Alberto Pepe added more stuff.tex  almost 10 years ago

Commit id: 6147b6f14b4bdb8e7a7f9e7e3a672bbe493bfea9

deletions | additions      

         

We produce an aggregate mood vector $m_d$ for the set of tweets submitted on a particular date $d$, denoted $T_d \subset T$ by simply averaging the mood vectors of the tweets submitted that day, i.e.  \[m_d = \frac{\sum_{\forall t \in T_d} \hat{m}}{||T_d||}\]  The time series of aggregated, daily mood vectors $m_d$ for a particular period of time $[i,i+k]$, denoted $\theta_{m_d}[i,k]$, is then defined as:  \[ \theta_{m_d}[i,k] = [ m_{i}, m_{i+1}, m_{i+2}, \cdots, m_{i+k}] \]  A different number of tweets is submitted on any given day. Each entry of $ \theta_{m_d}[i,k]$ is therefore derived from a different sample of $N_d = ||T_d||$ tweets. The probability that the terms extracted from the tweets submitted on any given day match the given number of POMS adjectives $N_p$ thus varies considerably along the binomial probability mass function:  \[P(K=n) = \left(\begin{array}{c}N_p\\||W(T_d)||\end{array}\right)p^{||W(T_d)||}(1-p)^{N_p-||W(T_d)||}\]  where $P(K=n)$ represents the probability of achieving $n$ number of POMS term matches, $||W(T_d)||$ represents the total number of terms extracted from the tweets submitted on day $d$ vs. $N_p$ the total number of POMS mood adjectives. Since the number of tweets per day has increased consistently from Twitter's inception in 2006 to present, this leads to systemic changes in the variance of $\theta_{m_d}[i,k]$ over time. In particular, the variance is larger in the early days of Twitter, when tweets are relatively scarce. As the number of tweets per day increases, the variance of the time series decreases. This effect makes it problematic to compare changes in the mood vectors of $\theta[i,k]$ over time.