<ol>
<li><p>The first assumption <span class="math-container">$E(y|x)=\beta_1+\beta_2 x$</span> identifies <span class="math-container">$\beta_2$</span>. The roles of the rest are limited (if not nil) in terms of the identification of <span class="math-container">$\beta_2$</span> (identification = answer to the question 'what is <span class="math-container">$\beta_2$</span>?').</p>
</li>
<li><p>Assumptions other than the first are all &quot;if&quot;s. They are useful for finding properties of OLS estimators, e.g., Gauss-Markov theorem, variance, efficiency, etc.</p>
</li>
<li><p>The third assumption should be written as <span class="math-container">$cov(y_i,y_j | x_1, \ldots, x_n)=0$</span> for <span class="math-container">$i\ne j$</span>. Unconditionally, <span class="math-container">$cov(y_i,y_j)$</span> does not have to be zero. (If <span class="math-container">$x_i$</span> and <span class="math-container">$x_j$</span> are correlated, then <span class="math-container">$y_i$</span> and <span class="math-container">$y_j$</span> can be correlated.) But under the fourth assumption (nonrandomness), <span class="math-container">$cov(y_i,y_j)=0$</span> is equivalent to <span class="math-container">$cov(y_i,y_j | x_1, \ldots, x_n)=0$</span>.</p>
</li>
<li><p>The fourth assumption is usually not well understood by beginners. It sometimes helps to state that <span class="math-container">$x_1$</span> is nonrandom, <span class="math-container">$x_2$</span> is nonrandom, and so on (instead of <span class="math-container">$x$</span> being nonrandom) in the context of repeated samples.</p>
</li>
<li><p><strong>To the no autocorrelation assumption</strong>, it is usually regarded as sensible and acceptable to assume that individuals are independent each other. But it does not mean that it is true. Then what happens if it is violated? In fact, that's the question you want to ask, not why.</p>
</li>
<li><p>If you are doubt about the assumptions, the question goes this way: What happens to OLS and what should we do if the normality assumption is violated; what happens to OLS and what should we do if the heteroskedasticity assumption is violated; what happens to OLS and what should we do if the no autocorrelation assumption is violated; what happens to OLS and what should we do if <span class="math-container">$x_1, \ldots, x_n$</span> are random; what happens to OLS and what should we do if <span class="math-container">$E(u|x)\ne 0$</span>?</p>
</li>
<li><p>So my answer to &quot;<strong>why no autocorrelation</strong>&quot; is: because it is a leading case and it is believed to be empirically relevant. And its violation does not necessarily mean the model is wrong. It only means that the unobserved determinants are correlated among individuals. The <span class="math-container">$\beta_2$</span> is  still the causal effect of <span class="math-container">$x$</span> on <span class="math-container">$y$</span>. The identification of <span class="math-container">$\beta_2$</span> is the very starting point. Don't let the tail wag the dog. (That said, someone might want to identify <span class="math-container">$\beta_2$</span> by the no autocorrelation condition. This is rather unusual. <span class="math-container">$\beta_2$</span> is usually identified by <span class="math-container">$E(y|x)=\beta_1+\beta_2 x$</span>.)</p>
</li>
<li><p>Related is, I don't think it is possible in general to completely account for autocorrelation by adding more <span class="math-container">$x$</span> variables. (For example, family members sharing the same experience but can this factor be sufficiently well observed?) More importantly, adding more variables to the right-hand side changes your model, by which you change the definition of your <span class="math-container">$\beta_2$</span>. Sometimes you can do it (e.g., randomized experiments) but in most cases your definition of <span class="math-container">$\beta_2$</span> changes by changing your model.</p>
</li>
<li><p>My answer pertains to econometrics that tries to find <strong>causal effects</strong>. There can be other areas of statistics that have different approaches.</p>
</li>
</ol>

CC BY-SA 4.0
2021-03-13T02:57:07.520Z
2021-03-13T02:57:07.520Z
chan1142
<p>I have started a book of econometrics and in the first pages are stated the assumption used in the linear regression model, which are :</p>
<img src="https://i.sstatic.net/4M2UX.png" width="450" height="350">
<p>The third one is the one I don't understand, why it has to be assumed? how can be verified if this assumption is not met? My professor explained it with an example : &quot;It is reasonable to say that the expenditure of a family with a certain income is independent of the one from another family with another income&quot;. What she says is okay to me, but it doesn't tell nothing about verifying the assumption when I have a set of datas, how can I have tuples of values in the case of the dependent variables <span class="math-container">$y_i$</span> and <span class="math-container">$y_j$</span> so that I can verify statistical independence or covariance equal <span class="math-container">$0$</span> ? Should I have the joint probability distribution of the variables? And why is it useful to assume one of these things, are not just the other assumptions sufficient? Any help is really appreciated.</p>

CC BY-SA 4.0
2021-03-12T15:29:01.773Z
Hi: I've never seen that assumption stated that way before but I'm pretty sure that it's equivalent to saying that the error terms and regressors ( the x ) are uncorrelated. This way of stating it makes more sense because it implies that the error terms are not carrying any information due to a some informative regressor being left out.
mark leeds
CC BY-SA 4.0
2021-03-12T16:11:45.857Z
Thanks a lot for the help mark, can you please elaborate a little more on your last sentence because I'm still a bit confused but I think your point is really important
Tortar
CC BY-SA 4.0
2021-03-12T16:28:18.730Z
The error from what I know should encapsulates the fact that there are other factors determining $y$ other than $x$, so if there were correlation between errors and regressors (which is to say $Cov(e,x)$ not zero, right?)  I found that there is a problem because random errors are not so random ( at least they could come from distribution with different variance I think) so we contraddict the second assumption. Am I right? This makes sense to me, still I don't see the equivalence with the assumption in my book, which is really unexplainable and 
unverifiable to me
Tortar
CC BY-SA 4.0
2021-03-12T22:31:09.667Z
Hi Tortar: I don't feel knowledgeable to explain it clearly or well but let me try to find a nice link where someone did and point you to that one. My point ( which was not clear ) is that, if there's another variable that matters that's not included in the regression and that variable is correlated with your used regressor, then your used regressor will be correlated with the error term. And I also think correlation of error term with used regressor should be the same assumption as correlation error term  with regressand. But let me see if I can find that link that explains it beautifully.
mark leeds
CC BY-SA 4.0
2021-03-12T22:50:23.700Z
Hi: Look at the answers of silverfish and matthew gunn at the link below. This wasn't the link that I was trying to find but I think it should do the trick. Note that it doesn't go into the way your error term assumption is written but, like I said, I think that yours is equivalent to the standard one ( error term not correlated with the  x predictors ). )https://stats.stackexchange.com/questions/263324/how-can-the-regression-error-term-ever-be-correlated-with-the-explanatory-variab/263327#263327
mark leeds
CC BY-SA 4.0
2021-03-12T23:58:06.487Z
thanks a lot mark, but I found surfing on the internet that the assumption of the image is equivalent to the one of nonautocorrelated errors which is not equivalent to the zero conditional mean error assumption : [link](https://www.google.com/url?sa=t&source=web&rct=j&url=http://qed.econ.queensu.ca/pub/faculty/abbott/econ351/351note01.pdf&ved=2ahUKEwiU0Zns8arvAhVN6aQKHVOSCvEQFjANegQIBxAC&usg=AOvVaw1oMD6NtIsLx2xWrmdu61CP)
Tortar
CC BY-SA 4.0
2021-03-14T00:19:25.873Z
ok. thanks for knowledge. the assumptions can be confusing because they are often written in different ways. If you have peter kennedy's  "a guide to econometrics", or can get a copy of it ,  he devotes a chapter to each and I remember it being well done.
mark leeds
<econometrics><regression><nonexpert>
Why is it assumed that covariance equal to $0$ or independence between $y$'s in the simple linear regression model?
Tortar
# Why is it assumed that covariance equal to $0$ or independence between $y$'s in the simple linear regression model?

(Asked by: username_0 on 2021-03-12)

I have started a book of econometrics and in the first pages are stated the assumption used in the linear regression model, which are :

![](https://i.sstatic.net/4M2UX.png)

The third one is the one I don't understand, why it has to be assumed? how can be verified if this assumption is not met? My professor explained it with an example : "It is reasonable to say that the expenditure of a family with a certain income is independent of the one from another family with another income". What she says is okay to me, but it doesn't tell nothing about verifying the assumption when I have a set of datas, how can I have tuples of values in the case of the dependent variables $y\_i$ and $y\_j$ so that I can verify statistical independence or covariance equal $0$ ? Should I have the joint probability distribution of the variables? And why is it useful to assume one of these things, are not just the other assumptions sufficient? Any help is really appreciated.

**Tags:** econometrics, regression, nonexpert

> **Comments:**
> **username_1**: Hi: I've never seen that assumption stated that way before but I'm pretty sure that it's equivalent to saying that the error terms and regressors ( the x ) are uncorrelated. This way of stating it makes more sense because it implies that the error terms are not carrying any information due to a some informative regressor being left out.  
> **username_0**: Thanks a lot for the help mark, can you please elaborate a little more on your last sentence because I'm still a bit confused but I think your point is really important  
> **username_0**: The error from what I know should encapsulates the fact that there are other factors determining $y$ other than $x$, so if there were correlation between errors and regressors (which is to say $Cov(e,x)$ not zero, right?)  I found that there is a problem because random errors are not so random ( at least they could come from distribution with different variance I think) so we contraddict the second assumption. Am I right? This makes sense to me, still I don't see the equivalence with the assumption in my book, which is really unexplainable and  unverifiable to me  
> **username_1**: Hi username_0: I don't feel knowledgeable to explain it clearly or well but let me try to find a nice link where someone did and point you to that one. My point ( which was not clear ) is that, if there's another variable that matters that's not included in the regression and that variable is correlated with your used regressor, then your used regressor will be correlated with the error term. And I also think correlation of error term with used regressor should be the same assumption as correlation error term  with regressand. But let me see if I can find that link that explains it beautifully.  
> **username_1**: Hi: Look at the answers of silverfish and matthew gunn at the link below. This wasn't the link that I was trying to find but I think it should do the trick. Note that it doesn't go into the way your error term assumption is written but, like I said, I think that yours is equivalent to the standard one ( error term not correlated with the  x predictors ). )https://stats.stackexchange.com/questions/263324/how-can-the-regression-error-term-ever-be-correlated-with-the-explanatory-variab/263327#263327  
> **username_0**: thanks a lot mark, but I found surfing on the internet that the assumption of the image is equivalent to the one of nonautocorrelated errors which is not equivalent to the zero conditional mean error assumption : [link](https://www.google.com/url?sa=t&source=web&rct=j&url=http://qed.econ.queensu.ca/pub/faculty/abbott/econ351/351note01.pdf&ved=2ahUKEwiU0Zns8arvAhVN6aQKHVOSCvEQFjANegQIBxAC&usg=AOvVaw1oMD6NtIsLx2xWrmdu61CP)  
> **username_1**: ok. thanks for knowledge. the assumptions can be confusing because they are often written in different ways. If you have peter kennedy's  "a guide to econometrics", or can get a copy of it ,  he devotes a chapter to each and I remember it being well done.  

---

## 1 answers

### Answer by username_2 on 2021-03-13. Score: 1

1. The first assumption $E(y|x)=\beta\_1+\beta\_2 x$ identifies $\beta\_2$. The roles of the rest are limited (if not nil) in terms of the identification of $\beta\_2$ (identification = answer to the question 'what is $\beta\_2$?').
2. Assumptions other than the first are all "if"s. They are useful for finding properties of OLS estimators, e.g., Gauss-Markov theorem, variance, efficiency, etc.
3. The third assumption should be written as $cov(y\_i,y\_j | x\_1, \ldots, x\_n)=0$ for $i\ne j$. Unconditionally, $cov(y\_i,y\_j)$ does not have to be zero. (If $x\_i$ and $x\_j$ are correlated, then $y\_i$ and $y\_j$ can be correlated.) But under the fourth assumption (nonrandomness), $cov(y\_i,y\_j)=0$ is equivalent to $cov(y\_i,y\_j | x\_1, \ldots, x\_n)=0$.
4. The fourth assumption is usually not well understood by beginners. It sometimes helps to state that $x\_1$ is nonrandom, $x\_2$ is nonrandom, and so on (instead of $x$ being nonrandom) in the context of repeated samples.
5. **To the no autocorrelation assumption**, it is usually regarded as sensible and acceptable to assume that individuals are independent each other. But it does not mean that it is true. Then what happens if it is violated? In fact, that's the question you want to ask, not why.
6. If you are doubt about the assumptions, the question goes this way: What happens to OLS and what should we do if the normality assumption is violated; what happens to OLS and what should we do if the heteroskedasticity assumption is violated; what happens to OLS and what should we do if the no autocorrelation assumption is violated; what happens to OLS and what should we do if $x\_1, \ldots, x\_n$ are random; what happens to OLS and what should we do if $E(u|x)\ne 0$?
7. So my answer to "**why no autocorrelation**" is: because it is a leading case and it is believed to be empirically relevant. And its violation does not necessarily mean the model is wrong. It only means that the unobserved determinants are correlated among individuals. The $\beta\_2$ is still the causal effect of $x$ on $y$. The identification of $\beta\_2$ is the very starting point. Don't let the tail wag the dog. (That said, someone might want to identify $\beta\_2$ by the no autocorrelation condition. This is rather unusual. $\beta\_2$ is usually identified by $E(y|x)=\beta\_1+\beta\_2 x$.)
8. Related is, I don't think it is possible in general to completely account for autocorrelation by adding more $x$ variables. (For example, family members sharing the same experience but can this factor be sufficiently well observed?) More importantly, adding more variables to the right-hand side changes your model, by which you change the definition of your $\beta\_2$. Sometimes you can do it (e.g., randomized experiments) but in most cases your definition of $\beta\_2$ changes by changing your model.
9. My answer pertains to econometrics that tries to find **causal effects**. There can be other areas of statistics that have different approaches.


---

