<p>I guess I will provide a basic answer for now, since I somewhat figured this out, and hopefully either someone posts a more complete answer, or I add more to this later.</p>

<p>Basically, we can use forward or backward iteration. For example, for forward iteration (given that we know the value of $V_1$ at $t=0$, call it $V_{initial}$), then we can use this to find the value of $V$ at time $t$ simply by using the equation over and over again. Or we can work backwards, if for some reason forward iteration doesn't work (at this moment I'm not sure why/how this is different then forward). I don't think the solution is too neat, but it works.</p>

<p>Or, if we are at a steady state, then $V_1(K,I_{-1}) = V_1(K'_I)$, so we can simply rearrange the equation and solve.</p>

<p>Again, this isn't a great answer, but it is correct.</p>

CC BY-SA 3.0
2015-12-06T22:24:33.647Z
2015-12-06T22:24:33.647Z
majmun
<p>What I mean by the title is often, if we have a value function like
$$V(K,I) = \max_{K',I'} F(K') +\beta V(K',I')$$
the First order conditions will give us something that depends on the derivative of the value function, say $V_1(K',I')$. We deal with this by using the B-S condition to find $V_1(K,I)$, then advance it one period?</p>

<p>What about when $V_1(K,I)$ still depends on $V_1(K',I')$, though? (see $(*)$ below for an example, if you wish to skip the setup)</p>

<p>Here is an example. Note that subscripts denote derivatives, the number in the subscript being the input with respect to which we are taking the derivative. <strong>The exception to this is</strong> negative subscripts, such as $I_{-1}$, where the subscript denotes being one period in the past (in the case of $-1$). A prime denotes being one period in the future (t+1), and two primes denotes being two periods in the future.</p>

<p>Back to the problem: We have value function
$$V(K,I_{-1}) = \max_{I,K'',C}u(C) + \beta V(K',I) \\
\text{ s.t. } C+I \leq f(K) \\
\text{ and  } I =K'' - (1-\delta)K'
$$
So basically we have a simple model with investment that takes two periods to build. $f(K)$ is our production function.</p>

<p>The FOC's give
$$
u_1(c) = \lambda_1 \text{, $\lambda_1$ is the multiplier on the first constraint }\\ 
\lambda_2 = 0 \text{ multiplier on second constraint is zero} \\
\beta V_2(K',I) = -\lambda_1
$$
Now to get $V_2$ we use the B-S condition, which gives
$$V_2(K,I_{-1}) = \beta V_1(K',I)$$
because $K' = I_{-1} + (1-\delta)K$ from the second constraint. Use the BS condition again and get
$$V_1(K,I_{-1}) =f_1(K) + (1-\delta)V_1(K',I) \tag{*}$$, again, because $K' = I_{-1} + (1-\delta)K$</p>

<p><strong>The previous equation is my question</strong> To reiterate, we use B-S condition to find the derivative of the value function, but in $(*)$ the B-S condition depends on what we are trying to find. How do we handle this?</p>

<p>I feel like $V_1(K'I)$ may just be $1$, or $0$, but then that makes $V_2$ be $\beta$ or $0$, which seems wrong...</p>

CC BY-SA 3.0
2015-12-04T19:32:42.630Z
What do the primes used in the notation for capital and investment mean?
Alecos Papadopoulos
CC BY-SA 3.0
2015-12-04T19:37:46.533Z
Primes indicate variables from one period ahead. They are used to eliminate the time subscripts, so $K$ is really $K_t$, and $K'$ is $K_{t+1}$. And therefore $K''$ is thus two periods ahead. That is, $K'' = K_{t+2}$
majmun
CC BY-SA 3.0
2015-12-04T19:45:15.640Z
You use primes in order to indicate also a derivative, and you use a different subscript notation to denote lagged investment ( I guess because "negative prime" would be even stranger a symbol). This makes the lot confusing. Why do you wish to avoid, time subscripts?
Alecos Papadopoulos
CC BY-SA 3.0
2015-12-04T19:47:42.587Z
The only place prime is used to indicate derivative is the derivative of $u$, which I will edit so that is no longer the case. There is no good reason to avoid time subscripts, it is simply how these problems are usually written, I believe. I guess it indicates the stationarity of the problem, which is important for knowing a solution exists. 

We are a bit off topic though; I'm just curious how the handle the B-S condition that arises in this problem.
majmun
CC BY-SA 3.0
2015-12-04T19:53:47.047Z
For my point of view, in order to be on-topic I have to understand what the topic is in the first place. Unfamiliar notation gets in the way (this is not how I am used to see these problems written), so I try first to clarify that so that I can see whether I have anything useful to offer.
Alecos Papadopoulos
<macroeconomics><dynamic-programming><bellman-equations>
Benveniste-Scheinkman condition gives derivative that still depends on the value function
majmun
# Benveniste-Scheinkman condition gives derivative that still depends on the value function

(Asked by: username_0 on 2015-12-04)

What I mean by the title is often, if we have a value function like
$$V(K,I) = \max\_{K',I'} F(K') +\beta V(K',I')$$
the First order conditions will give us something that depends on the derivative of the value function, say $V\_1(K',I')$. We deal with this by using the B-S condition to find $V\_1(K,I)$, then advance it one period?

What about when $V\_1(K,I)$ still depends on $V\_1(K',I')$, though? (see $(\*)$ below for an example, if you wish to skip the setup)

Here is an example. Note that subscripts denote derivatives, the number in the subscript being the input with respect to which we are taking the derivative. **The exception to this is** negative subscripts, such as $I\_{-1}$, where the subscript denotes being one period in the past (in the case of $-1$). A prime denotes being one period in the future (t+1), and two primes denotes being two periods in the future.

Back to the problem: We have value function
$$V(K,I\_{-1}) = \max\_{I,K'',C}u(C) + \beta V(K',I) \\
\text{ s.t. } C+I \leq f(K) \\
\text{ and } I =K'' - (1-\delta)K'
$$
So basically we have a simple model with investment that takes two periods to build. $f(K)$ is our production function.

The FOC's give
$$
u\_1(c) = \lambda\_1 \text{, $\lambda\_1$ is the multiplier on the first constraint }\\
\lambda\_2 = 0 \text{ multiplier on second constraint is zero} \\
\beta V\_2(K',I) = -\lambda\_1
$$
Now to get $V\_2$ we use the B-S condition, which gives
$$V\_2(K,I\_{-1}) = \beta V\_1(K',I)$$
because $K' = I\_{-1} + (1-\delta)K$ from the second constraint. Use the BS condition again and get
$$V\_1(K,I\_{-1}) =f\_1(K) + (1-\delta)V\_1(K',I) \tag{\*}$$, again, because $K' = I\_{-1} + (1-\delta)K$

**The previous equation is my question** To reiterate, we use B-S condition to find the derivative of the value function, but in $(\*)$ the B-S condition depends on what we are trying to find. How do we handle this?

I feel like $V\_1(K'I)$ may just be $1$, or $0$, but then that makes $V\_2$ be $\beta$ or $0$, which seems wrong...

**Tags:** macroeconomics, dynamic-programming, bellman-equations

> **Comments:**
> **username_1**: What do the primes used in the notation for capital and investment mean?  
> **username_0**: Primes indicate variables from one period ahead. They are used to eliminate the time subscripts, so $K$ is really $K_t$, and $K'$ is $K_{t+1}$. And therefore $K''$ is thus two periods ahead. That is, $K'' = K_{t+2}$  
> **username_1**: You use primes in order to indicate also a derivative, and you use a different subscript notation to denote lagged investment ( I guess because "negative prime" would be even stranger a symbol). This makes the lot confusing. Why do you wish to avoid, time subscripts?  
> **username_0**: The only place prime is used to indicate derivative is the derivative of $u$, which I will edit so that is no longer the case. There is no good reason to avoid time subscripts, it is simply how these problems are usually written, I believe. I guess it indicates the stationarity of the problem, which is important for knowing a solution exists.   We are a bit off topic though; I'm just curious how the handle the B-S condition that arises in this problem.  
> **username_1**: For my point of view, in order to be on-topic I have to understand what the topic is in the first place. Unfamiliar notation gets in the way (this is not how I am used to see these problems written), so I try first to clarify that so that I can see whether I have anything useful to offer.  

---

## 1 answers

### Answer by username_0 on 2015-12-06. Score: 0 | Accepted answer

I guess I will provide a basic answer for now, since I somewhat figured this out, and hopefully either someone posts a more complete answer, or I add more to this later.

Basically, we can use forward or backward iteration. For example, for forward iteration (given that we know the value of $V\_1$ at $t=0$, call it $V\_{initial}$), then we can use this to find the value of $V$ at time $t$ simply by using the equation over and over again. Or we can work backwards, if for some reason forward iteration doesn't work (at this moment I'm not sure why/how this is different then forward). I don't think the solution is too neat, but it works.

Or, if we are at a steady state, then $V\_1(K,I\_{-1}) = V\_1(K'\_I)$, so we can simply rearrange the equation and solve.

Again, this isn't a great answer, but it is correct.


---

