<p>In addition to the +1 Brian's answer there is actually a way how to you could get hour by hour data. You can create your own dataset with webscraping. </p>

<p>Most of the datasets in the Bilion Prices Project mentioned by Brian are created through webscraping  (See the details from Cavallo'spresentation on the project <a href="https://bfi.uchicago.edu/wp-content/uploads/Cavallo-1.pdf" rel="nofollow noreferrer">here</a>). The way how they are able to get their daily data is that they webscrape them from a websites of retailers that are considered to be representative. You can do the same thing as well with python and enough computing power. </p>

<p>For a small country with a relatively small number of retailers doing so would not be prohibitively expensive and could be done even with a relatively small team on a budget. Although note that prices probably dont fluctuate much on an intraday basis so you should take that into account before investing too much effort and resources into such solution.</p>

CC BY-SA 4.0
2020-06-15T18:44:23.653Z
In the absence of hyper inflation, it would seem that hour by hour/week by week/etc "inflation"  has no real macroeconomic meaning.
Michael
CC BY-SA 4.0
2020-06-15T18:49:24.447Z
@Michael I completely agree with you I do not necessarily think that doing this makes sense but who knows what kind of project the OP has in mind, the question just asked if it can be done so this would be a way of doing it. Whether it should be done is separate question and I completely agree as a macroeconomist that having data on such high frequency does not make much sense. Especially if other aggregates can’t be obtained at the same frequency. I can see use of the daily frequency for some univariate forecasting purposes though
1muflon1
CC BY-SA 4.0
2020-06-15T19:43:07.680Z
Do you have any ideas that would not be as computationally expensive?
Philogy
CC BY-SA 4.0
2020-06-15T19:48:36.060Z
@MrClottom i don’t think there is any other solution - although what I propose should not be outrageously computationally expensive. Some of my past colleagues are trying to copy the billion prices project for small EU country and they are all using their personal computers each focusing on different big online retailer and then they will add their data together. You will have more problems if you want to do it on hourly basis but I can’t think of any other way. Perhaps you could do it 4 times a day and then interpolate hourly data? I don’t expect that much interday variation in it so
1muflon1
CC BY-SA 4.0
2020-06-15T19:50:02.713Z
that could work reasonably well. Or just try to consider lowering the frequency in general. I don’t know for what purpose you need the data but as @Michael pointed out for most macroeconomic applications hourly inflation data will be meaningless
1muflon1
CC BY-SA 4.0
2020-06-16T05:20:36.097Z
@MrClottom I imagine prices are stable enough that you could have the scraper slowly, but continuously make it's way through a list of online retailers. If it can complete a pass in 1 week before starting over. That way you can balance computational cost, always having some fresh data and a comprehensive dataset
coagmano
CC BY-SA 4.0
2020-06-15T17:45:19.437Z
2020-06-15T18:01:03.087Z
2020-06-15T18:01:03.087Z
1muflon1
<p>The highest frequency real time data that I am aware of the Billion Prices Project, which is daily. <a href="http://www.thebillionpricesproject.com/" rel="noreferrer">Link to website.</a> These are prices on the internet, which can be mapped to the US CPI relatively well.</p>

<p>Otherwise, consumer prices in bricks and mortar stores are Generally not set “minute by minute,” nor is there a way to sample them at that frequency. </p>

<p>The closest you can get is countries in hyperinflation, where prices end up being indexed to a foreign currency. That is, the price paid is a fixed price in a foreign currency, multiplied by the exchange rate. This mechanism results in rapid changes, even during the time to drink a coffee (anecdote from the Weimar hyperinflation). Foreign exchange rates are the usual way of estimating a hyperinflation, since there is no good way to survey prices. </p>

CC BY-SA 4.0
2020-06-15T17:42:30.027Z
How does the billion project calculate these values?
Philogy
CC BY-SA 4.0
2020-06-15T18:34:24.977Z
They presumably have documents on their website?
Brian Romanchuk
CC BY-SA 4.0
2020-06-15T17:27:33.833Z
2020-06-15T17:27:33.833Z
Brian Romanchuk
<p>I'm looking to measure inflation in real time preferably minute to minute. What would be different feasible approaches to this? I know that the CPI measures inflation quite accurately but this is only on a month to month basis with the Bureau of Labour releasing their findings with a few month lag. The metric should be able to reflect a sudden inflationary spike like in the case of hyperinflation for example. Would much appreciate your help and thoughts!</p>

CC BY-SA 4.0
2020-06-16T07:09:59.697Z
What would you base your inflation numbers on? Most prices aren't updated minute to minute. Most prices aren't even updated daily. Hyperinflation is still quite visible in daily graphs, you don't need minute to minute date for this. Are you sure you're solving your *actual* problem?
Mast
<econometrics><inflation>
Best way to measure inflation in real time?
Philogy
# Best way to measure inflation in real time?

(Asked by: username_0 on 2020-06-15)

I'm looking to measure inflation in real time preferably minute to minute. What would be different feasible approaches to this? I know that the CPI measures inflation quite accurately but this is only on a month to month basis with the Bureau of Labour releasing their findings with a few month lag. The metric should be able to reflect a sudden inflationary spike like in the case of hyperinflation for example. Would much appreciate your help and thoughts!

**Tags:** econometrics, inflation

> **Comments:**
> **username_1**: What would you base your inflation numbers on? Most prices aren't updated minute to minute. Most prices aren't even updated daily. Hyperinflation is still quite visible in daily graphs, you don't need minute to minute date for this. Are you sure you're solving your *actual* problem?  

---

## 2 answers

### Answer by username_2 on 2020-06-15. Score: 2 | Accepted answer

In addition to the +1 Brian's answer there is actually a way how to you could get hour by hour data. You can create your own dataset with webscraping.

Most of the datasets in the Bilion Prices Project mentioned by Brian are created through webscraping (See the details from Cavallo'spresentation on the project [here](https://bfi.uchicago.edu/wp-content/uploads/Cavallo-1.pdf)). The way how they are able to get their daily data is that they webscrape them from a websites of retailers that are considered to be representative. You can do the same thing as well with python and enough computing power.

For a small country with a relatively small number of retailers doing so would not be prohibitively expensive and could be done even with a relatively small team on a budget. Although note that prices probably dont fluctuate much on an intraday basis so you should take that into account before investing too much effort and resources into such solution.

> **Comments:**
> **username_3**: In the absence of hyper inflation, it would seem that hour by hour/week by week/etc "inflation"  has no real macroeconomic meaning.  
> **username_2**: @username_3 I completely agree with you I do not necessarily think that doing this makes sense but who knows what kind of project the OP has in mind, the question just asked if it can be done so this would be a way of doing it. Whether it should be done is separate question and I completely agree as a macroeconomist that having data on such high frequency does not make much sense. Especially if other aggregates can’t be obtained at the same frequency. I can see use of the daily frequency for some univariate forecasting purposes though  
> **username_0**: Do you have any ideas that would not be as computationally expensive?  
> **username_2**: @MrClottom i don’t think there is any other solution - although what I propose should not be outrageously computationally expensive. Some of my past colleagues are trying to copy the billion prices project for small EU country and they are all using their personal computers each focusing on different big online retailer and then they will add their data together. You will have more problems if you want to do it on hourly basis but I can’t think of any other way. Perhaps you could do it 4 times a day and then interpolate hourly data? I don’t expect that much interday variation in it so  
> **username_2**: that could work reasonably well. Or just try to consider lowering the frequency in general. I don’t know for what purpose you need the data but as @username_3 pointed out for most macroeconomic applications hourly inflation data will be meaningless  
> **username_4**: @MrClottom I imagine prices are stable enough that you could have the scraper slowly, but continuously make it's way through a list of online retailers. If it can complete a pass in 1 week before starting over. That way you can balance computational cost, always having some fresh data and a comprehensive dataset  

---

### Answer by username_5 on 2020-06-15. Score: 5

The highest frequency real time data that I am aware of the Billion Prices Project, which is daily. [Link to website.](http://www.thebillionpricesproject.com/) These are prices on the internet, which can be mapped to the US CPI relatively well.

Otherwise, consumer prices in bricks and mortar stores are Generally not set “minute by minute,” nor is there a way to sample them at that frequency.

The closest you can get is countries in hyperinflation, where prices end up being indexed to a foreign currency. That is, the price paid is a fixed price in a foreign currency, multiplied by the exchange rate. This mechanism results in rapid changes, even during the time to drink a coffee (anecdote from the Weimar hyperinflation). Foreign exchange rates are the usual way of estimating a hyperinflation, since there is no good way to survey prices.

> **Comments:**
> **username_0**: How does the billion project calculate these values?  
> **username_5**: They presumably have documents on their website?  

---

