<p>I don't know if ERA5 data has some weird format, as I'm really not familiar with working with such data directly.  But it's vital to realize that the greatest hourly temp is rarely the daily max, and the same idea with mins.  <a href="https://w1.weather.gov/data/obhistory/KMCO.html" rel="nofollow noreferrer">Orlando's</a> data today:
<a href="https://i.sstatic.net/h1OR9.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/h1OR9.png" alt="enter image description here" /></a></p>
<p>The max today was 87°F and the min 63°F (found from this using the 6 hour max\mins... there can be rare issues with this when those don't fall at midnight... station reports or metars give 24 hour max\min midnight to midnight... though it's only an issue when a max or min is near midnight, which is rare, typically only during airmass changes)</p>
<p>Whereas the top hourly was 86°F and the bottom one was 65°F.  And that's a fairly typical thing to occur... they only match when the extreme temperatures happen to occur near the end of the hour (values are typically taken about 7 minutes before the hour in the US, and I believe that standard varies a bit internationally)</p>
<p>So I'd certainly question any work that tried to derive daily actual max\min values or compare to them using such hourly results, unless it turns out ERA5 does something unique.  It's tough to imagine it's valid given it you only get one hourly value.</p>
<p>Precipitation measurements on the other hand are over a time period, so those values should be hourly values, and summing them should give the results for the day.</p>
<p>When it comes to temperature (assuming ERA5 isn't somehow strangely taking care of the discontinuity), you could try to apply some sort of rough multiplier to give a very crude better guess... but thinking you won't be able to get legitimate daily max\mins without looking for actual site data, which are for example available <a href="https://sercc.com/noaa-online-weather/" rel="nofollow noreferrer">here</a> for basic US historic or recent data searches, or at <a href="https://www.ncdc.noaa.gov/cdo-web/" rel="nofollow noreferrer">NCDC</a>.  Of course those are only going to work for places they have observation sites.  But it doesn't seem that you can directly compare the ERA5 maxima results to actual station maxima easily.</p>

CC BY-SA 4.0
2021-04-15T11:40:00.947Z
Hi Jeopardy, thanks for you kindly answer! Yes, you're right, I'll not be able to get the real max and min and I'm ok with that. Actually, I was wondering, since I not working with meterological data, if what I'm doing makes some sense or if I should do some calculations considering also the area coverage by the stations..
user9585960
CC BY-SA 4.0
2021-04-15T03:42:32.027Z
2021-04-15T03:42:32.027Z
JeopardyTempest
<p>Yes, daily minima, maxima and precipitation totals are calculated simply as you suggested in your question. Take care that there aren't missing values,, but that's more of an issue calculating means. Also check whether the reported values for precipitation are in fact a null value, it's unlikely that it could be measured in such small units.</p>

CC BY-SA 4.0
2021-04-15T03:44:22.367Z
There are by definition a lot of missing values when you're only taking hourly temperatures?
JeopardyTempest
CC BY-SA 4.0
2021-04-15T04:00:10.077Z
It may be the best you can do with ERA5 and other reanalysis tools.  Maybe a multiplier or some alternative formula may be able to better approximate a natural look.  But directly using these values should likely give diurnal ranges that are systematically a bit smaller than they are in reality.
JeopardyTempest
CC BY-SA 4.0
2021-04-14T20:16:57.767Z
2021-04-14T20:16:57.767Z
Andy M
<p>I starting a weather project where I'm using ERA5 hourly dataset (ref: <a href="https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=form" rel="nofollow noreferrer">https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=form</a>). Using this dataset in python, I have now a dataframe as below.</p>
<p>As you can see, for one State I have n observations considering latitude|longitude and Time of observation. So, now I would like to aggregate this dataset daily, considering Admin2 and Admin1, in order to have Max Temp, Min Temp and Total precipitation. Is there a right way to do this aggregation or is this simple the max / min values from 2m temp and sum of precipitation?
As you can see, by the content of my question, I'm not a meterologist. I'm just trying to build a reliable database for past historical weather data from some cities around the world.</p>
<p><a href="https://i.sstatic.net/hftyM.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/hftyM.jpg" alt="enter image description here" /></a></p>

CC BY-SA 4.0
2021-04-15T03:07:00.113Z
I don't know much about ERA5 values at all.  But normally max\min temperatures aren't the max\min hourly temperatures.  For instance today [Orlando's](https://w1.weather.gov/data/obhistory/KMCO.html) high today was 87 and low 63... but it's hourly max\min were 86 and 65.  This is a typical result, unless you happen to be at max\min on an hour.  So I'd certainly question results that extrapolate these hourlies into max\min and tried to use compare them to the actual max\mins.
JeopardyTempest
<temperature><data-analysis><database><era>
What is the correct way to report historical daily Max / Min / Avg Temperature by City?
user9585960
# What is the correct way to report historical daily Max / Min / Avg Temperature by City?

(Asked by: username_0 on 2021-04-14)

I starting a weather project where I'm using ERA5 hourly dataset (ref: <https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=form>). Using this dataset in python, I have now a dataframe as below.

As you can see, for one State I have n observations considering latitude|longitude and Time of observation. So, now I would like to aggregate this dataset daily, considering Admin2 and Admin1, in order to have Max Temp, Min Temp and Total precipitation. Is there a right way to do this aggregation or is this simple the max / min values from 2m temp and sum of precipitation?
As you can see, by the content of my question, I'm not a meterologist. I'm just trying to build a reliable database for past historical weather data from some cities around the world.

[![enter image description here](https://i.sstatic.net/hftyM.jpg)](https://i.sstatic.net/hftyM.jpg)

**Tags:** temperature, data-analysis, database, era

> **Comments:**
> **username_1**: I don't know much about ERA5 values at all.  But normally max\min temperatures aren't the max\min hourly temperatures.  For instance today [Orlando's](https://w1.weather.gov/data/obhistory/KMCO.html) high today was 87 and low 63... but it's hourly max\min were 86 and 65.  This is a typical result, unless you happen to be at max\min on an hour.  So I'd certainly question results that extrapolate these hourlies into max\min and tried to use compare them to the actual max\mins.  

---

## 2 answers

### Answer by username_1 on 2021-04-15. Score: 1 | Accepted answer

I don't know if ERA5 data has some weird format, as I'm really not familiar with working with such data directly. But it's vital to realize that the greatest hourly temp is rarely the daily max, and the same idea with mins. [Orlando's](https://w1.weather.gov/data/obhistory/KMCO.html) data today:
[![enter image description here](https://i.sstatic.net/h1OR9.png)](https://i.sstatic.net/h1OR9.png)

The max today was 87°F and the min 63°F (found from this using the 6 hour max\mins... there can be rare issues with this when those don't fall at midnight... station reports or metars give 24 hour max\min midnight to midnight... though it's only an issue when a max or min is near midnight, which is rare, typically only during airmass changes)

Whereas the top hourly was 86°F and the bottom one was 65°F. And that's a fairly typical thing to occur... they only match when the extreme temperatures happen to occur near the end of the hour (values are typically taken about 7 minutes before the hour in the US, and I believe that standard varies a bit internationally)

So I'd certainly question any work that tried to derive daily actual max\min values or compare to them using such hourly results, unless it turns out ERA5 does something unique. It's tough to imagine it's valid given it you only get one hourly value.

Precipitation measurements on the other hand are over a time period, so those values should be hourly values, and summing them should give the results for the day.

When it comes to temperature (assuming ERA5 isn't somehow strangely taking care of the discontinuity), you could try to apply some sort of rough multiplier to give a very crude better guess... but thinking you won't be able to get legitimate daily max\mins without looking for actual site data, which are for example available [here](https://sercc.com/noaa-online-weather/) for basic US historic or recent data searches, or at [NCDC](https://www.ncdc.noaa.gov/cdo-web/). Of course those are only going to work for places they have observation sites. But it doesn't seem that you can directly compare the ERA5 maxima results to actual station maxima easily.

> **Comments:**
> **username_0**: Hi Jeopardy, thanks for you kindly answer! Yes, you're right, I'll not be able to get the real max and min and I'm ok with that. Actually, I was wondering, since I not working with meterological data, if what I'm doing makes some sense or if I should do some calculations considering also the area coverage by the stations..  

---

### Answer by username_2 on 2021-04-14. Score: 1

Yes, daily minima, maxima and precipitation totals are calculated simply as you suggested in your question. Take care that there aren't missing values,, but that's more of an issue calculating means. Also check whether the reported values for precipitation are in fact a null value, it's unlikely that it could be measured in such small units.

> **Comments:**
> **username_1**: There are by definition a lot of missing values when you're only taking hourly temperatures?  
> **username_1**: It may be the best you can do with ERA5 and other reanalysis tools.  Maybe a multiplier or some alternative formula may be able to better approximate a natural look.  But directly using these values should likely give diurnal ranges that are systematically a bit smaller than they are in reality.  

---

