Journal of Climate Research

Journal of Climate Research

Evaluation of the capability of ERA5 and AgMERRA to simulate long-term air temperature and solar radiation over the Khorasan Provinces, Iran

Document Type : Original Article

Authors
1 M.Sc. Student in Agroecology, Faculty of Agriculture, Ferdowsi University of Mashhad
2 Professor, Department of Agrotechnology, Faculty of Agriculture, Ferdowsi University of Mashhad
3 Ph.D. in Agroecology, Faculty of Agriculture, Ferdowsi University of Mashhad
10.22034/jcr.2026.505340.1683
Abstract
Introduction

Understanding climate change and its impacts on agriculture requires access to long and reliable daily weather records. For robust estimation of crop yield levels and variability, daily climate data over at least 10–20 years are needed. Reanalysis datasets, which combine observations with numerical weather prediction models, have therefore become key inputs for agro-climatic applications, including climate change assessment, water-resource management and crop modelling. Products such as ERA5, MERRA-2, NCEP/NCAR and the agriculture-oriented AgMERRA provide spatially continuous information on temperature, solar radiation and other variables, and have been successfully used to drive models such as DSSAT and WOFOST in different regions. Previous studies generally report good performance of ERA5 and AgMERRA for temperature and, to a lesser extent, for solar radiation, although biases and spatial heterogeneity in skill are frequently noted. In Iran, and particularly in the three Khorasan provinces in the north-east, the evaluation and use of both datasets remain limited despite their potential to support climate-change impact assessment and agricultural planning. The study therefore aims not to prove the superiority of one product over the other, but to provide an unbiased assessment of the performance and practical usability of both for daily temperature and solar radiation in this data-sparse region.



Materials and Methods

The study area comprises the three Khorasan provinces in north-eastern Iran, extending from 30°50′ to 38°30′N and 55°35′ to 61°25′E, with an area of about 294,000 km² (Fig. 1). Daily data from 42 synoptic stations (Table 2) were used, including minimum, maximum and mean air temperature and incoming solar radiation. Gridded reanalysis data were obtained in NetCDF format from ERA5 and AgMERRA (Table 1). ERA5 provides hourly temperature and radiation at 0.25° spatial resolution for 1940–2022, while AgMERRA provides daily data at 0.5° resolution for 1980–2010; ERA5 data were aggregated to daily values. Because the evaluation periods differ but partly overlap, direct comparison of skill metrics is only approximate and long-term analysis focuses on ERA5. For each station, the nearest grid cell was extracted in R and daily reanalysis values were compared with observations. Performance was assessed using Pearson’s correlation coefficient (r), root mean square error (RMSE), normalized RMSE (NRMSE, %), mean bias error (MBE) and Willmott’s index of agreement (d). For solar radiation, both reanalysis products were first evaluated against pyranometer measurements at stations with sufficiently long records. In a second step, ERA5 and AgMERRA were compared with daily radiation estimated from the Angström–Prescott relationship at nine synoptic stations in Razavi Khorasan. This two-stage approach was adopted because direct radiation measurements are sparse in the region and Angström–Prescott estimates are widely used as a surrogate in data-scarce agro-climatic studies.



Results and Discussion

Daily minimum temperature (tmin) was generally well reproduced by both reanalysis products. Across the 42 stations, ERA5 showed r mostly around 0.96–0.98 (mean ≈0.97) and AgMERRA around 0.92–0.96 (mean ≈0.94). The index of agreement d was high for both datasets (mean ≈0.98 for ERA5 and 0.95 for AgMERRA). However, NRMSE for tmin in ERA5 was typically about 4–9% (mean ≈5%), compared with roughly 5–13% (mean ≈7%) for AgMERRA, and both products exhibited a predominantly cold bias. In ERA5, most stations showed MBE close to zero or down to about −2 to −3 °C, whereas in AgMERRA some stations underestimated tmin by about 3–5 °C, which can be critical for frost-related applications. For daily maximum temperature (tmax), performance was even more robust. In almost all stations, r was close to 0.98–1.00 in ERA5 and about 0.97–0.98 in AgMERRA, with d generally above 0.97 in both datasets. Relative errors were mostly within 3–7% for ERA5 and about 4–9% for AgMERRA. Despite this high skill, both products tended to underestimate tmax by roughly 1–4 °C at many stations, while a few sites showed mild warm biases. Mean daily temperature (tm) also showed very high correlations (r >0.98 for ERA5 and >0.97 for AgMERRA), but NRMSE reached about 3–9% in ERA5 and 3–16% in AgMERRA, with larger relative errors at some northern and southern stations. Bias in tm was again predominantly negative, implying that degree-day indices derived from these data may be underestimated if no bias correction is applied. From a climatic perspective, the spatial pattern of skill is consistent with the geography of the Khorasan region. In open, relatively homogeneous plains, where temperature variability is mainly controlled by large-scale synoptic systems and regional temperature gradients, both datasets—especially ERA5—reproduce daily temperatures with high r, low NRMSE and limited bias. In contrast, in mountainous areas, valley margins and desert fringes, complex topography, strong nocturnal radiative cooling and large diurnal ranges increase the discrepancy between point measurements and grid-cell means, particularly for tmin and tm. This reflects the limited spatial resolution and inherent smoothing of reanalysis fields and explains why some stations in northern highlands and southern arid zones show larger cold biases and relative errors. These temperature results are broadly consistent with previous evaluations of AgMERRA in North and Razavi Khorasan and with recent national-scale assessments indicating that ERA5 generally provides the most accurate air-temperature estimates over Iran, with larger errors in complex mountain and coastal regions. Considering the longer evaluation period for ERA5 compared with AgMERRA, direct comparison of skill metrics remains approximate. Nevertheless, the combined evidence indicates that both datasets offer acceptable accuracy for daily tmin, tmax and tm at station scale in the three Khorasan provinces, and that statistical bias correction can further enhance their suitability for climate, hydrological and agricultural impact studies.



Conclusion

This study showed that both datasets reproduce daily tmin, tmax and tm over the three Khorasan provinces with high correlations and generally small relative errors, although a cold bias remains at some mountainous and desert stations and for tmin and tm. For solar radiation, ERA5 performs acceptably at most sites, whereas AgMERRA has more limited spatial coverage and a tendency to underestimate. Considering its longer temporal coverage, finer spatial resolution and ongoing updates, ERA5 emerges as the preferred dataset for long-term climate, water and agricultural applications in the region, while both products should ideally be used with local bias correction.
Keywords

1.     Fallah Ghalhari, Q., and Shakeri, F. (2016). Calibration of Angstrom- Prescott Coefficients for Selected Stations of Khorasan-e Razavi Province. Water and Soil Science, 26(3-2), 229-241. (In Persian with English Summary)
2.     Farhadi, M., Jahan, M. and Bannayan Aval, M. (2021). Investigation of Validity and Possibility of using AgMERRA Networked Dataset in North Khorasan Province. Iranian Journal of Field Crops Research, 19(2), 201-217. https://doi.org/10.22067/jcesc.2021.69532. 1044.
3.     Freitas, A. A. d., Carvalho, V. S. B., and Reboita, M. S. (2024). Extreme precipitation events during the wet season of the South America monsoon: A historical analysis over three major Brazilian watersheds. Climate, 12(11), 188. https://doi.org/10.3390/cli12110188.
4.     Grassini, P., van Bussel, L. G. J., Van Wart, J., Wolf, J., Claessens, L., Yang, H., Boogaard, H., de Groot, H., van Ittersum, M. K. and Cassman, K. G. (2015). How good is good enough? Data requirements for reliable crop yield simulations and yield-gap analysis. Field Crops Res., 177, 49-63. https://doi.org/10.1016/j.fcr.2015.03.004
5.     Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M.,…Jean-Noël, T. (2020). The ERA5 global reanalysis. Q. J. R. Meteorol. Soc., 146(730), 1999-2049. https://doi.org/10.1002/qj.3803.
6.     Heydari, A., Zarrin, A. and Dadashi-Roudbari, A. (2023). Investigating the performance of the deterministic and probabilistic versions (multi-member ensemble) of the ERA5 dataset in estimating Iran's temperature. Researches in Earth Sciences, 14(4), 1-20. https://doi.org/10.48308/esrj.2023.103874.
7.     Iizumi, T., Takimoto, T., Masaki, Y., Maruyama, A., Kayaba, N., Takaya, Y. and Masutomi, Y. (2024). A hybrid reanalysis-forecast meteorological forcing data for advancing climate adaptation in agriculture. Sci. Data, 11(1), 849. https://doi.org/10.1038/s41597-024-03702-5
8.     Javanshiri, Z. , Asadi Oskouei, E. , Flamarzi, Y. and Abasi, F. (2023). Accuracy assessment of CFS-v2, MERRA-2, ERA-5 temperature over the different regions of Iran. Iranian Journal of Geophysics, 17(4), 1-24. https://doi.org/10.30499/ijg.2022.360882.1452 (In Persian with English Summary)
9.     Kalnay, E., Kanamitsu, M., Kistler, R., Collins, W., Deaven, D., Gandin, L., Iredell, M., Saha, S., White, G., Woollen, J., Zhu, Y., Leetmaa, A., Reynolds, R., Chelliah, M., Ebisuzaki, W., Higgins, W., Janowiak, J., Mo, K. C., Ropelewski, C.,…Joseph, D. (1996). The NCEP/NCAR 40-year reanalysis project. Bull. Am. Meteorol. Soc., 77(3), 437-471. https://doi.org/10.1175/1520-0477(1996)077%3C0437:TNYRP%3E2.0.CO;2
10. Kamali, S., Ghahreman, N. and Bannayan, M. (2025). Evaluation of quantile mapping correction methods on AgMERRA and ERA5 precipitation and air temperature reanalysis data in Khorasan Razavi Province. Journal of Agricultural Meteorology, 13(1), 3-21. https://doi.org/10.22125/agmj.2025.481865.1175 .
11. Karami, R. and SalmanMahiny, A. (2022). Applicability Assessment of AgMERRA Database in time of data scarcity in Synoptic Stations of Sistan Plain. Climate Change Research, 3(9), 71-86. https://doi.org/10.30488/ccr.2022.337827.1076.
12.  Katsekpor, J. T., Greve, K., Yamba, E. I. and Amoah, E. G. (2024). Comparative analysis of satellite and reanalysis data with ground‐based observations in Northern Ghana. Meteorol. Appl., 31(4). https://doi.org/10.1002/met.2226
13.   Khansalari, S., Kordjazi, M., Majidi, O., Mollaarazi, A. and Saadatabadi, A. (2023). Searching suitable areas for installing solar panels in Golestan province using observation, ERA5 and GEOS-5 data. Iranian Journal of Geophysics, 17(1), 163-184. https://doi.org/10.30499/ijg.2022.341806.1425.
14. Kim, M., and Lee, E. (2022). Validation and comparison of climate reanalysis data in the East Asian monsoon region. Atmosphere (Basel), 13(10), 1589. https://doi.org/10.3390/atmos13101589
15.  Koohi, S., Bahmanabadi, B., Partovi, Z., Safari, F., Khajevand Sas, M. and Etedali, R. (2023). Evaluation of ERA5 Reanalysis Dataset for Simulation of Climatic Variables and Water Harvesting from Humidity (Case Study: Qazvin Province). jwss, 27(4), 153-167. http://dx.doi.org/10.47176/jwss.27.4.50623
16. Lashkari, A., Bannayan Aval, M., Koocheki, A., Alizadeh, A., Choi, Y. S. and Park, S. (2016). Applicability of AgMERRA forcing dataset forgap-filling of in-situ meteorological observation, Case Study: Mashhad Plain. Water and Soil, 29(6), 1749-1758. https://doi.org/10.22067/jsw.v29i6.41686
17. Lobell, D. B., Schlenker, W. and Costa-Roberts, J. (2011). Climate trends and global crop production since 1980. Science, 333(6042), 616-620. https://doi.org/10.1126/science.1204531
18.   Mohammadi, M. and Forozanfard, M. (2024). Evaluating ERA5 Reanalysis for Climate Trend Analysis in Sistan and Baluchestan, Iran. Climate Change Research, 5(19), 37-54. https://doi.org/10.30488/ccr.2024.458748.1218.
19. Mohammadi Ghaleni, M. and Sharafi, S. (2022). Evaluation of CRU TS4.05 and ERA5 Datasets Accuracy to Precipitation, Temperature and Potential Evapotranspiration in Different Climates across Iran. Iranian Journal of Irrigation & Drainage, 16(5), 879-890.
20. Rahimi, H., Asgari, J. and Nafisi, V. (2023). The effect of data sources on calculating mean temperature and integrated water vapor in Iran. Meteorological Applications, 30(6), e2167. https://doi.org/10.1002/met.2167
21.  Rolle, M., Tamea, S. and Claps, P. (2022). Climate-driven trends in agricultural water requirement: an ERA5-based assessment at daily scale over 50 years. Environ. Res. Lett., 17(4), 044017. https://doi.org/10.1088/1748-9326/ac57e4.
22.   Ruane, A. C., Goldberg, R. and Chryssanthacopoulos, J. (2015). Climate forcing datasets for agricultural modeling: Merged products for gap-filling and historical climate series estimation. Agric. For. Meteorol., 200, 233-248. https://doi.org/10.1016/j.agrformet.2014.09.016
23. Sianturi, Y., Marjuki, & Sartika, K. (2020, 2020). Evaluation of ERA5 and MERRA2 reanalyses to estimate solar irradiance using ground observations over Indonesia region international energy conference astechnova 2019. 
24. Sianturi, Y., Marjuki and Sartika, K. (2020). Evaluation of ERA5 and MERRA2 reanalyses to estimate solar irradiance using ground observations over Indonesia region. AIP Conference Proceedings. 2223. 020002. https://doi.org/10.1063/5.0000854.
25. Trenberth, K. E., Dai, A., van der Schrier, G., Jones, P. D., Barichivich, J., Briffa, K. R. and Sheffield, J. (2014). Global warming and changes in drought. Nat. Clim. Chang., 4(1), 17-22. https://doi.org/10.1038/nclimate2067
26.  van den Hurk, B., Kim, H., Krinner, G., Seneviratne, S. I., Derksen, C., Oki, T., Douville, H., Colin, J., Ducharne, A., Cheruy, F., Viovy, N., Puma, M. J., Wada, Y., Li, W., Jia, B., Alessandri, A., Lawrence, D. M., Weedon, G. P., Ellis, R.,…Sheffield, J. (2016). LS3MIP (v1.0) contribution to CMIP6: the Land Surface, Snow and Soil moisture Model Intercomparison Project – aims, setup and expected outcome. Geosci. Model Dev., 9(8), 2809-2832. https://doi.org/10.5194/gmd-9-2809-2016
27. van Ittersum, M. K., Cassman, K. G., Grassini, P., Wolf, J., Tittonell, P. and Hochman, Z. (2013). Yield gap analysis with local to global relevance—A review. Field Crops Res., 143, 4-17. https://doi.org/10.1016/j.fcr.2012.09.009
28. Van Wart, J., Grassini, P., Yang, H., Claessens, L., Jarvis, A. and Cassman, K. G. (2015). Creating long-term weather data from thin air for crop simulation modeling. Agric. For. Meteorol., 209-210, 49-58. https://doi.org/10.1016/j.agrformet.2015.02.020
29. van Wart, J., Kersebaum, K. C., Peng, S., Milner, M. and Cassman, K. G. (2013). Estimating crop yield potential at regional to national scales. Field Crops Res., 143, 34-43. https://doi.org/10.1016/j.fcr.2012.11.018
30.   Viggiano, M., Busetto, L., Cimini, D., Di Paola, F., Geraldi, E., Ranghetti, L., Ricciardelli, E. and Romano, F. (2019). A new spatial modeling and interpolation approach for high-resolution temperature maps combining reanalysis data and ground measurements. Agric. For. Meteorol., 276-277(107590), 107590. https://doi.org/10.1016/j.agrformet.2019.05.021
31. White, J. W., Hoogenboom, G., Kimball, B. A. and Wall, G. W. (2011). Methodologies for simulating impacts of climate change on crop production. Field Crops Res., 124(3), 357-368. https://doi.org/10.1016/j.fcr.2011.07.001
 
32. Yaghoubi, F., Bannayan Aval, M. and Asadi, G. A. (2018). Evaluation of Grided AgMERRA Weather Data for Simulation of Water Requirement and Yield of Rainfed Wheat in Khorasan Razavi Province. Water and Soil, 32(2), 415-431. https://doi.org/10.22067/jsw.v32i2.68948
33.  Yeşilköy, S. and Demir, I. (2024). Crop yield prediction based on reanalysis and crop phenology data in the agroclimatic zones. Theor. Appl. Climatol., 155(7), 7035-7048. https://doi.org/10.1007/s00704-024-05046-x
34.   Yilmaz, M. (2023). Accuracy assessment of temperature trends from ERA5 and ERA5-Land. Sci. Total Environ., 856(Pt 2), 159182. https://doi.org/10.1016/j.scitotenv.2022.159182
Zhang, R., Li, L., Zhang, Y., Huang, F., Li, J., Liu, W., Mao, T., Xiong, Z. and Shangguan, W. (2021). Assessment of agricultural drought using soil water deficit index based on ERA5-Land soil moisture data in four southern provinces of China. Agriculture, 11(5), 411. https://doi.org/10.3390/agriculture11050411.