Investigating the effectiveness of resampling algorithms in improving the classification of unbalanced data in digital soil mapping

Ebrahimi Meymand, Fatemeh; Ramezanpour, Hasan; Yaghmaeian, Nafiseh; Eftekhari, Kamran

doi:10.22059/jrwm.2023.354333.1692

Document Type : Research Paper

Authors

¹ Soil Science Department, College of Agriculture, University of Guilan, Rasht, Iran.

² Soil and Water Research Institute, Agriculture Research, Education and Extension Organization (AREEO), Karaj, Iran

10.22059/jrwm.2023.354333.1692

Abstract

In recent years, the use of digital soil mapping (DSM) based on machine learning algorithms with the aim of preparing soil maps has become widespread with the basis of soil class prediction with the help of modeling the relationships between them and environmental variables. One of this method's challenges is the imbalanced nature of soil distribution in landscape, which leads to overfitting and underfitting of classes, and as a result, reduces the accuracy of many used models. This study was conducted to evaluate the ability of two machine learning algorithms, including random forests and support vector machines, for the digital mapping of soil classes with an imbalanced data set. This study was conducted on 95 soil profile classes at the family level, in 4000 hectares of land in the Honam sub-basin, Lorestan province. The issue of imbalance in soil classes was investigated by using six data sets, including the original soil data set and five data sets created by several resampling approaches including two manual classifications and three over-sampling, under-sampling, and Synthetic Minority Over-Sampling Techniques in the R software. The results showed that despite the low values of overall accuracy, the Geographical distribution of soils with high frequency in the study area in digital soil map obtained from the random forest and the original data set as well as Synthetic Minority Over-Sampling Technique, with conventional soil map of study area is significant. Therefore, the low observation number of other soil classes and as a result incorrect training of models can be considered as one of the main reasons for the low accuracy of the used models.

Keywords

References

Abdi, L., & Hashemi, S. (2015). To combat multi-class imbalanced problems by means of over-sampling techniques. IEEE transactions on Knowledge and Data Engineering, 28(1), 238-251.

Adhikari, K., Minasny, B., Greve, M. B., & Greve, M. H. (2014). Constructing a soil class map of Denmark based on the FAO legend using digital techniques. Geoderma, 214, 101-113.

Bagheri Bodaghabadi, M., Martínez-Casasnovas, J. A., Esfandiarpour Borujeni, I., Salehi, M. H., Mohammadi, J., & Toomanian, N. (2016). Database extension for digital soil mapping using artificial neural networks. Arabian Journal of Geosciences, 9(18), 1-13.

Banai M.H. (1998). Soil thermal-moisture regimes map of Iran on 1:1,250,000 scales. Soil and Water Research Institute, Tehran. Iran. (In Persian)

Brungard, C. W., J. L. Boettinger, M. C. Duniway, S. A. Wills & T. C. Edwards. (2015). Machine learning for predicting soil classes in three semi-arid landscapes. Geoderma. 240: 68–83.

Chawla, N. V., K. W. Bowyer, L. O. Hall, & W. P. Kegelmeyer. (2002). “SMOTE: Synthetic Minority Over-Sampling Technique”. Journal of Artificial Intelligence Research, Vol. 16, pp. 321–357.

Congalton, R. 1991. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sensing Environmental, 37: 35–46.

Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017). Learning from class-imbalanced data: review of methods and applications. Expert Syst, Appl.73, 220–239.

Hengl, T. (2007). A Practical Guide to Geostatistical Mapping of Environmental Variables. EUR 22904 EN. Luxembourg (Luxembourg): Office for Official Publications of the European Communities. JRC38153.

Hengl, T., de Jesus, J.M., Heuvelink, G.B.M., Gonzalez, M.R., Kilibarda, M., Blagotić, A., Shangguan, W., Wright, M.N., Geng, X., Bauer-Marschallinger, B., Guevara, M.A., Vargas, R., MacMillan, R.A., Batjes, N.H., Leenaars, J.G.B., Ribeiro, E., Wheeler, I.,Mantel, S., & Kempen, B.(2017). SoilGrids250m: global gridded soil information based on machine learning. PLoS One, 12, e0169748.

Eftekhari, k. (2018). Detailed soil survey and land classification of Honam sub catchment, emphasizing on soil-landform relations. Soil and water reserch institute. Project No: 14-10-10-9201-92001-K9201. (In Persian)

Eftekhari, k. (2019). Discriminating of Geomorphic Surfaces in Honam Sub catchment as a Basis for Delineating Homogenous Land Areas, Using Landscape Analysis Techniques. Soil and water research institute. Project No: 14-10-10-9201-92002-K9201. (In Persian)

Jackson ML. (1973). Soil chemical analysis. New Delhi: Prentice Hall of India Pvt. Ltd.

Jafari A., Ayoubi S.H., Khademi H., Finke P.K., & Toomanian N. (2013). Selection of a taxonomic level for soil mapping using diversity and map purity indices: A case study from an Iranian arid region. Geomorphology, 201: 86-97.

Jasiewicz, J., & Stepinski, T. F. (2013). Geomorphons—a pattern recognition approach to classification and mapping of landforms. Geomorphology, 182, 147-156.

Kovačević, M., Bajat, B., & Gajić, B. (2010). Soil type classification and estimation of soil properties using support vector machines. Geoderma, 154(3-4), 340-347.

Ma, T., Brus, D. J., Zhu, A. X., Zhang, L., & Scholten, T. (2020). Comparison of conditioned Latin hypercube and feature space coverage sampling for predicting soil classes using simulation from soil maps. Geoderma, 370, 114366.

Martinez-Taboada, F., & Redondo, J. I. (2020). Variable importance plot (mean decrease accuracy and mean decrease Gini). Plos One, 15(4), e0230799.

Massawe, B. H., Subburayalu, S. K., Kaaya, A. K., Winowiecki, L., & Slater, B. K. (2018). Mapping numerically classified soil taxa in Kilombero Valley, Tanzania using machine learning. Geoderma, 311, 143-148.

McBratney, A. B., Santos, M. M., & Minasny, B. (2003). On digital soil mapping. Geoderma, 117(1-2), 3-52.

Minasny, B., & McBratney, A. B. (2016). Digital soil mapping: A brief history and some lessons. Geoderma, 264, 301-311.

Mirakzehi, M., Pahlavan-Rad, M. R., Shahriari, A, & Bameri, A. (2018). Digital soil mapping of deltaic soils: a case of study from Hirmand (Helmand) river delta, Geoderma, 313, 233–240.

Mosleh, Z., Salehi, M. H., Jafari, A., Borujeni, I. E., & Mehnatkesh, A. (2016). The effectiveness of digital soil mapping to predict soil properties over low-relief areas. Environmental monitoring and assessment, 188(3), 1-13.

Mousavi, S.R., Sarmadian, F & Rahmani, A. (2020). Modelling and Prediction of Soil Classes Using Boosting Regression Tree and Random Forests Machine Learning Algorithms in Some Part of Qazvin Plain. Iranian Journal of Soil and Water Research, 50(10), pp.2525-2538. (In Persian)

Nayal, A., Jomaa, H., & Awad, M. (2017). KerMinSVM for imbalanced datasets with a case study on arabic comics classification. Engineering Applications of Artificial Intelligence, 59, 159-169.

Nazari, S., Rostaminia, M., Ayoubi, S., Rahmani, A. & Mousavi, S.R. (2020). Efficiency of Different Feature Selection Methods in Digital Mapping of Subgroup and Soil Family Classes with Data Mining Algorithms. Journal of Water and Soil, 34(4,) 973-987. (In Persian)

Neyestani, M., Sarmadian, F., Jafari, A., Keshavarzi, A., & Sharififar, A. (2021). Digital mapping of soil classes using spatial extrapolation with imbalanced data. Geoderma Regional, 26, e00422.

pahlavan-Rad, M.R., Tomanian, N & Khormali, F (2016). Introduction to digital soil mapping. Land Management Journal, 4 (2), 97-114. (In Persian)

Pahlavan-Rad, M.R. & Akbari Moghaddam, A. R. (2018). Spatial variability of soil texture fractions and pH in a flood plain (a case study from eastern Iran), Catena, 160, 275–281.

Ramcharan, A., Hengl, T., Nauman, T., Brungard, C., Waltman, S., Wills, S., & Thompson, J. (2018). Soil property and class maps of the conterminous United States at 100‐meter spatial resolution. Soil Science Society of America Journal, 82(1), 186-201.

Sharififar, A., Sarmadian, F., Malone, B. P., & Minasny, B. (2019). Addressing the issue of digital mapping of soil classes with imbalanced class observations. Geoderma, 350, 84-92.

Soil Survey Staff. (2014). Keys to Soil Taxonomy. 12th Edition, USDA-Natural Resources Conservation Service, Washington DC.

Taghizadeh-Mehrjardi, R., K. Nabiollahi, B. Minasny & J. Triantafilis. (2015). Comparing data mining classifiers to predict spatial distribution of USDA-family soil groups in Baneh region, Iran. Geoderma, 253-254: 67–77

Thomas, G. W. (1996). Soil pH and Soil Acidity. In: Methods of Soil Analysis, Part 3. Chemical Methods, American Society of Agronomy, Inc. Madison, Wisconsin, USA. 475-491

Weston, J., & Watkins, C. (1998). Multi-class support vector machines (pp. 98-04). Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, May.

Zhu, B., Baesens, B., & vanden Broucke, S. K. (2017). An empirical comparison of techniques for the class imbalance problem in churn prediction. Information sciences, 408, 84-99.

Journal of Range and Watershed Managment

Investigating the effectiveness of resampling algorithms in improving the classification of unbalanced data in digital soil mapping

References

References

Volume 76, Issue 2
August 2023
Pages 159-176

Investigating the effectiveness of resampling algorithms in improving the classification of unbalanced data in digital soil mapping

References

References

Volume 76, Issue 2August 2023Pages 159-176

Volume 76, Issue 2
August 2023
Pages 159-176