Submitted to: World Congress of Soil Science
Publication Type: Abstract only
Publication Acceptance Date: 2/21/2006
Publication Date: 7/9/2006
Citation: Nemes, A., Rawls, W.J., Pachepsky, Y.A., van Grenuchte, M.T. 2006. Use of the non-parametric nearest-neighbor appraoch to estimate soil hydraulic properties [abstract]. 18th ISSS World Congress of Soil Science Conference. Paper No. 119-3. Interpretive Summary:
Technical Abstract: Non-parametric approaches are being used in various fields to address classification type problems, as well as to estimate continuous variables. One type of the non-parametric lazy learning algorithms, a k-Nearest Neighbor (k-NN) algorithm has been applied to estimate water retention at –33 and –1500 kPa matric potentials. Performance of the algorithm has subsequently been tested against estimations made by a neural network (NNet) model, developed using the same data and input soil attributes. We used a hierarchical set of inputs using soil texture, bulk density and organic matter content to avoid possible bias towards one set of inputs, and varied the size of the data set used to develop the NNet models and to run the k-NN estimation algorithms. Different ‘design-parameter’ settings, analogous to model parameters have been optimized. The k-NN technique showed little sensitivity to potential sub-optimal settings in terms of how many nearest soils were selected and how those were weighed while formulating the output of the algorithm, as long as extremes were avoided. The optimal settings were, however, dependent on the size of the development/reference data set. The non-parametric k-NN technique performed mostly equally well with the NNet models, in terms of root-mean-squared residuals and mean residuals. Gradual reduction of the data set size from 1600 to 100 resulted in only a slight loss of accuracy for both the k-NN and NNet approaches. We also characterized the sensitivity of this technique to (1) estimations made to soils with differing distribution of properties; (2) the choice between different weighing methods; (3) the presence of outliers in the reference data set; (4) the un-equal weighing of input attributes; (5) the addition of new – locally specific – data to the reference data set; and (6) the influence of local data density. The k-NN technique is a competitive alternative to other techniques to develop pedotransfer functions (PTFs), especially since re-development of PTFs is not necessarily needed as new data become available.