(Spatial) Block validation has so far not been added to the package given the complexities of assigning blocks to single or multiple datasets that might be specified in the model. Thus in most projects we usually implement the cross-validation externally, e.g. providing subsets of training data to individual ibis fits and then validate them externally. I still think outsourcing validation to the user makes the most sense.
However...., given that increasingly we have a range of projects that need to rely on this, we could brainstorm on how to best support this functionality within ibis.
I judge this as a relatively big overhaul if implemented well.
So possible implementation steps:
Thoughts?
(Spatial) Block validation has so far not been added to the package given the complexities of assigning blocks to single or multiple datasets that might be specified in the model. Thus in most projects we usually implement the cross-validation externally, e.g. providing subsets of training data to individual ibis fits and then validate them externally. I still think outsourcing validation to the user makes the most sense.
However...., given that increasingly we have a range of projects that need to rely on this, we could brainstorm on how to best support this functionality within ibis.
I judge this as a relatively big overhaul if implemented well.
So possible implementation steps:
cross_validate()(or another name?) opposed to justvalidate(). This function would need to store the method and blocks somehow in theBiodiversityDistribution-classobject so that it can be queried from within the object.BiodiversityDistribution-classobject and also in the resulting object with the fits.Thoughts?