W05-1: Accuracy Assessment []

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== W05-1: Accuracy Assessment ======
At the end of each Land cover classification (or of each predictive modeling in general) must be an assessment of the accuracy of the model. Though you might have the feeling that the hardest part of the task is done, the accuracy assessment is actually a challenging and very important part of the process.

===== Things you need for this worksheet =====
  * {{section>en:resources:templates:tools#R environment&inline}}
  * {{section>en:resources:templates:tools#R studio&inline}}
  * [[en:courses:training:element-01:worksheets:lc-ws-04-2|W04-2: Land cover classification]]



===== Learning log assignments =====
In this worksheet we will assess the performance of our classification using an independent test dataset.

Eyeball verification of map-type figures generally gives a very good (first) impression. For a quantitative description however, a more “objective” index might be requested by others. Regarding classification accuracies, Cohen's Kappa index of agreement might likely be the most commonly used index (see e.g. [Kuhnert2005] for a short overview and calculation information). Although Kappa is certainly not a one fits all purposes index, we will start with this one for today.


:-\ Do a visual validation of your land cover map

:-\ Use the testing data set that you held back from the classification to statistically test the performance of the model on independent data.
  * Calculate the overall accuracy
  * Calculate the Kappa index