Collectively designed standard protocol for coding CES from crowdsourced data. It includes the following files and a video tutorial to facilitate its implementation by other researchers:
- Protocol.doc: a document with the general instructions on the procedure for coding;
- Annex 1. CES coding.xlsx: an excel with detailed explanations and examples for each CES (one per sheet) and a last sheet, named “coding”, for performing the assessment;
- Annex 2. Additional info.doc: to provide other coders with the details needed for performing an informed assessment;
- Annex 3. Mcc.r: R code to run the Matthews Correlation Coefficient and calculate the inter- coders’ agreement;
- Annex 4. Self-evaluation of the ICA.doc: to compare assessments performed by different coders and compile a site-specific annotations to the protocol.
- video tutorial to guide the use of the protocol.
In addition, associated case studies include a dataset coded by following the protocol and applicable as a training set for automatic assessments.