COVID-19 response

Learn more about BIG DATA’s initiatives related to big data, food security and COVID-19

Meet the 2020 Inspire Challenge Winners

Annual Report 2019: NOW AVAILABLE

Read report

Grants that make a difference

Read about our 2020 Inspire Challenge grant and focus on COVID-19 response

Feeding the future. Byte by byte.

More about the Platform

Big data powered agricultural research & development

Feeding the future. Byte by byte.

Discover agricultural publications and data

Powered by GARDIAN

The Latest

Webinar – Next-gen crop production analytics

February 22, 2022

This webinar, co-presented by the Geospatial Data Community of Practice and the Enabling Crop Analytics at Scale Initiative, present a new two-stage crop production analytics approach to addressing the dual issues of inefficient ground-truth sampling design and inaccurate in-field crop yield measurement methods.

The Platform for Big Data and the digital future of CGIAR

December 29, 2021

The CGIAR Platform for Big Data in Agriculture is coming to the end of its cycle. Here are some important proof-points looking back over the Platform's start in 2017.

New webpage featuring the most used ontologies in the agri-food domain

December 3, 2021

The Ontologies Community of Practice has developed a webpage providing at a glance the most popular ontologies in the agri-food domain along with the ontologies developed by CGIAR and its partners.

Big data and agricultural research: Results of online survey for CAS Secretariat commissioned independent evaluation

November 23, 2021

The CGIAR Advisory Services Shared Secretariat (CAS Secretariat), in line with its mandate and 2021 workplan, commissioned an independent evaluation team of subject matter experts to evaluate the work of the Platform between 2017 and mid-2021. While the evaluation is still ongoing, some preliminary survey results are already available to

Webinar – Labelled property graphs, Web Ontology Language, and WebProtégé

September 9, 2021

This webinar by the Ontologies Community of Practice presents work on making WebProtégé compatible with a labelled property graph representation of Web Ontology Language ontologies.

Webinar – Governance operational model for ontologies (GOMO)

August 9, 2021

This webinar by the Ontologies Community of Practice presents the governance operational model for ontologies (GOMO) which establishes an agile governance model for BASF ontologies.

Go to blog

Covid-19 Rapid Response Grants Winners

Rapid response

Rapid diagnostics of COVID-19 farming impacts

Rapid response

Herd opportunity

Rapid response

Eyes on the ground for agricultural microcredit

Resources

Annual Report 2019

In 2019, under its three modules INSPIRE, CONVENE and ORGANIZE, the Platform made significant strides to build fundamental technologies and data standards to support CGIAR’s digital strategy, develop strategic digital partner networks, and foster new innovative pathways that leverage public-good data to solve intractable challenges at scale.

Shared Services

The platforms enables access to shared services in support of CGIAR research and its researchers, including the secure sharing and transfer of large datasets, commercial satellite imagery and gridded global weather data.

Learn more

2019 Convention Highlights

Check out the takeaways from our 2019 Convention

Webinars

Explore topics such as digital extension, interactive voice response, privacy guidelines and more.

RESPONSIBLE DATA GUIDELINES

Guidelines for managing privacy and personally identifiable information in the research project data cycle.

Learn more

The first pan-CGIAR publications and datasets search tool

Learn more

All resources

Communities of practice

Our communities foster collaboration spaces and opportunities, facilitate connectivity and sharing of methodologies, and support the organization of capacity-building workshops.

Engage with a range of industry experts & actors to produce new ideas to solve current agriculture development problems.

Agronomy

Crop Modeling

Geospatial

Info & data management

Livestock

Ontologies

Socio-Economic

All communities

The Inspire Challenge

The Inspire Challenge has so far awarded a total of USD3.225 million in grants to 21 projects. Follow their progress here!

Inspire Winner 2020

Croppie – the PhotoCropping app

Inspire Winner 2020

N-ALLyzer: From Nitrogen to ALL other nutrients

Inspire Winner 2020

‘On time’ predictive alerts for locust action

Inspire Winner 2020

Citizen-H2D3

Inspire Winner 2020

Rapid, Low-Cost Aflatoxin detection using AI

Inspire Winner 2020

“Hola Talia”- Boosting extension service through AI

Inspire Winner 2020

Big data in resilience of rangeland communities

Inspire Winner 2019

Gamifying weather forecasting: “Let it rain” campaign

Inspire Winner 2019

Hungry cities: Inclusive food markets in Africa

Inspire Winner 2019

Rapid genomic detection of aquaculture pathogens

Inspire Winner 2019

Real-time East Africa live groundwater use database

Revealing informal food flows through free WiFi

Inspire Winner 2018

Machine learning for smarter seed selection

Seeing is believing – Using smartphone camera data

Inspire Winner 2018

CubicA: The new farmer advisory app

An integrated data pipeline for smallscale fisheries

MARPLE: Real time diagnostics for devastating wheat rust

Farm.ink: Analysing livestock social media data for farmer chatbot

Using commercial microwave links (CMLs) to estimate rainfalls

PlantVillage Nuru: Pest and disease monitoring using artificial intelligence

About the challenge

Insights

Solutions for feeding the future, byte by byte.

Evidence Clearing House

Showcasing all kinds of digital tools that will help practitioners easily identify mature technologies and entry-points in food systems.

Learn more

Youth in Data Initiatives

The Platform is working towards creating pathways and opportunities for youth to contribute to agricultural transformation.

Learn more

Big Data on Gender

Learn more

Search the website

Discover agricultural data and publications

Powered by GARDIAN

Become a youth in data partner

Submit an initiative!

AgroFIMS: Your new companion for easy standardization of data collection and description

The Agronomy Field Information Management System (AgroFIMS) allows users to create fieldbooks to collect agronomic data that is already tied to a metadata standard (the CG Core Metadata Schema, aligned with the standard Dublin Core), and semantic standards like the Agronomy Ontology (AgrO), generating data that is Findable, Accessible, Interoperable, and Reusable (FAIR) at collection. AgroFIMS therefore standardizes data collection and description for easy aggregation and inter-linking across disparate datasets. The fieldbooks you create can be exported to the Android-based KDSmart data collection application, and collected data imported back to AgroFIMS for statistical analysis and reports. In 2021 AgroFIMS will allow you to set up agronomic survey questionnaires, for data collection via ODK. It will also allow easy upload of your “born FAIR” data to Dataverse repository platforms with Dublin Core-compliant metadata schemas. Funding for AgroFIMS was provided by the Bill and Melinda Gates Foundation’s Open Access, Open Data Initiative, and the CGIAR Platform for Big Data in Agriculture. AgroFIMS is under GPL license. Go to AGROFIMS →

Responsible Data Management Guidelines to protect privacy

CGIAR Platform for Big Data in Agriculture advocates open data for agricultural research for development. It considers that opening up research data for scrutiny and reuse confers significant benefits to society.

However, the Platform appreciates that not all research data can be open and that a broad range of legitimate circumstances may require data to be restricted.

As an integral component of its advocacy for open data, the Platform promotes responsible data management through the entire research data lifecycle from planning, collecting, storing, disclosing or publishing, transferring, discovery and archiving.

These guidelines were created from information collected from: review on best and emerging practices across various sectors in the fast changing landscape of privacy and ethics (130 external resources); privacy and ethic materials sourced from seven CGIAR centers; first draft was circulated for input and feedback across CGIAR and incorporated into this edition. It’s important to note that this is an evolving document, the next stage is to consult externally for further input.

These Guidelines are intended to assist agricultural researchers handle privacy and personally identifiable information (PII) in the research project data lifecycle.

Check the guidelines →

REUSE / TRANSFER

Ensure consistency with the DMP-PII and the purpose for which prior informed consent has been obtained
Revaluate likelihood of (re-)identification and risk of harm, particularly if it involves a public data-set containing PII (as above)
Ensure PII is stored securely to protect privacy (as above)
Minimize use of PII and risk of disclosure through pro-privacy access controls and analytical tools (as above)

Don’t transfer data containing PII unless have explicit consent
Don’t transfer data containing PII in the absence of a data sharing agreement identifying aspects such as purpose and scope of use, privacy protections measures, confidentiality and any limitations)
Don’t reuse or transfer PII until any inconsistencies with the DMP-PII and/or purpose compatibility have been resolved (e.g. through updated ethics review or consent from participant)

ARCHIVING / DISCARDING

Plan for archiving or data destruction early in the process. Destroying data can be more secure, however, archiving can be beneficial if the data has ongoing evidentiary, scientific or cultural value. If archiving, identify where and how, the budget require
Ensure DMP-PII and purpose compatibility (as above)
Ensure adequate security measures to protect privacy (as above)

Don’t wait until the end of the project to assess archiving needs when time and resources may be limited
Don’t assume the longevity of a particular format, future-proof your archives data
Don’t forget to budget for archiving data, this should be done as part of your Data Management Plan

PUBLISHING AND DISCOVERY

Ensure DMP-PII and purpose compatibility (as above)
Revaluate likelihood of (re-)identification and risk of harm, particularly if it involves a public data-set containing PII
Indicate in metadata the availability of raw data or minimized data containing PII, if available bilaterally
Minimize use of PII and risk of disclosure through pro-privacy access controls and analytical tools

Don’t include PII in public datasets unless absolutely necessary to preserve the data’s analytic potential, scientific utility or benefit to the participant (and subject to participants informed consent and a rigorous risk assessment)

STORAGE AND ANALYSIS

Ensure compatibility with the DMP-PII (as above) and also the purpose for which prior informed consent has been obtained

Ensure PII is stored securely to protect privacy, through organizational or project specific safeguards to prevent unauthorized access, accidental disclosure or breach of data (physical & technical)

encryption for the storage and transmission of PII
access control measures to limited access to PII
two-factor or multifactor authentication
cloud services & back-end security

Don’t store data in unsecured locations or on unsecured devices or servers

Don’t store encrypted data and encryption keys in locations where they can be easily accessed simultaneously

Don’t underestimate the importance and value of administrative safeguards to standardize practices (i.e. organizational policies, procedures and maintenance of security measures that are designed to protect private information, data and access)

COLLECTION

Ensure compatibility with the DMP-PII
De-identify data to anonymize by default unless it will impair the data’s analytic potential, scientific utility or benefit to the participant,
If you cannot anonymize, minimize the PII and pseudonymize to reduce the disclosure risk
Provide research participants sufficient information to use reasoned judgment to decide whether or not they wish to participate in the project
Ensure informed consent is designed to address the following elements:
- competence, comprehension, full disclosure, voluntariness
- legitimate scientific purpose for which the PII is collected and scope of use (e.g. stored, transferred, published and whether as anonymized, minimized or raw data)
- foreseeable risk of privacy loss and consequences
- meaningful alternatives including opt-in protection/anonymization
- safeguards to protect privacy, conditions on which PII may be shared and any limitations on reuse or third- party access and use of PII
- permission to follow-up or contact the participant and for what purpose (including by third- parties)
- participant’s right to withdraw and rights regarding their data (e.g. to be informed; to access; to rectify; to object; to erase)
- inclusion of physical, phone and/or electronic contact (at least two forms of contact) that participant can reach to exert her/rights
- explicit consent and participant’s acknowledgement of understanding
- if written, provide the participant a copy of processed informed consent
Use plain language and adapt informed consent to meet the needs of vulnerable populations (e.g. obtain orally or in local language)

Don’t collect PII unless you have a Data Management Plan and any necessary approvals in place, including the recorded approval of the potential participant
Don’t collect PII unless you absolutely need it
Don’t assume that removal of direct identifiers is sufficient to anonymize data or that all de-identification techniques will result in anonymized data. Consider the risk of re-identification of a research participant, particularly if datasets are combined. If there is a reasonable risk of re-identification the information should be handled as PII (i.e. undertake risk analysis, evaluate stronger anonymization techniques, seek informed consent for the disclosure of data and explain its possible consequences)
Don’t include vulnerable participants or communities if their ability or capacity to provide voluntary informed consent is genuinely in question
Don’t underestimate the potential of quasi or indirect identifiers to identify an individual, particularly the inherent ability of location-based data to identify participants and their communities, and the increased risk of harm this may pose to potentially vulnerable individuals/communities
Avoid seeking overly broad consent that may call into question transparency or a research participant’s understanding regarding the use of their PII, be specific regarding the activities, purpose and limitations associated with PII so that the participant can make a genuinely informed decision and downstream users can evaluate purpose compatibility and seek fresh consent if needed

PLANNING AND APPROVAL

Develop a Data Management Plan which governs the handling of PII in the research project and beyond (DMP-PII). It should address:
- the type and nature of PII
- compliance requirements (including necessary forms for obtaining consent, and ethics clearance, if applicable)
- legitimate research objectives that will be advanced by the PII
- foreseeable risks and consequences if participants are identified from the data
- privacy protection measures (or lack thereof) for collection, storage, transfer and publishing
- process for obtaining informed consent
- timeframe or trigger for archiving or deletion of PII
Employ stricter standards for research involving vulnerable populations such as children or illiterate participants or sensitive data such as ethnicity or religious beliefs
Undertake due-diligence of datasets previously collected by you or third parties to ensure you are entitled/permitted to use for your research project
Consult the legal, IRB or ethics clearance committee or any other relevant institutional group for specific institutional, local, regional or national policies and regulatory frameworks that may apply to PII in the context of your work

Don’t leave the handling of PII and privacy protection as an after-thought, plan ahead!
Don’t forget to check local laws and donor or third-party requirements in addition to institutional policies governing research ethics and privacy protection (seek expert support if unsure!)
Don’t ignore ethical practices/standards, if your institution does not have an ethics framework or clearance process in place self-assess!
In assessing whether information is capable of identifying someone (i.e. PII) don’t limit your focus to direct identifiers, also consider indirect/quasi identifiers. Appreciate this will depend on the context of the research project, the data in question and external data which is or may become otherwise available (i.e. there is no exhaustive list).
In assessing risk of harm don’t forget to consider potential harm to the participant’s community or groups of individuals that can otherwise be identified or associated with the participant

Feeding the future. Byte by byte.

Big data powered agricultural research & development

Discover agricultural publications and data

Powered by GARDIAN

The Latest

Covid-19 Rapid Response Grants Winners

Resources

Annual Report 2019

Shared Services

2019 Convention Highlights

Webinars

RESPONSIBLE DATA GUIDELINES

Communities of practice

Our communities foster collaboration spaces and opportunities, facilitate connectivity and sharing of methodologies, and support the organization of capacity-building workshops.

Engage with a range of industry experts & actors to produce new ideas to solve current agriculture development problems.

The Inspire Challenge

The Inspire Challenge has so far awarded a total of USD3.225 million in grants to 21 projects. Follow their progress here!

Insights

Solutions for feeding the future, byte by byte.

Evidence Clearing House

Youth in Data Initiatives

Big Data on Gender

Search the website

Discover agricultural data and publications

Powered by GARDIAN

Become a youth in data partner

Submit an initiative!

AgroFIMS: Your new companion for easy standardization of data collection and description

Responsible Data Management Guidelines to protect privacy

<img class="wp-image-93311 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/REUSE_arrow.png" alt="" width="100" height="100" />

REUSE / TRANSFER

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />

ARCHIVING / DISCARDING

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />

<img class="wp-image-93312 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/rss-transparent-300x300px.png" alt="" width="100" height="100" />

PUBLISHING AND DISCOVERY

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />

<img class="wp-image-93295 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/data-analysis-icon.png" alt="" width="100" height="100" />

STORAGE AND ANALYSIS

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />

<img class=" wp-image-93249 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/data-collection-icon.png" alt="" width="100" height="75" />

COLLECTION

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />

<img class=" wp-image-93217 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/planning-icon.png" alt="" width="100" height="114" />

PLANNING AND APPROVAL

<img class="alignnone size-full wp-image-92805 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/tips-icon-orange-100px.png" alt="" width="100" height="100" />

<img class=" wp-image-93476 aligncenter" src="https://bigdata.cgiar.org/wp-content/uploads/2019/01/DONT-DO-ICON.png" alt="" width="100" height="100" />