2017 & 2019 Winner

PlantVillage Nuru: Pest and disease monitoring using AI

The Inspire Challenge is an initiative to challenge partners, universities, and others to use CGIAR data to create innovative pilot projects that will scale. We look for novel approaches that democratize data-driven insights to inform local, national, regional, and global policies and applications in agriculture and food security in real time; helping people–especially smallholder farmers and producers–to lead happier and healthier lives.

This proposal was selected as a 2017 pilot project and 2019 scale up winner, with the team receiving a total of 350,000 USD to put their ideas into practice.

PlantVillage Nuru: Pest and disease monitoring using artificial intelligence

The project expects to radically transform pest and disease monitoring by using artificial intelligence (AI), advanced sensor technology and crowdsourcing capable of connecting the global agricultural community to help smallholder farmers. It aims to increase the effectiveness of farm-level advice by leveraging three critical advances:

  1. The democratization of AI thanks to open access platforms such as Google’s TensorFlow.
  2. The miniaturization of technology allowing affordable deployment.
  3. The development of massive communication and money exchange platforms such as M-Pesa that allow rural extension to scale as a viable economic model enabling last mile delivery in local languages.

More than 200,000 images of diseased crops have already been collected on farms at RTB cassava field sites in coastal Tanzania and western Kenya using cameras, spectrophotometers, and drones. These images will be used to train AI algorithms.

The team recently developed an AI algorithm with TensorFlow that can automatically classify five cassava diseases building on published work covering 26 diseases in 12 crops. Through a collaboration with Google, a TensorFlow smartphone app has been developed and field-tested in Tanzania by IITA.

Team

David Hughes | Email
Penn State

James Legg | Email
IITA

Partners

Step by step

Sep 2017

US$100K grant

The project was one of five winners of the Inspire Challenge 2017 and was awarded US$100K at the inaugural annual convention of the CGIAR Platform Big Data in Agriculture, during 19-22 of September.

Developing a mobile AI assistant that diagnoses cassava diseases

The team successfully developed a mobile AI assistant that works inside a standard smartphone and is capable of accurately diagnosing cassava diseases offline, without an internet connection. The assistant is called Nuru, which means ‘light’ in Swahili.

Under field conditions, Nuru  was, on average, twice as accurate as the extension workers she was tested against.

Nuru is linked to PlantVillage and allows advice from experts (at CGIAR/FAO/governments) to be sent offline and in local languages (currently in Swahili, French, Twi, Hindi, and English).

Training the convolutional neural network

The AI relies upon TensorFlow, a machine learning environment where a convolutional neural network (CNN) is trained to recognize crop diseases based on images collected at IITA research plots.

The project overcame a number of significant challenges in getting an accurate CNN to work offline inside an Android app; in-phone CNN deployment is not yet a standard approach and most systems rely upon the cloud, which would not be functional in a smallholder farmer setting where connectivity is poor. The CNN is a work in progress and will improve over time with more training.

Z

Building an expert portal on the PlantVillage platform

The project also built an expert portal on the PlantVillage platform for IITA scientists to examine records of diseases diagnosed by Nuru. Experts are automatically notified when a user receives a diagnosis, and they are shown the images and data (location, AI accuracy, time) associated with the diagnosis. This allows IITA to both check the accuracy of the AI assistant and note where and when diseases are being recorded.

An example of the portal in action was the identification of Cassava Mosaic Disease (CMD) in Oddar Meanchey Province, Cambodia where there had previously been only unconfirmed reports. The expert portal enabled IITA’s James Legg to interact directly with the Nuru user in Cambodia and discuss monitoring and control of CMD. This was a clear demonstration of Nuru’s potential to provide early warning support for the identification and management of new crop disease outbreaks.

Testing the system with farmers in Busia County, Kenya

Cassava Lab Uganda 16 Credit-S.Quinn_CIP

The system has been tested with farmers in Busia County, Kenya in partnership with Self Help Africa, a charity helping 28,000 farmers in the cassava value chain.

.

AI takes root

The team annotated thousands of cassava plant images, identifying and classifying diseases to train a machine learning model using TensorFlow. Once the model was trained to identify diseases, it was deployed in the app. Farmers can wave their phone in front of a cassava leaf and if a plant had a disease, the app could identify it and give options on the best ways to manage it.

For more information on how Nuru is helping farmers better identify and manage diseases quickly, watch Google’s video spotlight on the project below and read more on Google’s blog, The Keyword.

June 2018

Available on Google Play

Nuru AI was made freely-available for download onto Android devices through Google Play at the end of June 2018. It has been downloaded by users on all continents and used extensively in Africa and South-East Asia. This is the first stage of the application roll-out; additional funding would allow roll-out at a broader scale.

0
Oct 2018

Expansion to other crop diseases

Women potato farmers from the Dedza district in Malawi receive new and improved potato varieties from the International Potato Center. Photo: Hugh Rutherford/International Potato Center.

While the project focused on cassava disease detection, it also trained an accurate model for potato diseases which has been field tested and was deployed in India in October 2018 with 1,000 farmers as part of the Indian Government’s FarmerZone platform. The application is available in Hindi and Punjabi and will scale up its reach to 200,000 farmers within 24 months.

In collaboration with the United Nations Food and Agricultural Organization (FAO), the team has developed a tool to identify fall armyworm damage, and images of banana and sweet potato diseases are also being collected for future work.

The fall armyworm tool has demonstrated successful deployment of AI to farmers; it has been used in 66 countries and 28 languages by the UN FAO.

October 2019

US$250K scale-up grant

The project was awarded a 2019 Inspire Challenge Scale-up grant of US$250K at the third annual convention of the CGIAR Platform for Big Data in Agriculture, 16-18 October 2019.

December 2019 - August 2021

Advice contextualized for a changing climate

The effects of climate change observed in 2019 has demonstrated that advice on disease pressure must be contextualized within the realities of climate change. The team is now integrating weather data and past crop performance info to deliver contextualized advice.

/
January 2020

Nuru integrated with SMS system in Kenya

PlantVillage Nuru has been integrated with a hybrid information dissemination platform. This platform, an SMS system which sends agronomic advice, is used by young agronomists who work with communities in Kenya. This integrated system allows the reach of AI to be greater within these communities.

0
January 2020 - January 2023

Nuru integrated with platform for tracking cassava disease

PlantVillage Nuru will be integrated with WAVE 2 (West African viral epidemiology platform) to help track and arrest the spread of cassava brown streak disease. This work began in January 2020 and will continue for the next three years.

Photo: CGIAR Research Program on Roots, Tubers, and Bananas. Cassava brown streak disease.

0
January 2020 - July 2020

Expanding agronomic advice to wheat and rice diseases

The team is working with CIMMYT to expand the app’s agronomic advice to include wheat and rice fungal diseases such as rust and blast.

Photo: Petr Kosina / CIMMYT. Wheat rust.

0
February 2020 - August 2021

Nuru's AI tech used as a model for nutrition project in Ghana and Vietnam

Foundation Botnar will fund a new project with IFPRI to utilize PlantVillage Nuru’s AI to automate food tracking information needed by nutritionists.

The project will test the proposition that well-designed smartphone apps using AI can be a social force for positive eating habits, specifically for adolescent girls ages 15 to 17 years in schools Ghana and Vietnam.

0

What's next?

The team will continue to integrate climate smart services to provide contextualized advice to growers and harmonize with hybrid knowledge systems such as SMS, radio, TV, and agronomic experts.

Project News and Resources

Success story from a cassava farmer in Busia County, Kenya

23 Mar 2020
PlantVillage

Go to article →

AI takes root, helping farmers identify diseased plants

20 Jun 2018
The Keynote

Go to article →

Grant will support expanded use of artificial intelligence for crop health

26 Nov 2019
Penn State News

Go to article →

Revolutionary mobile app for monitoring crop pests and diseases

19 Sep 2017
RTB Blog

Go to article →

The Bots Are Here—and They’re Protecting Our Crops

2 Sept 2019
Scientific American

Go to article →

Project Brief

RTB – CGSpace

Download →