2017 & 2019 WinnerPlantVillage Nuru: Pest and disease monitoring using AI
The Inspire Challenge is an initiative to challenge partners, universities, and others to use CGIAR data to create innovative pilot projects that will scale. We look for novel approaches that democratize data-driven insights to inform local, national, regional, and global policies and applications in agriculture and food security in real time; helping people–especially smallholder farmers and producers–to lead happier and healthier lives.
This proposal was selected as a 2017 pilot project and 2019 scale up winner, with the team receiving a total of 350,000 USD to put their ideas into practice.
PlantVillage Nuru: Pest and disease monitoring using artificial intelligence
The project expects to radically transform pest and disease monitoring by using artificial intelligence (AI), advanced sensor technology and crowdsourcing capable of connecting the global agricultural community to help smallholder farmers. It aims to increase the effectiveness of farm-level advice by leveraging three critical advances:
- The democratization of AI thanks to open access platforms such as Google’s TensorFlow.
- The miniaturization of technology allowing affordable deployment.
- The development of massive communication and money exchange platforms such as M-Pesa that allow rural extension to scale as a viable economic model enabling last mile delivery in local languages.
More than 200,000 images of diseased crops have already been collected on farms at RTB cassava field sites in coastal Tanzania and western Kenya using cameras, spectrophotometers, and drones. These images will be used to train AI algorithms.
The team recently developed an AI algorithm with TensorFlow that can automatically classify five cassava diseases building on published work covering 26 diseases in 12 crops. Through a collaboration with Google, a TensorFlow smartphone app has been developed and field-tested in Tanzania by IITA.
Step by step
The project was one of five winners of the Inspire Challenge 2017 and was awarded US$100K at the inaugural annual convention of the CGIAR Platform Big Data in Agriculture, during 19-22 of September.
Developing a mobile AI assistant that diagnoses cassava diseases
The team successfully developed a mobile AI assistant that works inside a standard smartphone and is capable of accurately diagnosing cassava diseases offline, without an internet connection. The assistant is called Nuru, which means ‘light’ in Swahili.
Under field conditions, Nuru was, on average, twice as accurate as the extension workers she was tested against.
Nuru is linked to PlantVillage and allows advice from experts (at CGIAR/FAO/governments) to be sent offline and in local languages (currently in Swahili, French, Twi, Hindi, and English).
Training the convolutional neural network
The AI relies upon TensorFlow, a machine learning environment where a convolutional neural network (CNN) is trained to recognize crop diseases based on images collected at IITA research plots.
The project overcame a number of significant challenges in getting an accurate CNN to work offline inside an Android app; in-phone CNN deployment is not yet a standard approach and most systems rely upon the cloud, which would not be functional in a smallholder farmer setting where connectivity is poor. The CNN is a work in progress and will improve over time with more training.
Building an expert portal on the PlantVillage platform
The project also built an expert portal on the PlantVillage platform for IITA scientists to examine records of diseases diagnosed by Nuru. Experts are automatically notified when a user receives a diagnosis, and they are shown the images and data (location, AI accuracy, time) associated with the diagnosis. This allows IITA to both check the accuracy of the AI assistant and note where and when diseases are being recorded.
An example of the portal in action was the identification of Cassava Mosaic Disease (CMD) in Oddar Meanchey Province, Cambodia where there had previously been only unconfirmed reports. The expert portal enabled IITA’s James Legg to interact directly with the Nuru user in Cambodia and discuss monitoring and control of CMD. This was a clear demonstration of Nuru’s potential to provide early warning support for the identification and management of new crop disease outbreaks.
AI takes root
The team annotated thousands of cassava plant images, identifying and classifying diseases to train a machine learning model using TensorFlow. Once the model was trained to identify diseases, it was deployed in the app. Farmers can wave their phone in front of a cassava leaf and if a plant had a disease, the app could identify it and give options on the best ways to manage it.
For more information on how Nuru is helping farmers better identify and manage diseases quickly, watch Google’s video spotlight on the project below and read more on Google’s blog, The Keyword.
Available on Google Play
Nuru AI was made freely-available for download onto Android devices through Google Play at the end of June 2018. It has been downloaded by users on all continents and used extensively in Africa and South-East Asia. This is the first stage of the application roll-out; additional funding would allow roll-out at a broader scale.
Expansion to other crop diseases
While the project focused on cassava disease detection, it also trained an accurate model for potato diseases which has been field tested and was deployed in India in October 2018 with 1,000 farmers as part of the Indian Government’s FarmerZone platform. The application is available in Hindi and Punjabi and will scale up its reach to 200,000 farmers within 24 months.
In collaboration with the United Nations Food and Agricultural Organization (FAO), the team has developed a tool to identify fall armyworm damage, and images of banana and sweet potato diseases are also being collected for future work.
The fall armyworm tool has demonstrated successful deployment of AI to farmers; it has been used in 66 countries and 28 languages by the UN FAO.
US$250K scale-up grant
The project was awarded a 2019 Inspire Challenge Scale-up grant of US$250K at the third annual convention of the CGIAR Platform for Big Data in Agriculture, 16-18 October 2019.
Advice contextualized for a changing climate
The effects of climate change observed in 2019 has demonstrated that advice on disease pressure must be contextualized within the realities of climate change. The team is now integrating weather data and past crop performance info to deliver contextualized advice.
Nuru integrated with SMS system in Kenya
PlantVillage Nuru has been integrated with a hybrid information dissemination platform. This platform, an SMS system which sends agronomic advice, is used by young agronomists who work with communities in Kenya. This integrated system allows the reach of AI to be greater within these communities.
Nuru integrated with platform for tracking cassava disease
PlantVillage Nuru will be integrated with WAVE 2 (West African viral epidemiology platform) to help track and arrest the spread of cassava brown streak disease. This work began in January 2020 and will continue for the next three years.
Expanding agronomic advice to wheat and rice diseases
The team is working with CIMMYT to expand the app’s agronomic advice to include wheat and rice fungal diseases such as rust and blast.
Nuru's AI tech used as a model for nutrition project in Ghana and Vietnam
The project will test the proposition that well-designed smartphone apps using AI can be a social force for positive eating habits, specifically for adolescent girls ages 15 to 17 years in schools Ghana and Vietnam.
The team will continue to integrate climate smart services to provide contextualized advice to growers and harmonize with hybrid knowledge systems such as SMS, radio, TV, and agronomic experts.
Project News and Resources
Grant will support expanded use of artificial intelligence for crop health
26 Nov 2019
Penn State News
Revolutionary mobile app for monitoring crop pests and diseases
19 Sep 2017
The Bots Are Here—and They’re Protecting Our Crops
2 Sept 2019
RTB – CGSpace
Meet all the Winners