How data-driven farming could transform agriculture | Ranveer Chandra | TEDxUniversityofRochester

TEDx Talks
26 Jul 201817:33

Summary

TLDRThe speaker addresses the critical issue of increasing global food production by 70% by 2050 to feed the growing population. They highlight the challenges of limited arable land and receding water levels, proposing data-driven farming and precision agriculture as solutions. By using technologies like TV white spaces, UAVs, and machine learning, the FarmBeats project aims to reduce the cost of data-driven agriculture, making it accessible to smallholder farmers worldwide. The goal is to improve yields, reduce costs, and benefit the environment by enabling precise, site-specific applications of resources like water and pesticides.

Takeaways

  • 🌱 The world's food production needs to increase by 70% by 2050 to feed the growing population, highlighting the urgency of the global food problem.
  • 📈 Data-driven farming is a promising approach to significantly increase food production by leveraging data to optimize farming practices.
  • 🚜 Precision agriculture, which involves site-specific applications of water and pesticides, can improve yield, reduce costs, and benefit the environment.
  • 🌡️ Mapping soil moisture and nutrient levels throughout a farm can enable more precise farming techniques and is crucial for data-driven farming.
  • 💡 The Farm Beats project at Microsoft aims to reduce the cost of data-driven agriculture solutions by two orders of magnitude, making it more accessible to farmers.
  • 📶 Internet connectivity in farms is often expensive and limited, hindering the adoption of data-driven farming technologies.
  • 📡 TV white spaces technology can provide cost-effective connectivity in rural areas, enabling the use of data-driven farming solutions.
  • 🤖 Using UAVs (drones) and machine learning, it's possible to create detailed maps of farms with fewer sensors, reducing the cost of data collection.
  • 🎈 Tethered helium balloons with cameras can be a low-cost alternative to drones for capturing aerial imagery of farms.
  • 🖥️ Local processing of data on a farmer's PC can overcome connectivity issues and provide real-time insights without the need for internet.
  • 🔢 Farm Beats has demonstrated high accuracy in predicting soil conditions, which can be as reliable as direct sensor measurements for decision-making.

Q & A

  • What is the projected increase in world food production needed by 2050 to feed the growing population?

    -The world's food production needs to increase by 70% by 2050 to feed the growing population.

  • Why is the increase in food production necessary not just to feed but also to nourish the world's population?

    -The necessity to nourish the world's population makes the problem of increasing food production even more severe due to limited arable land and receding water levels.

  • What is data-driven farming and how does it relate to solving the world's food problem?

    -Data-driven farming refers to the ability to map every farm in the world and overlay it with various data, such as soil moisture and nutrient levels. This approach can enable techniques like precision agriculture, potentially increasing food production.

  • What is precision agriculture and how does it benefit farming practices?

    -Precision agriculture is the ability to apply water, pesticides, and other inputs uniformly or site-specifically only where it is needed. It improves yield, reduces costs by using fewer resources, and is environmentally friendly by avoiding overuse of pesticides and water.

  • What is phenotyping in agriculture and how does it differ from genotyping?

    -Phenotyping in agriculture is the process of understanding why the same seed variety grows differently in different parts of a farm. Unlike genotyping, which focuses on the genetic makeup of plants, phenotyping observes the physical characteristics and growth patterns influenced by environmental factors.

  • What is the Farm Beats project and what is its main goal?

    -The Farm Beats project, led by Microsoft, aims to significantly reduce the cost of data-driven agriculture solutions by two orders of magnitude, making it more accessible to farmers and potentially revolutionizing farming practices.

  • Why has the adoption of precision agriculture technology been slow despite its benefits?

    -The slow adoption of precision agriculture technology is primarily due to the high cost of existing data-driven agriculture solutions, which can be prohibitive for many farmers.

  • What is the TV white spaces technology and how does it benefit agriculture?

    -TV white spaces technology utilizes unused TV spectrum to provide long-range Wi-Fi-like connectivity. In agriculture, it can be used to connect remote farms to the internet, enabling the transmission of data from sensors and other devices.

  • How does the use of UAVs or drones contribute to creating accurate farm maps?

    -UAVs or drones equipped with cameras can quickly cover large areas of a farm and take images. Combined with artificial intelligence and machine learning, these images can be used to interpolate data from a few sensors and predict soil conditions across the entire farm.

  • What is the challenge with using drones for aerial imagery in remote parts of the world, and how is it being addressed?

    -The cost of drones and regulatory restrictions can limit their use in remote areas. To address this, tethered helium balloons with mounted smartphones are used to capture aerial imagery at a lower cost and without the need for special permissions.

  • How does the Farm Beats project handle the issue of limited internet connectivity from the farmer's house to the cloud?

    -The project uses a PC-based system that processes data from sensors and drones locally, reducing the need for high-speed internet. It also compresses and sends only necessary data to the cloud, ensuring that the system can run even with limited connectivity.

  • What kind of actionable insights can the Farm Beats system provide to farmers?

    -The Farm Beats system can provide insights such as soil moisture levels, pH levels, and the growth patterns of crops. It can also monitor animal health and movement, and flag areas that require attention, such as water puddles or acidic soil patches.

  • How accurate are the predictions made by the Farm Beats system compared to actual sensor measurements?

    -The predictions made by the Farm Beats system are so close to the actual sensor measurements that they are considered actionable by farmers, providing reliable data for making informed decisions.

Outlines

00:00

🌱 Addressing the Global Food Production Challenge

The speaker begins by highlighting the urgent need to increase the world's food production by 70% by 2050 to accommodate the growing population. The challenge is exacerbated by limited arable land and receding water levels, reminiscent of the Green Revolution. The speaker introduces data-driven farming as a promising solution, which involves mapping farms and overlaying them with data like soil moisture and nutrient levels to enable precision agriculture. Precision agriculture is shown to improve yields, reduce costs, and benefit the environment by applying water and pesticides only where needed. The talk also touches on phenotyping, which could lead to the creation of new genotypes. The speaker's background in computer science and personal experiences in India with agriculture set the stage for the Farm Beats project at Microsoft, aimed at significantly reducing the cost of data-driven agriculture solutions.

05:01

📡 Leveraging TV White Spaces for Farm Connectivity

The speaker discusses the high costs associated with existing data-driven agriculture solutions, particularly the internet connectivity required for remote farms. To address this, the speaker introduces the concept of TV white spaces, which are unused TV channels that can transmit Wi-Fi signals over long distances without interference. This technology, once legalized in 2010, has been used to connect rural areas to the internet. The speaker's insight is that farms, often located away from cities, have many empty TV channels, providing ample unused spectrum for connectivity. The vision is to use TV white spaces to connect entire farms, enabling the collection of data that was previously unattainable. The speaker also explains how this technology can be used to connect various devices on a farm, facilitating the gathering of extensive agricultural data.

10:02

🚁 Utilizing UAVs and Balloons for Aerial Farm Imaging

This section delves into the challenges of creating detailed maps of farms to understand soil conditions and other variables. The speaker proposes the use of Unmanned Aerial Vehicles (UAVs) or drones to quickly cover large areas and take images, which can then be used with artificial intelligence and machine learning to interpolate data from a few sensors across the entire farm. The speaker also addresses the challenges of using drones in certain countries and introduces a low-cost alternative: tethered helium balloons equipped with smartphones to capture continuous imagery. This approach allows for the creation of detailed maps with fewer sensors and provides a solution for areas where drones are restricted or too costly. The speaker describes how this technology has been used to monitor crops and prevent waste due to flood damage, with the potential for adaptation in various parts of the world.

15:03

🖥 On-Farm Processing and Machine Learning for Precision Farming

The speaker addresses the issue of limited internet connectivity from farms to the cloud, which hinders the transfer of large amounts of data collected by drones and sensors. To overcome this, the Farm Beats project utilizes on-farm processing, where a PC or a provided box runs analyses using data from sensors and drones, applying machine learning to generate actionable insights without relying on cloud connectivity. The speaker emphasizes that this approach allows for the retention of much data on the farm itself, reducing the need to send large volumes of data to the cloud. The system can also operate offline, ensuring continuity even during internet outages. The speaker shares examples of how this technology has been deployed and used by farmers to gain quick and valuable insights into their operations, such as monitoring cow health and identifying areas of the farm that require attention.

📊 Demonstrating the Accuracy and Impact of Farm Beats

In the final paragraph, the speaker presents the results of accuracy tests for the Farm Beats system, comparing its predictions for soil temperature, pH, and moisture with actual sensor measurements. The findings show that the predictions are highly accurate and actionable for farmers. The speaker also shares specific examples of how the system has been used to provide real-time insights, such as identifying areas of a farm that need attention before the next planting season and monitoring cow health. The speaker concludes by expressing gratitude for the opportunity to address the global food problem and showcasing the potential of technology to assist in solving it, highlighting the collaboration with farmers and agronomists to develop and implement these solutions.

Mindmap

Keywords

💡Food Production

Food production refers to the process of growing, harvesting, and preparing food. In the context of the video, it is emphasized that food production needs to increase by 70% by 2050 to meet the demands of the growing global population. This is a central theme as it sets the stage for discussing the challenges and solutions in agriculture.

💡Arable Land

Arable land is land that is suitable for agriculture and can be used to grow crops. The script mentions that the amount of arable land is limited, which is a significant challenge to increasing food production. This concept is critical as it highlights the scarcity of resources needed for farming.

💡Data-Driven Farming

Data-driven farming is an approach that utilizes data and analytics to optimize agricultural practices. The video discusses how mapping every farm with detailed data can enable precision agriculture and other techniques. This concept is key to understanding the innovative solutions being proposed to improve food production.

💡Precision Agriculture

Precision agriculture is a farming management technique that uses site-specific applications of inputs like water and pesticides only where they are needed. The video explains that this technique can improve yield, reduce costs, and benefit the environment. It's a core part of the proposed solution to the food problem.

💡Phenotyping

Phenotyping in agriculture is the process of measuring the observable characteristics of crops, such as growth patterns, which can be influenced by the environment. The video suggests that understanding why the same seed variety grows differently in different parts of the farm can lead to the creation of new genotypes. This is an important concept for improving crop yields.

💡TV White Spaces

TV white spaces refer to the unused frequency bands in the television broadcast spectrum. The video describes how these frequencies can be utilized to provide internet connectivity to remote and rural areas, including farms. This technology is highlighted as a solution to the challenge of internet connectivity for data-driven agriculture.

💡UAVs (Drones)

UAVs, or drones, are unmanned aerial vehicles that can be equipped with cameras and sensors to capture imagery and data from large areas quickly. In the video, drones are used to gather aerial imagery for creating detailed maps of farms, which is an essential part of the data-driven farming approach.

💡Artificial Intelligence (AI)

Artificial intelligence refers to the ability of machines to perform tasks that would typically require human intelligence, such as learning and problem-solving. The video discusses using AI and machine learning to interpolate data from a few sensors to predict values across the entire farm. AI is central to the innovative techniques being developed to enhance farming practices.

💡Machine Learning

Machine learning is a subset of AI that involves the use of algorithms to parse data, learn from it, and make informed decisions based on what they've learned. The video mentions using machine learning to create models that predict soil conditions across a farm, which is crucial for precision agriculture.

💡Soil Moisture

Soil moisture is the amount of water contained in the soil. Accurate measurement of soil moisture is important for farming as it affects plant growth and irrigation needs. The video uses soil moisture as an example of the kind of data that can be collected and analyzed through data-driven farming techniques.

💡Cost Reduction

Cost reduction is the process of decreasing expenses while maintaining or improving the quality of output. The video emphasizes the goal of the Farm Beats project to reduce the cost of data-driven agriculture solutions by two orders of magnitude, making it more accessible to farmers, particularly smallholder farmers.

Highlights

World's food production needs to increase by 70% by 2050 to feed the growing population.

Agricultural scientists are focusing on data-driven farming to address the food production challenge.

Data-driven farming involves mapping farms and overlaying them with data like soil moisture and nutrient levels.

Precision agriculture allows for site-specific applications of water and pesticides, improving yield and reducing costs.

Phenotyping can help understand why the same seed variety grows differently in different farm areas.

The Farm Beats project at Microsoft aims to reduce the cost of data-driven agriculture solutions by two orders of magnitude.

TV white spaces technology can provide long-range connectivity for farms, overcoming the cost barrier.

AI and machine learning can predict soil conditions across a farm using aerial imagery and sparse sensor data.

Tethered helium balloons are a low-cost alternative to drones for capturing continuous aerial imagery.

Farm Beats combines TV white spaces, sensors, and drones to create actionable insights for farmers.

Farm Beats technology can run offline, providing resilience against internet connectivity issues.

Farm Beats has been successfully deployed on farms, providing real-time insights on soil conditions and livestock.

The system can flag areas of a farm that need attention, such as water puddles or areas of differing soil pH.

Farm Beats' predictions are highly accurate and actionable, closely matching actual sensor measurements.

Farm Beats can monitor livestock health and movement, providing immediate feedback to farmers.

The project aims to bring these technologies to smallholder farmers worldwide, enhancing global food security.

Farm Beats demonstrates how non-agricultural technologies can be applied to solve pressing agricultural challenges.

The project combines advances in computer science with practical agricultural needs to create innovative solutions.

Transcripts

play00:02

you

play00:09

good morning everyone happier today

play00:12

today I'm here to tell you about the

play00:14

world's food

play00:15

problem the world's food production

play00:17

needs to increase by 70% by 2050 to feed

play00:21

the growing population of the world and

play00:23

this is just to feed if you talk about

play00:25

nourishing the world the problem is even

play00:27

more severe and the reason this is such

play00:29

a big problem is because the amount of

play00:32

arable land is limited the water levels

play00:35

are receding so it's like the Green

play00:37

Revolution problem all over again how do

play00:39

we get to this significant increase in

play00:41

food production the agricultural

play00:44

scientists have been think about this

play00:46

problem for quite a while and the most

play00:48

promising approach right now seems to be

play00:50

that of data-driven farming what we mean

play00:53

by data-driven farming is the ability to

play00:56

map every farm in the world and overlay

play00:59

it with lots and lots of data for

play01:02

example what is my soil moisture level

play01:04

six inches below the soil throughout the

play01:06

farm what is my soil nutrient level

play01:08

throughout the farm if you could build

play01:11

maps like this this could enable

play01:13

techniques like precision agriculture

play01:14

what we mean by precision agriculture is

play01:17

the ability to do site-specific

play01:20

applications for example right now

play01:22

farmers they apply water uniformly

play01:24

throughout the farm they'd apply

play01:26

pesticide uniformly throughout the farm

play01:28

with precision agriculture you could

play01:30

apply it only where it is needed

play01:32

precision agriculture as a technique has

play01:35

been shown to improve yield reduce cost

play01:38

because farmers would use less water

play01:40

less pesticide it's also better for the

play01:42

environment because you're not putting

play01:43

in more pesticide than needed you're not

play01:45

putting in more nitrogen you're not

play01:46

wasting water the other technique that

play01:49

such maps could enable is called

play01:51

phenotyping just like you could do

play01:52

genotyping you could do phenotyping as

play01:54

well that is if you could understand why

play01:56

did the same seed variety grow

play01:59

differently in different parts of the

play02:00

farm for example in the red or blue

play02:02

parts of the farm you could then create

play02:04

new genotypes this map that you're

play02:06

seeing here is one such map that we want

play02:08

to create for all farms in the world so

play02:12

in the rest of this talk I will talk

play02:13

about precision agriculture but you can

play02:15

see how the same techniques apply for

play02:17

phenotyping as well so precision

play02:20

agriculture as a technique given that

play02:22

the benefits are known was first

play02:24

proposed back in the 80s it's been 30

play02:27

years since then

play02:29

the technology hasn't taken off the

play02:32

biggest reason this technology hasn't

play02:33

taken off is because of the cost of

play02:35

existing data-driven agriculture

play02:37

solutions just to give you an idea of

play02:39

how expensive it is I was at an expo at

play02:41

a university where there were several

play02:43

companies talking about the latest

play02:45

precision AG equipment the latest sensor

play02:48

equipment the cheapest sensors that were

play02:50

available there were five sensors for

play02:52

$8,000 and a recurring cost for a farmer

play02:56

to afford that kind of equipment is

play02:58

expecting too much especially when they

play03:00

don't know what is the other wife what

play03:01

is my return of investment if I buy

play03:03

these sensors which is so expensive that

play03:06

is the goal of the farm beets project

play03:08

that I'm leading at Microsoft our goal

play03:10

is to bring down the cost of these data

play03:12

driven agriculture solutions by two

play03:14

orders of magnitude we want to bring it

play03:16

down from eight thousand to 80 and I'll

play03:18

talk about a few techniques that we

play03:20

think we can get that I think we can

play03:22

help us get us get there before I go

play03:25

that I wanted to let you know that I

play03:27

don't have a farming background my

play03:29

background is a PhD in computer science

play03:31

but the first 18 years growing up I grew

play03:34

up in India and as it happens in India

play03:36

people from India can relate to it we

play03:37

used to spend we had three brothers and

play03:39

a sister and we used to spend time with

play03:40

her grandparents in northern part of

play03:42

India in a small village in Bihar and we

play03:46

used to go there spend time in farms by

play03:48

the way I did not like farming the fact

play03:50

that those were the worst four months of

play03:51

my life every year but the reason but

play03:54

what the reason was that there was no

play03:56

electricity no toilets it was like in

play03:59

going from a city to spend four months

play04:01

in a village wasn't exciting but in a

play04:03

way that kind of exposed me to the

play04:05

problems of Agriculture and that's one

play04:07

of the goals of the farm beets project

play04:08

as well we want to take the technologies

play04:10

that we are building to the smallholder

play04:12

farmers everywhere in the world so I'll

play04:15

start by talking about the US but you

play04:17

can see how this relates to other parts

play04:18

of the world as well so going back the

play04:21

goal of the farm beets project is to

play04:23

bring down the costs of data-driven

play04:24

agriculture solutions

play04:25

significantly from where they are and

play04:27

I'll talk about three challenges because

play04:29

of which existing solutions are

play04:31

expensive the first reason existing

play04:33

solutions are expensive is because of

play04:35

Internet connectivity the farmers house

play04:38

in this case has some sort of

play04:40

connectivity to the Internet they pay

play04:41

for broadband they

play04:42

one two three megabits a second but the

play04:45

actual farm is a few miles away

play04:47

the reason existing solutions are

play04:49

expensive is because the farms don't

play04:51

have connectivity they end up using

play04:52

satellite or custom cellular solutions

play04:55

to connect these devices to the Internet

play04:57

so how do we bring down the cost of

play04:59

connectivity from the middle of the farm

play05:01

to do this we use one of the prior

play05:04

research I started researching on this

play05:05

concept in 2005 called the TV white

play05:07

spaces what the TV white spaces enables

play05:10

is imagine if you go by a Wi-Fi router

play05:13

and plug it in your house imagine if you

play05:15

could access it a few miles away that

play05:17

would be cool right as soon as you exit

play05:20

your house the Wi-Fi connection just

play05:22

disappears the way we do that is we took

play05:25

a Wi-Fi signal and put it in empty TV

play05:28

channels

play05:29

this is over-the-air TV so you know when

play05:33

you're a browsing through over-the-air

play05:34

TV on certain channels you see some

play05:36

reception other channels all you see is

play05:39

white noise there's nothing coming there

play05:40

with this technology we were able to fit

play05:43

a Wi-Fi signal in those empty TV

play05:46

channels and noisy TV channels in a way

play05:48

that did not interfere with the

play05:50

reception in an adjacent channel so you

play05:52

could be watching channel 7 at home on

play05:54

channel 8 we could be sending Wi-Fi

play05:56

signals and the reason this is so cool

play05:58

is that compared to Wi-Fi at the same

play06:01

power level in UHF TV frequencies your

play06:04

signals go four times father-in VHF they

play06:06

go 12 times father and this is just

play06:08

based on pure physics once you put trees

play06:10

crops canopies and so on your signals

play06:12

just keep going through in our latest

play06:14

experiments we put these sensors in soil

play06:16

of a meter under soil and a signal just

play06:20

keeps going through so this was a

play06:21

technology we had built back into 2009

play06:24

2010 is when the FCC Chairman had come

play06:27

to visit Microsoft to see the demo we

play06:28

had put together this was made legal in

play06:30

the US in 2010

play06:32

since then we have been deploying this

play06:35

technology in several parts of the world

play06:36

connecting rural hospitals schools

play06:39

libraries to the internet using this

play06:41

technology

play06:42

just to recap this is what the TV white

play06:46

spaces is in Seattle each of these holes

play06:49

there these gaps are what is the empty

play06:52

TV spectrum and I already told you how

play06:54

it is better than Wi-Fi or any

play06:56

the technology that exists in the

play06:59

context of agriculture our key insight

play07:01

was that TV towers are where people are

play07:04

in Rochester you'll have TV towers in

play07:07

New York City you'll have TV towers the

play07:09

farms are away from the cities there are

play07:10

fewer people so if you go to a farm and

play07:12

turn on an over-the-air TV you'll find

play07:14

very few channels most of the channels

play07:17

are just white noise the more such empty

play07:20

channels you have the more capacity you

play07:22

have so if you go to a farm you have a

play07:24

lot of unused spectrum we are talking of

play07:27

hundreds of megabits per second of

play07:29

unused capacity at which point we are

play07:32

not only talking of connecting sensors

play07:33

you could be connecting cameras drones

play07:35

tractors you could be getting a lot of

play07:38

information that you previously couldn't

play07:39

get if you talk to any agricultural

play07:41

scientists the number one problem

play07:43

they'll talk about is data how do you

play07:45

get data from the middle of the farm

play07:46

with the TV white spaces we believe we

play07:49

can solve that problem our vision here

play07:51

is just like Wi-Fi connects your house

play07:53

this TV white spaces could be used to

play07:55

connect your entire farm in fact this is

play07:57

what we are doing right now in our

play07:58

deployments we put this antenna in and

play08:00

miles around it now gets connected

play08:02

you're able to get data that you

play08:03

previously just couldn't gather so this

play08:05

was challenge number one

play08:06

the second challenge as I'd mentioned

play08:08

what we want to get to are these kind of

play08:10

maps what is the soil moisture level six

play08:13

inches below the soil throughout the

play08:14

farm how do we get there if you wanted

play08:17

to build an accurate map like this you

play08:19

need lots and lots of sensors you'll

play08:20

probably need a sensor every 10 meters

play08:23

but putting a sense that every 10 meters

play08:25

is expensive to deploy to manage it'll

play08:28

come in the way of the farmer as the

play08:30

farmer does to day to day job so the key

play08:32

question is the last bullet over here on

play08:34

this slide can we build such a map using

play08:37

very few sensors the way we solve this

play08:40

problem is using UAVs these are drones

play08:42

which can fly large areas very quickly

play08:45

they have a camera at the bottom that

play08:47

that can take images of the entire farm

play08:50

the key technology we built using

play08:52

artificial intelligence and machine

play08:54

learning techniques was a way to use the

play08:56

aerial image to interpolate the data

play08:59

from a few sensors and predict what

play09:01

these values are in other parts of the

play09:03

farm just to give you an idea the state

play09:05

of the art if people had to build maps

play09:07

like maps such as the one I showed in

play09:10

the previous

play09:11

one would need one would put a few

play09:12

sensors and then use either linear

play09:14

interpolation or Cragen's method is a

play09:16

state of the art but just use that to do

play09:18

the prediction with this technology you

play09:19

can use the Adel image the key insight

play09:21

is that if two parts of the farm looks

play09:23

similar either in RGB hyperspectral

play09:26

multispectral imagery they're likely to

play09:28

have similar values so this was one of

play09:30

the key algorithms that we developed one

play09:32

we showed this to work very well for

play09:33

soil moisture soil temperature and pH

play09:35

once we started talking about it there

play09:37

were various companies that came to us

play09:38

and told us to apply this in other for

play09:41

other services as well one of the key

play09:44

challenges in aerial imagery using UAVs

play09:45

well we use that in the US but as I said

play09:48

we want to take it to the remotest parts

play09:50

of the world

play09:51

well UAVs are great these drones the

play09:53

ones that you can buy for $1,000 but

play09:55

thousand dollars is still a lot of money

play09:58

if you think of smallholder farmers in

play09:59

Africa in India other problems with

play10:02

drones are for example in some of the

play10:04

countries where we want to get aerial

play10:05

imagery if we wanted to you if we wanted

play10:08

to use a drone we needed to get

play10:09

permission from the Ministry of Defense

play10:11

well at that point it isn't happening so

play10:14

then how do we get aerial imagery at

play10:16

low-cost

play10:16

the way we do that is we have a low-tech

play10:19

solution we use tethered helium balloons

play10:21

which are tethered to the ground they

play10:23

fly up 250 and 200 feet and they are

play10:26

able to take continuous Edel imagery of

play10:28

the farm they can last up to four to

play10:30

seven days the particular thing we built

play10:32

was a custom mount on which you can put

play10:34

a smartphone and a battery pack and this

play10:37

thing can keep clicking pictures for a

play10:39

really long period of time there is a

play10:41

farmer in Washington 25 miles east of

play10:44

Microsoft campus with whom we work he

play10:47

uses this technology to monitor floods

play10:49

so one of the problems either he's a

play10:50

smallholder farmer he sells his produce

play10:52

to the farmers market and to restaurants

play10:55

one of the problems he runs into is

play10:57

every time there is a flood he needs to

play10:59

throw away all his crop because

play11:01

regulations require that any crop that

play11:03

is touched by the flood needs to be

play11:05

thrown away right now that's what he

play11:06

does every morning when he comes he sees

play11:08

there was a flood he throws away all his

play11:10

crop with this technology he can monitor

play11:12

he knows which crops had actually

play11:14

touched by the flood and only throws

play11:15

away those crops in places like India

play11:18

and Africa someone could just walk

play11:20

around with the balloon or put it on a

play11:21

bike or a tractor and

play11:23

we have computer vision algorithms based

play11:25

on which we can stitch this together to

play11:27

create these big aerial maps for the

play11:30

entire park the key challenge here was

play11:31

that with drones you can keep them

play11:33

stable with balloons they'll move around

play11:35

with Reindeer camera is not always

play11:36

facing down so we have computer software

play11:38

based on which we are able to solve

play11:39

these problems so going back how do we

play11:42

build those accurate maps you'll get the

play11:43

aerial image either from drones or from

play11:46

balloons we then build these beautiful

play11:48

pictures of the entire farm we then take

play11:51

the raw sensor data and build the

play11:53

machine learning algorithm the

play11:54

artificial intelligence of them that's a

play11:55

model of how would these variables

play11:57

propagate throughout the farm and then

play11:59

use that to predict what these values

play12:01

are throughout the entire farm as I

play12:04

mentioned we've done this for pH

play12:05

moisture and temperature and we're

play12:07

working on other variables as well the

play12:09

key takeaway here is that right now if

play12:11

you look at the startups in the

play12:12

agriculture AG tech space a lot of them

play12:14

are working on either sensors or drones

play12:16

we believe you are the first who's been

play12:18

able to combine them in a meaningful way

play12:20

but we're just starting on the space

play12:21

there's a lot more to be done but this

play12:23

seems like a very promising approach to

play12:26

build these maps at low costs with the

play12:28

TV white spaces you can bring down the

play12:29

cost of each sensor with this technology

play12:32

you need much fewer sensors than what

play12:35

you would otherwise need to build

play12:36

accurate maps like this the third

play12:38

challenge is I mentioned how you can

play12:40

gather a lot of data and bring it to the

play12:42

farmers house over the TV white spaces

play12:44

apply machine learning but the

play12:46

connectivity from the farmers house to

play12:48

the cloud is not that great many farmers

play12:51

they pay for broadband but all they get

play12:53

is one to three megabits per second

play12:54

connectivity in your house just to give

play12:56

an idea of how limiting that is if you

play12:58

fly a UAV a drone in 15 minutes you

play13:01

could be generating over a gigabyte of

play13:03

data you can't send that to the cloud

play13:05

over a 1 to 3 megabits per second

play13:07

connection it will take a long time the

play13:09

other challenge is this connectivity is

play13:11

also prone to outages so there's a

play13:13

farmer in eastern New York on the

play13:14

Vermont border at whose farm we've

play13:17

deployed a system every time there is a

play13:19

snowstorm there's a high likelihood that

play13:21

his internet connection goes off so in

play13:23

that case even if we connect the data

play13:25

but we can't provide this information to

play13:26

the farmer it's of no use

play13:28

so to solve this problem what we do our

play13:31

key insight was that most farmers have

play13:32

pcs if they don't have a PC we ship them

play13:34

a box

play13:36

when everything inside this blue box

play13:37

runs on the farmers PC takes data from

play13:41

sensors from drones it's able to over

play13:43

the TV white spaces it then does a lot

play13:45

of this aerial image regeneration it

play13:47

does the machine learning piece the heat

play13:49

map generation all of that in the

play13:51

farmer's house itself it then we then

play13:54

feed this into the AG services that the

play13:57

blocks and blue are the ones we've

play13:58

already built the other ones are the

play13:59

ones we were working on of course as I

play14:01

mentioned my background is not in

play14:03

agriculture so we partner with people

play14:05

who understand agriculture the

play14:06

agronomist farmers to build all those

play14:08

services the other thing is that a lot

play14:10

of data stays in the farmers house we

play14:13

are not sending all the data to the

play14:14

cloud for example the detailed drawn

play14:17

imagery the gigabytes of video you can't

play14:19

ship all of that to the cloud but we

play14:21

transport it compress it and send a

play14:22

compressed version to the cloud so these

play14:25

are some of the unique features on the

play14:26

left of this entire system it can also

play14:28

run offline we can disconnect the system

play14:30

from the year and their Ethernet and it

play14:32

continues to run so just to give you an

play14:34

idea of what or how farmers are using it

play14:36

we've deployed it in quite a few farms

play14:38

now I'll talk about two of them one is a

play14:40

small farm it close to Microsoft campus

play14:43

the small older farmer and the other is

play14:45

a 2,000 acre farm in upstate New York

play14:48

the kind of insights we can provide to

play14:51

the farmers or I'll walk you through

play14:52

some of them this is a full kilometer

play14:54

stretch the farmer in New York he wanted

play14:56

to know how his cows are doing we flew

play14:59

the drone and within 30 minutes we

play15:01

transferred the data with the TV white

play15:03

spaces to this PC and we can start

play15:05

generating insights like the grass is

play15:07

growing back well from left to right

play15:09

there is a water puddle that needs to be

play15:12

fixed before the next planting season

play15:14

the cows are pooping well which is also

play15:16

important information for the farmer

play15:18

this is where the cows are and this is a

play15:21

stray cow that needs to be herded in all

play15:23

of this within 30 minutes of flying the

play15:25

drone the state-of-the-art is people

play15:27

would fly the drone take the SD card out

play15:29

go to a city upload all the data wait

play15:31

for 24 hours by that time the strake I

play15:33

would have gone somewhere else with this

play15:34

we can generate all of this within 30

play15:36

minutes other kind of insights this is

play15:38

the farm incarnation we are able to show

play15:40

the farmer beautiful pictures like this

play15:42

this is a soil moisture map where we

play15:44

were able to flag that the top left

play15:46

corner of the farm is still moist even

play15:49

though we did not have a

play15:50

said over there this is after the farmer

play15:52

had applied lime we were able to flag

play15:54

that the dark parts that you see here

play15:56

are still acidic the key question you

play15:58

would ask is how accurate is this so we

play16:00

went to three farms three different five

play16:02

acre plots and we captured a thousand

play16:04

measurements and we asked the question

play16:06

that if we pick just ten of these how

play16:09

accurately can we predict their 990 are

play16:11

the values using the farm beats

play16:14

technique of using aerial imagery with

play16:15

drone sensor data so these are the

play16:17

results for temperature pH and moisture

play16:20

this is how accurate farm beats is and

play16:22

this is how accurate the actual sensors

play16:24

were that is the sensors for example we

play16:27

use for soil temperature would report

play16:28

temperature in one degree Fahrenheit and

play16:30

so on so the key takeaway here is not

play16:32

that we are more or less accurate than

play16:34

the actual sensors themselves but that

play16:36

are our predictions are so close to the

play16:38

actual measurements that they are

play16:40

actually actionable by the farmer then

play16:44

again another scenario was we had

play16:45

cameras in barns streaming data with the

play16:48

TV white spaces very able to flag cows

play16:50

or the cows are moving around well

play16:51

whether some cow is sick all of this

play16:53

because we are doing the TV white spaces

play16:55

and we have a PC where we are running

play16:56

all the all the analysis in the farm

play16:59

itself so you can that's what farm beats

play17:01

is I wanted to make you aware of the

play17:03

food problem and some of the steps that

play17:05

we are taking even not being in the

play17:06

agriculture space of how we can help

play17:09

solve some of the food problem with the

play17:11

TV white spaces we are able to gather a

play17:13

lot of data that didn't exist and

play17:14

applying the latest advances in

play17:16

artificial intelligence and machine

play17:17

learning we can bring actionable

play17:19

insights to the farmers so these are the

play17:22

two farmers we work very closely with

play17:24

the three farmers Shawn mark and Kristen

play17:26

just amazing people so with that I

play17:29

wanted to end the talk thank you

play17:32

[Applause]

Rate This

5.0 / 5 (0 votes)

Related Tags
Precision AgricultureData-Driven FarmingFood ProductionSustainable AgricultureArtificial IntelligenceMachine LearningAgricultural TechnologyFarmBeatsMicrosoftGlobal Food Security