WO2019245122A1

WO2019245122A1 - System for monitoring, in real time, growth state of crop in greenhouse on basis of iot

Info

Publication number: WO2019245122A1
Application number: PCT/KR2018/015856
Authority: WO
Inventors: 장영원; 노혜민; 유철중
Original assignee: 주식회사 에스에스엘
Priority date: 2018-06-21
Filing date: 2018-12-13
Publication date: 2019-12-26
Also published as: KR20190143680A

Abstract

The present invention relates to a system for monitoring, in real time, the growth state of a crop in a greenhouse on the basis of IoT, comprising: a camera module for photographing the inside of the greenhouse; a greenhouse data collection module for collecting greenhouse data including a real-time greenhouse atmospheric environment and culture medium data from a plurality of sensors provided inside the greenhouse; a greenhouse environment management module for converting the greenhouse data collected by the greenhouse data collection module into a standardized format by combining, with the collected greenhouse data, a tag including a collection date, position information, and identification information, generating a unit stack by combining the greenhouse data of the standardized format with an image captured by the camera module, and providing the growth state of the crop as a panoramic image by sequentially combining a plurality of unit stacks; and a user terminal for displaying the growth state of the crop, having been generated by the greenhouse environment management module, and, when receiving an input signal for a specific region in the panoramic image, overlapping, on the panoramic image, greenhouse data corresponding to a unit stack displayed in the specific region and displaying same. According to the present invention, the growth state of a crop can be monitored in real time, and can be compared with a reference image so as to remotely control measures necessary for the growth of the crop.

Description

Real-time monitoring system of crop growth status in IoT-based greenhouse

The present invention relates to a real-time monitoring system for crop growth status in an IoT-based greenhouse for observing the growth status of crops using a camera installed in a greenhouse.

Greenhouse-based food and specialty crop cultivation has become the main cultivation system for agricultural production around the world. It is being researched in various ways to leap to new advanced cultivation system such as smart greenhouse or smart farm through convergence with IoT (Internet of Things) technology.

Just as farmers have shifted from an existing open field to a facility cultivation system using greenhouses, there are various reasons for introducing various advanced technologies to greenhouse cultivation, such as convenience of cultivation, efficient management of crops, and increased productivity.

By the way, most modern cultivation systems are focused on controlling the temperature, humidity and sunlight blocking inside the greenhouse, and controlling to keep the greenhouse at a constant state without changing weather or abnormal weather. I'm focused on.

Since a facility cultivation system using a greenhouse is a cultivation cost system that is expensive to maintain and manage, it is necessary to cultivate a crop that can profit more than the growth cost. However, in order to cultivate crops using a greenhouse cultivation system, it is necessary to study the growing environment of the crop grower in order to set the greenhouse temperature, humidity and sunlight suitable for crop cultivation, and trial and error may occur. There is a problem.

The present invention collects the environmental data and the badge data in the greenhouse using a plurality of sensors, by combining the image and the sensed data taken by real-time photographing the crop growth state in the greenhouse through the camera module, to manage in a standardized format, The purpose is to provide a real-time monitoring system for crop growth status in an IoT-based greenhouse for monitoring crop growth status in real time.

In order to achieve the above object, the IoT-based greenhouse crop growth status real-time monitoring system according to an embodiment of the present invention includes a camera module for photographing a greenhouse, real-time greenhouse atmospheric environment, and badge data from a plurality of sensors installed in the greenhouse. A greenhouse data collection module for collecting greenhouse data, including greenhouse data collected from the greenhouse data collection module, and a tag including a collection date, location information, and identification information, are converted into a standardized format, and converted into a standardized format. A greenhouse environment management module for combining greenhouse data with an image taken by the camera module to generate a unit stack, and combining a plurality of unit stacks in time series to provide a growth state of crops as a panoramic image, and the greenhouse environment management module Indicate the growth state of the crop produced in Panoramic when receiving an input signal for a particular region of the image, and the greenhouse data corresponding to the unit stack shown in the particular area comprises a user terminal for displaying by overlapping the panoramic image.

In addition, the IoT-based greenhouse growth status real-time monitoring system for the greenhouse environment control to remotely control at least one facility installed in the greenhouse based on the greenhouse data collected from the greenhouse data collection module or the control input received from the user terminal. It further includes a module.

Here, the at least one facility may include at least one of a window, a nutrient solution, a fan, an air conditioner, an LED light, and a sprinkler.

When receiving the first input through the user terminal, the greenhouse environment management module may overlap the panoramic image with a time point at which the greenhouse data of the standardized format is changed and the changed greenhouse data.

When the user terminal receives the second input, the user terminal may download the standard growth state of the grain from the server and display the standard growth state corresponding to the time point at which the greenhouse data is changed together with the greenhouse data.

The greenhouse environment management module compares the panoramic image with a pre-stored reference image and controls the greenhouse environment control module to increase the greenhouse temperature or humidity or drive the nutrient solution when the growth state of the grain is less than the standard growth state. You can.

The greenhouse environment management module may estimate the yield, biomass, and evapotranspiration based on the environmental data or the medium data.

According to the present invention, the growth state of the crop can be monitored in real time, and the crop yield can be improved by remotely controlling the measures necessary for the growth of the crop compared to the reference image.

In addition, by managing the greenhouse data collected from the various greenhouses in the standardized format by tagging the collection date, location information, identification information of each greenhouse, there is an effect that can be integrated and manage the remote greenhouse data of the remote.

In addition, according to the present invention, the crop growth state can be confirmed in real time using an image photographed through a camera module installed in a greenhouse, and the growth state history can be confirmed as a panoramic image.

1 is a schematic configuration diagram of a real-time monitoring system of crop growth status in an IoT-based greenhouse according to an embodiment of the present invention.

2 is a schematic configuration diagram of a greenhouse data collection module constituting a real-time monitoring system of crop growth status in an IoT-based greenhouse according to an embodiment of the present invention.

3 is a diagram showing a schematic configuration and appearance of the greenhouse environment management module constituting the real-time monitoring system for crop growth state in the IoT-based greenhouse according to an embodiment of the present invention.

4 to 15 are diagrams for explaining greenhouse data, medium data, or a growth state of crops to which a real-time monitoring system for growing crops in an IoT-based greenhouse according to an embodiment of the present invention is applied.

FIG. 16 is a view for explaining an implementation model of a real-time monitoring system for crop growth status in an IoT-based greenhouse according to an embodiment of the present invention.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be described in detail with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes any of a plurality of related description items or a combination of a plurality of related description items.

When a component is said to be "connected" or "connected" to another component, it may be directly connected to or connected to the other component, but it should be understood that there may be other components in between. something to do. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Throughout the specification and claims, when a part includes a certain component, it means that it may further include other components, except to exclude other components unless specifically stated otherwise.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1, the IoT-based greenhouse growth status real-time monitoring system 1000 according to an embodiment of the present invention includes a greenhouse data collection module 100, a camera module 300, a greenhouse environment management module 500, and And a user terminal 700. In addition, the IoT-based greenhouse growth status real-time monitoring system 1000 may further include a greenhouse environment control module 200 or at least one facility 300.

The greenhouse data collection module 100 may collect greenhouse data including a real-time greenhouse atmospheric environment and badge data from the sensors from the plurality of sensors installed in the greenhouse. Here, the plurality of sensors may be at least one of a temperature sensor, a humidity sensor, an illuminance sensor, a carbon dioxide measuring sensor, a weight sensing sensor of a medium, a pH measuring sensor, a geothermal measuring sensor, and an EC measuring sensor. Different kinds of sensors may be installed in a greenhouse at regular intervals.

Referring to FIG. 2, the greenhouse data collection module 100 includes an environmental data measuring instrument 100, a badge data measuring instrument 130, and a measuring instrument management unit 150. The environmental data measuring instrument 110 may include a temperature sensor 111, a humidity sensor 112, a carbon dioxide sensor 113, and an illuminance sensor 114 among a plurality of sensors. In addition, the badge data measuring instrument 130 may include a badge weight sensor 131, a PH sensor 132, a geothermal sensor 133, and an EC sensor 134. Here, the weight of the medium may be calculated by calculating at least one of the number of nutrient solution supply, the nutrient supply amount, and the culture solution of the medium.

The environmental data measuring instrument 110 and the discharge data measuring instrument 130 are each inserted into and fixed to an interface port, and are electrically connected to the measuring instrument manager 150 by electrical connection of each port to transmit and receive control signals and sensing data. can do.

In detail, the instrument management unit 150 communicates with the environmental data measuring instrument 110 and the badge data measuring instrument 130 by RS-232 communication, respectively, and the environment sensed by the environmental data measuring instrument 110 and the badge data measuring instrument 130. Data and badge data may be received and sensor control signals may be transmitted to the environmental data meter 110 and the badge data meter 130. That is, the first group of sensors installed above the set height from the ground to detect environmental data in the air is physically connected to the environmental data measuring instrument 110, and installed below the set height to detect the badge data. A plurality of sensors may be easily managed by physically connecting the second group of sensors to the discharge data meter 130. Thus, if the sensor is lost or broken, a quick replacement is possible.

The measuring instrument manager 150 is connected to the greenhouse environment management module 500 by wired or wireless internet, and the environmental data and badge data collected from the environmental data measuring instrument 110 and the badge data measuring instrument 130 are stored in the greenhouse environmental management module 500. ) Can be sent. In addition, the instrument manager 150 may receive control signals for the environmental data measuring instrument 110, the badge data measuring instrument 130, and sensors constituting each of the measuring instruments from the greenhouse environment management module 500 and transmit the control signals to the corresponding measuring instruments. have.

Next, the greenhouse environment control module 200 may remotely control at least one facility 300 installed in the greenhouse based on the greenhouse data collected from the greenhouse data collection module 100. Here, the at least one facility 300 may be at least one of a window installed in a greenhouse, a nutrient solution, a fan, an air conditioner, an LED light, a sprinkler, and a fog generator.

The camera module 300 may photograph the inside of the greenhouse. The camera module 300 may be installed at regular intervals in the greenhouse to capture an image of a crop corresponding to a preset area.

In addition, the greenhouse environment management module 500 may combine a tag including collection date, location information, and identification information with greenhouse data collected from the greenhouse data collection module 100 and convert the tag into a standardized format. In this case, the greenhouse environment management module 500 may combine the greenhouse data of the standardized format with the image captured by the camera module 300 to generate and manage a unit stack. The greenhouse environment management module 500 may combine a plurality of unit stacks in time series to provide a panoramic image of the growth state of crops.

The greenhouse environment management module 500 remotely controls the greenhouse environment control module 200 to change setting values of at least one facility when the greenhouse data, the stack image, or the panoramic image of the standardized format is out of a range of preset conditions. You can generate a signal. The at least one facility 300 may control the on or off of the corresponding facility or control the operating time, operation speed, etc. according to the remote control signal of the greenhouse environment management module 500. For example, when it is determined that the stack image is later than the reference image, the greenhouse environment management module 500 may control the greenhouse environment in a direction capable of increasing the growth rate. On the contrary, when the stack image is determined to be faster than the reference image, the greenhouse environment management module 500 controls the greenhouse environment in a direction capable of reducing the growth rate to control the crop to grow to a certain size. It can improve the marketability.

Referring to FIG. 3, the greenhouse environment management module 500 includes a display unit 510, a database 520, and a controller 530.

In detail, the display unit 510 may display a control state of at least one facility 300. At this time, the name and location of each facility can be represented by a specific indicator (W1, W2, ..., L1, L2, ..., C1, C2, ...), LED on / off, lighting indicated by the specific indicator The brightness, lighting color, etc. can be adjusted to display the control status of each facility.

The greenhouse environment management module 500 may convert the past history, standard information, and comparison information of the greenhouse data into a standardized graph or table and provide the same to the user terminal 700. In addition, the greenhouse environment management module 500 may manage the image photographed by the camera module 400 in conjunction with the tagged greenhouse data with reference to the tag. The greenhouse environment management module 500 may automatically calculate and predict the yield, biomass, and evapotranspiration based on the medium data.

The user terminal 700 displays the greenhouse data of the standardized format converted by the greenhouse environment management module 500 and at least one facility 300 installed in the greenhouse on the execution screen, and the specific greenhouse data or the specific facility displayed on the execution screen. When receiving the input signal for the greenhouse environment management module 500 may transmit the input signal. In this case, when the greenhouse environment management module 500 receives an input signal from the user terminal 700, the greenhouse environment management module 500 may further transmit a remote control signal to a specific facility to remotely control the specific facility. That is, the greenhouse environment management module 500 may further perform an operation corresponding to the user input when the user input for a specific facility operation is simultaneously received while remotely controlling at least one facility automatically using the sensed data. have. In this case, when the operation remotely controlled and the operation by the user's input are in conflict, the user's input may be preferentially executed. For example, the greenhouse environment management module 500 automatically transmits a control signal for operating the air conditioner, and then, when receiving an input signal for turning off the air conditioner through the user terminal 700, preferentially selects a user input. Can turn off the air conditioner. In this case, before executing the user input, the user terminal 700 may display a content indicating that an input opposite to the remote control operation is received in a pop-up window to induce the user to reselect.

Referring to FIG. 4, the medium data measurement module may automatically measure the medium weight of the cultivated crops on the module to calculate the number of nutrient solution supply, nutrient solution, supply amount, and drainage amount of the medium.

5 to 13, the greenhouse environment management module may receive temperature, humidity, wind direction, wind speed, sunrise / sunset time, and weather forecast, which are real-time weather data outside the greenhouse, for monitoring the greenhouse environment. have.

The greenhouse data collection module may sense temperature, humidity, illuminance, carbon dioxide, EC, PH, and geothermal data of a medium in real time, and provide the sensed data to a greenhouse environment management module or a user terminal. In this case, the greenhouse environment management module may process and manage and provide each data in a standardized format.

The greenhouse environment management module may automatically generate basic information for temperature / humidity control based on microclimate data, and provide a current temperature / humidity state of the greenhouse and a work guide accordingly. In addition, the greenhouse environment management module may provide a statistical chart of the collected data on a daily / weekly / monthly basis and display an ideal reference range together.

The greenhouse environment management module provides real-time data on the water content and the drainage amount at the time of monitoring, and calculates and provides the daily total number of times of feeding, the amount of feeding time and amount of each feeding, the total amount of water, and the total amount of draining.

Based on the medium data, the greenhouse environment management module may provide a graph so that the daily change trend of illuminance, medium weight, and drainage amount used for nutrient solution supply control can be identified at a glance.

In addition, the greenhouse environment management module may convert the past greenhouse environment and badge information history into a standardized format and store it in a database. Based on the data stored in the database, the greenhouse environment management module can query the greenhouse environment and the badge information from the past to the present, thereby comprehensively managing the growth of crops according to the change of the greenhouse environment. The greenhouse environment management module can additionally record the cultivation status and specificities that occurred on a specific date, and can select time-based monitoring items and required work based on the recorded data. The greenhouse environment management module may generate a selected monitoring item and a required task as a new tag, and additionally collect and manage new tag items when managing the greenhouse environment data and badge data from the time when a new tag is created.

The greenhouse environment management module may combine and store crop images in the greenhouse photographed through the camera module with tagged environmental data and badge data. The greenhouse environment management module may display crop growth state stored in chronological order, or display crop images by using tagged information such as location (by greenhouse location), temperature, and humidity as a filter.

Referring to FIG. 16, an implementation model of a real-time monitoring system for crop growth status in an IoT-based greenhouse according to an embodiment of the present invention is an information center (or database) for storing sensing data collected from data collection modules installed in a greenhouse and a house. ) May be included.

For efficient data management and cultivation information management, an optimal database schema definition can reliably store large amounts of data and can quickly process external requests and responses.

In addition, the IoT-based greenhouse environment management system may monitor access permission so that only registered users can access and perform user data encryption. It functions to permanently store data periodically received from the sensor, and can process cultivation history and real-time data requests from user applications.

A test bed may be installed for a plurality of greenhouses, and the greenhouse environment management module may collectively manage environmental data, medium data, and crop growth status in the plurality of greenhouses. In addition, when the greenhouse environment management module receives a request for information on its own greenhouse from a registered user terminal, the user receives a user authentication, searches for a greenhouse matching the registered user terminal, and transmits the information of the corresponding greenhouse to the user terminal. Can be.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

It is possible to monitor the growth status of the crops in real time and improve the crop yield by remotely controlling the measures necessary for the growth of the crop compared to the reference image.

Claims

A camera module for photographing the greenhouse;

A greenhouse data collection module for collecting greenhouse data including a real-time greenhouse atmosphere environment and badge data from a plurality of sensors installed in the greenhouse;

Combine the tag including the collection date, location information, and identification information to the greenhouse data collected from the greenhouse data collection module into a standardized format, and combine the greenhouse data of the standardized format with the image captured by the camera module. A greenhouse environment management module for generating a unit stack and combining a plurality of unit stacks in time series to provide a panoramic image of a growing state of a crop; And

When the growth state of the crop generated by the greenhouse environment management module is displayed and an input signal for a specific region is received in the panoramic image, the greenhouse data corresponding to the unit stack displayed in the specific region is overlapped with the panoramic image. To include; the user terminal to display

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 1,

And a greenhouse environment control module for remotely controlling at least one facility installed in the greenhouse based on greenhouse data collected from the greenhouse data collection module or a control input received from the user terminal.

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 2,

The at least one installation comprises at least one of a window, a nutrient solution, a fan, a heating and cooling device, LED lighting,

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 1,

When the greenhouse environment management module receives the first input through the user terminal, the greenhouse environment management module overlaps the panoramic image with a time point at which the greenhouse data of the standardized format is changed and the changed greenhouse data.

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 4, wherein

When the user terminal receives the second input, the user terminal downloads the standard growth state of the grain from the server, and displays the standard growth state corresponding to the time point at which the greenhouse data is changed together with the greenhouse data.

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 1,

The greenhouse environment management module compares the panoramic image with a pre-stored reference image, and when the growth state of the grain is lower than the standard growth state, the greenhouse environment control module is controlled to increase the greenhouse temperature or humidity or the nutrient solution. Driven,

Real-time monitoring system of crop growth status in IoT based greenhouse.
The method of claim 1,

The greenhouse environment management module, based on the environmental data or the medium data to predict the yield, biomass, evaporation amount,

Real-time monitoring system of crop growth status in IoT based greenhouse.