JP2021184286A - Environment monitoring system and method - Google Patents

Abstract

To accurately and efficiently collect environment data of a farm crop cultivation area.SOLUTION: In an environment monitoring system including: a data collector which collects image data of farm crops; and a server device which receives and registers the image data transmitted from the data collector and also transmits the registered image data to a user terminal, upon reception of the image data, for each set time zone division, the server device registers the received image data when the registered image data is not present in the time zone, and when the registered image data is present, the server device determines a degree of similarity between the image data which has a newest time stamp among the registered image data, and the received image data, and determines whether or not to register the received image data based on a result of the determination.SELECTED DRAWING: Figure 1

Description

The present invention relates to an environmental monitoring system using a computer network, and more particularly to an environmental monitoring system that stores environmental data and growth conditions of crop cultivated areas in a server and transmits them to a user terminal in a timely manner.

Conventionally, a technique has been proposed in which data such as a temperature sensor installed in a cultivation area of an agricultural product is transmitted to a server, stored, and distributed as history information to a mobile terminal of a user who performs agricultural work.

For example, in Patent Document 1, in order to provide a farmer with necessary equipment and functions at low cost, agricultural production information acquired by the farmer is stored in a farmer's database, stored in a center database via a farmer's server, and used by a user. A system that enables the collection, storage, update, and data processing of agricultural production information in the center database by the terminal accessing the center server is described.

Japanese Unexamined Patent Publication No. 2005-38019

By the way, in recent years, wireless LAN technology such as WiFi and communication technology such as 3G line have become widespread, and it is conceivable to use this technology to connect a device on the user side to a network such as the Internet to communicate with a server device. In particular, when monitoring the growth status of agricultural products, it is necessary to connect a data collection device installed on the cultivated area side to the network in addition to the mobile terminal that displays the data. At this time, when connecting to a network using the above communication technology, it is desirable that data necessary for network connection such as SSID and password can be easily set in the data collection device when a wireless LAN is adopted.

Further, since the user may check the environmental information through the mobile terminal while working in the field or the shipping place, the problem is how to provide an easy-to-operate user interface. Furthermore, when trying to collectively manage environmental information on a server, there is also the problem of how to efficiently store data due to the problem of storage capacity.

The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide an environmental monitoring system capable of collecting environmental data of crop cultivated land accurately and efficiently.

In order to achieve the above object, the environmental monitoring system according to the present invention stores and stores a data collection device that collects environmental data of agricultural crop cultivation areas and environmental data sent from the data collection device. An environmental monitoring system including a server device that transmits the environmental data to a user terminal.
When the environmental data is deficient, the server device executes a complement process to supplement the environmental data by using the non-defective data among the deficient environmental data based on the data loss rate. It is characterized by doing.

When the environmental data is continuously deleted, it is preferable that the server device sequentially complements the environmental data by using the data complemented by the complement processing. For example, when the data loss rate is equal to or less than a certain value, the server device supplements the missing data with the stored data, and when the data loss rate exceeds a certain value, the data without loss is first present. It is advisable to supplement the missing data by using the above, and thereafter, use the complemented data to sequentially complement the missing data. This enables highly accurate data complementation.

In addition, the data collection device of the environmental monitoring system according to the present invention periodically captures image data of the crop cultivated area and transmits it to the server device.
The server device includes a similarity determination means for determining the similarity between two images.
The similarity determination means compares the received image data with the latest stored image data, and performs a thinning process to save the received image data only when the similarity is equal to or less than a predetermined constant value. It is characterized by executing.

According to the present invention, since only the image data sent from the data collection device with a large change to some extent is accumulated, it is possible to save the storage capacity without deteriorating the monitoring function. In the present invention, when the image data is first received, there is no saved image data, so the received image data is saved as it is.

Preferably, the similarity determination means preferably executes the thinning process for each predetermined time zone division. For example, by executing the thinning process in units of one hour, even if there is no change in the image, it will be accumulated once an hour. This, in combination with the function of the condition determination means described later, enables efficient image display (slide show).

The server device of the environment monitoring system according to the present invention extracts image data after the start time and closest to the start time based on the start time and acquisition interval sent from the user terminal, and the extracted image data. The acquisition interval is added for each number of extractions based on the time information of the above, and the condition determination means for sequentially extracting the image data closest to the added value is provided. In the present invention, the image required for the slide show can be accurately extracted from the image data accumulated by the thinning process.

As described above, according to the environmental monitoring system of the present invention, it is possible to collect environmental data of crop cultivated areas accurately and efficiently.

It is a functional block diagram of the environment monitoring system 1 by embodiment of this invention. It is explanatory drawing of the user registration process and the network connection process of the environment monitoring system of FIG. This is an example of the alarm / target setting screen displayed on the mobile terminal of FIG. 1. 1 is an explanatory diagram of a setting screen displayed on the mobile terminal of FIG. 1, FIG. 4A is an example of a setting screen for setting information such as position information of a data collection device, and FIG. 4B is an arrangement of display items of monitoring data. This is an example of the order setting screen. This is an example of a screen when the screen is displayed on a personal computer according to the embodiment of the present invention. This is an example of a list screen displayed on the mobile terminal of FIG. This is an example of a detailed screen displayed on the mobile terminal of FIG. 1. It is another example of the detail screen displayed on the mobile terminal of FIG. It is explanatory drawing of the screen example and display processing at the time of the display switching is necessary in the screen of the mobile terminal of FIG.

The environmental monitoring system according to the embodiment of the present invention will be described below with reference to the drawings.
In FIG. 1, the environmental monitoring system 1 is stored in a data collecting device 10 installed in a field and collecting environmental data, a server device 30 connected to the data collecting device 10 via a network 2, and a server device 30 for storing environmental data. It is equipped with a mobile terminal 5 that displays the environmental data after processing such as graphing. As the mobile terminal 5, a user-owned mobile phone can be used. Further, in the present embodiment, the data collection device 10 will be described below assuming that the data collection device 10 is connected to the network 2 via the wireless LAN router 3.

The data collection device 10 includes a soil moisture sensor 14a, an illuminance sensor 14b, sensors 14 such as a temperature sensor 14c, a Web camera 15, a calculation processing unit 12 including a CPU, and a storage unit for storing data. 13. It is equipped with a communication unit 11 having a wireless LAN function such as WiFi. The communication unit 11 has both functions of a master unit mode and a slave unit mode, and operates in either mode by a switching command from the arithmetic processing unit 12.

The arithmetic processing unit 12 of the data collection device 10 is via an initial setting means 21 that performs initial settings at startup, an input processing means 22 that inputs signals and image data output from sensors 14 and a Web camera 15, and a communication unit. It includes a communication processing means 23 that communicates with an external device, and a switching command output means 24 that outputs a switching command between a master unit and a slave unit to a communication unit. Each means 21 to 24 can be realized by a program as a function of the CPU.

The server device 30 includes a communication unit 31 connected to a network, an arithmetic processing unit 32 for executing arithmetic processing, and a storage unit 33 for storing data. Further, the arithmetic processing unit 32 of the server device 30 registers the user information such as the user's email address in association with the user ID, the user information registration means 41, and the terminal information of the data collection device 10 in association with the user ID. It is set for each user: a registration means 42, an input / output processing means 43 for executing data transmission / reception with the data collection device 10 and the mobile terminal 5, a similarity determination means 44 for determining the similarity between two images, and a user. The condition determination means 45 for determining whether or not the condition is satisfied is provided based on the alarm condition of the environmental data and the extraction condition of the image data.

The mobile terminal 5 supports the connection of the communication unit 61 that communicates with the network 2, the wireless LAN router 3, or the data collection device 10, the arithmetic processing unit 62 that executes arithmetic processing, and the data collection device 10 to the wireless LAN router 3. It has a network connection support means 52, a display processing means 51 that executes display processing of environment data sent from the server device 30, and a display screen 64 that displays information and accepts touch operations. Each means 51 and 52 is downloaded from the server device 30 and executed as a program or as a language executed on a Web browser.

The data collection device 10 is connected to the network 2 through a wireless LAN router 3 provided near the installation location, and transmits the collected data to the server device 30. On the other hand, the mobile terminal 5 communicates with the server device 30 through a wireless LAN router, a 3G line, or the like.

The environment monitoring system 1 is configured by a client-server model, a cloud computing form, and the like, but is not limited thereto.

Next, the operation of the environment monitoring system 1 having the above configuration will be described. In the following description, the data acquisition device 10 will be referred to as a sensor box (or "box") 10.

1. 1. Initial setting process First, the user registration process and the network connection process of the environment monitoring system 1 will be described with reference to FIG.

(1) User registration process (step A1) The user activates the initial setting application program of the mobile terminal 5 and acquires GPS data (location information).
(Step A2) Next, the user inputs an e-mail address, a password and other information necessary for user registration into the mobile terminal 5 and sends the information to the server device 30.
(Step A3) When the user information registration means 41 of the server device 30 receives the user information, it stores it in the storage unit 33. The user information registration means 41 also issues a user ID and transmits it to the mobile terminal 5 of the user.
(Step A4) When the mobile terminal 5 receives the user ID transmitted from the server device 30, it stores it in the storage unit 63 of the mobile terminal 5.

(2) Network connection processing The user must then connect the sensor box 10 to the network 2 to enable data transmission with the server device 30, which can be easily done by the following procedure. You can make a reliable connection.

(Step A5) The user first searches for a wireless LAN (SSID) around the sensor box installation location using the mobile terminal 5. Then, among the wireless LAN routers in the list displayed on the wireless LAN setting confirmation screen of the mobile terminal 5, the sensor box 10 selects the wireless LAN router 3 used for network connection. The user then inputs a password for accessing the wireless LAN router 3.

(Step A6) When the user finishes inputting necessary information on the wireless LAN setting confirmation screen of the mobile terminal 5 and touches the OK button, the input information is saved in the storage unit 63 and the wireless terminal 5 wirelessly. The connection to the LAN router 3 is made.
(Step A7) The mobile terminal 5 accesses the server device 30 via the wireless LAN router 3.

(Step A8) The input / output processing means 43 of the server device 30 returns OK to the mobile terminal 5 when there is an access from the mobile terminal 5 via the wireless LAN.
(Step A9) Upon receiving the reply from the server device 30, the mobile terminal 5 activates the network connection support means 52 for setting the network of the sensor box 10.

(Step A10) The user then presses the switch 16 provided on the sensor box 10. When the switching command output means 24 of the sensor box 10 detects that the switch 16 is pressed, the wireless LAN function of the communication unit 11 is set to the master unit mode. As a result, the sensor box 10 and the mobile terminal 5 can be connected by wireless LAN. When the network connection support means 52 of the mobile terminal 5 detects that communication with the sensor box 10 has become possible, the sensor box 10 stores the SSID, password, user ID, and location information stored in the storage unit 63. Send to.

(Step A11) The user also makes necessary adjustments such as the orientation of the Web camera 15 in the sensor box 10 through the mobile terminal 5.
(Step A12) After completing the necessary adjustments, the user touches the setting completion button displayed on the mobile terminal 5. As a result, the setting completion notification is transmitted from the mobile terminal 5 to the sensor box 10.

(Step A13) Upon receiving the setting completion notification, the switching command output means 24 of the sensor box 10 disconnects the communication with the mobile terminal 5, switches the wireless LAN function of the communication unit 11 to the slave unit mode, and communicate processing means. Start 23.
(Step A14) Then, the communication processing means 23 of the sensor box 10 executes the connection process with the wireless LAN router 3 by using the SSID and the password received from the mobile terminal 5.

(Step A15) After connecting to the wireless LAN router 3, the communication processing means 23 of the sensor box 10 transmits a user ID, location information, and other necessary information to the server device 30 via the wireless LAN router 3.
(Step A16) When the terminal information registration means 42 of the server device 30 receives the information necessary for registration from the sensor box 10, it issues a terminal ID and transmits it to the sensor box 10. When the communication processing means 23 of the sensor box 10 receives the terminal ID, it stores it in the storage unit 13.
(Step A17) The input / output processing means 43 of the server device 30 notifies the user's mobile terminal 5 of a message to the effect that the connection with the sensor box 10 is completed.

By the above processing procedure, the environment monitoring system 1 connects the sensor box 10 and the wireless LAN router 3, and transmits the basic information of the sensor box 10 to the server device 30.

2. 2. Data collection / storage processing The input processing means 22 of the sensor box 10 periodically acquires predetermined environmental data and images from the sensors 14, for example, every 2 minutes. The environmental data includes soil moisture content, illuminance, temperature, etc., which are data acquired from sensors, but are not limited to these, and may include, for example, meteorological data acquired from the Japan Meteorological Agency DB via network 2. .. The acquired data is transmitted to the server device 30 via the communication unit 11 by the communication processing means 23 of the sensor box 10.

When the input / output processing means 43 of the server device 30 receives the data sent from the sensor box 10, it first determines whether or not the data is received for the first time. Then, in the case of the first time, the received data is stored in the storage unit 33. If it is not the first time, it is determined whether or not the preset accumulation conditions are met, and if the conditions are met, the data is saved together with the time stamp. If the conditions are not met, the process ends as it is.

(How to thin out images)
The input processing means of the sensor box 10 acquires the measurement data of the sensors 14 and the captured image of the Web camera 15 at a predetermined cycle, for example, every two minutes, and the acquired data is transmitted to the server device via the communication processing means 23 and the communication unit 11. Send to 30.

The server device 30 that has received the data processes the image data according to the following procedure.
1) The input / output processing means 43 of the server device 30 stores the image data in the temporary area. 2) The input / output processing means 43 also accesses the data list table which is a list of the stored data (including the image data). Then, among the registered data, the file name of the image data is set in the time zone to which the time stamp of the image data to be registered belongs (for example, when the time zone is divided into hour units, the xx time zone). Check if is recorded. If the registered image does not exist in that time zone, the received image data is adopted, the file name of the image data is registered in the data list table, and the process ends.

3) When the registered image exists in the data list table, the input / output processing means 43 activates the similarity determination means 44, and the image having the latest time stamp among the registered images is similar to the received image. Determine the degree. Existing techniques can be used to determine the similarity between two images.

4) As a result of the determination, if the similarity is equal to or less than a predetermined threshold value, it is assumed that the image has changed by a certain amount or more, and the received image is registered in the data list table. On the other hand, if the similarity is larger than the threshold value as a result of the determination, the received image is discarded and the process is terminated, assuming that there is no significant change in the image. The library libpuzzle can be used as the similarity determination means 44. However, since this library outputs a smaller value as the images are similar, it is registered as if there is a certain change when the threshold value (for example, 0.2) or more is used.

Since the amount of image data stored in the server device 30 is enormous, the storage capacity is tight. However, by the above-mentioned method, the change of the image is accurately transmitted to the user, and the storage is efficient. It is possible to reduce the capacity.

(How to supplement the integrated temperature including missing values)
Next, processing when a defect occurs in the collected data will be described. In this case, as shown below, by changing the processing content according to the number of data missing per predetermined period (for example, one day), highly accurate data complementation becomes possible.

The following is an example of complementing the temperature data, but the 1-hour value is used to calculate the average value of the integrated temperature, and if there is a defect, the number of days with the defect is displayed and the data for 3 days is used. It is good to display the complement.

1) Conditional branching of the defect method Assuming that integrated temperature data is collected in 1-hour units, if the number of data per day is 21/24 or more, that is, a total of 24 integrated temperatures will be collected in one day. When more than one piece of data can be collected (data loss rate of about 10% or less) or 20/24 or less (data loss rate of about 10% or more), branching is performed as follows.
・ If it is 21/24 or higher, the average value of all existing data will be the average temperature of the day.
・ If it is 20/24 or less, it is calculated from the data of other days (averaged with the data of the predetermined number of days described later) and used as the average temperature of that day.

2) Method of averaging the data for a predetermined number of days The following will be described by taking as an example the method of using the average value of the data for 3 days up to 3 days before the day to be complemented. In this method, even if the missing days continue, the complemented data is used to sequentially complement the data.

For example, if the temperature for each date is expressed as a date (temperature), the collected data will be August 1 (30.0 degrees), August 2 (29.0 degrees), and August 3 (32 degrees). It is assumed that it was (0.0 degrees), August 4 (deficiency), August 5 (deficiency), and August 6 (35.0 degrees).

In this case, for August 4th, when there was a data loss, the average value (30.3 degrees) for the three days before the data loss, that is, August 1st to 3rd, was calculated, and this was calculated on August 4th. Used as temperature. For August 5, the average temperature of 30.4 degrees on the previous 3 days, that is, August 2 to 4, is used. At this time, the supplemented temperature data is used for August 4.

By complementing the missing data sequentially from the data acquisition start date by this complementing procedure, the integrated value of the measured data can be calculated even if there is a missing value.

3. 3. Monitoring process (1) Alarm condition setting process The alarm condition is to notify the mobile terminal 5 when the accumulated data in the server device 30 corresponds to the condition.

FIG. 3 is an example of an alarm / target setting screen displayed on the mobile terminal 5. The data set on this screen is sent to the server device 30, and is stored in the storage unit 33 by the input / output processing means 43. The alarm set values include, for example, the upper and lower limits of temperature and humidity, and the target values include the integrated temperature.

The condition determination means 45 of the server device 30 constantly monitors whether or not the collected data exceeds this alarm set value, and if the collected data exceeds the alarm set value, push notification or e-mail notification is sent to the preset alarm notification destination. ..
The alarm can be paused, in which case a message indicating that the alarm is being paused is displayed on the mobile terminal.

FIG. 4A is an example of a setting screen for the name (device label) of the sensor box 10 and an installation location, and FIG. 4B is an example of a display item and an arrangement order setting screen. The display processing means 51 of the mobile terminal 5 displays important index items in a list (overview), and displays data in the order of display items. FIG. 5 is an example of a screen when displaying on a personal computer. The layout is different from that of mobile terminals, but the display data is basically the same as that of mobile terminals.

(2) Monitoring screen display The monitoring screen consists of an overview screen and a detail screen. FIG. 6 is an example of a list screen displayed on the mobile terminal 5. Items set as important index items in FIG. 4B are listed on this screen. 7 and 8 are examples of detailed screens.

(3) Screen switching process for time-series data, etc. Next, the display process when screen switching is required will be described with reference to FIG.
The display screen 64 of the mobile terminal 5 of the present embodiment moves the time series and displays data by detecting a touch operation in a predetermined range including arrows arranged on the left and right sides of the screen. If there is update data, the button arranged in the center of the lower part of the screen is displayed as an animation to inform the user of the existence of the update data, and the data is updated by detecting the touch operation of the button.

The arrows 81 and 82 arranged on the left and right sides of the screen are displayed surrounded by semicircular and semi-transparent operation areas 91 and 92 having a radius of 44 pixels or more. The mobile terminal detects a touch operation in the operation area and executes a display movement process in the direction of the arrow.

It is preferable to hide this operation area when it is not needed. For example, when the touch operation is not detected for a certain period of time, the operation area including the arrow is hidden. Then, by detecting the touch operation at an arbitrary position on the display screen 64, the operation area is set to the display state. As a result, the entire information display area can be made easier to see, and the user can reliably and easily perform the movement operation when necessary.

In particular, it is assumed that the user uses the mobile terminal while performing some work such as farm work and shipping preparation work. By the above method, while displaying necessary information in a limited screen area, the user can operate the screen without mistake while working.

In the display screen 64 of the mobile terminal 5, it is preferable that a certain range outside the operation input reception areas 91 and 92 is set as an operation input reception prohibition area, and this area does not accept any operation input. This area can be a semicircle having the same center as the operation input receiving areas 91 and 92. As a result, erroneous input can be reliably prevented.

Further, the display processing means 51 erases the operation input reception areas 91 and 92 from the display screen 64 after a certain period of time has elapsed after the operation input reception areas 91 and 92 are displayed, and then touches any part of the display screen 64. If it is detected, the operation input receiving areas 91 and 92 may be displayed again.

(4) Photo screen display processing Hereinafter, a photographic image display processing executed by the display processing means 51 of the mobile terminal 5, particularly an effective slide display method using thinned data will be described.
(Step S1) First, the start date and time, the end date and time, and the acquisition interval are specified and called.
After that, the display processing means 51 acquires and displays the image list in the following order.
(Step S2) Acquire the latest data with an image. (Display on the first sheet)

(Step S3) The number of acquisitions is calculated from the first time of the time to be displayed within the specified range.
For example, when the start date and time is from 00:00 on January 1, 2015 and the acquisition interval is every 3 hours on the hour, the time stamp of the accumulated image data is January 1, 2015 1: 00 to 2015 1. In the case of 0:00 on the 2nd of the month, the first time will be 3:00 on the 1st of January 2015, and the number of acquisitions will be 8.

(Step S4) Among the data in which images are registered in the range of 1.5 hours before and after the start time, the data at the time closest to the start time is added to the slide list.
After (step S5), add 3 hours to the start time for the number of acquired data and add the data to the slide list in the same manner.
(Step S6) The images registered in the slide list are sequentially switched and displayed at predetermined time intervals.

As described above, according to the present embodiment, in the screen display of the mobile terminal, the display screen can be easily and surely switched by the semicircular operation input receiving areas provided at the left and right ends of the display screen. This allows the user to do other work while checking the environmental data. Further, in the server device, since the thinning process of accumulating only the image data having a low degree of similarity is executed, the storage capacity can be saved. At this time, be sure to save the first acquired image at the time of switching the time zone for each time zone, and set the time interval when the slide show of the photographic image is specified to a value equal to or higher than the time zone. , The user will be able to perform an effective slide show that can accurately grasp the state of change, even when there is little change.

According to the present embodiment, further, the data necessary for network connection is set in the sensor box via the mobile terminal, and the user normally connects the sensor box and the server device by the notification sent from the server device to the mobile terminal. Since it is possible to know that a communication connection has been made, a reliable and efficient network connection is possible without providing a user interface in the sensor box.

The present invention is not limited to the above-described embodiment, and can be variously modified and implemented without departing from the gist thereof. For example, when a communication error occurs, the wireless LAN router cannot be controlled from the sensor box side, so it is necessary to reset it manually. For this reason, by installing a 3G line communication function in the sensor box and using the telephone number of the 3G line, complicated wireless LAN settings are not required, and it is possible to link with the user by the telephone number. .. Further, since the built-in 3G line can be controlled, when a communication abnormality is detected, communication is restored by reconnecting, and it can be expected to prevent data loss.

Further, in the present embodiment, the collected data is periodically transmitted from the sensor box to the server device, but the threshold value for each data type is made downloadable to the sensor box, and the value exceeds the threshold value on the sensor box side. It may be sent to the server device when it becomes.

1 Environmental monitoring system 2 Network 3 Wireless LAN router 5 Mobile terminal 10 Data acquisition device (sensor box)
11, 31, 61 Communication unit 12, 32, 62 Calculation processing unit 13, 33, 63 Storage unit 14 Sensors 14a Soil moisture content sensor 14b Illumination sensor 14c Temperature sensor 15 Web camera 16 Switch 21 Initial setting means 22 Input processing means 23 Communication processing means 24 Switching command output means 30 Server device 41 User information registration means 42 Terminal information registration means 43 Input / output processing means 44 Similarity judgment means 45 Condition judgment means 51 Display processing means 52 Network connection support means

The present invention relates to an environmental monitoring system using a computer network, and particularly relates to an environmental monitoring system and a method for accumulating environmental data and growing conditions of crop cultivated areas in a server and transmitting them to a user terminal in a timely manner.

Conventionally, a technique has been proposed in which data such as a temperature sensor installed in a cultivation area of an agricultural product is transmitted to a server, stored, and distributed as history information to a mobile terminal of a user who performs agricultural work.

For example, in Patent Document 1, in order to provide a farmer with necessary equipment and functions at low cost, agricultural production information acquired by the farmer is stored in a farmer's database, stored in a center database via a farmer's server, and used by a user. A system that enables the collection, storage, update, and data processing of agricultural production information in the center database by the terminal accessing the center server is described.

Japanese Unexamined Patent Publication No. 2005-38019

By the way, in recent years, wireless LAN technology such as WiFi and communication technology such as 3G line have become widespread, and it is conceivable to use this technology to connect a device on the user side to a network such as the Internet to communicate with a server device. In particular, when monitoring the growth status of agricultural products, it is necessary to connect a data collection device installed on the cultivated area side to the network in addition to the mobile terminal that displays the data. At this time, when connecting to a network using the above communication technology, it is desirable that data necessary for network connection such as SSID and password can be easily set in the data collection device when a wireless LAN is adopted.

Further, since the user may check the environmental information through the mobile terminal while working in the field or the shipping place, the problem is how to provide an easy-to-operate user interface. Furthermore, when trying to collectively manage environmental information on a server, there is also the problem of how to efficiently store data due to the problem of storage capacity.

The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide an environmental monitoring system and a method capable of accurately and efficiently collecting the growth state of agricultural products.

In order to achieve the above object, the environmental monitoring system according to the present invention receives and registers a data collection device that collects image data of agricultural products and image data sent from the data collection device, and is registered. It is equipped with a server device that sends the existing image data to the user terminal.
When the server device receives the image data, it registers the received image data for each set time zone division and if the registered image data does not exist in that time zone, the registered image data exists. If so, whether or not to determine the similarity between the image data having the newest time stamp among the registered image data and the received image data, and to register the received image data based on the result of the determination. It is characterized by determining.

For example, by setting the time zone division to an hour unit, even if there is no change in the image, it will be accumulated once an hour. This, in combination with the function of the condition determination means described later, enables efficient image display (slide show).

The front Symbol server environment monitoring system according to the present invention, the determination result, and registers the image data thus received only if below a certain value the degree of similarity is predetermined.

According to the present invention, since only the image data sent from the data collection device with a large change to some extent is accumulated, it is possible to save the storage capacity without deteriorating the monitoring function. In the present invention, when the image data is first received, there is no saved image data, so the received image data is saved as it is.

The server device of the environment monitoring system according to the present invention extracts image data after the start time and closest to the start time based on the start time and acquisition interval sent from the user terminal, and the extracted image data. The acquisition interval is added for each number of extractions based on the time information of the above, and the condition determination means for sequentially extracting the image data closest to the added value is provided. In the present invention, the image required for the slide show can be accurately extracted from the image data accumulated by the thinning process.

Further, the method for monitoring the growth status of agricultural products according to the present invention is a method executed by a data collection device that collects image data of agricultural products and a server device that is connected to a user terminal via a network.
The server device receives the image data sent from the data collection device, and
When image data is received, the received image data is registered for each set time zone if the registered image does not exist in that time zone, and if the registered image data exists, it is registered. The stage of determining the degree of similarity between the image data having the newest time stamp and the received image data among the image data of the above, and determining whether or not to register the received image data based on the result of the determination.
Based on the start time and acquisition interval sent from the user terminal, the image data that is after the start time and is closest to the start time is extracted, and the acquisition interval is extracted based on the time information of the extracted image data. A condition judgment stage in which image data closest to the added value is sequentially extracted by adding each time.
A step of executing a slide show on the user terminal using the image data extracted by the condition determination step, and a step of executing the slide show.
It is characterized by including.

As described above, according to the environmental monitoring system of the present invention, it is possible to collect the growing condition of agricultural products accurately and efficiently.

It is a functional block diagram of the environment monitoring system 1 by embodiment of this invention. It is explanatory drawing of the user registration process and the network connection process of the environment monitoring system of FIG. This is an example of the alarm / target setting screen displayed on the mobile terminal of FIG. 1. 1 is an explanatory diagram of a setting screen displayed on the mobile terminal of FIG. 1, FIG. 4A is an example of a setting screen for setting information such as position information of a data collection device, and FIG. 4B is an arrangement of display items of monitoring data. This is an example of the order setting screen. This is an example of a screen when the screen is displayed on a personal computer according to the embodiment of the present invention. This is an example of a list screen displayed on the mobile terminal of FIG. This is an example of a detailed screen displayed on the mobile terminal of FIG. 1. It is another example of the detail screen displayed on the mobile terminal of FIG. It is explanatory drawing of the screen example and display processing at the time of the display switching is necessary in the screen of the mobile terminal of FIG.

The environmental monitoring system according to the embodiment of the present invention will be described below with reference to the drawings.
In FIG. 1, the environmental monitoring system 1 is stored in a data collecting device 10 installed in a field and collecting environmental data, a server device 30 connected to the data collecting device 10 via a network 2, and a server device 30 for storing environmental data. It is equipped with a mobile terminal 5 that displays the environmental data after processing such as graphing. As the mobile terminal 5, a user-owned mobile phone can be used. Further, in the present embodiment, the data collection device 10 will be described below assuming that the data collection device 10 is connected to the network 2 via the wireless LAN router 3.

The data collection device 10 includes a soil moisture sensor 14a, an illuminance sensor 14b, sensors 14 such as a temperature sensor 14c, a Web camera 15, a calculation processing unit 12 including a CPU, and a storage unit for storing data. 13. It is equipped with a communication unit 11 having a wireless LAN function such as WiFi. The communication unit 11 has both functions of a master unit mode and a slave unit mode, and operates in either mode by a switching command from the arithmetic processing unit 12.

The arithmetic processing unit 12 of the data collection device 10 is via an initial setting means 21 that performs initial settings at startup, an input processing means 22 that inputs signals and image data output from sensors 14 and a Web camera 15, and a communication unit. It includes a communication processing means 23 that communicates with an external device, and a switching command output means 24 that outputs a switching command between a master unit and a slave unit to a communication unit. Each means 21 to 24 can be realized by a program as a function of the CPU.

The server device 30 includes a communication unit 31 connected to a network, an arithmetic processing unit 32 for executing arithmetic processing, and a storage unit 33 for storing data. Further, the arithmetic processing unit 32 of the server device 30 registers the user information such as the user's email address in association with the user ID, the user information registration means 41, and the terminal information of the data collection device 10 in association with the user ID. It is set for each user: a registration means 42, an input / output processing means 43 for executing data transmission / reception with the data collection device 10 and the mobile terminal 5, a similarity determination means 44 for determining the similarity between two images, and a user. The condition determination means 45 for determining whether or not the condition is satisfied is provided based on the alarm condition of the environmental data and the extraction condition of the image data.

The mobile terminal 5 supports the connection of the communication unit 61 that communicates with the network 2, the wireless LAN router 3, or the data collection device 10, the arithmetic processing unit 62 that executes arithmetic processing, and the data collection device 10 to the wireless LAN router 3. It has a network connection support means 52, a display processing means 51 that executes display processing of environment data sent from the server device 30, and a display screen 64 that displays information and accepts touch operations. Each means 51 and 52 is downloaded from the server device 30 and executed as a program or as a language executed on a Web browser.

The data collection device 10 is connected to the network 2 through a wireless LAN router 3 provided near the installation location, and transmits the collected data to the server device 30. On the other hand, the mobile terminal 5 communicates with the server device 30 through a wireless LAN router, a 3G line, or the like.

The environment monitoring system 1 is configured by a client-server model, a cloud computing form, and the like, but is not limited thereto.

Next, the operation of the environment monitoring system 1 having the above configuration will be described. In the following description, the data acquisition device 10 will be referred to as a sensor box (or "box") 10.

1. 1. Initial setting process First, the user registration process and the network connection process of the environment monitoring system 1 will be described with reference to FIG.

(1) User registration process (step A1) The user activates the initial setting application program of the mobile terminal 5 and acquires GPS data (location information).
(Step A2) Next, the user inputs an e-mail address, a password and other information necessary for user registration into the mobile terminal 5 and sends the information to the server device 30.
(Step A3) When the user information registration means 41 of the server device 30 receives the user information, it stores it in the storage unit 33. The user information registration means 41 also issues a user ID and transmits it to the mobile terminal 5 of the user.
(Step A4) When the mobile terminal 5 receives the user ID transmitted from the server device 30, it stores it in the storage unit 63 of the mobile terminal 5.

(2) Network connection processing The user must then connect the sensor box 10 to the network 2 to enable data transmission with the server device 30, which can be easily done by the following procedure. You can make a reliable connection.

(Step A5) The user first searches for a wireless LAN (SSID) around the sensor box installation location using the mobile terminal 5. Then, among the wireless LAN routers in the list displayed on the wireless LAN setting confirmation screen of the mobile terminal 5, the sensor box 10 selects the wireless LAN router 3 used for network connection. The user then inputs a password for accessing the wireless LAN router 3.

(Step A6) When the user finishes inputting necessary information on the wireless LAN setting confirmation screen of the mobile terminal 5 and touches the OK button, the input information is saved in the storage unit 63 and the wireless terminal 5 wirelessly. The connection to the LAN router 3 is made.
(Step A7) The mobile terminal 5 accesses the server device 30 via the wireless LAN router 3.

(Step A8) The input / output processing means 43 of the server device 30 returns OK to the mobile terminal 5 when there is an access from the mobile terminal 5 via the wireless LAN.
(Step A9) Upon receiving the reply from the server device 30, the mobile terminal 5 activates the network connection support means 52 for setting the network of the sensor box 10.

(Step A10) The user then presses the switch 16 provided on the sensor box 10. When the switching command output means 24 of the sensor box 10 detects that the switch 16 is pressed, the wireless LAN function of the communication unit 11 is set to the master unit mode. As a result, the sensor box 10 and the mobile terminal 5 can be connected by wireless LAN. When the network connection support means 52 of the mobile terminal 5 detects that communication with the sensor box 10 has become possible, the sensor box 10 stores the SSID, password, user ID, and location information stored in the storage unit 63. Send to.

(Step A11) The user also makes necessary adjustments such as the orientation of the Web camera 15 in the sensor box 10 through the mobile terminal 5.
(Step A12) After completing the necessary adjustments, the user touches the setting completion button displayed on the mobile terminal 5. As a result, the setting completion notification is transmitted from the mobile terminal 5 to the sensor box 10.

(Step A13) Upon receiving the setting completion notification, the switching command output means 24 of the sensor box 10 disconnects the communication with the mobile terminal 5, switches the wireless LAN function of the communication unit 11 to the slave unit mode, and communicate processing means. Start 23.
(Step A14) Then, the communication processing means 23 of the sensor box 10 executes the connection process with the wireless LAN router 3 by using the SSID and the password received from the mobile terminal 5.

(Step A15) After connecting to the wireless LAN router 3, the communication processing means 23 of the sensor box 10 transmits a user ID, location information, and other necessary information to the server device 30 via the wireless LAN router 3.
(Step A16) When the terminal information registration means 42 of the server device 30 receives the information necessary for registration from the sensor box 10, it issues a terminal ID and transmits it to the sensor box 10. When the communication processing means 23 of the sensor box 10 receives the terminal ID, it stores it in the storage unit 13.
(Step A17) The input / output processing means 43 of the server device 30 notifies the user's mobile terminal 5 of a message to the effect that the connection with the sensor box 10 is completed.

By the above processing procedure, the environment monitoring system 1 connects the sensor box 10 and the wireless LAN router 3, and transmits the basic information of the sensor box 10 to the server device 30.

2. 2. Data collection / storage processing The input processing means 22 of the sensor box 10 periodically acquires predetermined environmental data and images from the sensors 14, for example, every 2 minutes. The environmental data includes soil moisture content, illuminance, temperature, etc., which are data acquired from sensors, but are not limited to these, and may include, for example, meteorological data acquired from the Japan Meteorological Agency DB via network 2. .. The acquired data is transmitted to the server device 30 via the communication unit 11 by the communication processing means 23 of the sensor box 10.

When the input / output processing means 43 of the server device 30 receives the data sent from the sensor box 10, it first determines whether or not the data is received for the first time. Then, in the case of the first time, the received data is stored in the storage unit 33. If it is not the first time, it is determined whether or not the preset accumulation conditions are met, and if the conditions are met, the data is saved together with the time stamp. If the conditions are not met, the process ends as it is.

(How to thin out images)
The input processing means of the sensor box 10 acquires the measurement data of the sensors 14 and the captured image of the Web camera 15 at a predetermined cycle, for example, every two minutes, and the acquired data is transmitted to the server device via the communication processing means 23 and the communication unit 11. Send to 30.

The server device 30 that has received the data processes the image data according to the following procedure.
1) The input / output processing means 43 of the server device 30 stores the image data in the temporary area. 2) The input / output processing means 43 also accesses the data list table which is a list of the stored data (including the image data). Then, among the registered data, the file name of the image data is set in the time zone to which the time stamp of the image data to be registered belongs (for example, when the time zone is divided into hour units, the xx time zone). Check if is recorded. If the registered image does not exist in that time zone, the received image data is adopted, the file name of the image data is registered in the data list table, and the process ends.

3) When the registered image exists in the data list table, the input / output processing means 43 activates the similarity determination means 44, and the image having the latest time stamp among the registered images is similar to the received image. Determine the degree. Existing techniques can be used to determine the similarity between two images.

4) As a result of the determination, if the similarity is equal to or less than a predetermined threshold value, it is assumed that the image has changed by a certain amount or more, and the received image is registered in the data list table. On the other hand, if the similarity is larger than the threshold value as a result of the determination, the received image is discarded and the process is terminated, assuming that there is no significant change in the image. The library libpuzzle can be used as the similarity determination means 44. However, since this library outputs a smaller value as the images are similar, it is registered as if there is a certain change when the threshold value (for example, 0.2) or more is used.

Since the amount of image data stored in the server device 30 is enormous, the storage capacity is tight. However, by the above-mentioned method, the change of the image is accurately transmitted to the user, and the storage is efficient. It is possible to reduce the capacity.

(How to supplement the integrated temperature including missing values)
Next, processing when a defect occurs in the collected data will be described. In this case, as shown below, by changing the processing content according to the number of data missing per predetermined period (for example, one day), highly accurate data complementation becomes possible.

The following is an example of complementing the temperature data, but the 1-hour value is used to calculate the average value of the integrated temperature, and if there is a defect, the number of days with the defect is displayed and the data for 3 days is used. It is good to display the complement.

1) Conditional branching of the defect method Assuming that integrated temperature data is collected in 1-hour units, if the number of data per day is 21/24 or more, that is, a total of 24 integrated temperatures will be collected in one day. When more than one piece of data can be collected (data loss rate of about 10% or less) or 20/24 or less (data loss rate of about 10% or more), branching is performed as follows.
・ If it is 21/24 or higher, the average value of all existing data will be the average temperature of the day.
・ If it is 20/24 or less, it is calculated from the data of other days (averaged with the data of the predetermined number of days described later) and used as the average temperature of that day.

2) Method of averaging the data for a predetermined number of days The following will be described by taking as an example the method of using the average value of the data for 3 days up to 3 days before the day to be complemented. In this method, even if the missing days continue, the complemented data is used to sequentially complement the data.

For example, if the temperature for each date is expressed as a date (temperature), the collected data will be August 1 (30.0 degrees), August 2 (29.0 degrees), and August 3 (32 degrees). It is assumed that it was (0.0 degrees), August 4 (deficiency), August 5 (deficiency), and August 6 (35.0 degrees).

In this case, for August 4th, when there was a data loss, the average value (30.3 degrees) for the three days before the data loss, that is, August 1st to 3rd, was calculated, and this was calculated on August 4th. Used as temperature. For August 5, the average temperature of 30.4 degrees on the previous 3 days, that is, August 2 to 4, is used. At this time, the supplemented temperature data is used for August 4.

By complementing the missing data sequentially from the data acquisition start date by this complementing procedure, the integrated value of the measured data can be calculated even if there is a missing value.

3. 3. Monitoring process (1) Alarm condition setting process The alarm condition is to notify the mobile terminal 5 when the accumulated data in the server device 30 corresponds to the condition.

FIG. 3 is an example of an alarm / target setting screen displayed on the mobile terminal 5. The data set on this screen is sent to the server device 30, and is stored in the storage unit 33 by the input / output processing means 43. The alarm set values include, for example, the upper and lower limits of temperature and humidity, and the target values include the integrated temperature.

The condition determination means 45 of the server device 30 constantly monitors whether or not the collected data exceeds this alarm set value, and if the collected data exceeds the alarm set value, push notification or e-mail notification is sent to the preset alarm notification destination. ..
The alarm can be paused, in which case a message indicating that the alarm is being paused is displayed on the mobile terminal.

FIG. 4A is an example of a setting screen for the name (device label) of the sensor box 10 and an installation location, and FIG. 4B is an example of a display item and an arrangement order setting screen. The display processing means 51 of the mobile terminal 5 displays important index items in a list (overview), and displays data in the order of display items. FIG. 5 is an example of a screen when displaying on a personal computer. The layout is different from that of mobile terminals, but the display data is basically the same as that of mobile terminals.

(2) Monitoring screen display The monitoring screen consists of an overview screen and a detail screen. FIG. 6 is an example of a list screen displayed on the mobile terminal 5. Items set as important index items in FIG. 4B are listed on this screen. 7 and 8 are examples of detailed screens.

(3) Screen switching process for time-series data, etc. Next, the display process when screen switching is required will be described with reference to FIG.
The display screen 64 of the mobile terminal 5 of the present embodiment moves the time series and displays data by detecting a touch operation in a predetermined range including arrows arranged on the left and right sides of the screen. If there is update data, the button arranged in the center of the lower part of the screen is displayed as an animation to inform the user of the existence of the update data, and the data is updated by detecting the touch operation of the button.

The arrows 81 and 82 arranged on the left and right sides of the screen are displayed surrounded by semicircular and semi-transparent operation areas 91 and 92 having a radius of 44 pixels or more. The mobile terminal detects a touch operation in the operation area and executes a display movement process in the direction of the arrow.

It is preferable to hide this operation area when it is not needed. For example, when the touch operation is not detected for a certain period of time, the operation area including the arrow is hidden. Then, by detecting the touch operation at an arbitrary position on the display screen 64, the operation area is set to the display state. As a result, the entire information display area can be made easier to see, and the user can reliably and easily perform the movement operation when necessary.

In particular, it is assumed that the user uses the mobile terminal while performing some work such as farm work and shipping preparation work. By the above method, while displaying necessary information in a limited screen area, the user can operate the screen without mistake while working.

In the display screen 64 of the mobile terminal 5, it is preferable that a certain range outside the operation input reception areas 91 and 92 is set as an operation input reception prohibition area, and this area does not accept any operation input. This area can be a semicircle having the same center as the operation input receiving areas 91 and 92. As a result, erroneous input can be reliably prevented.

Further, the display processing means 51 erases the operation input reception areas 91 and 92 from the display screen 64 after a certain period of time has elapsed after the operation input reception areas 91 and 92 are displayed, and then touches any part of the display screen 64. If it is detected, the operation input receiving areas 91 and 92 may be displayed again.

(4) Photo screen display processing Hereinafter, a photographic image display processing executed by the display processing means 51 of the mobile terminal 5, particularly an effective slide display method using thinned data will be described.
(Step S1) First, the start date and time, the end date and time, and the acquisition interval are specified and called.
After that, the display processing means 51 acquires and displays the image list in the following order.
(Step S2) Acquire the latest data with an image. (Display on the first sheet)

(Step S3) The number of acquisitions is calculated from the first time of the time to be displayed within the specified range.
For example, when the start date and time is from 00:00 on January 1, 2015 and the acquisition interval is every 3 hours on the hour, the time stamp of the accumulated image data is January 1, 2015 1: 00 to 2015 1. In the case of 0:00 on the 2nd of the month, the first time will be 3:00 on the 1st of January 2015, and the number of acquisitions will be 8.

(Step S4) Among the data in which images are registered in the range of 1.5 hours before and after the start time, the data at the time closest to the start time is added to the slide list.
After (step S5), add 3 hours to the start time for the number of acquired data and add the data to the slide list in the same manner.
(Step S6) The images registered in the slide list are sequentially switched and displayed at predetermined time intervals.

As described above, according to the present embodiment, in the screen display of the mobile terminal, the display screen can be easily and surely switched by the semicircular operation input receiving areas provided at the left and right ends of the display screen. This allows the user to do other work while checking the environmental data. Further, in the server device, since the thinning process of accumulating only the image data having a low degree of similarity is executed, the storage capacity can be saved. At this time, be sure to save the first acquired image at the time of switching the time zone for each time zone, and set the time interval when the slide show of the photographic image is specified to a value equal to or higher than the time zone. , The user will be able to perform an effective slide show that can accurately grasp the state of change, even when there is little change.

According to the present embodiment, further, the data necessary for network connection is set in the sensor box via the mobile terminal, and the user normally connects the sensor box and the server device by the notification sent from the server device to the mobile terminal. Since it is possible to know that a communication connection has been made, a reliable and efficient network connection is possible without providing a user interface in the sensor box.

The present invention is not limited to the above-described embodiment, and can be variously modified and implemented without departing from the gist thereof. For example, when a communication error occurs, the wireless LAN router cannot be controlled from the sensor box side, so it is necessary to reset it manually. For this reason, by installing a 3G line communication function in the sensor box and using the telephone number of the 3G line, complicated wireless LAN settings are not required, and it is possible to link with the user by the telephone number. .. Further, since the built-in 3G line can be controlled, when a communication abnormality is detected, communication is restored by reconnecting, and it can be expected to prevent data loss.

Further, in the present embodiment, the collected data is periodically transmitted from the sensor box to the server device, but the threshold value for each data type is made downloadable to the sensor box, and the value exceeds the threshold value on the sensor box side. It may be sent to the server device when it becomes.

1 Environmental monitoring system 2 Network 3 Wireless LAN router 5 Mobile terminal 10 Data acquisition device (sensor box)
11, 31, 61 Communication unit 12, 32, 62 Calculation processing unit 13, 33, 63 Storage unit 14 Sensors 14a Soil moisture content sensor 14b Illumination sensor 14c Temperature sensor 15 Web camera 16 Switch 21 Initial setting means 22 Input processing means 23 Communication processing means 24 Switching command output means 30 Server device 41 User information registration means 42 Terminal information registration means 43 Input / output processing means 44 Similarity judgment means 45 Condition judgment means 51 Display processing means 52 Network connection support means

Claims (6)

It is equipped with a data collection device that collects environmental data of crop cultivation areas and a server device that stores the environmental data sent from the data collection device and also sends the stored environmental data to a user terminal.
When the environmental data is deficient, the server device executes a complement process to supplement the environmental data by using the non-defective data in the deficient environmental data based on the data loss rate. It ’s an environmental monitoring system.
The server device is an environmental monitoring system characterized in that, when the environmental data is continuously deleted, the environmental data is sequentially complemented by using the data complemented by the complementary process. It is equipped with a data collection device that collects environmental data of crop cultivation areas and a server device that stores the environmental data sent from the data collection device and also sends the stored environmental data to a user terminal.
When the environmental data is deficient, the server device executes a complement process to supplement the environmental data by using the non-defective data in the deficient environmental data based on the data loss rate. It ’s an environmental monitoring system.
When the data loss rate is below a certain value, the server device supplements the missing data with the stored data, and when the data loss rate exceeds a certain value, first uses the data without loss. An environmental monitoring system characterized in that the missing data is complemented by the data, and thereafter, the complemented data is also used to sequentially complement the missing data. The data collection device periodically captures image data of the crop cultivation area and transmits it to the server device.
The server device includes a similarity determination means for determining the similarity between two images.
The similarity determination means compares the received image data with the latest stored image data, and performs a thinning process to save the received image data only when the similarity is equal to or less than a predetermined constant value. The environmental monitoring system according to claim 1 or 2, characterized in that it is executed. The environmental monitoring system according to claim 3, wherein the similarity determination means executes the thinning process for each set time zone division. The server device extracts image data that is after the start time and is closest to the start time based on the start time and acquisition interval sent from the user terminal, and the time information of the extracted image data is used as a reference. The environmental monitoring system according to claim 3 or 4, wherein the acquisition interval is added for each number of extractions, and the condition determination means for sequentially extracting the image data closest to the added value is provided. The environment monitoring system according to claim 5, wherein the server device executes a slide show on the user terminal using image data extracted by the condition determination means.

Images