JP6655940B2 - Mobile terminals for environmental monitoring - Google Patents

Description

The present invention relates to environmental monitoring system using a computer network, particularly relates to a portable terminal end to display environmental data and growth situation of crop cultivation accumulated in the server.

  2. Description of the Related Art Conventionally, a technique has been proposed in which data of a temperature sensor or the like installed in a cultivation area of a crop is transmitted to a server, accumulated, and distributed as history information to a portable terminal of a user who performs the agricultural work.

  For example, in Patent Literature 1, in order to provide a farmer with necessary facilities and functions at low cost, agricultural production information acquired by the farmer is stored in a farmer's database, and stored in a center database via a farmer server. A system is described in which a terminal accesses a center server to enable collection, accumulation, updating, and data processing of agricultural production information in a center database.

JP 2005-38019 A

  By the way, in recent years, wireless LAN technology such as WiFi and communication technology such as 3G line have become widespread, and it is conceivable to use this technology to connect a device on the user side to a network such as the Internet to communicate with a server device. In particular, when monitoring the growth status of agricultural products, it is necessary to connect a data collection device installed on the cultivation area side to a network in addition to a portable terminal for displaying data. At this time, when connecting to a network using the above communication technology, it is desirable that data necessary for network connection, such as an SSID and a password, can be easily set in a data collection device when a wireless LAN is adopted.

  In addition, a user sometimes checks environmental information through a portable terminal while working in a field or a shipping place, and thus there is a problem how to provide an easy-to-operate user interface. Furthermore, there is a problem of how to efficiently accumulate data due to a problem of storage capacity when collectively managing environmental information in a server.

The present invention has been made in view of the circumstances consuming above, when displaying the environmental data agronomically land, and an object thereof is to provide a mobile terminal has good operability.

In order to achieve the above object, a portable terminal according to the present invention displays time-series data of the environmental data sent from a server device that collects environmental data via a data collection device installed in a crop cultivation area. A mobile terminal,
The mobile terminal,
On the display screen of the environmental data, in both the screen horizontal direction on the right end side and left side be in a substantially central position in the vertical direction of the screen in the longitudinal direction, semicircular operation with the right edge near and near the left end in each center The input reception area is displayed translucently and a predetermined section outside the operation input reception area is provided with an operation input reception prohibition area that does not receive any operation input, and further, a right-pointing arrow is provided in the operation input reception area on the right end side. Is displayed, a left-pointing arrow is displayed in the operation input reception area on the left end side, a touch operation in the operation input reception area is detected, and the time series is moved in the direction of the arrow to change the time series data. A display moving process for displaying is performed.

  According to the present invention, since the position where the operability of the mobile terminal used by the user is good is set as the operation input receiving area, the user can use one hand (thumb and middle finger or index finger) especially in a mobile terminal that also serves as a mobile phone. The screen switching operation can be performed by the parentheses. In addition, by making the operation input reception area displayed on the left and right ends semicircular, accurate input reception is possible in a small area, so that the display area of the original environmental data can be widened. Further, since the operation input reception area is displayed translucently, more information can be provided to the user without completely hiding the display of the environmental data.

Preferably, the time-series data is displayed on the display screen including the operation input reception area displayed in a translucent manner .

  More preferably, after the display of the operation input reception area, the display processing means erases the operation input reception area from the display screen after a certain period of time, and then detects a touch operation at an arbitrary position on the display screen, It is preferable to display the operation input reception area again. Thereby, the visibility of the environmental data can be improved without hindering the screen switching function.

As described above, according to the portable terminal of the present invention , it is possible to improve the operability when displaying the environmental data of the crop cultivation area. This allows the user to perform other tasks while checking the environment data.

It is a functional block diagram of environment monitoring system 1 by an embodiment of the invention. FIG. 2 is an explanatory diagram of a user registration process and a network connection process of the environment monitoring system of FIG. 1. 2 is an example of an alarm / target setting screen displayed on the mobile terminal in FIG. 1. FIG. 4A is an explanatory diagram of a setting screen displayed on the mobile terminal in FIG. 1, wherein FIG. 4A illustrates an example of a setting screen for position information and the like of a data collection device, and FIG. It is an example of an order setting screen. 6 is an example of a screen displayed on a personal computer according to an embodiment of the present invention. 2 is an example of a list screen displayed on the mobile terminal in FIG. 1. 2 is an example of a detailed screen displayed on the mobile terminal of FIG. 1. 5 is another example of a detail screen displayed on the mobile terminal of FIG. 1. FIG. 2 is an explanatory diagram of a screen example and display processing when display switching is required on the screen of the mobile terminal in FIG. 1.

Hereinafter, an environment monitoring system according to an embodiment of the present invention will be described with reference to the drawings.
In FIG. 1, an environment monitoring system 1 is installed in a field and collects environmental data. The data collecting apparatus 10 is connected to the data collecting apparatus 10 via a network 2 to accumulate environmental data. A mobile terminal 5 is provided to display the processed environmental data after performing processing such as graphing. Note that a mobile phone owned by a user can be used as the mobile terminal 5. In the present embodiment, the data collection device 10 will be described below as being connected to the network 2 via the wireless LAN router 3.

  The data collection device 10 includes sensors 14, such as a soil moisture sensor 14a, an illuminance sensor 14b, and a temperature sensor 14c, a Web camera 15, a CPU, and performs various arithmetic processing, and a storage unit that stores data. 13, a communication unit 11 having a wireless LAN function such as WiFi. The communication unit 11 has both functions of the master unit mode and the slave unit mode, and operates in either mode in response to a switching command from the arithmetic processing unit 12.

  The arithmetic processing unit 12 of the data collection device 10 includes an initial setting unit 21 for performing an initial setting at the time of startup, an input processing unit 22 for inputting signals and image data output from the sensors 14 and the Web camera 15, and a communication unit. A communication processing unit 23 that communicates with an external device, and a switching command output unit 24 that outputs a switching command of a master unit and a slave unit to a communication unit are provided. Each of the means 21 to 24 can be realized by a program as a function of the CPU.

  The server device 30 includes a communication unit 31 that connects to a network, an arithmetic processing unit 32 that executes arithmetic processing, and a storage unit 33 that stores data. The arithmetic processing unit 32 of the server device 30 includes a user information registration unit 41 for registering user information such as a user's mail address in association with a user ID, and a terminal information for registering a terminal ID of the data collection device 10 in association with a user ID. The registration unit 42, the input / output processing unit 43 for transmitting and receiving data to and from the data collection device 10 and the mobile terminal 5, the similarity determination unit 44 for determining the similarity between two images, and the setting are made for each user. There is provided a condition determining means 45 for determining whether or not a condition is met based on an alarm condition of environmental data and an extraction condition of image data.

  The mobile terminal 5 supports a communication unit 61 that communicates with the network 2, the wireless LAN router 3 or the data collection device 10, an arithmetic processing unit 62 that performs arithmetic processing, and connection of the data collection device 10 to the wireless LAN router 3. It has a network connection support unit 52, a display processing unit 51 for executing a display process of environmental data sent from the server device 30, and a display screen 64 for displaying information and accepting a touch operation. Each of the means 51 and 52 is downloaded from the server device 30 and executed as a program or a language executed on a Web browser.

  The data collection device 10 is connected to the network 2 through a wireless LAN router 3 provided near the installation location, and transmits collected data to the server device 30. On the other hand, the mobile terminal 5 communicates with the server device 30 through a wireless LAN router, a 3G line, or the like.

  The environment monitoring system 1 is configured by a client server model, a cloud computing mode, or the like, but is not limited thereto.

  Next, the operation of the environment monitoring system 1 having the above configuration will be described. In the following description, the data collection device 10 is referred to as a sensor box (or “box”) 10.

1. Initial Setting Process First, a user registration process and a network connection process of the environment monitoring system 1 will be described with reference to FIG.

(1) User Registration Process (Step A1) The user activates an application program for initial setting of the mobile terminal 5 and acquires GPS data (position information).
(Step A2) Next, the user inputs an e-mail address, a password, and other information necessary for user registration to the portable terminal 5, and transmits the information to the server device 30.
(Step A3) Upon receiving the user information, the user information registration unit 41 of the server device 30 stores the user information in the storage unit 33. The user information registration unit 41 also issues a user ID and transmits the user ID to the portable terminal 5 of the user.
(Step A4) Upon receiving the user ID transmitted from the server device 30, the mobile terminal 5 stores the user ID in the storage unit 63 of the mobile terminal 5.

(2) Network Connection Processing Next, the user must connect the sensor box 10 to the network 2 to enable data transmission with the server device 30. Connection can be made reliably.

(Step A5) First, the user searches the mobile terminal 5 for a wireless LAN (SSID) around the sensor box installation location. Then, among the wireless LAN routers in the list displayed on the wireless LAN setting confirmation screen of the mobile terminal 5, the wireless LAN router 3 used by the sensor box 10 for network connection is selected. Next, the user inputs a password for accessing the wireless LAN router 3.

(Step A6) When the user finishes inputting necessary information on the wireless LAN setting confirmation screen of the mobile terminal 5 and touches the OK button, the input information is stored in the storage unit 63 and the wireless communication of the mobile terminal 5 is performed. The connection to the LAN router 3 is made.
(Step A7) The portable terminal 5 accesses the server device 30 via the wireless LAN router 3.

(Step A8) The input / output processing unit 43 of the server device 30 sends an OK reply to the portable terminal 5 when there is access from the portable terminal 5 via the wireless LAN.
(Step A9) When the portable terminal 5 receives the reply from the server device 30, the portable terminal 5 activates the network connection support means 52 for performing network setting of the sensor box 10.

(Step A10) Next, the user presses the switch 16 provided on the sensor box 10. When the switch command output unit 24 of the sensor box 10 detects that the switch 16 has been pressed, it sets the wireless LAN function of the communication unit 11 to the parent device mode. Thereby, the sensor box 10 and the portable terminal 5 can be connected by the wireless LAN. When detecting that communication with the sensor box 10 is enabled, the network connection support means 52 of the mobile terminal 5 stores the SSID and password, the user ID, and the position information stored in the storage unit 63 in the sensor box 10. Send to

(Step A11) The user also makes necessary adjustments such as the orientation of the Web camera 15 in the sensor box 10 through the mobile terminal 5.
(Step A12) After the necessary adjustment is completed, the user touches a setting completion button displayed on the mobile terminal 5. Thereby, the setting completion notification is transmitted from the mobile terminal 5 to the sensor box 10.

(Step A13) Upon receiving the setting completion notification, the switching command output unit 24 of the sensor box 10 disconnects the communication with the portable terminal 5, switches the wireless LAN function of the communication unit 11 to the slave unit mode, and executes the communication processing unit. 23 is started.
(Step A14) Then, the communication processing means 23 of the sensor box 10 executes a connection process with the wireless LAN router 3 using the SSID and the password received from the mobile terminal 5.

(Step A15) After connection with the wireless LAN router 3, the communication processing means 23 of the sensor box 10 transmits a user ID, position information, and other necessary information to the server device 30 via the wireless LAN router 3.
(Step A16) Upon receiving the information necessary for registration from the sensor box 10, the terminal information registration unit 42 of the server device 30 issues a terminal ID and transmits it to the sensor box 10. Upon receiving the terminal ID, the communication processing unit 23 of the sensor box 10 stores the terminal ID in the storage unit 13.
(Step A17) The input / output processing means 43 of the server device 30 sends a PUSH message to the user's portable terminal 5 to the effect that the connection with the sensor box 10 has been completed.

  According to the above processing procedure, the environment monitoring system 1 connects the sensor box 10 to the wireless LAN router 3 and transmits basic information of the sensor box 10 to the server device 30.

2. Data collection / storage processing The input processing means 22 of the sensor box 10 periodically acquires predetermined environmental data and images from the sensors 14 such as every two minutes. Examples of the environmental data include soil moisture content, illuminance, and temperature, which are data acquired from sensors, but are not limited thereto, and may include, for example, weather data acquired from the Meteorological Agency DB via the network 2. . The acquired data is transmitted to the server device 30 via the communication unit 11 by the communication processing unit 23 of the sensor box 10.

  Upon receiving the data sent from the sensor box 10, the input / output processing unit 43 of the server device 30 first determines whether or not it is the first data reception. Then, in the case of the first time, the received data is stored in the storage unit 33. If it is not the first time, it is determined whether or not a preset accumulation condition has been met. If the condition has been met, the data is stored together with a time stamp. If the condition is not satisfied, the process ends.

(How to thin out images)
The input processing means of the sensor box 10 acquires the measurement data of the sensors 14 and the captured image of the Web camera 15 at a predetermined cycle, for example, every two minutes, and transmits the acquired data to the server device via the communication processing means 23 and the communication unit 11. Send to 30.

The server device 30 that has received the data processes the image data in the following procedure.
1) The input / output processing unit 43 of the server device 30 stores the image data in the temporary area. 2) The input / output processing unit 43 accesses the data list table which is a list of the stored data (including the image data). Then, of the registered data, the file name of the image data is set in the time zone to which the time stamp of the image data to be registered (for example, when the time zone is divided into one-hour units, xx hours). Check if is recorded. If there is no registered image in that time zone, the received image data is adopted, the file name of the image data is registered in the data list table, and the processing ends.

3) If there is a registered image in the data list table, the input / output processing unit 43 activates the similarity determination unit 44 to determine the similarity between the image with the latest time stamp and the received image among the registered images. Determine the degree. An existing technique can be used to determine the similarity between the two images.

4) As a result of the determination, if the similarity is equal to or smaller than a predetermined threshold, the received image is registered in the data list table assuming that the image has changed by a certain amount or more. On the other hand, if the similarity is greater than the threshold as a result of the determination, the received image is discarded and the processing is terminated, assuming that there is no significant change in the image. Note that a library libpuzzle can be used as the similarity determination unit 44. However, since the library outputs a smaller value as the images are more similar, the library is registered as having a certain change when the value is equal to or larger than a threshold value (for example, 0.2).

  The amount of image data stored in the server device 30 is enormous, which imposes a tight storage capacity. However, the above-described method accurately notifies the user of changes in the image while efficiently storing the image. The capacity can be reduced.

(Method of complementing the integrated temperature including missing values)
Next, a process when a loss occurs in collected data will be described. In this case, as described below, by changing the processing content according to the number of data loss per predetermined period (for example, one day), highly accurate data complement can be performed.

  The following is an example of complementing temperature data. One hour is used to calculate the average value of the integrated temperature, and if there is a loss, the number of days with the loss is displayed. It is good to display the complement.

1) Deletion method condition branch Assuming that integrated temperature data is collected in hourly units, if the number of data per day is 21/24 or more, that is, a total of 24 integrated temperatures are collected in one day. When more than two pieces of data can be collected (data loss rate of about 10% or less) or 20/24 or less (data loss rate of about 10% or more), the process branches as follows.
In the case of 21/24 or more, the average value of all existing data is taken as the average temperature of the day.
In the case of 20/24 or less, it is calculated from data on other days (averaged with data of a predetermined number of days described later), and is set as the average temperature on that day.

2) Method of averaging data of a predetermined number of days The following describes an example of a method of using an average value of data for three days up to three days before a date to be complemented. According to this method, even if the missing date continues, the supplemented data is sequentially supplemented using the supplemented data.

  For example, when the temperature for each date is expressed as a date (temperature), the collected data is August 1 (30.0 degrees), August 2 (29.0 degrees), and August 3 (32 degrees). 0.0 degrees), August 4 (loss), August 5 (loss), and August 6 (35.0 degrees).

  In this case, with respect to the data loss on August 4, the average value (30.3 degrees) of the three days before the data loss, that is, from August 1 to 3, was calculated. Use as temperature. On August 5, the average of 30.4 degrees of the temperature three days before, that is, August 2 to 4, is used. At this time, for August 4, the supplemented temperature data is used.

  By sequentially supplementing missing data by this complementing procedure from the data acquisition start date, even if there is a missing value, the integrated value of the measurement data can be calculated.

3. Monitoring Process (1) Alarm Condition Setting Process The alarm condition is to notify the portable terminal 5 when the stored data in the server device 30 meets the condition.

  FIG. 3 is an example of an alarm / target setting screen displayed on the mobile terminal 5. The data set on this screen is sent to the server device 30 and stored in the storage unit 33 by the input / output processing unit 43. The alarm set value includes, for example, upper and lower limit values of temperature and humidity, and the target value includes an integrated temperature.

The condition determining means 45 of the server device 30 constantly monitors whether the collected data exceeds the alarm set value, and when the collected data exceeds the alarm set value, sends a push notification or an e-mail notification to a preset alarm notification destination. .
Note that the alarm can be temporarily stopped, in which case a message indicating that the alarm is being paused is displayed on the portable terminal.

  FIG. 4A is an example of a setting screen for setting the name (device label) and installation location of the sensor box 10, and FIG. 4B is an example of a setting screen for the display items and the arrangement order. The display processing means 51 of the mobile terminal 5 displays the important index items in a list (overview) and performs data display in the order of the display items. FIG. 5 is an example of a screen displayed on a personal computer. The layout is different from the mobile terminal, but the display data is basically the same as the mobile terminal.

(2) Monitoring screen display The monitoring screen includes a list (overview) screen and a detail (detail) screen. FIG. 6 is an example of a list screen displayed on the mobile terminal 5. Items set as important index items in FIG. 4B are listed on this screen. 7 and 8 show examples of the detail screen.

(3) Screen Switching Process of Time Series Data, etc. Next, a display process when a screen switching is required will be described with reference to FIG.
The display screen 64 of the mobile terminal 5 according to the present embodiment displays data by moving the time series by detecting a touch operation in a predetermined range including arrows arranged on the left and right sides of the screen. When there is update data, the button arranged at the lower center of the screen is animated to inform the user of the existence of the update data, and the data is updated by detecting the touch operation of the button.

  Arrows 81 and 82 arranged on the left and right sides of the screen are displayed by being surrounded by semi-circular and translucent operation areas 91 and 92 having a radius of 44 pixels or more. The mobile terminal detects a touch operation in the operation area and executes a display moving process in the direction of the arrow.

  This operation area is preferably not displayed when it is unnecessary. For example, when a touch operation is not detected for a certain period of time, an operation area including an arrow is set to a non-display state. Then, by detecting a touch operation at an arbitrary position on the display screen 64, the operation area is brought into a display state. This makes it easier to see the entire information display area, and allows the user to perform the moving operation reliably and easily when necessary.

  In particular, it is assumed that the user uses the mobile terminal while performing some work such as farming work and shipping preparation work. According to the above-described method, while necessary information is displayed in a limited screen area, the user can perform a screen operation without error while working.

  Note that, on the display screen 64 of the mobile terminal 5, a certain range outside the operation input reception areas 91 and 92 is set as an operation input reception prohibition area, and this area may not receive any operation input. This area can be formed in a semicircular shape having the same center as the operation input receiving areas 91 and 92. Thus, erroneous input can be reliably prevented.

  After the operation input reception areas 91 and 92 are displayed, the display processing means 51 erases the operation input reception areas 91 and 92 from the display screen 64 after a certain period of time has elapsed, and then performs a touch operation on an arbitrary portion of the display screen 64. Upon detection, the operation input reception areas 91 and 92 may be displayed again.

(4) Photo Screen Display Processing Hereinafter, a description will be given of a display processing of a photographic image executed by the display processing means 51 of the mobile terminal 5, in particular, an effective slide display method using thinned data.
(Step S1) First, a start date and time, an end date and time, and an acquisition interval are designated and called.
After that, the display processing unit 51 acquires and displays the image list in the following order.
(Step S2) The latest image data is acquired. (Display on the first sheet)

(Step S3) The number of acquisitions is calculated from the first time of the time to be displayed within the specified range.
For example, assuming that the start date and time is 0:00 on January 1, 2015 and the acquisition interval is every three hours, the time stamp of the stored image data is January 1, 2015, 1: 00 to 2015, January 1, 2015. In the case of 0:00 on the second day of the month, the first time is 3:00 on January 1, 2015, and the number of acquisitions is eight.

(Step S4) Among the data in which the images are registered for 1.5 hours before and after the start time, the data at the time closest to the start time is added to the slide list.
(Step S5) After that, three hours are added to the start time by the number of acquisitions, and the data is similarly added to the slide list.
(Step S6) Images registered in the slide list are sequentially switched and displayed at predetermined time intervals.

  As described above, according to the present embodiment, in the screen display of the mobile terminal, the display screen can be easily and reliably switched by the semicircular operation input reception area provided on the left and right ends of the display screen. This allows the user to perform other tasks while checking the environment data. Further, the server device executes a thinning process of accumulating only image data having low similarity, so that storage capacity can be saved. At this time, be sure to save the first acquired image when switching the time zone for each time zone, and set the time interval when specifying the slide show of the photo image to a value equal to or longer than the time zone. In addition, an effective slide show in which the user can accurately grasp the state of the change even when the change is small is possible.

  According to the present embodiment, data necessary for network connection is further set in the sensor box via the mobile terminal, and the user normally operates the sensor box and the server device by a notification sent from the server device to the mobile terminal. Since it is possible to know that communication has been established, reliable and efficient network connection can be achieved without providing a user interface in the sensor box.

  The present invention is not limited to the above-described embodiment, and can be implemented with various modifications without departing from the scope of the invention. For example, when a communication error occurs, the wireless LAN router cannot be controlled from the sensor box side, and thus needs to be manually reset. Therefore, by installing a 3G line communication function in the sensor box and using a telephone number of the 3G line, complicated wireless LAN settings are not required, and it is possible to associate with the user by the telephone number. . Further, since the built-in 3G line can be controlled, when a communication abnormality is detected, communication is restored by reconnecting, and loss of data can be prevented.

  Further, in the present embodiment, the collected data is periodically transmitted from the sensor box to the server device. However, the threshold for each data type is made downloadable to the sensor box, and the threshold is set to be equal to or larger than the threshold on the sensor box side. It may be transmitted to the server device when it becomes necessary.

1 environment monitoring system 2 network 3 wireless LAN router 5 portable terminal 10 data collection device (sensor box)
11, 31, 61 Communication unit 12, 32, 62 Operation processing unit 13, 33, 63 Storage unit 14 Sensors 14a Soil moisture content sensor 14b Illuminance sensor 14c Temperature sensor 15 Web camera 16 Switch 21 Initial setting means 22 Input processing means 23 Communication processing means 24 Switching command output means 30 Server device 41 User information registration means 42 Terminal information registration means 43 Input / output processing means 44 Similarity determination means 45 Condition determination means 51 Display processing means 52 Network connection support means

Claims (3)

A portable terminal that displays time-series data of the environmental data sent from a server device that collects environmental data through a data collection device installed in a crop cultivation area,
The mobile terminal,
On the display screen of the environmental data, in both the screen horizontal direction on the right end side and left side be in a substantially central position in the vertical direction of the screen in the longitudinal direction, semicircular operation with the right edge near and near the left end in each center The input reception area is displayed translucently and a predetermined section outside the operation input reception area is provided with an operation input reception prohibition area that does not receive any operation input, and further, a right-pointing arrow is provided in the operation input reception area on the right end side. Is displayed, a left-pointing arrow is displayed in the operation input reception area on the left end side, a touch operation in the operation input reception area is detected, and the time series is moved in the direction of the arrow to change the time series data. A mobile terminal for performing a display moving process for displaying . The mobile terminal according to claim 1, wherein the time-series data is displayed on the display screen including the operation input reception area displayed in a translucent manner. After displaying the previous SL operation input reception area, the erased from the operation input reception area display screen by a predetermined time has elapsed, the subsequent detects a touch operation at an arbitrary position of the display screen, to re-displaying the operation input receiving region The mobile terminal according to claim 1 or 2, wherein: