JP7121253B2 - Information processing system, control method thereof, mobile terminal, mobile terminal control method, and program - Google Patents

Description

The present invention relates to an information processing system, its control method, a mobile terminal, a mobile terminal control method, and a program.

A farmer who manages and manages large-scale fields installs multiple fixed-point cameras to monitor and manage the condition of each field. is doing.

In addition, if an abnormality is found in the image captured by the fixed-point camera, the farm manager will send the image to a remote agricultural worker as necessary to confirm the state of the field where the abnormality was found. request acquisition. In response to the request, the agricultural worker takes an image of the specified farm field and transmits the taken image to the farm manager. In addition, images received from farm workers are checked together with images from farm managers and fixed-point cameras to confirm the state of farm fields.

In order to easily manage images related to specific locations, for example, in the mechanism of Patent Document 1, an image storage location is set based on location information, and images related to the location information are saved in the set storage location. mechanism is disclosed. Here, Patent Literature 1 discloses that a GPS (Global Positioning System) is used to acquire position information.

JP 2016-12232 A

However, as in the technology described in Patent Document 1, it cannot be said that the accuracy of position information is sufficient with GPS information. For example, when a farmer requests a field to be imaged based on GPS information when a plurality of fields are adjacent to each other, there is a possibility that a wrong position will be specified. Therefore, there is a risk that the farm worker who receives the request will pick up an image of the wrong field.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a mechanism capable of suppressing an operator from imaging an incorrect position in response to an imaging request for a specified position. and

In order to achieve the above objects, the present invention
An information processing system in which a plurality of imaging devices , an information processing device, and a mobile terminal are communicably connected,
a first obtaining means for obtaining , from the information processing device, first identification information that is information that enables identification of a specific imaging device among a plurality of imaging devices;
a second acquisition means for acquiring second identification information, which is information capable of identifying the imaging device , from the imaging device;
Control means for controlling to notify information according to whether the first identification information acquired by the first acquisition means and the second identification information acquired by the second acquisition means match or not and .

ADVANTAGE OF THE INVENTION According to this invention, the mechanism which can suppress the imaging of the wrong position by an operator in response to the imaging request of the designated position can be provided.

It is a figure showing an example of the system configuration of the information processing system in the embodiment of the present invention. 3 is a diagram showing an example of the hardware configuration of the server device 101 according to the embodiment of the present invention; FIG. 3 is a diagram showing an example of the hardware configuration of the mobile terminal 103 according to the embodiment of the invention; FIG. 3 is a diagram showing an example of hardware configuration of a fixed-point camera 104 according to the embodiment of the present invention; FIG. 3 is a diagram showing an example of the hardware configuration of the information processing device 105 according to the embodiment of the present invention; FIG. 1 shows an example of a functional configuration diagram of an information processing system according to an embodiment of the present invention; FIG. 4 shows a flowchart when regular imaging is performed by the fixed-point camera 104 in the embodiment of the present invention. 4 shows a flowchart from a farm field confirmation request to a farm field imaging implementation in the embodiment of the present invention. 3 shows a flowchart up to display of image data in the information processing apparatus 105 according to the embodiment of the present invention. An example of a display screen when image data is displayed by the information processing apparatus 105 according to the embodiment of the present invention is shown. An example of a display screen when the mobile terminal 103 according to the embodiment of the present invention receives a farm field confirmation request is shown. An example of a display screen when the portable terminal 103 according to the embodiment of the present invention is connected to the fixed point camera 104 is shown. An example of a display screen when the portable terminal 103 according to the embodiment of the present invention takes an image is shown. An example of an image data table 1400 in the embodiment of the present invention is shown.

An embodiment of the present invention will be described in detail below with reference to the drawings. It should be noted that the embodiment described below is an example of a specific implementation of the present invention, and is one of the specific embodiments of the configuration described in the claims.

FIG. 1 shows an example of an information processing system according to this embodiment. FIG. 1 is a diagram showing an example of the system configuration of an information processing system according to the first embodiment. In the information processing system, a server device 101, a mobile terminal 103, a fixed-point camera 104, and an information processing device 105 are communicably connected over a WAN102.

The server device 101 is connected to each communicable device such as the mobile terminal 103, fixed-point camera 104, and information processing device 105, and acquires and manages image data (captured images). It also has a function of outputting image data in response to a request from each device communicably connected to the server apparatus 101 .

The mobile terminal 103 is a terminal used by a worker, and has functions of communicating with the server device 101 and performing processing such as acquisition of position information of a field to be confirmed, reception of a field confirmation request, and transmission of captured image data. have

The fixed-point camera 104 has a function of communicating with the server device 101 and uploading regularly captured image data.

The information processing device 105 is a terminal used by the farm manager, and communicates with the server device 101 to display image data of each field and issue a field confirmation request to the worker (portable terminal 103).

Note that the configuration of various terminals connected to the wide area network (WAN) 102 in FIG. 1 is merely an example, and it goes without saying that there are various configuration examples depending on the application and purpose. The above is an example of the system configuration of the information processing system according to the present embodiment.

Next, the hardware configuration of the server device 101 will be described using FIG. FIG. 2 is a diagram showing the hardware configuration of the server device 101. As shown in FIG.

The CPU 201 comprehensively controls each device and controller connected to the system bus 204 .

The ROM 202 or the external memory 211 also stores a BIOS (Basic Input/Output System), which is a control program for the CPU 201, and an operating system program (OS). Also, the ROM 202 or the external memory 211 stores various programs and the like necessary for realizing the functions executed by each server or each PC. A RAM 203 functions as a main memory, a work area, and the like for the CPU 201 .

The CPU 201 implements various operations by loading programs and the like necessary for execution of processing into the RAM 203 and executing the programs.

An input controller (input C) 205 controls inputs from an input device 209 such as a keyboard and a pointing device such as a mouse (not shown).

A video controller (VC) 206 controls display on a display such as display 210 . The display may be a CRT or liquid crystal display.

A memory controller (MC) 207 controls access to an external memory 211 such as a hard disk (HD) that stores boot programs, browser software, various applications, font data, user files, edit files, various data, and the like. A memory controller (MC) 207 controls access to an external memory 211 such as a flexible disk (FD) or a card-type memory connected to a PCMCIA card slot via an adapter.

A communication I/F controller (communication I/FC) 208 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP/IP is possible.

The CPU 201 enables display on the display 210 by, for example, rasterizing an outline font to a display information area in the RAM 203 . The CPU 201 also allows the user to issue instructions using a mouse cursor (not shown) on the display 210 .

Various programs and the like used by the various devices and servers of the present invention to execute various processes described later are recorded in the external memory 211 and are loaded into the RAM 203 as necessary and executed by the CPU 201 . be. Furthermore, the definition files and various information tables used by the program according to the present invention are stored in the external memory 211 .

Next, the hardware configuration of the mobile terminal 103 will be described using FIG. FIG. 3 is a diagram showing the hardware configuration of the mobile terminal 103. As shown in FIG.

The CPU 301 comprehensively controls each device and controller connected to the system bus 304 .

The ROM 302 or the flash memory 314 also stores a BIOS (Basic Input/Output System), which is a control program for the CPU 301, an operating system program (OS), and a program necessary for realizing the functions executed by the mobile terminal, which will be described later. Various programs and the like to be used are stored. A RAM 303 functions as a main memory, a work area, and the like for the CPU 301 .

The CPU 301 implements various operations by loading programs and the like required for execution of processing into the RAM 303 and executing the programs.

Also, the input controller 305 controls inputs from the touch panel 310 , the microphone 311 and the camera 312 . The touch panel 310 controls input related to the user's touch operation, the microphone 311 controls voice input, and the camera 312 controls input of captured still images and moving images. The output controller 306 controls output to the touch panel 310 and speaker 313 .

The touch panel 310 detects a touch operation from the user and displays an image sent from the output controller 306 described above. The touch panel 310 is a component in which a display and a position input device are integrated. A touch operation (hereinafter referred to as multi-touch) on multiple points can also be detected. Further, the touch panel 310 displays various information acquired from other devices via the network. That is, the touch panel 310 has a function as a display (display unit).

A memory controller (MC) 307 controls access to a flash memory 314 that stores boot programs, browser software, various applications, font data, user files, edit files, various data, and the like. In this embodiment, a flash memory will be described, but a storage medium such as a hard disk (HD), a flexible disk (FD), or a card-type memory connected to a PCMCIA card slot via an adapter may be used.

A communication I/F controller 309 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP/IP is possible.

A sensor controller 308 controls input from a sensor 315 included in the tablet terminal 107 . Various sensors exist in the sensor 315 of the tablet terminal 107, such as a direction sensor, an acceleration sensor, and a GPS (Global Positioning System) sensor.

The CPU 301 enables display on the touch panel 310 by, for example, rasterizing an outline font to a display information area in the RAM 303 .

Various programs and the like used by the portable terminal 103 in the present embodiment to execute various processes described later are recorded in the flash memory 314, and are executed by the CPU 301 by being loaded into the RAM 303 as necessary. be. Furthermore, definition files and various information tables used by the program according to the present invention are stored in the flash memory 314 .

This completes the description of the hardware configuration of the mobile terminal 103 shown in FIG.

Next, FIG. 4 will be described. FIG. 4 is a diagram showing the hardware configuration of the fixed-point camera 104. As shown in FIG.

The CPU 401 comprehensively controls each device and controller connected to the system bus 404 .

The ROM 402 or external memory 408 also stores BIOS (Basic Input/Output System), which is a control program for the CPU 401, and an operating system program (OS). Also, the ROM 402 or external memory 408 stores various programs and the like necessary for realizing the functions executed by each server or each PC. A RAM 403 functions as a main memory, a work area, and the like for the CPU 401 .

The CPU 401 implements various operations by loading programs and the like required for execution of processing into the RAM 403 and executing the programs.

A memory controller (MC) 407 controls access to an external memory 408 such as a hard disk (HD) that stores a boot program, various applications, font data, user files, edit files, various data, and the like. A memory controller (MC) 407 controls access to an external memory 408 such as a flexible disk (FD) or a card-type memory connected to a PCMCIA card slot via an adapter.

The camera unit 406 is connected to the image processing unit 405, and performs photoelectric conversion on the light obtained by passing through the lens directed toward the object to be monitored, using a CCD, CMOS, or other light-receiving cell, and then outputs RGB signals. and complementary color signals to the image processing unit 405 .

An image processing unit 405 performs white balance adjustment, gamma processing, and sharpness processing based on RGB signals and complementary color signals. Furthermore, the image processing unit 405 performs YC signal processing to generate a luminance signal Y and a chroma signal (hereinafter referred to as YC signal), and compresses the YC signal in a predetermined compression format (eg, JPEG format, MotionJPEG format, etc.). . This compressed data is temporarily stored in the external memory 408 as image data.

A communication I/F controller (communication I/FC) 409 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP/IP is possible. Image data stored in the external memory 408 is transmitted to the external device by the communication I/F controller 409 .

Next, FIG. 5 will be described. FIG. 5 is a diagram showing the hardware configuration of the information processing apparatus 105. As shown in FIG.

A CPU 501 comprehensively controls each device and controller connected to the system bus 504 .

The ROM 502 or the external memory 511 also stores a BIOS (Basic Input/Output System), which is a control program for the CPU 501, and an operating system program (OS). Also, the ROM 502 or the external memory 511 stores various programs and the like necessary for realizing the functions executed by each server or each PC. A RAM 503 functions as a main memory, a work area, and the like for the CPU 501 .

The CPU 501 implements various operations by loading programs and the like necessary for executing processing into the RAM 503 and executing the programs.

An input controller (input C) 505 controls inputs from an input device 509 such as a keyboard and a pointing device such as a mouse (not shown).

A video controller (VC) 506 controls display on a display such as display 510 . The display may be a CRT or liquid crystal display.

A memory controller (MC) 507 controls access to an external memory 511 such as a hard disk (HD) that stores boot programs, browser software, various applications, font data, user files, edit files, various data, and the like. A memory controller (MC) 507 controls access to an external memory 511 such as a flexible disk (FD) or a card-type memory connected to a PCMCIA card slot via an adapter.

A communication I/F controller (communication I/FC) 508 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP/IP is possible.

The CPU 501 enables display on the display 510 by, for example, rasterizing an outline font to a display information area in the RAM 503 . Further, the CPU 501 enables user instructions with a mouse cursor or the like (not shown) on the display 510 .

Various programs and the like used by the various devices and servers of the present invention to execute various processes described later are recorded in the external memory 511 and are loaded into the RAM 503 as necessary and executed by the CPU 501 . be. Furthermore, the definition files and various information tables used by the program according to the present invention are stored in the external memory 511 .

Next, a functional configuration diagram of the information processing system according to this embodiment will be described with reference to FIG. Note that the functional configuration shown in FIG. 6 is merely an example, and there are various configuration examples depending on the application and purpose, so the configuration is not limited to this. These functions are executed by the CPU 201 of the server device 101 , the CPU 301 of the mobile terminal 103 , the CPU 401 of the fixed point camera 104 , and the CPU 501 of the information processing device 105 .

The server device 101 includes a data disclosure unit 611 , a data reception unit 612 , a storage unit 613 , a data sorting unit 614 and an event transmission unit 615 .

The data publishing unit 611 is a functional unit that publishes image data by outputting image data of each field according to a request from the information processing device 105 . The image data output here includes image data captured by the fixed-point camera 104 and image data captured by the portable terminal 103 .

A data receiving unit 612 is a functional unit that receives image data transmitted from the fixed point camera 104 or the mobile terminal 103 .

The storage unit 613 is a functional unit that stores image data captured by the fixed-point camera 104 or the mobile terminal 103 and received by the data reception unit 612 . The storage unit 613 further stores the image data captured by the fixed-point camera 104 and the image data captured by the portable terminal 103 in association with identification information such as the camera ID 1402 of the fixed-point camera 104 and the newly issued event ID 1403. is also possible. Note that the camera ID 1402 and event ID 1403 will be described later using the image data table 1400 in FIG.

The data sorting unit 614 is a functional unit that analyzes the image data received by the data receiving unit 612 according to specific rules. Analysis according to a specific rule means sorting out the image data using the identification information of the fixed point camera 104 and the information of the event ID 1403 linked to each farm field confirmation request. The farm field confirmation request will be described later in the description of the farm field confirmation request reception unit 631, which is the functional configuration of the mobile terminal 103 in FIG. The data sorting unit 614 analyzes the image data, stores it by the function of the storage unit 613, and arranges information about the image data so that necessary image data can be displayed in response to a request from the information processing apparatus 105 or another device. have the function to

The event transmission unit 615 is a functional unit that issues guidance for updating image data to the information processing apparatus 105 when image data is received from the mobile terminal 103 . Here, the image data to be updated is image data stored in the storage unit 613 . The information processing apparatus 105 that has received the guidance issued by the event transmission unit 615 can display the image data based on the URL indicating the storage location of the image data described in the guidance.

Next, the functional configuration of the mobile terminal 103 will be described. The mobile terminal 103 includes a field confirmation request receiving section 631 , a fixed point camera link section 632 , a fixed point camera ID checking section 633 , a mobile terminal photographing section 634 and a mobile terminal data transmitting section 635 .

The farm field confirmation request receiving unit 631 is a functional unit for receiving the farm field confirmation request transmitted from the information processing device 105 . Here, the farm field confirmation request is information that includes information that can identify the farm field, such as the camera ID 1402 of the fixed-point camera 104, and a request for photographing the farm field. In addition, the field confirmation request is notified to be transmitted to the mobile terminal 103 . The notification of the field imaging request is a notification displayed on the screen of the mobile terminal 103 . Note that the notification of the request for photographing the field is not limited to this, and may be notification by e-mail. Although the field confirmation request is transmitted from the information processing device 105 in the present embodiment, it is not limited to this. For example, the server device 101 may issue an agricultural field confirmation request and transmit it to the mobile terminal 103 in response to receiving the agricultural field confirmation request from the information processing device 105 . The name and camera ID 1402 of the fixed-point camera 104, the location of the fixed-point camera 104, and the like are displayed on the touch panel 310 of the portable terminal 103. FIG. Also, the camera ID 1402 will be described later in the explanation part of FIG.

A fixed-point camera link unit 632 is a functional unit that acquires identification information (camera ID 1402 ) from the fixed-point camera 104 . The connection method between the fixed-point camera 104 and the mobile terminal 103 may be wireless communication such as NFC (Near Field Communication) or IrDA (Infrared Data Association), or wired communication.

The fixed-point camera ID check unit 633 confirms that the identification information (second identification information) acquired by the fixed-point camera link unit 632 matches the identification information (first identification information) of the fixed-point camera 104 included in the received field confirmation request. It is a functional unit that determines whether or not to The fixed-point camera ID checking unit 633 notifies the result of determining the identification information of each fixed-point camera 104 .

The mobile terminal photographing unit 634 is a functional unit that controls photographing by the camera 312 of the mobile terminal 103 (imaging control means). In this embodiment, the identification information of the fixed-point camera 104 is determined by the fixed-point camera ID checking unit 633, and when it is determined that the two obtained identification information match each other, the function of the portable terminal photographing unit 634 is used to capture an image. If the fixed-point camera ID checking section 633 determines that the two pieces of identification information do not match, the portable terminal photographing section 634 may control the photographing so as not to perform the photographing.

The mobile terminal data transmission unit 635 is a functional unit that transmits the image data of the photograph taken by the mobile terminal photographing unit 634 to the server device 101 .

Next, the functional configuration of the fixed point camera 104 will be described. The fixed-point camera 104 includes a fixed-point camera photographing unit 641 , a fixed-point camera data transmission unit 642 , and a camera ID transmission unit 643 .

The fixed-point camera photographing unit 641 is a functional unit that periodically takes an image of the field. Here, the fixed-point camera photography unit 641 may capture moving images at a specific frame rate. Also, the fixed-point camera photographing section 641 may take an image at regular timing such as every hour or every day.

The fixed-point camera data transmission unit 642 is a functional unit that transmits image data of an image captured by the function of the fixed-point camera photographing unit 641 to the server device 101 .

A camera ID transmission unit 643 is a functional unit that transmits identification information (camera ID 1402 ) of the fixed point camera 104 to the mobile terminal 103 . The camera ID transmission unit 643 operates when the function of the fixed point camera link unit 632 of the mobile terminal 103 is detected.

Next, the functional configuration of the information processing device 105 will be described. The information processing device 105 includes a field confirmation request transmission unit 651 and a display control unit 652 .

The farm field confirmation request transmission unit 651 is a functional unit that transmits a farm field confirmation request to the mobile terminal 103 together with information that can identify the farm field such as the identification information of the fixed point camera 104 .

The display control unit 652 is a functional unit that controls the display 510 of the information processing apparatus 105 to display various screens. The display control unit 652 displays image data output by the function of the data disclosure unit 611 of the server device 101 . Furthermore, the display control unit 652 can also perform control to display specific image data in a distinguishable manner from other image data according to information included in the image data stored in the storage unit 613 of the server apparatus 101. . Displaying image data in an identifiable manner means, for example, displaying an image associated with other image data so that the correspondence relationship between the image data captured by the fixed-point camera 104 and the image data captured by the portable terminal 103 can be understood. Including the case where is displayed in a different display mode. In this case, the server apparatus 101 sets parameters for the association of image data and the identification display of the image data. Then, the information processing device 105 performs control to identify and display the image data based on the parameters set by the server device 101 .

It should be noted that the subject of operation of each functional unit described above may be changed as appropriate. As an example, the various functional units of the server device 101 may be provided in the mobile terminal 103, the fixed-point camera 104, and the information processing device 105. FIG. Also, various functional units of the mobile terminal 103 may be provided in the mobile terminal 103 and the server device 101 .

Next, with reference to FIG. 7, the flow of the flowchart when regular imaging is performed by the fixed-point camera 104 in the embodiment of the present invention will be described. The fixed-point camera 104 in this embodiment periodically captures an image of the field and transmits the image data obtained by capturing the image to the server device 101 .

In step S701, the CPU 401 of the fixed point camera 104 acquires current time information.

In step S702, the CPU 401 of the fixed-point camera 104 determines whether or not the current time is the imaging time at which imaging should be performed. More specifically, the set imaging time is compared with the current time, and if the current time is the same as the imaging time or has passed the imaging time, the process proceeds to step S703. If the current time has not yet reached the imaging time, the process of step S702 is repeated until the imaging time is reached.

In step S<b>703 , the CPU 401 of the fixed point camera 104 captures a photograph using the function of the fixed point camera photographing unit 641 .

In step S<b>704 , the CPU 401 of the fixed point camera 104 uses the function of the fixed point camera data transmission unit 642 to transmit the image data obtained by the imaging in step S<b>703 to the server device 101 .

In step S<b>705 , the CPU 201 of the server apparatus 101 receives image data from the fixed point camera 104 using the function of the data receiving unit 612 .

In step S706, the CPU 201 of the server device 101 analyzes the image data received in step S705 by the function of the data sorting unit 614, and converts the data into a structure that is easy to refer to. The structure that makes it easy to refer to data is, for example, the structure of an image data table 1400 shown in FIG. The CPU 201 of the server apparatus 101 organizes and stores information contained in the received image data like an image data table 1400 .

Now, FIG. 14 will be described. FIG. 14 shows an example of an image data table 1400 in this embodiment. The image data table 1400 is a data table that stores information on image data to be stored in the server device 101 . The image data table 1400 includes an image ID 1401 , camera ID 1402 , event ID 1403 , file path 1404 , and imaging time 1405 . The image ID 1401 indicates a value that can uniquely identify image data stored in the storage unit 613 of the server device 101 . A camera ID 1402 indicates a value that can uniquely identify each fixed point camera 104 . The camera ID 1402 is assigned to the image data captured by each fixed-point camera 104, and when the mobile terminal 103 and the fixed-point camera 104 communicate with each other in response to an agricultural field confirmation request to capture an image, the image data captured by the mobile terminal 103 is also given a camera ID 1402 . The event ID 1403 indicates a value with which the information processing apparatus 105 can uniquely identify the image data captured by the field confirmation request. The information processing device 105 uses the specified camera ID 1402 to issue a field confirmation request. Therefore, it is possible to use the event ID 1403 to associate the image data captured by the fixed-point camera 104 that issued the farm field confirmation request with the image data of the portable terminal 103 captured by the farm field confirmation request. . A file path 1404 indicates path information that allows access to files stored in the server device 101 . The imaging time 1405 indicates the date and time when the image data was saved in the server device 101 . On each screen displayed by the information processing apparatus 105 shown in FIG. 10, it is also possible to sort the order of arrangement of each image data using the image data table 1400 .

In step S<b>707 , the CPU 201 of the server apparatus 101 converts the file name of the image data analyzed in step S<b>706 according to the analysis result, and stores the image data using the function of the storage unit 613 .

In step S708, the CPU 401 of the fixed-point camera 104 calculates the next imaging time from the imaging time of the imaging in step S703 using preset imaging timing. The preset imaging timing is, for example, information indicating imaging timing such as 1 hour or 15 minutes after imaging.

With the above, the description of FIG. 7 ends. By the processing in FIG. 7, the fixed-point camera 104 periodically takes an image and transmits the image data obtained by the image pickup to the server device 101 .

Next, with reference to FIG. 8, a series of processes from a field confirmation request to the execution of imaging of the field in the embodiment of the present invention will be described.

In step S<b>801 , the CPU 501 of the information processing apparatus 105 receives a field confirmation request and transmits the field confirmation request to the mobile terminal 103 using the function of the field confirmation request transmission unit 651 . The information processing apparatus 105 accepts a request for field confirmation request on the confirmation request screen 1100 of FIG. 11, for example. The CPU 501 of the information processing device 105 also transmits the camera ID 1402 of the designated fixed-point camera 104 together with the field confirmation request. The camera ID 1402 receives selection on the fixed point camera selection screen 1000 shown in FIG. 10, for example.

FIG. 10 is a screen showing an example of a fixed point camera selection screen 1000. As shown in FIG. A fixed-point camera selection screen 1000 displays a list of camera IDs 1402 of fixed-point cameras managed by the server device 101 .

Here, the confirmation request screen 1100 in FIG. 11 will be described. The confirmation request screen 1100 includes a worker selection acceptance section 1101 , a request content description button 1102 , and a request button 1103 . The worker selection reception unit 1101 receives selection of a worker who transmits a field confirmation request. A request content entry button 1102 accepts entry of detailed content of the farm field confirmation request when the button 1102 is pressed. The request button 1103 transmits the content accepted by the request content description button 1102 to the mobile terminal 103 of the worker accepted by the worker selection acceptance unit 1101 . The farm field confirmation request may be transmitted from the information processing device 105, or the information processing device 105 may receive the farm field confirmation request, transmit it once to the server device 101, and transmit the farm field confirmation request received by the server device 101 to the mobile terminal 103. may be sent to

In step S<b>802 , the CPU 301 of the mobile terminal 103 receives a farm field confirmation request using the function of the farm field confirmation request reception unit 631 . When the farm field confirmation request is received, for example, a screen such as the farm field confirmation request reception screen 1110 in FIG. 11 is displayed on the screen of the mobile terminal 103 .

Here, the field confirmation request reception screen 1110 in FIG. 11 will be described. A farm field confirmation request reception screen 1110 is an example of a screen displayed on the mobile terminal 103 when a farm field confirmation request is received. The field confirmation request reception screen 1110 includes a request details display 1111, and displays the details of the request received on the confirmation request screen 1100 in the details display 1111. FIG. The detailed display 1111 may display the camera ID 1402 of the fixed point camera 104 .

In step S803, the CPU 301 of the mobile terminal 103 communicates with the fixed point camera 104 installed in the field. More specifically, the operator holds the portable terminal 103 over the fixed-point camera 104, and communicates with the fixed-point camera 104 through wireless communication. As long as it can communicate with the fixed point camera 104, it may be wireless communication or wired communication. Also, at this time, the worker carrying the portable terminal 103 needs to move to the field where the fixed point camera 104 is installed.

In step S<b>804 , the CPU 301 of the mobile terminal 103 receives the camera ID 1402 from the fixed point camera 104 using the function of the fixed point camera link section 632 . Here, the camera ID 1402 is transmitted from the fixed point camera 104 by the function of the camera ID transmission section 643 . Then, the CPU 301 of the portable terminal 103 determines whether or not the camera ID 1402 received together with the farm field confirmation request matches the camera ID 1402 received from the fixed point camera 104 using the function of the fixed point camera ID check unit 633 . If it is determined that the camera ID 1402 received together with the field confirmation request matches the camera ID 1402 received from the fixed point camera 104, the process proceeds to step S806. If it is determined that the camera ID 1402 received together with the field confirmation request does not match the camera ID 1402 received from the fixed point camera 104, the process proceeds to step S805.

In step S805, the CPU 301 of the mobile terminal 103 notifies the screen of the mobile terminal 103 of an error if the camera IDs 1402 do not match as a result of determining that the camera IDs 1402 match in step S804. The error notification is, for example, the confirmation failure screen 1200 shown in FIG.

Here, FIG. 12 will be described. FIG. 12 shows a screen for notifying the determination result by displaying on the screen of the portable terminal 103 when the camera ID 1402 matches and when the camera ID 1402 does not match as a result of confirming the match of the camera ID 1402 in step S804 of FIG. . A confirmation failure screen 1200 is displayed when the camera IDs 1402 do not match, and an error display 1201 is displayed. A confirmation success screen 1210 is a screen displayed when the camera IDs 1402 match, and displays a success display 1211 . After displaying the confirmation success screen 1210, the CPU 301 of the mobile terminal 103 displays a screen for imaging.

In step S806, the CPU 301 of the mobile terminal 103 determines that the camera IDs 1402 match in step S804, and notifies the user that the camera IDs 1402 match by displaying the confirmation success screen 1210 in FIG. Then, the CPU 301 of the mobile terminal 103 activates the camera 312 of the mobile terminal 103 and changes the mode to the photographing mode. Note that in this embodiment, in order for the mobile terminal 103 to switch to the imaging mode, it is necessary to determine in step S804 that the camera IDs 1402 match. That is, unless it is determined in step S804 that the camera IDs 1402 match, control is performed so that no photograph can be taken. As a result, it is possible to prevent the worker from transmitting image data captured at a wrong position to the server device 101 . In addition, even if the camera ID 1402 is not limited to matching, even if the image capturing is permitted, it is possible to prevent the image data of the captured image from being transmitted, or to prevent the image data received by the server device 101 from being stored (not stored). be. Such processing can also prevent storing image data acquired at the wrong location.

In step S<b>807 , the CPU 301 of the mobile terminal 103 captures a photo using the function of the mobile terminal photo imaging unit 634 .

A captured screen 1300 in FIG. 13 shows an example of a screen captured by the mobile terminal 103 . When the mode is changed to the imaging mode in step S<b>806 , the mobile terminal 103 displays the imaging screen 1300 .

In step S<b>808 , the CPU 301 of the mobile terminal 103 transmits the captured image data to the server device 101 using the function of the mobile terminal data transmission unit 635 .

In step S<b>809 , the CPU 201 of the server apparatus 101 receives image data using the function of the data receiving unit 612 .

In step S<b>810 , the CPU 201 of the server device 101 analyzes the received image data using the function of the data sorting section 614 . Analyzing the image data means storing information contained in the received image data in the image data table 1400 .

In step S<b>811 , the CPU 201 of the server device 101 converts the file name of the image data according to the analysis result in step S<b>810 , and stores the image data using the function of the storage unit 613 .

In step S<b>812 , the CPU 201 of the server apparatus 101 adds image data, issues an addition event indicating that the stored image data has been updated, and transmits event information to the information processing apparatus 105 . Event information indicates information that can be accessed to refer to image data, and is notified to the information processing apparatus 105 by the function of the event transmission unit 615 . As for the notification method, a notification screen may be displayed on the screen of the mobile terminal 103, or an e-mail may be sent to the information processing apparatus 105 for notification. As the content of the event information, for example, the CPU 201 of the server apparatus 101 issues an event ID 1403, issues a URL for accessing image data by adding the value of the event ID 1403, and updates the image data. including. The update of the image data includes the case where the image data captured by the field confirmation request is newly stored in the server device 101 and the case where the image data of the fixed point camera 104 is newly stored.

In step S<b>813 , the CPU 501 of the information processing device 105 receives event information from the server device 101 .

This completes the description of FIG. 8, a more detailed image related to the image of the fixed point camera 104 can be obtained from the mobile terminal 103 and stored in the server device 101. FIG. At this time, as described in step S806, by permitting image capturing using the camera ID 1402 of the fixed-point camera 104, it is possible to prevent the worker from transmitting image data captured at the wrong position to the server device 101. .

Next, a series of processes for displaying image data in the information processing apparatus 105 according to the embodiment of the present invention will be described with reference to FIG. The image data displayed here is image data captured by the fixed-point camera 104 and the mobile terminal 103 and stored in the server device 101 .

In step S<b>901 , the CPU 301 of the information processing apparatus 105 accesses the URL included in the event information of the image data received from the server apparatus 101 using the function of the data disclosure unit 611 . Upon receiving access to the URL, the CPU 301 of the information processing device 105 transmits an access request to the server device 101 . There are two types of URL arguments for accepting access, and a camera ID 1402 value for specifying image data and an arbitrary event ID 1403 value are given. The event ID 1403 is assigned when there is an image captured by the field confirmation request.

In step S902, the CPU 201 of the server apparatus 101 receives an access request from the information processing apparatus 105, and determines whether or not the event ID 1403 is assigned to the URL for which the access is received. If it is determined that the event ID 1403 is assigned, the process proceeds to step S906. When the CPU 201 of the server apparatus 101 determines that the event ID 1403 is not assigned, the process proceeds to step S903. Here, if the event ID 1403 is attached to the URL, it indicates that the image data is the image data of the portable terminal 103 in response to the farm field confirmation request. indicates that there is

In step S903, the CPU 201 of the server apparatus 101 acquires an image data list linked to the camera ID 1402 from the image data table 1400 using the function of the data disclosure unit 611 when the event ID 1403 is not assigned to the received URL. do.

In step S904, the CPU 201 of the server apparatus 101 determines whether image data having the event ID 1403 exists in the acquired image data list. If the CPU 201 of the server apparatus 101 determines that there is image data with the event ID 1403, the process advances to step S905. If the CPU 201 of the server apparatus 101 determines that there is no image data with the event ID 1403, the process advances to step S907.

In step S905, when the CPU 201 of the server apparatus 101 determines that the event ID 1403 exists in the acquired image data, it assigns an identifiable parameter for each event ID 1403 to the image data. The parameter is a parameter that enables the image data to be highlighted by identification display such as a color or a mark when the image data is displayed on the information processing apparatus 105 . In addition, since a parameter is assigned to each event ID 1403, there is an effect of facilitating recognition of associated image data. The display screen based on the parameters given to be emphasized in step S905 is the fixed point camera screen 1020 in FIG. Fixed-point camera screen 1020 in FIG. 10 will be described later in the description of FIG.

In step S<b>906 , the CPU 201 of the server apparatus 101 acquires an image data list linked to the event ID 1403 from the image data table 1400 when determining that the event ID 1403 is added to the URL received in step S<b>902 .

In step S907, the CPU 201 of the server apparatus 101 generates screen information for displaying image data on the information processing apparatus 105 based on the acquired information based on the processing of steps S903 to S905. Further, the CPU 201 of the server apparatus 101 generates screen information based on the process of step S902. The CPU 201 of the server device 101 that has generated the screen information in step S907 transmits the generated screen information to the information processing device 105 .

Here, fixed-point camera screen 1010 and fixed-point camera screen 1020 in FIG. 10 displayed by information processing apparatus 105 based on the screen information generated in step S907 will be described. A fixed-point camera screen 1010 and a fixed-point camera screen 1020 are screens that can be displayed by the information processing device 105, and are screens on which image data captured by the fixed-point camera 104 and the mobile terminal 103 stored in the server device 101 are displayed. . Fixed point camera screen 1010 includes display screen 1011 , thumbnail screen 1012 , and camera ID display 1013 . Note that the display screen 1011 and the thumbnail screen 1012 are commonly included in the fixed-point camera screen 1020 and the screen 1030 at the time of field confirmation in FIG. A thumbnail screen 1012 is a column in which a list of images captured so far is displayed as thumbnail images. Also, the image displayed on the fixed point camera screen 1010 is an image associated with the camera ID 1402 displayed on the camera ID display 1013 . A fixed-point camera screen 1010 is the image data captured by the fixed-point camera 104 acquired in step S903 of FIG. . Fixed point camera screen 1020 includes highlighting 1021 . A fixed-point camera screen 1020 is a screen on which image data captured by the fixed-point camera 104 and the mobile terminal 103 and associated with each other is displayed. Note that the image data associated with the display screen 1011 is displayed by highlighting 1021 so as to be distinguishable from other image data that does not correspond. This highlighting 1021 is displayed by the information processing device 105 based on the parameters assigned in step S905 of FIG.

Furthermore, the screen 1030 at the time of field confirmation in FIG. 10 will be described. A screen 1030 at the time of field confirmation includes an event ID display 1031 . A screen 1030 at the time of field confirmation shows an example of a screen for displaying image data captured by the mobile terminal 103 and acquired by the field confirmation request.

In step S<b>908 , the CPU 501 of the information processing apparatus 105 controls display of image data using the function of the display control unit 652 based on the screen information received from the server apparatus 101 . Here, the screens for displaying the image data are the fixed point camera screen 1010 and the fixed point camera screen 1020 in FIG. 10, and the screen 1030 at the time of field confirmation.

This completes the description of FIG. By the processing of FIG. 9, the user can easily check the image captured by the fixed-point camera 104 and the image captured by the mobile terminal 103 in response to the field confirmation request. Further, in this embodiment, the image data captured by the fixed-point camera 104 and the mobile terminal 103 are associated with each other by the camera ID 1402 and the event ID 1403 . Therefore, even if the user does not associate the image data captured by the fixed-point camera 104 and the portable terminal 103 with each other, the correspondence can be confirmed on the display screen of the information processing device 105 .

As described above, according to the present invention, there is an effect that it is possible to suppress the imaging of the wrong position by the operator in response to the imaging request of the designated position.

The present invention can also be embodied as, for example, a system, device, method, program, storage medium, etc. Specifically, it may be applied to a system composed of a plurality of devices. It may be applied to an apparatus consisting of one device.

Note that this embodiment can also be realized by a computer or a control computer executing a program (computer program). In addition, a means for supplying a program to a computer, for example, a computer-readable recording medium such as a CD-ROM recording such a program or a transmission medium such as the Internet transmitting such a program can be applied as an embodiment. . Moreover, the above program can also be applied as an embodiment. The above program, recording medium, transmission medium and program product are included in the scope of the present invention.

Although the above has been described in detail based on the embodiments, the scope of the present invention is not limited to specific embodiments, and includes various forms without departing from the gist of the invention. Furthermore, the above-described embodiment merely shows one embodiment, and inventions that can be easily imagined from the above-described embodiment are also included in the scope of the present invention.

101 server device 102 WAN
103 Portable terminal 104 Fixed point camera 105 Information processing device 201 CPU
202 ROMs
203 RAM
211 external memory 301 CPU
302 ROMs
303 RAM
310 touch panel 312 camera 401 CPU
402 ROMs
403 RAM
406 camera 501 CPU
502 ROMs
503 RAM
510 Display 511 External memory

Claims (19)

An information processing system in which a plurality of imaging devices , an information processing device, and a mobile terminal are communicably connected,
a first obtaining means for obtaining , from the information processing device, first identification information that is information that enables identification of a specific imaging device among a plurality of imaging devices;
a second acquisition means for acquiring second identification information, which is information capable of identifying the imaging device , from the imaging device;
Control means for controlling to notify information according to whether the first identification information acquired by the first acquisition means and the second identification information acquired by the second acquisition means match or not An information processing system comprising: and . 2. The information according to claim 1, wherein said control means performs control so that different notifications are given depending on whether said first identification information and said second identification information match and when they do not match. processing system. An information processing system in which a plurality of imaging devices , an information processing device, and a mobile terminal are communicably connected,
a first obtaining means for obtaining , from the information processing device, first identification information that is information that enables identification of a specific imaging device among a plurality of imaging devices;
a second acquisition means for acquiring second identification information, which is information capable of identifying the imaging device , from the imaging device;
Based on a match between the first identification information acquired by the first acquisition means and the second identification information acquired by the second acquisition means, the imaging means is controlled to perform imaging. An information processing system comprising: imaging control means; The imaging control means controls to display a screen for performing imaging by the imaging means in response to a match between the first identification information and the second identification information. The information processing system according to claim 3. The information processing device further comprises storage means for storing the captured image captured by the imaging control means,
5. The information processing system according to claim 3 , wherein said storage means stores said captured image in association with said first identification information and said second identification information. The information processing device further comprises display control means for controlling to display the captured image stored in the storage means,
The display control means stores an image captured by the imaging device and a captured image captured by the portable terminal in association with the first identification information and the second identification information in the storage means. 6. The information processing system according to claim 5 , wherein, if there is, a corresponding relationship between the image captured by said imaging device and the captured image captured by said mobile terminal is displayed so as to be identifiable. a first obtaining means for obtaining, from an information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition means for acquiring second identification information, which is information capable of identifying the imaging device, from the imaging device;
Control means for controlling to notify information according to whether the first identification information acquired by the first acquisition means and the second identification information acquired by the second acquisition means match or not When
A mobile terminal comprising: 8. The portable device according to claim 7, wherein said control means performs control so that different notifications are given depending on whether said first identification information and said second identification information match and when they do not match. terminal. a first obtaining means for obtaining, from an information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition means for acquiring second identification information, which is information capable of identifying the imaging device, from the imaging device;
Based on a match between the first identification information acquired by the first acquisition means and the second identification information acquired by the second acquisition means, control is performed so that the imaging means performs imaging. imaging control means;
A mobile terminal comprising: further comprising notifying means for notifying information according to whether the first identification information obtained by the first obtaining means and the second identification information obtained by the second obtaining means match or not; 10. The mobile terminal according to claim 9, characterized by: 11. A mobile terminal according to claim 9, comprising said imaging means. 12. The apparatus according to any one of claims 7 to 11, wherein the imaging apparatus is included in an information processing system in which a plurality of imaging devices, an information processing device that manages the plurality of imaging devices, and a portable terminal are communicatively connected. Mobile device as described. 12. The mobile terminal according to any one of claims 7 to 11, wherein the imaging device is a fixed point camera. 12. The mobile terminal according to any one of claims 7 to 11, wherein the imaging device is installed in a field. A control method for an information processing system in which a plurality of imaging devices , an information processing device, and a mobile terminal are communicably connected,
a first obtaining step of obtaining , from the information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition step of acquiring second identification information, which is information capable of identifying the imaging device , from the imaging device;
A control step of controlling to notify information according to whether or not the first identification information acquired in the first acquisition step and the second identification information acquired in the second acquisition step match. A control method for an information processing system, comprising: A control method for an information processing system in which a plurality of imaging devices , an information processing device, and a mobile terminal are communicably connected,
a first obtaining step of obtaining , from the information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition step of acquiring second identification information, which is information capable of identifying the imaging device , from the imaging device;
Based on the fact that the first identification information obtained in the first obtaining step and the second identification information obtained in the second obtaining step match, the imaging means is controlled to perform imaging. A control method for an information processing system, comprising: an imaging control step; a first obtaining step of obtaining, from an information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition step of acquiring second identification information, which is information capable of identifying the imaging device, from the imaging device;
A control step of controlling to notify information according to whether or not the first identification information acquired in the first acquisition step and the second identification information acquired in the second acquisition step match. When
A control method for a mobile terminal, comprising: a first obtaining step of obtaining, from an information processing device, first identification information that is information capable of identifying a specific imaging device among a plurality of imaging devices;
a second acquisition step of acquiring second identification information, which is information capable of identifying the imaging device, from the imaging device;
Based on the fact that the first identification information obtained in the first obtaining step and the second identification information obtained in the second obtaining step match, the imaging means is controlled to perform imaging. imaging control step and
A control method for a mobile terminal, comprising: A program for causing a computer to function as each means of the mobile terminal according to any one of claims 7 to 14.

Images