JP2015204050A - information providing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for grasping attributes of people and number of people existing in the surrounding, by acquiring and analyzing surrounding information such as positional information, image information and speech information when there is no response to an answer request for a constant time, and a technique for browsing safety information of a target person among system users.SOLUTION: When there is no response to an answer request for a constant time, after notification of the answer request, positional information, image information of the surrounding, and speech information of the surrounding are acquired, and pieces of the acquired information are analyzed for grasping attributes and number of people existing in the surrounding, and these information can be browsed among system users who have been authorized in advance, in addition to a manager.

Description

  The present invention relates to an information providing system that analyzes information collected from a user terminal and distributes the analysis result to the user terminal.

  As a system for collecting and tabulating a large amount of information assuming application to a large-scale disaster, there is a technique described in Patent Document 1. This gazette states that "using software that uses the camera function and GPS function of the mobile terminal, the site information such as the image and position information, which is information based on the telephone pole number, and the safety information are transmitted from the site to the information server. The site information and the safety information are accumulated in the information server and the damage status is totaled, and the information can be visually grasped on the map by using the location information by the client PC wired or wirelessly connected to the information server. There is a description of "providing system" (summary).

JP 2010-238002 A

  In patent document 1, the case where the positional information by a GPS function cannot be acquired, or the case where a telephone pole number cannot be acquired by a camera function is not assumed. Therefore, the position information is not specified when the position information obtained by the GPS function has failed to be acquired or when the utility pole number is not shown in the captured image.

  Further, the aggregated damage information is assumed to be browsed by a client PC wired or wirelessly connected to the information server, and it is not assumed that the system users browse the information using a portable terminal. .

  Furthermore, it is not assumed that the application cannot be responded to the application for some reason after the reply request arrives, and the data that can be processed is limited to the data that can be responded by the person holding the portable terminal.

  Accordingly, the present invention provides a more accurate information collection and analysis system including terminals that do not respond to a response request for a certain period of time.

  More specifically, the present invention acquires position information, surrounding video information, sound information, etc. when there is no response for a certain period of time after notifying an answer request, and analyzes the acquired information to identify the surrounding people Understand the attributes and number of people, and enable browsing of information by system users as well as administrators.

  A more specific aspect of the present invention includes a plurality of information acquisition terminals and an information processing device, wherein the information processing device 2 collects information from the plurality of information acquisition terminals, and displays a processing result of the collected information. It is an information providing system that enables browsing.

In the information providing system,
Each of the information acquisition terminals includes a communication function with the information processing device, an information acquisition device that acquires peripheral information, peripheral information acquired by the information acquisition device, and the information acquisition terminal received from the information processing device. A function of transmitting the safety information when the safety information is input in response to a safety information reply request to the user, to the information processing apparatus,
The information processing apparatus has a function of transmitting an input of the safety information and a response request for the input safety information to the plurality of information acquisition terminals, and the peripheral information received from the plurality of information acquisition terminals, or It has a function of analyzing the peripheral information and the safety information, and a function of enabling an analysis result to be browsed from the information processing apparatus and / or the information acquisition terminal.

Furthermore, the information acquisition terminal
When there is no response input by the user within a predetermined time in response to the received response request for the safety information, the peripheral information without the safety information is transmitted to the information processing apparatus. Also good.

  Furthermore, the information acquisition device may be any one or more of a sound collection device, an imaging device, and a position information acquisition device, and the peripheral information includes sound information acquired by the sound collection device, and the imaging device. May be any one or more of the image acquired and the position information acquired by the position information acquisition apparatus.

  Further, the information acquisition terminal presents a plurality of answer items for the answer request for the safety information so as to be selectable, and transmits any answer item selected by the user of the information terminal as the safety information. It may be configured.

  Further, the information processing apparatus may be configured to repeatedly transmit the answer request after a predetermined time interval.

  Further, the information processing apparatus manages processing results of responses to the reply requests repeatedly transmitted in chronological order so that the information processing apparatus and / or the information acquisition terminal can view the results in a state where they can be compared with each other. You may comprise.

  According to the present invention, more accurate information can be collected, which contributes to more disaster support.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

Network configuration diagram. The figure which shows the hardware structural example of the information acquisition terminal 1 of 1st Embodiment. 1 is a diagram illustrating a hardware configuration example of an information processing apparatus according to a first embodiment. 2 is a diagram illustrating a software configuration example of the information processing apparatus according to the first embodiment. FIG. The figure which shows the hardware structural example of the information acquisition terminal 1 of 2nd Embodiment. The figure which shows the hardware structural example of the information processing apparatus of 2nd Embodiment. The figure which displayed the processing result on the map on information processing apparatus. The figure which displayed the processing result on the map on the information acquisition terminal 1. FIG. The sequence diagram of a 1st embodiment. The flowchart which shows the process sequence example of 1st Embodiment. The figure which shows the example of the first picked-up image image | photographed using imaging devices, such as a camera of the information acquisition terminal 1. FIG. The figure which shows the example of an image image | photographed after the fixed time image | photographed using imaging devices, such as a camera of the information acquisition terminal. The figure which shows the example of the picked-up image previously registered into the apparatus which performs an image recognition process. The figure which shows the example of an image image | photographed using imaging devices, such as a camera of the information acquisition terminal. The figure which displayed the processing result guessed the positional information on information processing apparatus.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a network configuration diagram of this embodiment. In this embodiment, a reply request is notified from the information processing apparatus to the information acquisition terminal 1 via the communication network, and the information processing apparatus returns a reply.

  In the present embodiment, a portable sound collection device 13 (for example, a microphone), an imaging device 12 (for example, a camera), and a position information acquisition device using GPS, such as a portable device having the configuration shown in FIG. 11 is used as the information acquisition terminal 1, and an electronic computer such as a personal computer incorporating the sound recognition unit 21, the image recognition unit 20, and the position information processing unit 19 configured as shown in FIG. Used as

  In the present embodiment, the information acquisition terminal 1 is exemplified as a portable device such as a smartphone, and mainly describes acquiring information of an owner user (sometimes referred to as a user). As a device that collects information widely without specifying an information acquisition target person, a device such as a surveillance camera or a sound collecting microphone installed in a specific place, for example, in a street may be used.

  When the user does not input an answer for a certain period of time after receiving the notification from the information processing apparatus, the sound collection device 13, the imaging device 12, and the position information mounted on the information acquisition terminal 1 shown in FIG. Information may be acquired by an information acquisition device such as the acquisition device 11 and sent to the information processing device illustrated in FIG. 3, and the information processing device may estimate, for example, the safety or location of the user.

  In addition, when there is no response from the user or when it is desired to check a new safety situation as much as possible, for example, a reply request notification may be issued at regular intervals.

  In order to save the user from creating an answer, a plurality of answer items set in advance by the administrator may be presented to select an answer. Further, the position information of the information acquisition terminal 1 may be acquired at the time of answering and sent together.

  FIG. 4 shows a software configuration diagram of the sound recognition unit 21, the image recognition unit 20, and the position information processing unit 19 that is realized by the central processing unit 14 in the information processing apparatus 2 of FIG. These processing units are embodied when the central processing unit 14 reads and executes software stored in the storage device 16.

  If the acquired sound data is sound data, the sound recognition unit 21 performs one or more of the number determination 301, the sex determination 302, and the age determination 303. The number, gender, and age of people in the vicinity are determined from the acquired voice data. A plurality of sound collecting devices such as microphones may be mounted so that more detailed analysis can be performed by increasing the amount of data of voice to be acquired.

  The image recognition unit performs at least one of the number determination 301, the sex determination 302, the age determination 303, the movement determination 304, and the location determination 305 from the acquired video data. In the number determination, sex determination, and age determination, the number, sex, and age of people in the vicinity are determined from information acquired by the imaging device 12.

  The movement determination is performed by comparing the image as shown in FIG. 11 first captured with the image capturing device such as the camera of the information acquisition terminal 1 and the image as shown in FIG. Determine if you are moving. There may be a plurality of images taken after a certain time in FIG. When the imaging device 12 of the information acquisition terminal 1 captures images at regular intervals and the image recognition device 20 of the information processing device compares the respective image data, for example, if there is a difference, the information acquisition terminal 1 Consider moving. A plurality of imaging devices 12 such as cameras may be mounted and the amount of information of image data to be acquired may be increased so that, for example, an analysis can be made that a nearby person is moving.

  For the location determination, an image with location information added as shown in FIG. 13 registered in the storage device 16 of the information processing apparatus in advance and a user as shown in FIG. The image recognition unit compares the obtained image with the estimated image, and estimates the location of the user on the map as shown in FIG.

  In the position information processing unit, position information obtained by satellite positioning technology such as GPS is acquired, and the place determination 305 is performed. The information processing device 2 acquires position information at regular intervals, and the position information processing device 19 of the information processing device compares the respective position data. If there is a difference, for example, the information acquisition terminal 1 moves. Estimated.

  When the map is displayed, the information processing apparatus uses the display device 17 based on the position information obtained from the information acquisition terminal 1 to divide the map into cells as shown in FIG. The total result for each area is displayed, or the actual position is displayed with an icon as shown in FIG.

  FIG. 9 is a sequence diagram of this embodiment.

  Step 100: An answer request is transmitted to the information processing apparatus 2 from the operation terminal of the information processing apparatus 2. At this time, the notification may be sent from another server such as a crisis management server instead of the operation terminal of the information processing apparatus 2 as step 100.

  Step 101: The information processing apparatus 2 transmits a response request to the information acquisition terminal 1 by a PUSH notification. The information acquisition terminal 1 requests the user to input an answer to the answer request.

  Step 102: The information acquisition terminal 1 transmits an answer to the information processing device 2.

  Step 103: When the user does not transmit an answer to the information processing apparatus 2 for a certain time from the reception 101 of the answer request, the information acquisition terminal 1 uses the position information acquisition apparatus 11 to capture the position information and the imaging device such as a camera. 12, it is confirmed whether information obtained by photographing the surrounding situation and recorded sound information can be acquired by the sound collecting device 13 such as a microphone, and the acquired information is transmitted to the information processing device 2.

  Step 104: The information processing device 2 analyzes the obtained answer information by the position information processing unit 19, the image recognition unit 20, and the sound recognition unit 21, such as the number of people, gender, age, and place. The information is displayed on the display device 11 in the form of a map view or a graph.

  Step 105: The information acquisition terminal 1 browses the analysis result expressed in the form of a map view or a graph.

  Step 106: The analysis result expressed in the form of a map view, a graph or the like is viewed from the operation terminal of the information processing apparatus 2.

  FIG. 10 is a flowchart illustrating an example of a processing procedure of the system according to the present exemplary embodiment. The operation based on the flowchart of FIG. 10 is as follows.

  Step 200: The information processing device 2 notifies the information acquisition terminal 1 of a response request, and the information acquisition terminal 1 requests the user to input a response to the response request.

  Step 201: The information acquisition terminal 1 checks whether or not the user has input an answer to the answer request. If NO, go to step 203. If yes, go to step 102.

  Step 202: The information collecting apparatus 1 sends the answer result to the information processing apparatus 2 when it is confirmed that there is an answer input such as safety and position information from the user.

  Step 203: The information acquisition terminal 1 checks whether the position information can be acquired using the position information acquisition device 11 such as GPS. If NO, go to step 205. If yes, go to step 204.

  Step 204: The information acquisition terminal 1 acquires position information by the position information acquisition device 11.

  Step 205: The information acquisition terminal 1 checks whether video information can be acquired by the imaging device 12 such as a camera. If NO, go to Step 207. If yes, go to step 206.

  Step 206: The information acquisition terminal 1 acquires information obtained by photographing the surrounding situation by the imaging device 12 such as a camera.

  Step 207: The information acquisition terminal 1 checks whether sound information can be acquired by the sound collecting device 13 such as a microphone. If NO, go to step 209. If yes, go to step 208.

  Step 208: The information acquisition terminal 1 acquires ambient sound information by means of the sound collecting device 13 such as a microphone.

  Step 209: The information acquisition terminal 1 is acquirable and sends the acquired data to the information processing apparatus 2.

  Step 210: The sound recognition unit 21, the image recognition unit 20, and the position information processing unit 19 of the information processing device 2 analyze the acquired information.

  Step 211: The information processing apparatus 2 creates a drawing in which the analysis result is superimposed on the map and displays it on the display device 17. The analysis result may be sent to the information acquisition terminal 1 so that the user can view it, or may be accessible from the information acquisition terminal 1.

  Furthermore, analysis results may be managed in time series, and a plurality of analysis results having different analysis dates and times may be displayed so as to be comparable with each other (for example, a list display).

  As described above, even when the user cannot respond within a certain time, the information acquisition terminal 1 acquires information using a device capable of acquiring peripheral information such as the position information acquisition device 11, the imaging device 12, and the sound collection device 13. .

  As a result, even if the user who is the answer target cannot respond for some reason, it becomes possible to collect information such as the location information, the attributes and the number of people in the vicinity, and the information processing device is more accurate. Analysis becomes possible.

  The analysis result superimposed on the map can be confirmed not only by the administrator but also by the user of the information acquisition terminal 1 on the display device 11 of the information acquisition terminal 1, thereby improving user convenience.

  Moreover, not only an analysis result but a disaster prevention map and hazard map around the information acquisition terminal 1 may be sent or accessible so that the information acquisition terminal 1 can browse. These disaster prevention maps and hazard maps may be created by the administrator or may be guided to a server that is publicly accessible.

  In this embodiment, the information acquisition terminal 1 includes the sound recognition unit 21, the image recognition unit 20, and the position information processing unit 19 in the information processing apparatus 2 in the first embodiment as shown in FIG. The analysis is performed, and the acquired information and analysis result or only the analysis result is sent to the information processing apparatus as shown in FIG. In addition, in the sequence diagram of FIG. 9, steps that are changed from the first embodiment are shown below.

  Step 103: The position information processing unit 19, the image recognition unit 20, and the sound recognition unit 21 in the information acquisition terminal 1 analyze. The analysis result or both the original data and the analysis result are sent to the information processing apparatus 2.

  Step 104: The information processing apparatus 2 creates a map view and a graph from the acquired information.

  In addition, in the flowchart of FIG. 10, steps that are changed from the first embodiment are shown below.

  Step 204: The position information acquisition device 11 acquires position information. The position information processing unit 19 analyzes the position information using the acquired data. Get analysis results.

  Step 206: The imaging device 12 such as a camera acquires information obtained by photographing the surrounding situation. The image recognition unit 20 analyzes the video information using the acquired data. Obtain analysis results such as the number of people around you, gender, age, presence / absence of movement, location information, etc.

  Step 208: The sound collection device 13 such as a microphone acquires ambient sound information. The sound recognition unit 21 analyzes sound information using the acquired data. Obtain analysis results such as the number of people around you, gender, and age.

  Step 210: Since the acquisition information is analyzed by the information acquisition terminal 1, it is not necessary in the second embodiment.

  As described above, the peripheral information acquired by the information acquisition terminal 1 is analyzed by the information acquisition terminal 1, and the analysis result is sent to the information processing apparatus. In the information processing apparatus 2, for example, the analysis result is recorded and displayed. May be.

  DESCRIPTION OF SYMBOLS 1 ... Information acquisition terminal, 2 ... Information processing apparatus, 11 ... Position information acquisition apparatus, 12 ... Imaging device, 13 ... Sound collecting device, 14 ... Central processing unit, 15 ... Character input device, 16 ... Storage device, 17 ... Display device 18 Network connection device 19 Position information processing unit 20 Image recognition unit 21 Sound recognition unit

Claims (6)

A plurality of information acquisition terminals and an information processing device;
The information processing apparatus collects information from the plurality of information acquisition terminals;
An information providing system that enables browsing of the processing results of the collected information,
Each of the information acquisition terminals
A communication function with the information processing apparatus;
An information acquisition device for acquiring peripheral information;
The peripheral information acquired by the information acquisition device, and the safety information when the safety information is input in response to a safety information response request for the user of the information acquisition terminal received from the information processing device, A function of transmitting to an information processing device,
The information processing apparatus includes:
A function of transmitting the input of the safety information and a response request for the input safety information to the plurality of information acquisition terminals;
A function of analyzing the peripheral information received from a plurality of the information acquisition terminals, or the peripheral information and the safety information;
An information providing system comprising: a function of allowing an analysis result to be browsed from the information processing apparatus and / or the information acquisition terminal. In the information provision system of Claim 1,
The information acquisition terminal is
In response to a response request for the received safety information, if there is no response input by a user within a predetermined time, the peripheral information without the safety information is transmitted to the information processing device. Information provision system. In the information provision system according to claim 1 or 2,
The information acquisition device is one or more of a sound collection device, an imaging device, and a position information acquisition device,
The peripheral information is at least one of sound information acquired by the sound collection device, an image acquired by the imaging device, and position information acquired by the position information acquisition device. system. In the information provision system as described in any one of Claim 1 to 3,
The information acquisition terminal is
Presenting a plurality of response items to the response request for the safety information in a selectable manner,
Any answer item selected by the user of the information terminal is transmitted as the safety information. In the information provision system as described in any one of Claim 1 to 4,
The information processing system transmits the response request repeatedly after a predetermined time interval. In the information provision system of Claim 5,
The information processing apparatus manages processing results of replies to the reply request that has been repeatedly transmitted in chronological order, and enables browsing from the information processing apparatus and / or the information acquisition terminal in a state where they can be compared with each other. Information providing system.

Images