JP7015603B1 - Information provision system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for effectively utilizing data obtained from a user while reducing a security risk in particular. The present invention is an information providing system including a management server and a plurality of user terminals connected to the management server via a network. The user terminal receives mission information including judgment condition information and processing processing information, acquires the first outside world information based on the judgment condition information, and determines whether or not the first outside world information satisfies the judgment condition. When the first external world information satisfies the determination condition, the second external world information is acquired, and the second external world information is processed based on the processing processing information to generate the processing information; the processing information is managed. Send to the server. [Selection diagram] Fig. 1

Description

The present invention relates to an information providing system.

Patent Document 1 proposes a system in which information is added to an image based on image analysis without increasing the processing load of the server, and a reward is given according to the processing.

Japanese Patent Application Laid-Open No. 2003-16187

Similar to Patent Document 1, there is known a service of receiving image data or video data from a camera or the like installed by a user and giving a considerable reward to the user. Such services are, for example, for crime prevention purposes, environmental surveys, and the like.

Specifically, there are those that constantly send images (videos) from the camera installed by the user and give a reward for each transmission time, and those that give a reward for each number of images acquired by the camera.

However, when the image (raw data) acquired by the camera is transmitted to the service provider in real time, there is a risk of disclosure of leakage risk from the viewpoint of personal information and security.

Therefore, it is an object of the present invention to provide a technique for effectively utilizing images obtained from users while reducing privacy and security risks in particular.

According to the present invention, it is an information providing system including a management server and a plurality of user terminals connected to the management server via a network.
The user terminal is:
Receives mission information including judgment condition information and processing processing information;
The first external world information is acquired based on the determination condition information, and it is determined whether or not the first external world information satisfies the determination condition;
When the first outside world information satisfies the determination condition, the second outside world information is acquired, and the second outside world information is processed based on the processing processing information to generate processing information;
Sending the processing information to the management server,
An information provision system can be obtained.

According to the present invention, by providing a determination unit and a processing unit for detecting and processing an object contained in external world information on the user terminal side, it is not necessary to transmit so-called raw data to a management server, and security and personal information It is possible to prevent leakage and unnecessary disclosure.

In other words, by using the present invention, the user can provide only necessary information to the management server while constantly activating the acquisition unit such as a camera.

Further, according to the present invention, the user can obtain a plurality of rewards by receiving a plurality of mission information as long as he / she has his / her own terminal, and can encourage active participation in the system. ..

Further, according to the present invention, since the user can provide the management server with information within the range that he / she can tolerate, he / she can control the security by his / her own will.

It is a block diagram of the information provision system by embodiment of this invention. It is a figure which shows the functional block diagram of the management server of FIG. It is a figure which shows the functional block diagram of the user terminal of FIG. It is a figure explaining the flow of information processing on the user terminal side by this invention. It is a figure explaining the flow of information processing on the management server side by this invention. This is a display example displayed on the user's HMD. It is a figure in which the type of information transmitted from a user terminal to a management server is killed. It is a figure explaining the application example of this invention.

The contents of the embodiments of the present invention will be described in a list. The information providing system according to the embodiment of the present invention has the following configurations.
[Item 1]
An information providing system including a management server and a plurality of user terminals connected to the management server via a network.
The user terminal is:
Receives mission information including judgment condition information and processing processing information;
The first external world information is acquired based on the determination condition information, and it is determined whether or not the first external world information satisfies the determination condition;
When the first outside world information satisfies the determination condition, the second outside world information is acquired, and the second outside world information is processed based on the processing processing information to generate processing information;
Sending the processing information to the management server,
Information provision system.
[Item 2]
The information provision system described in item 1.
The second outside world information is obtained by the same acquisition means as the first outside world information.
Information provision system.
[Item 3]
The information providing system according to item 1 or item 2.
The processed information is generated by performing anonymization processing on at least a part of the second external world information.
Information provision system.
[Item 4]
The information providing system according to any one of items 1 to 3.
The processing information is generated by being extracted from the second outside world information.
Information provision system.
[Item 5]
The information providing system according to any one of items 1 to 4.
The user terminal is provided with a camera unit.
At least one of the first external world information and the second external world information is acquired by the camera unit.
Information provision system.
[Item 6]
The information providing system according to any one of items 1 to 5.
The management server grants the user a reward associated with the mission information according to the processing information.
Information provision system.
[Item 7]
The information provision system according to any one of item 6.
The management server evaluates the processing information acquired from the user terminal according to the evaluation conditions, and evaluates the processing information.
The reward is calculated based on the evaluation.
Information provision system.
[Item 8]
The information provision system described in item 7.
The content of the processing processing information can be changed within a predetermined range by designation from the user terminal.
The management server corrects the reward according to the designation.
Information provision system.
Item [Item 9]
The information provision system described in item 7.
The management server transmits the mission information to the user terminal.
Information provision system.
[Item 10]
The information providing system according to any one of items 9.
Including the client terminal
The management server generates the mission information based on the request from the requester terminal.
Information provision system.
[Item 11]
It is an information providing method realized by using a management server and a plurality of user terminals connected to the management server via a network.
The user terminal is:
Step of receiving mission information including judgment condition information and processing processing information;
A step of acquiring the first external world information based on the determination condition information and determining whether or not the first external world information satisfies the determination condition;
When the first external world information satisfies the determination condition, the second external world information is acquired, and the second external world information is processed based on the processing processing information to generate the processing information;
An information providing method including a step of transmitting the processing information to the management server.
[Item 12]
User terminal:
Receiver that receives mission information including judgment condition information and processing processing information;
A determination unit that acquires the first outside world information based on the determination condition information and determines whether or not the first outside world information satisfies the determination condition;
A processing unit that acquires the second external world information when the first external world information satisfies the determination condition, processes the second external world information based on the processing processing information, and generates processing information;
A transmitter that transmits the processing information to the management server,
An information providing program that functions as.

<Structure>
FIG. 1 is a schematic diagram showing elements constituting an information providing system according to the present embodiment. The structure of the figure is an example, and elements other than these may be included.

The information providing system according to the present invention has a management server 1, a plurality of users P1 (user terminal 2: not shown), and a plurality of companies (corporate terminal: not shown). These are connected to each other via a network so as to be able to communicate with each other starting from the management server 1.

In the information providing system according to the present embodiment, the user terminal 2 receives the mission information transmitted from the corporate terminal via the management server 1, and the acquisition unit (GPS, camera, microphone, etc. input unit) of the user terminal 2 is received. Only the information satisfying a predetermined condition is cut out (or processed) from the information obtained in the above and transmitted to the management server 1 to obtain a reward.

<Hardware configuration>
The hardware configuration of the information providing system will be described with reference to FIGS. 2 and 3. The management server 1 and the user terminal 2 according to the present embodiment have the following hardware configurations. The following configuration is an example, and may have other configurations. It is also possible to appropriately adopt other means having the same function.

<Management server 1>
The management server 1 constitutes a part of the information providing system by executing information processing via communication between the user terminal 2 and the corporate terminal. The management server 1 has a function related to processing of the entire information providing system.

FIG. 2 is a diagram showing an example of a functional block diagram of the management server 1. The configuration shown is an example, and functions other than these may be added.

The management server 1 may be a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

The management server 1 includes at least a processor 10, a memory 11, a storage 12, a transmission / reception unit 13, an input / output unit 14, and the like, and these are electrically connected to each other through a bus 15.

The processor 10 is an arithmetic unit that controls the operation of the entire management server 1, controls the transmission and reception of data between each element, and performs information processing and the like necessary for executing an application. For example, the processor 10 is a CPU (Central Processing Unit), and executes each information processing by executing a program or the like stored in the storage 12 and expanded in the memory 11.

The memory 11 includes a main storage configured by a volatile storage device such as a DRAM (Dynamic Random Access Memory) and an auxiliary storage configured by a non-volatile storage device such as a flash memory or an HDD (Hard Disk Drive). .. The memory 11 is used as a work area or the like of the processor 10, and also stores a BIOS (Basic Input / Output System) executed when the management server 1 is started, various setting information, and the like.

The storage 12 stores various programs such as application programs. A database storing data used for each process may be built in the storage 22.

The transmission / reception unit 13 connects the management server 1 to the network. The transmission / reception unit 13 may be provided with a short-range communication interface of Bluetooth (registered trademark) and BLE (Bluetooth Low Energy). The transmission / reception unit receives a request from the corporate terminal and transmits the generated mission information to the user terminal.

The input / output unit 14 is an information input device such as a keyboard and a mouse, and an output device such as a display.

The bus 15 is commonly connected to each of the above elements and transmits, for example, an address signal, a data signal, and various control signals.

<User terminal 2>

The user terminal 2 constitutes a part of the information providing system by executing information processing via communication with the management server 1.

FIG. 3 is a diagram showing an example of a functional block diagram of the user terminal 2. The configuration shown is an example, and functions other than these may be added.

The user terminal 2 may be, for example, a portable communication device such as a smartphone or a tablet terminal, but may be a general-purpose computer such as a personal computer.

As shown, the user terminal 2 includes at least a processor 20, a memory 21, a storage 22, a transmission / output unit 23, an input / output unit 24, and the like, which are electrically connected to each other through a bus 25. Since these functions are the same as those of the management server 1 described above, detailed description thereof will be omitted here.

The user terminal 2 according to the present embodiment is a so-called wearable terminal (AR goggles), and is worn on the user's head.

The input / output unit 24 described above includes at least a camera unit 242 as an input unit and an HMD (Head Mount Display) 241 as an output unit.

The camera unit has a recording function that covers an area substantially similar to the user's field of view. The HMD 242 is, for example, a glass type, and can display various information through the lens.

As shown in FIG. 4, the functional block has a determination unit, a processing unit, and an acquisition unit. These functions will be described later.
<Data>
As shown in FIG. 4, the mission information includes at least determination condition information, processing processing information, and reward information. These are generated by the management server 1 based on a request from the corporate terminal, but mission information may be generated by the corporate terminal as needed.

The determination condition information is information acquired by the acquisition unit of the user terminal 2 (position information, camera unit, time, temperature, atmospheric pressure, operation status, and other information directly or indirectly acquired by the sensor group provided in the user terminal). Contains information (functional package) necessary for determining (recognizing) whether or not a predetermined determination condition is satisfied. There may be a plurality of pieces of information to be acquired.

The processing processing information is information (functional package) for processing the information obtained from the acquisition unit when the above-mentioned determination conditions are satisfied.

The determination condition information and processing processing information described above include, for example, a logic for extracting an object from an image (video) acquired by a camera unit or the like. The logic can employ various techniques necessary for extracting an object, such as an image recognition model and a voice recognition model (when the target is voice).

For example, in the case of mission information to the effect of "information on the location of empty cans that have fallen in the city", the judgment condition information is to have the camera unit (acquisition unit) constantly acquire images and determine whether or not there are empty cans in the images. It is the information for making a determination (recognition), and the processing processing information is the instruction information for acquiring the position information of the user terminal when it is determined that the empty can has fallen.

Also, in the case of mission information to the effect of "information on license plates of vehicles abandoned in the city", the judgment condition information is determined by having the camera unit (acquisition unit) constantly acquire an image and whether or not there is an abandoned vehicle in the image. The processing information is information for cutting out the license plate from the abandoned vehicle and information for recognizing the characters of the license plate and extracting it as text information.

<Processing flow>
Subsequently, with reference to FIGS. 1, 4 and 5, the flow of processing of the information providing system according to the present embodiment will be described. As shown in FIG. 1, the management server 1 according to the present embodiment generally provides a platform service for connecting a company (corporate terminal) and a user (user terminal). Note that FIG. 1 is a schematic diagram, and the management server 1 does not have to be one, and each function may be distributed to a plurality of terminals.

The company (company A to company C) makes a request to the management server 1. Requests include, for example, "I want to know information about empty cans left in the city", "I want to collect information on illegal parking", "I want to know the products purchased by users who have entered convenience stores", etc. It relates to the user's visual information obtained by using the camera unit.

At this time, the company sets a reward for the information that it wants to know or collect. For example, "If you find one empty can, it costs 0.1 yen", "If you find one abandoned vehicle, it costs 0.7 yen", "If you provide merchandise information purchased at a convenience store, it costs 8 yen". The method of setting the reward may be set for each number / number of units, set according to a group number, or set according to the time searched for.

The management server 1 transmits the request to the user terminal as the above-mentioned mission information, and causes the user terminal to perform a predetermined process. The mission information includes, for example, items such as "empty can / 0.1 yen", "abandoned vehicle / 0.7 yen", and "field of view information in a convenience store / 8 yen".

Each of the user P1 to the user Pn has a terminal capable of operating the above-mentioned HMD, and the camera unit mounted on each HMD can acquire the information of the field of view V1 to the field of view Vn.

The user who receives the mission information can select whether or not to participate in the mission specified by the mission information. When a user participates in a mission, participation information is transmitted to the management server 1, and the identification information of the mission and the identification information of the user (user terminal) are associated and managed by participating.

<Processing on the user terminal 2 side>
More specifically, as shown in FIG. 4, the receiving unit of the user terminal 2 receives the mission information transmitted from the management server 1. At this time, of the mission information, only the determination condition information and the processing processing information may be received as the mission information.

The mission information is input to the control unit. Hereinafter, each process performed when the mission information regarding the above-mentioned "information on the location of empty cans left in the city" and "information on the license plate of the vehicle left in the city" is received will be described.

When receiving "information on the location of empty cans that have fallen in the city", the judgment unit enables the function of the camera unit based on the judgment condition information to constantly acquire the image, and whether or not there is an empty can in the image. Is determined by image recognition technology. The processing unit acquires position information from GPS based on the determination result. The position information is output to the transmission unit as processing information and transmitted to the management server 1.

In addition to the above-mentioned functions, the processing unit further trims only the empty can part of the image, applies a mosaic to the part other than the empty can, and extracts only the number of empty cans from the image to obtain numerical data (others). It may be converted into a format) or a process of extracting the brand of an empty can may be performed. Further, it may be transmitted together with other information obtained by the user terminal such as time information.

If necessary, it may be output to the transmission unit without any processing. In this case, from the user's point of view, the amount of information provided to the company increases, so that the reward may be increased.

Subsequently, when "information on the license plate of a vehicle left in the city" is received, the judgment unit activates the function of the camera unit based on the judgment condition information to constantly acquire the image, and also in the image. Whether or not there is a stopped vehicle is determined by image recognition technology. The processing part extracts only the part of the license plate from the image. The extracted information is output to the transmission unit and transmitted to the management server 1 as processing information.

In addition to the above-mentioned functions, the processing unit also trims only the license plate part of the image, applies a mosaic to the part other than the license plate, and extracts only the license plate text from the image and texts. It may be converted into data or information on the vehicle type of the vehicle may be extracted. Further, in addition to these information, position information may be acquired from GPS.

The image recognition model in the present embodiment is input to the image to be processed. Next, the area to be recognized is extracted from the input image. For example, when the object to be recognized is an object (person) related to the object information, the area determined to be the object is extracted from the supplied image. Multiple areas may be extracted from one image.

Then, the feature amount is extracted from the extracted area (image of the area). The content of the extracted features is specified by the recognition process.

As the recognition process (image recognition model), for example, a method suitable for the recognition target such as HMM (Hidden Markov Model) or SVM (Support Vector Machine) is used. Then, the feature amount suitable for the method to be used is extracted, and the parameter is held.

<Processing on the management server side 1>
As shown in FIG. 5, the data transmitted from the user terminal 2 is received by the receiving unit of the management server 1. The received data is input to the control unit and the reward is calculated in the reward calculation unit.

The reward is calculated according to the evaluation conditions. Evaluation conditions are carried out from various viewpoints. For example, if the information transmitted from the user terminal is not the information to be provided by the mission information, it will be 0 (that is, if a processing error or the like has occurred on the user terminal side, or an unauthorized operation has been performed. Case etc.). Further, even if the information satisfies the target information, if there is another user who has already transmitted the same information, the reward is low because the information is not new as data.

In this way, the evaluation conditions are defined from the viewpoint of eligibility as target information and usefulness of data. The viewpoint of evaluation may be other than this.

The reward calculation unit corrects and determines the reward to be given to the user based on the above evaluation conditions. The compensation can be adjusted by multiplying by a coefficient according to the standard amount or by increasing or decreasing the constant, but the method is not limited to this.

The fixed reward is notified to the user terminal 2.

<Example>
FIG. 6 is a field of view (outside world information) seen by the user through the HMD. For example, as shown in the figure, the cursor may be placed on a detection target related to the mission information in which the user is participating to notify the user.

In the figure, a car stopped on the road is recognized as an abandoned vehicle, and a cursor is displayed on the license plate of the vehicle. In this case, the information of the license plate is transmitted to the management server 1.

Similarly, in the figure, an empty can that has been thrown away on the road is recognized, and a cursor is displayed on the empty can. In this case, the information that the empty can was on the road is transmitted to the management server 1.

The above-mentioned processing information may be transmitted sequentially, or may be performed after a certain amount of data has been collected.

As described above, the management server 1 grants the set reward to the user (user terminal) according to the analysis result transmitted from the user terminal.

FIG. 7 is an image diagram illustrating the types of information transmitted from the user terminal 2 to the management server 1. As described above, not all the information acquired by the camera unit is transmitted to the management server 1. In other words, only the information related to the detection target included in the mission information is extracted and transmitted to the management server 1 from the outside world information.

For example, the following three patterns can be considered for the information transmitted from the user terminal to the management server 1. In the case of an empty can, only the "presence / absence" information of the detection target is transmitted to the management server 1 (1). Further, in the case of an abandoned vehicle, when the image data of only the license plate part is transmitted to the management server 1 (2), the character information is further analyzed from the license plate (that is, the information of (2) is processed). ) It may be sent to the management server 1 (3). Further, information obtained from another sensor group may be added and transmitted (4).

As described above, in the present embodiment, out of the information acquired by the camera unit of the user terminal, only the portion necessary for the mission information is transmitted to the management server 1, so that the data is lightweight. The following effects can be obtained in addition to the conversion.

That is, according to the present embodiment, since it is not necessary to transmit so-called raw data to the management server, it is possible to prevent security, leakage of personal information, and unnecessary disclosure.

Further, by using the present invention, the user can provide only necessary information to the management server while constantly activating the camera unit. That is, it is possible to save the trouble of activating the camera unit only when the camera unit captures the object to be detected (when an abandoned vehicle is found, an empty can is found, etc.).

In addition, by receiving multiple mission information, it is possible to obtain multiple rewards, and it is possible to encourage active participation in this system. As a result, it is possible to improve the efficiency of providing information to the company that requested the mission information.

The reward information may be changed according to the amount and content of the information received from the user terminal. Further, the user side may control the amount and content of the information transmitted to the management server 1.

The embodiments described above are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes its equivalents.

As shown in FIG. 7, the present invention can be applied not only to an HMD but also to, for example, an unmanned aerial vehicle equipped with a camera unit (drone or the like), an automobile having an automatic driving function, or the like. In this case, an analysis unit for analyzing the detection target of the mission information may be provided on the unmanned aircraft or the automobile side.

Further, the above-mentioned mission information is not limited to the example, and may be, for example, the provision of information on a specific person, object, phenomenon, or the like, or information on the user's home.

1 Management server 2 User terminal

Claims (14)

An information processing device connected to the management server
Equipped with a camera unit
Stores processing information including judgment conditions and logic to extract processing information from images.
The judgment condition is
Whether or not the detection target is captured in the image, or
Whether or not the detection target exists in the image for a predetermined time or longer.
And
An image is acquired from the camera unit, and it is determined whether or not the image satisfies the determination condition.
When the image satisfies the determination condition, the processing information is extracted from the image according to the processing information.
Sending the processing information to the management server,
An information processing device characterized by. The information processing apparatus according to claim 1.
Extracting a part of the image according to the processing information,
An information processing device characterized by. The information processing apparatus according to claim 1 or 2.
Cutting out a portion of the image that satisfies the determination condition according to the processing processing information.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 3.
Extracting an image in which at least a part other than the part satisfying the determination condition is mosaicked according to the processing information.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 4.
Analyzing the image and reading the character string according to the processing information,
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 5.
Acquiring sensor information from the sensor according to the processing information, and attaching the sensor information to the processing information.
An information processing device characterized by. The information processing apparatus according to claim 6.
The sensor acquires at least one of position information, image, time, temperature, barometric pressure, operation status, or voice.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 7.
When the first image acquired from the camera unit satisfies the determination condition, the second image is acquired from the camera unit according to the processing processing information, and the processing information is extracted from the second image. matter,
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 8.
Extracting information indicating that the detection target was captured in the image according to the processing processing information.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 9.
Sending after accumulating a predetermined number of the processing information,
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 10.
The image is a moving image,
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 11.
Analyzing the image according to the processing information to extract the type of the detection target included in the image.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 12.
Extracting the number of detection targets included in the image according to the processing information.
An information processing device characterized by. The information processing apparatus according to any one of claims 1 to 13.
To reduce the weight of the image according to the processing information,
An information processing device characterized by.

Images