JP2021047752A - Information processing device and information processing system - Google Patents

Abstract

To provide an information processing device capable of specifying a detailed position while reducing an amount of data transferred to a server.SOLUTION: An information processing device 1 for detecting a position of a target is configured by comprising: a wireless communication unit 110 that communicates with a wireless communication device of the target to acquire identification information; an imaging unit 120 that images an imaging region; a position specifying unit 121 that specifies a position of the object in the imaging region based on an imaging result of the imaging unit; and an information transmission unit 140 that transmits position information and identification information of the target specified by the position identification unit.SELECTED DRAWING: Figure 3

Description

One aspect of the present invention relates to an information processing device capable of transmitting target position information and identification information to specify the target position and the like.

Conventionally, there is a position identification system that makes it possible to grasp the position of a target person or an object by using an IC tag or the like. In Patent Document 1, in order to detect a change in the flow line of a moving body, an IC tag attached to the moving body is used to obtain the flow line, and when the movement is different from the pre-stored movement, a camera is used to take a picture. A flow line management system that detects changes and notifies the administrator is disclosed. Patent Document 2 discloses a position identification system capable of grasping the position of a resident in a management area in real time from a comprehensive operation panel by positioning using a mobile terminal.

Japanese Unexamined Patent Publication No. 2008-299584 JP-A-2018-142338

However, in the conventional position identification system, since an IC tag or the like is used for position identification (positioning), it may not be possible to specify a detailed position. Further, a device for specifying the position using the captured image is conceivable, but since it is necessary to transmit the captured image data to a server or the like, the amount of data transfer has increased.

The present invention takes the following means to solve the above problems. In the following description, reference numerals and the like in the drawings are added in parentheses to facilitate understanding of the invention, but each component of the present invention is not limited to those added. It should be widely interpreted to the extent that a person skilled in the art can technically understand it.

One means of the present invention is
A wireless communication unit (110) that communicates with the target wireless communication device to acquire identification information, and
An imaging unit (120) that captures an imaging region and
A position specifying unit (121) that specifies the position of the target in the imaging region based on the imaging result of the imaging unit, and
It includes a position information of the target specified by the position specifying unit and an information transmitting unit (140) for transmitting the identification information.
Information processing device (1).

According to the information processing device having the above configuration, in order to identify the target and the position of the target, the identification information and the position information specified from the imaging result are transmitted, so that the information processing device is based only on the IC tag or the like. It is possible to specify a more detailed position as compared with the configuration for specifying the position. Further, since it is not necessary to transmit the captured image data to the server or the like, it is possible to specify the detailed position based on the imaging result while suppressing the data transfer amount.

In the above information processing apparatus, preferably
The information transmitting unit does not transmit the imaging result imaged by the imaging unit.

According to the information processing device having the above configuration, since the data of the captured image is not transmitted, the amount of data to be transmitted for specifying the position of the target can be suppressed.

In the above information processing apparatus, preferably
A notification unit for notifying when the position information and the identification information of the target satisfy a predetermined condition is further provided.

According to the information processing device having the above configuration, for example, it is possible to automatically warn when the target person tries to enter the restricted area. In addition, it is possible to automatically warn when an attempt is made to place a combustible material in a place where the combustible material is prohibited.

Other means of the present invention
A plurality of information processing devices according to any one of claims 1 to 3, and a plurality of information processing devices.
With the server device
It is an information processing system equipped with
The server device
A server receiving unit that receives the location information and the identification information of the target transmitted from the plurality of information transmitting units, and a server receiving unit.
A server notification unit for notifying when the location information and the identification information of the target satisfy a predetermined condition is provided.
It is an information processing system.

According to the information processing system having the above configuration, for example, it is possible to specify the position of the target in real time while monitoring the entire predetermined area by a plurality of camera-integrated information processing devices.

FIG. 1 is a diagram showing an image pickup area to be imaged and an access prohibited area E of the information processing apparatus arranged in the position detection target area A. FIG. 2 is a diagram showing an information processing system including four information processing devices and a server device arranged for position detection. FIG. 3 is a diagram showing the configuration of the information processing device 1. FIG. 4 is a diagram showing the configuration of the server device 2. FIG. 5 is a flowchart showing the flow of the position detection process. FIG. 6 is a diagram showing a target person moving in the target area A in the embodiment. FIG. 7 is a table showing information detected and transmitted by the information processing apparatus 1a of the embodiment in the imaging region B1. FIG. 8 is a table showing information detected and transmitted by the information processing apparatus 1b of the embodiment in the imaging region B2. FIG. 9 is a table showing information detected and transmitted by the information processing apparatus 1c of the embodiment in the imaging region B3. FIG. 10 is a table showing information detected and transmitted by the information processing apparatus 1d of the embodiment in the imaging region B4. FIG. 11 is a flowchart showing the flow of the position detection process in the modified example. FIG. 12 is a diagram showing a configuration of the server device 2 in the modified example.

One embodiment of the present invention is an information processing system that uses a plurality of camera-equipped information processing devices arranged in a target area such as a store to identify a detailed position of a detection target person and issue a warning or the like as necessary. Is. In particular, in the present invention, the data transmitted from the information processing device to the server does not include the captured image itself, and by transmitting the identification information and the position information to the server, it is possible to specify the detailed position while suppressing the amount of data transfer. One of the features is the point.

The information processing apparatus of the present invention will be specifically described with reference to the drawings according to the following configuration. However, the embodiments described below are merely examples of the present invention, and do not limit the technical scope of the present invention. In each drawing, the same components are designated by the same reference numerals, and the description thereof may be omitted.
1. 1. Embodiment 2. Modification example 3. Features of the present invention 4. Supplementary information

<1. Embodiment>
FIG. 1 is a diagram showing each area in the target area A such as the floor of a store that is the target of position detection in the information processing system of the present embodiment. FIG. 2 shows a configuration of an information processing system including four information processing devices 1a to 1d arranged in the target area A for position detection and a server device 2 arranged so as to be able to communicate with the information processing devices 1a to 1d. It is a figure which shows.

As shown in FIG. 1, the target area A is divided into four imaging areas B1 to B4. In these four imaging regions B1 to B4, information processing devices 1a to 1d arranged so that each imaging region can be imaged are arranged. These information processing devices 1a to 1d are installed, for example, on the ceiling of the central portion of each imaging region B1 to B4. An unauthorized area E, which is prohibited from entering, is set in the target area A. In the disallowed area E, for example, a cabinet or the like in which confidential information that only a specific person is permitted to access is stored is arranged. As shown in FIG. 2, the information processing devices 1a to 1d are arranged so as to be able to communicate with the server device 2, respectively. In the target area A, there are a wireless owner such as an employee who has a wireless communication device that transmits identification information (beacon) to the information processing device 1 and a wireless non-owner who does not have the wireless communication device. Sometimes. Both radio owners and non-radio owners are detection targets.

The communication between the information processing devices 1a to 1d may be wireless or wired, but the configuration of the present invention is particularly suitable when wireless communication is adopted. The information processing devices 1a to 1d have the same configuration and functions, and these may be collectively referred to as the information processing device 1.

<Information processing device 1>
FIG. 3 is a diagram showing the configuration of the information processing device 1. As shown in FIG. 3, the information processing device 1 includes a wireless communication unit 110, an imaging unit 120, a position specifying unit 121, a control unit 130, an information transmitting unit 140, an information receiving unit 141, and a notification unit 150. Will be done. The information processing device 1 is a terminal with a camera, and has an appearance like a surveillance camera, for example.

<Wireless communication unit 110>
The wireless communication unit 110 communicates with a wireless communication device in the imaging region of the information processing device 1 and acquires identification information (beacon) of the wireless communication device. The wireless communication unit 110 outputs the acquired identification information (beacon) to the control unit 130. The wireless communication device is, for example, an IC tag, a wireless transmitter, a wireless terminal, or the like. The wireless communication device transmits a beacon containing its own identification information to, for example, the information processing device 1, and the wireless communication unit 110 identifies the information processing device 1 in the imaging region by receiving the beacon. .. The wireless communication unit 110 outputs the identification information acquired by communication with the wireless communication device to the control unit 130.

<Image pickup unit 120>
The imaging unit 120 is a so-called camera, which continuously images an imaging region and outputs an image of the imaging result to the position specifying unit 121. The imaging unit 120 may have a function of imaging the imaging region only when a person is detected in the imaging region by another sensor.

<Positioning unit 121>
The position specifying unit 121 identifies the detection target in the imaging region based on the image of the imaging result of the imaging unit 120, identifies the position, and outputs the position to the control unit 130. Specifically, the position specifying unit 121 detects a person existing in the imaging region by pattern recognition, and identifies who the detected person is. Well-known techniques are used for such pattern recognition. Further, the position specifying unit 121 identifies a specific position of the detected person and outputs it to the control unit 130.

<Control unit 130>
The control unit 130 controls each element of the information processing device 1. The control unit 130 receives the identification information (beacon) acquired by the wireless communication unit 110, the information that identifies the target person specified by the position identification unit 121, and the position of the target person, and transmits these information to the information transmission unit 140. The information to be transmitted from the server device 2 to the server device 2 is summarized. The information to be transmitted includes identification information (beacon), location information, area information where the target person is located, and the time at which the target person is detected. The time at the time of detection is acquired from an internal timer of the control unit 130 or the like. The area information in which the target person is located is information for distinguishing whether the location is an restricted area or an unauthorized area based on the location information.

When the wireless communication device is not detected in the imaging area and the identification information cannot be acquired and the person is detected, the person is recognized as the person whose identification information is unknown and is used as the information to be transmitted. Even if the identification information is not acquired, if a person is identified by pattern recognition, the identification information corresponding to this person may be included in the information to be transmitted. When the identification information of a plurality of wireless communication devices is acquired in the imaging region, the position of the detected person is associated with the identification information based on the result of the pattern recognition of the position identification unit 121 and used as the information to be transmitted.

<Information transmitter 140>
Under the control of the control unit 130, the information transmission unit 140 transmits the identification information (beacon), the position information, the area information in which the target person is present, and the time at the time of detection to the server device 2 by wire or wirelessly.

<Information receiving unit 141>
The information receiving unit 141 receives the command transmitted from the server device 2 and outputs the command to the control unit 130. For example, the information receiving unit 141 receives the warning command for issuing a warning transmitted from the server device 2 and outputs it to the control unit 130.

When the control unit 130 receives a warning command from the server device 2 via the information receiving unit 141, the control unit 130 gives a notification (warning) via the notification unit 150.

<Notification unit 150>
The notification unit 150 gives a notification (warning) to the imaging region under the control of the control unit 130. The notification unit 150 has an audio output unit for notification (warning). Such a notification (warning) is performed, for example, by giving a voice warning to the detection target person to leave the disallowed area E when the detection target person is detected in the restricted area E. .. The notification unit 150 may give a notification (warning) by a warning sound. Further, the notification unit 150 may give a notification (warning) by displaying an image other than voice, vibration, or the like.

<Server device 2>
FIG. 4 is a diagram showing the configuration of the server device 2. As shown in FIG. 4, the server device 2 includes a receiving unit 210, a transmitting unit 220, a control unit 230, and a storage unit 240. The server device 2 may be arranged in a server room or the like different from the place where the information processing device 1 is arranged, or may be arranged in any place in the target area A.

<Receiver 210>
The receiving unit 210 receives the information transmitted from the information transmitting unit 140 of the information processing device 1 and outputs the information to the control unit 230. The receiving unit 210 is a configuration example of the "server receiving unit" of the present invention.

<Control unit 230>
The control unit 230 stores the information received from the information processing device 1 by the reception unit 210 in the storage unit 240. When the area information in which the target person is located indicates the restricted area E among the information received from the information processing device 1, the control unit 230 warns the target person, so that the information is transmitted via the transmission unit 220. A warning command is transmitted to the processing device 1.

<Memory unit 240>
The storage unit 240 stores the information received from the information processing device 1 under the control of the control unit 230.

<Transmitter 220>
The transmission unit 220 transmits a warning command to the information reception unit 141 of the information processing device 1.

<Operation of information processing system>
Next, the operation of the position detection process in the information processing system of the present embodiment will be described. FIG. 5 is a flowchart showing the flow of the position detection process.

<S100-S103>
First, when the wireless communication unit 110 of the information processing device 1 receives the beacon transmitted from the wireless communication device (S100), the imaging unit 120 images the imaging region (S101). Next, the position specifying unit 121 identifies the position of the target person holding the wireless communication device based on the imaging result (S102). Next, the control unit 130 transmits the identification information (beacon), the position information, the area information in which the target person is present, and the time at the time of detection to the server device 2 via the information transmission unit 140 (S103). ..

<S110-S115>
Next, the receiving unit 210 of the server device 2 that has received the information from the information processing device 1 outputs the received information to the control unit 230 (S110). The control unit 230 stores the received information in the storage unit 240 (S111). When the control unit 230 confirms the area information in which the target person is present among the received information (S112) and indicates that the target person is in the restricted area E (Y in S112), the control unit 230 confirms the area information in which the target person is present. The control unit 230 transmits a warning command to the information processing device 1 via the transmission unit 220 (S113). When the area information indicates that the target person is in the access permission area N (N in S112), the server device 2 ends the process (S115).

<S120-S122>
Next, the information receiving unit 141 of the information processing device 1 that has received the warning command from the transmitting unit 220 of the server device 2 outputs the warning command to the control unit 130 (S120). The control unit 130 to which the warning command is input warns the target person by voice to move away from the unauthorized area E (S121) via the notification unit 150, and ends the process (S122).

<Example>
Next, an embodiment of the information processing system of the present embodiment will be described. FIG. 6 is a diagram showing target persons X and Y moving in the target area A. FIG. 6 shows how the target person X moves from the position Pos 1 to the position Pos 9 in order, and the target person Y moves from the position Pos 11 to the position Pos 12. The subject X does not have a wireless communication device, and the target person Y has a wireless communication device. The wireless communication device owned by the target person Y transmits "BC" as identification information (beacon). 7 to 10 are diagrams showing information transmitted by the information processing devices 1a to 1d to the server device 2, respectively. The information processing devices 1a to 1d have B1 to B4 as imaging regions, respectively.

When the subject X is at the position Pos1, the information processing device 1 generates information of ID: ID1, Beacon: No, Position: Pos1, Area: N, Time: Time1, as described at the beginning of FIG. Then, it is transmitted to the server device 2. The server device 2 stores the received information in the storage unit 240.

Of the information transmitted by the information processing device 1, the "ID" is a number automatically assigned to the target person. The "beacon" indicates identification information (beacon) transmitted from the wireless communication device possessed by the target person, and indicates "No" when the target person does not have the wireless communication device. “Position” indicates the position of the target person specified by the position specifying unit 121 from the image of the imaging result of the imaging unit 120. The “area” indicates whether the position of the target person is the permitted area N or the non-permitted area E. “Time” indicates the time when the subject was detected.

When the target person X moves from the position Pos 1 to the position Pos 9, the information transmitted from the information processing device 1 to the server device 2 changes as described in FIGS. 7 to 9.

As shown in the bottom line of FIG. 9, when the target person X moves to the position Pos 9, since this position Pos 9 is the unauthorized area E, E is transmitted as the area information. At this time, the server device 2 transmits a warning command to the information processing device 1. Upon receiving the warning command, the information processing device 1 gives a voice warning to the target person X to leave the unauthorized area E via the notification unit 150.

On the other hand, when the target person Y moves from the position Pos 11 to the position Pos 12, the information transmitted from the information processing device 1 to the server device 2 changes as shown in FIG. As shown in FIG. 10, the subject Y does not move from the position Pos 11 during the time Times 1 to 8, but moves to the position Pos 12 at the time Time 9. Since this position Pos 12 is the unauthorized area E, the information processing device 1 warns the target person Y to leave the unauthorized area E by the same processing as described above.

<2. Modification example>
Next, a modified example of this embodiment will be described. In this modification, when the detected target person is in the unauthorized area E, the information processing device 1 itself warns the target person without going through the server device 2. Further, the server device 2 notifies the administrator who manages the server device 2 that the unauthorized area E has been entered. Other than the above, it is the same as that of the embodiment. Hereinafter, differences from the embodiments will be described.

<S130-S132>
FIG. 11 is a flowchart showing the flow of the position detection process in this modification. As described above, the control unit 130 of the information processing device 1 transmits the identification information (beacon), the position information, the area information where the target person is present, and the time at the time of detection to the server device 2 via the information transmission unit 140. After the transmission (S103), it is confirmed whether or not the area information in which the target person is located is the unauthorized area E (S130). When the area information indicates that the target person is in the restricted area E (Y in S130), the control unit 130 causes the target person to leave the unauthorized area E via the notification unit 150. A voice warning is given (S131), and the process is terminated (S132). When the area information indicates that the target person is in the access permission area N (N in S130), the information processing apparatus 1 ends the process as it is (S132).

FIG. 12 is a diagram showing a configuration of the server device 2 of this modified example. As shown in FIG. 12, the server device 2 includes a notification unit 250 in addition to the configuration of the embodiment (configuration of FIG. 4). When it is detected that the target person is in the unauthorized area E, the notification unit 250 notifies the server administrator by sound or an image. The notification unit 250 has a voice generation unit for sound notification or a display unit for image notification.

<S112 to S115>
In the server device 2, when the area information indicates that the target person is in the restricted area E (Y in S112), the control unit 230 notifies the server administrator via the notification unit 250. (S114). When the area information indicates that the target person is in the access permission area N (N in S112), the server device 2 ends the process (S115).

<3. Features of the present invention>
The present invention described above by exemplifying the embodiments and modifications thereof has the following features.

In the information processing device 1, in order to identify the target person and the position of the target person, the position specified by the position specifying unit 121 from the identification information acquired by the wireless communication unit 110 and the imaging result of the imaging unit 120. Information is transmitted to the server device 2 by the information transmission unit 140. Therefore, the configuration is such that a more detailed position can be specified as compared with the conventional configuration in which the position is specified only based on the IC tag or the like. Further, since it is not necessary to transmit the captured image data to the server device 2, the configuration is such that detailed position identification based on the imaging result is possible while suppressing the amount of data transfer.

Further, in the information processing device 1, the information transmission unit 140 does not transmit the image which is the image pickup result of the image pickup unit 120 to the server device 2. Therefore, the amount of data transmitted to the server device 2 for specifying the position of the target person can be suppressed.

Further, the information processing device 1 is configured to include a notification unit 150 that gives a warning when the target person enters the unauthorized area E. Therefore, it is possible to automatically warn when the target person tries to enter the unauthorized area E.

Note that the notification (warning) to the target person is not limited to the case of entering the unauthorized area E as in the embodiment, but may be configured to be performed when a predetermined condition is satisfied. For example, when the detection target is a combustible material, it is possible to automatically warn when the combustible material to be detected is placed in a place where the combustible material is prohibited.

Further, if the information processing system including the plurality of information processing devices 1 and the server device 2 of the embodiment is adopted, the amount of data transferred between the server device 2 and the information processing device 1 is relatively small, so that the data can be transferred in real time. It is possible to specify the detailed position of the target.

<4. Supplementary information>
The embodiments and modifications of the present invention have been specifically described above. The above description is merely an explanation as one configuration example and one operation example, and the scope of the present invention is not limited to these embodiments and modifications, but is within a range that can be grasped by those skilled in the art based on the same technical idea. Is widely interpreted.

For example, in the embodiment, the target area is a store and the detection target is a person, but the target area can be a factory and the detection target can be a part arranged in the factory. The target area and the detection target can be set arbitrarily.

Further, the data stored in the storage unit 240 of the server device 2 in the embodiment can be used for flow line analysis of store employees and customers by using machine learning using AI or the like.

The information processing device of the present invention is useful as a position detecting device or the like capable of specifying a detailed position of an object.

1, 1a to 1d ... Information processing device 110 ... Wireless communication unit 120 ... Imaging unit 121 ... Position identification unit 130 ... Control unit 140 ... Information transmission unit 141 ... Information reception unit 150 ... Notification unit 2 ... Server device 210 ... Reception unit 220 ... Transmission unit 230 ... Control unit 240 ... Storage unit 250 ... Notification unit A ... Position detection target area B1 to B4 ... Imaging area E ... Disallowed area

Claims (4)

A wireless communication unit that communicates with the target wireless communication device to acquire identification information,
An imaging unit that captures the imaging area and
A position specifying unit that specifies the position of the target in the imaging region based on the imaging result of the imaging unit, and
A position information of the target specified by the position identification unit and an information transmission unit for transmitting the identification information are provided.
Information processing device. The information transmitting unit does not transmit the imaging result imaged by the imaging unit.
The information processing device according to claim 1. A notification unit for notifying when the position information and the identification information of the target satisfy a predetermined condition is further provided.
The information processing device according to claim 1 or 2. A plurality of information processing devices according to any one of claims 1 to 3, and a plurality of information processing devices.
With the server device
It is an information processing system equipped with
The server device
A server receiving unit that receives the location information and the identification information of the target transmitted from the plurality of information transmitting units, and a server receiving unit.
A server notification unit for notifying when the location information and the identification information of the target satisfy a predetermined condition is provided.
Information processing system.

Images