JP2021174391A - Image processing apparatus, terminal device, system, control method of image processing apparatus, control method of terminal device, and program - Google Patents

Abstract

To provide a technology for reducing unnecessary action of a store clerk, such as redundant patrol, in reporting a suspicious person.SOLUTION: An image processing apparatus includes: acquisition means which acquires an image obtained by imaging a space to be monitored; first detection means which analyzes the image acquired by the acquisition means and detects a first person showing suspicious behavior in the space; communication means which transmits information for specifying the first person to a plurality of terminal devices and receives responses from the terminal devices in accordance with the information; and second detection means which detects a second person from the image acquired by the acquisition means after the communication means transmits the information to the terminal devices. The communication means transmits additional information to at least one of the terminal devices on the basis of the contents of the received responses and a result detected by the second detection means.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to an image processing device, a terminal device, a system, a control method of the image processing device, a control method of the terminal device, and a program.

In recent years, shoplifting damage in various facilities such as retail stores and large-scale commercial stores has become more serious, and there is a need on the store side to reduce these damages. To meet these needs, we analyze images taken by surveillance cameras in real time to detect suspicious persons who are suspected of shoplifting, and notify store clerks and security guards of the detection results to prevent shoplifting. There is technology.

As an example of such a technique, there is a technique shown in Patent Document 1. In Patent Document 1, feature values such as the position, orientation, and line-of-sight direction of a person are extracted from video data taken by a camera, and these feature values are analyzed to detect a person suspected of shoplifting. Further, Patent Document 2 discloses that when a person suspected of shoplifting is detected, the store clerk is notified. Here, the detection information is notified to the mobile terminal of the store clerk. In addition, when the clerk who receives the notification on the mobile terminal completes the response to the suspicious person, the response completion information is transmitted to the management server.

Japanese Unexamined Patent Publication No. 2017-076771 Japanese Unexamined Patent Publication No. 2015-187869

When a person suspected of shoplifting is detected as in the above method, it is common to notify the clerk of the information. The clerk who receives the notification is required to approach the target suspicious person to see the situation or speak directly to prevent shoplifting. On the other hand, since the clerk originally needs to perform other work such as taking out the product and dealing with the cash register, it is desirable that the time and load required for dealing with the suspicious person is as small as possible and there is no duplication.

Therefore, the present invention provides a technique for suppressing unnecessary response of a clerk such as duplication of patrols when notifying a suspicious person.

The invention for solving the above-mentioned problems is an image processing apparatus.
An acquisition means for acquiring an image of the space to be monitored, and
A first detection means that analyzes an image acquired by the acquisition means and detects a first person taking a suspicious action in the space.
A communication means that transmits information for identifying the first person to a plurality of terminal devices and receives a response from the plurality of terminal devices according to the information.
A second detection means that detects a second person from an image acquired by the acquisition means after the communication means transmits the information to the plurality of terminal devices.
With
The communication means transmits further information to at least one of the plurality of terminal devices based on the content of the received response and the detection result by the second detection means.

According to the present invention, when a suspicious person is detected from an image of a surveillance camera and notified to a clerk, it is possible to suppress unnecessary measures of the clerk such as duplication of patrols.

The figure which shows an example of the structure of the system 100. The figure which shows the hardware configuration example of the image processing apparatus 101, and the figure for demonstrating the introduction example of a system. The figure which shows an example of the notification screen of the terminal apparatus 109. The flowchart which shows an example of the flow of suspicious person detection and notification processing. A flowchart showing an example of the flow of the clerk detection process. A flowchart showing an example of the flow of reception standby processing. The figure which shows another example of the notification screen of the terminal apparatus 109. The figure which shows an example of the structure of the system 800. A flowchart showing another example of the flow of reception standby processing.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiment, not all of the plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the attached drawings, the same or similar configurations are given the same reference numbers, and duplicate explanations are omitted.

[Embodiment 1]
Hereinafter, embodiments will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing an example of the configuration of the system 100 corresponding to the embodiment. The system 100 is configured by connecting an image processing device 101, an image pickup device 102, and a terminal device 109.

The image processing device 101 has an image acquisition unit 103 that acquires an image from the image pickup device 102, a suspicious person detection unit 104 that detects a person (suspicious person) who takes a suspicious action from the image, and a terminal device connected to the outside. Communication unit 105 that notifies 109 of detection information of a suspicious person, control unit 106 that controls various operations of the image processing device 101, display unit 107 that displays the processing status of the image processing device 101, and operations for the user to perform operations. It has an input unit 108 and a clerk detection unit 110 that detects a clerk from an image. The image processing device 101 is realized as, for example, a PC (personal computer). In addition to the image processing device, the PC can be called, for example, an information processing device, an image analysis device, a suspicious person detection device, or the like. Further, the image processing device 101 may be integrally configured with the image pickup device 102.

When the user operates the operation input unit 108 while observing the display on the display unit 107, the suspicious person detection unit 104, the communication unit 105, and the like can be set. The image processing device 101 receives the image captured by the image pickup device 102 via the image acquisition unit 103. Here, the image acquisition unit 103 acquires an image directly from the image pickup device 102, but may indirectly acquire the image via the relay device, or may acquire the image from the storage device that stores the recorded image. You may try to get it. Further, in this example, the image pickup device 102 is configured outside the image processing device 101, but the image processing device 101 itself has an image pickup unit that executes a function corresponding to the image pickup device 102 as a part of the image acquisition section 103. You may do it.

In this embodiment, an example in which a network camera is used as the image pickup apparatus 102 will be described. The image received from the image pickup apparatus 102 is displayed on the display unit 107 when the setting is changed by the user. In addition, the suspicious person detection unit 104 detects a person who takes a suspicious action from the received image. Suspicious behavior can be defined in various ways. For example, when a person who looks around himself with more care than necessary is regarded as a suspicious person, the orientation of the human body and head is detected by image analysis, and the neck is detected from the change in orientation. There is a method of estimating the pretending situation and making it a suspicious person if the head is shaken more than the default value.

In the present embodiment, the case where the swinging motion is regarded as a suspicious behavior will be described. The communication unit 105 transmits a suspicious person detection notification to the terminal device 109 connected to the outside of the image processing device 101 according to the detection result and the setting by the user. Here, a plurality of terminal devices 109 may exist, and the communication unit 105 transmits a notification to the plurality of terminal devices. Further, the communication unit 105 communicates with the plurality of terminal devices by receiving the respective information transmitted from the plurality of terminal devices 109. In the present embodiment, an example will be described in which the terminal device 109 is connected to the communication unit 105 by a network device.

The terminal device 109 may be a notebook personal computer (notebook PC) having a display function, or may be a portable smartphone or tablet PC. In the present embodiment, the terminal device 109 assumes a smartphone connected by a wireless LAN. In addition, the clerk detection unit 110 detects the clerk from the received image. Here, the image to be detected by the clerk is an image taken after the suspicious person detection unit 104 detects the suspicious person and notifies the terminal device 109 of the suspicious person. There are various methods for detecting a clerk, such as a method of registering a clerk's face image and face matching, and a method of assigning a clerk a characteristic uniform or a specific code that can be judged by appearance to the clerk and detecting it by image analysis. However, it may be detected by any of the methods. In this embodiment, a clerk detection method for detecting from an image based on a clerk's uniform is used.

Next, FIG. 2 is a diagram showing an example of the hardware configuration of the image processing device 101 corresponding to the embodiment. The image processing device 101 includes a CPU 201, a ROM 202, a RAM 203, a hard disk drive (HDD) 204, a disk drive 205, a network interface 206, an input device 207, and a display device 208. The network interface 206 is connected to the network 209. The CPU 201 is a control device that controls the image processing device 101 in an integrated manner. The ROM 202 stores a program for the CPU 201 to control the image processing device 101. A secondary storage device may be provided instead of the ROM 202.

The RAM 203 is a memory for expanding the program read from the ROM 202 by the CPU 201 and executing the process. The RAM 203 is also used as a temporary storage memory as a storage area for temporarily storing data to be processed in various ways. The HDD 204 may store the image to be detected. The CPU 201 acquires an image from the HDD 204 and executes the detection process corresponding to the present embodiment. When the CPU 201 acquires an image from the disk drive 205 or the network interface 206, the image does not necessarily have to be stored in the HDD 204. The disc drive 205 reads an image in a CD, DVD, Blu-ray disc, or flexible disc, and the CPU 201 acquires the image via the disc drive 205. When the CPU 201 acquires an image from the HDD 204 or the network interface 206, the disk drive 205 does not necessarily have to be used.

The network interface 206 is a circuit that communicates via the network 209. The CPU 201 acquires an image via the network 209. When the CPU 201 acquires an image from the HDD 204 or the disk drive 205, the image does not have to be acquired via the network interface 206.

The display device 208 is a device such as a display that displays an image or an area frame. The input device 207 includes a keyboard for inputting numerical values, a pointing device for instructing a display position of a display area of the display device 208, a mouse, a touch panel, and the like. The network 209 can be, for example, a local area network (LAN), but is not limited to this, and can be any wired or wireless network. Further, network 209 does not indicate one type of network, but is a general term for any plurality of networks, and may include both wired and wireless networks.

As described above, the hardware configuration of the image processing device 101 has the same hardware components as the hardware components mounted on a general PC (personal computer). Therefore, it is possible to implement various functions realized by the image processing device 101 as software that operates on the PC. The image processing device 101 realizes various functional configurations of the image processing device 101 shown in FIG. 1 by executing the program by the CPU 201, and executes the processes corresponding to the flowcharts of FIGS. 4 to 6 and the like. be able to.

Further, the hardware configuration of the terminal device 109 is almost the same as that shown in FIG. 2 (A). However, the network interface 206 is a wireless LAN interface, and the network 209 is a wireless LAN. Further, the terminal device may or may not have the disk drive 205. The input device 207 includes a touch panel. In addition, the terminal device 109 can additionally include an imaging unit. The imaging unit can be used as an in-camera described later.

Next, an introduction example of the system 100 will be described with reference to FIG. 2 (B). FIG. 2B shows an example in which the image processing device 101, the image pickup device 102, and the terminal device 109 are arranged in the space inside the store 210 as the space to be monitored. Imaging devices 102A to 102C, which correspond to surveillance cameras, are arranged in the store to monitor the behavior of customers who enter the store between the product shelves. Here, consider the case where the customer 212 who entered the store from the entrance 211 behaves suspiciously. The image processing device 101 analyzes an image acquired from any of the imaging devices 102A to 102C and detects suspicious behavior. When a suspicious behavior is detected, the clerk 213 and the clerk 214 notify the notification terminals 109A and 109B, respectively. At this time, the clerk 213 is a clerk working in the backyard, the clerk 214 is a clerk in charge of the cash register, and the clerk 215 is a clerk who does not have a notification terminal. Note that, in FIG. 2B, the illustration of network devices and the like is omitted.

When the customer 212 is detected as a suspicious person in the store 210 as described above, the clerk 213 and the clerk 214 are notified of the suspicious person at the same time. Here, if the backyard clerk 213 is engaged in highly urgent work, he cannot go around, but if not, he goes around the suspicious person 212. On the other hand, the cashier 214 cannot go around if another customer is dealing with the cashier, but if not, he goes around the suspicious person 212.

In this way, there are cases where no one goes around even though two clerk are notified, and conversely, it is useless because two clerk go around twice for one suspicious person. It is assumed that work will occur. Further, if the clerk 215 who does not have the notification terminal notices the suspicious person 212 visually before the notification by the suspicious person detection, the clerk 215 goes around the suspicious person 212 even before the clerk 213 and the clerk 214 are notified. I'm looking around, but clerk 213 and clerk 214 have no way of knowing it.

In such a case, a situation may occur in which three clerk go around the suspicious person in duplicate. In addition, when a suspicious person is detected and notified by the conventional method, there may be a case where no clerk goes around, and conversely, the clerk causes wasteful work by going around twice. There is a risk of increasing the load on. In the present embodiment described below, it is possible to avoid such a case where no clerk goes around and a case where the clerk goes around repeatedly to reduce unnecessary work and the load on the clerk.

First, FIG. 3 is a diagram showing an example of a notification screen in the terminal device 109 according to the present embodiment. When the image processing device 101 of the present embodiment detects a suspicious person, the image processing device 101 notifies the terminal device 109 of camera information for identifying the image pickup device 102 that detected the suspicious person and an image at the time of detection. The terminal device 109 that has received the notification displays the received image in the image display area 301 of the notification screen 300. Further, the received camera information and the time are displayed in the detection information display area 302.

The clerk holding the terminal device 109 can determine his / her response to the suspicious person by the patrol execution button 303 or the patrol request button 304 after confirming the information displayed on the notification screen 300. If you want to go around, press the patrol execution button 303. On the other hand, when he / she cannot go around and requests another clerk who has another terminal device to look around, he / she presses the tour request button 304. The terminal device 109 transmits the corresponding information to the image processing device 101 according to the pressed button.

Hereinafter, the method of notifying the terminal device 109 by the image processing device 101 according to the present embodiment will be described with reference to the drawings.

First, a method of notifying the suspicious person detection result by the image processing device 101 will be described with reference to the flowchart of FIG. When the image acquisition unit 103 sequentially receives the images for analysis from the image pickup device 102, the image processing device 101 starts the suspicious customer detection process by the suspicious person detection unit 104 in S401. In S402, as a result of the suspicious person detection unit 104 detecting the suspicious person in the received image, it is determined whether or not the suspicious person is detected. If no suspicious person is detected, the suspicious person detection is continuously executed, and if a suspicious person is detected, the process proceeds to S403. In S403, the communication unit 105 transmits the image of the suspicious person detected, the detection time, the detection location (for example, the name given to the image pickup device 102), and the like as suspicious person detection information to each terminal device 109. Through the above processing, the image processing device 101 notifies the terminal device 109 of the suspicious person detection information.

Next, the operation of the image processing device 101 after transmitting the suspicious person detection information to each terminal device 109 will be described with reference to FIGS. 5 and 6. After notifying the suspicious person detection, the image processing device 101 starts the clerk detection process of FIG. 5, and at the same time, waits for the response reception from the terminal device 109 of FIG.

In FIG. 5, first, when the image acquisition unit 103 sequentially receives the images for the clerk detection process from the image pickup device 102, the clerk detection unit 110 starts the clerk detection process in S501. Here, the image for the clerk detection process means, for example, an image obtained by capturing a place, area, or space in the monitored space where the suspicious person detection unit 104 has detected the suspicious person. Alternatively, it refers to an image acquired from an image pickup device 102 (for example, the image pickup device 102A of FIG. 2B) that images a place or the like where the suspicious person detection unit 104 has detected a suspicious person.

In the following S502, when the clerk is detected by the clerk detection process, the process proceeds to S503, and the image processing device 101 additionally notifies all the terminal devices 109 of the information indicating "looked around" by the communication unit 105. .. If the clerk is not detected in S502, the process returns to S501 to receive the image for clerk detection, and repeats the clerk detection process. By this process, even when a clerk who does not have a terminal device makes a patrol, it is possible to notify another clerk that the suspicious person has "looked around".

In the present embodiment, the image processing device 101 performs the above-mentioned clerk detection process, and at the same time, performs a reception standby process for waiting for a response from each terminal device 109. The response from the terminal device 109 referred to here is information transmitted from the corresponding terminal device 109 in response to the pressing of the patrol execution button 303 or the patrol request button 304 in each terminal device 109, and is referred to as “patrol execution”. Alternatively, it is information indicating a "patrolling request". The image processing device 101 listens for a response from each terminal device 109, and when the communication unit 105 receives the response, the process proceeds to S602.

In S602, the control unit 106 determines whether the information received from the terminal device 109 is “performing patrol” or “requesting patrol”. If the received information is information indicating "performing patrol", the process proceeds to S603. In S603, the target suspicious person is patrolled by the clerk who has the terminal device 109 that has transmitted the "look around", so that the control unit 106 controls the communication unit 105 to "look around" for all the other terminal devices 109. Information indicating "looked around" is additionally notified, and the response process for this suspicious person is terminated.

On the other hand, when the information received in S602 is information indicating a "tour request", the control unit 106 controls the communication unit 105 to issue a "tour request" to the suspicious person to the other terminal device 109. We will additionally notify you that it has been done. However, in FIG. 6, the terminal device 109 that has received the response is stored, and in S604, the control unit 106 first determines whether or not the response has been received from all the terminal devices 109. When the terminal device 109 that has not received the response exists, the control unit 106 transmits an additional notification that the above-mentioned "look around request" has been issued only to the terminal device 109. On the other hand, when the response is received from all the terminal devices 109, the response process for this suspicious person is terminated. In the present embodiment, the processes corresponding to the flowcharts shown in FIGS. 5 and 6 may be completed in response to the end of either process.

FIG. 7 shows a display example of the notification screen 300 of the terminal device 109 when an additional notification is given from the image processing device 101 by the process of FIG. When "look around" is additionally notified in S603, in FIG. 7A, a word indicating that the tour has been carried out by another clerk is displayed in the message display area 701 superimposed on the buttons up to that point. .. On the other hand, when the "patrolling request" is additionally notified in S605, in FIG. 7B, the wording to the effect that the patrol request has been issued is displayed in the message display area 702 together with the name of the terminal that issued the patrol request. In this way, the display content of the notification screen 300 is switched according to the response content from the terminal device 109. The display location and display method of the message are not limited to the methods described here, and various modifications and changes can be made.

According to the above embodiment, it is possible to prevent the same suspicious person from going around in duplicate and to prevent the load on the clerk from increasing.

[Embodiment 2]
Next, the second embodiment will be described with reference to the drawings. FIG. 8 is a diagram showing an example of the configuration of the system 800 in the second embodiment. The system 800 in this embodiment is configured by connecting an image processing device 801, an image pickup device 102, and a terminal device 109. The image processing device 801 has basically the same configuration as the image processing device 101 in the first embodiment, and gives a warning instruction to the warning device 810 arranged outside the image processing device 801 and connected to the image processing device 801. It has an additional warning instruction unit 802 for performing the above. Further, the operation and configuration of the image pickup apparatus 102 and the terminal apparatus 109 are the same as those described in the first embodiment.

The suspicious person detection unit 104 analyzes the image received from the image pickup device 102, and detects a person who behaves suspiciously. When a suspicious person is detected, the communication unit 105 transmits a suspicious person detection notification to the terminal device 109, and receives the respective information transmitted from the terminal device 109. Based on the information received from the terminal device 109 received by the communication unit 105, the warning instruction unit 802 issues a warning instruction for operating the warning device 810 installed outside.

The warning device 810 and the warning method are not particularly limited. For example, when a voice warning is desired, a speaker can be used as the warning device 810. Further, when it is desired to use a warning image or video, a monitor can be used as the warning device 810. In addition, warning lights are also available. In the description of this embodiment, a voice warning is given, and the warning device 810 assumes a speaker.

Hereinafter, a method of notifying the terminal device by the image processing device 801 and a method of instructing the warning device 810 according to the present embodiment will be described. The display content of the notification screen 300 of the terminal device 109 in this embodiment is the same as that shown in FIG. Further, the method of notifying the suspicious person detection result by the image processing device 801 is the same as the method described using the flowchart of FIG. Further, the clerk detection process by the image processing device 801 is the same as the method described with reference to the flowchart of FIG.

Next, the reception standby process corresponding to the present embodiment will be described with reference to FIG. The operation of the flowchart of FIG. 9 is substantially the same as that of the flowchart of FIG. 6 of the first embodiment. Therefore, the same step numbers are assigned to the corresponding processing steps, and the description thereof will be omitted. Further, the screen display of the terminal device 109 when the additional notification is given from the image processing device 801 shall be the same as the mode shown in FIG. 7.

In the first embodiment, when it is determined in S604 of FIG. 6 that a response has been received from all the terminal devices 109, the process has ended, but in the present embodiment, the process proceeds to S901 in FIG. In S901, when a "look around request" is received from all the terminal devices, it is considered that there is no clerk who can respond to the suspicious person, and the control unit 106 controls the warning instruction unit 802 to provide a warning installed outside. A warning instruction is given to the device 810, the warning device 810 is activated, and the presence of a suspicious person is notified to the inside of the store. As a result, it is possible to notify the clerk who does not hold the terminal device 109 of the existence of the suspicious person and give a warning to the suspicious person to discourage an act such as shoplifting.

The warning device 810 may be released by the terminal device 109. When the warning device 810 is activated, the warning instruction unit 802 transmits information for receiving an instruction to stop the operation of the warning device 810 to the terminal device 109. The terminal device 109 causes the notification screen 300 to display a button instructing the stop of the warning device 810 according to the received information. At this time, since the button display timing is after the warning for a certain period of time has been issued, it can be after a predetermined time has elapsed from the reception. When the stop button on the notification screen 300 is operated, the terminal device 109 transmits a stop instruction to the image processing device 101. When the image processing device 101 receives a stop instruction from any of the terminal devices 109, the warning instruction unit 802 issues a release instruction to release the operation of the warning device 810, and the operation of the warning device 810 is stopped.

By the above processing, it is possible to avoid going around the same suspicious person more than once, and at the same time, issue a warning to the suspicious person even in a situation where no one can respond to the report. This makes it possible to suppress shoplifting while preventing an increase in the load on the clerk.

The terminal device 109 in the first and second embodiments described above transmits the "look around request" notification only when the "look around request" button 304 is pressed. Not limited to this, after the terminal device 109 receives the suspicious person detection notification, or after the notification screen 300 as shown in FIG. The notification may be transmitted to the image processing device 101. Alternatively, when the in-camera is arranged on the notification screen 300 side of the terminal device 109, the face detection process is performed on the image obtained by automatically taking a picture with the in-camera when the above-mentioned predetermined time elapses, and it is suspicious. If the face of a person (face of a clerk) cannot be detected in the in-camera image after the notification of person detection, it can be treated as "a clerk is not in front of the terminal device (absence)" and "requested to look around". good.

The invention is not limited to the above embodiments, and various modifications and modifications can be made without departing from the spirit and scope of the invention. Therefore, a claim is attached to make the scope of the invention public.

(Other Examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

System: 100, image processing device: 101, image pickup device 102, terminal device: 109

Claims (19)

An acquisition means for acquiring an image of the space to be monitored, and
A first detection means that analyzes an image acquired by the acquisition means and detects a first person taking a suspicious action in the space.
A communication means that transmits information for identifying the first person to a plurality of terminal devices and receives a response from the plurality of terminal devices according to the information.
A second detection means that detects a second person from an image acquired by the acquisition means after the communication means transmits the information to the plurality of terminal devices.
An image processing device equipped with
The communication means is characterized in that further information is transmitted to at least one of the plurality of terminal devices based on at least one of the content of the received response and the detection result by the second detection means. Image processing device. When the content of the received response is to carry out a patrol around the first person.
The claim is characterized in that, among the plurality of terminal devices, the communication means transmits information notifying that the patrol has been performed to a terminal device different from the terminal device that transmitted the response. Item 1. The image processing apparatus according to item 1. When the content of the received response is to request a patrol around the first person.
The claim is characterized in that the communication means transmits information notifying that a patrol is requested to a terminal device different from the terminal device that has transmitted the response among the plurality of terminal devices. The image processing apparatus according to 1 or 2. Further equipped with warning instruction means to activate the warning device,
The image according to claim 3, wherein when the communication means receives a response requesting the patrol from all of the plurality of terminal devices, the warning instruction means activates the warning device. Processing equipment. After the warning instructing means operates the warning device, the communication means transmits information for instructing the warning device to stop to the plurality of terminal devices.
The fourth aspect of claim 4, wherein when the communication means receives an instruction to stop the warning device from any one of the plurality of terminal devices, the warning instruction means stops the operation of the warning device. Image processing equipment. When the second detection means detects the second person,
The image according to any one of claims 1 to 5, wherein the communication means transmits information notifying that the patrol has been performed to all of the plurality of terminal devices. Processing equipment. The second detection means according to any one of claims 1 to 6, wherein the second detection means detects the second person from an image obtained by capturing a place where the first person is detected in the space. The image processing apparatus described. The acquisition means acquires an image from each of a plurality of imaging devices arranged to image the space to be monitored.
The second detection means is characterized in that, among the plurality of image pickup devices, the second person is detected from the image captured by the image pickup device that has captured the image in which the first person is detected. Item 6. The image processing apparatus according to any one of Items 1 to 6. The space to be monitored is the space inside the store.
The first person is a customer who visits the store and
The image processing device according to any one of claims 1 to 8, wherein the second person is a clerk in the store. It ’s a terminal device,
A communication means for communicating with the image processing device according to any one of claims 1 to 9.
A display means for notifying the user of the terminal device, including the information received from the image processing device, and displaying a notification screen for accepting an operation.
With
When the communication means receives information from the image processing device for identifying a first person who is taking a suspicious action in the space to be monitored, the display means is for identifying the first person. The information, the first button notifying the image processing device to perform the patrol, and the second button notifying the image processing device to request the user of the other terminal device to perform the patrol are described above. Display on the notification screen
The display of the notification screen is switched according to the information further received by the communication means from the image processing device.
The communication means is a terminal device, characterized in that information based on an operation on the notification screen of a user of the terminal device is transmitted to the image processing device. When the user of the other terminal device operates the first button on the other terminal device, the display of the notification screen is a display notifying the user of the terminal device that the patrol has been carried out. Switch,
When the user of the other terminal device operates the second button on the other terminal device, the display of the notification screen is a display notifying the user of the terminal device that a patrol has been requested. The terminal device according to claim 10, wherein the terminal device is switched. When a predetermined time elapses after the first button and the second button are displayed on the notification screen,
The communication means according to claim 10 or 11, wherein the communication means transmits to the image processing device a notification requesting a user of another terminal device to look around, assuming that the second button has been operated. Terminal device. The terminal device further includes a photographing means for photographing a user of the terminal device on the same surface as the notification screen.
When a predetermined time elapses after the first button and the second button are displayed on the notification screen, the photographing means takes an image, and the user of the terminal device is not shown in the image. 10. The terminal device described. The display means further displays information instructing the stop of the operation of the warning device on the notification screen.
The claim is characterized in that, when the communication means receives an instruction to stop the operation of the warning device from a user of the terminal device on the notification screen, the communication means transmits an instruction to stop the warning device to the image processing device. The terminal device according to any one of 10 to 13. An imaging device that captures the space to be monitored, and
The image processing apparatus according to any one of claims 1 to 9,
The terminal device according to any one of claims 10 to 14,
A system characterized by being equipped with. The acquisition process is to acquire an image of the space to be monitored.
A first detection step in which the first detection means analyzes the image acquired in the acquisition step and detects a first person taking a suspicious action in the space.
A communication step in which the communication means transmits information for identifying the first person to a plurality of terminal devices and receives a response from the plurality of terminal devices according to the information.
A second detection step in which the second detection means detects a second person from an image acquired in the acquisition step after transmitting the information to the plurality of terminal devices in the communication step.
Based on at least one of the content of the response received in the communication step and the detection result in the second detection step, the communication means transmits further information to at least one of the plurality of terminal devices. A control method for an image processing apparatus, which comprises a transmission step. A communication means for communicating with the image processing device according to any one of claims 1 to 9.
A display means for notifying the user of the terminal device including the information received from the image processing device and displaying a notification screen for accepting an operation.
It is a control method of a terminal device provided with
A step in which the communication means receives information from the image processing device for identifying a first person who is taking a suspicious action in the space to be monitored.
The display means requests the user of another terminal device to perform the information for identifying the first person received, the first button notifying the image processing device that the patrol is to be performed, and the patrol. A step of displaying a second button for notifying the image processing device on the notification screen, and
A step in which the display means switches the display of the notification screen according to information further received by the communication means from the image processing device.
A method for controlling a terminal device, wherein the communication means includes a step of transmitting information based on an operation on the notification screen of a user of the terminal device to the image processing device. A program for operating a computer as each means of the image processing apparatus according to any one of claims 1 to 9. A program for operating a computer as each means of the terminal device according to any one of claims 10 to 14.

Images