JP2022190576A - Crime prevention system and program - Google Patents

Abstract

To prevent a commodity from being taken away without payment before the attempt.SOLUTION: A crime prevention system includes: a person authentication unit which performs face authentication so as to identify a person from an image captured by a camera installed in a store; a tracking unit which tracks the person authenticated by the person authentication unit using the image captured by the camera installed in the store; a sales promotion announcement unit which outputs information related to sales promotion to the person in the store from at least one of screen display and voice using a device installed in the store; a behavior recognition unit which recognizes suspicious behavior of the person in the store using the image captured by the camera installed in the store; and a deterrent announce unit which outputs information on a commodity related to the suspicious behavior and information for purchasing the commodity from the device installed near the person showing the suspicious behavior recognized by the behavior recognition unit.SELECTED DRAWING: Figure 10

Description

Embodiments of the present invention relate to security systems and programs.

Due to various backgrounds such as the spread of economic hardship due to social conditions, the decrease in the number of store clerks who make rounds in stores, and the use of shopping bags brought by customers instead of plastic bags, It is said that unaccounted goods are taken away from retail stores (so-called shoplifting).

Shoplifting is established when a customer leaves the store with unaccounted products, so the store side hopes that the customer will stop (or notice the mistake) while they are in the store as much as possible. . However, it is difficult for the store clerk to work on it. This is because, for the clerk, the person in the store is a customer, so it is difficult to talk to them if they are just suspicious, that is, if they cannot judge whether they are intending to commit a crime. For this reason, it is difficult to end shoplifting at the stage of attempted shoplifting.

Conventionally, various techniques have been devised for shoplifting prevention, and one of them is the technique disclosed in Patent Document 1, for example. This technique discloses the detection of suspicious customer behavior. However, this technique does not examine how to voluntarily discourage the subject from trying at the stage of the attempt.

The problem to be solved by the present invention is to provide a crime prevention system and a program that work to stop the attempted removal of unaccounted-for commodities.

A crime prevention system according to an embodiment includes a person authentication unit that performs face authentication so that an individual can be identified from an image captured by a camera installed in a store, and a person authenticated by the person authentication unit is identified by an image captured by a camera installed in the store. A follow-up unit that follows, a sales promotion announcement unit that notifies sales promotion information to people in the store by at least one of screen display and sound using a device installed in the store, and imaging by a camera installed in the store. A behavior recognition unit that recognizes the suspicious behavior of a person in the store from an image, and the device located near the person who has behaved suspiciously and is recognized by the behavior recognition unit. and a deterrent announcement unit for announcing information guiding toward purchase of the product.

1 is a diagram illustrating an example of a configuration of a security system according to an embodiment; FIG. FIG. 2 is a diagram illustrating an example of a configuration of a server; FIG. 3 is a diagram showing an example of a person list in a table format. FIG. 4 is a diagram showing an example of information stored in a store visitor storage unit in a table format. FIG. 5 is a diagram illustrating an example of a functional configuration of a server; FIG. 6 is a diagram illustrating an example of a signage configuration. FIG. 7 is a diagram illustrating an example of a configuration of a store clerk terminal; FIG. 8 is a diagram showing an example of information that associates alert levels with deterrent announcements. FIG. 9 is a diagram illustrating an example of information that associates actions with changes in vigilance levels. FIG. 10 is a diagram showing an example of options for the content of the restraining announcement. FIG. 11 is a diagram illustrating an example of associations between deterrence announcements and cooperation targets. FIG. 12 is a diagram illustrating an example of processing executed by the security system.

(First embodiment)
Embodiments will be described with reference to the drawings. 1 is a diagram illustrating an example of a configuration of a security system according to an embodiment; FIG. The security system of this embodiment includes a server 1, a camera 2, a signage 3, an electronic shelf label 4, a clerk terminal 5, a store controller 6, a router 7, networks 8 and 9, and a security terminal (not shown). Configured.

The server 1 controls the security system by communicating with each component included in the security system (camera 2, signage 3, electronic shelf label 4, clerk terminal 5, store controller 6, etc.), and each component outputs It receives information about what to do and sends instructions to each component. The server 1 is, for example, a head office server, and is provided at the head office that supervises a plurality of stores.

Camera 2 outputs a captured image. The captured image is transmitted to the server 1 . A plurality of cameras 2 are installed at various places in the store besides the store entrance. The installation location in the store is specifically a position where it is possible to capture an image of the products displayed on the display shelf, and the camera 2 captures an image of the customer picking up the product on the display shelf.

The signage 3 is a digital signage (electronic signboard), and is used for sales promotion (sales promotion), such as informing customers in the store of information on products and special sales. The electronic shelf label 4 is a shelf label using a display device such as electronic paper, and can display prices synchronized with the price master in cooperation with a host server connected via a network, for example.

The store clerk terminal 5 is a terminal device that notifies information to a store clerk or a security guard who owns the terminal, and is realized by, for example, a smartphone. Further, the clerk terminal 5 may be a dedicated handy terminal or a tablet-type terminal device, or may be a general computer such as a PC (Personal Computer) installed in a backyard or a guard room. good.

The store controller 6 is a general computer such as a PC (Personal Computer), which is also called a store computer or a store server. The store controller 6 cooperates with an in-store POS (Point Of Sales) terminal device (not shown) to manage sales information. In addition, the store controller 6 manages each of the above components (camera 2, signage 3, electronic shelf label 4, store clerk terminal 5, etc.). Furthermore, the store controller 6 shares information with the server 1 at the headquarters.

Each component in the store (camera 2, signage 3, electronic shelf label 4, clerk terminal 5, store controller 6, etc.) is connected to the router 7 via a network 8 such as a LAN (Local Area Network). Also, the router 7 connects to the server 1 via a network 9 such as the Internet or a mobile phone network. As a result, the router 7 mediates communication between the server 1 and each component described above.

FIG. 2 is a diagram showing an example of the configuration of the server 1. As shown in FIG. The server 1 is implemented by, for example, a general computer such as a PC. The server 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication I/F (Interface) 104, a display unit 105, an operation unit 106, a storage unit 120, and the like. configured with. It is assumed that the configuration of the store controller 6 is substantially the same.

Communication I/F 104 mediates communication with external devices (camera 2, signage 3, electronic shelf label 4, store clerk terminal 5, store controller 6).

The display unit 105 is a display device such as a liquid crystal panel, and displays information for the operator. An operation unit 106 is an operation device such as a keyboard or a touch panel, and is used to receive operations from an operator.

The storage unit 120 stores programs and various files. The storage unit 120 may be any storage device, such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Programs stored in the storage unit 120 are executed by the CPU 101 .

The ROM 102 stores programs executed by the CPU 101 . The RAM 103 is used for developing programs executed by the CPU 101 and temporarily storing various values. The CPU 101 functions as a control unit 110 by executing programs stored in the ROM 102 and the storage unit 120, and implements various functional units (see FIG. 5, which will be described later).

The files stored in the storage unit 120 are, for example, the person list 121, the advertisement information 122, the warning setting information 130, the store visitor storage unit 140, and the like.

The person list 121 stores the face images of suspicious persons and their caution levels. A suspicious person is, for example, a person who has a record of frequently confirming suspicious behavior in a store. The vigilance level is, for example, a numerical value from "1" to "9". Details will be described later. The person list 121 is created, for example, from information collected in the store. A well-known technique may be used for the method of creation, and there is a technique disclosed in Patent Document 1, for example.

FIG. 3 is a diagram showing an example of the person list 121 in a table format. This table stores the suspicious person ID, the face image of the suspicious person identified by the suspicious person ID, the face information, and the warning level. The face information is generated based on the face image described above in order to enable comparison with face images included in other captured images. This is information obtained by extracting facial features to the extent possible.

The publicity information 122 is sales promotion information notified by a device (for example, the signage 3 or the electronic shelf label 4) installed in the store. The sales promotion information is, for example, a moving image or still image with sound or a moving image or still image without sound, including information on new products or information on special sales.

Alert settings information 130 stores various settings that the security system uses for alert and deterrent announcements. Details will be described later with reference to FIGS. 8 to 11. FIG.

The store visitor storage unit 140 stores information about customers who are entering the store. FIG. 4 is a diagram showing an example of information stored in the store-entering person storage unit 140 in a table format. This table stores the ID of the person entering the store, the face image, the face information, the ID of the suspicious person, the caution level, the suspicious behavior of the day, and the like.

The store entrant ID is automatically numbered when writing a new record in this table. A record is generated each time a customer entering the store is included in the image captured by the camera 2 at the entrance of the store. The face image is the face image of the customer at the time of entering the store, which is included in the captured image of the camera 2 at the entrance of the store. The face information is generated based on the face image at the time of entering the store in order to enable comparison with the face images included in other captured images. For example, the person can be tracked by the camera 2 inside the store. It is information that extracts facial features that can be easily identified.

If the customer identified by the customer ID of this record is included in the person list 121, the suspicious person ID in the person list 121 is adopted as the suspicious person ID. Also, if the customer identified by the store-entering person ID of this record is not included in the person list 121, the suspicious person ID is set to "none".

If the person list 121 includes the customer identified by the store entrant ID of this record, the alert level in the person list 121 is adopted as the alert level. Also, if the customer identified by the store entrant ID of this record is not included in the person list 121, the alert level is set to the initial value of "0".

FIG. 5 is a diagram showing an example of the functional configuration of the server 1. As shown in FIG. The control unit 110 includes functional units such as a person authentication unit 111, a follower unit 112, an action recognition unit 113, a determination unit 114, a restraint announcement unit 115, a cooperation information notification unit 116, a sales promotion announcement unit 117, and the like.

The sales promotion announcement unit 117 provides information (sales promotion information) related to sales promotion to people in the store by at least one of screen display and voice using devices (for example, signage 3 and electronic shelf label 4) installed in the store. inform.

The person authentication unit 111 performs face authentication so that an individual can be identified from the captured image output by the camera 2 installed in the store.

More specifically, the person authentication unit 111 extracts a face image (or face information generated based on the face image) extracted by detecting a face part of a person from the image captured by the camera 2, and stores it in the person list 121 and the person list 121. The information stored in the store visitor storage unit 140 is referred to, and it is determined whether or not the same person is stored. In addition, the person authentication unit 111 newly generates a record of a person not stored in the person list 121 and the store visitor storage unit 140 in the store visitor storage unit 140 .

The tracking unit 112 tracks the person authenticated by the person authentication unit 111 using the image captured by the camera 2 installed in the store. More specifically, the tracking unit 112 stores face images detected from images captured by each camera 2 (or face information generated based on the face images) in a person list 121 or a predetermined area of the storage unit 120. The current location of each customer is grasped by matching with the stored face information of the customer and associating it with the imaging location. In addition to the current value of each customer, the tracking unit 112 may also record the movement locus of the customer.

The behavior recognition unit 113 recognizes the suspicious behavior of the person in the store from the image captured by the camera 2 installed in the store. As a method for recognizing suspicious behavior, for example, an existing method disclosed in Patent Document 1 is used. There are various ways to decide what kind of behavior is specifically regarded as suspicious behavior, and it will be described in detail later using FIG. , etc.

Note that the action recognition unit 113 also recognizes the action of picking up a product in order to obtain a trigger for the restraint announcement unit 115 to make a restraint announcement.

The determination unit 114 determines the level of caution (for example, the level of caution) that should be taken for the person who has performed the behavior according to the degree of suspicion of the behavior recognized by the behavior recognition unit 113, and notifies information according to the level. is performed by the suppression announcement unit 115 . It should be noted that the degree of suspicion and the corresponding warning level are determined by the warning setting information 130. FIG. The determination unit 114 refers to the alert setting information 130 to determine the degree of suspicion and the corresponding alert level.

Moreover, even if the same person repeats suspicious behavior during one visit, the determination unit 114 raises the caution level of the person each time the behavior is detected. As a result, for example, even after the deterrent announcement unit 115 has issued the notification, when the action recognition unit 113 further recognizes suspicious behavior of the person targeted for the notification, the action can be taken at a higher alert level than the previous time. Therefore, it is possible to make a deterrent announcement with a more direct and strong message.

The restraint announcement unit 115 uses a device normally used by the sales promotion announcement unit 117 to announce sales promotion information, and issues restraint announcements.

The deterrent announcement unit 115 notifies predetermined information using a device (for example, the signage 3 or the electronic shelf label 4) located near the person who has behaved suspiciously and has been recognized by the behavior recognition unit 113 . The predetermined information here is information related to the product related to the suspicious behavior recognized by the behavior recognition unit 113 and information guiding the purchase of the product. The contents of the notification by the restraint announcement unit 115 are determined by the warning setting information 130. FIG. The deterrence announcement unit 115 refers to the alert setting information 130 and announces the determined contents.

It should be noted that the position of the device used by the deterrent announcement unit 115 to notify information is described above as being "located near the person who behaved suspiciously". The vicinity here is, for example, a position that can be visually recognized (or heard) from the position of the target person. and Whether the device is visible from the target person can be determined by determining the position of the target person from the installation position information and imaging angle of the camera 2 that is capturing the target person, or from the display shelf in which the target person is captured. can be selected by

In addition, the deterrent announcement part 115 notifies information by means of a signage 3 installed for announcing sales promotion information and an electronic shelf label 4 installed on a display shelf for displaying commodities to display the price of the commodities.

Further, the deterrent announcement unit 115 notifies the captured image including the suspicious behavior recognized by the behavior recognition unit 113 through the signage 3 or the salesclerk terminal 5 when the alarm level exceeds a predetermined threshold.

The cooperation information notification unit 116 transmits the information regarding the person who has acted suspiciously and has been recognized by the behavior recognition unit 113 to the store clerk terminal 5 or the like.

FIG. 6 is a diagram showing an example of the configuration of the signage 3. As shown in FIG. The signage 3 includes a CPU 301, a ROM 302, a RAM 303, a communication I/F 304, a display section 305, an operation section 306, a speaker 307, a storage section 320, and the like.

The communication I/F 304 mediates communication with external devices (server 1, camera 2, electronic shelf label 4, store clerk terminal 5, store controller 6). The display unit 305 is, for example, a display device such as a liquid crystal panel. The operation unit 106 is an operation device such as a button, and is used to adjust the volume of the speaker 307 and the brightness of the display unit 305, for example.

The storage unit 320 is, for example, an SSD or flash memory, and stores programs and various files. Programs stored in the storage unit 320 are executed by the CPU 301 . The ROM 302 stores programs executed by the CPU 301 . A RAM 303 is used for developing programs executed by the CPU 301 and temporarily storing various values. CPU 301 executes programs stored in ROM 302 and storage unit 320 to centrally control each unit of signage 3 .

The signage 3 may receive the sales promotion information from the server 1 and perform streaming reproduction, or may download the information to the storage unit 320 and repeatedly reproduce it at a predetermined timing.

FIG. 7 is a diagram showing an example of the configuration of the store clerk terminal 5. As shown in FIG. The clerk terminal 5 includes a CPU 501, a ROM 502, a RAM 503, a communication I/F 504, a display section 505, an operation section 506, a speaker 507, a storage section 520, and the like.

Communication I/F 504 mediates communication with external devices (server 1, camera 2, signage 3, electronic shelf label 4, store controller 6). A display unit 505 is, for example, a display device such as a liquid crystal panel, and displays information for a store clerk or a security guard. An operation unit 506 is an operation device such as a keyboard or a touch panel, and is used to receive operations from an operator (clerk or security guard).

The storage unit 520 is, for example, a flash memory, and stores programs and various files. Programs stored in the storage unit 520 are executed by the CPU 501 . The ROM 502 stores programs executed by the CPU 501 . A RAM 503 is used for developing programs executed by the CPU 501 and temporarily storing various values. The CPU 501 executes programs stored in the ROM 502 and the storage unit 520 to control each unit of the store clerk terminal 5 in an integrated manner.

Next, the warning setting information 130 stored in the storage unit 120 of the server 1 will be described. The alert setting information 130 includes information illustrated in tables 131-134 of FIGS. 8-11. FIG. 8 is a diagram showing an example of information that associates alert levels with deterrent announcements. FIG. 9 is a diagram illustrating an example of information that associates actions with changes in vigilance levels. FIG. 10 is a diagram showing an example of options for the content of the restraining announcement. FIG. 11 is a diagram illustrating an example of associations between deterrence announcements and cooperation targets.

The table 131 shown in FIG. 8 stores information that associates alert levels with deterrent announcements. A vigilance level is an example of a level of vigilance to be taken with respect to a suspicious person (a person on the person list 121) or a person who has acted suspiciously. The vigilance level is, for example, 10 stages represented by numerical values from "0" to "9". Alert level "0" indicates that the person is not suspicious and does not need to be alerted. A warning level of "1" or higher indicates that there is something suspicious and caution is required. It should be noted that the person listed in the person list 121 is suspicious and requires vigilance, so the vigilance level is "1" or higher. Therefore, alert level “0” is set for persons not listed in the person list 121 .

The restraint announcement ID is represented by, for example, a numerical value of "1" to "3", and identifies the restraint announcement to a person (customer) in the store. In the present embodiment, the content of each deterrent announcement identified by the deterrent announcement ID has three levels of different strengths of expression, and is associated with each caution level. Further, in the present embodiment, the correspondence between the caution level and the deterrent announcement is different for a person on the person list 121 (applicable person) and for a person not on the person list 121 (non-applicable person). is performed on

For example, the persons (applicable persons) listed in the person list 121 are grouped into three alert levels, ie, "1" to "3", "4" to "6", and "7" to "9". Three groups are divided, and suppression announcement IDs are assigned in order. In other words, a deterrence announcement with an ID of "1", that is, a euphemistic expression, is made to a person with caution levels "1" to "3". Also, for persons with alert levels of "4" to "6", the ID is "2", that is, a deterrent announcement is made in a direct manner. Then, a strong deterrent announcement such as showing a photographed image is made to a person whose alert level is "7" to "9". As the Alert Level value increases, the deterrence announcement is made in a more direct manner.

Also, for persons not listed in the person list 121 (non-applicable persons), deterrent announcements are not made not only when there is no suspicious behavior but also when there are not many suspicious behaviors (when the alert level is low). Then, when the non-applicable person repeats suspicious behavior and the caution level becomes high, a deterrent announcement is made.

For example, for non-applicable persons, when the caution level is "3" to "5", the ID is "1", that is, a deterrent announcement is made with a euphemistic expression. For non-applicable persons, when alert levels are "6" and "7", the ID is "2", that is, a direct deterrent announcement is made. For non-applicable persons, when alert levels are "8" and "9", ID is "3", ie, a strong deterrent announcement such as showing a captured image is made.

The table 132 shown in FIG. 9 stores information that associates actions with changes in vigilance levels. The "behavior" here is an example of various suspicious behaviors, and the table 132 stores the details of changes in the caution level associated with each of them. The determination unit 114 refers to the table 132 and changes the caution level.

The table 132 stores control rules as exemplified below. For example, in the case of mild suspicion such as a long dwell time (staying in the same place all the time), repeated appearances, or the possibility of simply getting lost, one point is added to the caution level. Also, if there is an obviously suspicious act such as putting a product in a bag, the warning level is changed to the maximum value of "9". Furthermore, for a person who is not listed in the person list 121, the warning level is subtracted by, for example, 2 points as the relevant product is accounted for when the suspicious behavior is detected.

The table 133 shown in FIG. 10 stores options for the content of the restraining announcement. An image and a wording are specified for each option. The image is assumed to be displayed on the display unit 305 of the signage 3 or the like. The wording is assumed to be displayed on the display unit 305 of the signage 3 or pronounced by the speaker 307 of the signage 3 or the like.

Also, the above-mentioned image is the image of the product or the captured image of the camera 2 itself that is associated with the suspicious behavior recognized by the behavior recognition unit 113 . The above-mentioned wording is supplementary information of the product with suspicious behavior and wording that guides the purchase of the product.

Options include, for example, three types of announcement contents associated with IDs "1" to "3". The contents of the euphemistic deterrence announcement of ID "1" are the image of the product and a message such as "Welcome! This product is on sale today! Please bring it to the cash register when purchasing."

One of the intentions of this deterrent announcement is to tell the person who behaved suspiciously that the behavior and the product are specified by the image of the product and the words such as "this is the product". In addition, one of the intentions of this deterrent announcement is to tell people not to take home without going through the cash register by using the phrase "Please bring your purchase to the cash register." In addition, according to such a euphemistic deterrent announcement, for customers who do not intend to shoplift, the content can be heard as an explanation of the product as part of the sales promotion, and on the other hand, for those who intend to shoplift, can be content that discourages it.

The content of the direct deterrence announcement for ID "2" is an image of the product and a message such as "Please pay for the product you have." In this deterrent announcement for ID "2", the wording that guides people toward purchasing the product is more direct and stronger than the one for ID "1", so that the store can grasp that the product is in their hands. and instructions to pay.

The content of the deterrent announcement for ID "3" is a captured image, a warning sound, and a message such as "Images are being taken by a security camera. Please pay for the items you have." The warning sound is an electronic sound such as "beep" that attracts the attention of the surroundings. In this deterrent announcement of ID "3", a warning sound is used to call attention, and a photographed image is used to show evidence that the product is in hand. In addition, in this deterrent announcement of ID "3", the message that guides the purchase of the product is stronger than that of ID "2".

The table 134 shown in FIG. 11 stores associations between suppression announcements and cooperation targets. The cooperation information notification unit 116 refers to the table 134 and transmits information about the person targeted for the restraint announcement to the cooperation destination (clerk terminal 5 or security terminal) corresponding to the restraint announcement ID. It is assumed that the security terminal is a PC installed in a security guard's room, a guard's room, or the like.

With the configuration as described above, the crime prevention system performs the flow of processing shown in FIG. 12 as an example. FIG. 12 is a diagram (flowchart) showing an example of processing executed by the security system.

When receiving an output from the camera 2 at the entrance of the store, the control unit 110 cuts out a face image from the image captured by the camera 2 and performs face authentication (step S1). Next, when the face-authenticated customer corresponds to a person listed in the person list 121 (Yes in step S2), the control unit 110 follows the customer by outputting the cameras 2 installed in various places in the store. (step S3).

Next, when the customer shows a specific behavior corresponding to suspicious behavior (Yes in step S4), the control unit raises the alert level of the customer (step S5) and makes a restraining announcement according to the alert level. (Step S6). Then, control unit 110 returns the process to step S3.

Moreover, the control part 110 returns a process to step S3 also when a specific action is not seen by step S4 (No of step S4).

If the customer face-recognised in step S1 does not correspond to a person listed in the person list 121 (No in step S2), the control unit 110 detects the customer as one of the cameras 2 installed throughout the store. It follows according to the output (step S7).

Next, when the specific behavior corresponding to suspicious behavior is seen in the customer (Yes in step S8), the control unit raises the alert level of the customer (step S9), and determines that the alert level exceeds the threshold. (Yes in step S10), a deterrent announcement is made according to the warning level (step S11). Then, control unit 110 returns the process to step S7. In the case of this embodiment, it is assumed that the threshold is exceeded if the warning level is 3 or higher in step S10.

If the threshold value is not exceeded in step S10 (No in step S10), control unit 110 returns the process to step S7.

If the specific action is not seen in step S8 (No in step S8), the control unit 110 advances the process to step S12 and confirms whether the product related to the specific action has been paid (step S12). It is possible, for example, to check whether the payment has been made by referring to the sales information sent from the POS terminal in the store to the server 1 via the store controller 6 .

In step S12, if the payment for the corresponding product is confirmed (Yes in step S12), the control unit 110 lowers the alert level (step S13) and returns the process to step S7. Also, in step S12, if the payment for the corresponding product is not confirmed (No in step S12), the control unit 110 returns the process to step S7.

According to the crime prevention system described above, it is possible to prevent a person who intends to shoplift from attempting to take away unaccounted merchandise without making general customers who do not intend to shoplift uncomfortable. can work.

Further, according to this embodiment, the strength of the approach can be changed according to the degree of suspicion. In addition, it is possible to quickly convey information about a person who behaves suspiciously to a store clerk or a security guard and cooperate with them.

Further, according to the present embodiment, it is possible to raise the alert level of a person who repeatedly behaves suspiciously according to the number of times and details of suspicious behaviors.

Further, according to the present embodiment, even if a customer who is not listed in the person list 121 behaves suspiciously, the security level can be lowered by accounting for the product related to the behavior. According to this, even if a suspicious behavior is mechanically recognized, if the recognition is wrong, it can be automatically corrected.

In this embodiment, the server 1 includes various functional units (person authentication unit 111, follower unit 112, action recognition unit 113, determination unit 114, restraint announcement unit 115, cooperation information notification unit 116, sales promotion announcement unit 117). However, in practice, the store controller 6 may be provided with various functional units. Moreover, in this embodiment, the server 1 is a headquarters server, but in practice, the server 1 may be a virtual server (cloud server) on the cloud.

Further, in implementation, cooperation with the store clerk terminal 5, the security guard terminal, and the store controller 6 may be further enhanced. For example, the store clerk terminal 5, the security guard terminal, the store controller 6, etc. can directly instruct a device (for example, the signage 3 or the electronic shelf label 4) near the person who acts suspiciously to immediately notify the deterrence announcement. It may be configured as

In addition, the sales promotion announcement unit 117 and the restraint announcement unit 115 of the present embodiment announce information by the signage 3 and the electronic shelf label 4, but in practice, for example, both the signage 3 and the electronic shelf label 4 are not necessarily used. Information may be notified by either one of them. The signage 3 and the electronic shelf label 4 are examples of devices used for information notification, and other devices may be used for information notification.

In addition, when the deterrent announcement is made for the second time or more on the day for the target person, the announcement of that time may also refer to the product related to the previous deterrent announcement. By doing so, when the target person was not conscious of the restraining announcement before the last time, it is possible to make the target person aware of it again.

Further, in the present embodiment, the determination unit 114 is provided to determine the warning stage (warning level) and perform a more detailed action, but the implementation is not limited to this. In practice, for example, without providing the judgment unit 114, it is possible to make a uniform announcement directly by the deterrent announcement unit 115 when the action recognition unit 113 recognizes.

In addition, in the present embodiment, when a person who has been subject to a deterrent announcement once repeatedly behaves suspiciously, the level of vigilance is raised. It may not be essential to adjust the level of vigilance when a person who is the target of the above repeatedly behaves suspiciously.

Further, in the present embodiment, an example has been described in which it is recognized that the customer has picked up the product from the captured image of the camera 2. Recognition may be performed by multiple devices. More specifically, a weight sensor provided on the shelf board of the display shelf may detect that the product has been picked up. Also, a reader that reads wireless tags attached to the products may be used to detect the movement of the products from the display shelf. The radio tag is, for example, an RFID (radio frequency identifier) tag.

The security system of this embodiment includes a control device such as a CPU, a storage device such as a ROM (Read Only Memory) and a RAM, an external storage device such as an HDD and a CD drive device, a display device such as a display device, and a keyboard. Equipped with an input device such as a mouse and a mouse, it has a hardware configuration using a normal computer.

The program executed by the security system of this embodiment is a file in an installable format or an executable format, and can be read by a computer such as a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk). It is recorded on a possible recording medium and provided.

Alternatively, the program executed by the security system of this embodiment may be stored in a computer connected to a network such as the Internet, and may be provided by being downloaded via the network. Also, the program executed by the security system of this embodiment may be provided or distributed via a network such as the Internet.

Further, the program of the present embodiment may be configured so as to be pre-installed in a ROM or the like and provided.

The program executed by the security system of the present embodiment includes the above-described units (person authentication unit 111, follower unit 112, action recognition unit 113, judgment unit 114, restraint announcement unit 115, cooperation information notification unit 116, sales promotion announcement unit 117 ) is a module configuration. A CPU (processor) reads out and executes a program from the storage device, thereby loading the above units onto the main storage device. As a result, a person authentication unit 111, a follower unit 112, an action recognition unit 113, a judgment unit 114, a suppression announcement unit 115, a cooperation information notification unit 116, and a sales promotion announcement unit 117 are generated on the main storage device.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.

1 ... server,
101...CPU, 102...ROM, 103...RAM,
104... Communication I/F, 105... Display unit, 106... Operation unit,
110... control unit,
111... Person authentication unit, 112... Follower unit, 113... Action recognition unit, 114... Judgment unit,
115... Suppression announcement unit, 116... Cooperation information notification unit, 117... Sales promotion announcement unit,
120... Storage unit, 121... Person list, 122... Advertising information,
130...Warning setting information 131-134...Table 140...Entering person storage unit
2 ... camera,
3 … Signage,
301...CPU, 302...ROM, 303...RAM, 304...Communication I/F,
305... Display unit, 306... Operation unit, 307... Speaker, 320... Storage unit,
4 … electronic shelf label,
5 ... clerk terminal,
501...CPU, 502...ROM, 503...RAM, 504...Communication I/F,
505... Display unit, 506... Operation unit, 507... Speaker, 520... Storage unit,
6 ... store controller,
7 ... router,
8, 9... network.

JP 2021-073595 A

Claims (7)

A person authentication unit that performs face authentication so that an individual can be identified from the image captured by the camera installed in the store;
a tracking unit that tracks the person authenticated by the person authentication unit using an image captured by a camera installed in the store;
a sales promotion announcement unit that announces information related to sales promotion to people in the store by at least one of screen display and sound using a device installed in the store;
A behavior recognition unit that recognizes suspicious behavior of a person in the store from images captured by a camera installed in the store;
a deterrence announcement unit that uses the device located near the person who has behaved suspiciously and is recognized by the action recognition unit to announce information about the product related to the behavior and information guiding the purchase of the product;
security system. a judging unit that judges the level of caution to be taken with respect to the person who has performed the behavior according to the degree of suspicion of the behavior recognized by the behavior recognizing unit, and causes the deterrent announcement unit to announce information according to the level; The security system of claim 1, further comprising: 3. The determination unit according to claim 2, wherein when the behavior recognition unit further recognizes suspicious behavior of the person targeted for the notification after the notification is made by the deterrent announcement unit, the determination unit increases the warning level of the person. security system. 4. The method according to any one of claims 1 to 3, further comprising a cooperation information notification unit that transmits information about a person who has performed suspicious behavior recognized by the behavior recognition unit to a terminal device that notifies information directed to a salesclerk. security system. 5. The security system according to any one of claims 1 to 4, wherein the deterrence announcement unit uses the device to announce the captured image including the suspicious behavior recognized by the behavior recognition unit. The deterrent announcement unit notifies information by using a digital signage installed for announcing sales promotion information and an electronic shelf label installed on a display shelf for displaying merchandise to display the price of the merchandise as the devices. Item 6. The security system according to any one of Items 1 to 5. A person authentication function that recognizes the face so that an individual can be identified from the image captured by the camera installed in the store,
a tracking function that tracks a person authenticated by the person authentication function with an image captured by a camera installed in the store;
A sales promotion announcement function that notifies information related to sales promotion to people in the store by at least one of screen display and sound using a device installed in the store;
A behavior recognition function that recognizes suspicious behavior of people in the store from images captured by cameras installed in the store,
a deterrence announcement function that uses the device located near the person who has behaved suspiciously and is recognized by the action recognition function to announce information related to the product related to the behavior and information guiding the purchase of the product;
A program for realizing the security system computer.

Images