JP7250264B2 - Security device, vending machine or information providing device, and program - Google Patents

Description

The present invention relates to a crime prevention device and a crime prevention device that are installed in various devices that provide goods and services to unspecified people, such as vending machines and information providing devices, to prevent crimes from occurring around the devices. The present invention relates to a vending machine or an information providing device equipped with the device, and a program.

2. Description of the Related Art For example, the security device disclosed in Patent Document 1 is known as a security device that is installed in various devices that provide products and services to arbitrary users, such as a vending machine, and monitors the surroundings of the installed vending machine.

JP 2017-138678 A

In recent years, various devices such as vending machines and information providing devices that provide products and services to arbitrary users are installed in various places where unspecified people come and go, regardless of whether they are in downtown areas or residential areas. ing. If a vending machine is provided with a crime prevention function like the crime prevention device described in Patent Document 1, a crime can be prevented or even if a crime occurs, without securing a separate place for installing the crime prevention device. can be notified as soon as possible.

However, conventional security devices such as the security device of Patent Document 1 are in the form of constantly displaying the image of the security camera installed in the vending machine on the vending machine, and the vending machine in which the security device is installed. This is to announce around the vending machine that the vending machine has a crime prevention function. With such a conventional crime prevention device, people in the vicinity can sense that various devices such as vending machines equipped with the crime prevention device are photographing the surroundings. There was a problem that crime could not be effectively prevented when it was done.

The present invention has been made in view of the above problems. An object of the present invention is to provide a security device capable of preventing acts, a vending or information providing device equipped with the security device, and a program.

In order to solve such a problem, the security device according to the invention of claim 1 displays a predetermined image for an arbitrary user, obtains an image of the user on which the predetermined image is displayed, and / Or various devices that perform interactive services that provide predetermined goods or services by outputting a predetermined voice to the user and acquiring the voice uttered by the user to whom the predetermined voice is output a crime prevention device provided in a security device, comprising: a photographing unit for photographing the user and constantly photographing the surroundings of the various devices; and based on the image photographed by the photographing unit Detecting information necessary for providing the interactive service, and performing a predetermined analysis based on preset or stored predetermined criteria for judging the presence or absence of a criminal act. A video analysis unit that detects the occurrence of a criminal act in the vicinity of the various devices, a warning unit that performs a predetermined warning process when the occurrence of the criminal act is detected, and a video necessary for the interactive service. A video output unit for outputting a warning video as the predetermined warning process, and outputting a sound necessary for the interactive service and performing a warning sound output process as the predetermined warning process and an audio output unit , and the video analysis unit generates a judgment model machine-learned using videos of past criminal acts and videos of past criminal acts taken as training data. It is characterized in that the occurrence of the criminal act is detected by analyzing the photographed image using a predetermined criminal act determination criterion.

According to a second aspect of the invention, in the configuration according to the first aspect, the crime prevention device further comprises a communication unit that communicates with a communication unit that communicates via a predetermined communication network, and when the criminal act is detected, It is characterized by comprising a criminal act reporting unit that transmits crime detection information indicating that the crime has been detected by the communication unit.
A vending machine or an information providing device according to the invention of claim 3 is characterized by comprising the security device according to claim 1 or 2 .
A computer-readable program according to the invention of claim 4 causes a computer to function as the security device according to claim 1 or 2 .

According to the configuration of the present invention, the crime prevention device installed in various equipment as a device for providing a predetermined product or service to any user analyzes the images constantly photographed around the various equipment to detect a crime. The occurrence of an act is detected, and predetermined warning processing is performed when the occurrence of the criminal act is detected. With this configuration, by installing the security device of the present invention in various devices installed in various places where unspecified people come and go, it is possible to effectively prevent criminal acts in the vicinity of the various devices.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram conceptually showing an overall configuration of a security device according to an embodiment and a vending machine as an example of various devices; 4 is a flowchart conceptually showing the flow of processing of the security device according to the embodiment; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram conceptually showing a security device 100 according to an embodiment of the present invention and a vending machine 200 as an example of "various devices" in which the security device 100 is installed.

As shown in FIG. 1, security device 100 includes photographing unit 101, video analysis unit 102, warning unit 103, audio output unit 104, video output unit 105, communication unit 106, and criminal activity reporting unit 107. , and a recording unit 108 .

"Various devices" in this embodiment are devices for providing goods and services to arbitrary people, and are installed in places where unspecified people come and go, It is a device that automatically provides specific goods and services to users of "Various equipment" refers to the user's operation by pressing the operation button, touching the touch panel, voice input into the microphone, etc., and the movement and movement of the user's face, facial expressions, and lips photographed by a CCD camera or other imaging device. automatically provide prescribed products and services using the analysis results, etc.

"Various equipment" in this embodiment includes image information obtained by photographing a user's face and figure with a photographing device, voice information uttered by a user into a microphone, and predetermined information provided in "various equipment". Acquire information on user operations on operation means (for example, the user touches the touch panel of "various devices", presses the operation buttons of "various devices", and inputs operations on the keyboard of "various devices"). By analyzing the acquired information and presenting the answer information to the user by displaying images and characters, outputting voice, etc., the products and services desired by the user are automatically provided. "Various equipment" has a mechanical configuration, an electrical configuration, and an information processing configuration for providing goods and services in such a manner.

The "various devices" of this embodiment provide products and services to users using so-called interactive services. Specifically, "various devices" display characters and images on a display (not shown), and output sound from a speaker (not shown) to ask questions or prompt information input from users. and the procedure of acquiring and analyzing the user's contact with the touch panel, pressing of the operation button, keyboard operation information, and user's voice information uttered by the user. provide the products and services desired by the user.

"Various devices" in this embodiment are provided with so-called artificial intelligence (AI). "Various devices" are configured to provide interactive services to users and to provide predetermined products and services.

Specifically, for example, "various devices" use various machine learning methods such as deep learning, and record data given in advance as so-called teacher data (for example, predetermined input data and predetermined correct data). Then, a predetermined training procedure based on this training data (for example, a computer is repeatedly made to learn that predetermined correct data is the correct answer for predetermined input data, and the computer learns unknown input data. The computer can output the correct answer even for unknown input data by "supervised learning" or a predetermined training procedure without supervised data. It is configured so that predetermined products and services can be provided by providing interactive services to users through "unsupervised learning" of the training procedure to be used.

The “various devices” are also used to function as the crime prevention device 100 in a configuration for performing interactive services and providing predetermined products and services. For example, the "various devices" can be trained by using the above-mentioned "supervised learning" or "unsupervised learning" to provide images of criminal acts taken in the past and videos taken of a state in which no criminal acts were committed in the past. By performing the above-described training procedure as data, the "various devices" are set so as to be able to detect criminal acts performed by unspecified persons in the vicinity of the "various devices". This setting is mainly performed for the video analysis unit 102, which will be described later. Also, the settings for reporting a criminal act by the above-described "supervised learning" or "unsupervised learning" may be performed for the warning unit 103 and the criminal act reporting unit 107, which will be described later.

"Various equipment" in this embodiment includes, for example, vending machines for providing food and drink, daily necessities, etc., ticket vending machines for selling various tickets and tickets, roads to destinations that users want to go. Automatic information service provision equipment as an "information provision device" for introducing information and facilities, products and services that meet the user's desired conditions, copiers and printers installed for use by unspecified users , a washing machine, a dryer, and the like.

The places where unspecified people come and go, where the "various devices" of this embodiment are installed, include, for example, downtown areas, residential areas, parks, railway station premises and squares around stations, airport and port premises. and surrounding plazas, inside and around shops and department stores, in and around the premises of movie theaters, museums, various theme parks and amusement parks, in and around the premises of amusement facilities such as game centers, community centers and concert halls In and around the premises of public facilities such as, on and around public roads and private roads, parking areas on expressways, drive-ins along public roads, commercial facilities and rest facilities along public roads including so-called "roadside stations", etc. can be considered.

Hereinafter, in this embodiment, "various devices" are assumed to be the vending machine 200 in order to simplify the explanation. It cannot be overemphasized that it is not limited only to.

In this embodiment, security device 100 is configured using a built-in computer installed inside the body of vending machine 200 . In this embodiment, a secondary storage device of a computer incorporated in the vending machine 200 stores in advance a program for executing a process described later. The program is read from the secondary storage device and loaded into the memory, A CPU (Central Processing Unit) executes the computer to function as the security device 100 according to the present embodiment.

In this embodiment, as described above, the security device 100 is configured using an embedded computer, but the configuration of the security device 100 may be arbitrarily selected. For example, the security device 100 and the vending machine 200 may not be separable, and the control device (not shown) of the vending machine 200 may also serve as the security device 100 .

The photographing unit 101 constantly photographs the surroundings of the vending machine using the photographing device 203 of the vending machine 200 described later. A video image captured by the imaging unit 101 may be a still image or a moving image. The captured video is recorded in the recording unit 108 (to be described later) and analyzed by the video analysis unit 102 .

In the present embodiment, the image capturing unit 101 of the security device 100 uses the image capturing device 203 included in the vending machine 200 to capture an image of the surroundings of the vending machine. For example, the crime prevention device 100 is equipped with a photographing device (for example, for photographing the face and figure of the user who uses the vending machine 200 in order to provide the user with products using an interactive service). ) may be provided.

Also, the image captured by the image capturing unit 101 may be an image including sounds around the vending machine 200 . In this case, for example, if the photographing device 203 provided in the vending machine 200 has a voice input function, the voice input by the voice input function may be used, or the security device 100 or the vending machine 200 may is further equipped with a voice input device, and inputs voice around the vending machine from the voice input device. may be recorded in the recording unit 108.

The image analysis unit 102 detects a criminal act in the vicinity of the vending machine 200 by analyzing the image captured by the image capturing unit 101 described above. Predetermined criteria for judging criminal activity are set or recorded in advance in the security device 100, and the video analysis unit 102 analyzes the video based on the criteria for judging criminal activity. do.
The criteria for judging a criminal act in the present embodiment are obtained by using a machine-learned judging model using images of criminal acts taken in the past and images taken of a state in which no criminal acts were committed in the past as teacher data. there is Any well-known technique may be selected as to how the criminal activity criteria are created, set or recorded.

The warning unit 103 performs predetermined warning processing when a criminal act is detected around the vending machine 200 by the video analysis unit 102 described above. In this embodiment, as the predetermined warning processing, output processing of warning sound by the audio output unit 104 and output processing of warning video by the video output unit 105 are performed.

The audio output unit 104 outputs warning audio using the audio output device 202 provided in the vending machine 200 . The warning sound to be output may be, for example, a warning sound such as a siren, or may be a sound notifying that a criminal act is being committed. Further, in the present embodiment, the voice output unit 104 uses the voice output device 202 of the vending machine 200 to output the warning voice. Alternatively, the security device 100 may include an audio output device.

The image output unit 105 uses the display device 201 included in the vending machine 200 to output a warning image. The image to be output may be arbitrarily selected. For example, a predetermined warning mark may be displayed, or a detected criminal act may be displayed as an image. Alternatively, the display device 201 may flash to indicate that a criminal act is taking place around the vending machine. In the present embodiment, video output unit 105 uses display device 201 of vending machine 200 to output the warning video. The device 100 may be configured to include a display device, and the security device 100 may be installed in the vending machine 200 so that the display device can be visually recognized from the surroundings.

In the present embodiment, both the output of the warning sound by the audio output unit 104 and the output of the warning video by the video output unit 105 are used as predetermined warning processing, but the predetermined warning processing may be arbitrarily selected. , the output of a warning sound from the audio output unit 104 or the output of a warning video from the video output unit 105 may be performed.

The communication unit 106 communicates with a security server 400, which will be described later, via a communication network 300, which will be described later. Communication by the communication unit 106 may be wired communication or wireless communication.

When the video analysis unit 102 detects a criminal act in the vicinity of the vending machine 200, the criminal act reporting unit 107 transmits crime detection information indicating that the criminal act has been detected. Criminal act reporting unit 107 in the present embodiment transmits the crime detection information to security server 400 via communication network 300, which will be described later, by communication unit 106 described above. The format and contents of the crime detection information may be arbitrarily selected. For example, the crime detection information may be information obtained by adding the detection date and time and place as metadata to a video in which a criminal act is detected.

The recording unit 108 is a storage that records information necessary for the security device 100 to perform processing, which will be described later. In this embodiment, as described above, the security device 100 is configured using an embedded computer, and the recording unit 108 is an area secured in the secondary storage device provided in the embedded computer. Note that the logical configuration of the recording unit 108 may be arbitrarily selected from well-known techniques. For example, it may be configured to use an area secured in a secondary storage device as a file or directory space, or , the secured area may be used to construct a database.

The vending machine 200 is a vending machine that provides a given product or service to any user. The object to be provided by the vending machine 200 may be, for example, foodstuffs such as canned beverages, commodities such as predetermined admission tickets or train tickets, or services such as exchange or photography.

A vending machine 200 according to this embodiment includes a display device 201 , an audio output device 202 , and an imaging device 203 .

The display device 201 is a display device provided on the front side of the main body of the vending machine 200, and displays arbitrary images. In this embodiment, a predetermined warning image is output by the image output unit 105 described above, but in a situation where the image analysis unit 102 does not detect a criminal act, the content of the product or service to be sold is displayed. .

The voice output device 202 is a speaker device provided in the vending machine 200 and outputs arbitrary voice. In this embodiment, the audio output unit 104 described above outputs a predetermined warning sound. Alternatively, it outputs a voice announcing how to operate the vending machine 200 and the like.

In this embodiment, security device 100 is connected to communication network 300 . A security server 400 is also connected to the communication network 300 , and as described above, the criminal act reporting unit 107 of the security device 100 transmits crime detection information to the security server 400 via the communication network 300 via the communication unit 106 . Send. Security server 400 in the present embodiment is a server provided by a predetermined security company for receiving crime information from the outside.

The above is the overall configuration of the security device 100 and the vending machine 200 provided with the security device 100 according to the present embodiment.

Next, the flow of processing of the security device 100 according to this embodiment will be described. FIG. 2 is a flowchart conceptually showing the flow of security processing by security device 100 provided in vending machine 200 in this embodiment. 2 is started when the security device 100 is activated and ends when the security device 100 is stopped.

The crime prevention device 100 uses the imaging unit 101 to capture an image of the surroundings of the vending machine 200 using the imaging device 203 of the vending machine 200 (see step S101).

When the captured image satisfies a predetermined condition, the security device 100 records the captured image in the recording unit 108 (see step S102), and the image capturing unit 101 repeats image capturing. This repetition is performed while the security device 100 is in operation, and as a result, the photographing unit 101 constantly photographs the surroundings of the vending machine 200 . Note that the imaging unit 101 repeats imaging asynchronously with the processes after step S102, that is, without waiting for the completion of the processes after step S102.

The conditions for recording in step S102 may be arbitrarily selected. In the present embodiment, the predetermined condition is that the shooting time exceeds one minute, and the image of the surroundings of the vending machine 200 constantly shot is recorded in the recording unit 108 every minute, and is input to subsequent processing. used as a value.

The image recorded in step S102 described above is analyzed by the image analysis unit 102 of the security device 100 to detect any criminal activity occurring around the vending machine 200 (see step S103).

In the present embodiment, as described above, a judgment model obtained by machine learning using images of past criminal acts and images of a state in which no criminal acts were committed in the past as teacher data is used as the judgment model for criminal acts. Predetermined criminal act determination criteria for determining the presence or absence are preset or recorded in the security device 100 in advance. In step S103, the image recorded in step S102 is analyzed using the set or recorded criminal act determination criteria to detect the occurrence of a criminal act.

When the occurrence of a criminal act is detected in step S103, the security device 100 causes the warning unit 103 to perform predetermined warning processing. In the present embodiment, the above-described predetermined warning processing includes warning audio output processing by the audio output unit 104 (see step S104) and warning video output processing by the video output unit 105 (see step S105). On the other hand, if the occurrence of a criminal act is not detected in step S103, the processing after step S104 is not performed. By repeatedly executing steps S101 to S102 as described above, step S103 is executed each time step S102 is completed, and it is determined whether or not step S104 and subsequent steps are executed.

In this embodiment, in step S104, the voice output unit 104 of the security device 100 outputs a predetermined warning voice to the voice output device 202 provided in the vending machine 200. FIG. Further, in step S105, the image output unit 105 of the security device 100 outputs a predetermined warning image to the display device 201 provided in the vending machine 200. FIG.

In this embodiment, the warning sound output process in step S104 and the warning video output process in step S105 are executed in parallel at the same timing. It should be noted that the warning audio output process and the warning video output process may be executed in parallel, or either one may be executed first and then the other may be arbitrarily selected, and the start timings of both may be the same. You may also choose arbitrarily whether or not Further, the warning sound output process in step S104 and the warning video output process in step S104 are executed while criminal acts are detected as a result of the video analysis in step S103, and the warning process ends when criminal acts are no longer detected. do.

When the occurrence of a criminal act is detected in step S103, the security device 100 causes the criminal act reporting unit 107 to transmit crime detection information in parallel with the warning processing in steps S104 and S105 (see step S106). ).

As described above, in the present embodiment, security device 100 is connected to security server 400 via communication network 300, and in step S106, criminal activity reporting unit 107 reports criminal activity in step S103 via communication unit 106. to the security server 400, indicating that the crime has been detected.

As described above, the crime detection information may be information in any format. For example, it may be information including the video recorded in step S102 and information indicating the date and time and location of the recording. Only the information indicating date and time and place may be used as the crime detection information. In this case, for example, the security server 400 that has received the crime detection information requests the security device 100 to send an image as necessary, and the security device 100 responds to the request via the communication unit 106 and receives the request. The captured image may be transmitted to the security server 400 .

The above is the processing flow of the security device 100 according to the present embodiment. In this embodiment, the image capturing unit 101 of the crime prevention device 100 continuously captures images of the surroundings of the vending machine 200, the captured image is analyzed by the image analysis unit 102, and when the occurrence of a criminal act is detected, the warning unit 103 Predetermined warning processing is performed. With this configuration, it is possible to effectively prevent criminal acts in the vicinity of the vending machine 200 provided with the security device 100 .

In the above, when the warning process by the warning unit 103 is performed, a warning image is output to the display device 201 of the vending machine 200, and a warning sound is output to the audio output device 202. If not, that is, in a state where the occurrence of a criminal act is not detected, the display device 201 and the voice output device 202 function as normal functions of the vending machine 200, and output introductions, recommendations, operation instructions, etc. of products and services. do. According to this configuration, unless a criminal act is detected, it is unknown to the surroundings that the vending machine 200 has a crime prevention function. can be effectively prevented.

Although the description of the present embodiment is as above, the configuration of the present invention is not limited to the above embodiment. For example, in the present embodiment, security device 100 is provided inside the main body of vending machine 200 , but security device 100 may be provided outside the main body of vending machine 200 , or automatically via communication network 300 . You may make it connect with the vending machine 200. FIG.

In the above-described embodiment, video analysis unit 102, warning unit 103, and criminal act reporting unit 107 of vending machine 200 with interactive function are assumed to perform processing using so-called artificial intelligence. may perform processing using so-called artificial intelligence, or conversely, at least one of the above configurations performs processing by a normal computer system instead of processing using so-called artificial intelligence. may

Other specific configurations are not limited to this embodiment, and various modifications are possible without departing from the scope of the present invention.

100 security device 101 imaging unit 102 video analysis unit 103 warning unit 104 audio output unit 105 video output unit 106 communication unit 107 criminal act reporting unit 200 vending machine (various devices)
201 display device 202 audio output device 203 imaging device 300 communication network 400 security server

Claims (4)

Displaying a predetermined image to an arbitrary user and obtaining a video of the user on which the predetermined image is displayed, and/or outputting a predetermined sound to the user and outputting the predetermined sound A security device installed in various equipment that performs an interactive service that provides a predetermined product or service by acquiring the voice uttered by the user , wherein
a photographing unit for photographing the user and constantly photographing the surroundings of the various devices;
Based on the image captured by the image capture unit, information necessary for providing the interactive service based on the image captured of the user is detected, and a pre-set or pre-stored criminal act is detected. A video analysis unit that detects the occurrence of a criminal act in the vicinity of the various devices by performing a predetermined analysis based on a predetermined criminal act determination criterion for determining the presence or absence;
a warning unit that performs a predetermined warning process when the occurrence of the criminal act is detected;
a video output unit that outputs a video necessary for the interactive service and outputs a warning video as the predetermined warning process;
A voice output unit that outputs a voice necessary for the interactive service and outputs a warning voice as the predetermined warning process ,
The video analysis unit applies a judgment model machine-learned using video of a past criminal act and video of a state in which no criminal act was committed in the past as teacher data, based on the predetermined criminal act judging criteria. A security device that detects the occurrence of the criminal act by analyzing the video that has been photographed using a security device. The security device further includes a communication unit that communicates via a predetermined communication network, and when the criminal act is detected, the communication unit transmits crime detection information indicating that the criminal act has been detected. Have a criminal activity reporting unit
The security device according to claim 1, characterized in that: A vending machine or an information providing device comprising the security device according to claim 1 or 2. A computer-readable program that causes a computer to function as the security device according to claim 1 or 2.

Images