JP7330126B2 - Vending machines and person-finding systems - Google Patents

Description

The present invention relates to technology related to vending machines and technology related to person search.

Vending machines for selling products such as beverages are installed and used all over the country. In recent years, vending machines are increasingly equipped with cashless payment functions and corresponding payment devices. The settlement function includes, for example, a settlement function using an IC card such as Suica (registered trademark), a settlement function using a camera and a QR code (QR: Quick Response, registered trademark), and the like.

On the other hand, in order to search for a specific person such as a missing person or a wanted criminal, a person search system configured using surveillance cameras, computers, etc. is used. Japanese Patent Laying-Open No. 2004-126711 (Patent Document 1) is cited as a prior art example related to person search. Japanese Patent Laid-Open No. 2002-200000 describes that a person search system is provided that can easily search for a specific person from among a large number of people in a short time, and that: This person search system has a plurality of monitoring cameras installed at a plurality of locations in a facility, a plurality of monitoring terminals, and a server. Images from surveillance cameras are stored on a server. The server compares the face image of the search request information with the face image of the person in the stored video, extracts the video in which the lost child is shown, and transmits it to the monitoring terminal. The monitoring terminal displays search results.

JP 2004-126711 A

In the human search system of the prior art example such as that disclosed in Patent Document 1, each monitoring camera must be connected to a server, and the installation locations of each monitoring camera, server, etc. are also limited. Since the human search system of the prior art example has a limited installation range, the search range in which a human search is possible is also limited.

In addition, conventionally, searching for a person basically requires search work by personnel such as the police and supervisors, which increases the workload and costs.

SUMMARY OF THE INVENTION An object of the present invention is to provide a technology related to person search, which can widen the search range and realize person search with low workload and low cost.

A representative embodiment of the present invention has the following configuration. A vending machine according to an embodiment includes a product display unit having a product purchase button, a payment device for inputting payment information when a person facing the product display unit purchases the product, and a purchase button. a control device that performs control for providing the product based on the operation information and the payment information; a lighting device; When doing so, the lighting device and the photographing device are controlled to acquire a photographed image of the person, and data including the image is stored.

According to the representative embodiments of the present invention, in the technology related to person search, the search range can be widened, and person search can be realized with low workload and low cost.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the structure of the person search system of Embodiment 1 of this invention. 2 is a diagram showing a functional block configuration of the vending machine of Embodiment 1; FIG. 4 is a diagram showing an example of a processing sequence in the person searching system of Embodiment 1; FIG. 1 is a schematic side view of the vending machine or the like of Embodiment 1. FIG. FIG. 5 is a schematic side view of a vending machine or the like in a modified example of Embodiment 1; FIG. 10 is a diagram showing an example of a processing sequence in the person search system according to Embodiment 2 of the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In principle, the same reference numerals are given to the same parts in all the drawings, and repeated explanations are omitted.

(Embodiment 1)
A person searching system and a vending machine according to a first embodiment of the present invention will be described with reference to FIGS. 1 to 4. FIG.

The person search system of Embodiment 1 shown in FIG. 1 and the like is a system that enables person search using a plurality of vending machines 1 installed all over the country. As the vending machine 1, a general vending machine can be applied. This vending machine 1 captures an image of the person 5 under the control of the lighting device 102 and the imaging device 4 as the person 5 who faces the vending machine 1 purchases a product. In particular, this person search system uses the payment function provided in the vending machine 1 and the corresponding payment device 3 to control the person search. The payment device 3 controls the lighting device 102 and the photographing device 4 to brightly illuminate the face of the person 5 and photograph it when the person 5 facing the person 5 makes a payment or the like. In particular, the payment device 3 selects one or more lighting devices from the lighting devices 102 of the product display unit 103 and controls them to light up with a predetermined illuminance.

The settlement device 3 of the vending machine 1 compares the photographed image with the image of the search target set in advance from the server 2, and determines whether the facing person 5 corresponds to the search target. An estimation judgment is automatically made, and judgment result information is stored. The determination result information is information indicating that the person to be searched is in the vicinity of this vending machine 1 or has purchased the item. If the determination result information indicates that there is a match, the vending machine 1 transmits notification data including an image and payment information to the server 2 at a predetermined destination in real time. As a result, the person search system of Embodiment 1 can realize a person search in a wide search range using a vending machine network with low workload and low cost.

[Person search system]
FIG. 1 shows the configuration of a person search system according to the first embodiment. The person searching system of Embodiment 1 includes a plurality of vending machines 1 which are the vending machines of Embodiment 1, a server 2 which is a person searching server, and a settlement server 6, which are connected to communication including the Internet. They are connected via a network 7. It has a server 2 and a management PC 8 as an upper management system for a plurality of vending machines 1 via a communication network 7 . Server 2 and management PC 8 are connected by LAN 9 . Although one vending machine 1 is shown in FIG. 1, vending machines all over the country can have the same configuration. The person 5 is assumed to be a person who purchases a product using the vending machine 1, and includes a person to be searched, such as a missing person.

The vending machine 1 has a control device 100 , a product display unit 103 , a lighting device 102 , a payment device 3 , a photographing device 4 , a cash payment unit 104 and a product provision unit 105 . The vending machine 1 includes a control device 100 , a product storage section, a power supply section (not shown), and the like in a housing 101 . A product display unit 103, a payment device 3, a photographing device 4, a cash payment unit 104, and a product provision unit 105 are arranged on the front surface of the housing 101 so as to be exposed.

The control device 100 manages products such as beverages, and controls the provision of products from the product providing unit 105 based on purchase button operation information, payment information, and the like. The control device 100 is configured by an electronic circuit board or the like, and is a controller that controls the vending machine 1 . The control device 100 provides the product from the product providing unit 105 in response to the person 5 pressing the product purchase button (see FIG. 4 described later) and the payment operation to the payment device 3 or the cash payment unit 104 .

The product display section 103 includes a plurality of products (corresponding product advertisements) and purchase buttons for each product. The lighting device 102 illuminates the product group of the product display section 103 . In particular, the lighting device 102 is installed in the product display section 103 . In this example, lighting device 102 comprises a plurality of LED lighting devices. The lighting devices 102 are provided as a plurality of lighting devices in a plurality of rows, for example, corresponding to the rows of products (FIG. 4 to be described later). The control device 100 performs basic control such as lighting and extinguishing of the lighting device 102 . In this example, each lighting device can be individually controlled to turn on/off and control the illuminance.

One or more photographing devices are provided as the photographing device 4 at predetermined positions on the front surface of the vending machine 1 . In this example, the payment device 3 is provided with the photographing device 4 . One photographing device 4 is installed above the payment device 3 between the product display unit 103 and the payment device 3 in the height direction of the housing 101 . Note that the photographing device 4 may be integrated with the settlement device 3, may be provided in the vending machine 1 separately from the settlement device 3, or may be externally attached later.

The settlement device 3 inputs settlement information related to settlement when the person 5 purchases a product, and appropriately communicates with the settlement server 6 to perform settlement processing. The settlement device 3 is a part having a function of accepting and processing a settlement that does not require cash, in other words, a cashless settlement. The payment device 3 accepts payment by a contactless IC card 15 having a payment function, for example, a transportation IC card such as Suica. A person 5 may have an IC card 15 with a cashless payment function. When making a payment using the IC card 15, the person 5 holds the IC card 15 over the payment device 3 (reading unit 33 in FIG. 2). The settlement device 3 reads identification information and the like from the IC card 15 and inputs settlement information including the settlement amount and the like.

The payment device 3 may also have a function of accepting payment using a user terminal such as a smartphone and a code such as a QR code. For example, in the case of settlement corresponding to a settlement method using a QR code, particularly a store scan method, the settlement device 3 captures, for example, the QR code displayed on the display screen of the smartphone held by the person 5 with the photographing device 4. do. Then, the payment device 3 decodes the QR code from the photographed image and performs payment processing. The photographing device 4 provided in such a settlement device 3 can be used for photographing for person search.

The payment device 3 cooperates with the payment server 6 according to the payment function. The payment server 6 is a server that communicates with the payment device 3 to perform payment processing. Business operators that provide payment services manage the payment server 6 . The payment device 3 appropriately communicates with the payment server 6 during payment processing, and transmits payment information input from the IC card 15 or the like to the payment server 6 . The payment server 6 performs payment processing using the payment information received from the payment device 3 , stores the payment information D<b>4 , and transmits a payment response to the payment device 3 . Depending on the payment function, cooperation with the payment server 6 may not be required.

The server 2 is a person search server that communicates with the settlement device 3 of the vending machine 1 and performs processing related to person search. The server 2 has a predetermined destination for person search, such as a communication address or URL. In addition to the server 2, a predetermined destination for person search, such as a police server or telephone number, may be set. Also, a management PC 8 or the like of a searcher 10 is connected to the server 2 via a LAN 9 or the like. The searcher 10 is a person who operates the management PC 8 and performs person search work or monitoring and management related to the person search.

The server 2 sets and retains management information D1 for each vending machine 1 in a database (DB) or the like in advance. The management information D1 includes identification information (ID) of each vending machine 1 (or payment device 3), communication address information, position information on a map (for example, information such as latitude and longitude by GPS), and the like.

In addition, the server 2 sets and retains the search target person data D2 in a DB or the like in advance. The search target person data D2 is information about a specific person who is a search target, and includes, for example, known information such as name, sex, age, height, and region, and image data showing the face. . For example, search target person data D2 is registered in the server 2 from the management PC 8 via the LAN 9 based on the operation of the management PC 8 by the searcher 10 . Further, based on the search target person data D2, data including the image of the search target is transmitted in advance from the server 2 to the payment device 3 of each vending machine 1 via the communication network 7. FIG. As a result, search target person data D31 (FIG. 2) is set in the settlement device 3 of each vending machine 1. FIG.

Further, when the server 2 receives notification data regarding the person to be searched from the payment device 3 of the vending machine 1, the server 2 stores the notification data D3 in the DB or the like. The notification data is data indicating that it is estimated that the person to be searched is in the vicinity of the vending machine 1 .

Note that the configuration is not limited to that shown in FIG. 1, and for example, a configuration in which the server 2 and the settlement server 6 are integrated may be used. A settlement function installed in a user terminal such as a smart phone may be used instead of the IC card 15 .

The vending machine 1 detects a state in which a person 5 faces the front side by any means. For example, the state may be detected from the operation of the product purchase button, or the state may be detected from the operation of payment to the payment device 3 . Alternatively, the state may be detected based on confirmation of the monitor image of the photographing device 4, or the state may be detected using a human sensor (a sensor that detects the person 5) or the like. The control device 100 or the payment device 3 controls lighting and photographing as control for searching for a person, triggered by the detection of the facing state of the person 5 .

The payment device 3 controls the lighting device 102 to select and light one or more LED lighting devices at the above-mentioned trigger, and brightly illuminates the face of the person 5 by setting the predetermined illuminance. The settlement device 3 controls the lighting and also controls the photographing device 4 to photograph an image showing the face of the person 5 facing the person. After that, the settlement device 3 compares the photographed image with the preset image of the person to be searched, makes a determination, stores the result, and transmits notification data to the server 2 .

Vending machine 1 has communication means with communication network 7 . In particular, the payment device 3 has a communication unit 34 (FIG. 2) capable of communicating with the communication network 7 including wireless communication, and can communicate with the server 2 and the payment server 6 via the communication network 7. . Each vending machine 1 and server 2 can communicate with each other. Based on the search target person data D2, the search target person data including the image of the search target is notified in advance from the server 2 to the settlement device 3 of each vending machine 1 via the communication network 7 and set. be done. Also, from the payment device 3 side, notification data including a photographed image can be uploaded and registered in the server 2 . Based on the notification data, the server 2 can output to the management PC 8 information indicating that the person to be searched is in the vicinity of the vending machine 1, and an alert or notification to that effect. The searcher 10 can confirm such information by looking at the display screen of the management PC 8 . The output is not limited to display, and sound or light emission may be used. The searcher 10 can efficiently search for a person by using the support provided by this system.

[Functional block configuration]
FIG. 2 shows a functional block configuration example of the vending machine 1 of FIG. The vending machine 1 has the above-described control device 100 , product display unit 103 including illumination device 102 , photographing device 4 , payment device 3 , cash payment unit 104 , and product provision unit 105 . The settlement device 3 and the control device 100 are connected by a communication line 201 and can communicate with each other. The settlement device 3 and the imaging device 4 are connected by a communication line 202 and can communicate with each other. Although not shown, each unit is connected by a communication line or the like.

The product display section 103 includes, for example, four LED lighting devices arranged in four rows as the lighting device 102 . The control device 100 and the settlement device 3 can control lighting/lighting out and illuminance of each lighting device. The payment device 3 brightly illuminates the face of the person 5 facing the product display unit 103 by controlling the lighting device 102 when photographing.

The imaging device 4 includes an imaging unit 41 and a storage unit 42 . The photographing unit 41 controls a camera to photograph an image. The image may be a single still image or a plurality of continuous images. The storage unit 42 stores image data obtained by the imaging unit 41 . The control unit 31 of the payment device 3 controls the imaging unit 41 of the imaging device 4 through the communication line 202 .

The control device 100 acquires product purchase selection information based on the operation of the purchase button ( FIG. 4 ) of the product display unit 103 . In addition, the control device 100 acquires payment information (information indicating that the purchase price of the product has been paid) from the cash payment unit 104 or the payment device 3 . The control device 100 controls the provision of products from the product storage unit to the product provision unit 105 based on the selection information and payment information.

The settlement device 3 has a control unit 31, a storage unit 32, a reading unit 33, a communication unit 34, and the like, which are interconnected via a bus or the like. The control unit 31 is configured using a CPU (central control unit), ROM, RAM, etc., and constitutes a controller of the settlement apparatus 3 . The control unit 31 has a function of performing program processing, and realizes a settlement function by this function. The storage unit 32 is composed of a nonvolatile memory or the like. Various data and information handled by the control unit 31 are stored in the storage unit 32 . The storage unit 32 stores search target person data D31, image data D32, payment information D33, notification data D34, and the like.

The reading unit 33 is a part that reads identification information and the like from the held IC card 15 or the like and inputs payment information. The input and processed payment information is stored in the storage unit 32 as payment information D33. The settlement device 3 uses the communication unit 34 to communicate with the settlement server 6 and transmits settlement information to the settlement server 6 as necessary. In addition, the settlement device 3 notifies the control device 100 of the settlement information of the settlement result.

The communication unit 34 is a part that performs communication processing with the settlement server 6 and the server 2 via the communication network 7 . For example, the payment device 3 receives data including an image of a search target from the server 2 in advance, and stores the data in the storage unit 32 as search target person data D31.

The control unit 31 of the settlement device 3 controls the imaging device 4 to obtain an image captured by the imaging device 4 through the communication line 202 and stores it in the storage unit 32 as image data D32. The control unit 31 compares the image showing the face of the person 5 in the image data D32 with the image of the search target in the search target person data D31, estimates whether the person 5 corresponds to the search target, and makes a determination. Store the result information. When the control unit 31 estimates that the person 5 is highly likely to be the person to be searched, the control unit 31 creates notification data D34 including the photographed image of the person 5 and stores the notification data D34 in the storage unit 32 . Then, the control unit 31 uses the communication unit 34 to transmit the notification data D34 to the server 2 .

It should be noted that the configuration is not limited to the configuration example shown in FIG.

[sequence]
FIG. 3 shows a sequence of processing, etc., in the person search system of the first embodiment. This sequence includes the flow of operations and processes between the control device 100 of the vending machine 1 and the settlement device 3, the server 2, the settlement server 6, etc., and has steps S1 to S10.

First, as described above, the search target person data D2 (FIG. 1) is registered in the server 2 in advance. In step S1, data including an image of a search target is transmitted from the server 2 to the settlement device 3 of each vending machine 1, and set as search target person data D31 (FIG. 2).

In step S2, the control device 100 of the vending machine 1 and the settlement device 3 enter a standby state when the person 5 is not around the vending machine 1. FIG. The standby state of step S2 continues until a person is detected in step S3.

At step S3, the vending machine 1 detects by any means a state in which the person 5 is approaching and faces the product display section 103 or the like on the front surface of the housing 101. FIG. In particular, the payment device 3 detects the facing state of the person 5 by any means. Specific examples of this means are as follows.

As a first example, the payment device 3 detects an operation (corresponding selection information) of pressing the purchase button of the product display unit 103 through the control device 100 . This purchase button operation corresponds to the state in which the person 5 is facing the product display section 103 .

As a second example, the settlement device 3 detects a settlement operation using the IC card 15 or the like (for example, reading by the reading unit 33 in FIG. 2). This settlement operation corresponds to the state where the person 5 is in front of the settlement device 3 .

As a third example, if the vending machine 1 is equipped with a sensor such as a human sensor or a proximity sensor (for example, an infrared sensor or an ultrasonic sensor), the sensor may be used. The control device 100 detects the state of the person 5 facing or approaching the front surface of the housing 101 using the sensor. The payment device 3 recognizes the detection through the control device 100 .

As a fourth example, a monitor image captured by the photographing device 4 may be used. In other words, the camera of the photographing device 4 may be used as the sensor. The control device 100 or the settlement device 3 controls the photographing device 4 to set the photographing device 4 to monitor photographing mode all the time, periodically, or at a predetermined trigger (for example, detection by the above-described motion sensor or the like), and the monitor photographing mode. Allow an image (eg, a sequence of images) to be captured. Note that this monitor image is for detecting the surrounding situation, and is different from the person search image. The settlement device 3 or the control device 100 simply confirms the content of the monitor image captured by the imaging device 4 and determines whether or not the person 5 is present on the front side of the housing 101 . This determination does not require detailed image processing.

Triggered by the detection of the facing state of the person 5 by the above-described means, the settlement device 3 performs processing including photographing for subsequent person search. In the example of FIG. 3, in step S3, the payment device 3 exchanges payment information with the payment server 6 (step S3b) in response to the payment operation by the person 5, and thereafter searches for the person. Perform related processing.

In step S<b>4 , the payment device 3 first controls lighting of the lighting device 102 of the product display section 103 . This lighting control is control for forming a suitable lighting condition for photographing for person search, and is control for sufficiently brightly illuminating the face of the person 5 . The settlement device 3 sends the lighting device 102 (or the control device 100) a lighting control instruction for searching for a person. The payment device 3 may indirectly perform this lighting control through the control device 100 . For example, the settlement device 3 selects one or more lighting devices to be lit from among the plurality of LED lighting devices of the lighting device 102, and designates the illuminance of the lighting devices to be lit. The lighting device 102 lights according to the given instructions. As a result, the light emitted from the illumination device 102 also illuminates the vicinity of the face of the person 5 on the front side (FIG. 4). The payment device 3 obtains a response from the lighting device 102 (or the control device 100) that the indicated lighting state has been reached.

Subsequently, in step S5, the payment device 3 controls the photographing device 4 to start and execute one photographing for person search. The payment device 3 sends a photographing control instruction to the photographing device 4 through the communication line 202 . The photographing device 4 photographs an image showing the face of the person 5 according to the instruction. The settlement device 3 obtains the photographed image from the photographing device 4 and stores it in the storage unit 32 as image data D32 (FIG. 2).

In step S6, the settlement device 3 easily confirms whether or not the photographed image has content suitable for later collation (step S8), in other words, whether or not an image with appropriate brightness and the like has been obtained. ,To check. This confirmation is, for example, confirmation of whether or not the brightness (luminance of the corresponding pixel) in the captured image is sufficient, for example, whether or not it is equal to or greater than a threshold. Alternatively, this confirmation may be confirmation of whether or not a face-like region is included in the image. As a result of this confirmation, if the image is suitable (Y), the process proceeds to step S8, and if the image is unsuitable (N), the process proceeds to step S7.

In step S7, the payment device 3 again controls and adjusts the illumination state of the illumination device 102 for the purpose of photographing again. That is, the settlement device 3 determines the lighting device to be turned on, the illuminance, etc., and sends an instruction to the lighting device 102 . For example, in the second shooting, the number of lighting LED lighting devices may be increased or changed, or the illuminance may be increased. After adjusting the lighting in step S7, the process returns to step S5, and in that state, the second photographing is performed in the same manner. It should be noted that it is possible to repeat the photographing up to several times in the same manner, and if a suitable image cannot be obtained even after several times of photographing, it may be regarded as an error result. It should be noted that the control of steps S4 to S7 can be completed while the person 5 is facing him by performing it at a sufficiently high speed.

After that, in step S8, the payment device 3 compares the above-described suitable image with the image of the search target set in the search target person data D31, and the facing person 5 corresponds to the search target. Make an estimation judgment of whether or not. For this collation, for example, a process of extracting features in each image, comparing the features, and determining whether or not the degree of similarity is equal to or greater than a threshold can be applied as image processing. As a result of step S8, if it is determined in step S9 that there is a match (in other words, there is a high possibility that the person is the person to be searched) (Y), the process proceeds to step S10, and if it is determined that there is no match (N). , the process returns to step S2.

In step S10, the settlement apparatus 3 creates notification data D34 (FIG. 2) based on the determination result information, and transmits the notification data D34 to the server 2 at the predetermined destination. Notification data D<b>34 includes information indicating that there is a high possibility that the person to be searched was in the vicinity of this vending machine 1 . In addition, the notification data D34 includes the photographed image (image data D32), the photographing date and time, the ID of this vending machine 1, and the payment information D33.

In particular, if payment information is included in the notification data, the payment information and information associated with it, such as user registration information held by the payment service provider, will be used to search for the person to be searched. can do. As a result, it can be expected to increase the possibility of finding and specifying a person to be searched, and to improve the efficiency of search work. Note that the data to be notified to the server 2 may be only information indicating that the person is likely to be the person to be searched, and the photographed image and payment information may be omitted. Further, the notification data may include the location information of this vending machine 1 . Further, when the shooting date and time are included in the notification data, for example, the payment device 3 may use time information from its own clock, may acquire time information from the control device 100, or may obtain the time information from the communication unit 34. (FIG. 2) may be used to acquire the time information from the communication network 7 .

Although omitted in the above sequence, if the payment in step S3 is completed normally, the product is provided from the product providing unit 105, so the person 5 can take out the product from the product providing unit 105 and obtain it.

As a detailed example of the settlement process in step S3, when a settlement method using a QR code is used, the flow is as follows. A person 5 who is a user may use a payment method using a smart phone or a QR code for the advantage of giving points or the like. At the time of payment, the person 5 displays the QR code on the display screen of his/her smart phone and holds it over the payment device 3. - 特許庁The settlement device 3 captures the QR code on the display screen of the smartphone using the camera of the imaging device 4, recognizes and decodes the QR code, and obtains information. The settlement device 3 configures settlement information based on the obtained information and performs settlement processing.

[Lighting and photography (1)]
FIG. 4 is a schematic side view of the vending machine 1 and the like according to Embodiment 1, and shows an example of a detailed configuration when a person 5 purchases a product and is photographed for searching for a person. FIG. 4 shows an example of the arrangement configuration of the lighting device 102 and the photographing device 4 on the front side of the vending machine 1 . In the product display section 103, for example, products (corresponding product advertisements) 400 are arranged in three rows, and correspondingly, a purchase button 401 for each product 400 is provided. Correspondingly, the lighting devices 102 are arranged, for example, as four LED lighting devices in four rows so as to sandwich the product 400 in the height direction. In this example, the lighting devices are arranged at positions Z21, Z22, Z23, and Z24 in the height direction.

Each lighting device has an illumination range that covers the direction of the product 400 and the forward direction (indicated by the dashed line), and this range is, for example, about 180 degrees in the vertical direction. For example, when the person 5 who is an adult purchases a product, his/her face generally faces the lighting device 102 and the purchase button 401 of the product display section 103 . A lighting range including the forward direction is irradiated with light with a predetermined illuminance from the lighting device. As a result, even if the surroundings of the vending machine 1 are in a dark state such as at night, the face of the person 5 can be illuminated brightly. As a result, it becomes easier to obtain an image suitable for collation/determination of the person to be searched.

The photographing device 4 is arranged at a predetermined position Z4 below the product display section 103 and above the position Z3 of the payment device 3 in the height direction. The optical axis of the photographing range of the photographing device 4 faces forward as indicated by the dashed-dotted line. This photographing range has a predetermined angle α (angle of view in the vertical direction in FIG. 4) centered on the optical axis. This angle α is ensured as a sufficient angle so that the main human body parts including the face of the person 5 facing the front side of the housing 101 can be photographed. The angle α is preferably close to 180 degrees.

As an example of the operation when purchasing a product, the person 5 approaches the housing 101 and faces the front, sees the product 400 on the product display section 103, and presses the purchase button 401. FIG. Next, the person 5 looks at the settlement device 3 and holds the IC card 15 over the settlement device 3 (reading unit 33 in FIG. 2). The settlement device 3 reads information from the IC card 15 and inputs settlement information. Triggered by this payment operation, the payment device 3 controls the lighting device 102 and the photographing device 4 to obtain an image showing the face of the person 5 . Then, the settlement device 3 performs verification and notification processing as described above. The control device 100 provides the product 402 from the product providing unit 105 based on the operation information of the purchase button 401 and the payment information. Person 5 takes out product 402 from product providing unit 105 .

Not only the example of FIG. 4, but also when the photographing device 4 and the lighting device 102 are located at other positions, the control for person search can be similarly applied. For example, the photographing device 4 may be arranged inside the product display section 103 or on the upper side, right and left of the product display section 103, or the like. Further, the control device 100 or the payment device 3 may perform control to change the number, position, illuminance, etc. of lighting devices among the lighting devices 102 according to the detected state of the person 5 .

[Lighting and photography (2)]
The following are also examples of lighting and photographing control for person search. Similarly, FIG. 4 will be used for explanation. In FIG. 4, four LED lighting devices are arranged in the product display section 103 at positions Z21, Z22, Z23, and Z24 in the height direction. The payment device 3 selects an illumination device to be turned on or an illumination device with a higher illuminance than the other illumination devices from the plurality of illumination devices at the time of photographing for searching for a person. For example, the payment device 3 selects one or more lighting devices close to the height position of the purchase button 401 pressed by the person 5 . The payment device 3 may turn on only the selected lighting device, or may set the selected lighting device to have a higher illuminance than the other lighting devices. For example, in FIG. 4, when the person 5 presses the product purchase button 401 in the second row from the top, the settlement device 3 moves the position Z22 in the second row from the top of the four rows or the position Z23 in the third row from the top. Select at least one lighting device.

Further, for example, when the payment device 3 detects that the person 5 is bringing his/her face or hand closer to the payment device 3 for the payment operation, the one of the plurality of lighting devices closer to the payment device 3 is turned on. More than one lighting device may be selected, for example the lighting device at the lowest position Z24.

Further, for example, the settlement device 3 roughly estimates the height position of the face or the line-of-sight direction of the person 5 using the monitor image captured by the photographing device 4 in the above-described monitor photography mode, and estimates the estimated face position. The lighting device or the like to be turned on may be selected according to the height position or the like.

[Lighting and photography (3)]
FIG. 5 shows an example of controlling lighting and photographing for person search in a modified example. In this modified example, photographing devices 4A and 4B are provided as the two photographing devices 4 on the front portion of the housing 101 . In particular, in this example, two imaging devices 4 (4A, 4B) are arranged at two positions, an upper position Z41 and a lower position Z42 in the product display section 103. FIG. In this example, the housing 101 is provided with a human sensor 501 for power saving control and the like, and the human sensor 501 can also be used for searching for a person.

The settlement device 3 selects the photographing device 4 to be used for photographing for person search according to the detection of the person 5 and the estimated position of the face, and controls the photographing together with the control of the lighting device 102 . In this modification, the settlement device 3 selects one camera 4 to be used for photographing from among a plurality of (two) camera 4 (4A, 4B) in response to the detection of the facing person 5. may For example, if the estimated height position of the face based on the movement of the person 5 or the monitor image is above a predetermined threshold value, the payment device 3 selects the photographing device 4A at the upper position Z41, If it is below the threshold, the imaging device 4B at the lower position Z42 may be selected.

In addition, the settlement device 3 may acquire a plurality of images simultaneously using a plurality of photographing devices 4 in response to detection of the facing person 5 . For example, the settlement device 3 confirms two images obtained by simultaneously photographing with the two photographing devices 4 (4A, 4B) (step S6 described above), and selects a suitable image for verification. may be used.

4 and 5, the direction of the optical axis of the photographing device 4 is the forward direction (in other words, the horizontal direction). The direction of the optical axis of the photographing device 4 may be set in a direction inclined upward or downward with respect to the horizontal direction. Similarly, the illumination direction may be set in advance for the illumination device 102 as well. In addition, a plurality of lighting devices and a plurality of photographing devices may be provided not only in the height direction but also in the left and right direction of the housing 101, and the configuration may be such that they are controlled.

[Effects, etc.]
As described above, according to the person search system and the vending machine 1 of the first embodiment, the search range can be made wider than the conventional system using surveillance cameras or the like, and the person search can be performed with low workload and low cost. can. According to this person search system, a wide search range can be realized by using a network of a plurality of vending machines 1 all over the country. According to this person search system, it is possible to search for a person in real time by automatic photographing, notification, etc., even during a time zone in which it is difficult to perform search work conventionally. According to this person search system, since the vending machine 1 can be used, personnel involved in search work (police officers, police dogs, etc.) can be eliminated or reduced. According to this person search system, as the person 5 purchases a product at the vending machine 1, a suitable image is taken, and based on the image, the whereabouts of the person to be searched can be estimated and obtained in real time. It is possible to deal with it by notifying a predetermined destination.

In particular, according to this person search system, the lighting device 102 provided in advance in the vending machine 1 is controlled and used as lighting for person search. As a result, there is no need to additionally install a separate lighting device in each vending machine 1, which can be realized at low cost. In particular, according to this person search system, the photographing device 4 can be controlled by the payment device 3 provided in the vending machine 1, and an image can be photographed as the person 5 purchases a product. As a result, there is no need to additionally install a separate photographing device in each vending machine 1, which can be realized at low cost.

This vending machine 1 can implement the person search function with minimal changes from conventional general vending machines. The main changes are only additions or modifications of functions in the settlement device 3 . The vending machine 1 does not require a special sensor or the like to implement the person search function, and can be realized at low cost.

[Modification]
The following is possible as a modification of the first embodiment. In Embodiment 1, the vending machine 1 takes an image, stores the image data, and performs collation and notification. It is good also as a structure and it is good also as a structure which performs collation. A worker involved in service of the vending machine 1 may read and collect data stored in the vending machine 1 . Further, in Embodiment 1, the configuration in which the settlement device 3 mainly performs the control related to the person search is shown, but the configuration is not limited to this, and a configuration in which the control device 100 performs the control related to the person search is also possible. .

In a modification, a lighting device for searching for a person (referred to as a second lighting device) may be provided separately from the lighting device 102 (referred to as a first lighting device) of the product display section 103 . The settlement device 3 controls the second lighting device to brightly illuminate the face of the person 5 when photographing for person search. In this modified example, although the cost of the second lighting device is required, it is easy to set lighting suitable for searching for a person with the second lighting device.

In Embodiment 1, while payment information is transmitted from the payment device 3 of the vending machine 1 to the payment server 6, notification data including the payment information is transmitted from the payment device 3 to the server 2. , but not limited to. In a modified example, notification data that does not include payment information may be transmitted from the payment device 3 to the server 2 . In another modification, the payment information and notification data may be transmitted from the payment device 3 to the payment server 6 , and the notification data may be transmitted from the payment server 6 to the server 2 .

In the first embodiment, an example of application to cashless payment has been described, but when the person 5 pays in cash using the cash payment unit 104 (FIG. 1, etc.), the control for person search is similarly applied. It is possible. For example, when the control device 100 or the settlement device 3 detects that the person 5 has made a settlement using the cash settlement unit 104, the control device 100 or the settlement device 3 similarly controls lighting and photographing for searching for the person.

As a modification, the control device 100 of the vending machine 1 or the payment device 3 uses an illuminance sensor or the like to detect and determine the state of brightness around the vending machine 1, particularly in the vicinity of the front surface, Accordingly, the illuminance or the like of the illumination device 102 may be controlled during photographing for person search. The payment device 3 controls the lighting device 102 to the first illuminance when the surroundings are bright, for example, when the brightness is equal to or higher than a predetermined brightness threshold, and when the surroundings are dark, for example, when the brightness is less than the threshold, the illumination Device 102 may be controlled to a second illumination that is higher than the first illumination. As another modified example, the control of the lighting device 102 may be omitted when the surroundings are sufficiently bright.

As a modification, the configuration of the product display unit 103 may be of a type that uses a display screen of a display device. Even in this case, the control for person search described above can be similarly applied. That is, in this case, instead of controlling the illumination device 102 described above, the brightness of the display screen of the display device may be controlled. For example, the payment device 3 may be controlled to temporarily increase the brightness of the display screen when photographing for person search.

(Embodiment 2)
A person search system and a vending machine according to Embodiment 2 of the present invention will be described with reference to FIG. In Embodiment 1, each vending machine 1 performs image collation processing, but the present invention is not limited to this. In the second embodiment, the server 2 performs image collation processing.

FIG. 6 shows a sequence example in the person searching system of the second embodiment. This sequence has steps S21 to S31. In step S21, search target person data D2 (FIG. 1) is registered in the server 2 in advance. In the second embodiment, there is no need to notify and set the search target person data D31 (FIG. 2) to the vending machine 1 side. Steps S22 to S27 are the same as steps S2 to S7 in FIG. 3 in the first embodiment. The settlement device 3 controls the lighting device 102 and the photographing device 4 based on the detection of the person 5, and obtains a suitable image for searching for the person.

In step S28, the settlement apparatus 3 creates notification data D34 (FIG. 2) including a suitable image obtained by photographing, and transmits the notification data D34 to the server 2 at a predetermined destination. The notification data at this time includes the ID of the vending machine 1 and the shooting date and time, but does not include the determination result information as in the first embodiment.

In step S29, the server 2 stores the notification data received from the vending machine 1 in the DB, compares the image extracted from the notification data with the image of the search target in the search target person data D2, A determination is made as to whether or not the person 5 photographed by the aircraft 1 corresponds to the person to be searched. The server 2 stores the determination result information in the DB. In step S30, the server 2 determines that there is a match, that is, if there is a high possibility that the person 5 corresponds to the person to be searched (Y), in step S31, the server 2 sends information to that effect to the management PC 8 of the searcher 10. to output If there is no match in step S30 (N), step S31 is omitted. After that, the server 2 returns to the state of waiting for notification data from the vending machine 1 before step S29.

As described above, according to the person search system of Embodiment 2, in addition to obtaining the same effects as those of Embodiment 1, since image matching processing is performed on the server 2 side, the load of the matching processing is relatively high. However, it can be realized quickly and efficiently. In the settlement device 3, implementation of a function for matching processing of images can be omitted.

Although the present invention has been specifically described above based on the embodiments, the present invention is not limited to the above-described embodiments, and can be variously modified without departing from the scope of the invention.

DESCRIPTION OF SYMBOLS 1... Vending machine 2... Server 3... Payment device 4... Photographing device 5... Person 6... Payment server 7... Communication network 8... Management PC 9... LAN 10... Searcher 15... IC card 100 Control device 101 Case 102 Lighting device 103 Merchandise display unit 104 Cash payment unit 105 Merchandise providing unit D1 Management information D2 Search target person data D3 Notification data, D4: payment information.

Claims (6)

A vending machine for selling beverages,
a product display unit having a purchase button for a product that is a beverage ;
a payment device for inputting payment information when a person facing the product display unit purchases the product;
a control device that performs control to provide the product based on the purchase button operation information and the payment information;
a lighting device including one or more lighting devices that illuminate the product in the product display section ;
a photographing device that can be used when inputting payment information to the payment device ;
with
When the person purchases the product, the payment device acquires an image of the person by controlling the lighting device and the photographing device, and stores data including the image,
The payment device detects a state in which the person faces the product display section by using the operation of the purchase button, the operation of the payment device, the monitor image by the imaging device, or a sensor that detects the person, Triggered by the detection of the state in which the person is facing, the lighting device and the photographing device are controlled to photograph the image;
The payment device controls lighting and illuminance of the one or more lighting devices so as to illuminate the face of the person facing the product display unit during the photographing,
The payment device compares the photographed image with a pre-stored image of the person to be searched, determines whether the person corresponds to the person to be searched, and stores determination result information. , sending notification data including the determination result information to a predetermined destination server, or sending notification data including the photographed image to a predetermined destination server;
The payment device transmits the notification data including the payment information to the server.
vending machine. The vending machine according to claim 1,
The control device or the payment device checks the captured image, and if the image is inappropriate, changes the state of lighting and illuminance of the lighting device and redoes the capturing.
vending machine. The vending machine according to claim 1,
The photographing device has a photographing device used for settlement using a QR code as a photographing device provided in the settlement device,
The payment device controls a photographing device used for payment using the QR code to photograph the image when the payment is made using the QR code.
vending machine. The vending machine according to claim 1,
The photographing device has two photographing devices, a first photographing device installed at a position above the product display section and a second photographing device installed at a position below the product display section. death,
In response to the detection of the person, the payment device selects one of the two photographing devices as the photographing device to be used for photographing when the estimated height position of the person's face is above a threshold value. selects the first imager, and if below a threshold, selects the second imager;
vending machine. A person search system having a vending machine that sells beverages and a server,
The vending machine
a product display unit having a purchase button for a product that is a beverage ;
a payment device for inputting payment information when a person facing the product display unit purchases the product;
a control device that performs control to provide the product based on the purchase button operation information and the payment information;
a lighting device including one or more lighting devices that illuminate the product in the product display section ;
a photographing device that can be used when inputting payment information to the payment device ;
with
When the person purchases the product, the payment device acquires an image of the person by controlling the lighting device and the photographing device, and stores data including the image,
The payment device detects a state in which the person faces the product display section by using the operation of the purchase button, the operation of the payment device, the monitor image by the imaging device, or a sensor that detects the person, Triggered by the detection of the state in which the person is facing, the lighting device and the photographing device are controlled to photograph the image;
The payment device controls lighting and illuminance of the one or more lighting devices so as to illuminate the face of the person facing the product display unit during the photographing,
The payment device compares the photographed image with a pre-stored image of the person to be searched, determines whether the person corresponds to the person to be searched, and stores determination result information. , transmitting notification data including the determination result information to the server at a predetermined destination;
The payment device transmits the notification data including the payment information to the server,
The server receives and stores the notification data, and outputs the determination result information.
person search system. A person search system having a vending machine that sells beverages and a server,
The vending machine
a product display unit having a purchase button for a product that is a beverage ;
a payment device for inputting payment information when a person facing the product display unit purchases the product;
a control device that performs control to provide the product based on the purchase button operation information and the payment information;
a lighting device including one or more lighting devices that illuminate the product in the product display section ;
a photographing device that can be used when inputting payment information to the payment device ;
with
When the person purchases the product, the payment device acquires an image of the person by controlling the lighting device and the photographing device, and stores data including the image,
The payment device detects a state in which the person faces the product display section by using the operation of the purchase button, the operation of the payment device, the monitor image by the imaging device, or a sensor that detects the person, Triggered by the detection of the state in which the person is facing, the lighting device and the photographing device are controlled to photograph the image;
The payment device controls lighting and illuminance of the one or more lighting devices so as to illuminate the face of the person facing the product display unit during the photographing,
The payment device transmits notification data including the photographed image to the server at a predetermined destination,
The payment device transmits the notification data including the payment information to the server,
The server receives and stores the notification data, compares the photographed image with a pre-stored image of the person to be searched, and determines whether the person corresponds to the person to be searched. , storing judgment result information, and outputting the judgment result information;
person search system.

Images