JP2012232075A - Commodity transaction device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To transact a commodity without causing trouble.SOLUTION: In commodity transaction devices 10, 11 which transact commodities taken out by a transactor from among a plurality of kinds of the commodities which are displayed so as to be taken out in a store, there are provided: a transactor imaging means 11 which images the transactor; a takeout operation recognizing means 111 which recognizes the takeout operation for taking out the commodities on the basis of the imaged image; a taken-out commodity-specifying means 102 which specifies the commodities taken out by the transactor who has performed the takeout operation on the basis of the recognition result of the takeout operation; a transaction commodity storage means 105 which stores the specified commodities as the transaction commodities; and a payment means 102 which settles accounts of magnitudes of transaction values of the stored transaction commodities.

Description

  The present invention relates to a commodity transaction apparatus for performing commodity transactions in a store.

  2. Description of the Related Art Conventionally, in a game hall that is a store, a player who exchanges prizes as a product transaction is one in which a player himself designates a product by directly operating it without going through a store clerk (see, for example, Patent Document 1). ).

Japanese Patent Laid-Open No. 2007-117777

  However, in Patent Document 1, although the player himself can designate a product without going through the store clerk, the player is a person who is unaccustomed to the operation of the apparatus, such as when the player is an elderly person, for example. In some cases, it takes time to operate and the device is congested, resulting in confusion, incorrect operation resulting in malfunction of the device, or replacement with an undesired product. In some cases, this may cause confusion.

  The present invention has been made paying attention to such problems, and an object of the present invention is to provide a commodity transaction apparatus capable of performing commodity transactions without causing confusion.

In order to solve the above-described problem, a commodity transaction apparatus according to claim 1 of the present invention provides:
Merchandise transaction apparatus (transaction device) for transacting merchandise taken out by a trader (player, store clerk) among a plurality of types of merchandise (freebies) that are installed in a store (game hall) and displayed in the store Free gift exchange computer 10, 10 '),
A supplier image pickup means (image pickup units 11, 12, 13) for picking up an image of the supplier;
An extraction operation recognition unit (operation recognition processing board 111) for recognizing an extraction operation for extracting the product based on an image captured by the transaction imaging unit;
Based on the recognition result of the take-out operation by the take-out operation recognizing means, take-out product specifying means (a portion where the CPU 102 performs step Sb1 or step SB1) for specifying the product taken out by the trader who has performed the take-out operation;
Transaction product storage means for storing the product specified by the extracted product specification means as a transaction product (a premium exchange correspondence table or a room management table in the storage device 105);
A settlement means (a portion where the CPU 102 performs the checkout process in step S14 or step SS16) for settlement of the transaction value of the transaction product stored in the transaction product storage means;
It is characterized by having.
According to this feature, the trader can recognize the take-out operation only by taking out the product to be traded without operating the merchandise transaction apparatus, and the product taken out by the take-out operation is specified, and the trade product Since it will be stored and settled as a person, even those who are unfamiliar with the operation of the device can easily conduct product transactions, so it becomes possible to carry out product transactions without causing confusion, Product transactions can be made more efficient.

A commodity transaction apparatus according to means 1 of the present invention is the commodity transaction apparatus according to claim 1,
The trader is a store clerk who takes out merchandise in accordance with a player's instruction from a display shelf (display shelf 14) displayed so that the player can see in a game hall as a store.
According to this feature, even if the display shelf is a large display space so that the player can indicate various products that match his / her preference, the player can instruct and take out the display shelf. It is possible to eliminate the hassle of inputting the merchandise from the display location of the merchandise to the installation location of the device one by one, and the labor of the sales clerk in the merchandise transaction at the amusement hall can be significantly reduced.

The commodity transaction apparatus of means 2 of the present invention is the commodity transaction apparatus described in means 1,
Clerk determination means for determining whether or not the trader who has performed the take-out operation recognized by the take-out movement recognition means (motion recognition processing board 111) is a clerk registered in advance (the part where the CPU 102 executes step Sb0). When,
On the condition that the store clerk judging means determines that the trader is not a pre-registered store clerk (No in step Sb0), the take-out abnormality notifying means for notifying the occurrence of the take-out by a person other than the store clerk (the CPU 102 performs illegal take-out in step S9 A part for carrying out the notification process), and
It is characterized by having.
According to this feature, since it is notified that a product other than a store clerk registered in advance has taken out the product, that is, an unauthorized product is taken out, it is possible to take an appropriate response to the removal of the unauthorized product.

The commodity transaction apparatus of means 3 of the present invention is the commodity transaction apparatus according to claim 1,
The merchandise transaction according to claim 1, wherein the trader is a player who takes out desired merchandise from display shelves (display shelves A to D) displayed so as to be able to be taken out at a game hall as a store. apparatus.
According to this feature, the player can examine the products that he / she wants to trade up close, so that not only can the occurrence of product mistakes be remarkably reduced, but also the trouble of instructing the store clerk about the products he / she wishes to trade. Can be resolved.

The commodity transaction apparatus of means 4 of the present invention is the commodity transaction apparatus described in means 3,
A moving direction specifying means for specifying a moving direction of a trader (player) who has recognized the picking-up operation by the picking-up action recognizing means (specifying a moving direction of a player who has entered the room from a moving route stored in the action recognition processing board 111) Part)
Announcement of occurrence of abnormal behavior on condition that the moving direction specified by the moving direction specifying means (the direction in which the user leaves the prize exchange room) is a direction corresponding to a predetermined abnormal action (illegal take-out of goods) Abnormal behavior occurrence notification means (a portion where the CPU 102 performs the illegal take-out notification process in the leaving person confirmation process of step SS15);
Comprising
It is characterized by that.
According to this feature, it is notified of illegal product takeout (shoplifting) due to movement in the direction corresponding to abnormal behavior, for example, exit direction, so take appropriate measures against these illegal product takeout Can do.

The commodity transaction apparatus of means 5 of the present invention is the commodity transaction apparatus according to any one of claim 1 or means 1 to means 4, wherein
Based on images captured by the transaction imaging unit (imaging units 11, 12, and 13), transaction identification unit (an integrated circuit for face authentication (IC) on the motion recognition processing substrate 111) that individually identifies the transaction )
The transaction merchandise storage means (the prize exchange correspondence table or the occupant management table in the storage device 105) stores the transaction merchandise for each trader (for each clerk ID or occupant ID),
The settlement means is a transaction product stored for each trader in the trade product storage means (a merchandise ID stored in a gift exchange correspondence table or a room management table associated with a store clerk ID or a room resident ID). Settle the transaction value (exchange amount) of the product)
It is characterized by that.
According to this feature, it is not necessary to install a commodity transaction apparatus for each individual transaction person, so that not only can the burden of introducing a store be reduced, but each commodity transaction apparatus can store and settle transaction products of the same transaction person. Duplicate implementation can be avoided reliably.

The commodity transaction apparatus of means 6 of the present invention is the commodity transaction apparatus according to any one of claim 1 or means 1 to means 5, wherein
Value that can be used for transactions with the above-mentioned product, and can be used to identify the size (usable amount) of ownership value owned by the customer (player) who is the trader who receives the product. Receiving a recording medium (counting card, membership card) in which specific information (for example, card ID) is recorded, recording medium processing means (card reader / writer 15, 15a-c),
Whether or not the value of the ownership value specified from the ownership value specifying information read by the recording medium processing means is equal to or greater than the total value of the transaction values of the transaction products stored in the transaction product storage means Ownership value determination means for determining (whether or not the available balance is negative) (a portion where the CPU 102 executes step Sb5 or step SC7);
Insufficient value notifying means for notifying that the transaction is impossible due to the lack of the value of possession under the condition determined by the owned value determining means to be not more than the total (part where the CPU 102 executes step Sb7 or step SC14). When,
Comprising
It is characterized by that.
According to this feature, whether the total transaction value of the traded products that can be taken out can be settled with the magnitude of the value owned by the customer, that is, whether the product is taken out excessively. Since it becomes possible to accurately grasp whether or not, it is possible to improve the efficiency of the commodity transaction by taking out the commodity so that these notifications are not made.

The commodity transaction apparatus of means 7 of the present invention is the commodity transaction apparatus according to claim 1 or any one of means 1 to means 6,
A return action recognition means (action recognition processing board 111) for recognizing a return action for returning the merchandise taken out by the take-out action based on the image picked up by the trader image pick-up means with respect to the picked-up trader; ,
Based on the recognition result of the return action by the return action recognition means, return merchandise specifying means for specifying the merchandise returned by the trader who performed the return action (
CPU 102 performs step Sd1 and SD1),
Return product erasure means (a portion where the CPU 102 executes step Sd4 or step SD4) for erasing the storage of the product specified by the return product specification means from the transaction product storage means;
It is characterized by having.
According to this feature, by returning a part of the extracted product, the memory as the transaction product of the returned product is deleted, so there is no need to return all the extracted products and retrieve them again. Therefore, the efficiency of merchandise transactions can be improved.

It is a perspective view which shows the prize exchange counter of the game hall where the merchandise transaction apparatus in Example 1 was applied. It is a block diagram which shows the structure of the goods transaction apparatus of Example 1. FIG. (A) is a figure which shows the radiation | emission area | region of the infrared radiation pattern in Example 1, (b) is explanatory drawing which shows the infrared radiation pattern in Example 1. FIG. (A) is a figure which shows the merchandise management table memorize | stored in the prize exchange computer which comprises the merchandise transaction apparatus in Example 1, (b) is the storage box position memorize | stored in the prize exchange computer. It is a figure which shows an information table, (c) is a figure which shows the prize exchange log | history data memorize | stored in the computer for prize exchange. (A) is a figure which shows the registration shop assistant table memorize | stored in the prize exchange computer which comprises the goods transaction apparatus in Example 1, (b) is the prize exchange correspondence memorize | stored in the prize exchange computer. It is a figure which shows a table. It is a flowchart which shows the processing content of the prize exchange process in the prize exchange computer which comprises the goods transaction apparatus of Example 1. FIG. It is a flowchart which shows the processing content of the card | curd acceptance process in the computer for prize exchange which comprises the goods transaction apparatus of Example 1. FIG. It is a flowchart which shows the processing content of the taking-out merchandise registration process in the premium exchange computer which comprises the merchandise transaction apparatus of Example 1. FIG. It is a flowchart which shows the processing content of the return merchandise registration deletion process in the prize exchange computer which comprises the merchandise transaction apparatus of Example 1. FIG. It is a flowchart which shows the processing content of the payment process in the computer for prize exchange which comprises the goods transaction apparatus of Example 1. FIG. It is a figure which shows the prize exchange room of the game hall where the merchandise transaction apparatus in Example 2 was applied. It is a block diagram which shows the structure of the goods transaction apparatus of Example 2. FIG. (A)-(C) is a figure which shows the occupant management table memorize | stored in the computer for prize exchange which comprises the goods transaction apparatus in Example 2. FIG. It is a flowchart which shows the processing content of the prize exchange process in the computer for prize exchange which comprises the goods transaction apparatus of Example 2. FIG. It is a flowchart which shows the processing content of the card | curd acceptance process in the computer for prize exchange which comprises the goods transaction apparatus of Example 2. FIG. It is a flowchart which shows the processing content of the taking-out merchandise registration process in the premium exchange computer which comprises the merchandise transaction apparatus of Example 2. FIG. It is a flowchart which shows the processing content of the return merchandise registration deletion process in the prize exchange computer which comprises the goods transaction apparatus of Example 2. FIG. It is a flowchart which shows the processing content of the adjustment process in the prize exchange computer which comprises the goods transaction apparatus of Example 2. FIG.

  EMBODIMENT OF THE INVENTION The form for implementing the goods transaction apparatus which concerns on this invention is demonstrated below based on an Example. In the following embodiments, a game hall is illustrated as a store and prize exchange is illustrated as a transaction. However, the present invention is not limited to this, and the present invention is applied to stores other than a game hall that sells products as a transaction. It goes without saying that such a commodity transaction apparatus may be applied.

  FIG. 1 is a diagram showing a prize exchange counter in a game hall in which a prize exchange apparatus 1 according to the present embodiment which is a commodity transaction apparatus of the present invention is installed.

  The prize exchange counter in which the prize exchange device of the present embodiment is installed includes a horizontally long counter table 2 that divides the player side, which is a player, and the clerk side, and the counter on the clerk side (inside) of the counter table 2 A table 2 and a display shelf 14 provided at a predetermined interval are provided.

  As shown in FIG. 1, the display shelf 14 has a plurality of storage boxes 40 that can store prizes, and each storage box 40 stores the same product in a removable manner. Various prizes stored in 40 can be displayed so that a player or a store clerk can see.

  The counter table 2 has a top plate on the player side (outside) that is higher than the top plate on the store clerk side (inside), and three player displays on the top plate on the player side (outside) 16a-c are installed on the top plate on the store clerk's side (inner side) corresponding to each of the player displays 16a-c, and the membership card or counting card possessed by the player who wishes to exchange prizes Card reader / writers 15a to 15c (FIG. 2) in which a card is inserted, data (recording information) recorded on the inserted membership card or counting card is read and the data (recording information) can be rewritten. The number of stored balls or the number of acquired balls specified from data (recording information) such as a card ID read from the membership card or counting card inserted in each card reader / writer 15a-c. Owned piece count and the respective rate in the recreation who owns the information items retrieved by the clerk are to be displayed by specifying the the recreation's.

  That is, in the first embodiment, the counter table 2 includes three player displays 16a to 16c and card reader / writers 15a to 15c corresponding to the player displays 16a to 16c, so that a maximum of three players can be displayed. The player's prize exchange can be carried out simultaneously by three shop assistants corresponding to each player. However, the present invention is not limited to this, and these player displays, Only one set of card reader / writer 15 corresponding to the player display may be provided.

  In addition, at a substantially central position of the top plate on the store clerk side (inner side), a merchandise transaction apparatus is provided that can be operated by each store clerk inside the counter, and for exchanging premiums for controlling the operation of the merchandise transaction apparatus A computer 10 is installed.

  Further, as shown in FIG. 1, pattern infrared light, which is infrared light having a predetermined frequency, which is the radiation pattern shown in FIG. 3B, is shown in FIG. 3A on the ceiling above the counter table 2. As described above, by radiating toward the entire area of the front surface of the display shelf 14 and performing imaging with the pattern infrared light and imaging with visible light of the predetermined frequency, An imaging unit 11 that can capture an image for identifying a store clerk is installed.

  Next, the configuration of the merchandise transaction apparatus according to the present embodiment will be described with reference to FIG. 2. The merchandise transaction apparatus mainly includes a prize exchange computer 10 and the above-described imaging unit connected to the prize exchange computer 10. 11, display shelf 14, card reader / writers 15 a to 15 c, player displays 16 a to 16 c, and intercom communicator 17 that transmits a voice message to the wireless income 18 that is installed by each store clerk who exchanges prizes. ing.

  The wireless intercom 18 is given a unique intercom ID, and by using these intercom IDs, a voice message can be transmitted for each individual radio intercom 18 individually. Is provided with wireless income dedicated to the store clerk, and the income ID of the wireless income provided to the store clerk and attached to the store clerk is stored in association with the store clerk ID in a registered store clerk table described later. Therefore, the voice message can be transmitted only to the specific store clerk by specifying the income ID worn by the specific store clerk and transmitting the voice message to the income ID.

  The card reader / writers 15a to 15c according to the present embodiment perform a predetermined member registration at the amusement hall, so that a member game in which a stored ball that can be used again for the game can be obtained from the ball acquired in the game can be used. Accepts a membership card issued to a person or a counting card issued by counting the number of balls obtained by a ball counter (not shown), and individually records each card recorded on the membership card or the counting card. It has a reading function to read out an identifiable card ID, and has an operation unit consisting of a numeric keypad and a liquid crystal display unit on the upper surface, so that the identity of the member is confirmed when the inserted card is a member card. It has a function for accepting a PIN number, and a function for displaying various types of guidance, such as guidance for entering the PIN number and guidance for taking out returned membership cards and counting cards. To have.

  In this embodiment, in order to improve security as a membership card or counting card, a non-contact IC card in which a card ID that can individually identify each card is stored in an unrewritable manner is used. The non-contact IC card reading unit capable of at least reading the non-contact IC card is built in the inside of 15a-c, but the present invention is not limited to this, and as these membership cards and counting cards In this case, a magnetic card reading unit may be built in the card reader / writer 15.

  The card ID stored in the membership card or the counting card is a symbol string of a predetermined digit starting with KC in the case of a membership card, and a symbol string of a predetermined digit starting with VC in the case of a counting card. Thus, it is possible to determine whether the card is a member card or a counting card based on these card IDs.

  In addition, in this embodiment, the form using the counting card is illustrated, but the present invention is not limited to this, and the counter counts the number of counting balls instead of these counting cards. By issuing a receipt on which a symbolized barcode is printed and providing a barcode reading unit for reading the barcode recorded on the receipt in place of the card reader / writer 15 or together with the card reader / writer 15, The number of counting balls may be specified.

  Next, the imaging unit 11 used in this embodiment will be described. As shown in FIG. 2, the imaging unit 11 exchanges a pattern infrared light having a predetermined frequency patterned into a predetermined radiation pattern shown in FIG. 3B, as shown in FIG. 3A. Infrared light radiating portions 11a that radiate so as to spread downward toward the entire area of the front surface of the display shelf 14 installed in the counter table 2, which is the area where the store clerk to perform, and these infrared light radiating portions An infrared imaging unit 11b that performs imaging with pattern infrared light emitted from 11a, and a visible light imaging unit 11c that captures an area in front of the display shelf 14 from which pattern infrared light is emitted with normal visible light. The operation of extracting a person who is a clerk based on the pattern image (distance image) captured by the infrared imaging unit 11b, extracting each part of the person, estimating the posture based on the distance of the extracted person or part, and the like Recognition of the clerk's face image based on the visible light image corresponding to the region extracted as the human face part or the person's face part is performed by the prize exchange computer 10 (motion recognition processing board 111). .

  In this embodiment, the pattern infrared light radiated from the infrared light radiating portion 11a is arranged so that the circular light emitting areas having a predetermined figure are in a predetermined arrangement state, as shown in FIG. 3B. However, the present invention is not limited to this, and these radiation patterns indicate the operation content to be detected (necessary accuracy of operation detection) and the distance between the imaging unit 11 and the display shelf 14. What is necessary is just to use the thing suitable for etc.

  An infrared light source such as an infrared LED capable of emitting infrared light of a predetermined frequency can be suitably used for the infrared light emitting portion 11a that emits infrared light, and a large number of holes corresponding to the radiation pattern can be used. What is necessary is just to radiate | emit the light radiated | emitted from this infrared LED by making a radiation pattern using the screen etc. in which it was formed.

  The infrared imaging unit 11b includes an image sensor including an infrared filter that mainly transmits the pattern infrared light emitted from the infrared light emitting unit 11a and a charge coupled device (CCD) that images the pattern infrared light. Should be built in.

  In addition, the visible light imaging unit 211c only needs to include an image sensor that includes a visible light filter that hardly transmits infrared light and mainly transmits visible light, and a charge coupled device (CCD) that captures the visible light. .

  Next, the free gift exchange computer 10 used in this embodiment will be described with reference to FIG. 2. The free gift exchange computer 10 of this embodiment is connected to the data bus 101 for transmitting and receiving data inside the computer. A CPU (central processing unit) 102 that performs various processes performed by the replacement computer 10 based on a processing program, a RAM 103 used as a temporary storage area during processing, and a real-time output of current time information and calendar information A clock (RTC) 104, a storage device 105 composed of a magnetic disk or a magneto-optical disk, a display device 107 for displaying and outputting various information, and an input device 106 composed of a transparent touch panel, a keyboard, a mouse, etc. arranged on the front surface of the display device 107 , Print and issue receipts with details of exchange A communication unit 109 that performs data communication with the management device installed in the game hall in order to manage the number of stored balls, the number of balls to be counted, etc., the player display 16, the card reader / writer 15, The connection interface 110 to which the intercom communication device 17 is connected and the imaging unit 11 are connected, and an infrared light image and a visible light image captured by the imaging unit 11 are input, and the input captured image is displayed. On the basis of this, an operation recognition processing board 111 that identifies a clerk who provides a free gift at the free gift exchange counter, recognizes the operation of the identified clerk, and outputs various information based on the recognized operation to the CPU 102. Is a normal computer connected to.

  A ball counter that is installed at a predetermined position in the game hall to count the number of balls acquired by the player and is capable of issuing a counting card is installed in the management computer that is connected so that data communication is possible through the communication unit 109. The number of balls counted by the ball counter is stored and managed in the management computer in association with the card ID stored in the counting card read from the issued counting card. Yes. In the present embodiment, the counting card data is also recorded and issued on the counting card.

  In addition, the management computer associates the membership card ID recorded on the membership card with the membership ID, and the number of balls counted by the member on the day using a ball counter, The number of balls that do not charge a fee when used and the number of balls counted before the previous day with a ball counter and the number of stored balls that require a fee when used for a second game are managed. From the member card ID and the member ID, the number of possessed balls and the number of stored balls can be acquired from the management computer and specified. Note that the number of holding balls is updated after being added to the number of stored balls after the end of the business day.

  Note that the management computer also stores and manages information such as a personal identification number for performing identity verification in association with the card ID of the member card.

  The motion recognition processing board 111 has an image memory for storing an infrared light image and a visible light image captured by the imaging unit 11, and each of the radiation patterns included in these infrared light images (distance images). Perform image processing to analyze the interval (distance) between graphic points and the deformation status (large deformation and chipping in the contour portion), specify the distance to the subject, and the contour and shape of the subject by these analyzes, The human body included in the image and each body part of the human body are specified by comparison with the registered human body and the shape pattern of the body part of the human body, and the image analysis result (distance information and position to the person and each body part) The distance image sensor integrated circuit (IC) that outputs information, etc., and the human body posture estimation based on the image analysis result output from the distance image sensor integrated circuit (IC). And a visible light image corresponding to the region of the face part of the human body extracted by the posture estimation integrated circuit (IC) that performs motion recognition based on the estimated posture or the distance image sensor integrated circuit (IC); A face authentication integrated circuit (IC) for identifying a clerk by collating with a face image of a clerk registered in advance, and a posture estimation integrated circuit (IC) used for posture estimation, each in a different posture A posture data ROM or the like in which posture data about the human body part is stored is mounted.

  As these integrated circuits for distance image sensors (IC), for example, PS1080 (product name made by PrimeSense, USA) corresponding to “Light Coding technology” can be suitably used. As an integrated circuit for posture estimation (IC), A posture estimation program in which a posture estimation algorithm for implementing posture estimation based on the image analysis result output from the PS 1080 and posture data stored in the posture data ROM is incorporated, and has relatively high processing capability. A microcomputer can be used.

  Further, the face authentication integrated circuit (IC) determines whether or not they are the same person by comparing the face image of the visible light imaged by the imaging unit 11 with the face image of the clerk registered in advance. It is possible to use a microcomputer having a relatively excellent processing capability in which a face authentication program in which a known face authentication algorithm is programmed is incorporated.

  In this embodiment, since the posture estimation integrated circuit (IC) is highly necessary to operate in conjunction with the distance image sensor integrated circuit (IC), the posture estimation integrated circuit (IC) and the face The authentication integrated circuit (IC) is provided separately. However, the present invention is not limited to this, and if a microcomputer having sufficient processing capability can be used, these can be used. The posture estimation integrated circuit (IC) and the face authentication integrated circuit (IC) may be one microcomputer.

  In the present embodiment, as described above, the operation recognition of the store clerk is performed by radiating infrared light having a predetermined radiation pattern and capturing an image. For example, two visible light cameras are separated from each other without radiating infrared light having these radiation patterns, and the display shelf 14 is installed so as to be able to take an image. By identifying the distance from the store clerk and the attitude of the store clerk based on the parallax or the like, the operation of the store clerk may be recognized.

  When this posture estimation integrated circuit (IC) recognizes a cancel operation that crosses both arms, which is a predetermined operation set in advance, it indicates the clerk ID that performed the cancel operation and the fact that the cancel operation has been recognized. Cancel operation information including the operation ID of the cancel operation is output to the CPU 102.

  Further, when the posture estimation integrated circuit (IC) recognizes a predetermined operation set in advance, that is, an end operation of putting both hands overhead, it recognizes the clerk ID that performed the end operation and the end operation. Is output to the CPU 102.

  Further, when the posture estimation integrated circuit (IC) recognizes the take-out operation for taking out the product from the display shelf 14, which is a predetermined operation set in advance, the coordinates of the position at which the product is taken out on the display shelf 14 are patterned. Extraction operation information specified based on an infrared light image by infrared light and including the specified coordinate information, the clerk ID that performed the operation, and the operation ID of the extraction operation indicating that the extraction operation has been recognized Is output to the CPU 102.

  If the person who performed the extraction operation does not match the face image of any store clerk stored in advance in the image RAM at the time of activation, the store clerk who performed the extraction operation cannot be recognized, that is, a person other than the store clerk. If it is highly possible that the product has been taken out, the take-out operation information including predetermined data indicating a person other than the store clerk, for example, “0000” is output to the CPU 102 as the store clerk ID.

  In addition, when these take-out operations are recognized, the visible light image of the product taken out by the take-out operation is stored in the image memory until the collation result is output as will be described later, and used for the product collation. The

  Further, when the posture estimation integrated circuit (IC) recognizes a return operation for returning the product to the display shelf 14 which is a predetermined operation set in advance, the coordinates of the position where the product is returned on the display shelf 14 are displayed in the pattern red. Return operation information that is specified based on an infrared light image by outside light, and includes the specified coordinate information, the clerk ID that performed the operation, and the operation ID of the return operation indicating that the return operation has been recognized. It outputs to CPU102.

  As shown in FIG. 2, the storage device 105 includes a product management table shown in FIG. 4A and a product management table shown in FIG. The storage box position information table shown in b), the gift exchange history data shown in FIG. 4C, the registered clerk table shown in FIG. 5A, and the gift exchange correspondence table shown in FIG. 5B are stored. ing.

  In the product management table of this embodiment, as shown in FIG. 4A, various products are associated with product IDs that can be individually identified, the product classification of the product, the product name, and the product are The storage box number to be stored, the exchange amount required for the replacement of the product, and the path data to the detailed image file of the product are stored. 40, the exchange amount necessary for exchange with the product, and the path data to the detailed product image file can be specified.

  In the storage box position information table of the present embodiment, as shown in FIG. 4B, the storage box 40 is associated with the storage box number assigned to each storage box 40 on the front surface of the display shelf 14. The horizontal coordinate range on the front surface of the display shelf 14 (horizontal distance range from the reference position on the front surface) and the vertical coordinate range (vertical distance range from the reference position on the front surface), which are the existing position information, Is stored, and the coordinate information on the front surface of the display shelf 14 specified by the motion recognition based on the captured image on the motion recognition processing board 111 is output from the motion recognition processing board 111, whereby the coordinate information is A storage box 40 corresponding to the corresponding coordinate range is specified and recorded in the product management table in association with the specified storage box 40. Products being is identified as product or return goods taken out by the clerk.

  As shown in FIG. 4C, the prize exchange history data of the present embodiment is the transaction date and time when the prize exchange was performed, the card ID of the membership card or counting card used for the prize exchange, and the prize exchange used. The payment amount, which is the amount of money, the product ID of each product that has been exchanged for a free gift, and the quantity thereof are included, and the free gift exchange history data is stored upon completion of the settlement process in the free gift exchange.

  In the registered clerk table of the present embodiment, as shown in FIG. 5 (a), the clerk's name and the clerk are provided in association with the clerk IDs uniquely assigned to all the clerk of the game hall. The intercom ID of the wireless intercom 18 and the path data to the face image file including the face image of the store clerk imaged from various angles are stored. The face images taken from various angles included in these face image files and the store clerk ID are output to the motion recognition processing board 111 and stored in the mounted image RAM when the giveaway exchange computer 10 is activated. Thus, these face images are used by the face authentication integrated circuit (IC) to authenticate the face images without accessing the storage device 105, and the clerk ID of the authenticated store clerk is assigned to the face authentication integrated circuit (IC). ) Can be specified.

  In the prize exchange correspondence table of the present embodiment, information related to the exchange of prizes being handled by the store clerk is stored, and as shown in FIG. The card ID (accepting card ID) of the member card or counting card being received by the card reader / writers 15a to 15c installed in the corresponding port, and the 1 yen rate ball specified from the receiving member card or counting card Based on the number of items, the number of balls at the 4-yen rate, the amount of money that can be used for exchanging premiums based on the number of balls at the 1-yen rate and the number of balls at the 4-yen rate, The available remaining amount obtained by subtracting the necessary amount necessary for exchanging the extracted product from the available amount, the clerk ID of the clerk who is dealing with the prize exchange at the corresponding outlet, and the merchandise of the product taken out by the clerk And the ID and quantity is adapted to be stored.

  Next, a free gift exchange process performed in the free gift exchange computer 10 (CPU 102) of this embodiment will be described with reference to FIG. 6. In the free gift exchange process, as shown in FIG. 6, card reader / writers 15a to 15c. Whether or not a new member card or counting card is inserted (accepted) into the card (step S1), whether or not there is an input of movement operation information from the movement recognition processing board 111 (step S2), and the movement recognition processing board 111 whether there is an input of return operation information from 111 (step S3), whether there is an input of end operation information from the operation recognition processing board 111 (step S4), and cancellation operation information from the operation recognition processing board 111. Whether or not there is an input (step S5).

  When a new member card or counting card is inserted (accepted) into the card reader / writers 15a to 15c in the standby state of steps S1 to S5, specifically, a new one to the card reader / writers 15a to 15c is added. If there is an acceptance notification input from the card reader / writer 15a-c in response to the insertion (acceptance) of the membership card or counting card, it is determined as Yes in step S1, and the process proceeds to step S11, and the card shown in FIG. After performing the acceptance process, the process returns to the standby state of steps S1 to S5 again.

  Further, in the standby state of steps S1 to S5, if there is an input of take-out operation information from the action recognition processing board 111 in response to the take-out of the merchandise from the display shelf 14 by the store clerk, Yes is determined in step S2. Proceeding to step S12 and performing the extracted product registration process shown in FIG. 8, the process returns to the standby state of steps S1 to S5 again.

  In the standby state of steps S1 to S5, if there is an input of return operation information from the operation recognition processing board 111 in response to the return of the product to the display shelf 14 by the store clerk, it is determined Yes in step S3 and the step After proceeding to S13 and performing the return merchandise registration erasure process shown in FIG. 9, the process returns to the standby state of steps S1 to S5 again.

  Further, in the standby state of steps S1 to S5, when the end operation information is input from the motion recognition processing board 111 according to the end operation by the store clerk, it is determined Yes in step S4 and the process proceeds to step S14. After performing the settlement process shown in FIG. 10, the process returns to the standby state of steps S1 to S5 again.

  Further, in the standby state of steps S1 to S5, if cancel operation information is input from the motion recognition processing board 111 in response to the cancel operation by the store clerk, it is determined Yes in step S5 and the process proceeds to step S15. After performing the cancellation process, the process returns to the standby state of steps S1 to S5 again.

  Hereinafter, the flow of prize exchange in which the above-described processing of S11 to S15 will be described. For example, when a visitor player who finishes counting the number of balls acquired in the game in the counter carries out prize exchange Goes to the gift exchange counter and hands the counting card issued by the ball counter to a vacant corresponding port, for example, a store clerk at the corresponding port B.

  The store clerk who receives the counting card inserts the received counting card into the card reader / writer 15b installed in the corresponding port B.

  The insertion of the counting card is detected in step S1, and the process proceeds to step S11, where the card receiving process shown in FIG. 7 is performed.

  In this card acceptance process, as shown in FIG. 7, first, based on whether or not the card ID read by the card reader / writer 15b from the inserted card is a card ID corresponding to the membership card. Then, it is determined whether or not the inserted card is a membership card (step Sc1).

  If it is a membership card, the process proceeds to step Sc10, and a membership card authentication process involving acceptance of a personal identification number is performed. On the other hand, if it is not a membership card, that is, if it is a count card, the process proceeds to step Sc2. Perform the process. Therefore, when the card is a counting card as in the above example, the counting card authentication process is performed.

  In the membership card authentication process of step Sc10, first, the card reader / writer 15b accepts a password from the member player, and includes the received password and the card ID read from the member card by the card reader / writer 15b. An authentication request is transmitted to the management computer, and it is authenticated whether or not it matches with the code number stored and managed in the management computer in association with the card ID. The number of possessed balls stored in association with the card ID (only when present) and the number of stored balls are received from the management computer.

  On the other hand, in the counting card authentication process in step Sc2, an authentication request including the card ID read from the counting card received by the card reader / writer 15b and the number of counting balls is transmitted to the management computer and associated with the card ID. Then, it is authenticated whether or not it matches the number of counting balls stored and managed in the management computer, and the authentication result is received from the management computer.

  Next, it is determined whether or not the authentication result received from the management computer is authentication OK (step Sc3). If the authentication result is authentication NG, the process proceeds to step Sc11 to return (discharge) the accepted card. The process is executed and the process returns to the standby state of steps S1 to S5. On the other hand, if the authentication is OK, the process proceeds to step Sc4, and the amount of money that can be used for gift exchange (in the case of a membership card, for each rate). Whether the amount based on the total number of holding balls and the number of accumulated balls, or in the case of counting cards, the amount based on the number of counting balls at each rate) is equal to or greater than the minimum replacement amount, which is the amount of the product with the smallest replacement amount That is, it is determined whether or not the user has an available amount of money that can be exchanged.

  If it is not equal to or greater than the minimum replacement amount, the process proceeds to step Sc11 to perform card discharge processing for returning (discharging) the accepted card and returns to the standby state of steps S1 to S5, while when it is equal to or greater than the minimum replacement amount. The card ID read from the counting card received by the card reader / writer 15b is displayed as data corresponding to the counter port B in the prize exchange correspondence table after the available amount is displayed on the player display 16b. (Acceptance Card ID), 1 yen rate counting balls (rate 1 yen coins), 4 yen rate counting balls (rate 4 yen coins), these 1 yen rate counting balls (the equivalent exchange rate) Usable money that is the sum of the amount multiplied by 1 yen for exchange and the number of counting balls at the 4 yen rate multiplied by the prize exchange rate (4 yen for equivalent exchange) And stores the available balance of the available amount of money and the same amount.

  Next, the process proceeds to step Sc6, and a corresponding store clerk identification process is performed in which a counter card is inserted in the corresponding port B to identify the store clerk ID of the store clerk corresponding to the player.

  In this corresponding clerk identification process, the prize exchange computer 10 (CPU 102) outputs a clerk identification request including information on corresponding ports (corresponding ports A to C) to the motion recognition processing board 111.

  In response to the output of the store clerk identification request, the motion recognition processing board 111 exists in a region corresponding to the corresponding port B identified from the information on the corresponding port included in the output store clerk identification request in the visible light captured image. A face image of a person to be compared with the face image of the clerk stored in the image RAM (as described above, the same as the face image of the clerk image file stored in the registered clerk table) The store clerk ID of the store clerk is specified from the store clerk face image stored in the image RAM corresponding to the store clerk's face image corresponding to B, and the specified store clerk ID is output to the CPU 102 as a store clerk specifying response.

  In step Sc7, the clerk ID specified in step Sc6, specifically, the clerk ID output as the clerk identification response from the motion recognition processing board 111 is used as the corresponding clerk ID corresponding to the counter mouth B in the gift exchange correspondence table. Store as item data.

  Then, the income ID of the wireless income 18 attached to the clerk ID is specified from the income ID stored in the registered clerk table corresponding to the clerk ID, and the wireless income 18 of the identified income ID is identified. Through the intercom communication device 17, the available money stored in correspondence with the counter opening B in the prize exchange correspondence table, that is, the money that can be used for the prize exchange by the player who is newly supported by the store clerk is voiced. The message is transmitted and the process ends.

  As a result, the store clerk displays the amount of money that can be used from the counting card inserted into the card reader / writer 15b, that is, the maximum amount that the corresponding player can use to exchange prizes, etc. Can be perceived without being visually recognized, and it is possible to determine whether or not the player designates a product that cannot be exchanged.

  Then, when the player instructs the store clerk to take out the product he / she wants to exchange, the take-out operation is performed in response to the operation recognition processing board 111 recognizing the take-out operation of the store clerk as described above. Information is input, the input of the take-out operation information is detected in step S2, and the take-out merchandise registration process (FIG. 8) in step S12 is performed.

  In the take-out merchandise registration process of the present embodiment, as shown in FIG. 8, first, whether the input take-out operation information includes a regular clerk ID, that is, a clerk of “0000” indicating other than the clerk. It is determined whether or not an ID is included (step Sb0).

  If it is determined that a store clerk ID of “0000” indicating a person other than the store clerk is included in the determination, the process proceeds to step Sb9, and an unauthorized take-out notification process is performed to notify that a person other than the store clerk has taken out the product. To do.

  Specifically, in the unauthorized removal notification process, a message indicating that unauthorized removal of the product by a person other than the store clerk has occurred is displayed on the display device 107, and the unauthorized use of the product for all the wireless income 18 is displayed. A voice message indicating that the removal has occurred is transmitted and notified.

  On the other hand, if it is determined in step Sb0 that the regular store clerk ID is included, the process proceeds to step Sb1 and input from the coordinates of each storage box 40 stored in the storage box position information table. The storage box number of the storage box 40 corresponding to the coordinate information included in the take-out operation information is specified, and the product ID and product image of the product stored in the storage box 40 of the storage box number are identified. It is specified from the product ID stored in the product management table in association with the number and the path data to the product image file.

  And it progresses to step Sb2 and implements the goods collation process which collates whether the goods taken out by the store clerk are correct.

  Specifically, in the product matching process, the CPU 102 outputs a product matching request including the product image read from the product image file of the pass data specified in step Sb1 to the motion recognition processing board 111. In response to the output of the product verification request, the motion recognition processing board 111 displays the product image included in the product verification request and the visible light image (product image) of the product extracted by the extraction operation recognized by the output extraction operation information. Are collated based on whether or not the shapes, shades, and the like match, and the collation result (collation OK, collation NG) is output to the CPU 102 as a commodity collation response.

  When the collation result as the commodity collation response is collation NG, the CPU 102 determines No in step Sb3, proceeds to step Sb10, and executes a commodity re-collation process.

  In the product rematching process, the same process as the product matching process is performed to rematch the product. In the case of this re-collation, a re-collation request including the clerk ID of the clerk who performed the take-out operation and the product image is output to the motion recognition processing board 111. The CPU 102 identifies an image of the product possessed by the store clerk identified from the store clerk ID from the visible light image, collates the product image with the product image included in the rematch request, and uses the matching result as a product rematch response. Output to.

  That is, in the product matching process of Sb2, since the product image at the time when the action of the take-out operation is recognized is collated, the product image picked up by the visible light imaging unit 11c is blocked by the store clerk, and good matching is achieved. If the collation result is collation NG, the product image cannot be satisfactorily captured by performing the collation again using the product image captured by the visible light imaging unit 11c. Therefore, inconvenience caused by the verification being NG can be reduced as much as possible.

When the matching result as the product rematching response is matching NG, that is, when both of the matchings are matching NG, the process proceeds to step Sb12 and proceeds to the product matching error process. When the collation result is “OK”, the process proceeds to step Sb4.

  In the product verification error processing of the present embodiment, the income ID of the wireless income 18 worn by the store clerk who performed the product take-out operation is specified from the store clerk ID included in the take-out operation information. A notification message indicating that the collation result is NG is transmitted through the intercom communication device 17, and the product name and product image specified from the coordinates included in the take-out operation information are displayed on the display device 107 of the gift exchange computer 10, and A product confirmation screen including a selection input unit indicating whether or not there is a difference between the products is displayed, and confirmation input of the product is performed by the store clerk. If there is no difference, Sb4 is the same as in the case of Yes in step Sb11. If there is a difference, the store clerk is inserted in the card reader / writer 15 of the corresponding port. With discharging over de By cancel erase prize exchange the data of the corresponding openings in the prize exchange correspondence table again, so that again a prize exchange from the insertion of the card.

  When the collation result as the product collation response is collation OK, the CPU 102 determines Yes in step Sb3 and proceeds to step Sb4.

  In this step Sb4, the product ID and quantity (1) of the extracted product are stored (registered) in the premium exchange correspondence table in association with the clerk ID included in the input extraction operation information, and the premium exchange correspondence table is updated. . In this embodiment, the store clerk takes out the products one by one from the storage box 40. If a plurality of the same products are continuously taken out from the storage box 40, it is already possible to exchange prizes. Since the same product ID is stored (registered) in the table, the premium exchange table is updated by adding 1 to the quantity corresponding to the product ID and updating it.

  As described above, in this embodiment, the number of products can be surely specified by the number of recognition of the extraction operation by performing the extraction of the products one by one, but the present invention is limited to this. Rather than counting the number of products taken out in a single take-out operation by image recognition, and a counting sensor for counting the number of products taken out by each tag attached to the product in each storage box 40 For example, a plurality of products may be taken out by a single take-out operation.

  As the product ID is stored (registered) and the quantity is updated, the available balance is updated by subtracting the exchange amount necessary for exchanging the product with the updated product ID from the available balance.

  In step Sb5, it is determined whether or not the updated available balance is negative. If not, the process proceeds to step Sb6, and the player's display 16b in the corresponding port B which is the corresponding port is displayed. The displayed available remaining amount is updated to the updated new available remaining amount, and the updated new available remaining amount is transmitted to the wireless income 18 attached to the store clerk corresponding to the player. After performing the available remaining amount notification process to be performed, the process returns to the standby state of steps S1 to S5.

  On the other hand, if the remaining usable amount after the update is negative, that is, if the available amount is insufficient for exchanging all of the extracted products, that is, the product has been taken out too much. If there is, it is determined Yes in step Sb5 and the process proceeds to step Sb7, and a message is displayed on the player's display 16b of the corresponding port B, which is the corresponding port, that it is necessary to return the product. At the same time, after performing a merchandise return notification process for transmitting a voice message to the effect that the merchandise taken out must be returned to the wireless income 18 worn by the store clerk corresponding to the player, steps S1 to S5 are performed. Return to the standby state.

  When it is notified that it is necessary to return the product taken out in these product return notification processes, or the product taken out from the display shelf 14 is placed on the top plate on the player side (outside) of the counter table 2. Accordingly, when the player determines that the taken out product is not the desired product, the player instructs the store clerk to return the taken out product to the display shelf 14.

  As described above, when the player instructs the store clerk to return the merchandise that the player wants to return to the display shelf 14, as described above, the return operation of the store clerk is recognized by the motion recognition processing board 111. Return operation information is input, the input of the return operation information is detected in step S3, and the return merchandise registration deletion process (FIG. 9) in step S13 is performed.

  In the return merchandise registration erasure process of this embodiment, as shown in FIG. 9, first, a return merchandise specifying process for specifying the merchandise ID of the merchandise to be returned is performed (step Sd1).

  In this return product specifying process, the storage box number of the storage box 40 corresponding to the coordinate information included in the input return operation information is specified from the coordinates of each storage box 40 stored in the storage box position information table. The product ID of the product stored in the storage box 40 with the storage box number is specified from the product ID stored in the product management table in association with the specified storage box number.

  Next, all the product IDs stored in the premium exchange correspondence table are specified in association with the clerk ID included in the input return operation information (step Sd2).

  Then, whether or not the merchandise ID of the return merchandise identified in step Sd1 is included in the merchandise ID stored in the premium exchange correspondence table identified in step Sd2, that is, the return merchandise is taken out in the premium exchange correspondence table. It is determined whether or not it is stored (registered) as a product (step Sd3).

  If the product ID of the specified return product is not included in the product ID stored in the gift exchange correspondence table specified in step Sd2, it is determined No in step Sd3, and the process proceeds to step Sd10, where a product return error occurs. Execute the process.

  In this merchandise return error processing, the merchandise ID and the storage box number of the return destination are temporarily stored, and the returned merchandise is not included in the picked-up merchandise, that is, the storage box 40 that returned the merchandise is incorrect. Since there is a high possibility, the fact that the return destination is wrong is transmitted to the wireless income 18 of the store clerk who performed the return operation to prompt the user to take out the wrongly returned product. In response, the product ID temporarily stored above and the return destination storage box number are deleted, and the process returns to the standby state of steps S1 to S5.

  If the product ID of the identified return product is included in the product ID stored in the gift exchange correspondence table identified in step Sd2, the process proceeds to step Sd4, and the return product identified in step Sd1 The storage (registration) of the product ID in the gift exchange correspondence table is deleted. In this embodiment, as in the case of taking out the product, the store clerk returns the product to the storage box 40 one by one. When the product is returned, the product ID of the product is returned. It is determined whether or not the quantity corresponding to 1 is 1. If it is not 1, the registration of the return product is deleted by subtracting 1 from the quantity, and if the quantity is 1, the product of the product is obtained. The registration of the return product is deleted by deleting the registration of ID and quantity 1.

  As described above, in this embodiment, the number of returned products can be surely specified by the number of recognition of the return operation by performing the return of the products one by one, but the present invention is limited to this. Rather than being counted, the number of products returned in a single return operation is counted by image recognition, and the number of returned products in each storage box 40 is counted by a tag attached to the product. A plurality of products may be returned in one return operation by providing a counting sensor or the like.

  Note that the available balance is updated by adding the exchange amount of the product with the deleted product ID to the available balance as the product ID is deleted and updated or the quantity is subtracted and updated.

  Then, in step Sd5, it is determined whether or not the remaining usable amount after the update is negative. If not, the process proceeds to step Sd6 and is displayed on the player display 16b of the corresponding port B which is the corresponding port. The displayed available remaining amount is updated to the updated new available remaining amount, and the updated new available remaining amount is transmitted to the wireless income 18 attached to the store clerk corresponding to the player. After performing the available remaining amount notification process to be performed, the process returns to the standby state of steps S1 to S5.

  On the other hand, if the remaining usable amount after the update is still negative, it is determined Yes in step Sd5, and the process proceeds to step Sd7, which is taken out to the player display 16b of the corresponding port B which is the corresponding port. A message indicating that the product needs to be returned is continuously displayed, and a voice message is sent to the wireless intercom 18 worn by the store clerk corresponding to the player that the taken product needs to be returned. After performing the merchandise return notification process to be performed, by returning to the standby state of steps S1 to S5, by notifying the player and the store clerk that additional return is necessary, until these notifications are not made Encourage the return.

  In this embodiment, when the product is returned, the product is not checked and verified as in the case where the product is taken out, but the present invention is not limited to this, and these return operations are not performed. At the time of recognition, as in the case of recognizing the take-out operation, product confirmation / collation may be performed based on the product image.

  If the player wants to cancel the prize exchange in the middle of these prize exchanges, and tells the clerk that the cancellation, the clerk performs an operation of crossing both arms, which is a predetermined cancel operation, to form an X mark. As described above, the cancel operation information is input in response to the cancel operation of the store clerk being recognized by the operation recognition processing board 111, and the input of the cancel operation information is detected in step S5, and in step S15. Cancel processing is performed.

  In this canceling process, the clerk ID that is included in the canceling operation information is the clerk who has performed the canceling operation from the corresponding port (corresponding port B in this example) stored in the corresponding clerk ID item of the giveaway exchange correspondence table. The card reader / writer 15b in which the player's card (counting card) corresponding to is inserted is specified, the card (counting card) inserted in the specified card reader / writer 15b is discharged, and prize exchange is performed The data of the corresponding port (corresponding port B) in the corresponding table is deleted and the prize exchange is stopped.

  On the other hand, by notifying that the product needs to be returned as described above, that is, in a state where the available balance is not negative, the player tells the store clerk that the product has been taken out and is OK. When the store clerk performs an operation of putting both hands over the head, which is a predetermined end operation, as described above, the end operation information is obtained in response to the operation recognition processing board 111 recognizing the end operation of the store clerk. Then, the input of the end operation information is detected in step S4, and the settlement process (FIG. 10) in step S14 is performed.

  In this checkout process, as shown in FIG. 10, first, it is determined whether or not the available balance stored in the giveaway exchange correspondence table in association with the clerk ID included in the end operation information is negative ( Step Se1).

  If the available balance is negative, that is, if the exchange amount cannot be settled for all products due to a shortage of the available amount, the process proceeds to Step Se7, and the player of the corresponding port B that is the corresponding port A message indicating that the product price cannot be settled is displayed on the display 16b (a message indicating that the product needs to be returned is also displayed), and the store clerk corresponding to the player After carrying out the non-payment notification process for transmitting a voice message to the effect that the payment for the product cannot be made to the attached wireless income 18, the process returns to the standby state of steps S1 to S5.

  On the other hand, when the available remaining amount is not negative, the process proceeds to Step Se2 to execute the commodity price settlement process.

  Specifically, the difference between the available amount stored in association with the store clerk ID included in the end operation information and the available remaining amount in the giveaway exchange correspondence table at that time, that is, each product (premium) taken out ) By multiplying the exchange amount by the quantity and the card ID being received by the card reader / writer 15b, calculating the number of counting balls corresponding to the specified total amount, and calculating the calculated counting ball A subtraction request including the number and the specified card ID is transmitted to the management computer, and the counting ball number is subtracted and updated from the counting ball number managed in association with the card ID in the management computer. Then, in response to receiving the subtraction completion notification from the management computer, the count ball number included in the subtraction request is subtracted from the count ball data stored in the count card being received by the card reader / writer 15b. Rewrite and update the data with the new number of balls. If the card being accepted is a membership card, the counting ball number data is not stored in the card, so the counting ball number data is not rewritten and updated.

  In the case where the number of balls with different rates is stored in the prize exchange correspondence table, one of the rates, for example, the number of balls of a 1-yen rate is used preferentially, and the ball of 1-yen rate to be given priority. What is necessary is to subtract the shortage from the number of balls at the 4-yen rate.

  In response to the reception of the subtraction completion notification from the management computer, the prize exchange computer 10 additionally stores the prize exchange history of the prize exchange in the prize exchange history data and prints a receipt on which a breakdown of the prize exchange is printed. Issued from the printing device 108.

  Then, the process proceeds to step Se3, and it is determined from the card ID, for example, whether or not the accepted card is a counting card. If the card is not a counting card, that is, if it is a membership card, the process proceeds to step Se8. Is returned (discharged) from the card reader / writer 15b.

  On the other hand, in the case of a counting card, it is determined whether or not the available amount corresponding to the new number of counting balls updated and stored in the card is equal to or greater than the minimum replacement amount.

  If it is equal to or greater than the minimum replacement amount, the process proceeds to step Se8, where the counting card is returned (discharged) from the card reader / writer 15b. If it is not equal to or smaller than the minimum replacement amount, the process proceeds to step Se5. The light is collected by the writer 15b.

  Then, after proceeding to Step Se6 and erasing various data such as the returned or numbered card ID, the number of balls of each rate corresponding to the card ID, the corresponding clerk ID, and the product ID from the prize exchange correspondence table, The process returns to the standby state of steps S1 to S5.

  In response to the return or collection of these counting cards or the return of the membership card, the store clerk hands over the removed product, the returned card and the issued receipt to the player to complete the prize exchange, and to the next player. Move on to support.

  As described above, according to the first embodiment, even if the display shelf 14 is a large display space so that the player can indicate various products that match his / her preference, It is possible to eliminate the hassle of inputting the product instructed and taken out from the display location of the product to the installation location of the prize exchange computer 10 one by one. It can be significantly reduced.

  In addition, according to the first embodiment, the removal of the product by a person other than a registered store clerk, that is, the removal of the unauthorized product is notified by the unauthorized retrieval notification process. Can take.

  Next, a second embodiment of the present invention will be described. In addition, although Example 1 illustrated the form which recognizes operation | movement of the salesclerk who is a trader as mentioned above, in this Example 2, in the prize exchange room where the display shelf where prizes were displayed was installed, It is characterized by the point of recognizing the action of the player who takes out the merchandise from the display shelf, and in the following description, the description of the same configuration as the embodiment is omitted.

  FIG. 11 is a diagram illustrating a prize exchange room of a game hall in which the prize exchange device according to the second embodiment is installed. As shown in FIG. 11, in the prize exchange room of the second embodiment, an entrance and an exit to the prize exchange room are provided on one of the four walls forming the square prize exchange room. In the same manner as the display shelf 14 of the first embodiment, the prizes (commodities) are stored in the respective storage boxes 40 and displayed on the three walls other than the wall provided with the entrance and the exit. The shelves A to D are arranged along the front of each wall, and the player who has entered the room from the entrance takes out the products that he / she wishes to exchange for prizes from among the products displayed on the display shelves A to D. By bringing it to the counter table 2 'provided near the exit of the prize exchange room, the prize (product) brought in the counter table 2' is specified from the number of counting balls or membership card specified by the counting card. It can be exchanged for the number of held balls, the number of stored balls, etc.

  Similarly to the counter table 2 of the first embodiment, the counter table 2 ′ of the second embodiment has a top plate on the player side (outside) that is higher than the top plate on the store clerk side (inside). On the top (outside) top plate, a player display 16 and a card reader / writer 15 into which a member card or counting card is inserted by the player are installed.

  Further, on the top plate on the store clerk side (inner side), a merchandise transaction apparatus provided so that each store clerk inside the counter can operate is configured, and the same prize as in the first embodiment for controlling the operation of the merchandise transaction apparatus A replacement computer 10 'is installed.

  Further, as shown in FIG. 11, imaging units 12 and 13 having the same function as the imaging unit 11 of the first embodiment radiate from the imaging units 12 and 13 on the wall surface provided with the entrance / exit of the prize exchange room. The pattern infrared lights are installed so as to have a predetermined angle with respect to the wall surface so that they do not overlap each other and are radiated to almost all areas in the prize exchange room.

  In other words, in this embodiment, the imaging unit 12 emits pattern infrared light to the area 1 which is a half area connected to the entrance in the prize exchange room, so that the player takes out or returns the area in the area 1. The image capturing unit 13 shoots an image for performing motion recognition, and the imaging unit 13 radiates pattern infrared light to the region 2 which is a half region connected to the exit in the prize exchange room. An image for recognizing various operations such as a take-out operation and a return operation is taken.

  Next, the configuration of the merchandise transaction apparatus according to the present embodiment will be described with reference to FIG. 12. The merchandise transaction apparatus is mainly connected to the prize exchange computer 10 ′ and the prize exchange computer 10 ′ described above. The imaging units 12 and 13, display shelves A to D, a card reader / writer 15, and a player display 16 are configured. The card reader / writer 15 and the player display 16 are the same as those in the first embodiment. Description of is omitted. The membership card and counting card inserted into the card reader / writer 15 are the same as those in the first embodiment.

  Further, as shown in FIG. 12, the imaging units 12 and 13 used in the second embodiment also have the infrared light emitting portions 12a and 13a and the infrared light emitting portions 12a as in the case of the imaging unit 11 in the first embodiment. Infrared imaging units 12b and 13b that perform imaging with pattern infrared light radiated from 13a, and visible light imaging units 12c and 13c that image region 1 or region 2 that emits pattern infrared light with normal visible light And.

  In the second embodiment, the display shelves A to D are provided on the three wall surfaces of the gift exchange room, so that the coordinates of the product take-out position on each display shelf can be accurately specified with sufficient accuracy. However, the present invention is not limited to this. For example, a display shelf is provided only on one wall surface of the prize exchange room. In such a case, only one imaging unit may be used.

  Further, as shown in FIG. 12, the prize exchange computer 10 ′ used in the present embodiment is different from the processing program stored in the storage device 105, the contents of the table, etc. 1 is the same as the prize exchange computer 10 and includes the action recognition board 111, so that prize exchange based on action recognition using infrared light images or visible light images captured by the imaging units 12 and 13 can be performed. Has been.

  In the second embodiment, only one set of card reader / writer 15 and player display 16 are connected to the connection interface 110.

  Similar to the prize exchange computer 10 of the first embodiment, the storage device 105 stores a merchandise management table, a storage box position information table, prize exchange history data, merchandise image data, and the like. In place of the 1 prize exchange correspondence table, the occupant management table shown in FIG. 13 is stored.

  In the storage box position information table of the second embodiment, the position coordinates of the storage box 40 are stored for each display shelf A to D, and the display shelf has a display shelf number at the top of the storage box number in the product management table. "A ***" for A, "B ***" for display shelf B, "C ***" for display shelf C, "D *" for display shelf D As indicated by “**”, the storage box 40 of which display shelf is the storage box 40 can be specified from the storage box number.

  In the occupant management table of the second embodiment, as shown in FIG. 13, the members who are receiving the card reader / writer 15 in association with the occupant ID assigned to the player who entered the prize exchange room. Card ID of the card or counting card (accepting card ID), the number of balls of 1 yen rate or 4 yen rate specified from the member card or counting card being accepted, the number of balls of 1 yen rate and 4 The available amount that can be used for exchanging premiums based on the number of balls at the yen rate, and the necessary amount necessary for exchanging the retrieved items based on the number of products and items that have been removed by the player, from the available amount The available remaining amount after subtraction and the product ID and quantity of the product taken out by the player are stored.

  It should be noted that when the player enters the room, only the room ID assigned according to the room entry is stored in the room entry management table, and as shown in FIG. In addition, the product ID and quantity of the product are stored, and when the player is authenticated by inserting the card into the card reader / writer 15, as shown in FIG. Are stored, and prizes exchanged for the merchandise taken out by the player is performed based on the data stored in the room management table.

  Further, the posture estimation integrated circuit (IC) on the motion recognition processing board 111 of the second embodiment performs the cancel operation when it recognizes a cancel operation that crosses both arms, which is a predetermined operation set in advance. Cancel operation information including the room occupant ID or the store clerk ID and the operation ID of the cancel operation indicating that the cancel operation has been recognized is output to the CPU 102.

  Further, the posture estimation integrated circuit (IC) in the motion recognition processing board 111 of the second embodiment performs the end operation when it recognizes the end operation of putting both hands over the head, which is a predetermined operation set in advance. The ending operation information including the room occupant ID or the store clerk ID and the operation ID of the ending operation indicating that the ending operation has been recognized is output to the CPU 102.

  Further, the posture estimation integrated circuit (IC) on the motion recognition processing substrate 111 of the second embodiment recognizes a take-out operation for taking out a product from the display shelves A to D, which is a predetermined operation set in advance. The coordinates of the position where the product is taken out on A to D and the display shelf A to D are specified based on the infrared light image by the pattern infrared light, the specified coordinate information, the shelf The take-out operation information including the type (display shelves A to D), the ID of the room occupant who performed the operation, and the operation ID of the take-out operation indicating that the take-out operation has been recognized is output to the CPU 102.

  Further, when the posture estimation integrated circuit (IC) on the motion recognition processing board 111 of the second embodiment recognizes the return operation for returning the product to the display shelves A to D, which is a predetermined operation set in advance, the display shelf A The coordinates of the position where the merchandise is returned on D and the display shelves A to D are identified based on the infrared light image by the pattern infrared light, the identified coordinate information, and the shelf type Return operation information including (display shelves A to D), the ID of the room occupant who performed the operation, and the operation ID of the return operation indicating that the return operation has been recognized is output to the CPU 102.

  Further, the motion recognition processing board 111 of the second embodiment has a movement path storage function for storing the movement path of the player who has entered the room in association with the room occupant ID assigned to the player who has entered the room. It is determined whether or not the person extracted by the sensor integrated circuit (IC) is a person who has newly entered the prize exchange room from the entrance by determining whether or not the person whose movement route is stored is determined. When it is determined that the player is a newly entered player, the player ID is assigned to the player with a number next to the already-entered guest ID. At the same time, the room entry information including the given room occupant ID is output to the CPU 102.

  The action recognition processing board 111 stores the visible light image of the player in association with the assigned occupant ID in association with the assignment of the occupant ID described above, whereby the image (clothes, hairstyle, The player can be distinguished from other players who are entering the prize exchange room from the body type. The identification of the player based on these images is performed in the aforementioned face authentication integrated circuit (IC) mounted on the motion recognition processing board 111.

  In addition, the motion recognition processing board 111 of the second embodiment specifies the direction in which the player is moving based on the stored movement path of each player, and the exit or the entrance by moving in the movement direction. It is possible to recognize the situation that the user leaves the prize exchange room, that is, the exiting operation, and when the exiting operation is recognized, the entry given to the player who is performing the leaving operation The person ID is specified, and the exit information including the specified room ID is output to the CPU 102.

  Next, the prize exchange process performed in the prize exchange computer 10 ′ (CPU 102) of the second embodiment will be described with reference to FIG. 14. In the prize exchange process, as shown in FIG. Whether or not a member card or counting card is inserted (accepted) into the user (step SS1), whether or not there is an input of removal operation information from the operation recognition processing board 111 (step SS2), Whether there is an input of return operation information (step SS3), whether there is an input of room entry information from the motion recognition processing board 111 (step SS4), and there is an input of exit information from the motion recognition processing board 111. Whether or not (step SS5), there is an input of end motion information from the motion recognition processing board 111 (step SS6), motion recognition Whether or not an input of cancel operation information from the management board 111 (step SS7), and waits in a standby state in which cyclic implement.

  When a new member card or counting card is inserted (accepted) into the card reader / writer 15 in the standby state of steps SS1 to SS7, specifically, a new member card or counting to the card reader / writer 15 is entered. If an acceptance notification is input from the card reader / writer 15 in response to the insertion (acceptance) of the card, it is determined Yes in step SS1 and the process proceeds to step SS11, after the card acceptance process shown in FIG. 15 is performed. The process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of steps SS1 to SS7, if there is an input of the operation information taken out from the operation recognition processing board 111 in response to the removal of the product from the display shelves A to D by the player, Yes in step SS2 After the determination, the process proceeds to step SS12, and after performing the extracted product registration process shown in FIG. 15, the process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of steps SS1 to SS7, if there is an input of return operation information from the operation recognition processing board 111 in response to the return of the product to the display shelves A to D by the player, Yes in step SS3 After the determination, the process proceeds to step SS13, and after the return merchandise registration erasure process shown in FIG. 16 is performed, the process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of Steps SS1 to SS7, if there is input of room entry information from the motion recognition processing board 111 in response to a new player entering the room, it is determined Yes in Step SS4 and the process proceeds to Step SS14. After performing the resident registration process, the process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of Steps SS1 to SS7, when exit information is input from the motion recognition processing board 111 in response to the player leaving the room, it is determined as Yes in Step SS5, and the process proceeds to Step SS15. After performing the confirmation process, the process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of steps SS1 to SS7, when the end operation information is input from the motion recognition processing board 111 according to the end operation by the store clerk, it is determined Yes in step SS6 and the process proceeds to step S16. After the checkout process shown in FIG. 18 is performed, the process returns to the standby state of steps SS1 to SS7 again.

  Further, in the standby state of steps SS1 to SS7, when cancel operation information is input from the motion recognition processing board 111 in response to the cancel operation by the store clerk, it is determined Yes in step SS7 and the process proceeds to step SS17. After performing the cancellation process, the process returns to the standby state of steps SS1 to SS7 again.

  Hereinafter, the flow of prize exchange in the second embodiment in which the above-described processes of SS11 to SS17 are performed will be described. For example, a visitor player who has finished counting the number of balls acquired in the game in the counter is a prize. When exchanging, the prize exchange room is entered from the entrance and what kind of prize (product) is present is checked by looking at the display shelves AD.

  As described above, this player's entry into the prize exchange room is recognized by the motion recognition processing board 111, and a player ID is given to the player who has entered the room, and includes the assigned guest ID. The room entry information is input from the motion recognition processing board 111 to the CPU 102, the entry of the room entry information is detected in step SS4, and the room occupant registration process in step SS14 is performed.

  In this room occupant registration process, as shown in FIG. 13 (a), the room occupant ID included in the input room occupancy information is additionally stored as item data of “room occupant ID” in the room occupant management table. The process returns to the standby state of steps SS1 to SS7.

  When the entry information is output, as described above, a player image for distinguishing the player from other entering players is stored.

  When the player finds a prize (product) that he / she wants to exchange, the prize (product) is taken out of the display shelf A, for example, and placed in a shopping cart or the like.

  In response to the action recognition processing board 111 recognizing the player's take-out operation of the prize (product), the take-out operation information is input from the action recognition processing board 111 as described above. The input is detected in step SS2, and the takeout product registration process (FIG. 16) in step SS12 is performed.

  In the take-out merchandise registration process of the present embodiment, as shown in FIG. 16, first, coordinate information included in the take-out operation information input from the coordinates of each storage box 40 stored in the storage box position information table, The storage box number of the storage box 40 corresponding to the shelf type is specified, and the product ID and the product image of the product stored in the storage box 40 of the storage box number are associated with the specified storage box number. The product ID stored in the management table and the path data to the product image file are specified (step SB1).

  And it progresses to step SB2, and the goods collation process which collates whether the goods taken out by the player are the goods identified definitely is implemented.

  Specifically, in the product matching process, the CPU 102 outputs a product matching request including the product image read from the product image file of the path data specified in step SB1 to the motion recognition processing board 111. In response to the output of the product verification request, the motion recognition processing board 111 displays the product image included in the product verification request and the visible light image (product image) of the product extracted by the extraction operation recognized by the output extraction operation information. Are collated based on whether or not the shapes, shades, and the like match, and the collation result (collation OK, collation NG) is output to the CPU 102 as a commodity collation response.

  When the collation result as the commodity collation response is collation NG, the CPU 102 determines No in step SB3 and proceeds to step SB10, where the commodity ID of the commodity determined to be collation NG, the room user ID of the player, and the like Is stored as verification error information, and the process proceeds to step SB4.

  When the collation result as the product collation response is collation OK, the CPU 102 determines Yes in step SB3 and proceeds to step SB4.

  In this step SB4, the product ID and quantity (1) of the extracted product are stored (registered) in the occupant management table in association with the occupant ID included in the input extraction operation information, and the occupant management table is updated. Then, the process ends.

  Note that each display shelf A to D of this embodiment is provided with a cautionary note stating that it is necessary to take out each product individually, and one player is stored in the storage box 40. The products are taken out one by one. However, in the storage box 40, even in the same product, a product in which two products are packaged and a product in which three products are packaged are stored in different storage boxes 40 as different products. When one product is desired, the player can obtain three products at a time even if the products are taken out one by one by taking out the products packed in three products.

  Further, when a plurality of the same products are taken out from the storage box 40, the same product ID is already stored (registered) in the occupant management table, so the quantity corresponding to the product ID is set. 1 is added and updated, and the occupant management table is updated.

  Thus, each product taken out from the display shelves A to D is stored in the room management table in association with the room ID assigned to the player who has performed the product take-out operation.

  In the case where the player who has taken out the product in this way illegally leaves the entrance or exit without paying the prize (product) in the counter table 2 ′, the exit operation is performed by the motion recognition processing board 111. The above-mentioned exit information is input in response to the operation being recognized at, the input of the exit information is detected at step SS5, and the exit person confirmation process at step SS15 is performed.

  In this leaving person confirmation process, whether or not there is a product ID stored in the entering person management table in association with the entering person ID included in the inputted leaving information, that is, the game in which the leaving action has been performed It is determined whether or not the customer has taken out the product (premium) and possesses the product (premium).

  In the case where the stored product ID does not exist, that is, in the case of a player who has entered the room and viewed the product (free gift) but has left the room because there is no product to be exchanged, the person who entered the room of the player who left the room Delete the ID from the occupant management table.

  On the other hand, if there is a stored product ID, an illegal product (prize) has been taken out, and a message indicating that the product has been illegally taken out by the player is displayed. Unauthorized take-out notification processing to be displayed and notified on 107 is performed.

  Since the store clerk in the counter table 2 ′ can perceive that the product has been illegally taken out in this way, it is possible to visually identify the person who performed the fraud, that is, the person who is about to leave the room, For example, it is possible to take an appropriate measure such as notifying other store clerk of the occurrence of fraud (shoplifting) using a horn or the like possessed.

  In addition, as described above, among the prizes (products) taken out from the display shelves A to D, when the player wants to return the prize (products) without thinking about exchanging the prizes, the storage where the goods are taken out is stored. Return to box 40.

  As described above, when the player returns the merchandise that the player wants to return, the return operation information is input in response to the player's return operation being recognized by the operation recognition processing board 111 as described above. The input of operation information is detected in step SS3, and the return merchandise registration erasure process (FIG. 17) in step SS13 is performed.

  In the return product registration deletion process of the second embodiment, as shown in FIG. 17, first, a return product specifying process for specifying the product ID of the returned product is performed (step SD1).

  In this return merchandise specifying process, it corresponds to the coordinate information and shelf information included in the input return operation information from the coordinates of each storage box 40 for each display shelf AD stored in the storage box position information table. The storage box number of the storage box 40 to be identified is specified, and the product ID of the product stored in the storage box 40 of the storage box number is associated with the specified storage box number and stored in the product management table Specify from ID.

  Next, all product IDs stored in the room occupant management table are specified in association with the room occupant ID included in the input return operation information (step SD2).

  Then, whether or not the merchandise ID of the return merchandise identified in step SD1 is included in the merchandise ID stored in the occupant management table identified in step SD2, that is, the return merchandise is taken out to the occupant management table. It is determined whether or not the product is stored (registered) (step SD3).

  If the product ID of the specified return product is not included in the product ID stored in the room occupant management table specified in step SD2, it is determined No in step SD3, and the process proceeds to step SD10, and a product return error Execute the process.

  In the merchandise return error process, the merchandise ID and the storage box number of the return destination are stored, and the player is likely to be wrong with the storage box 40 that has returned the merchandise. A message indicating that the message has occurred is displayed on the display device 107 to notify the store clerk, and then the process ends.

  In response to the notification, the store clerk confirms from the storage box number displayed on the display device 107 the storage box 40 in which the product has been returned by mistake and the player in the vicinity of the storage box 40. Ask the customer for the returned merchandise and return the merchandise to the customer, return the merchandise to the player, tell the storage box 40 that is the regular return location, and return the merchandise to the storage box 40 to return the merchandise The purchased product is deleted from the occupant management table.

  In this embodiment, the clerk's take-out operation and return operation are not recognized. However, the present invention is not limited to this, and the merchandise ID of the product taken out by the clerk is recognized by recognizing the operation of these clerk. May be stored in the occupant management table in association with the occupant ID of the player who handed the product, or when the product ID of the product returned by the store clerk exists in the occupant management table The stored product ID may be deleted or the quantity may be subtracted. However, in this case, since the same product ID may be stored in the room management table in association with different room IDs, for example, the player who handed the product to the store clerk And the storage of the product ID stored in the room occupant management table in association with the room occupant ID of the identified player may be deleted or the quantity may be subtracted.

  On the other hand, if the product ID of the specified return product is included in the product ID stored in the room occupant management table specified in step SD2, the process proceeds to step SD4, and the return product specified in step SD1. The storage (registration) of the product ID in the room occupant management table is deleted. In the second embodiment, as in the case of taking out the product, the player returns the product to the storage box 40 one by one, and when the product is returned, It is determined whether or not the quantity corresponding to the product ID is 1, and if it is not 1, the registration of the return product is deleted by subtracting the quantity by 1, and if the quantity is 1, the product is Delete the registration (memory) of the product ID and quantity 1 to delete the registration (memory) of the return product and end the processing.

  In this way, in the second embodiment, since it is necessary to recognize the actions of many players in parallel, it is possible to return the number of returned merchandise by causing the merchandise to be returned one by one. Although it can be surely specified by the number of times of recognition of the operation, the present invention is not limited to this, and the number of products returned in one return operation can be counted by image recognition, and each storage A plurality of products may be returned in a single return operation by providing the box 40 with a counting sensor that counts the number of returned products using tags or the like attached to the products.

  As described above, when the player who has entered the room has taken out or returned the merchandise and determined the merchandise to be exchanged, the merchandise is brought to the counter table 2 ′ for payment.

  In the counter table 2 ′, the player inserts a counting card (or membership card) possessed by the card reader / writer 15.

  The insertion of the counting card is detected in step S1, and the process proceeds to step S11, where the card receiving process shown in FIG. 15 is performed.

  In this card acceptance process, as shown in FIG. 15, first, based on whether or not the card ID read by the card reader / writer 15 from the inserted card is a card ID corresponding to the membership card. Then, it is determined whether or not the inserted card is a membership card (step SC1).

  If it is a membership card, the process proceeds to step SC17, and a membership card authentication process involving acceptance of a personal identification number is performed. On the other hand, if it is not a membership card, that is, if it is a counting card, the process proceeds to step SC2. Perform the process. Therefore, in the case of a counting card as described above, the counting card authentication process is performed.

  In the member card authentication process of step SC17, first, the card reader / writer 15 receives a password from the member player, and includes the received password and the card ID read from the member card by the card reader / writer 15. An authentication request is transmitted to the management computer, and it is authenticated whether or not it matches with the code number stored and managed in the management computer in association with the card ID. The number of possessed balls stored in association with the card ID (only when present) and the number of stored balls are received from the management computer.

  On the other hand, in the counting card authentication process in step SC2, an authentication request including the card ID read from the counting card received by the card reader / writer 15 and the number of counting balls is transmitted to the management computer and associated with the card ID. Then, it is authenticated whether or not it matches the number of counting balls stored and managed in the management computer, and the authentication result is received from the management computer.

  Next, it is determined whether or not the authentication result received from the management computer is authentication OK (step SC3). If it is authentication NG, the process proceeds to step SC18 to return (discharge) the accepted card. The process is executed and the process returns to the standby state of steps SS1 to SS7. On the other hand, if the authentication is OK, the process proceeds to step SC4, and the amount of money that can be used for gift exchange (in the case of a membership card, for each rate). Whether the amount based on the total number of holding balls and the number of accumulated balls, or in the case of counting cards, the amount based on the number of counting balls at each rate) is equal to or greater than the minimum replacement amount, which is the amount of the product with the smallest replacement amount That is, it is determined whether or not the user has an available amount of money that can be exchanged.

  If it is not equal to or greater than the minimum exchange amount, the process proceeds to step SC18 to perform card ejection processing for returning (ejecting) the accepted card and returns to the standby state of steps SS1 to SS7. After displaying the available amount on the player display 16, the process proceeds to step SC5, where card user identification processing for identifying the card user who inserted the card is performed.

  In this card user specifying process, the room ID of the player who has inserted the card (counting card or member card) received by the card reader / writer 15 is specified. Specifically, the CPU 102 outputs an account settlement specific request to the motion recognition processing board 111.

  In response to the output of the accountant identification request, the motion recognition processing board 111 is a person who is present in a predetermined area (settlement place area) including the counter table 2 ′ in the visible light captured image captured by the imaging unit 13. And determining whether or not the person is a store clerk based on the face image of the store clerk stored in advance, and for the person determined not to be a store clerk, By comparing with the image of the player and identifying which player is in the room, the room occupant ID is identified, and the identified room occupant ID is output to the CPU 102 as an accountant identification response.

  In the comparison of these players, as described above, when the image is picked up by the image pickup unit 13, since the image is from behind the player, it is difficult to pick up the face image accurately. However, the present invention is not limited to this, for example, an imaging camera for capturing a face image of a room occupant at the entrance. Alternatively, an imaging camera may be separately provided on the player display 16 on the counter table 2 ′, and the player's room occupant ID may be specified by collating face images captured by the imaging camera.

  Next, the card ID, the available amount, etc. are registered in the room occupant management table in association with the room occupant ID specified in step SC5. Specifically, the card ID (accepting card ID) read from the counting card received by the card reader / writer 15 and the number of counting balls at a 1 yen rate (number of balls at a rate of 1 yen), the number of counting balls at a rate of 4 yen (rate) The number of 4-yen coins), the number of these 1-yen counting balls multiplied by the premium exchange rate (1 yen for equivalent exchanges), and the 4-yen counting ball number of premiums exchange rate (4 for equivalent exchanges) The total amount obtained by multiplying the available amount by multiplying (Yen)) and the total amount (required exchange amount) obtained by multiplying the exchange amount of each product stored at that time by the number of the product, and subtracting from the available amount The possible remaining amount is stored (step SC6).

  Then, the process proceeds to step SC6 + to determine whether or not the player ID of the player is stored as verification error information, that is, whether or not a product that cannot be verified is included in the product extracted by the player. If it is determined and stored as verification error information, the process proceeds to the product confirmation process in step SC20.

  In this product confirmation process, together with a message indicating that product confirmation is required, the product ID of the product that has not been verified and stored as verification error information together with the room ID, and the product identified from the product ID The name is displayed on the display device 107 as an unfinished product, and the product ID and product name of another product stored in the occupant management table in association with the resident ID are displayed as a verified product. By being displayed on the device 107, the store clerk confirming the display confirms whether or not the product brought by the player matches the product displayed as the unverified product.

  If they match, the store clerk inputs that they match, and the merchandise confirmation process is terminated, and the process proceeds to step SC7. On the other hand, if they do not match, the matched merchandise displayed on the display device 107 and the player Compare the product brought in by the product, identify the product that resulted in the verification error, and perform the specified change operation to change the product that resulted in the verification error to the specified product and perform the product confirmation process. End and proceed to step SC7.

  Then, the process proceeds to step SC7, and it is determined whether or not the available balance stored in step SC6 is negative.

  If the available balance is negative, that is, if the exchange price cannot be settled for all products due to a shortage of available money, the process proceeds to step SC14, and the display device 107 and the player display 16 are A message indicating that the product price cannot be settled is displayed, and the process ends.

  If the received card is a membership card and there are both the number of balls and the number of balls, the available amount based on the number of balls is insufficient and cannot be exchanged. The amount of money available based on the total number of balls and the number of stored balls can be informed that exchange is possible without shortage, or the amount available based on the number of stored balls is insufficient and cannot be exchanged. For each type of possession value owned by the player, such as notifying that the amount of money available based on the total number of balls in possession and the number of balls can be exchanged without shortage. You may make it alert | report whether exchange is possible.

  If these available amounts are insufficient, that is, if the product has been taken out excessively, as described above, the player returns a part of the product to be returned, In the state where the registration is deleted from the occupant management table and the remaining balance becomes 0 or positive, the store clerk or the player performs the end operation, so that the end operation of the store clerk or the player is recognized by the motion recognition process. When the end operation information is input in response to the operation being recognized by the substrate 111, the settlement process (FIG. 18) in step SS16 is performed.

  If the player returns to the storage box 40 from which the product is taken out when the available amount is insufficient, the return processing efficiency is reduced due to the time required for the return. For example, the player's display 16 is provided with a transparent touch panel that can be operated by the player, and a return-only box is arranged in the vicinity of the counter table 2 ′ so that all the taken out A list of products is displayed on the player display 16 to allow the player to select a product to be returned from the displayed product list, and the operation of the player to return the selected product to the return-only box is performed. Depending on the recognition, the product may be deleted from the occupant management table. Further, when the return operation to the return-only box is detected, the returned product may be verified in the same manner as the product verification in the first embodiment.

  On the other hand, if the available balance is not negative, the process proceeds to step SC8 to execute the commodity price settlement process.

  Specifically, the exchange required amount calculated in step SC6 (corresponding to the difference between the available amount and the available remaining amount) and the card ID being received by the card reader / writer 15 are specified, and the specified exchange required amount is dealt with. The number of counting balls to be calculated, a subtraction request including the calculated number of counting balls and the specified card ID is transmitted to the management computer, and the number of counting balls managed in association with the card ID in the management computer From this, the number of counting balls is subtracted and updated. In response to receiving the subtraction completion notification from the management computer, the count ball number included in the subtraction request is subtracted from the count ball data stored in the count card being received by the card reader / writer 15. Rewrite and update the data with the new number of balls. If the card being accepted is a membership card, the counting ball number data is not stored in the card, so the counting ball number data is not rewritten and updated.

  When the number of balls with different rates is stored in the occupant management table, one of the rates, for example, the number of balls with a 1 yen rate is used preferentially, and the ball with the preferred 1 yen rate is used. What is necessary is to subtract the shortage from the number of balls at the 4-yen rate. In addition, when the number of balls with the preferred 1 yen rate is insufficient, the player is informed that the number of balls with the 1 yen rate is insufficient, and the shortage is counted from the number of balls at the 4 yen rate. You may make it accept from a player whether it may be used.

  In response to the reception of the subtraction completion notification from the management computer, the gift exchange computer 10 'resets all the product IDs and quantities stored in the occupant management table in association with the card ID of the card being received. (Erase), the prize exchange history of the prize exchange is additionally stored in the prize exchange history data, and a receipt printed with the breakdown of the prize exchange is issued from the printing apparatus 108.

  Then, the process proceeds to step SC9, where it is determined from the card ID, for example, whether or not the card being received is a counting card. If the card is not a counting card, that is, if it is a membership card, the process proceeds to step SC13. Is returned (discharged) from the card reader / writer 15.

  On the other hand, in the case of a counting card, it is determined whether or not the available amount corresponding to the new number of counting balls updated and stored in the card is equal to or greater than the minimum replacement amount.

  If it is equal to or greater than the minimum exchange amount, the process proceeds to step SC13, and the counting card is returned (discharged) from the card reader / writer 15. On the other hand, if it is not equal to or less than the minimum exchange amount, the process proceeds to step SC11. The data is collected by the reader / writer 15.

  And it progresses to step SC12, and after deleting the data of the card ID which returned or numbered, the number of balls of each rate corresponding to this card ID, the amount of money available, and the amount of money remaining available, it goes to step SC12. Return to the standby state of SS1 to SS7.

  In addition, since the player who completes these payments leaves the exit from the exit with the products for which payment has been completed, the above-mentioned exit information is input in response to these exits, and the player ID of the player who has left the room Is deleted from the room attendee management table, and the player image stored when the player enters the room is also deleted.

  Further, as described above, when the player or the store clerk performs the end motion, the end motion information is input from the motion recognition processing board 111, and the input of the end motion information is detected in step SS6 and the settlement in step SS16 is performed. Processing (FIG. 18) is performed.

  In this settlement process, as shown in FIG. 18, first, it is determined whether or not the available balance corresponding to the card ID stored in the occupant management table at that time is negative (step SE1).

  If the available balance is negative, that is, if the exchange amount cannot be settled for all products due to a shortage of the available amount, the process proceeds to step SE7, and the display device 107 and the player display 16 are A message indicating that the product price cannot be settled is displayed, and the process ends.

  On the other hand, if the available balance is not negative, the process proceeds to step SE8 to execute the commodity price settlement process.

  More specifically, the difference between the card ID of the counting card being accepted and the available amount stored in association with the card ID and the available remaining amount in the occupant management table at that time, that is, is taken out. In addition, the total amount of each product (premium) multiplied by the exchange amount is specified, the number of counting balls corresponding to the specified total amount is calculated, and the calculated number of counting balls and the specified card ID Is sent to the management computer, and the counting ball number is subtracted and updated from the counting ball number managed in association with the card ID in the management computer. In response to receiving the subtraction completion notification from the management computer, the count ball number included in the subtraction request is subtracted from the count ball data stored in the count card being received by the card reader / writer 15. Rewrite and update the data with the new number of balls. If the card being accepted is a membership card, the counting ball number data is not stored in the card, so the counting ball number data is not rewritten and updated.

  When the number of balls with different rates is stored in the occupant management table, one of the rates, for example, the number of balls with a 1 yen rate is used preferentially, and the ball with the preferred 1 yen rate is used. What is necessary is to subtract the shortage from the number of balls at the 4-yen rate.

  In response to the reception of the subtraction completion notification from the management computer, the gift exchange computer 10 'resets all the product IDs and quantities stored in the occupant management table in association with the card ID of the card being received. (Erase), the prize exchange history of the prize exchange is additionally stored in the prize exchange history data, and a receipt printed with the breakdown of the prize exchange is issued from the printing apparatus 108.

  Then, the process proceeds to step SE3, and it is determined from the card ID, for example, whether or not the accepted card is a counting card. If the card is not a counting card, that is, if it is a membership card, the process proceeds to step SE8 and the membership card. Is returned (discharged) from the card reader / writer 15.

  On the other hand, in the case of a counting card, it is determined whether or not the available amount corresponding to the new number of counting balls updated and stored in the card is equal to or greater than the minimum replacement amount.

  If it is equal to or greater than the minimum replacement amount, the process proceeds to step SE8, where the counting card is returned (discharged) from the card reader / writer 15. On the other hand, if it is not greater than the minimum replacement amount, the process proceeds to step SE8. The data is collected by the reader / writer 15.

  And it progresses to step SE6, and after deleting the data of the card ID which returned or numbered, the number of balls of each rate corresponding to this card ID, the amount of money available, and the amount of money remaining available, from the room management table The process is terminated and the process returns to the standby state of steps SS1 to SS7.

  In addition, since the player who completes these payments leaves the exit from the exit with the products for which payment has been completed, the above-mentioned exit information is input in response to these exits, and the player ID of the player who has left the room Is deleted from the room attendee management table, and the player image stored when the player enters the room is also deleted.

  As described above, according to the second embodiment, since the player's own take-out operation is recognized, the player (player) can immediately examine a product (prize) desired to be exchanged for a transaction. Therefore, it is possible not only to significantly reduce the occurrence of product mistakes, but also to eliminate the trouble of instructing the store clerk about the products that are desired to be exchanged.

  Further, according to the second embodiment, an abnormal behavior, an operation of leaving the premium exchange room without carrying out the checkout, that is, taking out illegal goods (shoplifting) outside the premium exchange room or the store is notified. Therefore, it is possible to take an appropriate response to taking out these illegal products.

  In addition, according to each of the above embodiments, it is not necessary to provide a prize exchange computer or an imaging unit for each store clerk or player who is the target of motion detection. It is possible to reliably avoid the repeated storage and settlement of merchandise (premiums) taken out by the same store clerk and the same player in the computer.

  In addition, according to each of the above embodiments, the exchange required amount that is the sum of the transaction value of the extracted product (premium) is the use value that the player (transactioner) owns. Whether payments can be made with the available amount is informed based on whether the remaining available amount is negative or not, so that the store clerk and the player can accurately grasp whether or not the product has been taken out excessively. Therefore, the efficiency of merchandise transactions can be improved by taking out the merchandise so that these notifications are not made.

  In addition, according to each of the embodiments, by returning a part of the extracted product (premium), the memory as the extracted product in the premium exchange correspondence table or the occupant management table of the returned product (premium) is deleted. Therefore, it is not necessary to return all the products that have been taken out and take them out again, so that the efficiency of the product transaction can be improved.

  Although the embodiments of the present invention have been described with reference to the drawings, the specific configuration is not limited to these embodiments, and modifications and additions within the scope of the present invention are included in the present invention. It is.

  For example, in the above embodiment, a game hall is illustrated as a store, but the present invention is not limited to this, and as these stores, for example, a store with a loud environmental sound, for example, a cheer like a baseball field, etc. Small stores that are installed in facilities with high environmental noise and provide food and drinks, small stores that are installed in places where train noise such as stations are loud, and karaoke and discos Stores where large music and the like are played may be used, and in these stores, sales of merchandise correspond to transactions instead of gift exchanges.

  Moreover, in the said Example, although the form which alert | reports whether it is exchangeable by the available money amount which a player owns was illustrated, this invention is not limited to this, For example, the display in Example 1 In the shelf 14, for example, an exchangeable product is identified by the available remaining amount at that time, and, for example, provided in the exchangeable product storage box 40 so that a store clerk or a player can grasp the identified product. The lighting may be turned on.

  Moreover, in the said Example 2, although the form which only alert | reports whether the goods which the player took out with the amount of available money is exchangeable was illustrated, this invention is not limited to this, These alerting | reporting In this case, for example, a product to be taken that falls within the range of the available amount by returning 1 may be specified and displayed on the player display 16 as a return candidate product.

  In the above embodiment, the prize exchange history is not transmitted to the outside. However, the present invention is not limited to this, and the prize exchange computers 10, 10 ′ are externally connected in the settlement process. By transmitting to the management device, the prize exchange computers 10, 10 'may have the function of a POS terminal.

  In the second embodiment, the card reader / writer 15, the player display 16 and the prize exchange computer 10 are arranged on the counter table 2 ′, and after the player has taken out the product, The player is brought to the counter table 2 ′ and inserted into the card reader / writer 15 by inserting his / her counting card or membership card into the card reader / writer 15 so as to notify the player whether or not the exchange is possible. The present invention is not limited to this. For example, a card reader / writer 15 is installed at the entrance, and a counting card or a membership card is inserted into the card reader / writer 15 when entering the prize exchange room. The available amount owned by the player who entered the room can be specified before the player takes out the merchandise, and the player who has entered the room On the other hand, a product tray or the like that can receive and output a voice message transmitted from the wireless intercom or the intercom communicator 17 in the first embodiment is distributed, and in the same manner as in the first embodiment, according to the removal of the product. You may be made to notify each player of the remaining balance.

  Moreover, in the said Example, although the form which collates goods by an image was illustrated, this invention is not limited to this, For example, RF-ID by which the goods ID of the said goods was memorize | stored in all goods A product with a tag attached and an RF-ID tag reader provided for each storage box 40 so that the product ID read from the RF-ID tag attached to the product to be taken out is identified by the player's take-out operation. You may make it collate whether it corresponds with ID.

  In the second embodiment, the store clerk is arranged on the counter table 2 ′ installed at the exit so that the store clerk can check the goods brought by the player. However, the present invention is limited to this. For example, without assigning these store clerk, for example, the weight of each product is stored in the product management table, and a digital weighing scale is installed on the counter table 2 ', and the player brings it. When the total weight of products is measured and the total weight calculated from each product registered in the occupant management table and the number of products is compared with the measured total weight, and the weights match within a certain error range May be confirmed OK, but if they do not match within a certain error range, a confirmation NG is informed so that the commodity exchange computer 10 'can confirm the commodity.

  In the above-described embodiment, the form in which data is stored in advance in the product management table is illustrated. However, the present invention is not limited to this, and for example, a predetermined operation is performed on the gift exchange computers 10 and 10 ′. After the execution, the mode of the gift exchange computers 10 and 10 ′ is shifted to the product display mode, and the product ID to be displayed is input, and then the product is displayed on the display shelf 14 or the storage boxes 40 of the display shelves A to D. Thus, the number of the storage box 40 in which the input product ID is stored may be specified and automatically registered in the product management table. In this case, as in the case of taking out the product, whether or not the product specified from the inputted product ID matches the product actually stored (displayed) is based on the product image. You may make it collate. Further, the product ID may be input to the free gift exchanging computer 10, 10 ′ by reading a barcode attached to the product or reading an RF-ID tag attached to the product. good.

  Moreover, in the said Example, in order to make easy the comparison with the exchangeable amount based on each number of balls of the rate of several 1 yen and 4 yen, the magnitude | size required for exchange with each premium (product) Is stored in the merchandise management table as the exchange amount, but the present invention is not limited to this. For example, when the rate at the amusement hall is only a 4 yen rate, each prize ( The amount of value necessary for exchange with the product) is stored in the product management table as the number of exchanged balls, and the number of available balls based on the number of counting balls, the number of possessed balls or the number of stored balls specified from the membership card or counting card You may be made to exchange prizes (goods) based on the number of exchange balls of each goods.

  Further, in the first embodiment, in the take-out product registration process, if the input take-out operation information includes a store clerk ID of “0000” indicating a person other than the store clerk, unauthorized take-out of the product by a person other than the store clerk is performed. By carrying out the unauthorized take-out notification process to notify that it has occurred, the occurrence of unauthorized take-out of products by a person other than the store clerk is notified, but the present invention is not limited to this, for example, Even if the clerk ID is included in the input retrieval operation information, it is determined whether or not the clerk ID is the clerk ID of the clerk who is serving the customer at each corresponding port. If it is not the clerk ID of the clerk who is doing the service, a notification mode in the case of illegal takeout by a person other than the clerk that the clerk other than the clerk who handles the customer service has taken out the product It may be notified in a different manner.

2 Counter table 10 Premium exchange computer 10 ′ Premium exchange computer 11 Imaging unit 11a Infrared light emitting unit 11b Infrared imaging unit 11c Visible light imaging unit 12 Imaging unit 12a Infrared light emitting unit 12b Infrared imaging unit 12c Visible light imaging unit 13 Imaging unit 13a Infrared light emitting unit 13b Infrared imaging unit 13c Visible light imaging unit 14 Display shelf 15 Card reader / writer 15a-c Card reader / writer 16 Player display 16a-c Player display 17 Incom communicator 18 Wireless intercom 102 CPU (Central Processing Unit)
105 Storage Device 107 Display Device 111 Action Recognition Processing Board

Claims (1)

A merchandise transaction apparatus that conducts transactions of merchandise taken out by a trader from among a plurality of types of merchandise that are installed in a store and displayed in such a manner that the merchandise can be taken out.
A transaction imaging means for imaging the transaction;
A take-out operation recognizing unit for recognizing a take-out operation of taking out the product based on an image captured by the transaction image capturing unit;
Based on the recognition result of the take-out operation by the take-out operation recognizing means, take-out product specifying means for specifying the product taken out by the trader who has performed the take-out operation;
Transaction product storage means for storing the product specified by the extracted product specification means as a transaction product;
A settlement unit that settles the transaction value of the transaction product stored in the transaction product storage unit;
A product transaction apparatus comprising:

Images