JP6177122B2 - Product sales data processing apparatus and program - Google Patents

Description

  Embodiments described herein relate generally to a merchandise sales data processing apparatus and a program.

  Conventionally, stores such as supermarkets and convenience stores have a range in which products can be operated in product sales data processing devices such as POS (Point of Sales) terminals and electric cash registers (ECR) that process product information of products to be sold. (That is, the operation authority) is restricted by the operator. For example, store managers and manager-class operators are given the operating authority to aggregate sales in stores, whereas shop assistants such as part-time workers are only given the operating authority to process product information. .

  By changing the key used for the apparatus depending on the operator or by changing the information of the ID card carried by the operator, the operation authority of each operator in the merchandise sales data processing apparatus is changed. Then, the merchandise sales data processing apparatus is activated by each key or ID card, and a processing range permitted in advance corresponding to the operation authority is set in the merchandise sales data processing apparatus.

  However, when keys are exchanged between operators, there is a problem that the merchandise sales data processing device cannot be set in a processing range that is permitted in advance in accordance with the operation authority suitable for the operators. The same problem occurs when the ID card is exchanged.

  The problem to be solved by the present invention is to provide a merchandise sales data processing apparatus and program capable of setting the merchandise sales data processing apparatus in a processing range that is permitted in advance in accordance with the operation authority adapted to the operator. It is to be.

The product sales data processing apparatus according to the embodiment includes an input unit that inputs a result of face recognition processing performed based on a face image captured by an imaging device, and at least a part of processing related to product sales and management. executing means for executing a setting means for setting the processing range permitted in advance corresponding to the entered face recognition processing result, the processing at the set processing range by the setting means by said input means, operation Absence detection means for detecting whether or not a person is absent, and second face recognition processing input by the input means before the absence detection is continuously detected for a predetermined time or more after the absence is detected by the absence detection means. A first operation prohibiting unit that puts the device into a first operation prohibition state when the result does not match the result of the face recognition process input at the time of setting the processing range; and the absence detection In the case where the absence is continuously detected for a predetermined time or more after the absence is detected by the stage, the second operation prohibiting means for setting the device to the second operation prohibited state, and the prohibited state by the second operation prohibiting means, A release means for releasing the second operation prohibition state when a result of the third face recognition process input by the input means matches a result of the face recognition process input at the time of setting the processing range; Storage means for storing the result of the third face recognition process when the result of the third face recognition process does not match the result of the face recognition process input at the time of setting the processing range; .

The program according to the embodiment includes: an input unit that inputs a result of face recognition processing performed on a computer based on a face image captured by an imaging device; and at least a part of processing related to product sales and management. A setting unit that sets a pre-permitted processing range corresponding to the result of the face recognition process input by the input unit; an execution unit that executes the processing within the processing range set by the setting unit; and an operator A result of the second face recognition process input by the input unit before detecting the absence for a predetermined time or more after the absence is detected by the absence detection unit. The first operation prohibiting means that puts the device in a first operation prohibited state when the result does not match the result of the face recognition process input at the time of setting the processing range, and the absence In the case where the absence is continuously detected for a predetermined time or more after the absence is detected by the output means, the second operation prohibiting means for setting the device to the second operation prohibited state, and the prohibited state by the second operation prohibiting means Release means for canceling the second operation prohibition state when the result of the third face recognition process input by the input means matches the result of the face recognition process input when the processing range is set. Storage means for storing the result of the third face recognition process when the result of the third face recognition process does not match the result of the face recognition process input at the time of setting the processing range; Make it work.

FIG. 1 is a perspective view illustrating an appearance of a POS terminal according to an embodiment. FIG. 2 is a block diagram showing a hardware configuration of the POS terminal. FIG. 3 is a memory map showing an example of the file structure of the memory unit of the POS terminal. FIG. 4 is a memory map showing an example of the file structure of the RAM of the POS terminal. FIG. 5 is a functional block diagram showing a functional configuration of the POS terminal. FIG. 6 is a flowchart showing the flow of control processing of the POS terminal. FIG. 7 is a flowchart showing the flow of control processing of the POS terminal. FIG. 8 is a flowchart showing the flow of control processing of the POS terminal. FIG. 9 is a flowchart showing the flow of control processing of the POS terminal.

  Hereinafter, with reference to FIGS. 1 to 9, the merchandise sales data processing apparatus and program according to the embodiment will be described in detail. In the embodiment, a POS terminal will be described as a merchandise sales data processing apparatus. In addition, this invention is not limited by embodiment described below.

  FIG. 1 is a perspective view illustrating an appearance of a POS terminal according to an embodiment. In FIG. 1, the POS terminal 1 has a main body 2 and a money storage box 3. The money storage box 3 has a drawer, and stores banknotes, money of money deposited from customers, securities such as gift certificates, and changes handed over to customers.

  The main body 2 is provided with an operation unit 17 such as a keyboard, an operator display unit 18 for displaying information to the operator, and a customer display unit 19 for displaying information to the customer. The main body 2 includes a reading unit 20 that reads a code such as a barcode or a two-dimensional code attached to a product. Moreover, the main body 2 includes a printing unit 21 that prints product information. Further, the main body 2 includes a camera 221 that captures an image on the upper part of the outer frame of the operator display unit 18.

  Next, the hardware of the POS terminal 1 will be described with reference to FIGS. FIG. 2 is a block diagram showing a hardware configuration of the POS terminal 1. In FIG. 2, a POS terminal 1 includes a central processing unit (CPU) 11 serving as a control entity, a read only memory (ROM) 12 that stores various programs, a random access memory (RAM) 13 that develops various data, and various programs. The CPU 11, the ROM 12, the RAM 13, and the memory unit 14 are connected to each other via a data bus 15. The CPU 11, ROM 12, and RAM 13 constitute the control unit 100. That is, the control unit 100 executes a control process to be described later when the CPU 11 operates in accordance with a control program 141 stored in the ROM 12 or the memory unit 14 and expanded in the RAM 13.

  The RAM 13 has a timer 136. In addition, various programs such as the control program 141 stored in the memory unit 14 are expanded. Furthermore, it has various memory | storage parts shown in FIG.

  The memory unit 14 is a non-volatile memory such as an HDD (Hard Disc Drive) or a flash memory that retains stored information even when the power is turned off, and stores a program including the control program 141. The memory unit 14 stores a product master 143 and a face master 142 (see FIG. 3).

  An operation unit 17, an operator display unit 18, a customer display unit 19, a reading unit 20, a printing unit 21, and an imaging unit 22 are connected to the data bus 15 via the controller 16.

  The operation unit 17 includes various keys including a closing key 171, numeric keys, function keys, and the like. The closing key 171 is a key operated to end one transaction.

  The operator display unit 18 is installed with the display surface facing an operator such as a store clerk, and displays information to the operator. The operator display unit 18 includes a backlight 181 that brightens the display surface. The backlight 181 is configured by, for example, an LED (Light Emitting Diode) provided on the back side of the display surface.

  The customer display unit 19 is installed with the display surface facing the customer, and displays information to the customer. The customer display unit 19 includes a backlight 191 that brightens the display surface. The backlight 191 is configured by, for example, an LED or the like provided on the back side of the display surface.

  The reading unit 20 is constituted by a CCD (Charge Coupled Devices) image sensor or the like, and reads a barcode such as a barcode or a two-dimensional code attached to a product by receiving it with the CCD, and inputs a product code. The example of FIG. 1 is a handy-type reading unit 20, and the operator reads the code by bringing the reading unit 20 taken in his hand close to or in contact with the product code. The reading unit 20 may be a scanner configured to scan light emitted by a polygon mirror or the like and receive light reflected by a code.

  The printing unit 21 prints merchandise information, settlement information, and the like on a roll-shaped receipt sheet installed in the main body 2 by using, for example, a thermal printer equipped with a thermal transfer type print head, and issues it as a receipt.

  The imaging unit 22 includes a camera 221 configured with a CCD (Charge Coupled Devices) or the like. The camera 221 is provided in the upper part of the outer frame of the operator display unit 18. The imaging unit 22 captures an image of an object (for example, an operator) located in front of the camera 221.

  The data bus 15 is connected to a connection I / F (Interface) 23 that is electrically connected to a store server (not shown) installed in the store. The connection I / F 23 is connected to the line 24. The store server is electrically connected to all POS terminals 1 installed in the store, and collects product information and settlement information from each POS terminal 1. The store server transmits the product information and payment information collected from the POS terminal 1 to a headquarter server (not shown) installed in the headquarters.

  FIG. 3 is a memory map showing the face master 142 of the memory unit 14. In FIG. 3, the face master 142 includes an operator code part 1421, an operator information part 1422, an authority information part 1423, and a face information part 1424.

  The operator code unit 1421 stores an operator code that identifies the operator of the POS terminal 1. The POS terminal 1 can be signed in by inputting the operator code. The operator information unit 1422 stores various types of information (name, address, age, career, etc.) of the operator specified by the operator code. The authority information unit 1423 stores information indicating the range of operation authority given to the operator specified by the operator code in the operation of the POS terminal 1.

  In the example of FIG. 3, the authority range has three stages of A, B, and C. The operation authority “A” performs all processes that can be processed by the POS terminal 1, such as merchandise information processing related to merchandise sales, settlement processing, merchandise inventory management processing related to merchandise management, settlement processing for managing sales, and inspection processing. Permission to execute. This authority is an authority given to a manager or manager who operates the store.

  The operation authority “B” is an authority for managing product sales and stock status in a store, such as product information processing related to product sales, return processing, settlement processing, product inventory management processing related to product management, etc. This authority is given to mid-level managers who are entrusted with merchandise management at the store, etc. This operation authority “B” is more than the operation authority “A”. Not given.

  The operation authority “C” is an authority that can execute a merchandise sales process related to sales of merchandise in the store, such as a process of merchandise information related to merchandise sales and a settlement process. This authority is an authority given to a practitioner who performs product sales such as a part-time job. This operation authority “C” is not given operation authority related to merchandise management, such as return processing and inventory management processing, compared to operation authority “B”.

  The authority information section 1423 stores information on any of these authorities “A”, “B”, and “C” corresponding to the operator code. In the example of FIG. 3, since the operator with the operator code “001” is the store manager, the operation authority “A” is stored corresponding to the operator code “001”. Since the operator with the operator code “002” is a mid-level manager of the store, the operation authority “B” is stored in correspondence with the operator code “002”. Since the operators with the operator code “003” and the operator code “004” are part-time clerk, “C” is stored as the operation authority corresponding to the operator code “003” and the operator code “004”. ing.

  The face information unit 1424 stores face information of the operator in advance corresponding to the operator code. The face information is information indicating a feature and a relative relationship for each part of the face (for example, the shape of eyes, nose, cheek bone, chin, etc.).

  FIG. 4 is a memory map showing a part of the RAM 13. 4, the RAM 13 includes a first face information storage unit 131, a product information storage unit 132, a second face information storage unit 133, a mismatch storage unit 134, and an authority storage unit 135.

  The first face information storage unit 131 captures the face information obtained as a result of capturing an image of an operator who operates a sign-in key (not shown) by the image capturing unit 22 and performing face recognition using a known face recognition technique. When the face information stored in the face information section 1424 of the master 142 matches, the face information of the operator who has signed in is stored.

  Sign-in means that the POS terminal 1 that has been turned on is brought into a state in which operations such as product information processing are possible, and an operator who operates the POS terminal is registered in the POS terminal 1.

  The face recognition technique is a known technique for automatically identifying a person from a digital image of a captured face. For example, the face is recognized as follows. That is, a human face is recognized by extracting a prominent feature from the captured face image. For example, the human face is recognized using the relative positions and sizes of the parts of the face, and facial features such as the shape of eyes, nose, cheekbones, and jaws as features. Information obtained by the face recognition technique is face information.

  The face information stored in the first face information storage unit 131 stores the characteristics of each part of the face. The merchandise information storage unit 132 stores the merchandise information read from the merchandise master 143 corresponding to the merchandise code input based on the barcode read by the reading unit 20 in one transaction.

  The second face information storage unit 133 stores the face information that has been imaged by the imaging unit 22 during the pause and whose face has been recognized. The disagreement storage unit 134 compares the face information stored in the first face information storage unit 131 with the face information stored in the second face information storage unit 133, and stores a second face information storage if they do not match. The face information stored in the unit 133 is stored and saved. The authority storage unit 135 reads and stores the operation authority of the operator who has signed in and whose face information is stored in the first face information storage unit 131 from the authority information unit 1423 of the face master 142.

  Subsequently, the control processing of the POS terminal 1 will be described with reference to FIGS. FIG. 5 is a functional block diagram showing a functional configuration of the POS terminal. When the control unit 100 follows various programs including the control program 141 stored in the ROM 12 or the memory unit 14, the input unit 101, the setting unit 102, the execution unit 103, the absence detection unit 104, the first operation prohibition unit 105, (2) The operation prohibiting means 106, the releasing means 107, and the storage means 108 are caused to function.

  The input unit 101 has a function of inputting a result of face recognition processing performed based on the face image captured by the imaging unit 22.

  The setting means 102 is the first input by the input means 101 for at least a part of processing related to sales and management of products (for example, product information processing, settlement processing, inventory management processing, checkout processing, inspection processing, etc.). For example, it has a function of setting a pre-permitted processing range corresponding to, for example, face information obtained as a result of one face recognition process.

  The execution unit 103 has a function of executing processing within the processing range set by the setting unit 102.

  The absence detection means 104 has a function of detecting whether or not the operator is absent.

  The first operation prohibiting unit 105 sets the processing range based on the result of the second face recognition process input by the input unit 101 before continuously detecting the absence for a predetermined time or more after the absence is detected by the absence detecting unit 104. If the result of the first face recognition process that is sometimes input does not match, the apparatus has a function of placing the device in a first operation prohibited state.

  The second operation prohibiting unit 106 has a function of placing the device in the second operation prohibited state when the absence detecting unit 104 detects the absence for a predetermined time or longer.

  When the result of the third face recognition process input by the input unit 101 matches the result of the first face recognition process input at the time of setting the processing range in the prohibited state by the second operation prohibiting unit 106 And a function of canceling the second operation prohibited state.

  The storage unit 108 has a function of storing the result of the third face recognition process when the result of the third face recognition process and the result of the first face recognition process input at the time of setting the processing range do not match. .

  FIG. 6 is a flowchart showing a flow of control processing of the POS terminal 1 when newly registering the operator's face information in the face master 142. In FIG. 6, the control unit 100 determines whether or not an operator code for specifying the operator is input from the operation unit 17 (step S11). The controller 100 waits until it is input (No in step S11), and determines that the operator code has been input (Yes in step S11), the control unit 100 determines that the input operator code is the operator of the face master 142. It is determined whether it is stored in the code part 1421 (step S12).

  When it is determined that the information is stored (Yes in step S12), the control unit 100 receives information indicating the operation authority of the operator (any one of the operation authorities “A” to “C”) input from the operation unit 17. Are stored in correspondence with the inputted operator code (step S13). And the control part 100 images the image containing the operator's face which input the operation code using the imaging part 22 (step S14). And the control part 100 inputs the imaged image. Subsequently, the control unit 100 executes face recognition processing on the input image, and stores the resulting face information in the face information unit 1424 (step S15). Then, the control unit 100 ends the process.

  On the other hand, when it is determined in step S12 that the input operator code is not stored in the operator code portion 1421 of the face master 142 (No in step S12), the control unit 100 determines whether the memory code in the memory unit 14 is predetermined. It is determined whether or not an operator code is registered in an area (not shown) (step S16). In the predetermined area, an operator code of an operator who is permitted to operate the POS terminal 1 is stored. If the operator code input in the predetermined area is stored, the face master 142 stores the operator code. It is possible to register as a new operator.

  When it is determined that the operator code is registered in the predetermined area of the memory unit 14 (Yes in Step S16), the control unit 100 newly inputs the entered operator code in the operator code unit 1421 of the face master 142. Register (step S17). And the control part 100 performs step S13 and subsequent steps.

  When it is determined that the operator code input in the predetermined area of the memory unit 14 is not registered (No in step S16), the control unit 100 operates the POS terminal 1 with the input operator code. Therefore, an error process such as displaying an error message on the operator display unit 18 is executed (step S18). Then, the control unit 100 ends the process.

  7 to 9 are flowcharts showing the flow of control processing when signing in to the POS terminal 1, when the apparatus shifts to the hibernation mode, and when returning from the hibernation mode. In FIG. 7, the control unit 100 first executes the sign-in process shown in FIG. 8 (step S21).

  In FIG. 8, the control unit 100 determines whether or not a sign-in key (not shown) provided in the operation unit 17 has been operated (step S91). The sign-in key is a key operated when the operator starts sign-in processing on the POS terminal 1.

  The control unit 100 waits until it is operated (No in step S91), and determines that the sign-in key has been operated (Yes in step S91), the control unit 100 activates the camera 221 provided in the imaging unit 22 (step S92). ). And the control part 100 judges whether the imaging part 22 imaged the operator (step S93).

  The control unit 100 waits until the image is captured (No in step S93), and if it is determined that the image is captured (Yes in step S93), the control unit 100 performs the face recognition process (first face recognition process) based on the captured image. Execute (Step S94). Specifically, the control unit 100 executes face detection processing for determining whether or not a face is included in the captured image, and when determining that the face is included, the control unit 100 subsequently Face recognition processing is executed on the detected face.

  Then, the control unit 100 determines whether face recognition has been performed (step S95). When it is determined that the face has been recognized (Yes in step S95), the control unit 100 compares the face information obtained as a result of recognition with a plurality of pieces of face information stored in the face master 142 (step S96). As a result of the comparison, it is determined whether there is face information in the face master 142 that matches the face information recognized in step S95 (step S97). When it is determined that there is (Yes in step S97), the control unit 100 (input unit 101) stores the recognized face information as a result of the face recognition process in the first face information storage unit 131 together with the corresponding operator code. Store (step S98).

  Next, the control unit 100 reads out the operation authority information corresponding to the stored face information or operator code from the authority information unit 1423 (step S99). Then, the control unit 100 (setting unit 102) sets the read operation authority information in the authority storage unit 135 (step S100). Then, the control unit 100 (execution unit 103) executes the sign-in process of the POS terminal 1 in accordance with the stored operator code and authority (step S101). In the signed POS terminal 1, the control unit 100 (execution means 103) issues a process within a processing range corresponding to the operation authority. The POS terminal 1 cannot execute processing exceeding the operation authority. Then, the control unit 100 proceeds to step S31.

  When it is determined in step S97 that there is no face information that matches the face information recognized in step S95 (No in step S97), the control unit 100 displays a message indicating that the face information does not match. Error processing such as display on the display unit 18 is executed (step S103). Then, the control unit 100 ends the sign-in process.

  When it is determined in step S95 that face recognition cannot be performed (No in step S95), the control unit 100 performs error processing such as displaying a message indicating that face recognition cannot be performed on the operator display unit 18. Execute (Step S102). Then, the control unit 100 returns to step S92 and repeats imaging by the imaging unit 22.

  Returning to the description of FIG. When the sign-in process is completed in step S21, the control unit 100 next determines whether or not a product code is input from the reading unit 20 (step S31). If it is determined that a product code has been input (Yes in step S31), the control unit 100 reads product information from the product master 143 corresponding to the input product code and stores it in the product information storage unit 132 (step S31). S32). Then, the control unit 100 returns to step S31 and waits.

  When determining that the product code has not been input (No in step S31), the control unit 100 determines whether or not the tightening key 171 provided in the operation unit 17 has been operated (step S41). If it is determined that it has been operated (Yes in step S41), the control unit 100 executes a settlement process based on the product information stored in the product information storage unit 132 and the amount information input from the operation unit 17 ( Step S42). Then, the control unit 100 ends the process.

  In the settlement process, the total amount and change are calculated based on the product information stored in the product information storage unit 132 and the input deposit amount information, and the product information, total amount information, deposit amount information, and change amount information are calculated. Or the like is printed on a receipt sheet by the printing unit 21 and a receipt is issued. The payment process includes a process of transmitting the product information, the payment information, etc. stored in the product information storage unit 132 to a store server (not shown).

  In Step S41, when it is determined that the tightening key 171 provided on the operation unit 17 is not operated (No in Step S41), the control unit 100 (absence detection unit 104) is imaged by the imaging unit 22. Based on the obtained image, it is determined whether or not the presence of a person is detected in the image (step S51). If it is determined that a person is present (Yes in step S51), the control unit 100 returns to step S31 and waits.

  On the other hand, when it is determined that a person is not present (that is, absent) (No in step S51), the control unit 100 starts the timer 136 (step S52). Then, the control unit 100 determines whether or not the timer 136 has passed a predetermined time 1 (for example, 1 minute) while continuously detecting the absence of a person (step S53).

  When it is determined that the predetermined time has elapsed (Yes in Step S53), the control unit 100 turns off the backlight 181 of the operator display unit 18 and the backlight 191 of the customer display unit 19 (Step S54). .

  Then, the control unit 100 determines whether or not the timer 136 has passed a predetermined time 2 (for example, 3 minutes) while continuously detecting the absence of a person (step S55). When it is determined that the predetermined time has elapsed (Yes in step S55), the control unit 100 (second operation prohibiting means 106) sets the POS terminal 1 to the sleep mode state (second operation prohibited state) (step S55). S56).

  The hibernation mode means that most of the control of the POS terminal 1 is interrupted to enter a standby state, and the operation is disabled. For example, the display of the operator display unit 18 and the customer display unit 19 is set to a non-display state. The reading unit 20 emits no light. The energization to the print head of the printing unit 21 is stopped to release the remaining heat state. The operator cannot input from the operation unit 17 or the reading unit 20. However, at least the control unit 100 and the imaging unit 22 maintain the operating state. The imaging unit 22 continues imaging in the vicinity where the operator exists.

  Next, the control unit 100 determines whether or not the presence of a person has been detected in the image captured by the image capturing unit 22 in the pause mode state (step S57). It waits until it judges that it detected (No of step S57), and when it judges that it detected (Yes of step S57), the control part 100 performs the face recognition process (3rd face recognition) about the detected person's image. Process) is executed (step S58).

  FIG. 9 shows details of the face recognition process in step S58. In FIG. 9, the control unit 100 performs face recognition processing similar to that in step S94 (step S111). And the control part 100 judges whether the face was recognized (step S112). If it is determined that it has been recognized (Yes in step S112), the control unit 100 stores the recognized face information in the second face information storage unit 133 (step S113). And the control part 100 transfers to the process of step S59.

  On the other hand, when determining that the face could not be recognized (No in Step S112), the control unit 100 determines whether Step S111 and Step S112 are repeated a predetermined number of times (Step S114). If it is determined that it has not been repeated (No in step S114), the control unit 100 returns to step S111, and repeats the processing in step S111 and the determination in step S112 until the predetermined number of times is reached.

  On the other hand, if it is determined that the process has been repeated a predetermined number of times (Yes in step S114), the control unit 100 displays information indicating that the face cannot be recognized on the operator display unit 18 (step S115). Then, the control unit 100 ends the process.

  Returning to the description of FIG. Next, the control unit 100 compares the face information stored in the second face information storage unit 133 with the face information stored in the first face information storage unit 131 (step S59). And the control part 100 judges whether both matched as a result of the comparison (step S60).

  If it is determined that they match (Yes in step S60), the control unit 100 (release means 107) cancels the sleep mode of the POS terminal 1 (step S61). That is, for example, the display of the operator display unit 18 and the customer display unit 19 is restored, and the backlight 181 and the backlight 191 are turned on. The preliminary energization to the printing unit 21 is resumed. Other hibernates are also restored. Next, the control unit 100 resets the timer 136 (step S62). Then, the control unit 100 returns to step S31 and waits.

  On the other hand, when it is determined in step S60 that the face information stored in the second face information storage unit 133 does not match the face information stored in the first face information storage unit 131 (No in step S60), the control unit 100 Since the person who recognized the face in step S58 may be a different person from the person who signed in in step S101, for example, there may be a suspicious person, the control unit 100 stores the second face information storage unit 133 in the second face information storage unit 133. The stored face information is stored and saved in the mismatch storage unit 134 (step S63). Then, the control unit 100 sounds an alarm (not shown) to notify that face authentication has been performed for a person different from the person who has signed in (step S64).

  If it is determined in step S53 that the predetermined time 1 has not elapsed (No in step S53), the control unit 100 subsequently determines whether or not the presence of a person has been detected (step S81). If it is determined that it has not been detected (No in step S81), the control unit 100 returns to step S53 and waits. When the timer 136 detects the presence of a person before the predetermined time 1 has elapsed in step S81 (Yes in step S81), the control unit 100 executes a face recognition process (second face recognition process) ( Step S82). The face recognition process in step S82 is the same as the face recognition process in step S58, and the process in FIG. 9 is executed. Then, after the process of step S113 is completed, the control unit 100 compares the face information stored in the second face information storage unit 133 with the face information stored in the first face information storage unit 131. And the control part 100 judges whether both matched as a result of the comparison (step S83).

  If it is determined that they match (Yes in step S83), the control unit 100 proceeds to the process in step S62. If it is determined that they do not match (No in step S83), the controller 100 may recognize that the person who recognized the face in step S82 is a different person from the person who signed in in step S101. Since there is also a possibility, the control unit 100 stores and stores the face information stored in the second face information storage unit 133 in the mismatch storage unit 134 (step S84). Then, the control unit 100 (first operation prohibiting means 105) places the POS terminal 1 in a locked state (first operation prohibited state) (step S85).

  The locked state is a state in which an input from the operation unit 17 or the reading unit 20 by an operator is prohibited and the POS terminal 1 is not operable.

If it is determined in step S55 that the predetermined time 2 has not elapsed (No in step S55), the control unit 100 subsequently determines whether or not the presence of a person has been detected (step S71). If it is determined that it has not been detected (No in step S71), the control unit 100 returns to step S55 and waits. When the timer 136 detects the presence of a person before the predetermined time 2 has elapsed in step S71 (Yes in step S71), the control unit 100 executes face recognition processing (third face recognition processing) ( Step S72). The face recognition process in step S72 is the same as the face recognition process in step S58, and the process in FIG. 9 is executed. And after the process of step S113 is complete | finished, the control part 100 is the 2nd face information storage part 1.
The face information stored in 33 and the face information stored in the first face information storage unit 131 are compared, and it is determined whether or not they match as a result of the comparison (step S7 3 ).

If it is determined that the matched (Yes in step S7 3), the control unit 100 turns on the backlight 181 and the backlight 191 off at step S54 (step S7 4). And the control part 100 transfers to the process of step S62. If it is determined that they do not match (No in step S7 3), the control unit 100, the person who face recognition in step S72 may be a person different from the person may sign in step S101, for example, a suspicious person Therefore, the control unit 100 stores and stores the face information stored in the second face information storage unit 133 in the mismatch storage unit 134 (step S7 5 ). And the control part 100 (1st operation prohibition means 105) makes the POS terminal 1 a locked state (step S76 ). Then, the control unit 100 ends the process.

  According to such an embodiment, since the sign-in process is executed based on the result of the face recognition process so that the sign-in process can be performed within the processing range corresponding to the operation authority registered in advance, The POS terminal can be operated within an operation range suitable for the user.

  Further, according to the embodiment, based on the image captured by the imaging unit 22, the POS terminal 1 is put into the sleep mode when the absence of the operator continues for a predetermined time. It is possible to prevent the terminal 1 from entering the sleep mode.

  Further, according to the embodiment, since the POS terminal 1 can be canceled only when the POS terminal 1 is in the pause mode and is the same person as the person who has signed in as a result of the face recognition, security can be ensured.

  In addition, according to the embodiment, when it is determined that the POS terminal 1 is not in the pause mode and the person who is signed in as a result of face recognition is not the same person, the pause mode is not canceled, so that the security of the apparatus can be ensured. In this case, since the control unit 100 is notified by an alarm, for example, an unauthorized operation by a suspicious person can be checked in advance.

  Further, according to the embodiment, it is detected that no person is present, and the backlight is turned off or the sleep mode is set after a predetermined time has elapsed, so that a power saving (energy saving) effect can be obtained.

  As mentioned above, although embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  For example, in the embodiment, the face master 142 is provided in the memory unit 14 of the POS terminal 1, but a face master is provided in a store server installed in the POS terminal 1 or a headquarter server installed in the headquarters, and a plurality of face masters are provided. In response to an inquiry from the POS terminal 1, face information may be transmitted from a face master provided in the server.

  In the embodiment, the face authentication process is executed by the POS terminal 1, but may be executed by a store server or a headquarter server.

  In the embodiment, the sleep mode is used as the operation prohibited state. However, the present invention can be applied to an operation prohibited state other than the sleep mode such as the standby mode or the standby mode.

  The program executed by the merchandise sales data processing apparatus of the embodiment is a file in an installable or executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), or the like. And recorded on a computer-readable recording medium.

  Further, the program executed by the merchandise sales data processing apparatus of the embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program executed by the product sales data processing apparatus of the embodiment may be provided or distributed via a network such as the Internet.

  Further, the program executed by the merchandise sales data processing apparatus of the embodiment may be configured to be provided by being incorporated in advance in a ROM or the like.

1 POS terminal 11 CPU
13 RAM
14 memory unit 22 imaging unit 100 control unit 101 input unit 102 setting unit 103 execution unit 104 absence detection unit 105 first operation prohibition unit 106 second operation prohibition unit 107 release unit 108 storage unit 131 first face information storage unit 133 second Face information storage unit 142 Face master 1423 Authority information unit

JP 2009-230682 A

Claims (3)

An input means for inputting a result of face recognition processing performed based on a face image captured by the imaging device;
Setting means for setting a pre-permitted processing range corresponding to the result of the face recognition process input by the input means for at least some of the processes related to sales and management of products;
Execution means for executing the processing within the processing range set by the setting means;
Absence detection means for detecting whether the operator is absent;
The face recognition that the result of the second face recognition process input by the input unit before the absence is continuously detected for a predetermined time or more after the absence is detected by the absence detection unit is input when the processing range is set. A first operation prohibiting means for placing the device in a first operation prohibited state when the result of the processing does not match,
A second operation prohibiting unit that places the device in a second operation prohibited state when the absence is detected continuously by the absence detecting unit after a predetermined time has been detected;
When the result of the third face recognition process input by the input means coincides with the result of the face recognition process input when setting the processing range in the prohibited state by the second operation prohibiting means, the second A release means for releasing the operation prohibition state of
Storage means for storing the result of the third face recognition process when the result of the third face recognition process and the result of the face recognition process input at the time of setting the processing range do not match;
Product sales data processing device with Storing processing range information for specifying the pre-permitted processing range specified by the result;
The merchandise sales data processing device according to claim 1, wherein the setting unit sets the processing range based on the processing range information stored corresponding to a result input by the input unit. Computer
An input means for inputting a result of face recognition processing performed based on a face image captured by the imaging device;
Setting means for setting a pre-permitted processing range corresponding to the result of the face recognition process input by the input means for at least some of the processes related to sales and management of products;
And execution means that perform the processing at a set processing range by the setting means,
Absence detection means for detecting whether the operator is absent;
The face recognition that the result of the second face recognition process input by the input unit before the absence is continuously detected for a predetermined time or more after the absence is detected by the absence detection unit is input when the processing range is set. A first operation prohibiting means for placing the device in a first operation prohibited state when the result of the processing does not match,
A second operation prohibiting unit that places the device in a second operation prohibited state when the absence is detected continuously by the absence detecting unit after a predetermined time has been detected;
When the result of the third face recognition process input by the input means coincides with the result of the face recognition process input when setting the processing range in the prohibited state by the second operation prohibiting means, the second A release means for releasing the operation prohibition state of
Storage means for storing the result of the third face recognition process when the result of the third face recognition process and the result of the face recognition process input at the time of setting the processing range do not match;
Program to function as a.

Images