JP6794144B2 - Operation input device, sales data processing device and program - Google Patents

Description

Embodiments of the present invention relate to operation input devices, sales data processing devices and programs.

The operation screen of a device that can be operated by an unspecified number of people is generally the one that uses the standard language at the destination of the device. However, the language used by the operator of the device may differ from its standard language. Therefore, the above-mentioned device prepares a plurality of operation screens corresponding to a plurality of languages and an object such as a button for instructing the change, and responds to the operation of the object by the operator. It is possible to display it selectively.
In general, operators of such devices are likely to use a standard language. And for such an operator, it is not necessary to switch the operation screen, and the frequency of operating the above object is not so high. For this reason, the above objects may have an inconspicuous appearance.
However, if the object for language switching has an inconspicuous appearance, there is a problem that the operability of the operator who requires language switching is deteriorated.

Japanese Unexamined Patent Publication No. 2001-118147

The problem to be solved by the embodiment of the present invention may be that language switching is necessary while making the object for language switching have an normally inconspicuous appearance and for the convenience of an operator who does not need language switching. It is to provide the operator with an operation input device, a vending device, and a program that can easily find an object for language switching.

The operation input device of the embodiment includes a display device, a first control means, an object, a second control means, a determination means, and a change means. The first control means causes the display device to display one of a plurality of operation screens associated with each of the plurality of languages. The object is for the operator to operate in order to instruct the change of the operation screen. The second control means causes the display device to display one of the plurality of operation screens associated with each of the plurality of languages, which is designated by the operator, after the object is operated by the operator. The determination means is a language associated with the operation screen displayed on the display device by the first control means and the second control means or the operation screen displayed on the display device by the first control means. but the degree operator is language used is determined based on the face image obtained by photographing the face of the operator. Changing means, visibility of about the degree to which it is determined Ri by the judgment means is small object is to change the appearance of the object to increase.

The block diagram which shows the main part circuit composition of the self-checkout apparatus which concerns on embodiment. The figure which shows an example of the table in FIG. The flowchart of the control processing by a CPU in FIG. The figure which shows an example of the image displayed on the screen of the touch panel in FIG. The figure which shows an example of the image displayed on the screen of the touch panel in FIG. The figure which shows an example of the image displayed on the screen of the touch panel in FIG.

Hereinafter, the operation input device according to the embodiment will be described with reference to the drawings.

In the embodiment, a self-checkout device will be described as an example of a device having a built-in operation input device.
FIG. 1 is a block diagram showing a main circuit configuration of the self-checkout device 1 according to the embodiment. The self-checkout device 1 is installed in a store and registers and setstles purchased products according to operations by shoppers. The self-checkout device 1 is an example of a sales data processing device provided with an operation input device. The self-checkout device 1 includes a CPU (central processing unit) 11, a main memory 12, an auxiliary storage device 13, a touch panel 14, a scanner 15, a camera 16, a motion sensor 17, and a bus 18.

The CPU 11 corresponds to a central part of a computer that performs processing and control necessary for the operation of the self-checkout device 1. The CPU 11 controls each part in order to realize various functions of the self-checkout device 1 based on a program such as an operating system and application software stored in the main memory 12.

The main memory 12 corresponds to the main memory portion of the computer. The main memory 12 stores programs such as the operating system and application software. Further, the main memory 12 stores data referred to when the CPU 11 performs various processes. Further, the main memory 12 is used as a so-called work area for storing data temporarily used by the CPU 11 for performing various processes.

The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. The auxiliary storage device 13 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), an SSD (solid state drive), or the like. The auxiliary storage device 13 stores data used by the CPU 11 to perform various processes, data generated by the process of the CPU 11, and the like. The auxiliary storage device 13 may store a program such as the above operating system or application. The auxiliary storage device 13 stores the table T.

FIG. 2 is a diagram showing an example of the table T. Table T associates language groups and features with each of the plurality of races. Races are shown as race 1, race 2, ..., race k in FIG. 2, but specifically, for example, race 1, race 2, ..., race k is ... Mongoloids, Negroids and Caucasians. Alternatively, for example, race 1, race 2, ..., Race k is Japanese, British, Chinese, or the like. Race is not limited to these, and various classifications can be used. Language groups represent one or more representative languages used by the corresponding race. For example, if the race is Mongoloid, the language group indicates Japanese, Chinese, Korean, and so on. Also, for example, if the race is Japanese, the language group indicates Japanese. The feature quantity is a numerical representation of the average facial features of the corresponding race.

The auxiliary storage device 13 also stores the set language. The setting language indicates a language mainly displayed on the touch panel 14. As the setting language, the language most used in the area where the self-checkout device 1 is sold is set as the default language by the designer or the seller of the self-checkout device 1. For example, if the self-checkout device 1 is for sale in Japan, the default language is usually Japanese. The setting language is changed by the CPU 11 when a change instruction is given by the administrator of the self-checkout device 1.

The main memory 12 or the auxiliary storage device 13 also stores a product list, which is a list of products registered as purchased products.

The program stored in the main memory 12 or the auxiliary storage device 13 includes a control program described for the control process described later. As an example, the self-checkout device 1 is transferred to the user in a state where the control program is stored in the main memory 12 or the auxiliary storage device 13. However, the self-checkout device 1 may be transferred to the user in a state where the control program is not stored in the main memory 12 or the auxiliary storage device 13. Then, the control program separately transferred to the user may be written to the main memory 12 or the auxiliary storage device 13 under the operation of the user, the serviceman, or the like. The transfer of the control program at this time can be realized by recording on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, or a semiconductor memory, or by downloading via a network.

The touch panel 14 functions as a display device that displays a screen for notifying the operator of the self-checkout device 1 of various information. Further, the touch panel 14 functions as an input device that accepts a touch operation by the operator.

The scanner 15 reads the barcode displayed on the product and outputs the product code represented by the barcode.

The camera 16 captures the face of the operator. As the camera 16, either a camera that captures a still image or a video camera that captures a moving image can be used. The camera 16 may be capable of capturing both still images and moving images.

The motion sensor 17 is provided to detect that a person is in close proximity to the self-checkout device 1. As the motion sensor 17, various sensors such as an optical sensor, an infrared sensor, and an ultrasonic sensor can be used. It should be noted that image recognition using the camera 16 may detect that a person is in close proximity. In this case, it is not enough to provide the motion sensor 17.

The bus 18 includes an address bus, a data bus, and the like, and transmits signals sent and received by each part of the self-checkout device 1.

The operation of the self-checkout device 1 will be described with reference to FIG. The content of the process described below is an example, and various processes capable of obtaining similar results can be appropriately used.

In Act 1, the CPU 11 resets the product list stored in the main memory 12 or the auxiliary storage device 13. That is, the CPU 11 instructs the main memory 12 or the auxiliary storage device 13 so that the product is not registered in the product list.

In Act2, the CPU 11 stores the language stored in the auxiliary storage device 13 as the setting language in the main memory 12 as the language used for displaying the operation screen. For example, if the set language is Japanese, Japanese is stored in the main memory 12 as the language to be used.

The operator stands in front of the self-checkout device 1 to operate the self-checkout device 1. Then, the motion sensor 17 detects the operator.
In Act3, the CPU 11 waits for the motion sensor 17 to detect that a person is in close proximity to the self-checkout device 1. If the CPU 11 detects that a person is in close proximity as described above, the CPU 11 determines Yes in Act 3 and proceeds to Act 4.

In Act 4, the CPU 11 instructs the camera 16 to take an image. In response to this instruction, the camera 16 takes an image of the operator and outputs an image.

In Act 5, the CPU 11 uses the image captured in Act 4 to perform a determination process for determining the degree to which the language stored as the language used in the main memory 12 is the language used by the captured operator. The CPU 11 performs the determination process as follows as an example. First, the CPU 11 calculates the feature amount of the operator's face reflected in the image. Then, the CPU 11 acquires from the table T the average facial feature amount of the race that uses the language stored as the language to be used in the main memory 12. After that, the CPU 11 calculates the difference between the feature amount calculated from the operator's face and the feature amount acquired from the table T. For example, if Japanese is stored in the main memory 12 as the language used by the CPU 11, the feature amount calculated from the operator's face and the average face of Mongoloid or Japanese who use Japanese are used. Calculate the difference from the feature amount. The smaller this difference is, the closer the operator's face is to the average face of a race that uses the language stored as the language used in the main memory 12. That is, the smaller the difference, the higher the possibility that the race of the operator is the race that uses the language stored as the language used in the main memory 12. Further, the fact that the race of the operator is likely to be a race that uses the language stored as the language used in the main memory 12 means that the operator uses the language stored as the language used in the main memory 12. It means that there is a high possibility of doing so. When there are a plurality of races that use the language stored as the language to be used in the main memory 12, the CPU 11 calculates the difference for, for example, the most representative race among them. The representative race is, for example, predetermined by the designer or seller of the self-checkout device 1. Alternatively, for example, the CPU 11 calculates a difference for each of a plurality of races, and sets the average value or the minimum value as the difference obtained by this Act5. As described above, by performing the Act5 process, the computer centered on the CPU 11 operates as a determination means. The CPU 11 sets the difference to 0 when the face is not shown in the image captured by Act4.

In Act 6, the CPU 11 determines whether or not the language stored as the language used in the main memory 12 is the same as the language used by the operator. That is, when the difference calculated by Act 5 is equal to or less than a predetermined value, the CPU 11 determines that the language stored as the language used in the main memory 12 is the same as the language that the operator is likely to use. .. If the language stored as the language used in the main memory 12 is the same as the language used by the operator, the CPU 11 determines Yes in Act 6 and proceeds to Act 7.

In Act 7, the CPU 11 generates an image corresponding to the first top screen SC1a as shown in FIG. 4, and instructs the touch panel 14 to display this image. In response to this instruction, the touch panel 14 displays the first top screen SC1a.

FIG. 4 is a diagram showing an example of the first top screen SC1a. A language stored as a language used in the main memory 12 is mainly used for the first top screen SC1a. The first top screen SC1a is an example in which Japanese is stored as the language used in the main memory 12. The first top screen SC1a includes a button B1a, a button B2, and an area S. Button B1a is touched by the operator when changing the language displayed on the touch panel. In this example, the character string displayed on the button B1a is English regardless of the language stored in the main memory 12 as the language used. This is because English is a language that is likely to be read even by a person whose mother tongue is other than English. The button B1a is an example of an object operated by the operator to instruct the change of the operation screen. Button B2 is touched by the operator when the registration of the purchased product is completed. In the area S, a list of products registered in the product list is displayed.
When the Act7 process is performed without going through the Act15 process described later, the language stored as the language used in the main memory 12 is a language stored in advance as the set language in the auxiliary storage device 13. Therefore, the first top screen SC1a displayed when the Act7 process is performed without passing through the Act15 process is a predetermined one of the plurality of operation screens associated with each of the plurality of languages. Is. Thus, by performing the processing of Act7 without passing through the processing of Act15, the computer centered on the CPU 11 operates as the first control means.

On the other hand, if the language stored as the language to be used in the main memory 12 is not the same as the language that the operator is likely to use, the CPU 11 determines No in Act 6 and proceeds to Act 8.
In Act 8, the CPU 11 generates an image corresponding to the second top screen SC1b as shown in FIG. 5, and instructs the touch panel 14 to display this image. In response to this instruction, the touch panel 14 displays the second top screen SC1b.

FIG. 5 is a diagram showing an example of the second top screen SC1b. The same elements as those in FIG. 4 are designated by the same reference numerals. A language stored as a language to be used in the main memory 12 is mainly used for the second top screen SC1b. The second top screen SC1b shows the second top screen SC1b which is an example in the case where Japanese is stored as the language used in the main memory 12. The second top screen SC1b includes a button B1b, a button B2, and an area S. Button B1b is touched by the operator when changing the language displayed on the touch panel. In this example, the character string displayed on the button B1b is English regardless of the language stored in the main memory 12 as the language used. This is because English is a language that is likely to be read even by a person whose mother tongue is other than English. The button B1b is an example of an object operated by the operator to instruct the change of the operation screen. Compared to the button B1a, the button B1b has a larger size and a character size of the character string, and has a double border. As described above, the appearance of the button B1a and the button B1b, which are examples of the objects, are different. Therefore, by performing the processes of Act6 to Act8, the computer centered on the CPU 11 operates as a changing means for changing the appearance of the object. The first top screen SC1a and the second top screen SC1b are the same except for the buttons B1a and the buttons B1b. The CPU 11 generates an image of the button B1b corresponding to the second top screen SC1b so that the larger the difference calculated by Act5, the higher the visibility. For example, the CPU 11 increases the size of the button B1b as the difference increases, or changes the color of the button B1b to a color with higher visibility as the difference increases. Both the size and the color may be changed.
When the Act 8 is processed, the language stored as the language to be used in the main memory 12 is a language stored in advance as the set language in the auxiliary storage device 13. Therefore, the second top screen SC1b is a predetermined one of the plurality of operation screens associated with each of the plurality of languages. Thus, by performing the processing of Act8, the computer centered on the CPU 11 operates as the first control means.

The CPU 11 proceeds to Act9 after the processing of Act7 or Act8.
In Act9, the CPU 11 confirms whether or not an operation for changing the language has been performed. That is, the CPU 11 confirms whether or not the button B1a or the button B1b is touched. If the operation of changing the language is not performed, the CPU 11 determines No in Act9 and proceeds to Act10.

In Act10, the CPU 11 confirms whether or not the product code has been read. That is, the CPU 11 confirms whether or not the barcode attached to the product has been read by the scanner 15. If the product code is not read, the CPU 11 determines No in Act 10 and proceeds to Act 11.

In Act 11, the CPU 11 confirms whether or not the operation of completing the registration of the product has been performed. That is, the CPU 11 confirms whether or not the button B2 is touched. It should be noted that the operation rule for instructing the completion of registration is to perform the operation after registering one or more products. The operation of the CPU 11 when an operation for instructing the completion of registration is performed in a state where the product is not registered may be determined by the designer of the control program of the CPU 11. For example, the CPU 11 ignores the operation of instructing the completion of registration. Alternatively, the CPU 11 may not be able to perform the operation itself for instructing the completion of registration when the product is not registered. If the operation for instructing the completion of registration is not performed, the CPU 11 determines No in Act 11 and returns to Act 9. Thus, the CPU 11 repeats Act9 to Act11 until an operation of changing the language is performed, a product code is read, or an operation of instructing registration completion is performed. If the operation of changing the language is performed while in the standby state of Act9 to Act11, the CPU 11 determines Yes in Act9 and proceeds to Act12.

In Act 12, the CPU 11 generates an image corresponding to the selection screen SC2 as shown in FIG. 6, and instructs the touch panel 14 to display this image. In response to this instruction, the touch panel 14 displays the selection screen SC2.

FIG. 6 is a diagram showing an example of the selection screen SC2. The selection screen SC2 includes a button B3 and a button B4-1 to a button B4-8. The button B3 is touched by the operator when canceling the language change and returning to the first top screen SC1a or the second top screen SC1b. Buttons B4-1 to B4-8 are touched when the operator specifies a desired language. In FIG. 4, as an example, buttons B4-1 to buttons B4-8 are associated with English, French, German, Spanish, Portuguese, Japanese, Korean, and Chinese, respectively. In FIG. 6, eight buttons B4-1 to B4-8 are touched when the operator specifies a desired language, but the number of buttons is not limited to eight. On the selection screen, a number of buttons are displayed according to the number of languages that can be selected.

In Act 13, the CPU 11 confirms whether or not an operation for selecting a language has been performed. That is, the CPU 11 confirms whether or not a predetermined operation such as touching any of the buttons B4-1 to B4-8 has been performed. If the operation of selecting the language is not performed, the CPU 11 determines No in Act 13 and proceeds to Act 14.

In Act 14, the CPU 11 confirms whether or not the operation of returning to the top screen has been performed. That is, the CPU 11 confirms whether or not a predetermined operation such as touching the button B3 has been performed. Thus, the CPU 11 repeats Act 13 and Act 14 until an operation of selecting a language is performed or an operation of returning to the top screen is performed. If the operation of selecting a language is performed while the Act13 and the Act14 are in the standby state, the CPU 11 determines Yes in the Act13 and proceeds to the Act15.

In Act 15, the CPU 11 changes the language stored as the language used in the main memory 12 to the language selected in Act 13. For example, if the button B4-1 associated with English is touched by the operator, English is stored in the main memory 12 as the language to be used. The CPU 11 returns to Act7 after the processing of Act15. Here, the language selected by the operator in Act 13 is stored in the main memory 12 as the language to be used. Further, the CPU 11 generates an image corresponding to the first top screen in which the language stored as the language used in the main memory 12 is mainly used. Then, the CPU 11 instructs the touch panel 14 to display the image. As a result, the touch panel 14 displays the first top screen corresponding to the language stored as the language used in the main memory 12. Here, the language stored as the language used in the main memory 12 is one language designated by the operator from among the plurality of languages. That is, the first top screen displayed here is one designated by the operator among the plurality of operation screens associated with each of the plurality of languages. Therefore, by performing the processing of Act7 after the processing of Act15, the computer centered on the CPU 11 operates as the second control means.

If the operation of stopping the language selection is performed while the Act13 and the Act14 are in the standby state, the CPU 11 determines Yes in the Act14 and returns to the Act6.

If the product code is read while in the standby state of Act9 to Act11, the CPU 11 determines Yes in Act10 and proceeds to Act16.

In Act 16, the CPU 11 instructs the main memory 12 or the auxiliary storage device 13 to add the read product code to the product list.

In Act 17, the CPU 11 updates the screen in order to display the product newly registered in Act 16 in the area S. That is, the CPU 11 generates an image corresponding to the first top screen SC1a or the second top screen SC1b so that the newly registered products are included in the list of products displayed in the area S. Then, the CPU 11 instructs the touch panel 14 to display this image. In response to this instruction, the touch panel 14 displays the first top screen SC1a or the second top screen SC1b.
The CPU 11 returns to Act9 after the processing of Act17.

When the registration of the product to be settled for one transaction is completed, the operator performs an operation for completing the registration of the product.
If the operation for instructing the completion of registration is performed while the Act9 to Act11 are in the standby state, the CPU 11 determines Yes in Act11 and proceeds to Act18.

In Act 18, the CPU 11 performs payment processing using cash, a credit card, a debit card, or the like for the products registered in the product list. Since a well-known process can be applied to the settlement process, the description thereof will be omitted. The CPU 11 returns to Act1 after the processing of Act18.

According to the self-checkout device 1, the buttons B1a and B1b for changing the language depending on whether the language mainly displayed on the touch panel 14 and the language that the operator is likely to use correspond to or do not correspond to each other. The appearance of is changed. The language mainly displayed on the touch panel 14 is a language stored as a language used in the main memory 12 here. Therefore, for the operator who is unlikely to need language switching, by displaying the button B1a having a relatively low visibility, the operator who does not need language switching can be convenient. Further, for the operator who may need to switch the language, by displaying the button B1b having a relatively high visibility, the operator can be made aware that the button B1b exists.

According to the self-checkout device 1, the more likely the language used by the operator and the language displayed on the display device are different, the more prominently the button for changing the language is displayed. Therefore, it is possible to prevent the button from being excessively conspicuous to the operator who does not need to change the language.

According to the self-checkout device 1, by changing the size or color of the button for changing the language, it is possible to make it easier for the operator who may need to switch the language to find the button. ..

The above embodiment can be modified as follows.

Regarding the method of determining race, "Race estimation technology by face image (recognition of face and gesture)", IEICE Technical Report. HIP, Human Information Processing 103 (454), 19-24, 2003-11-13 "," Face Image Racial Estimation Using Average Face Proof Space Base ", Proceedings of the General Conference of the Society of Electronics, Information and Communication Engineers 2005_ Information Systems (2), 221, 2005-03-07 ”and“ Automatic Racial Estimation Technology Using Face Images: Feature Extraction Learned from Human Visuals and Application of SVM ”, Omron technologies 44 (1), 12- 16, 2004 ”and so on. The CPU 11 uses known methods such as those described in these to determine the degree to which the language stored as the language used in the main memory 12 is the language used by the captured operator. May be done. Further, the CPU 11 may determine what language the operator is likely to use by determining the race of the operator using a known method. Then, the CPU 11 changes the appearance of the buttons B1a and B1b for changing the language depending on whether the language that is likely to be used by the operator and the language stored as the language used in the main memory 12 are the same or different. You may.

The CPU 11 may return to Act 5 after the processing of Act 15. In this case, by performing the process of Act8 after the process of Act15, the computer centered on the CPU 11 operates as the second control means.

When there are two types of languages that can be selected, when the button B1a or button B1b displayed on the first top screen or the second top screen is touched, they are mainly displayed without displaying the selection screen. Language may be changed. For example, when only Japanese and English can be selected, each time the button B1a or the button B1b is pressed, the language mainly used on the top screen is switched between Japanese and English alternately. In order to realize this, for example, the CPU 11 processes as follows. After the processing of Act9, the CPU 11 skips the processing of Act12 to Act14 and performs the processing of Act15. In this case, the button B1a or the button B1b is touched when the operator specifies a desired language. The character string displayed on the button B1a or the button B1b is a language name.

When the difference is larger than a predetermined value, the CPU 11 may further improve the visibility by using a method such as blinking the button B1b or moving the button B1b.

Buttons B4-1 to B4-8 on the selection screen SC2 may be arranged in order from the one corresponding to the language most likely to be used by the operator. In order to realize this, for example, the CPU 11 processes as follows. The CPU 11 performs the same processing as Act 5 for each of the languages associated with the buttons B4-1 to B4-8. Next, the CPU 11 ranks the buttons B4-1 to B4-8 in ascending order of the difference value calculated for each language, and the buttons B4-1 to the buttons B4-1 to the positions associated with the respective ranks. Place B4-8. By doing so, it is possible for the operator to easily find the button associated with the language that the operator wants to select.

A hardware element such as a key switch may be applied as an object operated by the operator to instruct a change in the operation screen. In this case, for example, a light emitting diode or the like may be embedded in the key switch, and the CPU 11 may turn off the diode in Act7 and turn it on in Act8.

In the embodiment, the self-checkout device 1 is shown as an example of a device having a built-in operation input device. However, in all the devices in which the operator can select the language displayed on the display device, it is possible to implement the device as a device having a built-in operation input device. For example, in a semi-self-type checkout device in which a clerk or the like performs a product registration operation and a shopper specifies a payment method and pays for the product price, it can be performed as a device with a built-in operation input device. Is. The semi-self checkout device is an example of a sales data processing device. In addition, as a device that allows the operator to select the language displayed on the display device, an operation input device is used in sales data processing devices such as vending machines and ticket vending machines, copiers, and ATMs (automatic teller machines). Can be implemented as a built-in device. Further, in a device in which a passerby is an operator and displays information related to route guidance on a display device, it can be implemented as a device having a built-in operation input device. Since the processes of Act1, Act10, Act11 and Act16 to Act18 are processes specific to the self-checkout device 1, the processes are not performed when the processes are performed as devices other than the self-checkout device 1. Then, processing specific to the device is performed. The sales data processing device having a built-in operation input device processes data related to sales according to the operation input by the operation input device. By performing this processing, the computer centered on the CPU included in the sales data processing device operates as a processing means.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof.
Hereinafter, the inventions described in the claims of the original application of the present application will be added.
[1]
Display device and
A first control means for displaying a predetermined one of a plurality of operation screens associated with each of the plurality of languages on the display device, and
An object operated by the operator to instruct the change of the language associated with the operation screen, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
Regarding the operation screen displayed on the display device by the first control means, the face of the operator is determined whether the language associated with the operation screen is a language that the operator is likely to use. Judgment means to judge based on the photographed face image,
An operation input device including changing means for changing the appearance of the object on condition of a determination result by the determination means.
[2]
The determination means is an operation screen of an operation screen displayed on the display device by the first control means and the second control means or an operation screen displayed on the display device by the first control means. The degree to which the language associated with is the language used by the operator is determined.
The operation input device according to Appendix [1], wherein the changing means changes the appearance of the object so that the smaller the degree of determination by the determining means is, the higher the visibility of the object is.
[3]
The operation input device according to Appendix [1] or Appendix [2], wherein the changing means changes the appearance of the object by changing at least one of the size and color of the object.
[4]
The determination means determines the degree of the language used by the operator for each of the plurality of languages.
The second control means has a plurality of buttons associated with each of a plurality of languages for selecting an operation screen to be displayed on the display device on condition that the object has been operated by the operator. The operation input device according to any one of the appendices [1] to [3], wherein the display device is displayed in an array according to the degree of determination by the determination means.
[5]
The operation input device according to any one of the appendices [1] to [4] and the operation input device.
A sales data processing device including a processing means for processing data related to sales according to an operation input by the operation input device.
[6]
A computer provided with an operation input device including a display device and an object operated by an operator to instruct a language change associated with an operation screen.
A first control means for displaying a predetermined one of the plurality of operation screens associated with each of the plurality of languages on the display device, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
Regarding the operation screen displayed on the display device by the first control means, the face of the operator is determined whether the language associated with the operation screen is a language that the operator is likely to use. Judgment means to judge based on the photographed face image,
A program for functioning as a changing means for changing the appearance of the object on condition of a determination result by the determining means.

1 ... Self-checkout device, 11 ... CPU, 12 ... Main memory, 13 ... Auxiliary storage device, 14 ... Touch panel, 15 ... Scanner, 16 ... Camera, 17 ... Human sensor, 18 ... Bus.

Claims (6)

Display device and
A first control means for displaying a predetermined one of a plurality of operation screens associated with each of the plurality of languages on the display device, and
An object operated by the operator to instruct the change of the language associated with the operation screen, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
The operation screen displayed on the display device by the first control means and the second control means or the operation screen displayed on the display device by the first control means is associated with the operation screen. language, degree and a determination means based on the face image obtained by photographing the face of the operator is Rugen word use the operator,
Wherein the changing means the smaller the degree of Ri is determined by the determining means to change the appearance of the object so visibility is increased in the object comprises an operation input device. Display device and
A first control means for displaying a predetermined one of a plurality of operation screens associated with each of the plurality of languages on the display device, and
An object operated by the operator to instruct the change of the language associated with the operation screen, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
For the first operation screen displayed on the display device by the control means, for each of a plurality of languages associated with the operation screen, the degree of the operator is Rugen word use, the operator Judgment means to judge based on the face image of the face
A changing means for changing the appearance of the object is provided on the condition of the determination result by the determining means .
The second control means has a plurality of buttons associated with each of a plurality of languages for selecting an operation screen to be displayed on the display device on condition that the object has been operated by the operator. Is displayed on the display device in an array according to the degree of determination by the determination means . The operation input device according to claim 1 or 2, wherein the changing means changes the appearance of the object by changing at least one of the size and color of the object. The operation input device according to any one of claims 1 to 3 ,
A sales data processing device including a processing means for processing data related to sales according to an operation input by the operation input device. A plurality of computers provided with an operation input device including a display device, an object operated by an operator to instruct an operator to change a language associated with an operation screen, and a plurality of computers associated with each of a plurality of languages. A first control means for displaying a predetermined one of the operation screens on the display device, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
The operation screen displayed on the display device by the first control means and the second control means or the operation screen displayed on the display device by the first control means is associated with the operation screen. language, degree and a determination means based on the face image obtained by photographing the face of the operator is Rugen word use the operator,
The changing means for changing the appearance of the object so visibility is increased enough the determined degree is smaller the object Ri by the determining means, programmed to function with. A plurality of computers provided with an operation input device including a display device, an object operated by an operator to instruct an operator to change a language associated with an operation screen, and a plurality of computers associated with each of a plurality of languages. A first control means for displaying a predetermined one of the operation screens on the display device, and
After the object is operated by the operator, a second control means for causing the display device to display one of a plurality of operation screens associated with each of the plurality of languages, which is designated by the operator. When,
For the first operation screen displayed on the display device by the control means, for each of a plurality of languages associated with the operation screen, the degree of the operator is Rugen word use, the operator Judgment means to judge based on the face image of the face
On condition of the determination result by the determination means, the object is made to function as a change means for changing the appearance of the object .
The second control means has a plurality of buttons associated with each of a plurality of languages for selecting an operation screen to be displayed on the display device on condition that the object has been operated by the operator. Is displayed on the display device in an array according to the degree of determination by the determination means .