JP7268670B2 - Information processing device, control method, and program - Google Patents

Description

The present invention relates to an information processing device, control method, and program.

Sales clerks and the like in the hospitality industry are required to perform various actions at the time of accounting processing in accordance with predetermined manuals and the like. Patent Literatures 1 and 2 disclose techniques for analyzing voice data of a voice uttered by a store clerk and determining whether or not a predetermined utterance is made.
Some store clerks, etc., do not fully understand the customer service work that should be performed at the time of checkout, and are unable to act as prescribed in the manual. The customer service level improves with work experience, but non-regular workers such as part-time workers engaged in accounting work at stores such as convenience stores and supermarkets are in flux, and it is important for stores to maintain the customer service level at the time of accounting. I am in a difficult situation. The techniques disclosed in Patent Literatures 1 and 2 evaluate the customer service level of the salesclerk based on the salesclerk's remarks, but do not disclose a technique for supporting customer service at the time of checkout.

JP 2004-192545 A JP-A-7-37170

The present invention has been made in view of the above problems. An object of the present invention is to provide technology for assisting users .

An information processing apparatus provided by the present invention includes display means for displaying a display representing a predetermined action performed by a customer before the predetermined action ;
detection means for detecting the predetermined behavior of the customer ;
Control means for changing or deleting display of the predetermined action when the predetermined action is detected by the detection means;
a recognition means for recognizing a customer ,
The display means displays a different display of the predetermined action according to the recognized customer , or determines whether or not to display the predetermined action according to the recognized customer ,
The recognition means recognizes the customer by analyzing a captured image of the customer , recognizing the customer 's voice by voice, or reading the customer 's card.

The control method provided by the present invention is executed by a computer. The control method includes a display step of displaying a display representing a predetermined action performed by the customer before the predetermined action ;
a detection step of detecting the predetermined behavior of the customer ;
a control step of changing or deleting display of the predetermined action when the predetermined action is detected by the detecting step;
a recognition step of recognizing the customer ;
The displaying step displays a different display according to the recognized customer , or determines whether or not to display the predetermined action according to the recognized customer ,
The recognition step recognizes the customer by analyzing an image of the customer, recognizing the voice of the customer , or reading the customer 's card.

A program provided by the present invention is a program that causes a computer to operate as an information processing apparatus provided by the present invention.

ADVANTAGE OF THE INVENTION According to this invention, the technique which supports customer service at the time of payment is provided.

The above objectives, as well as other objectives, features and advantages, will become further apparent from the preferred embodiments described below and the accompanying drawings below.

1 is a block diagram illustrating an information processing apparatus according to Embodiment 1 together with its usage environment; FIG. 4 is a flowchart illustrating the flow of processing executed by the information processing apparatus of Embodiment 1; 2 is a diagram conceptually illustrating a hardware configuration example of the information processing apparatus according to the first embodiment; FIG. It is a figure which illustrates the 1st display screen where the 1st display is displayed. It is a figure which illustrates 1st detection information in a table form. It is a figure which illustrates the 1st display changed by the 1st control part. FIG. 3 is a block diagram illustrating an information processing apparatus according to a second embodiment together with its usage environment; 8 is a flowchart illustrating the flow of processing executed by the information processing apparatus of the second embodiment; FIG. 11 is a block diagram illustrating an information processing apparatus according to a third embodiment together with its usage environment; 14 is a flowchart illustrating the flow of processing executed by the information processing apparatus of the third embodiment; FIG. 11 is a block diagram illustrating an information processing apparatus according to a fourth embodiment together with its usage environment; 14 is a flowchart illustrating the flow of processing executed by the information processing apparatus of the fourth embodiment; It is a figure which illustrates the 1st display information which shows a 1st display for every predetermined period in a table form. 14 is a flowchart illustrating the flow of processing executed by the information processing apparatus of the fifth embodiment; FIG. 11 is a block diagram illustrating an information processing apparatus according to a sixth embodiment together with its usage environment; It is a figure which illustrates the 1st display information which matched the customer's attribute and the 1st display in a table form. 14 is a flowchart illustrating the flow of processing executed by the information processing apparatus of Embodiment 6; FIG. 12 is a block diagram illustrating an information processing apparatus according to a seventh embodiment together with its usage environment; It is a figure which illustrates the 2nd detection information in a table form. 19 is a flowchart illustrating the flow of processing for controlling the first display, which is executed by the information processing apparatus of Embodiment 7; 19 is a flowchart illustrating the flow of processing for controlling the second display, which is executed by the information processing apparatus of Embodiment 7; It is a figure which shows the structural example of a POS register apparatus. It is a figure which shows the structural example of a POS system.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, in all the drawings, the same constituent elements are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[Embodiment 1]
FIG. 1 is a block diagram illustrating an information processing apparatus 2000 according to the first embodiment together with its usage environment. In FIG. 1, arrows represent the flow of information. Furthermore, in FIG. 1, each block does not represent the configuration in units of hardware, but the configuration in units of functions.

The information processing device 2000 has a first display section 2020 , a first detection section 2040 and a first control section 2060 . The first display unit 2020 displays on the first display screen 3020 a first display representing a predetermined statement to be made by the operator who operates the input terminal. Here, the input terminal is, for example, a POS terminal. The POS terminals here include not only cash register terminals but also portable terminals for taking orders. A first detection unit 2040 detects an operator's speech. The first control unit 2060 changes or deletes the first display when the first detection unit 2040 detects the predetermined utterance.

The first display screen 3020 is a display screen viewed by an operator who operates the input terminal. Note that the first display screen 3020 may be provided integrally with the information processing apparatus 2000, or may be provided separately. Also, the first display screen 3020 may be provided integrally with an input terminal operated by an operator. Further, the information processing device 2000 may be provided integrally with the input terminal operated by the operator, or may be provided separately.

<Process flow>
FIG. 2 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the first embodiment. The first display unit 2020 displays the first display on the first display screen (S102). The information processing device 2000 determines whether or not the predetermined utterance is detected by the first detection unit 2040 (S104). If the predetermined utterance is not detected (S104: NO), the process of FIG. 2 proceeds to step S104 again. On the other hand, if the predetermined utterance is detected (S104: YES), the processing in FIG. 2 proceeds to step S106. In step S106, the first control unit 2060 changes or deletes the first display.

According to the information processing apparatus 2000 of the present embodiment, a predetermined remark to be made by the operator is displayed on the first display screen, and the first display is changed or deleted by the operator making the predetermined remark. By doing so, it is possible to increase the probability that the operator will make a predetermined remark according to the first display.

The information processing apparatus 2000 of this embodiment will be described in further detail below.

<Hardware configuration example>
FIG. 3 is a diagram conceptually illustrating a hardware configuration example of the information processing apparatus according to the first embodiment. As shown in FIG. 3, the information processing device 2000 has a CPU (Central Processing Unit) 1, a memory 2, an input/output interface (I/F) 3, a communication section 4, and the like. The CPU 1 is connected to other units via communication lines such as buses. The memory 2 is RAM (Random Access Memory), ROM (Read Only Memory), flash memory, or the like. The communication unit 4 exchanges signals with other devices and devices. A portable recording medium or the like can also be connected to the communication unit 4 . The input/output I/F 3 is connected to the display section 5, the input section 6, the imaging section 7, the sound collecting section 8, the audio output section 9, and the like.

The display unit 5 is hardware that realizes the first display screen 3020 described above. Specifically, it displays a screen corresponding to drawing data processed by CPU1 or GPU (Graphics Processing Unit) (not shown), such as LCD (Liquid Crystal Display) or CRT (Cathode Ray Tube) display. is a unit. The input unit 6 is a unit that receives operator input, and is implemented as a hardware button unit, a touch sensor, or the like, for example. The display unit 5 and the input unit 6 can be integrated and realized as a touch panel. The imaging unit 7 is a camera formed from a lens, an imaging element, etc., and captures still images and moving images. The sound collector 8 is a microphone unit. The audio output unit 9 is a speaker unit, a bell, or the like.

The hardware configuration of the information processing device 2000 is not limited to the configuration shown in FIG. The information processing device 2000 may further have a configuration other than the configuration shown in FIG. Further, the information processing device 2000 does not have to have the display unit 5 , the input unit 6 , the imaging unit 7 , the sound collecting unit 8 and the audio output unit 9 . In this case, the information processing device 2000 performs display on the display unit 5 of another device, acquires an image captured by the imaging unit 7, and obtains sound obtained by the sound collector 8 by communication via the communication unit 4. Acquisition of data and output to the audio output unit 9 can be performed.

<Details of the first display>
The first display represents the content of the statement that the operator should make. The statement that the operator should make is, for example, a statement that prompts the customer to present a predetermined object. Specifically, it includes statements such as "Do you have a point card?" that prompt the presentation of a point card, statements that prompt the presentation of a coupon such as "Do you have a coupon?", or "I have a parking ticket." But?” to encourage the presentation of a parking ticket. Also, the statement to be made by the operator may be a statement representing the provision of the service. Concretely, it is a remark such as "Would you like to warm the lunch?" or "Do you want to divide the bag into two?" Also, the statement to be made by the operator may be a statement recommending the purchase of a product. Specifically, it is a remark that recommends the purchase of an additional product, such as "Would you like to purchase the product A together?"

<Display method of the first display>
There are various ways in which the first display may be displayed by the first display 2020 . For example, the first display unit 2020 performs the first display at a position on the first display screen 3020 that is easily visible to the operator. The position that is conspicuous to the operator is the center of the first display screen 3020, the top of a window already displayed on the first display screen 3020, or the like.

FIG. 4 is a diagram illustrating a first display screen 3020 on which the first display 20 is displayed. The main window 10 is a window showing the accounting status. In this example, the first display section 2020 displays the first display 20 on the main window 10 . In general, an operator who performs accounting processing at an input terminal performs accounting processing while viewing a window, such as the main window 10, that displays the status of accounting processing. Therefore, displaying the first display 20 on the main window 10 makes the first display 20 more noticeable to the operator.

Alternatively, for example, the first display unit 2020 may erase each display already displayed on the first display screen and display only the first display on the first display screen.

In this way, by displaying the first display at a position that is easily visible to the operator, or by turning off other displays that have already been displayed and displaying the first display, it is possible for the operator to see other objects such as the main window 10 as well. becomes difficult to see. Therefore, the operator is given the motivation to "make a predetermined remark and turn off the first display." Therefore, the operator positively makes a predetermined remark.

<Details of First Detector 2040>
<<Speech to detect>>
A predetermined utterance to be made by the operator corresponds to the first display. Specifically, the predetermined utterance is a utterance having the content represented by the first display.

Here, it is assumed that information representing the combination of “first display, predetermined utterance” is stored in advance inside or outside the information processing apparatus 2000 . Information representing this combination is hereinafter referred to as first detection information. FIG. 5 is a diagram illustrating the first detection information in a table format. The table shown in FIG. 5 is referred to as a first detection information table 200. FIG. The first detection information table 200 has three columns: key 202 , first display 204 , and predetermined utterance 206 . A key 202 is a key for identifying each record of the first detection information table 200 . A first display 204 represents the first display, and a predetermined utterance 206 represents a predetermined utterance corresponding to the first display 204 .

For example, the record in the first line indicates that the predetermined remark that the operator should make when the first display "confirm point card" is displayed on the first display screen is "Do you have a point card?".

Here, there are cases in which a plurality of variations meaning the same content are conceivable for the statement that the operator should make. For example, the above statement requesting presentation of a point card may be a statement "Do you have a point card?" In this way, when a plurality of variations are conceivable for an utterance, all conceivable variations are shown in the predetermined utterance 206, for example. Then, when any one of the plurality of utterances indicated in the predetermined utterance 206 is detected, first detection section 2040 determines that the predetermined utterance has been detected.

Further, the predetermined utterance 206 may indicate a keyword that should be included in the utterance, instead of indicating the entire utterance content. For example, in the case of the above example, the keyword "point card" is shown in the predetermined utterance 206. FIG. Here, the predetermined utterance 206 may indicate multiple keywords.

When a plurality of keywords are indicated in the predetermined utterance 206, the first detection unit 2040 may determine that the predetermined utterance is detected when any of the plurality of keywords is included in the utterance, It may be determined that the predetermined utterance is detected when all of the plurality of keywords are included in the utterance. For example, if the predetermined utterance 206 indicates "keyword A or keyword B," the first detection unit 2040 detects the predetermined utterance when either keyword A or B is included in the operator's utterance. I judge. On the other hand, if the predetermined utterance 206 indicates "keyword A and keyword B," the first detection unit 2040 detects the predetermined utterance when both keywords A and B are included in the operator's utterance. I judge.

<<Method of detection>>
For example, the first detection unit 2040 detects the operator's utterance by analyzing voice data in which the operator's utterance is recorded. In this case, a microphone or the like for acquiring voice is provided inside or outside the information processing apparatus 2000 . The first detection unit 2040 acquires the sound acquired by this microphone or the like.

Here, a technique for detecting a predetermined utterance from audio data in which a person's utterance is recorded is a known technique. Therefore, details of this known technique are omitted.

<Details of First Control Unit 2060>
The first control unit 2060 changes or deletes the first display. This prevents the first display from interfering with the operator's work (accounting processing, etc.).

"Deletion of the first display" means erasing the first display from the first display screen. Hereinafter, "change of the first display" will be specifically described.

<<Change display position>>
For example, the first control unit 2060 changes the display position of the first display. For example, the first control unit 2060 changes the display position of the first display to a position that is less likely to interfere with the operator's work, such as a position that is less noticeable to the operator. For example, when the display position of the first display is near the center of the first display screen, the first control unit 2060 changes the display position to a corner of the first display screen. Further, when the display position of the first display displayed by the first display unit 2020 is on another window or the like, the first control unit 2060 changes the display position to a position that does not overlap the window or the like.

<<Change size>>
Also, for example, the first control unit 2060 reduces the size of the first display. For example, if the first display overlaps a part of another window, the first control unit 2060 reduces the size of the first display so that it does not overlap with the window or the like. Furthermore, the first control unit 2060 may change the display position of the reduced first display. For example, the first control unit 2060 reduces the size of the first display and moves the first display to the corner of the first display screen.

<< Change of content >>
Also, for example, the first control unit 2060 changes the display content of the first display. For example, the first control unit 2060 changes the display content of the first display to content indicating that the predetermined speech has been made. Specifically, the first control unit 2060 displays a strike-through line on the display such as "confirm point card" or displays a check mark or the like next to the display.

FIG. 6 is a diagram exemplifying the first display changed by the first control unit 2060. As shown in FIG. FIG. 6 shows a state after the operator makes a predetermined statement under the condition that "the first display 20 is displayed on the main window 10" shown in FIG. The first control unit 2060 reduces the size of the first display 20 and changes the display position of the first display 20 to the lower right corner of the first display screen 3020 so as not to overlap the main window 10 . Then, the first control unit 2060 displays a check mark on the first display 20 to indicate that the predetermined statement has been made.

[Embodiment 2]
FIG. 7 is a block diagram illustrating the information processing apparatus 2000 according to the second embodiment together with its usage environment. In FIG. 7, arrows represent the flow of information. Furthermore, in FIG. 7, each block does not represent the configuration in units of hardware, but the configuration in units of functions. The information processing apparatus 2000 of the second embodiment has functions similar to those of the information processing apparatus 2000 of the first embodiment, except for the points described below.

The information processing apparatus 2000 according to the second embodiment has an end accepting unit 2080 . The end accepting unit 2080 accepts an input indicating the end of the customer input process. The input processing includes, for example, product accounting processing and order reception processing. Accounting processing is a process of reading information on a product purchased by a customer with an input terminal, receiving the purchase price of the product from the customer, and inputting the received price into the input terminal. More specifically, the accounting process consists of a series of processes of "scanning the barcode of each product at the cash register terminal, presenting the total amount to the customer, receiving payment from the customer, and entering the received price into the cash register terminal." processing, etc. In addition, the order acceptance process is, for example, a process of "listening to a customer for an item to be ordered and inputting the item into a portable terminal" in a restaurant or the like.

The "input indicating the end of accounting processing" received by the end receiving unit 2080 is an input for determining the product to be purchased and the price to be put into the cashier terminal. After this input, if there is change, the change is output from the cash register terminal. The "input indicating the end of the order reception process" received by the end reception unit 2080 is, for example, an input for confirming the order. These inputs are, for example, pressing buttons provided on the input terminal. Moreover, when a touch panel is provided on the first display screen, these inputs may be an operation of touching a confirmation button displayed on the display screen. Hereinafter, the above-mentioned button for performing an input indicating the end of input processing to the input terminal will be referred to as an end button. However, the name of this button is not limited to "end button".

Termination accepting unit 2080 either 1) does not accept input until the first representation is changed or deleted, or 2) rejects input received before the first representation is changed or deleted. In the case of 1), for example, the termination reception unit 2080 disables the termination button of the input terminal or the termination button on the display screen until the first display is changed or deleted, thereby disabling input by pressing the button. do not accept.

In the case of 2), the end accepting unit 2080 determines whether the first display has been changed or deleted when an input such as pressing of the end button is detected. Then, if the first display has not been changed or deleted, the process of terminating the input process is not performed. At this time, for example, the end reception unit 2080 may display an error message or the like.

<Process flow>
FIG. 8 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the second embodiment. Note that FIG. 8 shows the flow of processing when the end accepting unit 2080 rejects the input accepted before the first display is changed or deleted.

The first display unit 2020 displays the first display on the first display screen (S202). The end accepting unit 2080 accepts input indicating the end of the input process (S204). The processing of FIG. 8 branches at step S206. If the first display has been changed or deleted by the first control unit 2060 (S206: YES), the process of FIG. 8 ends. In this case, the input process is terminated.

On the other hand, if the first display has not been changed or deleted by the first control unit 2060 (S206: NO), the process of FIG. 8 returns to step S204.

According to the information processing apparatus 2000 of this embodiment, the input process does not end until the first display is changed or deleted. Therefore, it is possible to urge the operator to make a predetermined statement while preventing the operator from terminating the input process without making a predetermined statement.

[Embodiment 3]
FIG. 9 is a block diagram illustrating an information processing apparatus 2000 according to the third embodiment together with its usage environment. In FIG. 9, arrows represent the flow of information. Furthermore, in FIG. 9, each block does not represent the configuration in units of hardware, but the configuration in units of functions. The information processing apparatus 2000 of the third embodiment has the same functions as the information processing apparatus 2000 of the first or second embodiment, except for the points described below.

The information processing apparatus 2000 according to the third embodiment has an end reception unit 2080 and a warning unit 2100. FIG. The termination reception unit 2080 of the third embodiment has the same function as the termination reception unit 2080 of the second embodiment.

The warning unit 2100 issues a warning when an input is made to the end reception unit 2080 before the first display is changed or deleted.

The content of the warning issued by the warning unit 2100 is a warning indicating that the predetermined statement has not been made. For example, the content of the warning indicates the same content as the content of the first display. For example, if the content of the first display is "confirmation of point card", the content of the warning is "forgot to confirm point card".

There are various ways in which the warning unit 2100 can warn. For example, the warning unit 2100 displays a warning display (hereinafter referred to as warning display) on the first display screen. Here, the situation in which the termination reception unit 2080 issues a warning is a situation in which the operator does not make a predetermined remark even though the first display is displayed. Therefore, it is preferable that the warning unit 2100 displays the warning display more conspicuously than the first display. For example, the warning unit 2100 displays the warning display so as to overlap the first display.

Further, for example, the warning unit 2100 may issue a warning by changing the content of the first display to a content representing a warning.

Further, for example, the warning unit 2100 may output the contents of the warning by voice. For example, when the content of the first display is "confirmation of point card", the warning unit 2100 outputs a voice saying "I forgot to confirm the point card". Furthermore, the warning unit 2100 may issue a warning by outputting a warning sound such as a beep.

<Process flow>
FIG. 10 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the third embodiment. Among the steps in FIG. 10, steps with the same reference numerals in FIG. 8 represent the same processes as the steps with the same reference numerals.

In step S206, if the first display has been changed or deleted by the first control unit 2060 (S206: YES), the process of FIG. 10 ends. In this case, the input process is terminated.

On the other hand, if the first display has not been changed or deleted by the first control unit 2060 in step S206 (S206: NO), the process of FIG. 10 proceeds to step S302. In step S302, the warning unit 2100 outputs a warning.

Here, in FIG. 10, the processing by the information processing apparatus 2000 ends when step S302 is executed. However, some processing may be performed after step S302. For example, the information processing apparatus 2000 receives again an input indicating the end of the input process after issuing the warning by the warning unit 2100 . Then, if the first display has not been changed or deleted even when the input indicating the end of the input process is received again, the information processing apparatus 2000 ends the process. This flow of processing means that if the operator intends to terminate the input processing even after issuing a warning once, the operator's operation is accepted and the input processing is terminated.

Also, for example, the warning unit 2100 may receive an operator's reply to the warning. For example, this reply is an input that selects one of the following two options: 1) continue the termination of the input process, or 2) cancel the termination of the input process. If 1) is selected, the input process is terminated. On the other hand, if 2) is selected, the process of FIG. 10 returns to step S204.

According to the information processing apparatus 2000 of this embodiment, a warning is issued to the operator who has attempted to end the input process without making a predetermined statement. As a result, it is possible to urge the operator to make a predetermined statement while preventing the operator from performing input processing without making a predetermined statement.

[Embodiment 4]
FIG. 11 is a block diagram illustrating an information processing apparatus 2000 according to the fourth embodiment together with its usage environment. In FIG. 11, arrows represent the flow of information. Furthermore, in FIG. 11, each block does not represent the configuration in units of hardware, but the configuration in units of functions. The information processing apparatus 2000 of the fourth embodiment has functions similar to those of the information processing apparatuses 2000 of the first to third embodiments, except for the points described below.

The information processing apparatus 2000 according to the fourth embodiment has an end reception unit 2080 and an evaluation unit 2120 . The termination reception unit 2080 of the fourth embodiment has the same function as the termination reception unit 2080 of the second embodiment.

The evaluation unit 2120 evaluates the operator. Moreover, the evaluation unit 2120 lowers the operator's evaluation when an input is made to the end reception unit 2080 while the first display has not been changed or deleted.

For example, the operator's evaluation is 1) low when he does not perform an action that should be performed or does not perform an action that should not be performed, and 2) when he performs an action that should be performed or does not perform an action that should not be performed. Highly rated. For example, the evaluation unit 2120 assigns points to the operators so that the higher the evaluation of the operator, the higher the score. In this case, the evaluation of the operator can be lowered by deducting or not adding points to the operator's score. Further, in this case, the evaluation of the operator can be increased by adding points to the operator's score or by not subtracting the operator's score.

For example, when an input is made to the end reception unit 2080 while the first display is not changed or deleted, the evaluation unit 2120 deducts or does not add points to the score of the operator. , to lower the rating of that operator. When lowering the operator's evaluation by not adding points, the evaluation unit 2120, when an input is made to the end reception unit 2080 in a state where the first display is changed or deleted, reduces the operator's score. to add points. By doing this, the operator's evaluation when input is made to the termination reception unit 2080 in a state in which the first display is not changed or deleted is the same as that in the termination reception unit in a state in which the first display is changed or deleted. 2080 is lower than the operator's rating.

<Process flow>
FIG. 12 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the fourth embodiment. Among the steps in FIG. 12, steps with the same reference numerals in FIG. 8 represent the same processes as the steps with the same reference numerals.

In step S206, if the first display has been changed or deleted by the first control unit 2060 (S206: YES), the process of FIG. 12 ends. In this case, the input process is terminated.

On the other hand, if the first display has not been changed or deleted by the first control unit 2060 in step S206 (S206: NO), the process of FIG. 12 proceeds to step S402. In step S402, the evaluation unit 2120 performs a process of lowering the operator's evaluation (point deduction process, etc.).

The flow of processing executed by the information processing apparatus 2000 of the fourth embodiment is not limited to the flow shown in FIG. 12 . For example, when the first display is changed or deleted in step S206 (S206: YES), the evaluation unit 2120 performs processing (point addition processing, etc.) to increase the operator's evaluation. On the other hand, if the first display has not been changed or deleted in step S206 (S206: NO), the evaluation unit 2120 does not perform the process of increasing the operator's evaluation. In this way, similarly to the case where the processing is performed according to the flow shown in FIG. The operator's evaluation can be made lower than when the end reception unit 2080 receives the input with the first display changed or deleted.

According to the information processing apparatus 2000 of the present embodiment, if an input indicating the end of the input process is performed before the first display is changed or deleted, the operator's evaluation is lowered. Therefore, the operator makes a predetermined remark in order not to lower his evaluation. Thus, according to the information processing apparatus 2000 of this embodiment, it is possible to give the operator an incentive to make a predetermined statement.

[Embodiment 5]
For example, the configuration of the information processing apparatus 2000 according to the fifth embodiment is shown in FIG. 1, like the information processing apparatus 2000 according to the first embodiment. The information processing apparatus 2000 according to the fifth embodiment has functions similar to those of the information processing apparatuses 2000 according to the first to fourth embodiments, except for the points described below.

The operation of the first display unit 2020 of the fifth embodiment differs depending on the time of operation. Specifically, the first display unit 2020 of the fifth embodiment 1) displays a different first display depending on the time of operation, or 2) displays the first display depending on the time of operation, or not displayed.

For example, the first display unit 2020 uses the first display associated with the predetermined period. Specifically, the first display unit 2020 calculates a predetermined period including the point in time when the first display unit 2020 operates, and displays the first display corresponding to the predetermined period. For example, the predetermined period is an arbitrary period such as "6:00 to 9:00" or "September to October".

In this case, the first display unit 2020 acquires information (hereinafter referred to as first display information) indicating the association of “predetermined period, first display”. The first display information is stored in advance in an internal or external storage device of the information processing device 2000 .

FIG. 13 is a diagram illustrating, in a table format, first display information indicating the first display for each predetermined period. The table shown in FIG. 13 is referred to as a first display information table 300. FIG. The first display information table 300 has three columns: Key 302 , Predetermined Period 304 , and First Display 306 . A key 302 indicates a key that identifies each record. A predetermined period of time 304 represents the predetermined period of time described above. A first display 306 shows a first display corresponding to the predetermined time period 304 .

For example, in the first row record of the first display information table 300, the first display 306 "check point card" is associated with the predetermined period 304 "from 6:00 to 9:00". In this case, the first display unit 2020 displays the first display "Confirm point card" during the time period other than 6:00 to 9:00, but this first display is displayed during the time period from 6:00 to 9:00. Do not show display. For example, this record is based on the assumption that "since there are many customers during commuting hours from 6:00 to 9:00, the work of checking point cards can be omitted."

Further, for example, in the record on the second line of the first display information table 300, the first display 306 of "Give guidance on campaign A" is associated with the predetermined period 304 of "July 2014". When a product campaign is being held for a certain period of time, the operator may have to say "recommend the product to the customer" during the campaign period. Therefore, for example, as in the second row record of the first display information table 300, a record is created such that the period of the campaign is shown in the predetermined period 304 and the display prompting the guidance of the campaign is shown in the first display 306. back.

Here, if the first display unit 2020 operates at a time not included in any period shown in the first display information table 300, the first display unit 2020 does not display the first display, for example. Also, for example, a default first display may be provided. In this case, when the first display unit 2020 operates at a time that does not correspond to any of the periods shown in the first display information table 300, the first display unit 2020 displays this default first display.

<Process flow>
FIG. 14 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the fifth embodiment. The first display unit 2020 acquires the first display associated with the predetermined period including the current time (S502). If the first display has been acquired (S504: YES), the process of FIG. 14 proceeds to step S506. On the other hand, if the first display has not been acquired (S504: NO), the process of FIG. 14 ends. In step S<b>506 , the first display unit 2020 displays the obtained first display screen 3020 .

According to the information processing apparatus 2000 of the present embodiment, the first display is displayed on the first display screen 3020 according to the time when the first display unit 2020 operates. By doing so, when the operator's speech to be made differs depending on the time at which the input process is performed, the first display corresponding to the predetermined speech corresponding to that time is displayed. Therefore, it is possible to prompt the operator to make an appropriate statement according to the timing of the input processing.

[Embodiment 6]
FIG. 15 is a block diagram illustrating an information processing apparatus 2000 according to the sixth embodiment together with its usage environment. In FIG. 15, arrows represent the flow of information. Furthermore, in FIG. 15, each block does not represent the configuration in units of hardware, but the configuration in units of functions. The information processing apparatus 2000 of the sixth embodiment has functions similar to those of the information processing apparatuses 2000 of the first to fifth embodiments, except for the points described below.

The information processing apparatus 2000 of Embodiment 6 has a recognition unit 2140 . The recognition unit 2140 recognizes the customer. Then, the first display unit 2020 of the sixth embodiment controls the first display according to the recognition result by the recognition unit 2140. FIG.

The “customer recognition” performed by the recognition unit 2140 is various. Specific examples of methods for recognizing customers are given below.

<<Recognition of Age and Gender>>
For example, the recognition unit 2140 recognizes customer characteristics such as age and gender. This recognition is performed, for example, by analyzing the customer's face, clothing, and the like captured by a camera. Techniques for determining characteristics such as age and sex of a person from the face and clothing of the person in the image are known techniques. Therefore, a detailed description of this technology is omitted.

The camera that captures the image of the customer may be a dedicated camera that is installed to capture the image of the customer that is the target of the input processing, or may be a camera that is installed in the store for other purposes. Cameras installed in stores for other purposes are, for example, surveillance cameras.

For example, the information processing device 2000 acquires and analyzes an image stored inside a camera. Further, when an image captured by a camera is stored in a storage device external to the camera, the information processing apparatus 2000 may acquire the image from the storage device. Also, the camera may be configured to store captured images in a storage device provided inside the information processing apparatus 2000 . In this case, the information processing device 2000 acquires the image from a storage unit provided inside the information processing device 2000 .

Recognition of customer characteristics may be performed by analyzing the customer's voice recorded using a microphone or the like. Here, the technique of deriving characteristics such as age and sex of a person from the recorded voice of the person is a known technique. Therefore, a detailed description of this technology is omitted.

The microphone for recording the customer's voice may be a dedicated microphone installed to record the customer's voice for input processing, or may be a microphone installed for other purposes. . “A microphone installed for other purposes” is, for example, a microphone used by the first detection unit 2040 to record the operator's voice.

When the voice recorded by the microphone is stored in a storage device external to the information processing device 2000, the information processing device 2000 acquires the voice from the storage device. Also, the microphone may be configured to store the recorded voice in a storage device provided inside the information processing device 2000 . In this case, the information processing device 2000 acquires the voice from a storage unit provided inside the information processing device 2000 .

<<Recognition of Customer ID>>
The recognition unit 2140 may recognize a customer by recognizing an ID or the like assigned to the customer. For example, when a point card or membership card possessed by a customer is read by an input terminal, the customer's ID (membership number, etc.) is recognized using the information read from the card.

<Details of the first display according to the customer>
For example, the first display unit 2020 performs different first displays according to the recognized customer. For example, it is assumed that there are product A for women and product B for men as target products for a certain campaign. In this case, when the customer recognized by the recognition unit 2140 is a woman, the first display unit 2020 displays the first display "Recommend product A". On the other hand, when the customer recognized by the recognition unit 2140 is male, the first display unit 2020 displays the first display "Recommend product B".

Further, for example, the first display unit 2020 determines whether or not to display the first display according to the recognized customer. For example, it is assumed that product A, which is a campaign target product, is a product for women. In this case, the first display unit 2020 displays the first display "Product A is recommended" only when the customer recognized by the recognition unit 2140 is female.

Also, for example, if the customer is a small child, it may be preferable not to recommend the creation of a membership card or the like. In such a case, for example, the first display unit 2020 displays the first display of "recommend creation of a membership card" only when the recognized customer is over a predetermined age. It is assumed that this predetermined age is set in advance.

Further, for example, giving the same guidance each time to a customer who repeatedly visits the store may offend the customer and lead to a deterioration in the quality of service. In such a case, it is preferable for the operator to recommend the purchase of the campaign target product A only to customers who have made a purchase for the first time, for example, during the campaign period. Therefore, the first display unit 2020 displays the first display "Purchase of product A is recommended" only when the recognized customer is the first customer to be subjected to input processing during the campaign period. It should be noted that whether or not a certain customer has been subject to input processing during a predetermined period is determined by, for example, matching the ID of the customer determined by a point card or membership card read at the time of input processing. This can be grasped by storing the history of input processing.

<Specific example of first display information>
The first display unit 2020 uses first display information in which characteristics such as the customer's age or sex, or the customer's ID are associated with the first display. Hereinafter, customer features and IDs are collectively referred to as "customer attributes". The first display information is stored in advance in the internal or external storage device of the information processing apparatus 2000, similarly to the first display information described in the fifth embodiment.

FIG. 16 is a diagram illustrating, in a table format, first display information in which customer attributes and first displays are associated with each other. The table shown in FIG. 16 is referred to as first display information table 400 . First Display Information Table 400 has five columns: Key 402 , Age 406 , Gender 408 , Customer ID 410 and First Display 412 . A key 402 is a key for identifying each record. Age 406 represents a condition related to age, Gender 408 represents a condition related to gender, and Customer ID 410 represents a condition related to customer ID. The first display 412 is the first display associated with the combination of "age 406, gender 408, customer ID 410". Here, blank fields for age 406, sex 408, and customer ID 410 indicate that there is no designation.

For example, the record in the first row associates the gender 408 of "female" with the first indication 412 of "recommend product A". This record is the first display for prompting the operator to make a predetermined remark "recommend product A" only when the customer is female.

<Process flow>
FIG. 17 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the sixth embodiment. Among the steps in FIG. 17, steps with the same reference numerals in FIG. 14 represent the same processes as the steps with the same reference numerals.

The recognition unit 2140 recognizes the customer (S602). The first display unit 2020 acquires a first display corresponding to the recognized attribute of the customer (S604). Then, as in the fifth embodiment, when the first display is acquired (S504: YES), the first display unit 2020 displays the first display on the first display screen (S506).

According to the information processing apparatus 2000 of this embodiment, the first display corresponding to the recognized customer is displayed. Therefore, when the remarks to be made by the operator differ depending on the customer, the operator can be urged to make an appropriate remark according to the customer.

[Embodiment 7]
FIG. 18 is a block diagram illustrating an information processing apparatus 2000 according to the seventh embodiment together with its use environment. In FIG. 18, arrows represent the flow of information. Furthermore, in FIG. 18, each block does not represent the configuration in units of hardware, but the configuration in units of functions. The information processing apparatus 2000 of Embodiment 7 has the same functions as the information processing apparatuses 2000 of Embodiments 1 to 6, except for the points described below.

The second display screen 3040 is a display screen that can be viewed by the customer. For example, the second display screen 3040 is a display screen installed in the input terminal and installed facing the customer. Note that the second display screen 3040 may be provided integrally with the information processing apparatus 2000 or may be provided separately.

The information processing apparatus 2000 of Embodiment 7 has a second display section 2160 , a second detection section 2180 and a second control section 2200 . Second display unit 2160 displays a second display on second display screen 3040 . Here, the second display is a display representing the customer's predetermined behavior related to the predetermined utterance.

The second detection unit 2180 detects customer behavior. The second control unit 2200 changes or deletes the second display. Here, the second display is changed or deleted by the second control unit 2200 when 1) the first detection unit 2040 detects a predetermined utterance, or 2) the second detection unit 2180 detects a predetermined action. is performed on

Furthermore, in the seventh embodiment, the first control unit 2060 performs the first display when 1) the first detection unit 2040 detects a predetermined utterance or 2) the second detection unit 2180 detects a predetermined action. change or delete

<Details of Second Display Unit 2160>
As described above, the second display displayed on the second display unit 2160 represents the predetermined action related to the predetermined utterance. For example, if the predetermined statement is "a statement that the operator should make", the predetermined action is an action related to that statement. For example, it is assumed that the statement to be made by the operator is "Do you have a point card?" In this case, the predetermined action performed by the customer is the action of "presenting a point card." Therefore, the second display prompts a predetermined action to "present a point card", such as "Please present a point card if you have one."

The information processing apparatus 2000 uses information (hereinafter referred to as second detection information) indicating the association of "first display, predetermined utterance, second display, predetermined action". Specifically, the information processing apparatus 2000 acquires the second correspondence information, 1) displays the first display on the first display screen 3020 by the first display unit 2020, and 2) displays the first display on the first display screen 3020 by the second display unit 2160. A second display is displayed on the second display screen 3040 . The second correspondence information is stored in a storage unit provided inside or outside the information processing apparatus 2000 .

For example, the method by which the second display unit 2160 performs the second display is the same as the method by which the first display unit 2020 performs the first display.

FIG. 19 is a diagram exemplifying the second detection information in a table format. The table shown in FIG. 19 is referred to as a second detection information table 500. FIG. The second detection information table 500 has five columns: key 502 , first display 504 , predetermined utterance 506 , second display 508 , and predetermined action 510 . A key 502 is a key for identifying each record of the second detection information table 500 . For example, the record in the second row of the second detection information table 500 is a record related to the predetermined statement "recommend the product A to the customer." Therefore, the second display 508 viewed by the customer is a display that recommends the product A, "How about the product A?"

Here, when the customer purchases the product A, there is no need to recommend the product A to the customer. Therefore, the above record indicates “purchase product A” in the predetermined action 510 . As a result, when the customer purchases product A, the second display "How about product A?" is changed or deleted by the second control unit 2200 .

The behavior of "purchasing product A" can be detected by, for example, analyzing the customer's purchased product imaged by a camera and determining whether or not product A is included in the purchased products. Further, for example, the action can also be detected by determining whether or not the product A has been read by the input terminal.

<Second detector 2180>
For example, the second detection unit 2180 detects customer's remarks and customer's actions. Here, the method by which the second detection unit 2180 recognizes the customer's utterance is the same as the method by which the recognition unit 2140 recognizes the customer's utterance, for example.

When the second detection unit 2180 detects the customer's motion, the information processing device 2000 acquires and analyzes an image from the camera that captured the customer's motion, thereby recognizing the customer's motion. Here, the technique of detecting the motion of a person from an image (moving image) in which a person is captured is a known technique. Therefore, a detailed description of this technology is omitted.

Further, for example, the second detection unit 2180 may recognize specific behavior of the customer by acquiring information from the input terminal. This specific action is, for example, the action of presenting a point card or membership card. When a customer presents a point card or membership card, the operator uses the input terminal to read these cards. Therefore, by obtaining information that these cards have been read from the input terminal, it is possible to detect the customer's behavior of presenting these cards.

<Details of Second Control Unit 2200>
As described above, the second control unit 2200 controls the second display when 1) the first detection unit 2040 detects a predetermined utterance or 2) the second detection unit 2180 detects a predetermined action. make changes or deletions; For example, in the case of presenting a point card as described above, if the operator says "Do you have a point card?", there is no need to display "Please present your point card" on the second display screen. Therefore, the second control unit 2200 changes or deletes the second display in the case of 1). In addition, even when the customer performs the predetermined action of "presenting the point card", there is no need to display "please present the point card" on the second display screen. Therefore, the second control unit 2200 changes or deletes the second display also in the case of 2).

The method for changing or deleting the second display by the second control unit 2200 is the same as the “method for changing or deleting the first display by the first control unit 2060” exemplified in the first embodiment, for example.

<Process flow>
20 and 21 are flowcharts illustrating the flow of processing executed by the information processing apparatus 2000 of the seventh embodiment. FIG. 20 shows the flow of processing for controlling the first display. On the other hand, FIG. 21 shows the flow of processing for controlling the second display.

In FIG. 20, the first display unit 2020 first displays the first display on the first display screen (S702). Next, if the first detection unit 2040 detects a predetermined utterance or the second detection unit 2180 detects a predetermined action (S704: YES), the process of FIG. 20 proceeds to step S706. On the other hand, if neither the predetermined utterance nor the predetermined action is detected (S704: NO), the processing in FIG. 20 proceeds to step S704 again.

In step S706, the first control unit 2060 changes or deletes the first display.

In FIG. 21, the second display unit 2160 first displays the second display on the second display screen (S802). Next, if the first detection unit 2040 detects a predetermined utterance or the second detection unit 2180 detects a predetermined action (S804: YES), the process of FIG. 21 proceeds to step S806. On the other hand, if neither the predetermined utterance nor the predetermined action is detected (S804: NO), the processing in FIG. 21 proceeds to step S804 again.

In step S806, the second control unit 2200 changes or deletes the second display.

According to the information processing apparatus 2000 of the present embodiment, a display representing a predetermined action related to a predetermined remark to be performed by the operator is displayed on the second display screen viewed by the customer. When the predetermined utterance represents "a utterance urging the customer to take a predetermined action", for example, a display corresponding to the operator's utterance is displayed as the second display. Therefore, even if the operator does not make a predetermined remark, it is possible to increase the probability that the customer will perform the predetermined action.

[Example]
A number of examples are provided below to describe each of the above-described embodiments in more detail. The present invention is not limited in any way by the following examples.

<Example 1>
FIG. 22 is a diagram showing a configuration example of a POS register device. As shown in FIG. 22, the first embodiment shows an example in which the information processing device 2000 described above is applied to a POS cash register device 30. As shown in FIG. The POS register device 30 in Embodiment 1 is composed of a checker device 31 and a cashier device 41 . The checker device 31 registers the product as an accounting object and sends information on the accounting object product to the cashier device 41 . The cashier device 41 performs settlement processing for products to be accounted for. Accounting objects can be registered in both the checker device 31 and the cashier device 41 .

The checker device 31 and the cashier device 41 in the first embodiment have a CPU 1, a memory 2, an input/output I/10, a communication section 4, etc., as in FIG. The information processing device 2000 described above can be applied to both the checker device 31 and the cashier device 41 , and the product image presentation method described above can be executed by both the checker device 31 and the cashier device 41 .

The operator of the POS register device 30 holds the product over the reading window 36 when performing accounting processing for the product. As a result, the bar code or the like attached to the product is read, and the product is registered as an accounting object.

The display unit 5 (first display screen 3020 ) described above corresponds to at least one of the display unit 32 a and the display unit 42 of the touch panel unit 32 . The input unit 6 described above corresponds to at least one of the touch panel 32 b and the keyboard 33 of the touch panel unit 32 and the keyboard 43 . The imaging unit 7 described above corresponds to the scanner device 34 . The scanner device 34 captures a product image showing the appearance of the product held over the reading window 36 . The sound collector 8 described above is attached to, for example, the member 35 of the checker device 31, the operator of the POS register device 30, or the like. Note that the sound collector 8 may be used for customer recognition performed by the recognition unit 2140 . The voice output unit 9 described above is installed in the checker device 31 or the cashier device 41, for example.

When implementing the information processing device 2000 of the seventh embodiment, the POS register device 30 further has a second display screen 3040, for example. For example, the second display screen 3040 is provided on the back side of the touch panel unit 32 .

<Example 2>
FIG. 23 is a diagram showing a configuration example of a POS system. As shown in FIG. 23, the second embodiment shows an example in which the information processing apparatus 2000 described above is applied to a POS system 50. FIG. A POS system 50 according to the second embodiment is composed of a server device 51 and a store side configuration 52, and the server device 51 and the store side configuration 52 are connected by a communication network 53 so as to be communicable. The store side configuration 52 includes a store terminal 54 connectable to a communication network 53 via a communication relay device, a stand 55, and the like. The stand 55 is a device for communicably connecting the store terminal 54 and other devices (handy scanner, cash drawer, receipt printer, etc.).

The store terminal 54 is a general-purpose computer such as a PC (Personal Computer), a notebook PC, a tablet-type terminal, a smart phone, etc., and exchanges data with the server device 51 to perform data exchange with the POS register device 30 described above. achieve similar functionality. The shop terminal 54 has a touch panel unit 56, an imaging section 57, a microphone (not shown), and the like. The display section 5 described above corresponds to the display section of the touch panel unit 56 . The input unit 6 described above corresponds to the touch panel of the touch panel unit 56 . The imaging section 7 described above corresponds to the imaging section 57 . The sound collector 8 described above corresponds to a microphone built into the store terminal 54 .

The server device 51 is a general server computer and implemented as a WEB server, an application server, or the like. The store terminal 54 and the server device 51 have a CPU 1, a memory 2, an input/output I/10, a communication section 4, and the like, as in FIG.

The information processing device 2000 described above can be implemented as the store terminal 54 only, or as a combination of the server device 51 and the store device. When part of the information processing apparatus 2000 is realized by the server device 51 , for example, among the processes executed by the first display unit 2020 , the processing up to determining the character string to be displayed is realized by the server device 51 . Then, the determined character string or the like is transmitted from the server device 51 to the shop terminal 54 . The store terminal 54 performs processing for displaying the acquired character string or the like on the first display screen 3020 . In addition, the store terminal 54 transmits the operator's detected utterance (voice, etc.) to the server device 51, and the server device 51 determines whether or not the utterance corresponds to a predetermined utterance. When the server device 51 determines that “predetermined utterance is detected”, it determines how to change or delete the first display, and transmits information indicating the content of the determination to the store terminal 54 . The store terminal 54 changes or deletes the first display according to the received information.

<Example 3>
The information processing device 2000 described above is applicable not only to the POS register device 30 and the POS system 50, but also to various devices. For example, the information processing apparatus 2000 and control method described above may be applied to general-purpose computers such as PCs and smart devices used by general users. In this case, if the user wants to know the price of the product he/she has picked up after the service is applied, the user can take a picture of the product with the imaging unit of the computer, and after the service is applied to the product, You can see the price of

Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and combinations of the above embodiments and various configurations other than the above embodiments can also be adopted.

Examples of reference forms are added below.
1. a first display means for displaying, on a first display screen viewed by the operator, a first display representing a predetermined statement to be made by an operator who operates an input terminal;
a first detection means for detecting the operator's speech;
a first control means for changing or deleting the first display when the predetermined utterance is detected by the first detection means;
Information processing device having
2. Having an end reception unit that receives an input indicating the end of input processing regarding a customer,
The termination accepting unit does not accept input until the first display is changed or deleted, or rejects input accepted before the first display is changed or deleted.1. The information processing device according to .
3. an end reception unit that receives an input indicating the end of input processing regarding a customer;
a warning unit that outputs a warning when the input is received before the first display is changed or deleted;
1. or 2. The information processing device according to .
4. an end reception unit that receives an input indicating the end of input processing regarding a customer;
and evaluation means for evaluating the operator,
If the input is received before the first display is changed or deleted, the evaluation means lowers the operator's evaluation1. to 3. The information processing device according to any one of the above.
5. 1. The first display means displays a different first display depending on the operating time, or determines whether or not to display the first display depending on the operating time. to 4. The information processing device according to any one of the above.
6. having recognition means for recognizing a customer,
1. The first display means displays a different first display according to the recognized customer, or determines whether or not to display the first display according to the recognized customer. to 5. The information processing device according to any one of the above.
7. a second display means for displaying a second display representing a predetermined action related to the predetermined utterance on a second display screen that can be viewed by a customer;
a second detection means for detecting customer behavior;
and second control means for changing or deleting the second display when the first detection means detects the predetermined utterance or the second detection means detects the predetermined action. ,
1. The first control means changes or deletes the first display when the second detection means detects the predetermined action. to 6. The information processing device according to any one of the above.
8. The input terminal is a POS terminal1. to 7. The information processing device according to any one of the above.
9. A control method implemented by a computer, comprising:
a first display step of displaying a first display representing a predetermined statement to be made by an operator who operates an input terminal on a first display screen viewed by the operator;
a first detection step of detecting the operator's speech;
a first control step of changing or deleting the first display when the predetermined utterance is detected by the first detection step;
A control method with
10. having an end reception step for receiving an input indicating the end of the input processing regarding the customer;
9. The end accepting step does not accept input until the first display is changed or deleted, or rejects the input accepted before the first display is changed or deleted.9. The control method described in .
11. an end receiving step for receiving an input indicating the end of the input processing regarding the customer;
a warning step of providing an output indicative of a warning if the input is received before the first representation is changed or deleted;
9. or 10. The control method described in .
12. an end receiving step for receiving an input indicating the end of the input processing regarding the customer;
and an evaluation step of evaluating the operator,
9. If the input is received before the first representation is changed or deleted, the rating step lowers the operator's rating. 11. A control method according to any one of the preceding claims.
13. 9. In the first display step, a different first display is displayed depending on the operating time, or whether or not to display the first display depending on the operating time.9. 12. A control method according to any one of the preceding claims.
14. having a recognition step for recognizing the customer,
9. The first display step displays a different first display according to the recognized customer, or determines whether or not to display the first display according to the recognized customer. to 13. A control method according to any one of the preceding claims.
15. a second display step of displaying a second display representing a predetermined action related to the predetermined utterance on a second display screen that can be viewed by a customer;
a second detection step of detecting customer behavior;
and a second control step of changing or deleting the second display when the first detection step detects the predetermined utterance or the second detection step detects the predetermined action. ,
9. The first control step changes or deletes the first display when the predetermined behavior is detected by the second detection step. to 14. A control method according to any one of the preceding claims.
16. 9. The input terminal is a POS terminal. to 15. A control method according to any one of the preceding claims.
17. The computer:1. to 8. A program having a function of operating as the information processing device according to any one of the above.

Examples of further reference forms are appended.
18. a first display means for displaying a first display representing a predetermined utterance made by a user on a first display screen before the predetermined utterance;
a first detection means for detecting the predetermined utterance of the user;
a first control means for changing or deleting the first display when the predetermined utterance is detected by the first detection means;
a recognition means for recognizing a user;
The first display means displays a different first display according to the recognized user, or determines whether or not to display the first display according to the recognized user,
The recognition means is an information processing device that recognizes the user by analyzing an image of the user, recognizing the voice of the user, or reading the card of the user.
19. 18. The recognition means recognizes at least one of age and gender of the user. The information processing device according to .
20. having end reception means for receiving an input indicating the end of input processing related to the user;
18. The end accepting means does not accept input until the first display is changed or deleted, or rejects the input accepted before the first display is changed or deleted. or 19. The information processing device according to .
21. an end receiving means for receiving an input indicating the end of input processing relating to a user;
a warning unit that outputs a warning when the input is received before the first display is changed or deleted;
18. 20. The information processing device according to any one of the above.
22. a second display means for displaying a second display representing a predetermined action related to the predetermined utterance on a second display screen that can be viewed by a user;
a second detection means for detecting user behavior;
and second control means for changing or deleting the second display when the first detection means detects the predetermined utterance or the second detection means detects the predetermined action. ,
18. The first control means changes or deletes the first display when the second detection means detects the predetermined action. 21. The information processing device according to any one of the above.
23. 18. The input terminal is a POS terminal. 22. The information processing device according to any one of the above.
24. A control method implemented by a computer, comprising:
a first display step of displaying a first display representing a predetermined utterance made by a user on a first display screen before the predetermined utterance;
a first detection step of detecting the predetermined utterance of the user;
a first control step of changing or deleting the first display when the predetermined utterance is detected by the first detection step;
a recognition step of recognizing a user;
The first display step displays a different first display according to the recognized user, or determines whether or not to display the first display according to the recognized user;
The recognition step is a control method for recognizing the user by analyzing an image of the user, recognizing the voice of the user, or reading the card of the user.
25. 23. The step of recognizing recognizes at least one of age and gender of the user. The control method described in .
26. to the computer;18. 23. A program having a function of operating as the information processing device according to any one of the above.

This application claims priority based on Japanese Patent Application No. 2014-201362 filed on September 30, 2014, and the entire disclosure thereof is incorporated herein.

Claims (8)

Recognition means for recognizing the customer by analyzing a captured image of the customer, recognizing the customer's voice by voice, or reading the customer's card;
display means for displaying a display prompting a customer to make a predetermined remark before the predetermined remark ;
detection means for detecting the predetermined utterance of the customer;
a control means for changing or deleting a display prompting the predetermined utterance when the predetermined utterance is detected by the detection means;
The information processing apparatus, wherein the display means displays a different display prompting the predetermined remark according to the recognized customer, or determines whether or not there is a display prompting the predetermined remark according to the recognized customer. 2. The information processing apparatus according to claim 1, wherein said recognition means recognizes at least one of age and sex of said customer. having an end reception means for receiving an input indicating the end of the input processing regarding the customer;
3. The information processing apparatus according to claim 1, wherein said end accepting means does not accept an input until said display is changed or deleted, or rejects an input accepted before said display is changed or deleted. an end receiving means for receiving an input indicating the end of input processing regarding a customer;
a warning unit that outputs a warning if the input is accepted before the display is changed or deleted;
The information processing apparatus according to any one of claims 1 to 3, comprising: 5. The information processing apparatus according to any one of claims 1 to 4, wherein the input processing regarding the customer is performed by a POS terminal. A control method implemented by a computer, comprising:
a recognition step of recognizing the customer by analyzing an image of the customer, recognizing the voice of the customer, or reading the customer's card;
a display step of displaying a display prompting the customer to make a predetermined remark before the predetermined remark ;
a detection step of detecting the predetermined utterance of the customer;
a control step of changing or deleting a display prompting the predetermined utterance when the predetermined utterance is detected by the detecting step;
a recognition step of recognizing the customer;
The control method, wherein the display step displays a different display prompting the predetermined remark according to the recognized customer, or determines whether or not there is a display prompting the predetermined remark according to the recognized customer. 7. The control method according to claim 6, wherein the recognition step recognizes at least one of age and sex of the customer. to the computer,
Recognition processing for recognizing the customer by analyzing an image of the customer, recognizing the voice of the customer, or reading the customer's card;
a display process of displaying a display prompting a customer to make a predetermined remark before the predetermined remark;
a detection process for detecting the predetermined utterance of the customer;
a control process for changing or deleting a display prompting the predetermined utterance when the predetermined utterance is detected by the detection process;
A program for, in the display processing, displaying a different display prompting the predetermined remark according to the recognized customer, or determining whether or not there is a display prompting the predetermined remark according to the recognized customer.

Images