JP6964549B2 - Evaluation acquisition system - Google Patents

Description

The present invention relates to an evaluation acquisition system.

In recent years, a system for providing evaluation information of restaurants has been proposed.
The information providing system described in Patent Document 1 is a system that receives evaluation information of a restaurant as word-of-mouth information from a user and discloses the received word-of-mouth information to other users. In this information provision system, not only the word-of-mouth information is disclosed, but also the registration of the specialty area and the specialty genre is accepted from each poster, and each poster responds to the restaurant corresponding to his / her specialty area or the specialty genre. By aggregating the posted word-of-mouth information for each region or genre that is common to each contributor, information related to the evaluation ranking for each region or genre in which restaurants are ranked is generated.

JP-A-2007-193427

At restaurants, it is desirable to provide products that customers find delicious. Therefore, it is conceivable to acquire information on the evaluation of the food and drink from the customer and refer to the acquired information when cooking thereafter. It is desirable that the information to be acquired has high accuracy.
An object of the present invention is to provide an evaluation acquisition system capable of acquiring information on evaluation with high accuracy.

The present invention completed for this purpose is a reception means for receiving a connection request from a user terminal of a user who visits a restaurant, and a display control for displaying a list of products provided at the restaurant on the user terminal. The means, an ordering means for receiving an order for the product from the user terminal, and a grasping means for grasping information on the evaluation of the product from the behavior of the user, the grasping means records the speech of the user. Based on at least one of the utterance content recorded by the recording means and the image taken by the imaging means, one product that the user has eaten or eaten is specified from the plurality of products provided at the restaurant, and one product is specified. It is an evaluation acquisition system characterized by grasping information on the evaluation of the one product based on at least one of the utterance content and the image.
Here, before Symbol grasping means, even to understand the information on the evaluation of the one of the product based on the facial expression of the user after eating the said one of the product by the imaging means has captured for imaging a facial expression of the user good.
Further, the grasping means may identify the one product based on the image taken by the imaging means, and grasp the evaluation of the one product based on the utterance content recorded by the recording means.
Further, the grasping means compares the feature amount extracted from the image taken by the imaging means with the feature amount of each product given as recognition data, and determines whether the degree of matching is equal to or higher than the threshold value. When specifying the product, the feature amount of the product ordered by the ordering means may be first compared with the feature amount extracted from the image.

According to the present invention, it is possible to provide an evaluation acquisition system capable of acquiring information on evaluation with high accuracy.

It is a figure which illustrated the schematic structure of the cashless system which concerns on embodiment. It is a figure which illustrated the schematic structure of the user terminal. It is a block diagram which illustrated the functional structure of a server. It is a figure which shows an example of the access screen displayed on a user terminal. It is a figure which shows an example of the menu screen displayed on a user terminal. It is a figure which shows an example of the information which a storage part stores. It is a figure which shows an example of the accounting screen displayed on a user terminal. It is a figure which shows an example of the summary accounting screen displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of summary accounting displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of accounting for each terminal displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of the equivalent rate accounting displayed on a user terminal. It is a figure which shows an example of the special discount accounting screen displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of special discount accounting displayed on a user terminal. It is a block diagram which illustrated the functional structure of the evaluation grasping part. It is a flowchart which shows an example of the procedure of the evaluation grasping process performed by the evaluation grasping part. It is a block diagram which illustrated the functional structure of a store terminal. It is a sequence diagram which showed the operation example in the cashless system which concerns on this embodiment. It is a sequence diagram which showed the operation example in the cashless system which concerns on this embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.
FIG. 1 is a diagram illustrating a schematic configuration of a cashless system 1 according to the present embodiment.
The cashless system 1 includes a user terminal 10 owned by a user, a server 20 that manages menus that can be provided at a store such as a restaurant, a store terminal 30 owned by the store, and a well-known printer 40. I have. Further, the cashless system 1 includes a microphone 61, a camera 62, and a communication server 63, and includes an acquisition system 60 for acquiring information on evaluation of products provided at a store.

The user terminal 10, the server 20, the store terminal 30, and the acquisition system 60 are connected to a network 50 that connects the devices so that they can communicate with each other, and can communicate with each other via the network 50. The network 50 is not particularly limited as long as it is a communication network used for data communication between each system and device, and examples thereof include LAN (Local Area Network), WAN (Wide Area Network), and the Internet. can. The communication line used for data communication may be a combination of these, regardless of whether it is wired or wireless. Further, a relay device such as a gateway device or a router may be used to connect each device via a plurality of networks or communication lines. The store terminal 30 and the printer 40 can communicate with each other by wireless communication such as LAN, bluetooth (registered trademark) or infrared communication, or wired communication. Further, the store terminal 30 and the printer 40 may be able to communicate with each other via WAN and the Internet.

<User terminal 10>
FIG. 2 is a diagram illustrating a schematic configuration of the user terminal 10.
The user terminal 10 has a control unit 11 that controls the entire device, a storage unit 12 that is used for storing data and the like, a display unit 13 that is used for displaying an operation reception screen and an image, and an operation that accepts a user's input operation. A unit 14 and a communication unit 15 used for communication with an external device are provided. Further, the user terminal 10 includes a camera 16, a speaker 17, and a microphone 18.

The control unit 11 is composed of a CPU (Central Processing Unit) 11a, a ROM (Read Only Memory) 11b, and a RAM (Random Access Memory) 11c. The ROM 11b stores a basic program (operating system) executed by the CPU 11a, various settings, and the like. The CPU 11a uses the RAM 11c as a work area and executes an application program read from the ROM 11b and the storage unit 12. Each part of the user terminal 10 is controlled by the CPU 11a executing the program.

It can be exemplified that the storage unit 12 is a storage device such as a semiconductor memory.
The display unit 13 is a display device that displays a still image, a moving image, or the like. The display unit 13 can be exemplified as a liquid crystal display or an organic EL (Electro Luminescence) display.
The operation unit 14 is an input device that receives an operation from the user. It can be exemplified that the operation unit 14 is a button, a switch, and a touch panel.
The communication unit 15 can be exemplified as a communication interface.
It can be exemplified that the camera 16 is a digital camera capable of capturing a still image or a moving image.
It can be exemplified that the speaker 17 is a device that converts an electrical sound signal from the control unit 11 into sound and outputs it.
It can be exemplified that the microphone 18 is a device that converts a sound input from the outside of the user terminal 10 into an electric sound signal and outputs the sound to the control unit 11.

The user terminal 10 configured as described above is a multifunctional mobile phone (so-called "smartphone"), a mobile phone (so-called "feature phone"), a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, or the like. It can be exemplified that there is.

The user terminal 10 has a function of reading code information such as a QR code (registered trademark) with the camera 16.
In addition, the user terminal 10 is provided with an electronic payment function for making payments by exchanging electronic data when paying for goods or services. For electronic payment, if credit card information is registered in advance, payment can be made without performing authentication procedures such as entering a PIN, such as Apple Pay (registered trademark) and Google Wallet (registered trademark). It can be exemplified that the service (electronic payment system) is used (however, fingerprint authentication or face authentication may be required as in Apple Pay (registered trademark)). Further, as the electronic payment, it can be exemplified that a credit card payment service or a carrier payment service in which the product price is paid together with the mobile phone usage fee is used.

<Server 20>
FIG. 3 is a block diagram illustrating the functional configuration of the server 20.
The server 20 includes a control unit 11, a storage unit 12, a display unit 13, an operation unit 14, a communication unit 15, a control unit 21, a storage unit 22, a display unit (not shown), and an operation unit, which are included in the user terminal 10. It is equipped with a communication unit (not shown) and a communication unit (not shown). The storage unit 22 may be an HDD (Hard Disk Drive).

The control unit 21 has a CPU (not shown), a ROM (not shown), a RAM (not shown), and the like, and the CPU executes a program to realize the following functions.
That is, the control unit 21 is a receiving unit as an example of a receiving means for receiving a connection request from each user terminal 10 of a plurality of user terminals 10 owned by a plurality of users (customers) constituting one group who visited the store. It has 211. Further, the control unit 21 has an identification unit 212 as an example of identification means for uniquely identifying and identifying each user terminal 10 from the connection request received by the reception unit 211. Further, the control unit 21 has a generation unit 213 that generates an HTML (HyperText Markup Language) document that publishes a web page having various information about the product to the user terminal 10. Further, the control unit 21 has an ordering unit 214 that receives an order for a product that can be provided at a store from the user terminal 10, and a charging unit 215 as an example of a charging means that charges a fee for an order made from the user terminal 10. And have. Further, the control unit 21 has a creation unit 216 for creating code information and a transmission unit 217 for transmitting the HTML document generated by the generation unit 213 and the code information created by the creation unit 216. Further, the control unit 21 has an evaluation grasping unit 220 for grasping information related to the evaluation of the product.

(Receiver)
The receiving unit 211 receives the information transmitted from the user terminal 10 via the network 50.
Here, the information that the receiving unit 211 first receives from the user terminal 10 will be illustrated.
FIG. 4 is a diagram showing an example of the access screen 70 displayed on the user terminal 10.
The access screen 70 shown in FIG. 4 is a screen displayed on the display unit 13 of the user terminal 10 after the camera 16 of the user terminal 10 reads the code information issued in advance and will be described later. As shown in FIG. 4, a predetermined address 70a is displayed on the access screen 70.
When the user who owns the user terminal 10 presses the address 70a, the receiving unit 211 of the server 20 receives the information that the code information issued in advance by the user terminal 10 has been read and the information of the user terminal 10. do.

(Identification section)
The identification unit 212 uniquely identifies and identifies the user terminal 10 based on the information from the user terminal 10 received by the reception unit 211.
As described above, when the user terminal 10 accesses the address displayed after reading the code information issued in advance to be described later, the receiving unit 211 receives the information transmitted from the user terminal 10. , The identification unit 212 analyzes the information received by the reception unit 211. Based on the information transmitted from the user terminal 10, the identification unit 212 grasps which area in the store the user terminal 10 has read the code information assigned to. In other words, the identification unit 212 grasps that the user who owns the user terminal 10 eats and drinks in a predetermined area in the store. It should be noted that the area can be exemplified as an area divided for each table or each room.

The identification unit 212 stores the area number, which is the identification number of the area, and the user number, which is the identification number of the user terminal 10, in the storage unit 22 in association with each other. When the user terminal 10 that has accessed the address displayed by reading the code information associated with one area is the Nth, the identification unit 212 sets the user number of the user terminal 10 to N. For example, when the user terminal 10 that has accessed the address displayed by reading the code information associated with the area having the area number 1 is the first, the identification unit 212 is the user of the user terminal 10. The number is 1.

Further, when there are a plurality of user terminals 10 that have accessed the address displayed by reading the code information associated with the same area (same area number), the identification unit 212 uses one of these user terminals 10. It is grasped that it is a plurality of user terminals 10 possessed by a plurality of users constituting the group of.
In this way, based on the area number, it is possible to distinguish between a group that eats and drinks in one area and a group that eats and drinks in another area. Further, by assigning a user number to the identification unit 212, it is possible to distinguish a plurality of users who eat and drink in the same area.

(Generator)
The generation unit 213 generates an HTML document that publishes a web page having various information about the products provided in the store in response to the access from the user terminal 10.
For example, the generation unit 213 displays products that can be provided at the store when the reception unit 211 receives the first access (access to the address 70a displayed after reading the code information) from the user terminal 10. Generate an HTML document to display the screen.

FIG. 5 is a diagram showing an example of the menu screen 71 displayed on the user terminal 10.
The HTML document for displaying the menu screen 71 generated by the generation unit 213 is transmitted to the user terminal 10 via the transmission unit 217. In the user terminal 10 that has received the HTML document transmitted from the server 20, the control unit 11 causes the display screen 13a of the display unit 13 to display the menu screen 71 shown in FIG. 5 based on the HTML document.
On the menu screen 71, a product name 71a, a product image 71b, a product description 71c, an order button 71d described as "order", and the like are displayed for each product provided at the store. Further, on the menu screen 71, the area number and the user number are displayed together with the product list. Further, on the menu screen 71, the accounting button 71e described as "accounting" is displayed.
The menu screen 71 illustrated in FIG. 5 is configured so that the products included in the category are displayed for each category such as fried food and pottery, but all the products are displayed on one screen. It may be displayed with. Further, if it is difficult to see all the products included in the category on one screen, it may be configured on a plurality of screens.
The generation unit 213 generates an HTML document for displaying the accounting screen 72 (see FIG. 7) described later when the accounting button 71e displayed on the menu screen 71 is pressed.

(Order Department)
FIG. 6 is a diagram showing an example of information stored in the storage unit 22.
The order receiving unit 214 receives an order from the user terminal 10.
The ordering unit 214 has received an order from the user terminal 10 when the receiving unit 211 receives information that the order button 71d has been pressed on the menu screen 71 displayed on the display unit 13 of the user terminal 10. To grasp.
The order receiving unit 214 stores the ordered product and its amount in the storage unit 22 in association with the user number and area number of the user terminal 10 that has placed the order.
As shown in FIG. 6, the user terminal 10 that has first accessed the address displayed by reading the code information associated with the area whose area number is 1, is accessed second by the user terminal 10A. The user terminal 10 that has been accessed is referred to as a user terminal 10B, and the user terminal 10 that has accessed third is referred to as a user terminal 10C.
In addition, the order receiving unit 214 transmits information such as the ordered product, the user number of the user terminal 10 that placed the order, and the area number to the store terminal 30 via the transmitting unit 217.

(Billing department)
The billing unit 215 charges the user terminal 10 by a billing method according to the accounting method selected by the user terminal 10 from a plurality of predetermined billing methods. In addition, the billing unit 215 transmits the amount to be paid using the user terminal 10 to the user terminal 10 via the transmission unit 217.

Among the plurality of billing methods, a collective billing method in which the total amount of all products eaten and eaten in one area (all products ordered via all user terminals 10) is charged to one user terminal 10. There is a way.
Further, among the plurality of billing methods, there is a terminal-by-terminal billing method in which the total amount of only the products ordered through the user terminal 10 is charged to the user terminal 10.
Further, in the plurality of billing methods, the total amount of all products eaten and eaten in one area (all products ordered via all user terminals 10) is stored in association with the one area. There is an equivalent discount billing method in which the amount of money equally divided by the number of user terminals 10 is charged to each user terminal 10.
In addition, among the plurality of billing methods, the total amount of all products eaten and eaten in one area (all products ordered via all user terminals 10) is divided by the ratio input by the user. , There is a special discount billing method for charging each user terminal 10.

In other words, the user having the user terminal 10 can select one accounting method from a plurality of predetermined accounting methods. Among the plurality of accounting methods, there is a collective accounting method in which the total amount of all products eaten and eaten in one area (all products ordered through all user terminals 10) is paid using one user terminal 10. .. Further, among the plurality of accounting methods, there is a terminal-by-terminal accounting method in which the total amount of only the products ordered through the user terminal 10 is paid by using the user terminal 10. When the user selects the collective accounting method and the terminal-based accounting method, the server 20 charges by the collective billing method and the terminal-based billing method, respectively.

In addition, among the plurality of accounting methods, each user divides the total amount of all products eaten and eaten in one area by the number of user terminals 10 stored in association with the one area. There is an equivalent discount accounting method for paying using the terminal 10.
Further, among the plurality of accounting methods, there is a special discount accounting method in which the total amount of all the products eaten and eaten in one area is divided by the ratio input by the user, and the amount is paid by using each user terminal 10. When the user selects the equal discount accounting method and the special discount accounting method, the server 20 charges by the equal discount billing method and the special discount billing method, respectively.

FIG. 7 is a diagram showing an example of the accounting screen 72 displayed on the user terminal 10.
The accounting screen 72 is displayed when the accounting button 71e displayed on the menu screen 71 shown in FIG. 5 is pressed. On the accounting screen 72, a summary accounting button 72a described as "summary accounting", a terminal accounting button 72b described as "terminal accounting", and an equivalent accounting button 72c described as "equivalent accounting" are displayed. And the special discount accounting button 72d described as "special discount accounting" are displayed.

FIG. 8 is a diagram showing an example of the summary accounting screen 73 displayed on the user terminal 10.
The summary accounting screen 73 is displayed when the summary accounting button 72a is pressed. On the summary accounting screen 73, as many buttons with user numbers as the number of user terminals 10 are displayed as buttons for selecting which user terminal 10 to use for payment. For example, when there are three user terminals 10 registered in the area where the area number is 1, "user number: 1", "user number: 2", and "user number", as shown in FIG. : 3 ”is displayed with three user number buttons 73a.

FIG. 9 is a diagram showing an example of a payment screen 74 at the time of summary accounting displayed on the user terminal 10.
The payment screen 74 is displayed when any user number button 73a is pressed on the summary accounting screen 73.
On the summary accounting screen 73 shown in FIG. 8, for example, when the user number button 73a described as "user number: 2" is pressed, the billing unit 215 of the server 20 is the user terminal having the user number 2. It is determined that the summary accounting is performed using 10. Then, the billing unit 215 transmits an HTML document including information such as the total amount to the user terminal 10 having the user number 2 via the transmission unit 217. As a result, the payment screen 74 shown in FIG. 9 is displayed on the display unit 13 of the user terminal 10. On the payment screen 74, the amount to be paid using the user terminal 10 (for example, 12,000 yen) is displayed as the billing amount, and the confirmation button 74a described as "confirmation" is displayed. When the user presses the confirmation button 74a displayed on the payment screen 74, the payment is completed using the electronic payment service described above. That is, when the billing unit 215 acquires the information that the confirmation button 74a is pressed, the billing unit 215 executes a predetermined payment process according to the electronic payment service selected on the user terminal 10. Then, when the billing unit 215 executes the predetermined payment process, the billing unit 215 may send a notification to the user terminal 10 that the payment has been completed. When the user terminal 10 uses, for example, a credit card payment service or a carrier payment service, and uses a service that requires an authentication procedure, the billing unit 215 performs a predetermined authentication procedure on the user terminal 10. After that, the payment process is executed.

FIG. 10 is a diagram showing an example of a payment screen 75 at the time of accounting for each terminal displayed on the user terminal 10. FIG. 10A illustrates the payment screen 75 displayed on the display unit 13 of the user terminal 10A, and FIG. 10B illustrates the payment screen 75 displayed on the display unit 13 of the user terminal 10B. However, FIG. 10C illustrates a payment screen 75 displayed on the display unit 13 of the user terminal 10C.
On the accounting screen 72 shown in FIG. 7, when the accounting button 72b for each terminal is pressed, the billing unit 215 of the server 20 provides information such as the total amount of only the products ordered via each user terminal 10. The included HTML document is transmitted via the transmission unit 217. As a result, as illustrated in FIG. 10, the display unit 13 of each user terminal 10 shows the amount to be paid using the user terminal 10 (the total amount of only the products ordered through the user terminal 10 (FIG. 10). In 10, the user terminal 10A is 3,000 yen, the user terminal 10B is 4,000 yen, and the user terminal 10C is 5,000 yen) is displayed as the billing amount, and the confirmation button 74a described as "confirmation" is displayed. However, the payment is completed by pressing the confirmation button 74a displayed on the display unit 13. The processing of the billing unit 215 after the confirmation button 74a is pressed is as described above.

FIG. 11 is a diagram showing an example of a payment screen 76 at the time of equivalent split accounting displayed on the user terminal 10. FIG. 11A illustrates the payment screen 76 displayed on the display unit 13 of the user terminal 10A, and FIG. 11B illustrates the payment screen 76 displayed on the display unit 13 of the user terminal 10B. However, FIG. 11C illustrates a payment screen 76 displayed on the display unit 13 of the user terminal 10C.
When the equivalent accounting button 72c is pressed on the accounting screen 72 shown in FIG. 7, the billing unit 215 of the server 20 is ordered for all products eaten and eaten in one area (via all user terminals 10). An HTML document containing information such as an amount obtained by dividing the total amount of the total amount of the products) by the number of the user terminals 10 is transmitted to all the user terminals 10 via the transmission unit 217. As a result, as illustrated in FIG. 11, the display unit 13 of each user terminal 10 is charged the amount to be paid using the user terminal 10 (the amount obtained by dividing the total amount by the same amount (so-called split amount)). Along with being displayed as an amount of money, a confirmation button 74a described as "confirmation" is displayed. The payment is completed when the user presses the confirmation button 74a displayed on the display unit 13. The processing of the billing unit 215 after the confirmation button 74a is pressed is as described above.

FIG. 12 is a diagram showing an example of the special discount accounting screen 77 displayed on the user terminal 10.
The special discount accounting screen 77 is displayed when the special discount accounting button 72d is pressed on the accounting screen 72 shown in FIG. 7. On the special discount accounting screen 77, all user numbers are displayed, and next to each user number, an input field 77a for inputting the ratio of the user terminal 10 of the user number and a number to be input in the input field 77a. The increase button 77b for increasing the number and the decrease button 77c for decreasing the number to be input in the input field 77a are displayed for the number of user terminals 10. In addition, on the special discount accounting screen 77, in order to prompt the input so that the total of the numbers to be input in all the input fields 77a is 10, "Please input so that the total is 10." Is displayed. Further, on the special discount accounting screen 77, a decision button 77d described as "decision" is displayed.
The special discount accounting screen 77 shown in FIG. 12 is an input example in which the ratio to the user number 1 is 5, the ratio to the user number 2 is 3, and the ratio to the user number 2 is 2.

FIG. 13 is a diagram showing an example of the payment screen 78 at the time of special discount accounting displayed on the user terminal 10.
When the ratio of all user terminals 10 is input on the special discount accounting screen 77 and the enter button 77d is pressed, the billing unit 215 of the server 20 eats and drinks all products in one area (all user terminals 10). An HTML document containing information such as an amount obtained by dividing the total amount of all the products ordered through the user at a ratio input by the user is transmitted to all user terminals 10 via the transmission unit 217. For example, in the billing unit 215, as illustrated on the special discount accounting screen 77 of FIG. 12, when the ratio of the user number 1 is 5, the ratio of the user number 2 is 3, and the ratio of the user number 3 is 2. An HTML document containing information such as the total amount multiplied by 5/10 is transmitted to the user terminal 10A of user number 1 via the transmission unit 217. Further, the billing unit 215 transmits an HTML document including information such as an amount obtained by multiplying the total amount by 3/10 to the user terminal 10B having the user number 2. Further, the billing unit 215 transmits an HTML document including information such as an amount obtained by multiplying the total amount by 2/10 to the user terminal 10C having the user number 3.

As a result, the payment screen 78 shown in FIG. 13 is displayed on the display unit 13 of each user terminal 10. On the payment screen 78, the amount to be paid using each user terminal 10 is displayed as the billing amount (the amount is a value according to the input ratio), and the confirmation button 74a described as "confirmation" is displayed. Is displayed. The payment is completed when the user presses the confirmation button 74a displayed on the payment screen 78. The processing of the billing unit 215 after the confirmation button 74a is pressed is as described above.

(Creation department)
The creation unit 216 creates code information including the area number of the area for each area predetermined in the store. By accessing the address displayed after the user terminal 10 reads the code information created by the creation unit 216, the identification unit 212 can grasp which area the code information is read and accessed. can.
The creation unit 216 newly creates code information for the area after eating and drinking in a certain area and grasping that the payment has been completed. The completion of payment can be grasped, for example, by acquiring information that the billing unit 215 has executed the payment process. In addition, the creation unit 216 may create code information according to the instructions of the store employee. Employees may create code information after confirming that a group that has finished eating and drinking in a certain area has left the store, or create as many code information as necessary on the day before business starts. You may.
The creation unit 216 transmits information including the created code information to the store terminal 30 via the transmission unit 217. Based on the instruction from the store terminal 30, the printer 40 forms, for example, an image including code information on paper, and outputs (prints out) it.
In addition, it can be exemplified that the area is divided for each table or each room. However, even if the paper on which the image containing the code information is formed is arranged for each table or room, if the number of people forming one group exceeds the number of people allowed for each table or room, One code information may be shared by a plurality of people who use a plurality of areas.

(Transmitter)
The transmission unit 217 transmits the HTML document generated by the generation unit 213 to the user terminal 10. For example, the transmission unit 217 transmits an HTML document for displaying the menu screen 71 to the user terminal 10.
In addition, the transmission unit 217 transmits information such as a product ordered from the user terminal 10 and a user number and area number of the user terminal 10 that placed the order to the store terminal 30.
In addition, the transmission unit 217 transmits information including the code information created by the creation unit 216 to the store terminal 30.
Further, the transmission unit 217 transmits the evaluation for one product grasped by the evaluation grasping unit 220 to the store terminal 30.

(Evaluation grasping department)
FIG. 14 is a block diagram illustrating the functional configuration of the evaluation grasping unit 220.
The evaluation grasping unit 220 includes a voice analysis unit 221 that analyzes the human voice recorded by the microphone 61 of the acquisition system 60, and an image analysis unit 222 that analyzes the captured image captured by the camera 62 of the acquisition system 60. doing. Further, the evaluation grasping unit 220 has an evaluation deriving unit 223 that derives information on product evaluation based on at least one of the voice analyzed by the voice analysis unit 221 and the image analyzed by the image analysis unit 222. ..

≪Voice analysis department≫
The voice analysis unit 221 analyzes the acoustic information recorded by the microphone 61 among the information acquired from the acquisition system 60. The voice analysis unit 221 analyzes the recorded acoustic information and identifies a human voice. Then, the voice analysis unit 221 analyzes the human voice, recognizes the utterance content, and converts it into a text. More specifically, the voice analysis unit 221 first detects the content of the utterance and the utterance section (start time and end time) corresponding to the continuous voice from the acoustic information recorded by the microphone 61, and then each of them. Convert the content of the utterance into text. The voice analysis unit 221 provides information on evaluations such as "delicious", "not delicious", "bad", "strong taste", "light taste", "cold", "slimy", and information on products. Only can be recognized and converted into text.
The voice analysis unit 221 also recognizes the utterance content recorded by the microphone 61 installed at which position in which area. In addition, the voice analysis unit 221 also recognizes which user in one area has generated the voice.

≪Image analysis department≫
The image analysis unit 222 analyzes the captured image captured by the camera 62 among the information acquired from the acquisition system 60. The image analysis unit 222 analyzes the captured image and recognizes the captured area as a three-dimensional space. In addition, the image analysis unit 222 identifies a person and a non-person object among the photographed objects. Identification of a person or other object by image analysis can be performed using existing technology related to image recognition. The image analysis unit 222 also recognizes which area the image was taken. In addition, the image analysis unit 222 also recognizes which user in one area is the photographed image.

Further, the image analysis unit 222 detects the user's face by performing contour detection or the like from the captured image of the person, and extracts the feature amount of each part of the face such as eyes, nose, and mouth. Then, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount of each part of the face such as eyes, nose, and mouth when smiling, which is given as recognition data, and the degree of matching is obtained. When it is equal to or more than the threshold value, the user's facial expression is recognized as a smile. On the other hand, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount given as recognition data, and recognizes that the user's facial expression is not a smile when the degree of matching is less than the threshold value. do. That is, the smile recognized by the image analysis unit 222 is extracted from the image in which the features of each part of the face extracted from the captured image are selected as the image in which the smile is reflected at the time of development of the smile recognition function or the like. It is a facial expression that matches the facial features by a threshold or more. Further, the image analysis unit 222 recognizes the time when the recognized smile is taken.

In addition, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount of each part of the face such as eyes, nose, and mouth at the time of an angry face, which is given as recognition data, and the degree of agreement. When is equal to or greater than the threshold value, the user's facial expression is recognized as an angry face. On the other hand, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount given as the recognition data, and if the degree of matching is less than the threshold value, the user's facial expression is not an angry face. recognize. That is, the angry face recognized by the image analysis unit 222 is an image in which the features of each part of the face extracted from the captured image are selected as an image in which the angry face is reflected at the time of development of the angry face recognition function or the like. It is a facial expression that matches the extracted facial features by a threshold or more. In addition, the image analysis unit 222 recognizes the time when the recognized angry face was photographed.

Further, the image analysis unit 222 detects a product from a photographed image of an object other than a person and extracts a feature amount of the product. Then, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount of each product given as recognition data, and identifies the product based on whether or not the degree of matching is equal to or greater than the threshold value. .. That is, the product recognized by the image analysis unit 222 is a product whose characteristics extracted from the photographed image are extracted from the image selected as the image in which the product is shown at the time of development of the product recognition function or the like. It is a product that matches the characteristics and the threshold or more. In addition, the image analysis unit 222 recognizes the time when the recognized product was photographed.

The image analysis unit 222 may be based on the product for which the order receiving unit 214 has received an order when identifying the product from the captured image. For example, when the image analysis unit 222 identifies a product from a photographed image, if the ordering unit 214 receives an order from one group for one product, the image analysis unit 222 sets the feature amount extracted from the photographed image and the feature amount. It is advisable to first compare the feature quantity of one product for which the order receiving unit 214 has received an order. When identifying products from the captured image, if there are multiple products for which the ordering unit 214 has received an order from one group, the feature quantity extracted from the captured image and the plurality of products for which the ordering unit 214 has received an order. It is advisable to compare the feature quantity of the product of the above product before the feature quantity of the product for which the order has not been received. By considering the product for which the order receiving unit 214 has received the order, it is possible to identify the product more quickly and accurately than when the ordering unit 214 does not consider the product for which the order has been received.
Further, when the facial expression is specified, the image analysis unit 222 identifies the user who eats or drinks the product.

≪Evaluation derivation part≫
The evaluation derivation unit 223 derives information on product evaluation based on at least one of the voice analyzed by the voice analysis unit 221 and the image analyzed by the image analysis unit 222.
When the evaluation derivation unit 223 can derive information on the evaluation of one product from the utterance content of one user recognized by the voice analysis unit 221 and converted into text, the evaluation derivation unit 223 obtains the analysis result by the voice analysis unit 221. Use to derive information about the evaluation of one product. For example, in the evaluation derivation unit 223, when the voice analysis unit 221 recognizes the utterance content of "this fried tofu is delicious" and "fried tofu" and "delicious" are continuous, and converts it into a text. Derives that the evaluation of "fried tofu" is "delicious". In addition, the evaluation derivation unit 223 derives that the evaluation of "draft beer" is "slimy" when the voice analysis unit 221 recognizes the utterance content of "this draft beer, lukewarm" and converts it into a text. do.

The evaluation derivation unit 223 uses the image analysis unit 222 when it is possible to derive information on the evaluation of one product from the facial expression of one user recognized by the image analysis unit 222 and the product eaten or eaten by the one user. Information on the evaluation of one product is derived using the analysis results. For example, when the image analysis unit 222 recognizes the smile of the user and specifies that the product with a smile is "fried tofu", the evaluation derivation unit 223 evaluates the "fried tofu". Derives that is a "smile". Assuming that "smile" means "good", it may be derived that the evaluation of "fried tofu" is "good". Further, when the image analysis unit 222 recognizes the user's angry face and specifies that the product with the angry face is "beer", the evaluation derivation unit 223 evaluates the "beer" to "beer". Derive that it is an angry face. Assuming that "angry face" means "bad", it may be derived that the evaluation of "beer" is "bad".

The evaluation derivation unit 223 can derive information on the evaluation of a certain product from the utterance content of one user recognized by the voice analysis unit 221, but if the product to be evaluated cannot be specified, the other Identify the target product using the utterance content of the person. For example, the evaluation derivation unit 223 derives that the evaluation of a certain product is "delicious" when the voice analysis unit 221 recognizes the content of the utterance "this is delicious". Then, when the target product for evaluation as "delicious" cannot be specified from the utterance content of one user recognized by the voice analysis unit 221, another person before and after one user utters "delicious". Identify the product using the utterance content. For example, if the voice analysis unit 221 recognizes that the other user is uttering "How about the taste of fried tofu?" Just before the one user utters "delicious", the evaluation derivation unit 223 derives that the evaluation of "fried tofu" is "delicious". In addition, when the voice analysis unit 221 recognizes that the caterer utters, for example, "Agedashi tofu" immediately before the one user utters "delicious", the evaluation derivation unit 223 changes to ". It is derived that the evaluation of "fried tofu" is "delicious". Refer to the time when one user utters "delicious" and the time when another user utters "How about the taste of fried tofu?" Or the time when the caterer utters "It is fried tofu." Therefore, it is possible to identify that the target product evaluated as "delicious" is "fried tofu".

Further, the evaluation derivation unit 223 can derive information on the evaluation of a certain product from the utterance content of one user recognized by the voice analysis unit 221, but when the product to be evaluated cannot be specified, the evaluation derivation unit 223 can derive the information. , The product is specified using the product recognized by the image analysis unit 222. For example, the evaluation derivation unit 223 derives that the evaluation of a certain product is "delicious" when the voice analysis unit 221 recognizes the content of the utterance "delicious". Then, when the target product for evaluation as "delicious" cannot be specified from the utterance content recognized by the voice analysis unit 221, the product eaten or eaten immediately before the user who utters "delicious" utters "delicious" is eaten. The product is specified using the product recognized by the image analysis unit 222. By referring to the time when the product is said to be "delicious" and the time when the product is eaten or eaten, the product to be evaluated as "delicious" can be specified.

Further, the evaluation derivation unit 223 can derive information on the evaluation of the product from the facial expression of one user recognized by the image analysis unit 222, but the product to be evaluated from the image analyzed by the image analysis unit 222. If it cannot be specified, the target product is specified using the utterance content. For example, if the voice analysis unit 221 recognizes that another user is uttering "How about the taste of fried tofu?" Immediately after one user has a facial expression related to the evaluation, the evaluation is derived. Department 223 identifies that the product to be evaluated is "fried tofu". In addition, when the voice analysis unit 221 recognizes that the caterer utters, for example, "It is fried tofu" immediately before one user has a facial expression related to the evaluation, the evaluation derivation unit 223 Identify that the product to be evaluated is "fried tofu". In addition, when the voice analysis unit 221 recognizes that the one user has uttered, for example, "I will have fried tofu" immediately before the one user has a facial expression related to the evaluation, the evaluation is derived. Department 223 identifies that the product to be evaluated is "fried tofu". The time when one user had a facial expression (for example, a smile) related to the evaluation, the time when the other user said "How about the taste of fried tofu?", And the caterer said "It's fried tofu." By referring to the time or the time when one user says "I will have fried tofu", it is possible to identify that the product to be evaluated is "fried tofu".

Further, the evaluation derivation unit 223 may be based on the product for which the order receiving unit 214 has received an order when specifying the product from the utterance content or the photographed image. For example, even if the voice analysis unit 221 recognizes that the evaluation derivation unit 223 is uttering "Steak is delicious", if the ordering unit 214 has not received an order for steak from this group, the store is informed. It may be judged that the evaluation is not the evaluation of the provided product, and the evaluation may not be derived.

When the evaluation derivation unit 223 derives the evaluation for one product, the evaluation derivation unit 223 stores the product name and the information related to the evaluation in the storage unit 22 in association with each other. In the above-mentioned example, the evaluation derivation unit 223 stores the “fried tofu” and the “delicious” in the storage unit 22 in association with each other. Further, the evaluation derivation unit 223 stores the “fried tofu” and the “smile” or “good” in the storage unit 22 in association with each other. Further, the evaluation derivation unit 223 stores "beer" in the storage unit 22 in association with "angry face" or "bad".
When the evaluation derivation unit 223 derives the evaluation for one product, the evaluation derivation unit 223 associates the product name with the information related to the evaluation and transmits the product name to the store terminal 30 via the transmission unit 217.

Next, an example of the procedure of the evaluation grasping process performed by the evaluation grasping unit 220 will be described with reference to the flowchart.
FIG. 15 is a flowchart showing an example of the procedure of the evaluation grasping process performed by the evaluation grasping unit 220.
The evaluation grasping unit 220 repeatedly executes this evaluation grasping process every predetermined period (for example, 1 millisecond).

The evaluation grasping unit 220 determines whether or not the user's utterance content includes information related to the evaluation (step (hereinafter, may be referred to as “S”) 1501). This is a process in which the evaluation derivation unit 223 determines based on the user's utterance content recognized by the voice analysis unit 221, and the utterance content includes information on evaluation such as "delicious" or "not delicious". It is a process of determining whether or not it is included. Then, when the information regarding the evaluation is included (Yes in S1501), it is determined whether or not the product to be evaluated can be specified from the utterance content of one user (S1502). For example, the utterance content of one user recognized by the voice analysis unit 221 is a sentence in which the information related to the evaluation determined to be included in S1501 such as "This fried tofu is delicious" and the product name are continuous. In that case, it is determined that the product to be evaluated can be specified. Then, when the product to be evaluated can be specified (Yes in S1502), the product name and the information related to the evaluation are associated and stored in the storage unit 22 (S1503). Further, the evaluation grasping unit 220 may store the product name in the storage unit 22 and may associate the product name with the information related to the evaluation and transmit the product name to the store terminal 30 via the transmitting unit 217.

On the other hand, when the product to be evaluated cannot be specified (No in S1502), the evaluation grasping unit 220 can identify the product from the utterance content of another user or is based on the image recognized by the image analysis unit 222. It is determined whether or not the product can be specified by other means such as whether or not the product can be specified (S1504). When the product to be evaluated can be specified (Yes in S1504), the evaluation grasping unit 220 stores the product name in the storage unit 22 and stores the product name and the information related to the evaluation in the storage unit 22 (Yes). S1503).

On the other hand, when the evaluation-related information is not included (No in S1501), it is determined whether or not the evaluation-related information can be acquired using the image recognized by the image analysis unit 222 (step (S1505). , The evaluation derivation unit 223 is a process of determining based on the user's facial expression recognized by the image analysis unit 222. For example, whether or not the user's facial expression immediately after eating or drinking the product is a "smile" or an "angry face". This is a process of determining whether or not the product is evaluated. If the evaluation information is included (Yes in S1505), the user (for example, "smile") whose evaluation target product is shown in the image obtained from the evaluation information. (S1506), and when the product to be evaluated can be identified (Yes in S1506), the evaluation grasping unit 220 determines whether or not it can be identified from the images before and after the user) eats and drinks. , The product name and the information related to the evaluation are associated with each other and stored in the storage unit 22 (S1503).

On the other hand, when the product to be evaluated cannot be specified (No in S1506), the evaluation grasping unit 220 is the user (for example, the user who was "smiling") or another user who is reflected in the image from which the evaluation information is acquired. It is determined whether or not the product can be specified from the content of the user's utterance (S1507). When the product to be evaluated can be specified (Yes in S1507), the evaluation grasping unit 220 stores the product name in the storage unit 22 and stores the product name and the information related to the evaluation in the storage unit 22 (Yes). S1503).

<Store terminal 30>
FIG. 16 is a block diagram illustrating the functional configuration of the store terminal 30.
The store terminal 30 includes a control unit 11, a storage unit 12, a display unit 13, an operation unit 14, a communication unit 15, a speaker 17, and a control unit 31, a storage unit (not shown), and a display unit, which are included in the user terminal 10. 33, an operation unit (not shown), a communication unit (not shown), and a speaker 37 are provided.
It can be exemplified that the store terminal 30 is a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, a desktop PC, or the like.
It can be exemplified that the store terminal 30 is arranged in the kitchen of the store, for example.

The control unit 31 has a CPU (not shown), a ROM (not shown), a RAM (not shown), and the like, and the CPU executes a program to realize the following functions.
That is, the control unit 31 has an acquisition unit 311 that acquires information or the like that the order for the product has been accepted from the server 20. Further, the control unit 31 includes a display control unit 312 that controls the display unit 33, an acoustic control unit 313 that controls the speaker 37, and an output unit 314 that causes the printer 40 to output an image.

The acquisition unit 311 acquires the ordered product, the user number of the user terminal 10 that placed the order, the area number, and the like, which are information related to the order of the product, from the server 20.
The display control unit 312 controls the display unit 33 so that the information regarding the order acquired by the acquisition unit 311 is displayed on the display screen of the display unit 33. For example, the display control unit 312 displays the product name and product number for which the order has been received, the user number and area number for which the order has been placed, on the display screen of the display unit 33.

The acoustic control unit 313 controls the speaker 37 so as to output a sound about the information regarding the order acquired by the acquisition unit 311. For example, the acoustic control unit 313 causes the speaker 37 to output the product name and product number for which the order has been received, the user number and area number for which the order has been placed, by voice.
The output unit 314 causes the printer 40 to output an image of the product name and product number that received the order, the user number that placed the order, and the area number, which is information about the order acquired by the acquisition unit 311. Further, the output unit 314 causes the printer 40 to output the code information created by the creation unit 216 of the server 20 and the image of the area number associated with the code information.

The cook received the order for the product by displaying the product name, product number, user number, area number, etc. on the display screen of the display unit 33 or by outputting the sound from the speaker 37. It becomes possible to grasp that, and the caterer can deliver the product to the area where the order is placed. Further, by looking at the paper on which the product name, product number, user number, area number, etc. are written, which is output by the printer 40, the cook can grasp that the product has been ordered. The caterer will be able to deliver the product to the area where the order was placed.
The paper on which the code information and the like are written is placed in the corresponding area by an employee of the store (for example, a caterer).

In addition, the acquisition unit 311 acquires information and the like related to product evaluation from the server 20.
The display control unit 312 may control the display unit 33 so that the information regarding the evaluation of the product acquired by the acquisition unit 311 is displayed on the display screen of the display unit 33.
The acoustic control unit 313 may control the speaker 37 so as to output a sound about the information regarding the evaluation acquired by the acquisition unit 311.
The output unit 314 may output an image of the evaluation-related information acquired by the acquisition unit 311 to the printer 40.

The store employee grasps the evaluation of the product by displaying the product name and information related to the evaluation of the product on the display screen of the display unit 33 or by outputting the sound from the speaker 37. It becomes possible to do. Further, by looking at the paper on which the product name and the information related to the evaluation of the product are described, which is output by the printer 40, the store employee can grasp the evaluation of the product.
The display control unit 312 displays the product name and information related to the evaluation of the product on the display unit 33, the acoustic control unit 313 outputs sound from the speaker 37, and the output unit 314 outputs the product to the printer 40. It may be done at the request of the employee of the store.

<Acquisition system 60>
The acquisition system 60 includes a microphone 61, a camera 62, and a communication server 63. The microphone 61 and the camera 62 are connected to the communication server 63. The communication server 63 is further connected to the server 20 via the network 50. The microphone 61, the camera 62, the communication server 63, and the communication server 63 and the server 20 may be able to communicate with each other by wireless communication such as LAN, bluetooth (registered trademark) or infrared communication, or wired communication.

The microphone 61 is a recording device that records sound (acoustic information) as information. As the microphone 61, a microphone having various characteristics and configurations may be used depending on the place to be recorded, the type of acoustic information, and the like. The acoustic information recorded by the microphone 61 is sent to the communication server 63 as digital data. It can be exemplified that a plurality of microphones 61 are provided so as to be able to record utterances in all areas provided in the store. Further, it can be exemplified that a plurality of microphones 61 are provided so as to be able to record the utterances of all the plurality of users who eat and drink in one area.

The camera 62 is an imaging device that acquires an image of the inside of the store. The image acquired by the camera 62 is sent to the communication server 63 as digital data. The image acquired by the camera 62 may be either a moving image or a still image. As the camera 62, those having various configurations may be used depending on the usage environment. For example, it may be a portable camera or a fixed camera. Further, a wide-angle camera or an all-around camera that acquires an image of a wide surrounding space, a plurality of camera groups that capture a specific object or place at various angles, or the like may be used. It can be exemplified that a plurality of users who eat and drink in one area and a plurality of cameras 62 are provided so as to be able to photograph all the products placed on the table installed in one area.

The communication server 63 is a communication control device that transmits information acquired by the microphone 61 and the camera 62 to the server 20. It can be exemplified that the communication server 63 is, for example, a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, a desktop PC, or the like. Further, a router constituting a LAN to which a microphone 61 and a camera 62 (hereinafter, these may be collectively referred to as an “information acquisition device”) is connected to have an information processing function and a communication control function is used. You may. Further, various information devices (television receiver, facsimile machine, etc.) having a function of connecting to the network 50 and an information processing function may be used.

The communication server 63 collects information from each information acquisition device according to the setting. Specifically, information may be acquired continuously at all times, information may be acquired intermittently at regular time intervals, or when a predetermined event occurs (event). Information may be acquired as a trigger). Information may be sent from the information acquisition device by push-type communication, or information may be acquired by pull-type communication in which the communication server 63 inquires of the information acquisition device. As long as the communication does not collide, the information may be sent to the communication server 63 by a different method or mode for each information acquisition device. As a predetermined event, it can be exemplified that the order receiving unit 214 of the server 20 receives an order by a user who eats and drinks using the area to be acquired by each information acquisition device. Then, the communication server 63 may end the acquisition when the user who eats and drinks using the area to be acquired by each information acquisition device leaves the store.

Further, the communication server 63 transmits the acquired information to the server 20 according to the setting. Specifically, it may be connected to the server 20 at all times to continuously transmit information, or may be intermittently connected to the server 20 at regular time intervals to transmit information. Further, information may be transmitted by connecting to the server 20 when a predetermined event (event) occurs as a trigger. As a predetermined event, it can be exemplified that a user who eats and drinks using the area to be acquired by each information acquisition device leaves the store.

17-1 and 17-2 are sequence diagrams showing an operation example in the cashless system 1 according to the present embodiment. In the operation example shown in FIGS. 17-1 and 17-2, one group including three users A, B, and C is formed, and the user terminal 10A owned by the user A and the user B own the operation example. An operation example is shown when an order or an accounting is performed on the user terminal 10B and the user terminal 10C owned by the user C.

First, the user A reads the code information previously placed in the guided area (the area number is 1) by the user terminal 10A owned by the user A, and accesses the address displayed after the reading. (S1701).
The server 20 stores the area number and the user terminal 10A in association with each other (S1702). More specifically, since it is the user terminal 10A that first accesses based on the address displayed by reading the code information arranged in the area where the area number is 1, the user terminal 10A The user number, which is the identification number, is set to 1, and is stored in the storage unit 22 in association with the area number. This is a process performed by the identification unit 212. Then, in the server 20, the generation unit 213 generates an HTML document for displaying the menu screen and transmits it to the user terminal 10A (S1703). The user terminal 10A displays a menu screen on the display unit 13 (S1704).

The user B reads the code information previously placed in the guided area (area number: 1) by the user terminal 10B owned by the user B, and accesses the address displayed after the reading (S1705).
The server 20 stores the area number and the user terminal 10B in association with each other (S1706). More specifically, since it is the user terminal 10B that has accessed next to the user terminal 10A based on the address displayed by reading the code information arranged in the area where the area number is 1. , The user number, which is the identification number of the user terminal 10B, is set to 2, and is stored in the storage unit 22 in association with the area number. Then, the server 20 generates an HTML document for displaying the menu screen and transmits it to the user terminal 10B (S1707). The user terminal 10B displays a menu screen on the display unit 13 (S1708).

The user C reads the code information previously placed in the guided area by the user terminal 10C owned by the user C, and accesses the address displayed after reading the code information (S1709).
The server 20 stores the area number and the user terminal 10C in association with each other (S1710). More specifically, since it is the user terminal 10C that has accessed next to the user terminal 10B based on the address displayed by reading the code information arranged in the area where the area number is 1. , The user number, which is the identification number of the user terminal 10C, is set to 3, and is stored in the storage unit 22 in association with the area number. Then, the server 20 generates an HTML document for displaying the menu screen and transmits it to the user terminal 10C (S1711). The user terminal 10C displays a menu screen on the display unit 13 (S1712).

After that, the user A selects one product (for example, beer) from the product group displayed on the menu screen displayed on the display unit 13 of the user terminal 10A, and presses the order button 71d for that product. (S1713). The server 20 receives an order for the product, and stores the ordered product in the storage unit 22 in association with the user number and area number of the user terminal 10 that has placed the order (S1714). Then, the server 20 transmits information such as the ordered product, the user number of the user terminal 10 that placed the order, and the area number to the store terminal 30 (S1715). These are the processes performed by the order receiving unit 214.

In the store terminal 30, information on the order of the product from the server 20 is acquired, and the acquired information, the ordered product (for example, beer), and the user number (user number: 1) of the user terminal 10A that placed the order. ) And the area number (area number: 1) are notified (S1716). As the notification method, at least one of the above-mentioned display on the display screen of the display unit 33, sound output from the speaker 37, and output to the printer 40 can be exemplified.
Then, the employee of the store (for example, the caterer) delivers the ordered product (for example, beer) to the user A, and the user A receives the ordered product (S1717).
The processing of S1713 to S1717 is repeated for each order until the orders from all the users of user A, user B, and user C are completed.

The evaluation grasping unit 220 of the server 20 performs an evaluation grasping process for grasping information related to product evaluation based on at least one of the voice analyzed by the voice analysis unit 221 and the image analyzed by the image analysis unit 222 (S1718). .. In this evaluation grasping process, when the evaluation grasping unit 220 grasps the evaluation for one product, the product name and the information related to the evaluation are associated and stored in the storage unit 22. Further, the evaluation grasping unit 220 may transmit the product name and the information related to the evaluation to the store terminal 30. In this way, the server 20 can grasp the evaluation of the product immediately after the user eats and drinks. Therefore, the server 20 can grasp the information regarding the evaluation with higher accuracy than, for example, inputting the evaluation after the user leaves the store.

When any user constituting one group presses the accounting button 71e displayed on the menu screen 71 displayed on the display unit 13 of the user terminal 10 (user terminal 10A in FIG. 17-2). (S1719). In the server 20, the generation unit 213 generates an HTML document for displaying the accounting screen 72 (S1720), and the transmission unit 217 transmits the HTML document to the user terminal 10A (S1721). The user terminal 10A displays the accounting screen 72 on the display unit 13 (S1722).

After that, it is assumed that the user A presses the equivalent accounting button 72c displayed on the accounting screen 72 displayed on the display unit 13 of the user terminal 10A (S1723). In the server 20, the billing unit 215 calculates the total amount of all the products eaten and eaten in the area where the area number is 1, divided by 3 which is the number of user terminals 10 (S1724). An HTML document containing information such as an amount of money is transmitted to all user terminals 10 (user terminal 10A, user terminal 10B, user terminal 10C) via the transmission unit 217 (S1725). All user terminals 10 (user terminals 10A, user terminals 10B, user terminals 10C) display the same divided amount and the confirmation button 74a on the display unit 13 (S1726).

After that, when the user A presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10A (S1727), the server 20 performs the payment process (S1728). As a result, payment using the user terminal 10A is completed. Further, when the user B presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10B (S1729), the server 20 performs the payment process (S1730). As a result, payment using the user terminal 10B is completed. Further, when the user C presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10C (S1731), the server 20 performs the payment process (S1732). As a result, payment using the user terminal 10C is completed.

The cashless system 1 according to the present embodiment configured as described above includes a receiving unit 211 as an example of a receiving means for receiving a connection request from a user terminal 10 of a user who visits a restaurant, and a restaurant. This is an example of an evaluation acquisition system including a generation unit 213 as an example of display control means for displaying a list of dishes to be provided on the user terminal 10. The cashless system 1 according to the present embodiment is an ordering unit 214 as an example of an ordering means for receiving an order for a product from the user terminal 10, and a grasping means for grasping information on product evaluation from the behavior of the user. An evaluation grasping unit 220 is provided as an example.
According to the cashless system 1 according to the present embodiment, since the evaluation grasping unit 220 grasps the information related to the evaluation of the product from the behavior of the user, it is more than the case where the information related to the evaluation of the product is grasped from other than the behavior of the user. It is possible to grasp information on highly accurate evaluation.

The evaluation grasping unit 220 may grasp the information regarding the evaluation of the product based on the utterance content recorded by the microphone 61 as an example of the recording means for recording the user's utterance. The voice analysis unit 221 recognizes the user's utterance content by analyzing the acoustic information recorded by the microphone 61. Then, when the evaluation derivation unit 223 can grasp the evaluation for one product from the utterance content recognized by the voice analysis unit 221, the evaluation derivation unit 223 grasps the evaluation for one product by using the analysis result by the voice analysis unit 221. do. According to the cashless system 1 according to the present embodiment, for example, by grasping the information regarding the evaluation of the product based on the raw voice immediately after eating and drinking of the user, it is possible to grasp the information regarding the highly accurate evaluation.

The evaluation grasping unit 220 may grasp the information regarding the evaluation of the product based on the facial expression of the user after eating the product taken by the camera 62 as an example of the imaging means for capturing the facial expression of the user. The image analysis unit 222 recognizes the facial expression of the user by analyzing the captured image captured by the camera 62. The image analysis unit 222 identifies the products eaten and eaten by the user by analyzing the captured image captured by the camera 62. Then, the evaluation derivation unit 223 uses the analysis result by the image analysis unit 222 when the evaluation for one product can be grasped from the user's facial expression recognized by the image analysis unit 222 and the product that the user eats and drinks. Grasp the evaluation of one product. According to the cashless system 1 according to the present embodiment, for example, by grasping the information regarding the evaluation of the product based on the facial expression of the user immediately after eating and drinking, it is possible to grasp the information regarding the highly accurate evaluation.

The evaluation grasping unit 220 may specify the product eaten by the user based on the order received by the order receiving unit 214. For example, when the image analysis unit 222 specifies a product from a captured image, if the ordering unit 214 receives a plurality of orders from one group, the feature amount extracted from the captured image and the ordering unit 214 It is advisable to compare the feature quantities of a plurality of ordered products before the feature quantities of the products that have not received an order. By considering the product for which the order receiving unit 214 has received the order, it is possible to identify the product more quickly and accurately than when the ordering unit 214 does not consider the product for which the order has been received.

The evaluation grasping unit 220 may grasp the information regarding the evaluation of the product based on the utterance content recorded by the microphone 61 and the image taken by the camera 62. That is, when the microphone 61 cannot record both the product information and the evaluation information, or when the camera 62 cannot capture both the product and the user's facial expression, the utterance content recorded by the microphone 61 and the camera 62 capture the image. Information on the product and information on the evaluation may be grasped by using the captured image.
For example, the evaluation grasping unit 220 may specify the product that the user has eaten or drink based on the image taken by the camera 62, and grasp the evaluation of the product based on the utterance content recorded by the microphone 61. Alternatively, the evaluation grasping unit 220 may grasp the evaluation of the product based on the facial expression of the user photographed by the camera 62, and specify the product eaten or eaten by the user based on the utterance content recorded by the microphone 61.

The evaluation grasping unit 220 may specify the product eaten by the user by selecting from a plurality of products for which the order receiving unit 214 has received the order. When the user identifies the product that the user has eaten or eaten based on the utterance content recorded by the microphone 61 or the image taken by the camera 62, the order unit 214 considers the product for which the order has been received, so that the order unit 214 It is possible to identify the product more quickly and accurately than when the ordered product is not taken into consideration.

In the cashless system 1 according to the above-described embodiment, the image analysis unit 222 recognizes a smiling face or an angry face, which is a facial expression of the user, as information regarding the evaluation of the product, and the evaluation derivation unit 223 receives the evaluation derivation unit 223. It is understood that "smile" is an evaluation indicating "good" and "angry face" is an evaluation indicating "bad", but it is not particularly limited to such an aspect. For example, the image analysis unit 222 recognizes that the facial expression of the user is a marvelous face or an astringent face, and the evaluation derivation unit 223 recognizes that the "amazing face" is "good" and the "astringent face" is "bad". It may be understood that it is an evaluation indicating that.
Further, the image analysis unit 222 may recognize other than the facial expression of the user in order to obtain information on the evaluation. For example, the image analysis unit 222 may recognize a gesture of raising the thumb or a gesture of lowering the thumb. Then, the evaluation derivation unit 223 may grasp that the "thumb-up gesture" is an evaluation indicating "good" and the "thumb-down gesture" is an evaluation indicating "bad".

Further, in the cashless system 1 according to the present embodiment, the server 20 makes it possible to browse the evaluation of each product grasped by the evaluation grasping unit 220 as word-of-mouth on the Internet together with the list of dishes provided at the restaurant. You may. This makes it possible for a restaurant to appeal to a particular dish if it has strengths. For example, even if the overall rating of a restaurant is low due to poor customer service, if the restaurant has strengths in a particular dish and the rating of that particular dish is high, it will acquire customers for that particular dish. be able to. As a result, it becomes possible to improve the management of the restaurant. In addition, the user can satisfy the demand for deliciously eating a favorite dish by visiting a store where a specific dish is highly evaluated.
When making the evaluation of food available on the Internet, the server 20 may display the food provided at the restaurant on the external terminal in descending order of evaluation. As a result, the person who owns the external terminal can easily check the food with a high evaluation when checking the food. Further, the server 20 may not publish the grasped evaluation when it is negative.

In the cashless system 1 according to the above-described embodiment, accounting processing is performed after eating and drinking at a restaurant, but payment can be made each time an order is placed on the user terminal 10. You may. For example, when the server 20 receives the fact that the order button 71d of the menu screen 71 displayed on the display unit 13 of the user terminal 10 is pressed, the server 20 displays the accounting screen 72 illustrated in FIG. 7 on the display unit of the user terminal 10. It may be displayed on 13. Then, it is possible to select whether to pay the price of each ordered product at the user terminal 10 of any of the plurality of users constituting one group, the equal discount, or the special discount. It is good to set it to.

Further, in the cashless system 1 according to the above-described embodiment, the checkout button is displayed on the menu screen 71 displayed on all the display units 13 of the plurality of user terminals 10 owned by the plurality of users constituting one group. Although 71e is displayed, the present invention is not particularly limited to this mode. For example, one of a plurality of users constituting one group is set as an accounting authority, and the menu screen 71 is displayed only on the display unit 13 of the user terminal 10 (accounting authority terminal) owned by the accounting authority. The checkout button 71e may be displayed. Then, the accounting screen 72 may be displayed only on the terminal of the accounting authority, and summary accounting, terminal-by-terminal accounting, equivalent discount accounting, and special discount accounting may be selected. The accounting authority may be able to determine by a plurality of users constituting one group, and accounts for the person who owns the user terminal 10 who first accesses the address displayed by reading the code information. It may be determined as an authorized person (the user terminal 10 is the accounting authorized person terminal).

Further, in the cashless system 1 according to the above-described embodiment, the mode in which the caterer of the store serves the ordered product (food, drink, etc.) is not particularly limited to such a mode. When the product is ready, the user terminal 10 may be notified by calling or sending a message to the user terminal 10 who placed the order, and the user may come to pick up the product. In such an embodiment, the store terminal 30 may be provided with a function of sending a telephone call or a message to the user terminal 10.

Further, in the cashless system 1 according to the above-described embodiment, the store terminal 30 is preferably arranged in a store such as a kitchen, but the server 20 may be arranged in the store. It may be located outside the store. When the server 20 is arranged in the store, the server 20 and the store terminal 30 may be integrated. Further, the store terminal 30 and the printer 40 may be integrated, or the server 20, the store terminal 30 and the printer 40 may be integrated. The device in which these are integrated and the acquisition system 60 may be able to communicate with each other by wireless communication such as LAN, bluetooth (registered trademark) or infrared communication, or wired communication.
Further, the printer 40 is not limited to the mode in which the paper on which the image including the code information is formed is arranged in the area. For example, the code information may be displayed on a display device such as a liquid crystal panel installed in the area, and the code information displayed on the display device may be read by the user terminal 10.

Further, in the cashless system 1 according to the above-described embodiment, the server 20 capable of ordering and accounting for the product using the user terminal 10 grasps the information regarding the evaluation of the product from the behavior of the user. It has a function, but is not particularly limited to such an embodiment. For example, a server that cannot order and account for products using the user terminal 10 has an evaluation grasping unit 220, and is related to product evaluation based on voices and images acquired from an acquisition system 60 arranged in the store. It may have a function of grasping information from the behavior of the user. In such a case, the server provided with the evaluation grasping unit 220 can be regarded as an evaluation acquisition system including the evaluation grasping unit 220 as an example of the grasping means for grasping the information regarding the evaluation of the product from the behavior of the user.

Further, in the cashless system 1 according to the above-described embodiment, the present invention is based on a so-called browser format in which the user terminal 10 displays the menu screen 71 or the like on the display unit 13 by interpreting the HTML document acquired from the server 20. Although the case where it is realized has been described, the present invention is not particularly limited to such a mode. It may be realized by a so-called native application format in which the menu screen 71 or the like is displayed by executing the program downloaded by the user terminal 10.

1 ... Cashless system, 10 ... User terminal, 20 ... Server, 21 ... Control unit, 30 ... Store terminal, 40 ... Printer, 60 ... Acquisition system, 211 ... Receiver unit, 212 ... Identification unit, 213 ... Generation unit, 214 ... Ordering unit, 215 ... Billing unit, 216 ... Creating unit, 217 ... Transmitting unit, 220 ... Evaluation grasping unit, 221 ... Voice analysis unit, 222 ... Image analysis unit, 223 ... Evaluation derivation unit

Claims (4)

A reception means for accepting connection requests from user terminals of users who visit restaurants,
A display control means for displaying a list of products provided at the restaurant on the user terminal, and
An ordering means for receiving an order for the product from the user terminal,
A grasping means for grasping information related to the evaluation of the product from the behavior of the user, and
Equipped with a,
The grasping means is based on at least one of the utterance content recorded by the recording means for recording the user's utterance and the image taken by the imaging means, and the user is selected from a plurality of products provided at the restaurant. An evaluation acquisition system characterized in that one product that has been eaten or eaten by the person is identified, and information regarding the evaluation of the one product is grasped based on at least one of the utterance content and the image. The grasping means according to claim 1, wherein the grasping means grasps information regarding the evaluation of the one product based on the facial expression of the user after eating and drinking the one product taken by the imaging means that captures the facial expression of the user. Evaluation acquisition system. The grasping means according to claim 1 or 2 , wherein the grasping means identifies the one product based on an image taken by the imaging means, and grasps the evaluation of the one product based on the utterance content recorded by the recording means. Evaluation acquisition system. The grasping means compares the feature amount extracted from the image taken by the imaging means with the feature amount of each product given as recognition data, and determines the product depending on whether the degree of matching is equal to or greater than the threshold value. At the time of identification, the feature amount of the product for which the ordering means has received an order is first compared with the feature amount extracted from the image.
The evaluation acquisition system according to claim 3.

Images