JP2019175188A - Evaluation acquisition system - Google Patents

Abstract

To provide an evaluation acquisition system capable of acquiring highly reliable evaluation-related information.SOLUTION: An evaluation acquisition system is provided, comprising: reception means for receiving a connection request from a user terminal of a user visiting a restaurant; display control means for displaying a list of products (dishes) offered by the restaurant on the user terminal; order reception means for receiving orders for products from the user terminal; and grasping means configured to grasp product evaluation-related information from behavior of the user.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an evaluation acquisition system.

In recent years, a system for providing restaurant evaluation information has been proposed.
The information providing system described in Patent Literature 1 is a system that accepts restaurant evaluation information from a user as word-of-mouth information and opens the accepted word-of-mouth information to other users. In this information provision system, not only publishing word-of-mouth information, but also accepting registration of specialty areas and genres from each contributor, and each contributor to restaurants corresponding to his / her favorite areas and genres. By summing up posted word-of-mouth information for each of the specialty areas and genres that are common to each contributor, information related to the ranking of restaurants and the evaluation ranking for each genre is generated.

JP 2007-193427 A

In restaurants, it is desirable to provide products that customers feel delicious. Therefore, it is conceivable that information related to the evaluation of a product that has been eaten or consumed is acquired from a customer, and the acquired information is used as a reference when cooking. And it is desirable that the acquired information has high accuracy.
An object of this invention is to provide the evaluation acquisition system which can acquire the information regarding evaluation with high accuracy.

The present invention completed for this purpose includes a reception means for receiving a connection request from a user terminal of a user who has visited a restaurant, and a display control for displaying a list of products provided at the restaurant on the user terminal. An evaluation acquisition system comprising: means; order receiving means for receiving an order for the product from the user terminal; and grasping means for grasping information related to the evaluation of the product from the behavior of the user.
Here, the grasping means may grasp information relating to the evaluation of the product based on the utterance content recorded by the recording means for recording the user's utterance.
In addition, the grasping unit may grasp information related to the evaluation of the product based on the user's facial expression after eating and drinking the product captured by the imaging unit that captures the user's facial expression.
In addition, the grasping unit may specify a product eaten or consumed by the user based on an order received by the order receiving unit.
The grasping means may grasp information related to the evaluation of the product based on the user's utterance content recorded by the recording means and an image taken by the imaging means.
Further, the grasping means may identify a product eaten or consumed by the user based on an image taken by the imaging means, and grasp an evaluation of the product based on the utterance content recorded by the recording means.
In addition, the grasping unit may specify a product eaten or consumed by the user by selecting from a plurality of products for which the order receiving unit has received an order.

  ADVANTAGE OF THE INVENTION According to this invention, the evaluation acquisition system which can acquire the information regarding evaluation with high accuracy can be provided.

It is the figure which illustrated schematic structure of the cashless system concerning an embodiment. It is the figure which illustrated schematic structure of the user terminal. It is the block diagram which illustrated the functional composition of the server. It is a figure which shows an example of the access screen displayed on a user terminal. It is a figure which shows an example of the menu screen displayed on a user terminal. It is a figure which shows an example of the information which a memory | storage part memorize | stores. It is a figure which shows an example of the accounting screen displayed on a user terminal. It is a figure which shows an example of the summary accounting screen displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of the summary accounting displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of the accounting for every terminal displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of the equivalent percent accounting displayed on a user terminal. It is a figure which shows an example of the special discount accounting screen displayed on a user terminal. It is a figure which shows an example of the payment screen at the time of the special discount accounting displayed on a user terminal. It is the block diagram which illustrated the functional composition of the evaluation grasping part. It is a flowchart which shows an example of the procedure of the evaluation recognition process which an evaluation recognition part performs. It is the block diagram which illustrated the functional composition of the store terminal. It is the sequence diagram which showed the operation example in the cashless system which concerns on this Embodiment. It is the sequence diagram which showed the operation example in the cashless system which concerns on this Embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.
FIG. 1 is a diagram illustrating a schematic configuration of a cashless system 1 according to the present embodiment.
The cashless system 1 includes a user terminal 10 owned by a user, a server 20 that manages a menu that can be provided at a store such as a restaurant, a store terminal 30 owned by the store, and a known printer 40. I have. The cashless system 1 includes a microphone 61, a camera 62, and a communication server 63, and includes an acquisition system 60 that acquires information related to evaluation of products provided at a store.

  The user terminal 10, the server 20, the store terminal 30, and the acquisition system 60 are connected to a network 50 that connects the apparatuses so that they can communicate with each other, and can communicate with each other via the network 50. The network 50 is not particularly limited as long as it is a communication network used for data communication between each system and device. For example, the network 50 may be a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. it can. A communication line used for data communication may be used in combination regardless of whether it is wired or wireless. Further, a relay device such as a gateway device or a router may be used to connect each device via a plurality of networks or communication lines. The shop terminal 30 and the printer 40 can communicate with each other by wireless communication such as LAN, bluetooth (registered trademark), infrared communication, or wired communication. Further, the shop terminal 30 and the printer 40 may be able to communicate with each other via a WAN or the Internet.

<User terminal 10>
FIG. 2 is a diagram illustrating a schematic configuration of the user terminal 10.
The user terminal 10 includes a control unit 11 that controls the entire apparatus, a storage unit 12 that is used to store data, a display unit 13 that is used to display an operation reception screen and an image, and an operation that receives user input operations. Unit 14 and a communication unit 15 used for communication with an external device. The user terminal 10 includes a camera 16, a speaker 17, and a microphone 18.

  The control unit 11 includes a CPU (Central Processing Unit) 11a, a ROM (Read Only Memory) 11b, and a RAM (Random Access Memory) 11c. The ROM 11b stores a basic program (operation system) executed by the CPU 11a, various settings, and the like. The CPU 11a uses the RAM 11c as a work area and executes an application program read from the ROM 11b or the storage unit 12. Each part of the user terminal 10 is controlled by the CPU 11a executing the program.

It can be exemplified that the storage unit 12 is a storage device such as a semiconductor memory.
The display unit 13 is a display device that displays still images, moving images, and the like. The display unit 13 can be exemplified as a liquid crystal display or an organic EL (Electro Luminescence) display.
The operation unit 14 is an input device that receives an operation from a user. The operation part 14 can illustrate that it is a button, a switch, and a touch panel.
It can be exemplified that the communication unit 15 is a communication interface.
It can be exemplified that the camera 16 is a digital camera capable of capturing a still image or a moving image.
The speaker 17 can be exemplified as a device that converts an electrical sound signal from the control unit 11 into sound and outputs the sound.
The microphone 18 can be exemplified as a device that converts sound input from the outside of the user terminal 10 into an electrical sound signal and outputs the electrical sound signal to the control unit 11.

  The user terminal 10 configured as described above is a multi-function mobile phone (so-called “smart phone”), a mobile phone (so-called “feature phone”), a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, or the like. It can be exemplified.

The user terminal 10 has a function that allows the camera 16 to read code information such as QR code (registered trademark).
In addition, the user terminal 10 has an electronic settlement function that performs payment by exchanging electronic data when paying money as a price for goods or services. Electronic payments such as Apple Pay (registered trademark) and Google Wallet (registered trademark) that can be settled without performing authentication procedures such as entering a PIN if credit card information is registered in advance. It can be exemplified that the service (electronic payment system) is used (however, fingerprint authentication and face authentication may be necessary as in Apple Pay (registered trademark), for example). Examples of the electronic payment include use of a credit card payment service or a carrier payment service that pays a product price together with a mobile phone usage fee.

<Server 20>
FIG. 3 is a block diagram illustrating a functional configuration of the server 20.
Similarly to the control unit 11, the storage unit 12, the display unit 13, the operation unit 14, and the communication unit 15 included in the user terminal 10, the server 20 includes a control unit 21, a storage unit 22, a display unit (not shown), and an operation unit. (Not shown) and a communication unit (not shown). The storage unit 22 may be an HDD (Hard Disk Drive).

The control unit 21 includes a CPU (not shown), a ROM (not shown), a RAM (not shown), and the like, and the following functions are realized when the CPU executes a program.
That is, the control unit 21 is a receiving unit as an example of a receiving unit that receives a connection request from each of the user terminals 10 of the plurality of user terminals 10 included in a plurality of users (customers) that form one group that has visited the store. 211. In addition, the control unit 21 includes an identification unit 212 as an example of an identification unit that uniquely identifies and identifies each user terminal 10 from the connection request received by the reception unit 211. In addition, the control unit 21 includes a generation unit 213 that generates, for the user terminal 10, an HTML (HyperText Markup Language) document that publishes a web page having various pieces of information about products. In addition, the control unit 21 receives from the user terminal 10 an order receiving unit 214 that accepts orders for products that can be provided in the store, and a charging unit 215 as an example of a charging unit that charges a fee for orders placed from the user terminal 10. And have. In addition, the control unit 21 includes a creation unit 216 that creates code information, and a transmission unit 217 that transmits the HTML document created by the creation unit 213 and the code information created by the creation unit 216. Moreover, the control part 21 has the evaluation grasping part 220 which grasps | ascertains the information regarding evaluation of goods.

(Receiver)
The receiving unit 211 receives information transmitted from the user terminal 10 via the network 50.
Here, information received first from the user terminal 10 by the receiving unit 211 is illustrated.
FIG. 4 is a diagram illustrating an example of the access screen 70 displayed on the user terminal 10.
The access screen 70 illustrated in FIG. 4 is a screen displayed on the display unit 13 of the user terminal 10 after the camera 16 of the user terminal 10 reads code information, which will be described later, issued in advance. As shown in FIG. 4, a predetermined address 70 a is displayed on the access screen 70.
When the user who owns the user terminal 10 presses the address 70a, the reception unit 211 of the server 20 receives information indicating that the code information issued in advance by the user terminal 10 and the information of the user terminal 10 are received. To do.

(Identification part)
The identification unit 212 uniquely identifies and identifies the user terminal 10 based on the information from the user terminal 10 received by the reception unit 211.
As described above, when the user terminal 10 accesses an address displayed after reading pre-issued code information to be described later, the receiving unit 211 receives the information transmitted from the user terminal 10. The identification unit 212 analyzes the information received by the reception unit 211. Based on the information transmitted from the user terminal 10, the identification unit 212 knows which area in the store the code information assigned to the store has been read. In other words, the identification unit 212 grasps that the user who owns the user terminal 10 eats and drinks in a predetermined area in the store. The area can be exemplified as an area divided for each table or for each room.

  The identification unit 212 associates the area number that is the identification number of the area and the user number that is the identification number of the user terminal 10 and stores them in the storage unit 22. When the user terminal 10 that has accessed the address displayed by reading the code information associated with one area is the Nth, the identification unit 212 sets the user number of the user terminal 10 to N. For example, when the user terminal 10 that has accessed the address displayed by reading the code information associated with the area having the area number 1 is the first, the identification unit 212 is the user of the user terminal 10. The number is 1.

In addition, when there are a plurality of user terminals 10 that have accessed the address displayed by reading the code information associated with the same area (the same area number), the identification unit 212 identifies these user terminals 10 as one. It is grasped that it is a plurality of user terminals 10 possessed by a plurality of users constituting the group.
Thus, based on the area number, it is possible to distinguish between a group eating and drinking in one area and a group eating and drinking in another area. Moreover, it becomes possible to distinguish the some user who eats and drinks in the same area because the identification part 212 gives a user number.

(Generator)
In response to access from the user terminal 10, the generation unit 213 generates an HTML document that publishes a web page having various information related to products provided at a store.
For example, when the reception unit 211 receives the first access from the user terminal 10 (access to the address 70a displayed after reading the code information), the generation unit 213 displays a product that can be provided at the store. An HTML document for displaying a screen is generated.

FIG. 5 is a diagram illustrating an example of the menu screen 71 displayed on the user terminal 10.
The HTML document for displaying the menu screen 71 generated by the generation unit 213 is transmitted to the user terminal 10 via the transmission unit 217. In the user terminal 10 that has received the HTML document transmitted from the server 20, the control unit 11 causes the display screen 13 a of the display unit 13 to display the menu screen 71 shown in FIG. 5 based on the HTML document.
On the menu screen 71, for each product provided in the store, a product name 71a, a product image 71b, a product description 71c, an order button 71d with “Order”, and the like are displayed. In addition, the menu screen 71 displays an area number and a user number together with a list of products. On the menu screen 71, an accounting button 71e described as “accounting” is displayed.
The menu screen 71 illustrated in FIG. 5 is configured to be a screen on which products included in the category are displayed for each category such as fried food and grilled food, but all the products are displayed on one screen. May be displayed. Further, when it is difficult to view all the products included in the category on one screen, the screen may be configured with a plurality of screens.
The generation unit 213 generates an HTML document for displaying an accounting screen 72 (see FIG. 7) described later when the accounting button 71e displayed on the menu screen 71 is pressed.

(Order Department)
FIG. 6 is a diagram illustrating an example of information stored in the storage unit 22.
The order receiving unit 214 receives an order from the user terminal 10.
The order receiving unit 214 has received an order from the user terminal 10 when the receiving unit 211 receives information indicating that the order button 71d has been pressed on the menu screen 71 displayed on the display unit 13 of the user terminal 10. To figure out.
The order receiving unit 214 stores in the storage unit 22 an associated product and its amount, and the user number and area number of the user terminal 10 that has placed the order in association with each other.
As shown in FIG. 6, the user terminal 10 that has accessed the address first by accessing the address displayed by reading the code information associated with the area having the area number 1 is accessed second by the user terminal 10 </ b> A. The user terminal 10 that has been accessed is referred to as a user terminal 10B, and the user terminal 10 that has accessed third is referred to as a user terminal 10C.
Further, the order receiving unit 214 transmits information such as the ordered product and the user number and area number of the user terminal 10 that has placed the order to the store terminal 30 via the transmission unit 217.

(Billing Department)
The charging unit 215 charges the user terminal 10 by a charging method corresponding to the accounting method selected by the user terminal 10 from among a plurality of predetermined charging methods. In addition, the charging unit 215 transmits the amount to be paid using the user terminal 10 to the user terminal 10 via the transmission unit 217.

Among the plurality of billing methods, collective billing that charges the total amount of all products eaten and eaten in one area (all products ordered through all user terminals 10) to one user terminal 10 There is a way.
Among the plurality of billing methods, there is a per-terminal billing method that charges the user terminal 10 for the total price of only the products ordered through the user terminal 10.
In addition, among the plurality of billing methods, the total amount of all the products eaten and consumed in one area (all the products ordered through all the user terminals 10) is stored in association with the one area. There is an equivalent billing method of charging each user terminal 10 with an amount that is equally divided by the number of user terminals 10 that are present.
In addition, among a plurality of billing methods, an amount obtained by dividing the total amount of all products eaten and eaten in one area (all products ordered through all user terminals 10) at a rate input by the user There is a special billing method for charging each user terminal 10.

  In other words, the user having the user terminal 10 can select one accounting method from a plurality of predetermined accounting methods. Among the plurality of accounting methods, there is a collective accounting method in which the total amount of all the products eaten and eaten in one area (all the products ordered through all user terminals 10) is paid using one user terminal 10. . In addition, among the plurality of accounting methods, there is a per-terminal accounting method in which the total price of only the products ordered through the user terminal 10 is paid using the user terminal 10. When the user selects the summary accounting method and the terminal accounting method, the server 20 charges by the summary accounting method and the terminal accounting method, respectively.

In addition, in a plurality of accounting methods, each user has an amount obtained by equally dividing the total amount of all products eaten and consumed in one area by the number of user terminals 10 stored in association with the one area. There is an equivalent percent accounting method that pays using the terminal 10.
In addition, among the plurality of accounting methods, there is a special accounting method that pays, using each user terminal 10, an amount obtained by dividing the total amount of all products eaten and consumed in one area by a ratio input by the user. When the user selects the equivalent percent accounting method or the special percent accounting method, the server 20 charges using the equivalent percent accounting method or the special percent accounting method, respectively.

FIG. 7 is a diagram illustrating an example of a transaction screen 72 displayed on the user terminal 10.
The accounting screen 72 is displayed when the accounting button 71e displayed on the menu screen 71 shown in FIG. 5 is pressed. On the accounting screen 72, a summary accounting button 72a described as "Summary accounting", a terminal accounting button 72b described as "Terminal accounting", and an equivalent accounting button 72c described as "Equivalent accounting" And a special percent accounting button 72d with “Special percent accounting” written therein.

FIG. 8 is a diagram illustrating an example of the summary accounting screen 73 displayed on the user terminal 10.
The summary accounting screen 73 is displayed when the summary accounting button 72a is pressed. On the summary accounting screen 73, as many buttons as the buttons for selecting which user terminal 10 is used for payment, buttons corresponding to the number of user terminals 10 are displayed. For example, when there are three user terminals 10 registered in the area having the area number 1, as shown in FIG. 8, “user number: 1”, “user number: 2”, “user number” : 3 ”is displayed. Three user number buttons 73a are displayed.

FIG. 9 is a diagram illustrating an example of a payment screen 74 displayed at the time of summary accounting displayed on the user terminal 10.
The payment screen 74 is displayed when any user number button 73 a is pressed on the summary accounting screen 73.
In the summary accounting screen 73 shown in FIG. 8, for example, when the user number button 73 a described as “user number: 2” is pressed, the charging unit 215 of the server 20 displays the user terminal whose user number is 2 10 is used to determine that summary accounting is performed. Then, the billing unit 215 transmits an HTML document including information such as the total amount to the user terminal 10 with the user number 2 via the transmission unit 217. As a result, the payment screen 74 shown in FIG. 9 is displayed on the display unit 13 of the user terminal 10. On the payment screen 74, an amount to be paid using the user terminal 10 (for example, 12,000 yen) is displayed as a billing amount, and a confirmation button 74 a with “confirm” is displayed. When the user presses the confirmation button 74a displayed on the payment screen 74, the payment is completed using the electronic payment service described above. That is, when the charging unit 215 acquires information indicating that the confirmation button 74a has been pressed, the charging unit 215 performs a predetermined payment process according to the electronic payment service selected on the user terminal 10. Then, the billing unit 215 may transmit a notification that the payment is completed to the user terminal 10 when a predetermined settlement process is executed. When the user terminal 10 uses a credit card payment service or a carrier payment service, for example, and uses a service that requires an authentication procedure, the charging unit 215 performs a predetermined authentication procedure in the user terminal 10. After the payment is made, the settlement process is executed.

FIG. 10 is a diagram showing an example of a payment screen 75 displayed at the user terminal 10 at the time of accounting for each terminal. 10A illustrates the payment screen 75 displayed on the display unit 13 of the user terminal 10A, and FIG. 10B illustrates the payment screen 75 displayed on the display unit 13 of the user terminal 10B. FIG. 10C illustrates a payment screen 75 displayed on the display unit 13 of the user terminal 10C.
In the accounting screen 72 shown in FIG. 7, when the terminal accounting button 72 b is pressed, the accounting unit 215 of the server 20 displays information such as the total price of only the products ordered through each user terminal 10. The included HTML document is transmitted via the transmission unit 217. As a result, as illustrated in FIG. 10, the display unit 13 of each user terminal 10 has an amount to be paid using the user terminal 10 (a total amount of only products ordered through the user terminal 10 (FIG. 10, the user terminal 10 </ b> A is 3,000 yen, the user terminal 10 </ b> B is 4,000 yen, and the user terminal 10 </ b> C is 5,000 yen) as a billing amount, and a confirmation button 74 a with “Confirm” is displayed. However, the payment is completed by pressing the confirmation button 74a displayed on the display unit 13. The processing of the charging unit 215 after the confirmation button 74a is pressed is as described above.

FIG. 11 is a diagram showing an example of a payment screen 76 displayed at the user terminal 10 at the time of equivalent billing. FIG. 11A illustrates a payment screen 76 displayed on the display unit 13 of the user terminal 10A, and FIG. 11B illustrates a payment screen 76 displayed on the display unit 13 of the user terminal 10B. FIG. 11C illustrates a payment screen 76 displayed on the display unit 13 of the user terminal 10C.
In the accounting screen 72 shown in FIG. 7, when the equivalence accounting button 72 c is pressed, the accounting unit 215 of the server 20 orders all the products eaten and eaten in one area (all user terminals 10 are ordered). The HTML document including information such as an amount obtained by equally dividing the total amount of all the products) by the number of user terminals 10 is transmitted to all user terminals 10 via the transmission unit 217. As a result, as illustrated in FIG. 11, the display unit 13 of each user terminal 10 is charged with an amount to be paid using the user terminal 10 (an amount obtained by equally dividing the total amount (so-called split amount)). In addition to being displayed as a monetary amount, a confirmation button 74a with "confirmation" is displayed. The payment is completed when the user presses the confirmation button 74 a displayed on the display unit 13. The processing of the accounting unit 215 after the confirmation button 74a is pressed is as described above.

FIG. 12 is a diagram illustrating an example of the special discount accounting screen 77 displayed on the user terminal 10.
The special discount accounting screen 77 is displayed when the special discount accounting button 72d is pressed on the accounting screen 72 shown in FIG. The special account accounting screen 77 displays all user numbers, an input field 77a for inputting the ratio of the user terminal 10 of the user number beside each user number, and a number to be input to the input field 77a An increase button 77b for increasing the number and a decrease button 77c for decreasing the number input in the input field 77a are displayed for the number of user terminals 10. In addition, in order to urge the special discount accounting screen 77 to input so that the total of the numbers entered in all the input fields 77a is 10, “Please input so that the total is 10.” Is displayed. In addition, on the special discount accounting screen 77, a determination button 77d described as “decision” is displayed.
The special discount accounting screen 77 shown in FIG. 12 is an input example when the ratio to the user number 1 is 5, the ratio to the user number 2 is 3, and the ratio to the user number 2 is 2.

FIG. 13 is a diagram illustrating an example of the payment screen 78 for special discount accounting displayed on the user terminal 10.
When the ratio of all the user terminals 10 is input on the special discount accounting screen 77 and the determination button 77d is pressed, the charging unit 215 of the server 20 displays all the products eaten and consumed in one area (all the user terminals 10). An HTML document including information such as an amount obtained by dividing the total price of all the products ordered via the ratio entered by the user is transmitted to all user terminals 10 via the transmission unit 217. For example, as illustrated in the special discount accounting screen 77 of FIG. 12, the charging unit 215 has a ratio of user number 1 of 5, a ratio of user number 2 of 3, and a ratio of user number 3 of 2. An HTML document including information such as an amount obtained by multiplying the total amount by 5/10 is transmitted to the user terminal 10A having the user number 1 via the transmission unit 217. The accounting unit 215 transmits an HTML document including information such as an amount obtained by multiplying the total amount by 3/10 to the user terminal 10B having the user number 2. The accounting unit 215 transmits an HTML document including information such as an amount obtained by multiplying the total amount by 2/10 to the user terminal 10C having the user number 3.

  As a result, the payment screen 78 shown in FIG. 13 is displayed on the display unit 13 of each user terminal 10. On the payment screen 78, the amount to be paid using each user terminal 10 is displayed as the amount to be charged (the amount is a value corresponding to the input ratio), and a confirmation button 74a described as “confirm” is displayed. Is displayed. The payment is completed when the user presses the confirmation button 74 a displayed on the payment screen 78. The processing of the accounting unit 215 after the confirmation button 74a is pressed is as described above.

(Creation Department)
The creation unit 216 creates code information including an area number of the area for each area predetermined in the store. By accessing the address displayed after the user terminal 10 reads the code information created by the creation unit 216, the identification unit 212 can grasp the code information arranged in which area has been read and accessed. it can.
The creation unit 216 finishes eating and drinking in a certain area and grasps that the payment is completed, and then newly creates code information of the area. Completion of payment can be grasped, for example, by acquiring information indicating that the billing unit 215 has executed payment processing. The creation unit 216 may create code information in accordance with instructions from store employees. Employees may create code information after confirming that a group that has finished eating and drinking in a certain area has left the store, or create the number of code information considered necessary on the day before the business starts. May be.
The creation unit 216 transmits information including the created code information to the store terminal 30 via the transmission unit 217. Based on an instruction from the store terminal 30, the printer 40 forms and outputs (prints out) an image including code information on, for example, paper.
In addition, it can be illustrated that the area is divided for each table or for each room. However, even if a sheet on which an image including code information is formed is arranged for each table or room, if the number of people constituting one group exceeds the number allowed for each table or room, One code information may be shared by a plurality of people using a plurality of areas.

(Transmitter)
The transmission unit 217 transmits the HTML document generated by the generation unit 213 to the user terminal 10. For example, the transmission unit 217 transmits an HTML document for displaying the menu screen 71 to the user terminal 10.
Further, the transmission unit 217 transmits information such as the product for which an order has been received from the user terminal 10 and the user number and area number of the user terminal 10 that has placed the order, to the store terminal 30.
In addition, the transmission unit 217 transmits information including the code information created by the creation unit 216 to the store terminal 30.
In addition, the transmission unit 217 transmits the evaluation for the one product grasped by the evaluation grasping unit 220 to the store terminal 30.

(Evaluation grasping department)
FIG. 14 is a block diagram illustrating a functional configuration of the evaluation grasping unit 220.
The evaluation grasping unit 220 includes a voice analysis unit 221 that analyzes a human voice recorded by the microphone 61 of the acquisition system 60 and an image analysis unit 222 that analyzes a captured image captured by the camera 62 of the acquisition system 60. is doing. In addition, the evaluation grasping unit 220 includes an evaluation deriving unit 223 that derives information related to product evaluation based on at least one of the sound analyzed by the sound analyzing unit 221 and the image analyzed by the image analyzing unit 222. .

≪Speech analysis department≫
The voice analysis unit 221 analyzes the acoustic information recorded by the microphone 61 among the information acquired from the acquisition system 60. The voice analysis unit 221 analyzes the recorded acoustic information and identifies a human voice. Then, the voice analysis unit 221 recognizes the utterance content by analyzing a person's voice and converts it into text. More specifically, the voice analysis unit 221 first detects the content and utterance section (start time and end time) corresponding to a series of voices from the acoustic information recorded by the microphone 61, and then Text the utterance content. The voice analysis unit 221 includes information related to evaluations such as “delicious”, “not delicious”, “bad”, “savory”, “slightly tasted”, “cold”, “warm”, and information related to products. It may be recognized and converted into text.
The voice analysis unit 221 also recognizes the utterance content recorded by the microphone 61 installed at which position in which area. The voice analysis unit 221 also recognizes which user in one area the voice is generated.

≪Image analysis department≫
The image analysis unit 222 analyzes a captured image captured by the camera 62 among the information acquired from the acquisition system 60. The image analysis unit 222 analyzes the captured image and recognizes the captured region as a three-dimensional space. In addition, the image analysis unit 222 identifies a person and a non-person object among the captured objects. Identification of a person or other object by image analysis can be performed using an existing technique related to image recognition. The image analysis unit 222 also recognizes which area is the captured image. The image analysis unit 222 also recognizes which user in one area is captured.

  Further, the image analysis unit 222 detects the user's face by performing contour detection or the like from the photographed image of the person, and extracts feature amounts of each part of the face such as eyes, nose, and mouth. Then, the image analysis unit 222 compares the feature amount extracted from the photographed image with the feature amount of each part of the face such as eyes, nose, mouth, etc. given as recognition data, and the degree of coincidence is compared. If it is equal to or greater than the threshold, the user's facial expression is recognized as a smile. On the other hand, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount given as recognition data, and recognizes that the facial expression of the user is not a smile when the degree of matching is less than the threshold value. To do. In other words, the smile recognized by the image analysis unit 222 is extracted from an image in which the features of each part of the face extracted from the photographed image are selected as an image showing a smile when developing a smile recognition function or the like. The facial expression matches the facial feature by a threshold or more. Further, the image analysis unit 222 recognizes the time when the recognized smile was photographed.

  Further, the image analysis unit 222 compares the feature amount extracted from the photographed image with the feature amount of each part of the face such as eyes, nose, mouth, etc. at the time of an angry face given as recognition data, and the degree of coincidence Is greater than or equal to the threshold, the user's facial expression is recognized as an angry face. On the other hand, the image analysis unit 222 compares the feature amount extracted from the captured image with the feature amount given as recognition data, and if the matching degree is less than the threshold value, the user's facial expression is not an angry face. recognize. In other words, the angry face recognized by the image analysis unit 222 is obtained from an image selected as an image in which the features of each part of the face extracted from the photographed image are shown when the angry face recognition function is developed. The facial expression is equal to or more than a threshold value with the extracted facial feature. Further, the image analysis unit 222 recognizes the time when the recognized angry face is photographed.

  Further, the image analysis unit 222 detects a product from a photographed image of an object other than a person, and extracts a feature amount of the product. Then, the image analysis unit 222 compares the feature amount extracted from the photographed image with the feature amount of each product given as recognition data, and identifies the product based on whether or not the degree of coincidence is equal to or greater than a threshold value. . In other words, the product recognized by the image analysis unit 222 is the product extracted from the image selected as the image in which the product is extracted when the product recognition function is developed. It is a product that matches the feature with a threshold or more. Further, the image analysis unit 222 recognizes the time when the recognized product is photographed.

The image analysis unit 222 may be based on the product for which the order receiving unit 214 has received an order when specifying the product from the captured image. For example, when the product analysis unit 222 specifies a product from a captured image and the order receiving unit 214 has received one order from one group, the feature amount extracted from the captured image, The order receiving unit 214 may compare the feature quantity of one product that has been ordered first. When there are a plurality of products for which the order receiving unit 214 has received an order from one group when specifying the product from the photographed image, the feature amount extracted from the photographed image and the plurality of items for which the order receiving unit 214 has received the order It is better to compare the feature quantity of the product before the feature quantity of the product that has not been ordered. By considering the product for which the order receiving unit 214 has received the order, it is possible to specify the product more quickly and with higher accuracy than when the order receiving unit 214 does not consider the product for which the order has been received.
In addition, when the facial expression is specified, the image analysis unit 222 specifies a user who eats or drinks the product.

≪Evaluation derivation part≫
The evaluation deriving unit 223 derives information related to product evaluation based on at least one of the sound analyzed by the sound analyzing unit 221 and the image analyzed by the image analyzing unit 222.
The evaluation deriving unit 223 recognizes the analysis result of the voice analysis unit 221 when information about the evaluation for one product can be derived from the utterance contents of one user recognized and converted into text by the voice analysis unit 221. Use to derive information about the evaluation of one product. For example, the evaluation deriving unit 223 recognizes the utterance content in which “the fried tofu is delicious” and “delicious tofu” and “delicious” are continuously written, and the text is converted into text. In other words, it is derived that the evaluation for “fried tofu” is “delicious”. In addition, the evaluation deriving unit 223 derives that the evaluation for “draft beer” is “slimy” when the speech analysis unit 221 recognizes the utterance content “this draft beer, lukewarm” and converts it into text. To do.

  The evaluation deriving unit 223 uses the image analyzing unit 222 when the information about the evaluation for one product can be derived from the facial expression of the one user recognized by the image analyzing unit 222 and the product eaten or consumed by the one user. Information about evaluation for one product is derived using the analysis result. For example, when the image analysis unit 222 recognizes the smile of the user and specifies that the product that has become a smile is “fried tofu”, the evaluation deriving unit 223 evaluates “fried tofu”. Is derived from “smile”. “Smile” may mean that “good” means “good” as an evaluation of “fried tofu”. In addition, when the image analysis unit 222 recognizes the user's angry face and specifies that the product with the angry face is “beer”, the evaluation deriving unit 223 evaluates “beer” as “ It is derived that it is an angry face. It may be derived that “bad” means “bad” and “bad” evaluation for “beer”.

  The evaluation deriving unit 223 can derive information related to an evaluation for a certain product from the content of one user's utterance recognized by the voice analysis unit 221. If the product for the evaluation cannot be identified, The target product is specified using the utterance content of the person. For example, the evaluation deriving unit 223 derives that the evaluation for a certain product is “delicious” when the speech analysis unit 221 recognizes the utterance content “this is delicious”. Then, when it is not possible to identify the product to be evaluated as “delicious” from the utterance content of one user recognized by the voice analysis unit 221, the other users before and after the one user uttered “delicious” Identify products using utterance content. For example, when the voice analysis unit 221 recognizes that another user is saying “How is the taste of fried tofu?” Just before the one user says “delicious”, the evaluation deriving unit 223 derives that the evaluation for “fried tofu” is “delicious”. When the voice analysis unit 221 recognizes that the serving person has spoken, for example, “It is fried tofu,” immediately before the one user says “delicious”, the evaluation deriving unit 223 “ It is derived that the evaluation for “fried tofu” is “delicious”. Refers to the time when one user says “delicious” and the time when another user says “How does the taste of fried tofu?” Or the time when the caterer says “It ’s fried tofu.” Thus, it is possible to specify that the product to be evaluated as “delicious” is “fried tofu”.

  In addition, the evaluation deriving unit 223 can derive information related to an evaluation for a certain product from the utterance content of one user recognized by the voice analysis unit 221, but when the product to be evaluated cannot be identified. The product is identified using the product recognized by the image analysis unit 222. For example, when the voice analysis unit 221 recognizes the utterance content “delicious”, the evaluation deriving unit 223 derives that the evaluation for a certain product is “delicious”. If the speech analysis unit 221 recognizes the utterance content that cannot be identified as a product that is evaluated as “delicious”, the user who has spoken “delicious” The product is identified using the product recognized by the image analysis unit 222. By referring to the time at which “delicious” is spoken and the time at which the product is eaten or consumed, it is possible to identify the target product to be evaluated as “delicious”.

  Further, the evaluation deriving unit 223 can derive information related to the evaluation of the product from the facial expression of one user recognized by the image analysis unit 222, but the evaluation target product is based on the image analyzed by the image analysis unit 222. If the product cannot be specified, the target product is specified using the utterance content. For example, when the voice analysis unit 221 recognizes that another user is saying “How is the taste of fried tofu?” Immediately after one user has an expression related to evaluation, the evaluation derivation is performed. The part 223 specifies that the product to be evaluated is “fried tofu”. In addition, when the voice analysis unit 221 recognizes that the serving person uttered, for example, “It is fried tofu” immediately before one user has an expression related to evaluation, the evaluation deriving unit 223 The product to be evaluated is identified as “fried tofu”. In addition, when the voice analysis unit 221 recognizes that the one user has spoken, for example, “Get a fried tofu” immediately before the one user has an expression related to the evaluation, the evaluation derivation is performed. The part 223 specifies that the product to be evaluated is “fried tofu”. The time when one user had a facial expression related to the evaluation (for example, a smile), the time when another user uttered "How does the taste of fried tofu?" By referring to the time of day or the time when one user uttered “Get fried tofu”, it is possible to specify that the product to be evaluated is “fried tofu”.

  Further, the evaluation deriving unit 223 may be based on the product for which the order receiving unit 214 has received an order when specifying the product from the utterance content or the captured image. Even if the voice analysis unit 221 recognizes that the evaluation derivation unit 223 utters, for example, “steak is delicious.”, If the order receiving unit 214 has not received an order for steak from this group, It may be determined that the evaluation is not for the product provided and the evaluation may not be derived.

When the evaluation for one product is derived, the evaluation deriving unit 223 stores the product name and information related to the evaluation in the storage unit 22 in association with each other. In the example described above, the evaluation deriving unit 223 stores “fried tofu” and “delicious” in the storage unit 22 in association with each other. In addition, the evaluation deriving unit 223 stores “fried tofu” and “smile” or “good” in the storage unit 22 in association with each other. The evaluation deriving unit 223 stores “beer” and “angry face” or “bad” in the storage unit 22 in association with each other.
When the evaluation deriving unit 223 derives an evaluation for one product, the evaluation deriving unit 223 associates the product name and information related to the evaluation and transmits the information to the store terminal 30 via the transmission unit 217.

Next, an example of the procedure of the evaluation grasping process performed by the evaluation grasping unit 220 will be described using a flowchart.
FIG. 15 is a flowchart illustrating an example of the procedure of the evaluation grasping process performed by the evaluation grasping unit 220.
The evaluation grasping unit 220 repeatedly executes this evaluation grasping process every predetermined period (for example, 1 millisecond).

  The evaluation grasping unit 220 determines whether or not information related to the evaluation is included in the user's utterance content (step (hereinafter also referred to as “S”) 1501). This is a process in which the evaluation deriving unit 223 determines based on the user's utterance content recognized by the voice analysis unit 221. In the utterance content, for example, information regarding evaluation such as “delicious” or “not delicious” is included. This is a process for determining whether or not it is included. If information related to the evaluation is included (Yes in S1501), it is determined whether or not the evaluation target product can be specified from the utterance content of one user (S1502). For example, the utterance content of one user recognized by the voice analysis unit 221 is a single sentence in which the information regarding the evaluation determined to be included in S1501 and the product name, such as “This fried tofu, delicious.” In this case, it is determined that the product to be evaluated can be specified. Then, if it is possible to identify the product to be evaluated (Yes in S1502), the product name and the information related to the evaluation are associated and stored in the storage unit 22 (S1503). Further, the evaluation grasping unit 220 may store the product name in the storage unit 22 and transmit the product name and information related to the evaluation to the store terminal 30 via the transmission unit 217.

  On the other hand, if it is not possible to identify the product to be evaluated (No in S1502), the evaluation grasping unit 220 can identify the product from the utterance contents of other users or based on the image recognized by the image analysis unit 222. It is determined whether or not the product can be specified by other means, such as whether or not the product can be specified (S1504). When the evaluation target product can be specified (Yes in S1504), the evaluation grasping unit 220 stores the information in the storage unit 22 and associates the product name and information related to the evaluation in the storage unit 22 ( S1503).

  On the other hand, if the information related to the evaluation is not included (No in S1501), it is determined whether or not the information related to the evaluation can be acquired using the image recognized by the image analysis unit 222 (step (S1505)). The evaluation deriving unit 223 is a process for determining based on the facial expression of the user recognized by the image analysis unit 222. For example, whether the facial expression of the user immediately after eating or drinking the product is “smile” or “angry face”. If the information related to the evaluation is included (Yes in S1505), a user (for example, “smile”) showing the evaluation target product in the image obtained by acquiring the information related to the evaluation. It is discriminated whether or not it is possible to specify from the images before and after eating and drinking (S1506), and the product to be evaluated can be specified (in S1506). es), evaluation recognition unit 220 stores in the storage unit 22, the storage unit 22 in association with the information on the evaluation and trade name (S1503).

  On the other hand, when it is not possible to specify the product to be evaluated (No in S1506), the evaluation grasping unit 220 is a user (for example, a user who was “smiling”) reflected in the acquired image or other information. It is determined whether or not the product can be specified from the user's utterance content (S1507). If the evaluation target product can be specified (Yes in S1507), the evaluation grasping unit 220 stores the product name and information related to the evaluation in the storage unit 22 while storing them in the storage unit 22 ( S1503).

<Store terminal 30>
FIG. 16 is a block diagram illustrating a functional configuration of the store terminal 30.
The store terminal 30 includes a control unit 31, a storage unit (not shown), and a display unit corresponding to the control unit 11, the storage unit 12, the display unit 13, the operation unit 14, the communication unit 15, and the speaker 17 included in the user terminal 10. 33, an operation unit (not shown), a communication unit (not shown), and a speaker 37 are provided.
The store terminal 30 can be exemplified as a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, a desktop PC, or the like.
For example, the store terminal 30 can be exemplified as being located in a store kitchen.

The control unit 31 includes a CPU (not shown), a ROM (not shown), a RAM (not shown), and the like, and the following functions are realized when the CPU executes a program.
That is, the control unit 31 includes an acquisition unit 311 that acquires information indicating that an order for a product has been received from the server 20. The control unit 31 includes a display control unit 312 that controls the display unit 33, an acoustic control unit 313 that controls the speaker 37, and an output unit 314 that causes the printer 40 to output an image.

The acquisition unit 311 acquires, from the server 20, information related to product order, such as an ordered product, a user number and an area number of the user terminal 10 that made the order, and the like.
The display control unit 312 controls the display unit 33 to display information related to the order acquired by the acquisition unit 311 on the display screen of the display unit 33. For example, the display control unit 312 displays on the display screen of the display unit 33 the product name and product number for which the order has been received, and the user number and area number that made the order.

The acoustic control unit 313 controls the speaker 37 so as to output a sound regarding information regarding the order acquired by the acquisition unit 311. For example, the sound control unit 313 outputs, from the speaker 37, the product name and product number for which the order has been received, and the user number and area number that made the order, from the speaker 37.
The output unit 314 causes the printer 40 to output an image of the ordered product name and product number, and the user number and area number that made the order, which are information related to the order acquired by the acquiring unit 311. Further, the output unit 314 causes the printer 40 to output the code information created by the creation unit 216 of the server 20 and the image of the area number associated with the code information.

When the product name, product number, user number, area number, or the like is displayed on the display screen of the display unit 33 or the sound is output from the speaker 37, the cook receives an order for the product. It becomes possible to grasp this, and the distributor can deliver the product to the area where the order has been placed. Also, by looking at the paper output by the printer 40 on which the product name, product number, user number, area number, etc. are written, the cook can grasp that the product has been ordered, The distributor can deliver the product to the area where the order has been placed.
Note that the paper on which the code information or the like is written is arranged in a corresponding area by an employee of the store (for example, a distributor).

In addition, the acquisition unit 311 acquires information related to product evaluation from the server 20.
The display control unit 312 may control the display unit 33 so that information related to the evaluation of the product acquired by the acquisition unit 311 is displayed on the display screen of the display unit 33.
The acoustic control unit 313 may control the speaker 37 so as to output a sound regarding the information regarding the evaluation acquired by the acquisition unit 311.
The output unit 314 may cause the printer 40 to output an image of information related to the evaluation acquired by the acquisition unit 311.

By displaying the product name and information related to the evaluation of the product on the display screen of the display unit 33 or outputting sound from the speaker 37, the store employee grasps the evaluation of the product. It becomes possible to do. Further, by looking at the paper output by the printer 40 on which the product name and information about the evaluation of the product are described, the store employee can grasp the evaluation of the product.
The display control unit 312 causes the display unit 33 to display the product name and information related to the evaluation of the product, the acoustic control unit 313 outputs sound from the speaker 37, and the output unit 314 outputs to the printer 40. You may perform it according to the request | requirement from the employee of a store.

<Acquisition system 60>
The acquisition system 60 includes a microphone 61, a camera 62, and a communication server 63. The microphone 61 and the camera 62 are connected to the communication server 63. The communication server 63 is further connected to the server 20 via the network 50. The microphone 61 and the camera 62 and the communication server 63, and the communication server 63 and the server 20 may be able to communicate with each other by wireless communication such as LAN, bluetooth (registered trademark), infrared communication, or wired communication.

  The microphone 61 is a recording device that records sound (acoustic information) as information. As the microphone 61, a microphone having various characteristics and configurations may be used depending on the location where recording is to be performed, the type of acoustic information, and the like. The acoustic information recorded by the microphone 61 is sent to the communication server 63 as digital data. It can be exemplified that a plurality of microphones 61 are provided so that utterances of all the areas provided in the store can be recorded. Moreover, it can be illustrated that a plurality of microphones 61 are provided so that the utterances of all the plurality of users who eat and drink in one area can be recorded.

  The camera 62 is an imaging device that acquires an in-store image. The image acquired by the camera 62 is sent to the communication server 63 as digital data. The image acquired by the camera 62 may be either a moving image or a still image. As the camera 62, cameras having various configurations may be used depending on the use environment. For example, a portable camera or a fixed camera may be used. Further, a wide-angle camera or an all-around camera that acquires an image of a wide surrounding space, a plurality of camera groups that capture a specific object or place at various angles, and the like may be used. It can be exemplified that a plurality of cameras 62 are provided so that a plurality of users who eat and drink in one area and a plurality of products placed on a table installed in one area can be photographed.

  The communication server 63 is a communication control device that transmits information acquired by the microphone 61 and the camera 62 to the server 20. Examples of the communication server 63 include a personal digital assistant (PDA), a tablet terminal, a tablet PC, a notebook PC, and a desktop PC. In addition, a router that constitutes a LAN to which a microphone 61 and a camera 62 (hereinafter may be collectively referred to as an “information acquisition device”) is connected is provided with an information processing function and a communication control function. May be. Furthermore, various information devices (such as a television receiver and a facsimile machine) having a function of connecting to the network 50 and an information processing function may be used.

  The communication server 63 collects information from each information acquisition device according to the setting. Specifically, information may be acquired continuously at all times, information may be acquired intermittently at regular time intervals, or when a predetermined event (event) occurs ( Information may be acquired as a trigger). Information may be sent from the information acquisition device by push-type communication, or information may be acquired by pull-type communication inquiring from the communication server 63 to the information acquisition device. In a range where communication does not collide (collision), information may be sent to the communication server 63 by a different method or mode for each individual information acquisition device. As a predetermined event (event), it can be illustrated that the order receiving unit 214 of the server 20 has received an order from a user who eats and drinks using the area to be acquired by each information acquisition device. And the communication server 63 may complete | finish acquisition, when the user who eats and drinks using the area for which each information acquisition device obtains leaves a store.

  Further, the communication server 63 transmits the acquired information to the server 20 according to the setting. Specifically, the information may be transmitted continuously by connecting to the server 20 constantly, or may be transmitted by connecting to the server 20 intermittently at regular time intervals. Further, information may be transmitted by connecting to the server 20 triggered by occurrence of a predetermined event. As a predetermined event (event), it can be illustrated that a user who eats and drinks using an area to be acquired by each information acquisition device leaves the store.

  FIGS. 17A and 17B are sequence diagrams illustrating an operation example in the cashless system 1 according to the present embodiment. In the operation example shown in FIG. 17A and FIG. 17B, one group is configured including three users A, B, and C, and the user terminal 10A and user B owned by the user A own. The operation example in the case where an order and accounting are performed at the user terminal 10C owned by the user terminal 10B and the user terminal C owned by the user C is shown.

First, the user A reads the code information previously placed in the guided area (the area number is 1) by the user terminal 10A owned by the user A and accesses the address displayed after the reading. (S1701).
The server 20 stores the area number and the user terminal 10A in association with each other (S1702). More specifically, since the user terminal 10A first accessed based on the address displayed by reading the code information arranged in the area having the area number 1, the user terminal 10A The user number, which is the identification number, is set to 1, and stored in the storage unit 22 in association with the area number. This is a process performed by the identification unit 212. In the server 20, the generation unit 213 generates an HTML document for displaying the menu screen, and transmits the HTML document to the user terminal 10A (S1703). The user terminal 10A displays a menu screen on the display unit 13 (S1704).

The user B reads the code information previously placed in the guided area (area number: 1) at the user terminal 10B owned by the user B and accesses the address displayed after the reading (S1705).
The server 20 stores the area number and the user terminal 10B in association with each other (S1706). More specifically, based on the address displayed by reading the code information arranged in the area whose area number is 1, the user terminal 10B has accessed after the user terminal 10A. The user number, which is the identification number of the user terminal 10B, is set to 2 and stored in the storage unit 22 in association with the area number. Then, the server 20 generates an HTML document for displaying the menu screen, and transmits it to the user terminal 10B (S1707). The user terminal 10B displays a menu screen on the display unit 13 (S1708).

The user C reads the code information previously placed in the guided area at the user terminal 10C owned by the user C and accesses the address displayed after the reading (S1709).
The server 20 stores the area number and the user terminal 10C in association with each other (S1710). More specifically, based on the address displayed by reading the code information arranged in the area whose area number is 1, it is the user terminal 10C that has accessed the user terminal 10B next, so that The user number, which is the identification number of the user terminal 10C, is set to 3, and stored in the storage unit 22 in association with the area number. Then, the server 20 generates an HTML document for displaying the menu screen, and transmits it to the user terminal 10C (S1711). The user terminal 10C displays a menu screen on the display unit 13 (S1712).

  Thereafter, the user A selects one product (for example, beer) from the product group displayed on the menu screen displayed on the display unit 13 of the user terminal 10A, and presses the order button 71d for the product. Suppose that (S1713). The server 20 accepts the order for the product, and stores the received product in the storage unit 22 in association with the user number and area number of the user terminal 10 that has placed the order (S1714). Then, the server 20 transmits information such as the ordered product and the user number and area number of the user terminal 10 that made the order to the store terminal 30 (S1715). These are processes performed by the order receiving unit 214.

In the store terminal 30, information related to the order of the product from the server 20 is acquired, the acquired product (for example, beer), which is the acquired information, and the user number (user number: 1) of the user terminal 10A that made the order. ) And the area number (area number: 1) are notified (S1716). Examples of the notification method include at least one of the above-described display on the display screen of the display unit 33, audio output from the speaker 37, and output to the printer 40.
Then, an employee of the store (for example, a distributor) delivers the ordered product (for example, beer) to the user A, and the user A receives the ordered product (S1717).
The processes of S1713 to S1717 are repeated for each order until the orders from all the users A, B, and C are completed.

  The evaluation grasping unit 220 of the server 20 performs an evaluation grasping process for grasping information related to product evaluation based on at least one of the sound analyzed by the sound analyzing unit 221 and the image analyzed by the image analyzing unit 222 (S1718). . In this evaluation grasping process, when the evaluation grasping unit 220 grasps the evaluation for one product, the product name and information related to the evaluation are associated with each other and stored in the storage unit 22. Further, the evaluation grasping unit 220 may transmit the product name and information regarding the evaluation to the store terminal 30. In this way, the server 20 can grasp the evaluation for the product immediately after the user eats or drinks. Therefore, the server 20 can grasp information related to evaluation with higher accuracy than, for example, inputting the evaluation after the user leaves the store.

  When any user who constitutes one group presses the accounting button 71e displayed on the menu screen 71 displayed on the display unit 13 of the user terminal 10 (the user terminal 10A in FIG. 17-2). (S1719). In the server 20, the generation unit 213 generates an HTML document for displaying the accounting screen 72 (S1720), and the transmission unit 217 transmits the HTML document to the user terminal 10A (S1721). The user terminal 10A displays the accounting screen 72 on the display unit 13 (S1722).

  Thereafter, it is assumed that the user A presses the equivalence accounting button 72c displayed on the accounting screen 72 displayed on the display unit 13 of the user terminal 10A (S1723). In the server 20, the billing unit 215 calculates an amount obtained by equally dividing the total amount of all products eaten and consumed in the area having the area number 1 by 3 which is the number of user terminals 10 (S1724). An HTML document including information such as the amount of money is transmitted to all user terminals 10 (user terminal 10A, user terminal 10B, user terminal 10C) via the transmission unit 217 (S1725). All the user terminals 10 (user terminal 10A, user terminal 10B, user terminal 10C) display the equally divided amount and the confirmation button 74a on the display unit 13 (S1726).

  Thereafter, when the user A presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10A (S1727), the server 20 performs a settlement process (S1728). Thereby, the payment using the user terminal 10A is completed. When the user B presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10B (S1729), the server 20 performs a settlement process (S1730). Thereby, the payment using the user terminal 10B is completed. When the user C presses the confirmation button 74a displayed on the display unit 13 of the user terminal 10C (S1731), the server 20 performs a settlement process (S1732). Thereby, the payment using the user terminal 10C is completed.

The cashless system 1 according to the present embodiment configured as described above includes a reception unit 211 as an example of a reception unit that receives a connection request from a user terminal 10 of a user who has visited a restaurant, and a restaurant. It is an example of an evaluation acquisition system provided with the production | generation part 213 as an example of the display control means to display the list of the food to provide on the user terminal 10. FIG. The cashless system 1 according to the present embodiment includes an order receiving unit 214 as an example of an order receiving unit that receives an order for a product from the user terminal 10, and a grasping unit that grasps information related to product evaluation from a user's behavior. And an evaluation grasping unit 220 as an example.
According to the cashless system 1 according to the present embodiment, since the evaluation grasping unit 220 grasps information related to product evaluation from the user's behavior, than when grasping information related to product evaluation from other than the user's behavior, Information about highly accurate evaluation can be grasped.

  The evaluation grasping unit 220 may grasp information related to the evaluation of the product based on the utterance content recorded by the microphone 61 as an example of a recording unit that records the user's utterance. The voice analysis unit 221 recognizes the user's utterance content by analyzing the acoustic information recorded by the microphone 61. Then, the evaluation deriving unit 223 grasps the evaluation for the one product using the analysis result by the voice analysis unit 221 when the evaluation for the one product can be grasped from the utterance content recognized by the voice analysis unit 221. To do. According to the cashless system 1 according to the present embodiment, for example, it is possible to grasp information relating to highly accurate evaluation by grasping information relating to product evaluation based on a user's live voice immediately after eating and drinking.

  The evaluation grasping unit 220 may grasp information relating to the evaluation of the product based on the facial expression of the user after eating the product captured by the camera 62 as an example of an imaging unit that captures the facial expression of the user. The image analysis unit 222 recognizes the user's facial expression by analyzing the captured image captured by the camera 62. The image analysis unit 222 identifies a product eaten or consumed by the user by analyzing a photographed image photographed by the camera 62. The evaluation deriving unit 223 uses the analysis result of the image analysis unit 222 when the evaluation of one product can be grasped from the facial expression of the user recognized by the image analysis unit 222 and the product eaten or consumed by the user. Understand the evaluation of one product. According to the cashless system 1 according to the present embodiment, for example, it is possible to grasp information related to evaluation with high accuracy by grasping information related to product evaluation based on a facial expression of a user immediately after eating and drinking.

  The evaluation grasping unit 220 may specify the product eaten by the user based on the order received by the order receiving unit 214. For example, when the order receiving unit 214 receives a plurality of orders from one group when specifying a product from the captured image, the image analyzing unit 222 uses the feature amount extracted from the captured image and the order receiving unit 214 The feature quantities of a plurality of products that have been ordered may be compared before the feature quantities of the products that have not been ordered. By considering the product for which the order receiving unit 214 has received the order, it is possible to specify the product more quickly and with higher accuracy than when the order receiving unit 214 does not consider the product for which the order has been received.

The evaluation grasping unit 220 may grasp information related to product evaluation based on the utterance content recorded by the microphone 61 and the image taken by the camera 62. That is, when the microphone 61 cannot record both information related to the product and information related to the evaluation, or when the camera 62 cannot capture both the product and the user's facial expression, the utterance content recorded by the microphone 61 and the camera 62 capture the image. You may grasp | ascertain the information regarding goods, and the information regarding evaluation using the taken image.
For example, the evaluation grasping unit 220 may identify a product eaten or consumed by the user based on an image captured by the camera 62 and may grasp the evaluation of the product based on the utterance content recorded by the microphone 61. Alternatively, the evaluation grasping unit 220 may grasp the evaluation of the product based on the facial expression of the user photographed by the camera 62 and specify the product eaten and consumed by the user based on the utterance content recorded by the microphone 61.

  The evaluation grasping unit 220 may specify a product eaten by the user by selecting from a plurality of products for which the order receiving unit 214 has received an order. When the product ordered by the user is identified based on the utterance content recorded by the microphone 61 or the image taken by the camera 62, the order receiving unit 214 considers the product for which the order has been received. It is possible to specify a product quickly and with higher accuracy than when the product for which an order has been received is not taken into consideration.

In the cashless system 1 according to the above-described embodiment, as information related to product evaluation, the image analysis unit 222 recognizes a smile or angry face that is a facial expression of the user, and the evaluation deriving unit 223 Although it is understood that “smile” is an evaluation indicating “good” and “angry face” is “bad”, the present invention is not particularly limited to such an aspect. For example, the image analysis unit 222 recognizes that the facial expression of the user is a surprised or astringent face, and the evaluation deriving unit 223 determines that the “amazed face” is “good” and the “astringent face” is “bad”. You may grasp that it is the evaluation which shows.
Further, the image analysis unit 222 may recognize information other than the facial expression of the user in order to obtain information related to the evaluation. For example, the image analysis unit 222 may recognize a gesture for raising a thumb or a gesture for lowering a thumb. Then, the evaluation deriving unit 223 may grasp that the “gesture for raising the thumb” is “good” and the “gesture for lowering the thumb” is “bad”.

Further, in the cashless system 1 according to the present embodiment, the server 20 makes it possible to browse the evaluation of each product grasped by the evaluation grasping unit 220 as a word of mouth along with a list of dishes provided at the restaurant. May be. Thereby, when a restaurant has strength in a specific dish, it becomes possible to appeal that dish. For example, even if the overall rating of a restaurant is low due to poor customer service, if a particular dish has strength and the rating of that particular dish is high, acquire customers for that particular dish be able to. As a result, the restaurant management can be improved. In addition, the user can satisfy a request to eat a favorite dish deliciously by visiting a store having a high evaluation of a specific dish.
In addition, when making evaluation of cooking possible on the Internet, the server 20 may display the food provided at the restaurant on the external terminal in descending order of evaluation. Thereby, the person who owns the external terminal can easily check a dish having a high evaluation when checking the dish. Further, the server 20 may not make it public when the grasped evaluation is negative.

  In addition, in the cashless system 1 which concerns on embodiment mentioned above, although it is the aspect which performs an accounting process after having finished eating and drinking in a restaurant, it enables it to pay each time an order is made in the user terminal 10. May be. For example, when the server 20 receives a notification that the order button 71d of the menu screen 71 displayed on the display unit 13 of the user terminal 10 is pressed, the server 20 displays the accounting screen 72 illustrated in FIG. 13 may be displayed. And, you can choose whether to pay for each ordered product at the user terminal 10 of one of multiple users who make up one group, or to make an equivalent or special discount It is good to make it.

  In the cashless system 1 according to the above-described embodiment, the accounting button is displayed on the menu screen 71 displayed on all the display units 13 of the plurality of user terminals 10 owned by the plurality of users constituting one group. Although 71e is displayed, it is not particularly limited to such a mode. For example, one of a plurality of users constituting one group is set as an accounting authority, and the menu screen 71 is displayed only on the display unit 13 of the user terminal 10 (accounting authority terminal) owned by the accounting authority. The accounting button 71e may be displayed. Then, the accounting screen 72 may be displayed only at the accounting authority terminal, and summary accounting, terminal accounting, equivalent accounting, and special accounting can be selected. The accounting authority may make it possible for a plurality of users who make up one group to make a decision, or may determine who owns the user terminal 10 that has first accessed the address displayed by reading the code information. You may determine as an authorized person (the said user terminal 10 is an accounting authorized person terminal).

  In addition, in the cashless system 1 according to the above-described embodiment, the store distributor distributes the ordered products (such as dishes and drinks), but is not particularly limited thereto. When the product is ready, a notification may be issued by calling or sending a message to the user terminal 10 that has placed the order, and the user may pick up the product. In such an aspect, the store terminal 30 may have a function of sending a phone call or a message to the user terminal 10.

Further, in the cashless system 1 according to the above-described embodiment, the store terminal 30 is preferably arranged in a store such as a kitchen, but the server 20 may be arranged in the store, It may be arranged outside the store. When the server 20 is disposed in the store, the server 20 and the store terminal 30 may be integrated. Further, the store terminal 30 and the printer 40 may be integrated, or the server 20, the store terminal 30 and the printer 40 may be integrated. The device in which these are integrated and the acquisition system 60 may be able to communicate with each other by wireless communication such as LAN, bluetooth (registered trademark), infrared communication, or wired communication.
Further, the present invention is not limited to a mode in which a sheet on which an image including code information is formed by the printer 40 is arranged in an area. For example, code information may be displayed on a display device such as a liquid crystal panel installed in the area, and the code information displayed on the display device may be read by the user terminal 10.

  In addition, in the cashless system 1 according to the above-described embodiment, the server 20 that can implement ordering and accounting for the product using the user terminal 10 grasps information related to product evaluation from the user's behavior. Although it has a function, it is not limited to such an aspect. For example, a server that cannot perform ordering and accounting for a product using the user terminal 10 has an evaluation grasping unit 220 and relates to the evaluation of the product based on voice and images acquired from the acquisition system 60 arranged in the store. You may have the function to grasp | ascertain information from a user's behavior. In this case, the server including the evaluation grasping unit 220 can be regarded as an evaluation acquisition system including the evaluation grasping unit 220 as an example of grasping means for grasping information related to product evaluation from the user's behavior.

  Further, in the cashless system 1 according to the above-described embodiment, the present invention is based on a so-called browser format in which the user terminal 10 displays a menu screen 71 or the like on the display unit 13 by interpreting an HTML document acquired from the server 20. Although the case where it implement | achieves was demonstrated, it is not limited to this aspect in particular. You may implement | achieve by what is called a native application format which displays the menu screen 71 grade | etc., By running the program which the user terminal 10 downloaded.

DESCRIPTION OF SYMBOLS 1 ... Cashless system, 10 ... User terminal, 20 ... Server, 21 ... Control part, 30 ... Store terminal, 40 ... Printer, 60 ... Acquisition system, 211 ... Reception part, 212 ... Identification part, 213 ... Generation part, 214 ... order receiving part, 215 ... charging part, 216 ... creating part, 217 ... transmitting part, 220 ... evaluation grasping part, 221 ... voice analyzing part, 222 ... image analyzing part, 223 ... evaluation deriving part

Claims (7)

Accepting means for accepting a connection request from a user terminal of a user who has visited a restaurant;
Display control means for displaying a list of products provided at the restaurant on the user terminal;
Order receiving means for receiving an order for the product from the user terminal;
Grasping means for grasping information on evaluation of the product from the behavior of the user;
An evaluation acquisition system comprising: The evaluation acquisition system according to claim 1, wherein the grasping means grasps information related to the evaluation of the product based on the utterance content recorded by the recording means for recording the user's utterance. The evaluation acquisition system according to claim 1, wherein the grasping unit grasps information related to the evaluation of the product based on the facial expression of the user after eating and drinking the product captured by the imaging unit that captures the facial expression of the user. The evaluation acquisition system according to claim 3, wherein the grasping unit specifies a product eaten or consumed by the user based on an order received by the order receiving unit. The evaluation acquisition system according to claim 1, wherein the grasping unit grasps information related to the evaluation of the product based on the user's utterance content recorded by the recording unit and an image captured by the imaging unit. 6. The evaluation according to claim 5, wherein the grasping means identifies a product eaten and consumed by the user based on an image taken by the imaging means, and grasps the evaluation of the product based on the utterance content recorded by the recording means. Acquisition system. The evaluation acquisition system according to claim 6, wherein the grasping unit specifies a product eaten or consumed by the user by selecting from among a plurality of products for which the order receiving unit has received an order.