WO2018150756A1

WO2018150756A1 - Information processing device, information processing method, and storage medium

Info

Publication number: WO2018150756A1
Application number: PCT/JP2017/047343
Authority: WO
Inventors: 裕士瀧本; 岩村　厚志
Original assignee: ソニー株式会社
Priority date: 2017-02-15
Filing date: 2017-12-28
Publication date: 2018-08-23

Abstract

[Problem] To provide a technology capable of improving the quality of service associated with foods or drinks provided according to user interaction. [Solution] An information processing device is provided with a control unit that controls the presentation of a display object associated with foods or drinks on the basis of information associated with the food or the drink obtained as a result of sensing and preset information that maps the food or the drink.

Description

Information processing apparatus, information processing method, and storage medium

The present disclosure relates to an information processing apparatus, an information processing method, and a storage medium.

Devices that display various information according to user operations on the touch panel, such as smartphones and tablet terminals, are widely used. With regard to tablet terminals, the screen size has been increased, and the use method in which a plurality of users operate at the same time is being considered. In addition, a projector is conventionally used as a device for displaying information.

Many techniques for efficiently displaying information according to user interaction have been proposed. For example, in Patent Document 1 below, information is displayed according to the environment in which information is to be displayed and the status of the information being displayed. Techniques for performing are disclosed.

International Publication No. 2015/098188

In recent years, an increasing number of devices provide various services based on user interaction, including the various information processing devices described above. One example is the provision of services related to food and drink at restaurants and the like. Even in the above-mentioned Patent Document 1, although provision of services related to food and drink is considered, there is room for improvement in the quality of services provided.

Therefore, the present disclosure provides a mechanism that can further improve the quality of services related to foods or beverages provided according to user interaction.

According to the present disclosure, the control unit that controls display of the display object related to the food or beverage based on the information related to the food or beverage obtained as a result of the sensing and the setting information associated with the food or beverage. An information processing apparatus is provided.

Moreover, according to this indication, based on the information regarding the food or drink obtained as a result of the sensing, and the setting information associated with the food or drink, the display of the display object related to the food or drink is controlled by the processor. An information processing method including the above is provided.

Further, according to the present disclosure, the computer controls display of the display object related to the food or beverage based on the information related to the food or beverage obtained as a result of the sensing and the setting information associated with the food or beverage. A storage medium storing a program for functioning as a control unit is provided.

According to the present disclosure, the display of the display object related to the food and drink is controlled based on the information about the food or beverage (hereinafter, also simply referred to as food or drink) obtained as a result of the sensing. It is possible to provide a real-time service according to meal conditions. Furthermore, according to this indication, since the display of the display object regarding the said food / beverage is controlled based on the setting information matched with food / beverage, it is possible to provide a detailed service for every food / beverage. . Thus, according to the present disclosure, it is possible to provide a real-time and detailed service.

As described above, according to the present disclosure, a mechanism capable of further improving the quality of services related to food and drink provided according to user interaction is provided. Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

It is a figure showing an example of 1 composition of an information processing system concerning one embodiment of this indication. It is a figure which shows the other structural example of the information processing system which concerns on this embodiment. It is a figure which shows the other structural example of the information processing system which concerns on this embodiment. It is a block diagram which shows an example of a function structure of the information processing system which concerns on this embodiment. It is a figure for demonstrating the outline | summary of the information processing system which concerns on this embodiment. It is a figure which shows an example of the flow of the operation processing of the information processing system which concerns on this embodiment. It is a figure which shows an example of the display control by the information processing system which concerns on this embodiment. It is a figure which shows an example of the display control by the information processing system which concerns on this embodiment. It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus which concerns on this embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. Overview of information processing system 2. Functional configuration example Technical features 3.1. Outline 3.2. Information about food and drink 3.3. Setting information 3.3.1. Content of setting information 3.3.2. Setting information setting 3.4. Display control 3.5. 3. Notification to external device 4. Hardware configuration example Summary

<< 1. Overview of Information Processing System >>
A configuration of an information processing system according to an embodiment of the present disclosure will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment of the present disclosure. In this specification, the system may mean a configuration for executing a predetermined process, and the system as a whole can be regarded as one device, or a system is configured by a plurality of devices. It can also be regarded as. The information processing system according to the present embodiment illustrated in FIG. 1 may also be configured to execute predetermined processing (for example, processing realized by the functional configuration illustrated in FIG. 4) as the entire information processing system. Which of these configurations is considered as one device may be arbitrary.

Referring to FIG. 1, an information processing system 100a according to an embodiment of the present disclosure includes an input unit 110a and an output unit 130a.

The output unit 130a visually notifies the user of the information by displaying various types of information on the table 140a. For example, a projector is used as the output unit 130a. As illustrated, the output unit 130a is disposed above the table 140a, for example, spaced from the table 140a by a predetermined distance while being suspended from the ceiling, and projects information on the top surface of the table 140a. A method for displaying information on the top surface of the table 140a from above is also referred to as a “projection type”.

In the following description, the entire area where information is displayed by the output unit 130a is also referred to as a display screen. For example, the output unit 130a displays information presented to the user as the application is executed by the information processing system 100a on the display screen. The displayed information is, for example, an operation screen of each application. Hereinafter, each display area in which the operation screen of such an application is displayed on the display screen is also referred to as a display object. The display object may be a so-called GUI (Graphical User Interface) component (widget).

Here, when the information processing system 100a is a projection type, the output unit 130a may include a lighting device. When the output unit 130a includes a lighting device, the information processing system 100a turns on the lighting device based on the content of information input by the input unit 110a and / or the content of information displayed by the output unit 130a. You may control states, such as light extinction.

Further, the output unit 130a may include a speaker and may output various kinds of information as sound. When the output unit 130a is configured by speakers, the number of speakers may be one or plural. When the output unit 130a includes a plurality of speakers, the information processing system 100a may limit the speakers that output sound or adjust the direction in which sound is output. Of course, the output unit 130a may include a plurality of output devices, and may include, for example, a projector, a lighting device, and a speaker.

The input unit 110a is a device that inputs operation details of a user who uses the information processing system 100a. In the example illustrated in FIG. 1, the input unit 110a is provided above the table 140a, for example, in a state suspended from the ceiling. As described above, the input unit 110a is provided apart from the table 140a on which information is displayed. The input unit 110a may be configured by an imaging device that can capture the top surface of the table 140a, that is, the display screen. As the input unit 110a, for example, a camera that images the table 140a with one lens, a stereo camera that can record information in the depth direction by imaging the table 140a with two lenses, or the like can be used. When the input unit 110a is a stereo camera, for example, a visible light camera or an infrared camera can be used.

When a camera that captures the table 140a with a single lens is used as the input unit 110a, the information processing system 100a analyzes the image (captured image) captured by the camera to physically locate the table 140a. It is possible to detect an object (hereinafter also referred to as a real object), for example, the position of a user's hand. When a stereo camera is used as the input unit 110a, the information processing system 100a analyzes the captured image by the stereo camera, and in addition to the position information of the object located on the table 140a, Depth information (in other words, three-dimensional information) can be acquired. The information processing system 100a can detect contact or proximity of the user's hand to the table 140a in the height direction and separation of the hand from the table 140a based on the depth information. In the following description, when the user touches or brings an operating body such as a hand in contact with information on the display screen is also simply referred to as “contact”.

In the present embodiment, based on the image captured by the input unit 110a, the position of the operating body, for example, the user's hand on the display screen (that is, the top surface of the table 140a) is detected, and based on the detected position of the operating body. Various information is input. That is, the user can perform various operation inputs by moving the operating tool on the display screen. For example, when a user's hand contact with the display object is detected, an operation input for the display object is performed. In the following description, a case where a user's hand is used as an operation body will be described as an example, but the present embodiment is not limited to this example, and various operation members such as a stylus are used as the operation body. May be.

Further, when the input unit 110a is configured by an imaging device, the input unit 110a may capture not only the top surface of the table 140a but also a user existing around the table 140a. For example, the information processing system 100a can detect the position of the user around the table 140a based on the captured image. In addition, for example, the information processing system 100a may perform personal recognition of the user by extracting physical features that can identify the individual of the user, such as the size of the user's face and body included in the captured image. .

Here, the present embodiment is not limited to such an example, and user operation input may be executed by other methods. For example, the input unit 110a may be provided as a touch panel on the top surface of the table 140a, and the user's operation input may be detected by contact of the user's finger or the like with respect to the touch panel. The touch panel may be realized by various methods such as a pressure-sensitive type, a capacitance type, and an optical type. Further, the input unit 110a performs spatial position recognition of an object using ultrasonic reflection, or detects a contact position between the object and another object by detecting and analyzing the vibration of the object. Thus, a user operation on the table top surface 140a may be detected. The input unit 110a may employ any one or any combination thereof as a technique for detecting a user operation on the table top surface 140a. Further, the user's operation input may be detected by a gesture with respect to the imaging device constituting the input unit 110a. Alternatively, the input unit 110a may include a voice input device such as a microphone that picks up sounds produced by the user and environmental sounds of the surrounding environment. As the sound input device, a microphone array for collecting sound in a specific direction can be suitably used. Further, the microphone array can be configured such that the sound collection direction can be adjusted to an arbitrary direction. When a voice input device is used as the input unit 110a, an operation input may be performed using the collected voice. Further, the information processing system 100a may perform individual recognition based on the voice by analyzing the collected voice. Alternatively, the input unit 110a may be configured by a remote control device (so-called remote control). The remote controller may be one in which a predetermined instruction is input by operating a predetermined button arranged on the remote controller, or movement of the remote controller by a sensor such as an acceleration sensor or a gyro sensor mounted on the remote controller. Or a posture may be detected, and a predetermined instruction may be input by an operation of the user moving the remote controller. Furthermore, the information processing system 100a may include other input devices such as a mouse, a keyboard, buttons, switches, and levers (not shown) as the input unit 110a, and user operations are input through these input devices. Also good.

The configuration of the information processing system 100a according to the present embodiment has been described above with reference to FIG. Although not shown in FIG. 1, another device may be connected to the information processing system 100a. For example, an illumination device for illuminating the table 140a may be connected to the information processing system 100a. The information processing system 100a may control the lighting state of the lighting device according to the state of the display screen.

Here, in the present embodiment, the configuration of the information processing system is not limited to that shown in FIG. The information processing system according to the present embodiment only needs to include an output unit that displays various types of information on the display screen, and an input unit that can accept at least an operation input for the displayed information. Is not limited. With reference to FIG.2 and FIG.3, the other structural example of the information processing system which concerns on this embodiment is demonstrated. 2 and 3 are diagrams showing another configuration example of the information processing system according to the present embodiment.

In the information processing system 100b shown in FIG. 2, an output unit 130a is provided below the table 140b. The output unit 130a is a projector, for example, and projects information from below toward the top plate of the table 140b. The top plate of the table 140b is formed of a transparent material such as a glass plate or a transparent plastic plate, and the information projected by the output unit 130a is displayed on the top surface of the table 140b. A method of projecting information from the bottom of the table 140b onto the output unit 130a and displaying the information on the top surface of the table 140b is also referred to as a “rear projection type”.

In the example shown in FIG. 2, the input unit 110b is provided on the top surface (front surface) of the table 140b. The input unit 110b is configured by, for example, a touch panel, and the operation input by the user is performed when the touch of the operating body on the display screen on the top surface of the table 140b is detected by the touch panel. Note that the configuration of the input unit 110b is not limited to this example, and the input unit 110b may be provided below the table 140b and separated from the table 140b, similarly to the information processing system 100a shown in FIG. In this case, the input unit 110b is configured by an imaging device, for example, and can detect the position of the operation body on the top surface of the table 140b through a top plate formed of a transparent material.

In the information processing system 100c shown in FIG. 3, a touch panel display is installed on a table with its display screen facing upward. In the information processing system 100c, the input unit 110c and the output unit 130c can be integrally configured as the touch panel display. That is, various types of information are displayed on the display screen of the display, and the operation input by the user is performed by detecting the touch of the operating body on the display screen of the display by the touch panel. In the information processing system 100c as well, as in the information processing system 100a shown in FIG. 1, an imaging device may be provided above the touch panel display as the input unit 110c. The position of the user around the table can be detected by the imaging device.

The other configuration example of the information processing system according to the present embodiment has been described above with reference to FIGS. 2 and 3. As described above, the information processing system according to the present embodiment can be realized by various configurations. Here, in the following, the present embodiment will be described by taking as an example the configuration of the information processing system 100a in which the input unit 110a and the output unit 130a are provided above the table 140a shown in FIG. However, even with other configurations that can realize the information processing system according to the present embodiment, such as the configuration shown in FIG. 2 or FIG. 3 described above, functions similar to those described below can be realized. is there. In the following description, for the sake of simplicity, the information processing system 100a, the input unit 110a, and the output unit 130a are simply referred to as the information processing system 100, the input unit 110, and the output unit 130.

<< 2. Functional configuration >>
Hereinafter, a functional configuration capable of realizing the information processing system 100 according to the present embodiment described above will be described with reference to FIG. FIG. 4 is a block diagram illustrating an example of a functional configuration of the information processing system 100 according to the present embodiment.

Referring to FIG. 4, the information processing system 100 according to the present embodiment includes an input unit 110, a processing unit 120, an output unit 130, a storage unit 150, and a communication unit 160 as its functions.

(1) Input unit 110
The input unit 110 is an input interface for inputting various information to the information processing system 100. A user can input various types of information to the information processing system 100 via the input unit 110. The input unit 110 corresponds to the input units 110a to 110c shown in FIGS.

The input unit 110 can include various sensors. The input unit 110 performs sensing on the user in the sensing target range, user actions, real objects, and the relationship between these and display objects, generates sensing information indicating the sensing result, and outputs the sensing information to the processing unit 120. The sensing target range may not be limited to the top surface of the table 140, and may include, for example, the periphery of the table 140.

For example, the input unit 110 includes an imaging device and captures a captured image including a user's body, a user's face, a user's hand, and an object positioned on the top surface of the table 140. Information (for example, information about the captured image) input via the input unit 110 is provided to the processing unit 120 described later, and a user is identified, a user operation input is recognized, or an object is detected. Or The imaging device may be a visible light camera or an infrared camera, for example. Further, as described above, the input unit 110 may be configured as an imaging device including a function as a depth sensor capable of acquiring depth information such as a stereo camera. On the other hand, the depth sensor may be configured separately from the imaging device as a sensor using an arbitrary method such as a time of flight method or a structured light method. The input unit 110 may include a touch sensor. In that case, the touch sensor detects a touch on the display screen. And the detection function of the user's hand which is not touching on the display screen and the object on the display screen may be secured by the imaging device which images the depth sensor and / or the display screen from above.

For example, the input unit 110 includes a sound collection device and collects a user's voice, a sound accompanying a user's operation, an environmental sound, and the like. Information input via the input unit 110 is provided to the processing unit 120 described later, and a user's voice input is recognized, or movement of an object is detected. The sound collection device may be an array microphone, and the sound source direction may be detected by the processing unit 120. The sound collection device is typically configured by a microphone, but may be configured as a sensor that detects sound by vibration of light.

(2) Processing unit 120
The processing unit 120 includes various processors such as a CPU and a DSP, and controls the operation of the information processing system 100 by executing various arithmetic processes. For example, the processing unit 120 processes various types of information obtained from the input unit 110 or the communication unit 160 and stores the information in the storage unit 150 or causes the output unit 130 to output the information. The processing unit 120 may be regarded as an information processing apparatus that processes various types of information. The processing unit 120 includes a setting unit 121, an acquisition unit 123, a display control unit 125, and a notification unit 127 as its functions. Note that the processing unit 120 may have functions other than these functions. In addition, each function of the processing unit 120 is realized by a processor constituting the processing unit 120 operating according to a predetermined program.

For example, the setting unit 121 has a function of setting setting information in association with food and drink. Moreover, the acquisition part 123 has a function which acquires the information regarding food / beverage obtained as a result of sensing, and the setting information matched with the said food / beverage. Moreover, the display control part 125 has a function which controls the display of the display object regarding the said food / beverage based on the information regarding the acquired food / beverage and setting information. In addition, the notification unit 127 has a function of notifying the external device of information about the food and drink based on the acquired information about food and drink and the setting information. Details of processing by each of these components will be described in detail later.

(3) Output unit 130
The output unit 130 is an output interface for notifying the user of various types of information processed by the information processing system 100. The output unit 130 includes a display device such as a display, a touch panel, or a projector, and displays various types of information on the display screen under the control of the display control unit 123. The output unit 130 corresponds to the output units 130a to 130c shown in FIGS. 1 to 3, and displays a display object on the display screen as described above. Note that the present embodiment is not limited to this example, and the output unit 130 may further include an audio output device such as a speaker, and may output various types of information as audio.

(4) Storage unit 150
The storage unit 150 is a storage device that temporarily or permanently stores information for the operation of the information processing system 100. For example, the storage unit 150 stores setting information.

(5) Communication unit 160
The communication unit 160 is a communication interface for transmitting / receiving data to / from an external device by wire / wireless. For example, the communication unit 160 is a method such as wireless LAN (Local Area Network), Wi-Fi (Wireless Fidelity (registered trademark)), infrared communication, Bluetooth (registered trademark), etc., directly with an external device or via a network access point. Communicate. For example, the communication unit 160 communicates information with a user device such as a user's smartphone or a wearable device attached to the user. The communication unit 160 may acquire information from an SNS (Social Networking Service) or the like by communicating with a server on the Web, for example.

<< 3. Technical features >>
<3.1. Overview>
First, with reference to FIG.5 and FIG.6, the outline | summary of operation | movement by the information processing system 100 which concerns on this embodiment is demonstrated.

FIG. 5 is a diagram for explaining an overview of the information processing system 100 according to the present embodiment. FIG. 5 shows a scene at a restaurant such as a restaurant, bar or cafe. As shown in FIG. 5, users (ie, guests) 10A and 10B are seated on the table 140, and the food and

drink

20A, 20B, and 20C are placed on the top surface (ie, display screen) of the table 140. ing. These food and

drink

20A, 20B, and 20C are ordered by the

user

10A or 10B and distributed by a restaurant clerk.

The information processing system 100 is installed in such a restaurant, for example. Then, the information processing system 100 senses food and

drinks

20A, 20B, and 20C by the

users

10A and 10B via the input unit 110. Then, as illustrated in FIG. 5, the information processing system 100 displays the display objects 30 A and 30 B on the top surface of the table 140 via the output unit 130. In FIG. 5, an example in which the information processing system 100 displays a display object on the table 140 on which food and drink are arranged by a display device (that is, the output unit 130) installed in a restaurant that provides food and drink. Although described, the present technology is not limited to such an example. For example, the display object may be displayed on a user terminal such as a user's smartphone or wearable device, or may be displayed on a wall or floor of a restaurant.

Hereinafter, operation processing by the information processing system 100 in the example shown in FIG. 5 will be described in detail with reference to FIG.

FIG. 6 is a diagram illustrating an example of the flow of operation processing of the information processing system 100 according to the present embodiment. As illustrated in FIG. 6, the information processing system 100 performs sensing using the input unit 110 and acquires information about the

foods

20A, 20B, and 20C (step S102). In addition, the information processing system 100 acquires setting information associated with the

foods

20A, 20B, and 20C (step S104).

Next, the information processing system 100 controls the display of the display object based on the information on the

foods

20A, 20B, and 20C and the setting information associated with the

foods

20A, 20B, and 20C (step S106). For example, the information processing system 100 displays a display object 30A including a beverage menu for prompting the user 10A who eats the meat dish 20A to order additional beverages. In addition, the information processing system 100 displays a display object 30 B including a cooking menu for prompting the user 10 B who eats the shrimp fried food 20 B and drinks the beer 20 C to order additional side dishes. The information processing system 100 accepts additional orders in response to user operations on these display objects 30A or 30B. In this way, the information processing system 100 senses food and drink and displays display objects corresponding to the food and drink setting information, thereby simplifying the user's ordering operation or proposing a combination of food and drink, for example. It becomes possible to do. Thereby, it is possible to enrich a user's eating and drinking experience.

Next, the information processing system 100 controls the notification of information to the external device based on the information on the

foods

20A, 20B, and 20C and the setting information associated with the

foods

20A, 20B, and 20C ( Step S108). Examples of external devices include various devices in restaurants, terminals held by store clerk, and servers on a network. For example, the information processing system 100 transmits a lower bowl instruction to the store clerk's terminal at the timing when the food and drink have been eaten, and an instruction to arrange the next food and drink in the course dish. Further, the information processing system 100 transmits the order information to the kitchen apparatus at the timing when the additional order is made. In addition, the information processing system 100 transmits an accounting instruction to the accounting apparatus of the restaurant at the timing when all the food and drink on the table 140 have been eaten and finished drinking. Thereby, the restaurant can provide an appropriate service at an appropriate timing.

Thereafter, the information processing system 100 determines whether or not the end condition is satisfied (step S110). If it is determined that the condition is not satisfied, the process returns to step S102. If it is determined that the condition is satisfied, the process ends. As the termination condition, for example, a user standing up can be considered.

The outline of the operation by the information processing system 100 according to the present embodiment has been described above. Hereinafter, technical features of the information processing system 100 will be described in detail.

<3.2. Information about food and drink>
Information processing system 100 (for example, acquisition part 123) acquires information about food and drink based on sensing information. For example, the information processing system 100 acquires information on food and drink based on sensing information such as a captured image, an infrared image, user voice, or depth information. In particular, the information processing system may acquire information on food and drink associated with the user. The user here is, for example, a person who is provided with food or drink (for example, a person who ordered or a person who eats or drinks) or a person who provides food or drink (for example, a person who cooks food or drink in a kitchen, or a kitchen A person who carries food and drink to the table). Below, the case where a user is the person who was provided with food and drink is demonstrated. In addition, the information regarding food / beverage may be acquired for every food / beverage, may be acquired collectively regarding several food / beverage products corresponding to a user, and may be acquired collectively for every table. In addition, food and drink may be captured as ingested items. The ingestion is a food, drink or combination thereof that is taken orally.

Information on food and drink is considered diverse. An example will be described below.

For example, information on food and drink may include information unique to food and drink. As information unique to food and drink, for example, names of food and drink, raw materials, cooking methods, and the like are conceivable.

For example, information on food and drink may include information on the state of food and drink. As information regarding the state of food and drink, for example, the temperature, remaining amount and consumption speed of food and drink can be considered.

For example, information on food and drink may include information on provision of food and drink. Examples of information related to the provision of food and drink include, for example, the elapsed time since provision, whether or not it is a part of a course dish, related food and drink (for example, other dishes included in the course dish, or main dishes) The corresponding wine) may be offered.

For example, the information regarding food and drink may include information regarding people regarding food and drink.
As information about a person related to food and drink, which user is associated (orderer or food and drink), whether or not the user who eats or drinks belongs to one or more groups, the role of the user in the group, food and drink The degree of store congestion, the number of store clerk, and the like can be considered.

<3.3. Setting information>
Information processing system 100 (for example, acquisition part 123) acquires setting information matched with food and drink. For example, the information processing system 100 identifies food and drink by recognizing food and drink, and acquires setting information associated with the identified food and drink from the storage unit 150.

<3.3.1. Contents of setting information>
(1) Setting information related to display execution condition The setting information may include information related to the display execution condition of the display object. The information processing system 100 (for example, the display control unit 125) displays a display object when a display execution condition included in the setting information is satisfied.

The display execution condition includes a condition for starting display and a condition for ending. The information processing system 100 displays the display object for a period from when the condition for starting display is satisfied until the condition for ending is satisfied.

The setting information may include a plurality of display execution conditions. For example, there may be a plurality of display object candidates that can be displayed for one food and drink, and display execution conditions can be set for each candidate. Then, the information processing system 100 displays a display object corresponding to the satisfied display execution condition.

-An example of setting information regarding display execution conditions An example of setting information regarding display execution conditions will be described below. The setting information related to the display execution condition is based on at least one of those described below.

-Display execution condition regarding food and drink The display execution condition may be related to food and drink. An example will be described below.

The display execution condition may be based on the remaining amount of food and drink. For example, when the remaining amount of the beverage is equal to or less than the threshold value, it may be determined that display of the display object that prompts the additional order should be executed.

The display execution condition may be based on contact between food and drink and a predetermined real object. For example, when a fork comes into contact with a meat dish, it may be determined that display of a display object that explains the production area of the meat should be executed.

The display execution condition may be based on the relationship between the food and drink and other food and drink. For example, regarding a plurality of beverages provided to a plurality of users, when the remaining amount of some of the beverages is 20% or less, it may be determined that display of a display object that prompts an additional order should be executed.

The display execution condition may be based on whether food or drink is provided as a single item or as part of a course meal. For example, it may be determined that different display objects should be displayed for food and drink provided as a single item (for example, in a la carte) and food and drink provided as part of a course meal.

-Display execution condition regarding time The display execution condition may be related to time. An example will be described below.

The display execution condition may be based on time. For example, it may be determined that a different display object should be displayed depending on whether the time belongs to a lunch time zone or a dinner time zone.

The display execution condition may be based on the elapsed time since the food or drink is provided. For example, when the elapsed time from the provision of food and drink exceeds a threshold, it can be determined that display of a display object that prompts an additional order should be executed.

The display execution condition may be based on the elapsed time since the user started eating. For example, when the elapsed time since the user started eating for a seat exceeds a threshold value, it may be determined that display of a display object that prompts an additional order should be executed.

-Display execution condition regarding the user The display execution condition may be related to the user. An example will be described below.

The display execution condition may be based on user attribute information. As user attribute information, for example, identification information such as a user name, sex, age, occupation, and the like are conceivable. For example, it may be determined that different display objects should be displayed depending on whether the user is male or female.

The display execution condition may be based on the user's state. As the user's state, for example, the user's biometric information, emotion, seat position, and the like can be considered. In addition, as biological information, pulse, body temperature, blood pressure, complexion color, and the like can be considered. For example, it may be determined that different display objects should be displayed when the emotion is high and when the emotion is calm.

The display execution condition may be based on the relationship between the user and another user (for example, a fellow person). For example, when the user is the host of the group, it is determined that the display object that prompts the additional order should be displayed, and when the user is the guest, the display object that prompts the additional order should not be displayed. It can be judged.

The display execution condition may be based on the user's eating history or preference. The user's food history can be acquired from, for example, a database that stores food and drinks that the user has eaten and pasted in association with identification information. The user's preference can be estimated from the user's food history, for example. For example, it may be determined that display object display recommending food and drink that matches the user's preference should be executed.

The display execution condition may be based on the user's voice. For example, it may be determined that display object display that recommends food and drink along a topic should be executed based on a voice recognition result of a conversation between the user and another user (for example, a cohabitant) or a store clerk.

The display execution conditions related to the user described above may be set for one user or may be set for a group. For example, it may be determined that different display objects should be displayed depending on whether the user is seated alone or a group of people is seated.

Display execution condition related to user operation The display execution condition may relate to a user operation. For example, when a predetermined operation such as a single tap, a double tap, or a drag on the displayed display object is detected, it can be determined that display of the display object should be executed.

-Supplement The setting information related to the display execution condition may be information indicating the display execution condition itself. The information indicating the display execution condition itself is, for example, information indicating a threshold for the remaining amount of beverage.

In addition, the setting information related to the display execution condition may be information for changing the display execution condition itself. The information that affects the display execution condition itself is, for example, information that lowers the threshold value of the remaining amount of beverage according to the elapsed time since the meal was started. Typically, the consumption of food and drink is fast in the time zone immediately after the meal is started, and the consumption becomes slow as time passes. Based on this, in the first half of the meal, a display object that prompts an additional order is displayed even if the remaining amount of beverage is large, and in the second half of the meal, a display object that prompts an additional order is displayed when the remaining amount of beverage is small. obtain.

Further, the setting information related to the display execution condition may include information indicating a time lag from when the display execution condition is satisfied until the display object is actually displayed. In this case, the information processing system 100 displays the display object after the set time lag has elapsed after the display execution condition is satisfied. For example, the information processing system 100 displays a display object that prompts an additional order as soon as the remaining amount of beverage falls below the threshold in the first half of the meal, and predetermined after the remaining amount of beverage falls below the threshold in the second half of the meal. A display object that prompts for additional orders is displayed after a lapse of time. The same thing can be realized by changing the display execution condition such as lowering the threshold value of the remaining amount of beverage according to the elapsed time since the meal was started.

(2) Setting information regarding contents For example, the setting information may include information regarding the contents of the display object. When the display execution condition included in the setting information is satisfied, the information processing system 100 (for example, the display control unit 125) displays a display object having contents corresponding to the satisfied display execution condition.

Specifically, the setting information related to the content of the display object can include at least one of image (moving image / still image) data, audio data, and text data.

-An example of setting information regarding the contents of a display object An example of setting information regarding the contents of a display object will be described below. The setting information related to the content is at least one of the items described below.

For example, the content of the display object may be information on additional orders. Examples of information relating to additional orders include, for example, an order issue button, information indicating food and drink candidates that can be ordered, information indicating order history at that time (may include total amount information at that time), and ordering Information indicating customizable options such as number, size and other options may be considered. It should be noted that the display object related to the additional order may be in a format for accepting selection of the food and options desired by the user, or an order for the same food and drink that the user is currently eating and drinking, that is, a request for a replacement. May be accepted. By displaying the information regarding the additional order, the user can easily place the additional order.

For example, the content of the display object may be information related to the elapsed time since the food and drink were provided. By displaying the elapsed time since the food and drink are provided, it is possible to motivate the user to eat early. Thereby, it becomes possible for a restaurant to improve the rotation rate of a seat.

For example, the content of the display object may be information regarding the temperature of food and drink. By displaying the temperature of the food and drink, it is possible to motivate the user to eat at an appropriate temperature.

For example, the content of the display object may be information related to the association between the food and drink and the user. By displaying which user of the group ordered the beverage, the user can prevent losing his / her beverage due to, for example, moving the seat.

For example, the content of the display object may be information explaining food and drink. As information explaining food and drink, a production area, raw materials, allergy information, a nutrient, energy amount, how to eat, etc. can be considered, for example. By displaying information describing food and drink, the user can eat the food in an appropriate way even if it is the first food, for example.

(3) Setting information regarding display style For example, the setting information may include information regarding the display style of the display object. When the display execution condition included in the setting information is satisfied, the information processing system 100 (for example, the display control unit 125) displays a display object having contents corresponding to the satisfied display execution condition in the set display format. indicate.

-Example of setting information related to display style An example of setting information related to the display style will be described below. The setting information regarding the display format is at least one of the following items.

The setting information regarding the display style of the display object may be setting information regarding the display position of the display object. As setting information regarding the display position, for example, a position on the display screen where the display object is to be displayed (for example, an absolute position or a relative position based on food and drink), a range, a size, and other display objects or real objects It is conceivable whether or not to allow duplication.

The setting information regarding the display style of the display object may be setting information regarding the display orientation of the display object. The setting information regarding the display posture may include, for example, information indicating the direction of characters included in the display object, and the information processing system 100 rotates the display object so that the characters included in the display object face the user, for example. Can be.

The setting information related to the display style of the display object may be setting information related to animation. As the animation, for example, movement, rotation, size change, color change, and the like of the display object can be considered.

The setting information regarding the display style of the display object may be setting information regarding the degree of detail. For example, a simple display object may be displayed when a sufficient display area cannot be secured, and a detailed display object may be displayed when a sufficient display area is secured. As a simple display object, an icon indicating that there is new information can be considered.

(4) Setting information related to notification to external device The setting information related to notification to an external device may include information similar to setting information related to display of a display object. For example, the setting information related to the notification to the external device may include information similar to the setting information related to the display execution condition as setting information related to the notification execution condition to the external device.

<3.3.2. Setting information settings>
The information processing system 100 (for example, the setting unit 121) can set setting information in various ways.

For example, the information processing system 100 may first set default setting information, and change the setting information by performing machine learning according to the subsequent usage history. Note that the default setting information may be learned based on the usage history in other restaurants, for example.

The information processing system 100 may change the setting information according to the input by the restaurant. Specifically, each item of the setting information (for example, the threshold value of the remaining amount of beverage related to the display execution condition) may be input by the restaurant. Moreover, each item of setting information may be changed according to the rough input by a restaurant. For example, the restaurant inputs a flag for setting the display timing of the display object such as “normal”, “early”, and “late” for food and drink. Then, the information processing system 100 raises or lowers the threshold value of the remaining amount of the beverage related to the display execution condition, for example, so as to satisfy the request to make the display timing early / slow. In addition, the input of the flag may be performed individually for each food and drink, or common to a plurality of food and drink such as common to drinks or small quantities of food. May be done.

The information processing system 100 may flexibly change the setting information according to circumstances for each user or convenience for each restaurant. In other words, the setting information may be variably set based on at least one of a user or a restaurant that provides food and drink. Specifically, the information processing system 100 can change the setting information according to the past use history for a user who has a past visit history (for example, a regular customer). In addition, the information processing system 100 can change the setting information according to various seasonal conditions such as recommended items for each season, the purchase status of the day, and sales. In addition, the information processing system 100 may change the setting information according to the weather or the like.

∙ Whether the setting information can be changed may be set for each item. For example, items that cannot be changed by the restaurant side can be fixed.

In the setting information, a changeable range may be set for changeable items. For example, with respect to items having a preferable range for the restaurant side, it is possible to keep the change within the preferable range.

<3.4. Display control>
Information processing system 100 (for example, display control part 125) controls display of a display object about the food based on information about food and drink obtained as a result of sensing and setting information associated with the food and drink. To do. For example, the information processing system 100 controls the display object to be displayed, the display start / end timing of the display object, and / or the display style based on the information about the food and drink provided to the user and the setting information.

Hereinafter, a specific example of display control by the information processing system 100 will be described.

(1) Remaining amount of food and drink The information processing system 100 may control the display of display objects according to the amount of food and drink. For example, the information processing system 100 may make a display object that prompts an additional order stand out as the remaining amount of food or drink decreases. An example is shown in FIG. FIG. 7 is a diagram illustrating an example of display control by the information processing system 100 according to the present embodiment. In the example shown in FIG. 7, the information processing system 100 displays a small menu icon 30A when the remaining amount of beer 20 provided to the user 10 is abundant, and a large menu icon 30B when the remaining amount decreases. Is displayed, and a refill order button 30C is displayed when it is drunk. In this way, as the remaining amount of food and drink decreases, it is possible to prevent the user from forgetting to order and to increase sales for the restaurant by prompting the additional order.

(2) Consumption pace The information processing system 100 may control the display of display objects according to the consumption pace of food and drink. For example, the information processing system 100 may display a display object that prompts an additional order at an earlier timing as the consumption pace of food and drink is faster and at a later timing as the rate is slower. Specifically, when the time from serving to the end of eating or drinking is short, the information processing system 100 displays a display object that prompts an additional order after a short time from the end of eating or the end of drinking. In addition, when the time from serving to the end of eating or drinking is long, the information processing system 100 displays a display object that prompts an additional order after a long time from the end of eating or drinking. Thereby, it becomes possible to receive an additional order at an appropriate timing according to the user's consumption pace.

(3) Order to eat and drink The information processing system 100 may control the display of display objects according to the order in which the user eats and drinks food and drink. For example, the information processing system 100 estimates the user's preference based on the order of eating and drinking food, in other words, how to reduce or leave the food, and adds other food and beverage such as matching the user's preference. A display object that prompts an order may be displayed. Note that the information processing system 100 may acquire profile information from the database and determine whether it is left because it does not like the left food or food, or whether it is left intentionally.

(4) Progress of food and beverage provision The information processing system 100 may control the display of display objects according to the progress of food and beverage provision. The progress of food and beverage provision may be, for example, the progress of course cooking (how many of all the products have been provided) or the progress of a plurality of foods and beverages ordered individually. For example, the information processing system 100 displays the display object earlier in the first half of the course dish and displays the display object later in the second half of the course dish. In addition, for example, when a platter dish is served after a predetermined time, the information processing system 100 displays a display object that instructs the user to open the center of the table.

(5) Correspondence relationship between food and drink and user The information processing system 100 may control the display of display objects according to the correspondence between food and drink and the user. For example, the information processing system 100 may display a display object that indicates the correspondence between the food and drink and the user. Such a display object may clearly indicate to the user the food and drink ordered by the user. In this case, for example, it is possible to prevent the user from losing sight of his / her beverage by moving the seat. In addition, the display object may clearly indicate to the store clerk which user ordered the food or drink. In that case, the store clerk can know the place where the food or drink is to be served. An example is shown in FIG. FIG. 8 is a diagram illustrating an example of display control by the information processing system 100 according to the present embodiment. As shown in FIG. 8,

beers

20A and 20B are placed on a table 140 on which

users

10A and 10B are seated, and a store clerk 40 is about to serve

dishes

20C and 20D. As illustrated in FIG. 8, the information processing system 100 displays a display object 30A indicating that the beer 20A belongs to the user 10A and a display object 30B indicating that the beer 20B belongs to the user 10B. . 8, the information processing system 100 includes a display object 30C indicating that the orderer of the dish 20C is the user 10A and should be arranged in front of the user 10A, and the orderer of the dish 20D is the user 10B. A display object 30D indicating that the user 10B should be arranged is displayed in front of the user 10B.

(6) End of eating and drinking of food and drink The information processing system 100 may control the display of display objects according to the end of eating and drinking of food and drink. For example, the information processing system 100 may display a display object that accepts an evaluation of food and drink at the timing when the food and drink of the food and drink are finished (finished eating or finished drinking). The evaluation may be in a scoring format or may be a free-filled questionnaire format. Thereby, the evaluation for every food and drink finer than the evaluation for every restaurant widely performed conventionally becomes possible. Moreover, the information processing system 100 may post the input evaluation to the user's SNS together with the captured image of the food and drink.

(7) Elapsed time after display The information processing system 100 may control the display of the display object according to the elapsed time after the display object is displayed. For example, the information processing system 100 makes the display area less noticeable, for example, by reducing the display area over time after the display of the display object is started, and finally ends the display.

(8) Congestion degree of restaurant The information processing system 100 may control the display of the display object according to the congestion degree of the restaurant. The degree of congestion of the restaurant may be the degree of order congestion or the degree of customer congestion. For example, when the degree of order congestion (for example, the order frequency or the number of unsuccessful orders) exceeds a threshold value, the information processing system 100 delays the display timing of the display object related to the additional order or displays it inconspicuously. To do. As a result, new orders are suppressed and the degree of congestion can be reduced.

(9) Role in Group The information processing system 100 can control the display of display objects according to the role of the user in the group. For example, when the user is a group host, the information processing system 100 displays a display object that prompts an additional order and a display object that includes accounting information. Thereby, for example, the user can appropriately treat the guest.

(10) User Action The information processing system 100 may control the display of the display object according to the user action. For example, the information processing system 100 starts or ends display of the display object when detecting a specific gesture such as shaking a glass.

(11) Audio The information processing system 100 may control display of the display object according to the user's audio. For example, the information processing system 100 can recognize the content of the user's conversation by voice to estimate what the user wants to eat or drink and can control the display of the display object according to the estimation result.

(12) Biometric information The information processing system 100 may control display of a display object according to biometric information. For example, the information processing system 100 displays a display object that recommends warm food when the user's body temperature is lower than a threshold.

<3.5. Notification to external devices>
The information processing system 100 (for example, the notification unit 127) externally outputs the information about the food and drink based on the information about the food and drink provided to the user obtained as a result of the sensing and the setting information associated with the food and drink. Control device notifications. For example, the information processing system 100 controls the information to be notified, the notification timing, and / or the notification format based on the information about the food and drink provided to the user and the setting information.

For example, the information processing system 100 may notify the external device of order information when an order for a predetermined amount of food or drink is made in units of tables. In other words, the information processing system 100 may wait for notification of order information until there is an order for a predetermined amount of food and drink in units of tables. Thereby, it is possible to improve the work efficiency of the restaurant side.

Further, the information processing system 100 may issue an alert or stop accepting an order when an order exceeding a threshold set for each user or each table is performed. Thus, the user can limit the accounting amount or the amount of alcohol consumed.

<< 4. Hardware configuration example >>
Finally, the hardware configuration of the information processing apparatus according to the present embodiment will be described with reference to FIG. FIG. 9 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present embodiment. Note that the information processing apparatus 900 illustrated in FIG. 9 can realize the information processing system 100 illustrated in FIG. 4, for example. Information processing by the information processing system 100 according to the present embodiment is realized by cooperation between software and hardware described below.

As shown in FIG. 9, the information processing apparatus 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, and a host bus 904a. The information processing apparatus 900 includes a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a drive 909, a connection port 911, and a communication device 913. The information processing apparatus 900 may include a processing circuit such as an electric circuit, a DSP, or an ASIC instead of or in addition to the CPU 901.

The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 900 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. For example, the CPU 901 can form the processing unit 120 illustrated in FIG. 4.

The CPU 901, ROM 902, and RAM 903 are connected to each other by a host bus 904a including a CPU bus. The host bus 904 a is connected to an external bus 904 b such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 904. Note that the host bus 904a, the bridge 904, and the external bus 904b do not necessarily have to be configured separately, and these functions may be mounted on one bus.

The input device 906 is realized by a device in which information is input by the user, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever. The input device 906 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or a PDA that supports the operation of the information processing device 900. . Furthermore, the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by the user using the above-described input means and outputs the input signal to the CPU 901. A user of the information processing apparatus 900 can input various data and instruct a processing operation to the information processing apparatus 900 by operating the input device 906.

Alternatively, the input device 906 can be formed by a device that detects information about the user. For example, the input device 906 includes various sensors such as an image sensor (for example, a camera), a depth sensor (for example, a stereo camera), an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, a sound sensor, a distance sensor, and a force sensor. Can be included. In addition, the input device 906 includes information related to the information processing device 900 state, such as the posture and movement speed of the information processing device 900, and information related to the surrounding environment of the information processing device 900, such as brightness and noise around the information processing device 900. May be obtained. Further, the input device 906 receives a GNSS signal from a GNSS (Global Navigation Satellite System) satellite (for example, a GPS signal from a GPS (Global Positioning System) satellite) and receives position information including the latitude, longitude, and altitude of the device. A GNSS module to measure may be included. As for the position information, the input device 906 may detect the position by transmission / reception with Wi-Fi (registered trademark), a mobile phone / PHS / smartphone, or the like, or near field communication. The input device 906 can form, for example, the input unit 110 shown in FIG.

The output device 907 is formed of a device that can notify the user of the acquired information visually or audibly. Examples of such devices include CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, display devices such as laser projectors, LED projectors and lamps, audio output devices such as speakers and headphones, printer devices, and the like. . For example, the output device 907 outputs results obtained by various processes performed by the information processing device 900. Specifically, the display device visually displays results obtained by various processes performed by the information processing device 900 in various formats such as text, images, tables, and graphs. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally. The output device 907 can form, for example, the output unit 130 shown in FIG.

The storage device 908 is a data storage device formed as an example of a storage unit of the information processing device 900. The storage apparatus 908 is realized by, for example, a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. The storage device 908 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 908 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like. The storage device 908 can form, for example, the storage unit 150 shown in FIG.

The drive 909 is a storage medium reader / writer, and is built in or externally attached to the information processing apparatus 900. The drive 909 reads information recorded on a removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. The drive 909 can also write information to a removable storage medium.

The connection port 911 is an interface connected to an external device, and is a connection port with an external device capable of transmitting data by USB (Universal Serial Bus), for example.

The communication device 913 is a communication interface formed by a communication device or the like for connecting to the network 920, for example. The communication device 913 is, for example, a communication card for wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 913 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communication, or the like. The communication device 913 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet and other communication devices. The communication device 913 can form, for example, the communication unit 160 illustrated in FIG.

Note that the network 920 is a wired or wireless transmission path for information transmitted from a device connected to the network 920. For example, the network 920 may include a public line network such as the Internet, a telephone line network, and a satellite communication network, various LANs including the Ethernet (registered trademark), a wide area network (WAN), and the like. Further, the network 920 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

Heretofore, an example of the hardware configuration capable of realizing the functions of the information processing apparatus 900 according to the present embodiment has been shown. Each of the above components may be realized using a general-purpose member, or may be realized by hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out this embodiment.

It should be noted that a computer program for realizing each function of the information processing apparatus 900 according to the present embodiment as described above can be produced and mounted on a PC or the like. In addition, a computer-readable recording medium storing such a computer program can be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.

<< 5. Summary >>
The embodiment of the present disclosure has been described in detail above with reference to FIGS. As described above, the information processing system 100 according to the present embodiment is based on information about food and drink provided to a user obtained as a result of sensing and setting information associated with the food and drink. Controls display of display objects related to objects. Thereby, the information processing system 100 can provide a fine-tuned service set for each food and drink in real time according to the state of meal.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

For example, in the above-described embodiment, an example in which the information processing system 100 is applied in a restaurant has been described, but the present technology is not limited to such an example. For example, the information processing system 100 can be applied in any place where food and drink can be provided, such as a general home or a cafeteria cafeteria.

Note that the device described in this specification may be realized as a single device, or a part or all of the devices may be realized as separate devices. For example, in the functional configuration example of the information processing system 100 illustrated in FIG. 4, the processing unit 120 and the storage unit 150 are connected to an apparatus such as a server connected to the input unit 110, the output unit 130, and the communication unit 160 via a network or the like. It may be provided. When the processing unit 120 and the storage unit 150 are provided in a device such as a server, information obtained by the input unit 110 or the communication unit 160 is transmitted to the device such as the server via a network or the like, and the processing unit 120 sets the drawing information set. The information for the output unit 130 to output from the device such as the server is sent to the output unit 130 through a network or the like.

In addition, the processes described using the flowcharts in this specification do not necessarily have to be executed in the order shown. Some processing steps may be performed in parallel. Further, additional processing steps may be employed, and some processing steps may be omitted.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A control unit for controlling display of a display object relating to the food or beverage based on information relating to the food or beverage obtained as a result of sensing and setting information associated with the food or beverage;
An information processing apparatus comprising:
(2)
The information processing apparatus according to (1), wherein the setting information relates to display execution conditions for the display object.
(3)
The display execution condition is based on at least one of the remaining amount of the food or beverage, the contact between the food or beverage and a predetermined real object, or the relationship between the food or beverage and another food or beverage, The information processing apparatus according to 2).
(4)
The information processing apparatus according to (2) or (3), wherein the display execution condition is based on whether the food or beverage is provided as a single item or as part of a course dish.
(5)
The display execution condition is based on at least one of a time, an elapsed time since the food or beverage was provided, or an elapsed time since the user who provided the food or beverage started eating ( The information processing apparatus according to any one of 2) to (4).
(6)
The information processing apparatus according to any one of (1) to (5), wherein the setting information relates to a content of the display object.
(7)
The content includes information on additional orders, information on the elapsed time since the food or beverage was provided, information on the temperature of the food or beverage, and correspondence between the food or beverage and the user provided with the food or beverage. The information processing apparatus according to (6), wherein the information processing apparatus is at least one of information on attaching or information describing the food or beverage.
(8)
The information processing apparatus according to any one of (1) to (7), wherein the setting information relates to a display format of the display object.
(9)
The information processing apparatus according to (8), wherein the display style is at least one of a display position, a display posture, an animation, and a detail level of the display object.
(10)
The setting information is variably set based on at least one of a user to whom the food or beverage is provided or a restaurant that provides the food or beverage, (1) to (9) The information processing apparatus described in 1.
(11)
The information processing apparatus according to any one of (1) to (10), wherein the control unit makes the display object that prompts an additional order stand out as the remaining amount of the food or beverage decreases.
(12)
The control unit displays the display object that prompts an additional order at an earlier timing as the consumption pace of the food or beverage is faster, and at a later timing as the delay is slower, according to any one of (1) to (11). The information processing apparatus described.
(13)
The control unit displays the display object that prompts an additional order of another food or beverage according to an order in which the user to whom the food or beverage is provided eats or drinks the food or beverage, (1) to (12 ). The information processing apparatus according to any one of
(14)
The information processing according to any one of (1) to (13), wherein the control unit displays the display object indicating a correspondence relationship between the food or beverage and a user to whom the food or beverage is provided. apparatus.
(15)
The information processing unit according to any one of (1) to (14), wherein the control unit displays the display object that receives an evaluation of the food or beverage at a timing when the eating or drinking of the food or beverage is completed. apparatus.
(16)
The information processing apparatus according to any one of (1) to (15), wherein the control unit controls display of the display object in accordance with a degree of congestion of a restaurant that provides the food or beverage.
(17)
The information processing apparatus according to any one of (1) to (16), wherein the control unit displays the display object according to a role of a user who is provided with the food or beverage.
(18)
The control unit displays the display object on a table on which the food or beverage is arranged by a display device installed in a restaurant that provides the food or beverage, any one of (1) to (17) The information processing apparatus according to item.
(19)
Controlling display of a display object related to the food or beverage by a processor based on information about the food or beverage obtained as a result of sensing and setting information associated with the food or beverage,
An information processing method including:
(20)
Computer
A control unit for controlling display of a display object relating to the food or beverage based on information relating to the food or beverage obtained as a result of sensing and setting information associated with the food or beverage;
A storage medium that stores a program for functioning as a computer.

DESCRIPTION OF SYMBOLS 10 User 20 Food and drink 30 Display object 100 Information processing system 110 Input part 120 Processing part 121 Setting part 123 Acquisition part 125 Display control part 127 Notification part 130 Output part 140 Table 150 Storage part 160 Communication part

Claims

A control unit for controlling display of a display object relating to the food or beverage based on information relating to the food or beverage obtained as a result of sensing and setting information associated with the food or beverage;
An information processing apparatus comprising:
The information processing apparatus according to claim 1, wherein the setting information relates to a display execution condition of the display object.
The display execution condition is based on at least one of a remaining amount of the food or beverage, a contact between the food or beverage and a predetermined real object, or a relationship between the food or beverage and another food or beverage. 2. The information processing apparatus according to 2.
3. The information processing apparatus according to claim 2, wherein the display execution condition is based on whether the food or beverage is provided as a single item or as part of a course dish.
The display execution condition is based on at least one of a time, an elapsed time since the food or beverage was provided, or an elapsed time since the user who provided the food or beverage started eating. 2. The information processing apparatus according to 2.
The information processing apparatus according to claim 1, wherein the setting information relates to a content of the display object.
The content includes information on additional orders, information on the elapsed time since the food or beverage was provided, information on the temperature of the food or beverage, and correspondence between the food or beverage and the user provided with the food or beverage. The information processing apparatus according to claim 6, wherein the information processing apparatus is at least one of information relating to pasting or information describing the food or beverage.
The information processing apparatus according to claim 1, wherein the setting information relates to a display style of the display object.
The information processing apparatus according to claim 8, wherein the display style is at least one of a display position, a display posture, an animation, and a detail level of the display object.
The information processing apparatus according to claim 1, wherein the setting information is variably set based on at least one of a user to whom the food or beverage is provided or a restaurant that provides the food or beverage.
The information processing apparatus according to claim 1, wherein the control unit makes the display object that prompts an additional order stand out as the remaining amount of the food or beverage decreases.
2. The information processing apparatus according to claim 1, wherein the control unit displays the display object that prompts an additional order at an earlier timing as the consumption pace of the food or beverage is faster and at a later timing as the delay is slower.
2. The information according to claim 1, wherein the control unit displays the display object that prompts an additional order of another food or beverage according to an order in which the user to whom the food or beverage is provided eats or drinks the food or beverage. Processing equipment.
The information processing apparatus according to claim 1, wherein the control unit displays the display object indicating a correspondence relationship between the food or beverage and a user who is provided with the food or beverage.
The information processing apparatus according to claim 1, wherein the control unit displays the display object that receives an evaluation of the food or beverage at a timing when the eating or drinking of the food or beverage is completed.
The information processing apparatus according to claim 1, wherein the control unit controls display of the display object according to a degree of congestion of a restaurant that provides the food or beverage.
The information processing apparatus according to claim 1, wherein the control unit displays the display object corresponding to a role of a user who is provided with the food or beverage.
The information processing apparatus according to claim 1, wherein the control unit displays the display object on a table on which the food or beverage is arranged by a display device installed in a restaurant that provides the food or beverage.
Controlling display of a display object related to the food or beverage by a processor based on information about the food or beverage obtained as a result of sensing and setting information associated with the food or beverage,
An information processing method including:
Computer
A control unit for controlling display of a display object relating to the food or beverage based on information relating to the food or beverage obtained as a result of sensing and setting information associated with the food or beverage;
A storage medium that stores a program for functioning as a computer.