WO2016088597A1

WO2016088597A1 - Food management system, refrigerator, server, terminal device, and control program

Info

Publication number: WO2016088597A1
Application number: PCT/JP2015/082857
Authority: WO
Inventors: 吉洋福田; 善久脇
Original assignee: シャープ株式会社
Priority date: 2014-12-01
Filing date: 2015-11-24
Publication date: 2016-06-09
Also published as: CN106796671B; JPWO2016088597A1; CN106796671A; JP6302567B2

Abstract

A food management system, wherein a server detects the presence of a user in the vicinity of a refrigerator (S8). The server generates a message based on an order from the user and keeps the message registered in memory, reads out the message from memory at a timing based on the detection (S9), and transfers the read message to the refrigerator (S10). Then, after transferring the message, the server accepts input of order placement for food from the refrigerator for a predefined period (S13-S15). This makes it possible to provide a food management system including a refrigerator that effectively notifies the user of information.

Description

Food management system, refrigerator, server, terminal device, and control program

The present disclosure relates to a food management system, a refrigerator, a server, a terminal device, and a control program, and in particular, a food management system including a refrigerator having a notification function to a user, the refrigerator, a server included in the system, a terminal device, and a control Regarding the program.

Some refrigerators have a function of managing food items in the warehouse and notifying information on food items such as food stock information and accident information. For example, Japanese Patent Application Laid-Open No. 2006-139551 (hereinafter referred to as Patent Document 1) discloses a refrigerator that displays information on food in a warehouse by display or sound.

In a refrigerator having a notification function such as that in Patent Document 1, information is normally notified at the timing when notification is required. Thereby, the timely alerting | reporting to a user is realizable.

JP 2006-139551 A

However, even if information is notified by a display device or a speaker mounted on the refrigerator main body, if the user is not in the vicinity of the refrigerator, the information is not transmitted to the user. That is, depending on the notification timing, effective notification to the user may not be realized.

Therefore, the present disclosure is intended to provide a food management system including a refrigerator that has a notification function and effectively notifies the user of information. Moreover, this indication is a refrigerator which has an alerting | reporting function, Comprising: It aims at providing the refrigerator which alert | reports information effectively to a user. Moreover, this indication is a refrigerator which has an alerting | reporting function, Comprising: It aims at providing the server contained in the foodstuff management system containing the refrigerator which alert | reports information effectively to a user. Moreover, this indication is a refrigerator which has an alerting | reporting function, Comprising: It aims at providing the terminal device which can communicate with the refrigerator which alert | reports information effectively to a user. Moreover, this indication is a refrigerator which has an alerting | reporting function, Comprising: It aims at providing the control program of the terminal device which can communicate with the refrigerator which alert | reports information effectively to a user.

According to the present embodiment, the food management system includes a server and a refrigerator that can communicate with the server. The server includes storage means for storing notification information in the refrigerator. The refrigerator includes a notification device and an input device. The food management system includes a detection unit for detecting the presence of a user in the vicinity of the refrigerator, a notification control unit for performing notification by a notification device based on notification information at a timing based on detection by the detection unit, And an input means for receiving food order input from the input device for a predetermined period after the notification.

Preferably, the detection means detects the presence of a user in the vicinity of the refrigerator by detecting the occurrence of a user action involving a contact with the refrigerator.

More preferably, the detection means detects opening / closing of the refrigerator door as a user action for the refrigerator.

Preferably, the notification device has an audio output function. The notification includes notification performed by voice.

Preferably, the input device has a voice input function. The food order input includes voice input.

Preferably, the notification device can communicate with a terminal device within a predetermined range. The notification includes transferring the notification information to a terminal device in which the notification device is within a predetermined range.

Preferably, the input device can communicate with a terminal device within a predetermined range. The food order input includes receiving an input of order information from a terminal device whose input device is within a predetermined range.

Preferably, the server transfers the food order by transferring the communication means for communicating with the device for managing food orders and the food order input received by the input device to the device for managing food orders. Ordering means for placing an order is further provided. The storage means further stores information about the order status of food ordered by the ordering means, which is input from a device that manages food ordering. The notification information includes information related to the order status of food ordered by the ordering means.

More preferably, the predetermined period is a period until the shipment of the food ordered before the notification is completed.

More preferably, the food management system further includes a terminal device capable of communicating with the server. The order input received within a predetermined period is an additional order input with respect to the order input made in the terminal device before the notification. The terminal device accepts an input of a keyword at the time of order input performed before notification. The terminal device transmits the accepted keyword to the server. The refrigerator receives an input of a keyword by voice at the time of order input received within a predetermined period. The refrigerator transmits the accepted keyword to the server. The server notifies the device managing the food order of the order input received within a predetermined period on condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

According to another embodiment, the refrigerator can communicate with the server. The refrigerator includes a detection unit for detecting the presence of a user near the refrigerator, a notification unit for reporting notification information acquired from the server at a timing based on detection by the detection unit, and a food after the notification. Input means for receiving the order input, and ordering means for ordering food by transferring the order information received by the input means to the server.

Preferably, the notification by the notification means includes notification performed by voice.
Preferably, the order input by the input means includes an input by voice.

Preferably, the refrigerator further includes a communication means for communicating with a terminal device within a predetermined range. The notification by the notification means includes transferring the notification information to a terminal device within a predetermined range.

Preferably, the refrigerator further includes a communication means for communicating with a terminal device within a predetermined range. Order input by the input means includes receiving input of order information from a terminal device within a predetermined range.

Preferably, the refrigerator further includes notification means for notifying the server of detection by the detection means. The notification means notifies the notification information transferred from the server in response to the notification.

Preferably, the refrigerator further includes an acquisition unit for acquiring notification information from the server at a predetermined timing, and a storage unit for storing the notification information. The notification means reads out the notification information from the storage means at a timing based on the detection by the detection means and notifies it.

More preferably, the food order input by the input means is an additional order input with respect to the order input made in the terminal device before the notification. The input means receives a keyword input by voice when an order is received after notification. The refrigerator further includes transmission means for transmitting the accepted keyword to the server.

According to another embodiment, the server can communicate with the refrigerator. This server reads the notification information from the storage means at a timing based on the detection means in the storage means for storing the notification information in the refrigerator, the detection means for detecting the presence of the user near the refrigerator, and the detection means. Transfer means for transferring to the refrigerator, and input means for receiving an input of food order from the refrigerator for a predetermined period after the transfer.

Preferably, the server transfers the food order by transferring the communication order for communicating with the device for managing food orders and the food order input received by the input means to the device for managing food orders. Ordering means for placing an order is further provided. The storage means further stores information about the order status of food ordered by the ordering means, which is input from a device that manages food ordering. The notification information includes information related to the order status of food ordered by the ordering means.

More preferably, the predetermined period is a period until shipping of the food ordered before the transfer is completed.

More preferably, the server can communicate with the terminal device. The order entry received within a predetermined period is an additional order entry with respect to the order entry made at the terminal device before transfer. The server receives from the terminal device a keyword accepted by the terminal device at the time of order entry made before transfer. The server receives from the refrigerator the keyword received by the refrigerator by voice when an order is received within a predetermined period. The server notifies the device managing the food order of the order input received within a predetermined period on condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

According to another embodiment, the terminal device can communicate with a refrigerator within a predetermined range. The terminal device includes an input means for receiving food order input, a transfer means for transferring information representing the order input to the refrigerator, an acquisition means for acquiring notification information input from the refrigerator, and notification information Display means for performing display based on the above.

According to another embodiment, the control program is a server control program that can communicate with the refrigerator. The server has a memory for storing notification information in the refrigerator. The control program includes a step of detecting presence of a user in the vicinity of the refrigerator on the server, a step of reading notification information from the memory at a timing based on the detection, and transferring the notification information to the refrigerator. And a step of receiving an input of food order from the refrigerator.

According to another embodiment, the control program is a control program for a terminal device that can communicate with a refrigerator within a predetermined range. This control program performs a display based on the notification information, a step of receiving a food order input to the terminal device, a step of transferring information representing the order input to the refrigerator, a step of acquiring notification information from the refrigerator. Step.

According to this disclosure, information can be effectively notified to the user.

It is a figure showing the specific example of the structure of the system (henceforth only a system) containing a refrigerator concerning embodiment. It is a block diagram showing an example of the apparatus structure of the server contained in a system. It is a block diagram showing an example of the apparatus structure of the refrigerator contained in a system. It is a block diagram showing an example of the apparatus structure of the terminal device contained in a system. It is a figure for demonstrating the operation | movement outline | summary of this system. It is a figure showing an example of order information (list). It is a figure showing an example of speech information (list). It is a block diagram showing an example of a functional structure of a refrigerator. It is a block diagram showing an example of a functional structure of a server. It is a flowchart showing an example of the flow of operation of a refrigerator. It is a flowchart showing an example of the flow of operation | movement of a server. It is a block diagram showing an example of functional composition of an upper terminal unit. It is a figure showing an example of the screen displayed when receiving an order in a terminal device. It is a figure showing an example of the screen displayed when ordering in a terminal device. It is a figure showing an example of the order information containing a password. It is a block diagram showing an example of a functional structure of a refrigerator. 2 is a block diagram illustrating an example of a functional configuration of a server 100. FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

[First Embodiment]
<System configuration>
FIG. 1 is a diagram illustrating a specific example of a configuration of a system including a refrigerator (hereinafter also simply referred to as a system) according to the present embodiment. With reference to FIG. 1, the present system includes a server 100, a refrigerator 300, and a terminal device 500. These are connected via a network such as the Internet or a dedicated line, and can communicate with each other. The server 100 may be composed of a single server. Alternatively, a plurality of servers may cooperate to realize the function of the server 100 as a whole.

Preferably, a PC (personal computer) 700 can be further connected to the system. The PC 700 is a PC owned by the food sales service. The PC 700 may also be configured with a single PC. Alternatively, a plurality of PCs may cooperate to implement the function of the PC 700 as a whole.

A touch panel 36 is disposed on the refrigerator 300, for example, on the front of the door. Furthermore, a microphone 34 and a speaker 35 are disposed on the refrigerator 300, for example, on the front of the door. Thereby, the refrigerator 300 can alert | report information with a display and / or an audio | voice with respect to a user. Moreover, the refrigerator 300 can accept information input from a user by touch or voice.

Refrigerator 300 has a plurality of doors. The refrigerator includes a sensor 37 for detecting opening and closing of at least one of the plurality of doors.

Preferably, the refrigerator 300 and the terminal device 500 include the

communication devices

39 and 55, respectively, and can perform direct communication. Communication between the refrigerator 300 and the terminal device 500 is wireless communication. The communication between the refrigerator 300 and the terminal device 500 is short-range wireless communication such as Bluetooth (registered trademark).

<Device configuration>
FIG. 2 is a block diagram illustrating an example of a device configuration of the server 100. The server 100 may be configured with a general PC. Therefore, FIG. 2 shows a general configuration of a PC.

Specifically, referring to FIG. 2, the server 100 includes a CPU (Central Processing Unit) 10 for controlling the entire apparatus. Further, the server 100 stores a ROM (Read Only Memory) 11 for storing a program executed by the CPU 10, a RAM (Random Access Memory) 12 serving as a work area when the CPU 10 executes the program, and various data. HDD (Hard Disk Drive) 13 for storing. The server 100 also includes a network controller 14. The network controller 14 controls communication with other devices via the network.

FIG. 3 is a block diagram showing an example of the apparatus configuration of the refrigerator 300. Referring to FIG. 3, refrigerator 300 includes a CPU 30 for controlling the entire apparatus. Furthermore, the refrigerator 300 includes a ROM 31 for storing a program executed by the CPU 30 and a RAM 32 for serving as a work area when the CPU 30 executes the program and for storing various data.

Further, the refrigerator 300 includes a drive mechanism 33. The drive mechanism 33 is, for example, a motor for driving a compressor, a motor for driving a fan, or the like. The CPU 30 controls driving of the drive mechanism 33.

The refrigerator 300 includes a microphone 34, a speaker 35, and a touch panel 36. The CPU 30 controls audio output from the speaker 35 and display on the touch panel 36. In addition, the CPU 30 accepts voice input from the microphone 34 and input from the touch panel 36.

In addition, the refrigerator 300 includes a sensor 37. The sensor 37 detects opening / closing of at least one door. The sensor 37 inputs a sensor signal indicating opening / closing of the door to the CPU 30.

The refrigerator 300 includes a network controller 38 and a communication device 39. The network controller 38 controls communication with other devices via the network. The communication device 39 performs wireless communication with the communication device 55 mounted on the terminal device 500.

FIG. 4 is a block diagram showing an example of the device configuration of the terminal device 500. The terminal device 500 is a terminal device called, for example, a smartphone. FIG. 4 shows only a portion of the device configuration of the terminal device 500 that is related to the operation of this system. Therefore, the terminal device 500 may include a configuration other than the configuration shown in FIG.

Referring to FIG. 4, terminal device 500 includes a CPU 50 for controlling the entire device. Further, the terminal device 500 includes a ROM 51 for storing a program executed by the CPU 50 and a RAM 52 for serving as a work area when the CPU 50 executes the program and for storing various data.

Further, the terminal device 500 includes a touch panel 53. The CPU 50 controls display on the touch panel 53. In addition, the CPU 30 receives an input from the touch panel 53.

The terminal device 500 includes a network controller 54 and a communication device 55. The network controller 54 controls communication with other devices via the network. The communication device 55 performs wireless communication with the communication device 39 mounted on the refrigerator 300.

<Overview of operation>
FIG. 5 is a diagram for explaining an outline of the operation of the system. Referring to FIG. 5, server 100 receives an order for a product (food) from the user (step S 0). In the example of FIG. 5, the user performs an operation for ordering the terminal device 500. When receiving an ordering operation from the user, the terminal device 500 transfers the ordering information representing the contents of the order to the server 100 (step S1), and orders the designated product (food).

The user may order a product by operating the refrigerator 300. For example, the user may input an order by touching the touch panel 36. Alternatively, the user may input an order by voice input to the microphone 34. Receiving the user operation, the refrigerator 300 orders the specified product by transferring the ordering information representing the contents of the order to the server 100.

The server 100 that has received the input of the ordering information from the terminal device 500 executes a process for receiving the order (step S2). In step S 2, for example, the server 100 performs processing for registering order information in a predetermined area of the HDD 13. The order information is, for example, information in a list format in which information related to products ordered by the user is described for each user associated with the refrigerator.

FIG. 6 is a diagram showing an example of order information (list). Referring to FIG. 6, as an example, server 100 is associated with an order ID (identification) that is information for identifying one order and the date and time when the order is received and designated for each ordered product. Registered products (food).

The server 100 places the ordered product by transferring the ordering information to the PC 700 (step S3). If there are a plurality of PCs 700 as the ordering destinations, the server 100 registers the corresponding PCs for each product in advance, and transfers the ordering information to the corresponding PCs 700 in step S3.

Preferably, when the server 100 transfers the order information to the PC 700 in step S3, the server 100 updates the order information in FIG. That is, referring to FIG. 6, server 100 adds an order status indicating whether or not an order has been placed with respect to PC 700 in step S3 to the order information.

The PC 700 that has received the order information from the server 100 executes processing for the order (step S4). The process here is not limited to a specific process. For example, the PC 700 may display the ordered product on a display (not shown) in order to notify the person in charge of purchase. Further, for example, the PC 700 may accept an input of a shipping date from a person in charge of purchase. The PC 700 transfers the information about the scheduled shipping date and other products input or acquired from other devices to the server 100 as product information (step S5).

The server 100 that has received the product information from the PC 700 executes processing for managing orders (step S6). In step S 6, for example, the server 100 performs a process of adding and registering information based on the product information from the PC 700 to the order information. Referring to FIG. 6, server 100 adds the scheduled shipping date included in the product information from PC 700 to the order information and registers it.

Furthermore, the server 100 generates information used for the refrigerator 300 to notify the user of product information. As an example, it is assumed that the refrigerator 300 notifies (speaks) to the user by voice from the speaker 35. Therefore, the server 100 generates a message output from the refrigerator 300 based on the order information (step S7), and performs a process of registering it as speech information in a predetermined area of the HDD 13. The utterance information is, for example, information in a list format in which a message is described for each user associated with the refrigerator.

FIG. 7 is a diagram showing an example of utterance information (list). Referring to FIG. 7, as an example, for each ordered product, the server 100 notifies a message that an order for the product has been accepted, and a product ( A message for notifying the scheduled delivery date of the product group) and a message for notifying the scheduled delivery date are generated, and the generated message is registered in the utterance information.

As an example, when receiving an order for a product, the server 100 generates a message notifying that the order for the product has been received, and registers the message in the utterance information. Also, as an example, when the product information is received from the PC 700, the server 100 generates a message for informing the scheduled delivery date based on the scheduled delivery date included in the product information, and registers it in the utterance information. Further, as an example, when the server 100 reaches a scheduled shipping date registered in the order information of FIG. 6 for a certain order, the server 100 generates a message notifying that the current date is the scheduled delivery date, and includes the utterance information. sign up.

When the server 100 generates a message and registers it in the utterance information shown in FIG. 7, it waits until the notification timing is reached. The notification timing is the timing at which the server 100 detects the presence of a user near the refrigerator 300. The presence of the user in the vicinity of the refrigerator 300 is detected, for example, by detecting the occurrence of a user action involving contact with the refrigerator 300. As an example, the user action involving contact with the refrigerator 300 is opening and closing the door of the refrigerator 300. The user action may be a touch on the touch panel 36 of the refrigerator 300. Alternatively, the presence of a user near the refrigerator 300 is detected by voice input from a human sensor (not shown) or a microphone 34, image analysis of a photographed image by a camera (not shown) mounted on the refrigerator 300, fingerprint authentication, and the like. May be.

When the refrigerator 300 detects opening / closing of the door by the sensor 37, the refrigerator 300 notifies the server 100 that the user action has been performed (step S8). By receiving this notification from the refrigerator 300, the server 100 detects the occurrence of the user action on the refrigerator 300. As another example, the server 100 may monitor the power consumption from the refrigerator 300 and determine whether the internal lighting is on or off. It may be detected.

When the occurrence of the user action on the refrigerator 300 is detected, the server 100 extracts a message that has not yet been transferred to the refrigerator 300 from the messages registered in the utterance information of FIG. 7 (step S9). Then, the server 100 transfers the corresponding message to the refrigerator 300 (step S10).

The refrigerator 300 that has received the information of the message outputs (speaks) voice from the speaker 35 based on the information (step S11). Thereby, a sound is output at the timing when the user is in the vicinity. As a result, effective notification to the user is realized.

When the server 100 transfers the message to the refrigerator 300 in step S10, the server 100 executes a process for managing notifications in the refrigerator 300 (step S12). In step S 12, for example, the server 100 performs a process of adding information indicating presence / absence of notification to the refrigerator 300 to the utterance information. That is, referring to FIG. 7, server 100 adds to the utterance information a notification state indicating whether or not the message has been transferred to refrigerator 300 in step S 10. By adding this information to the utterance information, in step S9, the server 100 can extract a message that has not yet been transferred to the refrigerator 300 when the occurrence of the user action is detected.

When the server 100 transfers the message to the refrigerator 300 in step S10, the server 100 sets a period for accepting the input of the additional order for the order related to the message (step S13). Preferably, the period is a period defined in advance after the message is transferred. The predetermined period may be a period registered in advance in the server 100. As an example, the predetermined period is a period up to the scheduled shipping date registered in the order information. When the server 100 accepts input of product information indicating that the ordered product has been shipped from the PC 700 (step S20), more preferably, the predetermined period is a period until the product is shipped. is there.

The user who has heard the voice notification from the refrigerator 300 may think of forgetting an order or adding an order. The server 100 accepts an order for a product (food item) from such a user. In the example of FIG. 5, the user performs an operation for ordering by voice input to the refrigerator 300. When receiving the user's voice input, the refrigerator 300 orders the designated product (food) by transferring the order information representing the contents of the order to the server 100 (step S14).

The server 100 that has received the input of order information from the refrigerator 300 executes a process for managing the additional order (step S15). In step S15, the server 100 adds the received order to the order related to the message transferred to the refrigerator 300 in step S10 when the input of the ordering information is within the period set in step S13. The server 100 then places an order for the ordered product by transferring the ordering information to the PC 700 as an addition of the order (step S16).

The PC 700 that has received the ordering information from the server 100 executes the processing for the order (step S4 ') as in step S4. Then, the PC 700 transfers the product information to the server 100 in the same manner as in step S5 '(step S5'). Receiving the product information, the server 100 generates a message notifying that the additional order has been accepted and registers it in the utterance information (step S17). Then, the server 100 transfers the generated message to the refrigerator 300 (step S18).

Refrigerator 300 that has received the information of the message outputs (speaks) voice from speaker 35 based on the information (step S19). As a result, a sound is output at the timing when the user places an additional order near the refrigerator 300. As a result, effective notification to the user is realized.

<Functional configuration>
FIG. 8 is a block diagram illustrating an example of a functional configuration of the refrigerator 300 for performing the above operation. Each function of FIG. 8 is mainly realized by the CPU 30 when the CPU 30 of the refrigerator 300 reads the program stored in the ROM 31 onto the RAM 32 and executes it. However, some functions may be realized by other hardware (not shown) such as the hardware shown in FIG. 3 or an electric circuit.

Referring to FIG. 8, CPU 30 of refrigerator 300 includes a detection unit 301 and a notification unit 302. The detection unit 301 detects opening / closing of the door based on a sensor signal from the sensor 37. The notification unit 302 notifies the server 100 that the door has been opened and closed.

Further, the CPU 30 includes a message input unit 303 for receiving a message input from the server 100 and an output control unit 304 for controlling output from the speaker 35. As an example, when the message input unit 303 receives an input of a message from the server 100, the output control unit 304 controls to output the message from the speaker 35.

Further, the CPU 30 includes an order input unit 305 for receiving an order input and an order unit 306 for placing an order with respect to the server 100. The order input unit 305 receives an order input by voice input from the microphone 34. As an example, the order input unit 305 has a voice recognition function and performs voice input analysis. Then, the order input unit 305 specifies the order contents included in the voice and generates order information representing the order contents. The ordering unit 306 receives ordering information from the ordering input unit 305. Then, the ordering unit 306 transfers the ordering information to the server 100 via the network controller 38.

FIG. 9 is a block diagram showing an example of a functional configuration of the server 100 for performing the above operation. Each function of FIG. 9 is mainly realized by the CPU 10 when the CPU 10 of the server 100 reads a program stored in the ROM 11 onto the RAM 12 and executes it. However, some functions may be realized by other hardware (not shown) such as the hardware shown in FIG. 2 or an electric circuit.

Referring to FIG. 9, HDD 13 of server 100 stores order information storage unit 131 which is a storage area for storing the order information (list) of FIG. 6 and utterance information (list) of FIG. 7. And an utterance information storage unit 132 which is a storage area.

Still referring to FIG. 9, CPU 10 of server 100 includes an order input unit 101 for receiving input of order information from other devices such as refrigerator 300 and terminal device 500. The order input unit 101 includes a determination unit 108. The determination unit 108 determines whether or not the timing at which the order information is input is within a period during which an order can be accepted.

Further, the CPU 10 includes a management unit 102 for managing ordering. When the ordering information received by the order input unit 101 is within a period during which an order can be received, the management unit 102 registers information representing the order in the order information stored in the order information storage unit 131 To do.

Further, the CPU 10 places an ordering unit 103 for placing an order for a product with respect to the PC 700 which is a device for managing the ordering of the product, and product information input for receiving from the PC 700 information regarding the order status of the ordered product. Part 104. The ordering unit 103 orders the product by transferring the ordering information to the PC 700. Preferably, the management unit 102 registers the order record from the ordering unit 103 in the order information. In addition, the management unit 102 registers the scheduled shipping date included in the product information received by the product information input unit 104 in addition to the order information.

Further, the CPU 10 includes a generation unit 105 for generating a message based on the order information and generating utterance information which is information for outputting the message by voice. The generation unit 105 registers the generated message in the utterance information storage unit 132.

Further, the CPU 10 includes a detection unit 106 for detecting opening and closing of a door, which is an example of a user action involving contact with the refrigerator 300. As an example, the detection unit 106 detects that the door has been opened and closed by receiving a notification from the refrigerator 300 that the door has been opened and closed.

Further, the CPU 10 includes a transfer unit 107 for reading out the utterance information of the corresponding message from the utterance information storage unit 132 and transferring it to the refrigerator 300. When the detection unit 106 detects that the door of the refrigerator 300 has been opened and closed, the transfer unit 107 transfers the message registered in the utterance information stored in the utterance information storage unit 132 to the refrigerator 300. The message that has not been read is read and transferred to the refrigerator 300.

<Operation flow>
FIG. 10 is a flowchart showing an example of the operation flow of the refrigerator 300. The operation represented by the flowchart of FIG. 10 is realized by the CPU 30 of the refrigerator 300 reading out and executing the program stored in the ROM 31 on the RAM 32 and exhibiting the functions of FIG.

Referring to FIG. 10, CPU 30 of refrigerator 300 detects the opening / closing of the door based on the sensor signal input from sensor 37. When detecting that the door is opened and closed (YES in step S101), the CPU 30 notifies the server 100 (step S103).

When the CPU 30 receives an input of a message from the server 100 (YES in step S105), the CPU 30 outputs a message by voice from the speaker 35 (step S107).

When the CPU 30 receives an order input from the user by voice input to the microphone 34 (YES in step S109), the CPU 30 transfers the order information to the server 100 (step S111).

The CPU 30 repeats the above operation.
FIG. 11 is a flowchart showing an example of the operation flow of the server 100. The operation represented by the flowchart of FIG. 11 is realized by the CPU 10 of the server 100 reading out and executing the program stored in the ROM 11 on the RAM 12 and exhibiting the functions of FIG.

Referring to FIG. 11, when CPU 10 of server 100 receives an input of order information from refrigerator 300 or terminal device 500 (YES in step S201), CPU 10 determines whether the order is in a period during which the order can be received. To do. If the order of the product is a new order, the CPU 10 determines that the order is within a period that can be accepted. When the order of the product is an addition to the previously placed order, the CPU 10 determines whether or not the additional order is within an acceptable period. The period during which the additional order can be made is, for example, a period until the shipment of the commodity related to the order is completed.

When the received order is an order within a period during which the order can be received (YES in step S203), the CPU 10 executes a process for managing the received order (step S205). Specifically, in step S205, the CPU 10 registers information about the ordered product in the order information.

The CPU 10 transfers the ordering information to the PC 700, which is a device that manages the ordering of commodities (step S207). In addition, for the newly ordered product, the CPU 10 generates a message indicating that the order for the product has been accepted (step S209). And CPU10 transfers a message to the refrigerator 300 (step S211). Thereby, in the refrigerator 300, it is notified by voice that the server 100 has received the order at the timing when the order for the product is received.

When receiving input of product information from the PC 700 (NO in step S201, YES in step S213), the CPU 10 executes a process for managing the corresponding order (step S215). Specifically, in step S215, the CPU 10 updates the order information by adding the scheduled shipping date included in the product information to the order information.

CPU10 produces | generates the message which alert | reports the scheduled date of shipment of the said goods about applicable goods based on the updated order information (step S217). Then, the CPU 10 registers the generated message in the utterance information (step S219). Further, when the product information includes information for notifying completion of shipment, the CPU 10 sets the end of the period during which an additional order to the order can be accepted to the completion date of shipment (step S221).

When the opening / closing of the door of the refrigerator 300 is detected (NO in step S201, NO in step S213, YES in step S223), the CPU 10 checks whether there is a message that has not been transferred to the refrigerator 300 in the utterance information. (Step S225). Then, the CPU 10 extracts a message that has not been transferred to the refrigerator 300 and transfers the message to the refrigerator 300 (YES in step S225, step S227). In addition, the CPU 10 sets the end of a period during which an additional order to the order can be accepted as a shipment completion date (step S229).

<Effect of Embodiment>
By performing the above operation in the system according to the first embodiment, in this system, when the user is in the vicinity of the refrigerator 300, such as when the door of the refrigerator 300 is opened or closed, the product (food) ) Is notified by voice. Thereby, in this system, effective information can be realized to the user.

Furthermore, in this system, additional orders can be made for a predetermined period from the above notification. Thereby, a user's convenience can be improved significantly.

[Second Embodiment]
In the first embodiment, the notification is made by voice from the refrigerator 300. For this reason, it is considered effective for notification that the user is in the vicinity of the refrigerator 300. However, the notification is not limited to voice. For example, in the system according to the second embodiment, the notification is made by display on the touch panel 36. Since each device included in the system according to the second embodiment is the same as each device included in the system according to the first embodiment, description of hardware and the like will not be repeated.

In the system according to the second embodiment, the server 100 generates a message to be displayed on the refrigerator 300. Then, the server 100 transfers the message to the refrigerator 300 at the timing when the occurrence of a user action involving contact such as opening and closing of the door of the refrigerator 300 is detected. When receiving an input of a message from server 100, refrigerator 300 performs processing for displaying the message on touch panel 36. Thereby, also in the system according to the second embodiment, similar to the system according to the first embodiment, the user is displayed on the touch panel 36 when the user is in the vicinity of the refrigerator. Therefore, effective notification to the user can be realized.

Similarly, in the second embodiment, the refrigerator 300 may accept an additional order from the user via the touch panel 36. In this case as well, as in the system according to the first embodiment, the server 100 detects the opening / closing of the door of the refrigerator 300 and transfers a display message until the product is shipped. It is time to accept orders. Thereby, also in the system according to the second embodiment, the convenience of the user can be remarkably improved as in the system according to the first embodiment.

[Third Embodiment]
In the first embodiment and the second embodiment, the notification is made by the refrigerator 300. For this reason, it is considered effective for notification that the user is in the vicinity of the refrigerator 300. However, the notification is not limited to that by the refrigerator 300. For example, in the system according to the third embodiment, the notification is performed by the terminal device 500 that can communicate with the refrigerator 300. Since each device included in the system according to the third embodiment is also the same as each device included in the system according to the first embodiment, description of hardware and the like will not be repeated.

Steps S31 and S32 in FIG. 5 represent the operation of the system according to the third embodiment. That is, in the system according to the third embodiment, when the refrigerator 300 accepts the transfer of a message from the server 100 (step S18), the message is sent to the terminal device 500 that is in a communication range with the communication device 39. Is transferred (step S31). Then, the terminal device 500 that has received the message displays the message or outputs the message and notifies the user (step S32).

FIG. 12 is a block diagram showing an example of a functional configuration of the terminal device 500 for performing the above operation. Each function of FIG. 12 is mainly realized by the CPU 50 when the CPU 50 of the terminal device 500 reads the program stored in the ROM 51 onto the RAM 52 and executes it. However, some functions may be realized by other hardware (not shown) such as the hardware shown in FIG. 4 or an electric circuit.

Referring to FIG. 12, the CPU 50 of the terminal device 500 includes an order input unit 501 for receiving an order input and an ordering unit 502 for placing an order with respect to the server 100. The order input unit 501 receives an input of an order by touching the touch panel 53. The ordering unit 502 receives ordering information from the ordering input unit 501. Then, the ordering unit 502 transfers the ordering information to the server 100 via the network controller 54.

The CPU 50 includes a notification information input unit 503 for receiving an input of a message received by the communication device 55 from the communication device 39 of the refrigerator 300, and a display processing unit 504 for executing processing for displaying the touch panel 53. As an example, when the notification information input unit 503 receives an input of a message from the server 100, the display processing unit 504 executes a process for displaying the message on the touch panel 53.

In the system according to the third embodiment, the server 100 generates a message to be displayed on the terminal device 500. Then, the server 100 transfers the message to the refrigerator 300 at the timing when the occurrence of a user action involving contact such as opening and closing of the door of the refrigerator 300 is detected. When the refrigerator 300 receives an input of a message from the server 100, the refrigerator 300 transfers the message to the terminal device 500 that is within a range in which the communication device 39 can communicate. When terminal device 500 receives an input of a message from refrigerator 300, terminal device 500 displays the message on touch panel 53. Thereby, also in the system according to the third embodiment, as in the system according to the first embodiment, when the user is in the vicinity of the refrigerator, the display is performed on the touch panel 53 of the terminal device 500 carried by the user. Will be. Therefore, effective notification to the user can be realized.

[Fourth Embodiment]
In the above description, when opening / closing of the door is detected in the refrigerator 300, a message is transferred from the server 100 and notified. However, the message transfer from the server 100 to the refrigerator 300 may be performed at a predetermined timing such as a timing when the message is generated. Then, a message may be stored in the refrigerator 300, and when opening / closing of the door is detected, a notification based on an unoutput message may be performed. Since each device included in the system according to the fourth embodiment is also the same as each device included in the system according to the first embodiment, description of hardware and the like will not be repeated.

In this case, the server 100 may not include the detection unit 106. Then, when the message is generated, the transfer unit 107 transfers the message to the refrigerator 300 via the network controller 14. The RAM 32 of the refrigerator 300 includes the utterance information storage unit 132 (FIG. 9). And CPU30 of the refrigerator 300 will register into speech information, if a message is received from the server 100. FIG. When the detection unit 301 detects the opening / closing of the door, the output control unit 304 of the refrigerator performs control to extract an unoutput message from among messages registered in the utterance information and output the message through the speaker 35. Thereby, also in the system according to the fourth embodiment, the convenience of the user can be significantly improved as in the system according to the first embodiment.

[Fifth Embodiment]
Furthermore, it can also be provided as a program for causing the CPU 10 of the server 100 to execute the above-described operation. By providing such a program, a general-purpose PC can be operated as the server 100. Moreover, it can also provide as a program for making CPU50 of the terminal device 500 perform the above-mentioned operation | movement. By providing such a program, a general-purpose terminal device can be operated as the terminal device 500.

Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

Further, the program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

[Sixth Embodiment]
In the system according to the first embodiment (hereinafter, also referred to as “food management system”), as shown in FIG. 5, refrigerator 300 accepts an order addition from the user by voice input (order input after step S11). The received additional order is transmitted to the server 100 (step S15). The details of this process are as follows.

Refrigerator 300 accepts an additional order from the user on the condition that the speech recognition function determines that the user's utterance content is a predetermined word. For example, if the refrigerator 300 recognizes that the user's utterance content is the word “additional order”, the refrigerator 300 shifts to an operation mode for receiving the additional order. As described above, the refrigerator 300 uses the input (recognition) of a predetermined word as a trigger for the transition to the operation mode for accepting an additional order.

More specifically, when the user utters “additional order”, the refrigerator 300 utters “You accept additional orders. What will you order?”. The user can place an additional order by responding to the utterance of the refrigerator by voice.

In the above description, the configuration has been described in which the refrigerator 300 accepts an additional order based on the user uttering a predetermined word. However, the refrigerator 300 may be configured to inquire whether the user has an additional order. Good. For example, the refrigerator 300 may be configured to accept an additional order from the user when the user opens the door of the refrigerator 300 as a trigger.

[Seventh Embodiment]
After the user places an additional order (step S15 in FIG. 5), the server 100 needs to perform a settlement process based on an input process for settlement by the user. Examples of input processing for settlement include input processing by voice and input processing other than voice, such as a touch operation on the terminal device 500 or other communication device (not shown). Below, the process performed in the food management system (system provided with the server 100, the refrigerator 300, and the terminal device 500) when performing the voice input process as the input process for settlement will be described.

<Pre-registration of password>
When placing an order with the terminal device 500 (step S0 in FIG. 5), a secret word (keyword) is registered as a password using the terminal device 500. The secret word is transmitted to the server 100 by the terminal device 500 together with the ordering information. After that, when the user places an additional order for the order within the above-described predetermined period, the user speaks the password registered for the refrigerator 300, so that the server 100 performs a settlement process for the additional order. Done. Details of such processing will be described below.

FIG. 13 is a diagram illustrating an example of a screen 510 (user interface) displayed when the terminal device 500 receives an order (step S0 in FIG. 5). Referring to FIG. 13, terminal device 500 includes a menu display field 511, a settlement store selection field 512, a password selection field 513, and a plurality of selectable objects 514 to 517, and touch panel 53 (specifically, touch panel). Displayed on the display).

The menu display field 511 is used for the user to select a product to order. The menu display field 511 displays a plurality of product names. The menu display field 511 is used for accepting selection of displayed products. Specifically, the menu display column 511 includes a column for entering a product identification number, a product name, a unit price, a quantity, a total price (subtotal) for each product, and a total price for all products. Is displayed. Specifically, the menu display field 511 receives an input of a desired quantity regarding a product that the user desires to purchase.

In addition, when the object 515 is selected by the user, the terminal device 500 displays a menu display column (previous menu) on a page before the currently displayed menu display column 511. Further, when the object 516 is selected by the user, the terminal device 500 displays a menu display field (next menu) on a page after the menu display field 511 currently displayed.

The settlement store selection column 512 is used by the user to select a settlement store. The settlement store is typically an online mail order company.

The password selection field 513 is used for the user to input a password (password, keyword). For example, the terminal device 500 accepts an input of a password every time an order is placed (step S0 in FIG. 5).

The object 514 is used to cancel the input in the menu display field 511, the settlement store selection field 512, and the password selection field 513. Specifically, when the object 514 is selected by the user, the terminal device 500 deletes the quantity information in the menu display field 511. Further, the terminal device 500 sets the payment store in the payment store selection field 512 to a state in which no payment store is selected. Furthermore, the terminal device 500 sets the password selection field 513 as not described (blank).

The object 517 is used to determine information input by the user on the screen shown in FIG. When the object 517 is selected, the terminal device 500 switches the screen to be displayed from the screen 510 in FIG. 13 to the screen 520 (see FIG. 14) for placing an order.

FIG. 14 is a diagram showing an example of a screen 520 (user interface) displayed when placing an order (step S1 in FIG. 5) in the terminal device 500. Specifically, the screen 520 shown in FIG. 14 is a screen displayed after the object 517 of FIG. 13 is selected.

Referring to FIG. 14, the terminal device 500 displays a selected product display field 521, a settlement store display field 522, a password display field 523, and a plurality of

selectable objects

524 and 525 on a touch panel 53 (in detail, Display on the display constituting the touch panel).

The object 524 is used by the user when the user wants to change the content shown on the screen 520. When the user selects the object 524, the terminal device 500 switches the screen to be displayed from the screen 520 to the screen 510 shown in FIG.

The object 525 is used to place an order with the contents shown in the selected product display field 521 of the screen 520. When the user selects the object 525, the terminal device 500 transmits various types of information shown on the screen 520 to the server 100. Specifically, the terminal device 500 transmits the product selected by the user and the quantity of the product, information on the settlement store, and the password to the server 100 in association with each other. In other words, the terminal device 500 transmits information input by the user using the screen 510 illustrated in FIG.

Through the above processing, the order information (step S1 in FIG. 5) based on the user's order operation (step S0 in FIG. 5) is transmitted to the server 100 in a state where the password is associated. The server 100 typically stores order information based on the order information in a predetermined area of the HDD 13 including the password. In addition, as described above, the order information includes information on the product ordered by the user for each user associated with the refrigerator 300.

FIG. 15 shows an example of order information (list) including a password. Specifically, FIG. 15 is a diagram for explaining the order information stored in the server 100 instead of the order information shown in FIG. Referring to FIG. 15, server 100 associates with an order ID, which is information for identifying one order, at least for each ordered product, the date and time when the order was received, and the specified product ( Food) and keywords. Further, the server 100 orders the ordered product by transferring the order information to the PC 700 (step S3 in FIG. 5). The server 100 does not need to transmit the password.

Through the above processing, the password for the order using the terminal device 500 is registered in the server 100.

<Payment using password>
After making an additional order (order input after step S 11 in FIG. 5), the user utters the keyword pre-registered in the server 100 using the terminal device 500 to the refrigerator 300. Specifically, the user utters a keyword pre-registered in the server 100 with respect to the refrigerator 300 after performing voice input on the product and quantity to be added.

Refrigerator 300 recognizes the utterance content by voice recognition technology. The refrigerator 300 transmits the recognition result to the server 100.

The server 100 settles the additional order on the condition that the recognition result matches the keyword registered in the server 100 in advance. If the payment process itself is performed by a server other than the server 100, the server 100 may request the other server for the payment process.

By the above processing, the food management system can perform voice input processing using a password as input processing for settlement.

<Summary of this embodiment>
As described in the first embodiment, the food management system assumes (i) the presence of a user near the refrigerator 300 and (ii) a notification based on notification information at a timing based on the detection. (Iii) After notification, the food order input is accepted for a predetermined period.

The food management system according to the present embodiment has the following configuration in addition to the above configuration. First, the order input received within a predetermined period is an additional order input with respect to the order input made in the terminal device 500 before the notification. The terminal device 500 receives an input of a keyword at the time of order input performed before the notification, and transmits the received keyword to the server. The refrigerator 300 receives a keyword input by voice at the time of order input received within the predetermined period, and transmits the received keyword to the server 100. The server 100 notifies the PC 700 that manages food ordering of the order input received within the predetermined period on condition that the keyword received from the terminal device 500 matches the keyword received from the refrigerator 300. To do. According to such a system configuration, as described above, voice input processing can be performed using a password as input processing for settlement.

<Modification>
(1) In the above description, the configuration in which a password is registered for each order has been described as an example. However, the present invention is not limited to this. A password may be registered for each refrigerator 300, and the food management system may be configured so that it is not necessary to register the password again when placing an order. According to this configuration, the user does not need to register a password each time an order is placed. In this case, the server 100 needs to associate the refrigerator 300 with the password.

(2) In the above description, the configuration of accepting registration of keywords and the like using the terminal device 500 has been described as an example, but registration of keywords may be accepted using the touch panel 36 of the refrigerator 300.

(3) Instead of selecting a settlement store, a credit company that performs settlement from a plurality of credit companies may be selected.

[Eighth Embodiment]
In each of the above-described embodiments, the configuration in which the refrigerator 300 having the voice recognition function executes various processes based on the result of the voice recognition has been described as an example. However, the refrigerator 300 does not necessarily have a voice recognition function.

The server 100 may be equipped with a voice recognition function, and the server 100 may perform voice recognition processing instead of the refrigerator 300. Specifically, the refrigerator 300 uploads audio data of audio input to the microphone 34 of the refrigerator 300 to the server 100. Server 100 performs voice recognition processing on the voice data uploaded from refrigerator 300. Hereinafter, an example of a functional configuration of the refrigerator 300 and the server 100 having such a configuration will be described.

FIG. 16 is a block diagram illustrating an example of a functional configuration of the refrigerator 300 according to the present embodiment. Refrigerator 300 according to the present embodiment includes CPU 30 A instead of CPU 30. Each function of FIG. 16 is mainly realized by the CPU 30 A when the CPU 30 A of the refrigerator 300 reads out and executes the program stored in the ROM 31 on the RAM 32. However, some functions may be realized by other hardware (not shown) such as the hardware shown in FIG. 3 or an electric circuit.

Referring to FIG. 16, the CPU 30A includes a detection unit 301, a notification unit 302, a message input unit 303, an output control unit 304, a voice input unit 308, and a voice transmission unit 309. As described above, the CPU 30A is different from the CPU 30 (see FIG. 8) in that the voice input unit 308 and the voice transmission unit 309 are provided instead of the order input unit 305 and the ordering unit 306.

The voice input unit 308 receives voice (analog data) collected by the microphone 34 and converts it into digital data (hereinafter also referred to as “voice data”). The voice input unit 308 sends the voice data to the voice transmission unit 309.

The voice transmission unit 309 transfers the voice data received from the voice input unit 308 to the server 100 via the network controller 38. Thereby, the server 100 can receive the audio data based on the user's utterance content from the refrigerator 300.

FIG. 17 is a block diagram illustrating an example of a functional configuration of the server 100 according to the present embodiment. Server 100 according to the present embodiment includes CPU 10 A instead of CPU 10.

17 is implemented mainly by the CPU 10A when the CPU 10A of the server 100 reads out and executes the program stored in the ROM 11 on the RAM 12. However, some functions may be realized by other hardware (not shown) such as the hardware shown in FIG. 2 or an electric circuit.

Referring to FIG. 17, the CPU 10 A includes a management unit 102, an ordering unit 103, a product information input unit 104, a generation unit 105, a detection unit 106, a transfer unit 107, and a voice reception unit 109. The voice receiving unit 109 includes a voice recognition unit 1091 and an order determination unit 1092. As described above, the CPU 10A is different from the CPU 10 (see FIG. 9) in that the voice receiving unit 109 is provided instead of the order input unit 101.

The voice receiving unit 109 receives voice data from the refrigerator 300 via the network controller 14. Specifically, the voice recognition unit 1091 of the voice reception unit 109 performs voice recognition processing on the voice data received from the refrigerator 300.

Also, the order determination unit 1092 of the voice receiving unit 109 determines the order content (ordering information) from the voice recognition result of the voice recognition unit 1091. The order determination unit 1092 sends the determined order details to the management unit 102.

Note that each of the refrigerator 300 and the server 100 may perform voice recognition processing. In this case, based on the recognition result of the voice recognition performed first among the refrigerator 300 and the server 100, the refrigerator 300 performs various processes such as voice response and transition to an operation mode for accepting additional orders. Just do it. According to such a structure, the process in the refrigerator 300 can be accelerated.

[Summary]
One aspect of the present disclosure can be expressed as follows.

(1)
A server (server 100) and a refrigerator (refrigerator 300) communicable with the server are included, and the server includes storage means (speech information storage unit 132) for storing notification information in the refrigerator. A detection means (sensor 37, detection units 106, 301) for detecting the presence of a user in the vicinity of the refrigerator, including a device (speaker 35) and an input device (microphone 34, touch panel 36), and detection by the detection means A notification control means (output control unit 304) for performing notification by the notification device based on the notification information at a timing based on the notification information, and for receiving a food order input from the input device for a predetermined period after the notification. A food management system further comprising: an input means (order input unit 305).

(2)
(1) The food management system according to (1), wherein the detection unit detects the presence of a user in the vicinity of the refrigerator by detecting occurrence of a user action involving contact with the refrigerator.

(3)
The detection means is the food management system according to (2), which detects opening and closing of a refrigerator door as a user action for the refrigerator.

(4)
The information management system according to any one of (1) to (3), wherein the notification device has a voice output function, and the notification includes notification performed by voice.

(5)
The food management system according to any one of (1) to (4), wherein the input device has a voice input function, and food order input includes voice input.

(6)
The notification device can communicate with a terminal device (terminal device 500) within a predetermined range, and the notification includes transferring the notification information to the terminal device within the predetermined range. The food management system according to any one of (5).

(7)
The input device is communicable with a terminal device within a predetermined range, and the food order input includes receiving the input of order information from the terminal device within the predetermined range. The food management system according to any one of 6).

(8)
The server transfers the communication order (network controller 14) for communicating with the device (PC 700) for managing food orders and the food order input received by the input device to the device for managing food orders. And an ordering means (ordering unit 103) for ordering food, and the storage means inputs information about the order status of food ordered by the ordering means, which is input from a device that manages food ordering. And the notification information includes information on the order status of the food ordered by the ordering means, according to any one of (1) to (7).

(9)
The food management system according to (8), wherein the predetermined period is a period until shipment of food ordered before the notification is completed.

(10)
A terminal device (500) communicable with the server, wherein the order input received within the predetermined period is an additional order input for the order input made in the terminal device before the notification; The apparatus accepts an input of a keyword at the time of order entry made before the notification, transmits the accepted keyword to the server, and the refrigerator accepts an order entry received within the predetermined period. The keyword input is received by voice, the received keyword is transmitted to the server, and the server is stipulated on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator. The food management system according to any one of (1) to (5), wherein an order input received within a period is notified to a device that manages food orders.

(11)
It is a refrigerator (refrigerator 300) that can communicate with the server (server 100), and detection means (sensor 37, detection unit 301) for detecting the presence of a user near the refrigerator, and notification information acquired from the server, Notification means (speaker 35, output control unit 304) for notification at timing based on detection by the detection means, input means (order input unit 305) for receiving food order input after notification, input means A refrigerator comprising ordering means (ordering unit 306) for ordering food by transferring the ordering information received in step 1 to a server.

(12)
The detection unit according to (11), wherein the detection unit detects the presence of a user near the refrigerator by detecting occurrence of a user action involving contact with the refrigerator.

(13)
The notification according to (11) or (12), wherein the notification by the notification means includes notification performed by voice.

(14)
The refrigerator according to any one of (10) to (13), wherein the order input by the input means includes an input by voice.

(15)
The communication device (communication device 39) for communicating with the terminal device within the predetermined range is further provided, and the notification by the notification device includes transferring the notification information to the terminal device within the predetermined range, (11) The refrigerator according to any one of (14) to (14).

(16)
Communication means (communication device 39) for communicating with a terminal device within a predetermined range is further provided, and the order input by the input means includes receiving input of order information from the terminal device within the predetermined range. The refrigerator according to any one of 11) to (15).

(17)
(11) to (16), further comprising notification means (notification unit 302) for notifying the server of the detection by the detection means, wherein the notification means notifies the notification information transferred from the server in response to the notification. The refrigerator in any one.

(18)
The information processing apparatus further includes an acquisition unit (message input unit 303) for acquiring notification information from the server at a predetermined timing, and a storage unit (RAM 32) for storing the notification information. The refrigerator according to any one of (11) to (16), wherein the notification information is read from the storage unit and notified at a timing based on the detection.

(19)
The food order input by the input means is an additional order input for the order input made in the terminal device (500) before the notification, and the input means uses the keyword in the order input received after the notification. The refrigerator according to any one of (11) to (14), further comprising: a transmission unit that receives the input of the voice signal and transmits the received keyword to the server.

(20)
A server communicable with the refrigerator (refrigerator 300), a storage means (speech information storage unit 132) for storing notification information in the refrigerator, and a detection means (detection) for detecting the presence of a user near the refrigerator Unit 106), transfer means (transfer unit 107) for reading out the notification information from the storage means and transferring it to the refrigerator at a timing based on detection by the detection means, and from the refrigerator for a predetermined period after the transfer. A server comprising input means (order input unit 101) for receiving an input of food order.

(21)
By transferring the communication order (network controller 14) for communicating with the device for managing food orders (PC700) and the food order input received by the input means to the device for managing food orders Ordering means (ordering unit 103) for ordering food is further provided, and the storage means further stores information about the order status of food ordered by the ordering means, which is input from a device that manages food ordering. The server according to (20), wherein the notification information includes information related to an order status of food ordered by the ordering unit.

(22)
The server according to (21), wherein the predetermined period is a period until shipping of the food ordered before the transfer is completed.

(23)
The server is communicable with the terminal device (500), and the order input received within the predetermined period is an additional order input with respect to the order input made in the terminal device before the transfer, The server receives from the terminal device a keyword accepted by the terminal device at the time of order entry performed before the transfer, and receives a keyword from the refrigerator at the time of order entry received within the predetermined period. Receives the keyword received by voice, and inputs the order input received within the predetermined period on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator. The server according to any one of (20) to (22), which notifies a device that manages an order.

(24)
A terminal device (terminal device 500) communicable with a refrigerator (refrigerator 300) within a predetermined range, wherein input means (order input unit 501) for receiving food order input and information indicating the order input are stored in the refrigerator Transfer means (transfer unit 502) for transferring to the receiving device, acquisition means for acquiring notification information input from the refrigerator (notification information input unit 503), and display means for performing display based on the notification information (display processing) Unit 504).

(25)
A control program for a server (server 100) that can communicate with a refrigerator (refrigerator 300), the server having a memory (speech information storage unit 132) for storing notification information in the refrigerator, and the control program is a server The step of detecting the presence of a user near the refrigerator (S223), the step of reading out the notification information from the memory and transferring it to the refrigerator at a timing based on the detection (S227), and a predetermined period after the transfer, The control program which performs the step (S229, S201) which receives the input of food order from a refrigerator.

(26)
A control program for a terminal device (PC 700) communicable with a refrigerator (refrigerator 300) within a predetermined range, the control program receiving a food order input to the terminal device (S0), and information representing the order input The control program which performs the step (S1) which transfers information to a refrigerator, the step (S31) which acquires the input of alerting | reporting information from a refrigerator, and the step (S32) which performs the display based on alerting | reporting information

The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

10, 30, 50 CPU, 11, 31, 51 ROM, 12, 32, 52 RAM, 13 HDD, 14, 38, 54 Network controller, 33 drive mechanism, 34 microphone, 35 speaker, 36, 53 touch panel, 37 sensor, 39, 55 communication device, 100 server, 101 order input unit, 102 management unit, 103, 306, 502 ordering unit, 104 product information input unit, 105 generation unit, 106, 301 detection unit, 107 transfer unit, 108 determination unit, 131 order information storage unit, 132 utterance information storage unit, 300 refrigerator, 302 notification unit, 303 message input unit, 304 output control unit, 305, 501 order input unit, 500 terminal device, 503 notification information input unit, 504 display processing unit 700 PC.

Claims

Server,
A refrigerator capable of communicating with the server,
The server includes storage means for storing notification information in the refrigerator,
The refrigerator includes a notification device and an input device,
Detecting means for detecting the presence of a user in the vicinity of the refrigerator;
Notification control means for causing notification by the notification device based on the notification information at a timing based on detection by the detection means;
A food management system, further comprising an input unit for receiving a food order input from the input device for a predetermined period after the notification.
The food management system according to claim 1, wherein the detection means detects the presence of a user in the vicinity of the refrigerator by detecting occurrence of a user action involving contact with the refrigerator.
The food management system according to claim 2, wherein the detection means detects opening / closing of the refrigerator door as a user action for the refrigerator.
The notification device has a voice output function,
The food management system according to any one of claims 1 to 3, wherein the notification includes notification performed by voice.
The input device has a voice input function,
The food management system according to any one of claims 1 to 4, wherein the food order input includes voice input.
The notification device can communicate with a terminal device within a predetermined range,
The food management system according to any one of claims 1 to 5, wherein the notification includes the notification device transferring the notification information to the terminal device within the predetermined range.
The input device can communicate with a terminal device within a predetermined range,
7. The food management system according to claim 1, wherein the food order input includes receiving an input of order information from the terminal device within the predetermined range.
The server includes communication means for communicating with a device for managing food orders;
Order input means for ordering the food by transferring the order input of the food received by the input device to a device for managing the order of the food,
The storage means further stores information about the order status of the food ordered by the ordering means, which is input from an apparatus that manages the ordering of the food,
The food management system according to any one of claims 1 to 7, wherein the notification information includes information related to an order status of food ordered by the ordering unit.
The food management system according to claim 8, wherein the predetermined period is a period until shipment of food ordered before the notification is completed.
A terminal device capable of communicating with the server;
The order input received within the predetermined period is an additional order input with respect to the order input made in the terminal device before the notification,
The terminal device
When entering an order placed before the notification, accept keyword input,
Sending the accepted keyword to the server;
The refrigerator is
When inputting an order received within the predetermined period, keyword input is received by voice,
Sending the accepted keyword to the server;
The server manages an order for food on the basis of an order input received within the predetermined period on condition that the keyword received from the terminal device matches the keyword received from the refrigerator. The food management system according to any of claims 1 to 5, wherein
A refrigerator capable of communicating with a server,
Detection means for detecting the presence of a user near the refrigerator;
Notification means for notifying the notification information acquired from the server at a timing based on detection by the detection means;
After the notification, input means for accepting food order input;
A refrigerator comprising: ordering means for ordering the food by transferring the ordering information received by the input means to the server.
The refrigerator according to claim 11, wherein the detection means detects the presence of a user in the vicinity of the refrigerator by detecting occurrence of a user action accompanied by contact with the refrigerator.
The refrigerator according to claim 11 or 12, wherein the notification by the notification means includes notification performed by voice.
The refrigerator according to any one of claims 11 to 13, wherein the order input by the input means includes input by voice.
A communication means for communicating with a terminal device within a predetermined range;
The refrigerator according to any one of claims 11 to 14, wherein the notification by the notification means includes transferring the notification information to the terminal device within the predetermined range.
A communication means for communicating with a terminal device within a predetermined range;
The refrigerator according to any one of claims 11 to 15, wherein the order input by the input means includes receiving input of order information from the terminal device within the predetermined range.
A notification means for notifying the server of the detection by the detection means;
The refrigerator according to any one of claims 11 to 16, wherein the notification unit notifies the notification information transferred from the server in response to the notification.
Acquisition means for acquiring the notification information from the server at a predetermined timing;
Storage means for storing the notification information,
The refrigerator according to any one of claims 11 to 16, wherein the notification means reads out and notifies the notification information from the storage means at a timing based on detection by the detection means.
The food order input by the input means is an additional order input for the order input made in the terminal device before the notification,
The input means receives an input of a keyword by voice at the time of order input received after the notification,
The refrigerator according to any one of claims 11 to 14, further comprising transmission means for transmitting the accepted keyword to the server.
A server capable of communicating with the refrigerator,
Storage means for storing notification information in the refrigerator;
Detecting means for detecting the presence of a user in the vicinity of the refrigerator;
Transfer means for reading out the notification information from the storage means and transferring it to the refrigerator at a timing based on detection by the detection means;
A server comprising input means for receiving an input of food order from the refrigerator for a predetermined period after the transfer.
A communication means for communicating with a device for managing food orders;
Ordering means for ordering the food by transferring the food order input received by the input means to a device that manages the ordering of the food, further comprising:
The storage means further stores information about the order status of the food ordered by the ordering means, which is input from an apparatus that manages the ordering of the food,
The server according to claim 20, wherein the notification information includes information related to an order status of food ordered by the ordering unit.
The server according to claim 21, wherein the predetermined period is a period until shipment of food ordered before the transfer is completed.
The server is capable of communicating with a terminal device;
The order input received within the predetermined period is an additional order input for the order input made at the terminal device before the transfer,
The server
From the terminal device, the keyword received by the terminal device at the time of order entry made before the transfer is received,
From the refrigerator, at the time of order input received within the predetermined period, the keyword received by the refrigerator by voice is received,
Notifying the order input received within the predetermined period to the device that manages food orders, on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator; The server according to any one of claims 20 to 22.
A terminal device capable of communicating with a refrigerator within a predetermined range,
Input means for accepting food order inputs;
Transfer means for transferring information representing the order input to the refrigerator;
Acquisition means for acquiring input of notification information from the refrigerator;
A terminal device comprising display means for performing display based on the notification information.
A server control program capable of communicating with a refrigerator,
The server has a memory for storing notification information in the refrigerator,
The control program is stored in the server.
Detecting the presence of a user near the refrigerator;
Reading the notification information from the memory and transferring it to the refrigerator at a timing based on the detection;
The control program which performs the step which receives the input of food order from the said refrigerator for the period prescribed | regulated previously after the said transfer.
A control program for a terminal device capable of communicating with a refrigerator within a predetermined range,
The control program is stored in the terminal device.
Receiving a food order input;
Transferring information representing the order entry to the refrigerator;
Obtaining notification information input from the refrigerator;
A control program for executing a display based on the notification information.