CN106796671B

CN106796671B - Food management system, refrigerator, server, and recording medium

Info

Publication number: CN106796671B
Application number: CN201580055220.7A
Authority: CN
Inventors: 福田吉洋; 胁善久
Original assignee: Sharp Corp
Current assignee: Sharp Corp
Priority date: 2014-12-01
Filing date: 2015-11-24
Publication date: 2021-01-12
Anticipated expiration: 2035-11-24
Also published as: CN106796671A; JP6302567B2; WO2016088597A1; JPWO2016088597A1

Abstract

In the food management system, the server detects the presence of a user near the refrigerator (S8). The server generates a message based on the order from the user and registers to the storage, reads the message from the storage at a timing based on the detection (S9), and transmits to the refrigerator (S10). Then, the server receives an input of ordering of the food items from the refrigerator for a predetermined period after the transmission of the message (S13 to S15). Thus, a food management system including a refrigerator that effectively reports information to a user can be provided.

Description

Food management system, refrigerator, server, and recording medium

Technical Field

The present disclosure relates to a food management system, a refrigerator, a server, a terminal device, and a control program, and particularly to a food management system including a refrigerator having a report function for reporting to a user, the refrigerator, a server, a terminal device, and a control program included in the system.

Background

Some refrigerators have a function of managing food items and the like in the refrigerator and reporting information on food items such as food item stock information and accident information. For example, japanese patent application laid-open No. 2006-139551 (hereinafter, patent document 1) discloses a refrigerator that outputs information of foods in the refrigerator by display or sound.

In the refrigerator having the reporting function as in patent document 1, information is usually reported at a timing when a report is required. This enables timely reporting to the user.

Prior art documents

Patent document

Patent document 1: japanese patent laid-open publication No. 2006-139551

Disclosure of Invention

Problems to be solved by the invention

However, even if information is reported by a display device or a speaker mounted on the refrigerator main body, the information cannot be transmitted to the user when the user is not near the refrigerator. In other words, there are cases where effective reporting to the user cannot be achieved depending on the timing of the reporting.

Accordingly, it is an object of the present disclosure to provide a food management system including a refrigerator having a reporting function, i.e., a refrigerator that effectively reports information to a user. Further, it is an object of the present disclosure to provide a refrigerator having a reporting function, that is, a refrigerator that effectively reports information to a user. Further, it is an object of the present disclosure to provide a server included in a food management system including a refrigerator having a reporting function, that is, a refrigerator that effectively reports information to a user. Another object of the present disclosure is to provide a terminal device capable of communicating with a refrigerator having a reporting function, that is, a refrigerator that effectively reports information to a user. Another object of the present disclosure is to provide a control program for a terminal device that can communicate with a refrigerator having a reporting function, that is, a refrigerator that effectively reports information to a user.

Means for solving the problem

According to the present embodiment, a food management system includes: a server, and a refrigerator capable of communicating with the server. The server includes a storage unit for storing the report information in the refrigerator. The refrigerator includes a reporting device and an input device. The food management system further includes: a detection unit for detecting the presence of a user near the refrigerator; a report control unit configured to perform a report by the reporting apparatus based on the report information at a timing based on the detection by the detection unit; and an input unit for receiving a food ordering input from the input device for a predetermined period after the report.

Preferably, the detection unit detects the presence of the user in the vicinity of the refrigerator by detecting the occurrence of the user action accompanying the contact against the refrigerator.

More preferably, the detection unit detects opening and closing of a door of the refrigerator as a user action with respect to the refrigerator.

Preferably, the reporting means has a sound output function. The report includes a report by sound.

Preferably, the input device has a voice input function. Ordering input for the food product comprises voice-based input.

Preferably, the reporting device is capable of communicating with terminal devices within a prescribed range. The report includes a report device transmitting report information to terminal devices within a predetermined range.

Preferably, the input device is capable of communicating with terminal devices within a prescribed range. The ordering input of the food includes an input device receiving ordering information from a terminal device within a predetermined range.

Preferably, the server further includes: a communication unit for communicating with a device for managing ordering of food; and an ordering unit for ordering the food items by transmitting an ordering input of the food items accepted by the input device to a device for managing ordering of the food items. The storage unit further stores information related to the order acceptance status of the food ordered by the ordering unit, which is input from the device for managing ordering of the food. The report information includes information on the acceptance and ordering status of the food ordered by the ordering unit.

More preferably, the predetermined period is a period from when the end of shipment of the previously ordered food item is reported.

More preferably, the food management system further includes a terminal device capable of communicating with the server. The order input accepted within the predetermined period is an additional order input to the order input made in the terminal device before the report. The terminal device accepts input of a keyword when a user places an order before reporting. The terminal device transmits the received keyword to the server. The refrigerator receives a keyword input by voice when receiving a menu input within a predetermined period. The refrigerator transmits the accepted keyword to the server. The server notifies the device that manages the placing of the food item of a placing input received within a predetermined period of time on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

According to other embodiments, the refrigerator is capable of communicating with the server. The refrigerator is provided with: a detection unit for detecting the presence of a user in the vicinity of the refrigerator; a reporting unit configured to report the report information acquired from the server at a timing based on the detection by the detecting unit; an input unit for accepting an order input of the food after the report; and an ordering unit for ordering the food by transmitting the ordering information accepted by the input unit to the server.

Preferably, the report by the reporting unit comprises a report by sound.

Preferably, the ordering input by the input unit comprises a voice-based input.

Preferably, the refrigerator further includes a communication unit for communicating with a terminal device within a predetermined range. The reporting by the reporting means includes transmitting report information to terminal apparatuses within a predetermined range.

Preferably, the refrigerator further includes a communication unit for communicating with a terminal device within a predetermined range. The order input by the input means includes an input for receiving order information from a terminal device within a predetermined range.

Preferably, the refrigerator further includes a notification unit for notifying the server of the detection by the detection unit. The reporting unit reports the report information transmitted from the server according to the notification.

Preferably, the refrigerator further includes: an acquisition unit configured to acquire report information from a server at a predetermined timing; and a storage unit for storing the report information. The reporting unit reads the report information from the storage unit and reports it at a timing based on the detection by the detecting unit.

More preferably, the ordering input of the food based on the input unit is an additional ordering input with respect to the ordering input made in the terminal device before the report. The input unit receives an input of a keyword by voice at the time of a receipt input received after the report. The refrigerator further includes a transmission unit that transmits the received keyword to the server.

According to other embodiments, the server is capable of communicating with the refrigerator. The server is provided with: a storage unit for storing report information in the refrigerator; a detection unit for detecting the presence of a user near the refrigerator; a transmission unit for reading the report information from the storage unit and transmitting to the refrigerator at a timing based on the detection by the detection unit; and an input unit for receiving an input of ordering of the food from the refrigerator for a predetermined period after the transmission.

Preferably, the server further includes: a communication unit for communicating with a device for managing ordering of food; and an ordering unit for ordering the food items by transmitting an ordering input of the food items accepted by the input unit to the device for managing ordering of the food items. The storage unit further stores information related to the order acceptance status of the food ordered by the ordering unit, which is input from the device for managing ordering of the food. The report information includes information on the acceptance and ordering status of the food ordered by the ordering unit.

More preferably, the predetermined period is a period from the end of shipment of the ordered food items before the transfer.

More preferably, the server is capable of communicating with the terminal device. The order input accepted within a predetermined period is an additional order input to the order input performed in the terminal device before transmission. The server receives, from the terminal apparatus, a keyword accepted by the terminal apparatus at the time of a next order input performed before transmission. The server receives a keyword received by voice from the refrigerator when the server receives a placing input received within a predetermined period from the refrigerator, and notifies the device for managing placing of food items of the placing input received within the predetermined period on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

According to other embodiments, the terminal device is capable of communicating with refrigerators within a prescribed range. The terminal device includes: the input unit is used for receiving ordering input of food; a transmission unit for transmitting information indicating ordering input to the refrigerator; an acquisition unit for acquiring input of report information from the refrigerator; and a display unit for performing display based on the report information.

According to another embodiment, the control program is a control program of a server capable of communicating with the refrigerator. The server has a memory for storing the report information in the refrigerator. The control program causes the server to execute the steps of: detecting the presence of a user in the vicinity of the refrigerator; reading the report information from the memory and transmitting it to the refrigerator at the timing based on the detection; and a step of accepting an input of ordering of the food from the refrigerator for a predetermined period after the transfer.

According to another embodiment, the control program is a control program of a terminal device that can communicate with a refrigerator within a predetermined range. The control program causes the terminal device to execute the steps of: receiving ordering input of food; transmitting information indicating the order input to the refrigerator; a step of acquiring an input of report information from the refrigerator; and a step of performing display based on the report information.

Effect of invention

According to the present disclosure, information can be efficiently reported to a user.

Drawings

Fig. 1 is a diagram showing a specific example of a configuration of a system including a refrigerator according to an embodiment (hereinafter, also simply referred to as a system).

Fig. 2 is a block diagram showing an example of the device configuration of a server included in the system.

Fig. 3 is a block diagram showing an example of the apparatus configuration of the refrigerator included in the system.

Fig. 4 is a block diagram showing an example of the device configuration of a terminal device included in the system.

Fig. 5 is a diagram for explaining an outline of the operation of the present system.

Fig. 6 is a diagram showing an example of the order information (list).

Fig. 7 is a diagram showing an example of the sound emission information (list).

Fig. 8 is a block diagram showing an example of a functional configuration of the refrigerator.

Fig. 9 is a block diagram showing an example of a functional configuration of the server.

Fig. 10 is a flowchart showing an example of the flow of the operation of the refrigerator.

Fig. 11 is a flowchart showing an example of the flow of the server operation.

Fig. 12 is a block diagram showing an example of a functional configuration of the upper terminal apparatus.

Fig. 13 is a diagram showing an example of a screen displayed when an order is accepted in the terminal device.

Fig. 14 is a diagram showing an example of a screen displayed when an order is made in the terminal device.

Fig. 15 is a diagram showing an example of order information including a password.

Fig. 16 is a block diagram showing an example of a functional configuration of the refrigerator.

Fig. 17 is a block diagram showing an example of the functional configuration of the server 100.

Detailed Description

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same components and constituent elements are denoted by the same reference numerals. The names and functions of these are also the same. Therefore, the description of these is not repeated.

[ embodiment 1 ]

< System configuration >

Fig. 1 is a diagram showing a specific example of a configuration of a system including a refrigerator according to the present embodiment (hereinafter, also simply referred to as a system). Referring to fig. 1, the present system comprises: a server 100, a refrigerator 300, and a terminal apparatus 500. These are connected via a network such as the internet or a dedicated line, and can communicate with each other. The server 100 may be constituted by 1 server. Further, a plurality of servers may be combined to realize the functions of the server 100 as a whole.

Preferably, the present system can be further connected to a PC (personal computer) 700. The PC700 is a PC possessed by the food sales service. The PC700 may be constituted by 1 PC. Further, a plurality of PCs may be combined to realize the functions of the PC700 as a whole.

The touch panel 36 is disposed on, for example, the front face of the door of the refrigerator 300. Further, a microphone 34 and a speaker 35 are disposed on, for example, the front face of the door of the refrigerator 300. Thereby, the refrigerator 300 can report information to the user by display and/or sound. Further, the refrigerator 300 can accept information input from a user by touch or sound.

The refrigerator 300 has a plurality of doors. The refrigerator includes a sensor 37 for detecting opening and closing of at least one door among the plurality of doors.

Preferably, the refrigerator 300 and the terminal device 500 include

communication devices

39 and 55, respectively, which are capable of direct communication. The communication of the refrigerator 300 with the terminal apparatus 500 is wireless communication. Communication between refrigerator 300 and terminal device 500 is short-range wireless communication such as Bluetooth (registered trademark).

< apparatus construction >

Fig. 2 is a block diagram showing an example of the device configuration of the server 100. The server 100 may be a general PC. Accordingly, fig. 2 shows a general PC configuration.

Specifically, referring to fig. 2, the server 100 includes a CPU (Central Processing Unit) 10 for controlling the entire apparatus. Further, the server 100 includes: a ROM (Read Only Memory) 11 for storing programs executed by the CPU10, a RAM (Random Access Memory) 12 as a work area when the programs are executed by the CPU10, and an HDD (Hard Disk Drive) 13 for storing various data. Further, the server 100 includes a network controller 14. The network controller 14 controls communication with other devices via a network.

Fig. 3 is a block diagram showing an example of the apparatus configuration of the refrigerator 300. Referring to fig. 3, the refrigerator 300 includes a CPU30 for controlling the entire apparatus. Further, the refrigerator 300 includes: a ROM31 for storing programs executed by the CPU30, and a RAM32 for serving as a work area when the programs are executed by the CPU30 or storing various data.

Further, the refrigerator 300 includes a driving mechanism 33. The driving mechanism 33 is, for example, a motor for driving a compressor, a motor for driving a fan, or the like. The CPU30 controls the driving of the driving mechanism 33.

Further, the refrigerator 300 includes: a microphone 34, a speaker 35, and a touch panel 36. The CPU30 controls the sound output from the speaker 35 and the display at the touch panel 36. Further, the CPU30 accepts sound input from the microphone 34 and input from the touch panel 36.

Further, the refrigerator 300 includes a sensor 37. The sensor 37 detects at least opening and closing of one door. The sensor 37 inputs a sensor signal indicating opening and closing of the door to the CPU 30.

Further, the refrigerator 300 includes a network controller 38 and a communication device 39. The network controller 38 controls communication with other devices via a network. The communication device 39 performs wireless communication with the communication device 55 mounted on the terminal device 500.

Fig. 4 is a block diagram showing an example of the device configuration of the terminal device 500. The terminal device 500 is a terminal device called a smartphone or the like, for example. Fig. 4 exemplifies only a part related to the operation in the present system among the device configurations of the terminal device 500. Therefore, the terminal device 500 may include a configuration other than the configuration shown in fig. 4.

Referring to fig. 4, the terminal apparatus 500 includes a CPU50 for controlling the entire apparatus. Further, the terminal device 500 includes: a ROM51 for storing programs executed by the CPU50, a RAM52 for serving as a work area when the programs are executed by the CPU50, or storing various data.

Further, the terminal device 500 includes a touch panel 53. The CPU50 controls display at the touch panel 53. Further, the CPU30 accepts input from the touch panel 53.

Further, the terminal apparatus 500 includes a network controller 54 and a communication apparatus 55. The network controller 54 controls communication with other devices via a network. Communication device 55 performs wireless communication with communication device 39 mounted on refrigerator 300.

< summary of actions >

Fig. 5 is a diagram for explaining an outline of the operation of the present system. Referring to fig. 5, the server 100 accepts ordering of goods (food) from the user (step S0). The example of fig. 5 is an example of the operation for ordering performed by the user with respect to the terminal apparatus 500. Upon receiving the ordering operation from the user, the terminal device 500 transmits order placing information indicating the ordered content to the server 100 (step S1), thereby placing an order for the specified product (food).

The user can also operate the refrigerator 300 to order goods. For example, the user may also enter an order by touching the touch panel 36. Alternatively, the user may enter the order through voice input to microphone 34. Refrigerator 300 that has received the user operation places an order for a specified product by transmitting order information indicating the ordered content to server 100.

Server 100 that has received the input of the order placing information from terminal apparatus 500 executes processing for order acceptance (step S2). In step S2, the server 100 performs processing for registering order information in a predetermined area of the HDD13, for example. The order information is information in the form of, for example, a list in which information on the items ordered by the user is described for each user who establishes an association with the refrigerator.

Fig. 6 is a diagram showing an example of the order information (list). Referring to fig. 6, as an example, server 100 registers the date and time when the order was received and the designated product (food) for each ordered product in association with order id (identification) which is information for identifying 1 order.

The server 100 places an order for the ordered goods by transmitting the order information to the PC700 (step S3). In the case where there are a plurality of PCs 700 as ordering targets, the server 100 registers a PC corresponding to each commodity in advance, and transmits ordering information to the corresponding PC700 through step S3.

Preferably, if the server 100 transmits order placing information to the PC700 through step S3, the subscription information of fig. 6 is updated. That is, referring to fig. 6, the server 100 adds, to the order information, a placing status indicating whether or not placing of the order has been performed on the PC700 in step S3 described above.

The PC700 that has accepted the order placing information from the server 100 executes processing for the order (step S4). The process here is not limited to a specific process. For example, PC700 may display the product that has received the order on a display (not shown) in order to report to the person in charge of purchase. For example, the PC700 may receive an input of a date scheduled for shipment from the purchaser. The PC700 transmits the predicted date of shipment or other information about the product, which is input or acquired from another device, to the server 100 as product information (step S5).

The server 100 that has accepted the commodity information from the PC700 executes processing for managing the order (step S6). In step S6, the server 100 performs a process of adding information based on the commodity information from the PC700 to the order information and registering the order information, for example. Referring to fig. 6, server 100 registers the order information with the scheduled shipment date included in the commodity information from PC 700.

Further, the server 100 generates information for the refrigerator 300 to report the commodity information to the user. As one example, the refrigerator 300 reports (sounds) to the user from the speaker 35 by sound. Therefore, the server 100 performs the following processing: based on the order information, a message output from the refrigerator 300 is generated (step S7) and registered as sound emission information to a predefined area of the HDD 13. The sound information is information in the form of, for example, a list in which messages are recorded for each user who establishes association with the refrigerator.

Fig. 7 is a diagram showing an example of the sound emission information (list). Referring to fig. 7, as an example, server 100 generates a message reporting acceptance of an order of a product for each ordered product, a message reporting a scheduled date of delivery of the product (product group) included in the order for each 1 order, and a message reporting contents thereof on a scheduled delivery day, and registers the generated messages in sound emission information.

As an example, when receiving an order for a product, the server 100 generates a message reporting that the order for the product is received, and registers the message with the utterance information. Further, as an example, when receiving the product information from PC700, server 100 generates a message reporting a scheduled date of delivery based on a scheduled date of delivery included in the product information, and registers the message in the utterance information. In addition, as an example, when a certain order arrives at a scheduled date of shipment registered in the order information of fig. 6, the server 100 generates a message reporting that this day is the scheduled date of shipment, and registers the message in the utterance information.

When the message is generated and registered in the utterance information in fig. 7, the server 100 waits until the report timing. The timing of the report is the timing at which the server 100 detects the presence of the user near the refrigerator 300. The presence of a user in the vicinity of the refrigerator 300 is detected by, for example, detecting the occurrence of a user action accompanying contact with the refrigerator 300. As an example, the user action accompanying the contact for the refrigerator 300 is opening and closing of a door of the refrigerator 300. The user action may be a touch on the touch panel 36 of the refrigerator 300. The presence of the user in the vicinity of refrigerator 300 may be detected by a human detection sensor (not shown), voice input from microphone 34, image analysis based on a photographed image of a camera (not shown) mounted on refrigerator 300, fingerprint authentication, or the like.

When refrigerator 300 detects the opening and closing of the door by sensor 37, server 100 is notified of the presence of the user operation (step S8). The server 100 detects the generation of the above-described user action for the refrigerator 300 by receiving the notification from the refrigerator 300. As another example, server 100 may monitor power consumption from refrigerator 300 to determine ON/OFF of the interior lighting, and when there is no notification from refrigerator 300, server 100 may detect the occurrence of the user action described above with respect to refrigerator 300.

If the generation of the above-described user action with respect to refrigerator 300 is detected, server 100 extracts a message that has not been transmitted to refrigerator 300 among the messages registered to the sound emission information of fig. 7 (step S9). Then, the server 100 transmits the message to the refrigerator 300 (step S10).

The refrigerator 300 that has received the information of the above message outputs (emits) a sound from the speaker 35 based on the information (step S11). Thereby, the sound is output at the timing when the user is in the vicinity. As a result, effective reporting is achieved for the user.

If the server 100 transmits a message to the refrigerator 300 through the above-described step S10, a process for managing a report in the refrigerator 300 is performed (step S12). In step S12, server 100 adds information indicating the presence or absence of a report in refrigerator 300 to the sound information, for example. That is, referring to fig. 7, server 100 adds to the sound information a report status indicating whether or not a message was transmitted to refrigerator 300 in step S10. By adding this information to the utterance information, server 100 can extract a message that has not been transmitted to refrigerator 300 at the time when occurrence of the user action is detected in step S9.

When the server 100 transmits a message to the refrigerator 300 in step S10, a period for which the message is related to accept input of an additional order for the order is set (step S13). Preferably, the period is a predetermined period after the transmission of the message. The predetermined period may be a period registered in the server 100 in advance. As an example, the predetermined period is a period until the order information is registered on a predetermined date of shipment. When the server 100 receives the input of the commodity information indicating that the shipment of the ordered commodity is completed from the PC700 (step S20), the predetermined period is more preferably a period until the commodity is shipped.

The user who hears the report based on the sound from the refrigerator 300 may forget the order or want the addition of the order. The server 100 accepts orders for goods (food) from such users. The example of fig. 5 is an operation for ordering by the user through a sound input to the refrigerator 300. When the refrigerator 300 receives the voice input from the user, the order information indicating the ordered contents is transmitted to the server 100 (step S14), and the order of the specified product (food) is placed.

Server 100, having received the input of order placing information from refrigerator 300, executes processing for managing additional orders (step S15). In step S15, if the order placing information is inputted within the period set in step S13, the server 100 adds the accepted order to the order related to the message transmitted to the refrigerator 300 in step S10. Then, the server 100 additionally orders the ordered product by transmitting the order information to the PC700 as the addition of the order (step S16).

The PC700 that has received the order placing information from the server 100 executes the process for ordering (step S4') in the same manner as the step S4 described above. Then, the PC700 transmits the commodity information to the server 100 in the same manner as in step S5 '(step S5'). The server 100 that has received the commodity information generates a message reporting that the order was received, and registers the message in the sound information (step S17). Then, the server 100 transmits the generated message to the refrigerator 300 (step S18).

The refrigerator 300 that has received the information of the above message outputs (emits) a sound from the speaker 35 based on the information (step S19). Thus, the sound is output at a timing when the user makes an additional order near the refrigerator 300. As a result, effective reporting is achieved for the user.

< functional constitution >

Fig. 8 is a block diagram showing an example of a functional configuration of the refrigerator 300 for performing the above-described operation. The functions of fig. 8 are mainly realized by the CPU30 by reading a program stored in the ROM31 onto the RAM32 by the CPU30 of the refrigerator 300 and executing the program. However, a part of the functions may be realized by other hardware (not shown) such as hardware or an electric circuit shown in fig. 3.

Referring to fig. 8, the CPU30 of the refrigerator 300 includes a detection section 301 and a notification section 302. The detection section 301 detects the opening and closing of the door based on the sensor signal from the sensor 37. The notification unit 302 notifies the server 100 that the door is opened or closed.

Further, the CPU30 includes: a message input unit 303 for receiving input of a message from the server 100, and an output control unit 304 for controlling output by the speaker 35. For example, the output control unit 304 controls the message input unit 303 to output a message from the speaker 35 when receiving an input of the message from the server 100.

Further, the CPU30 includes: a placing input section 305 for accepting an input for placing an order, and a placing section 306 for placing an order for the server 100. The order input unit 305 accepts an input for ordering based on the sound input from the microphone 34. For example, the order entry unit 305 has a voice recognition function and performs input analysis by voice. The order input unit 305 specifies the order content included in the sound and generates order information indicating the order content. The order entry unit 306 receives order entry information from the order entry unit 305. Also, the ordering unit 306 transmits ordering information to the server 100 via the network controller 38.

Fig. 9 is a block diagram showing an example of a functional configuration of the server 100 for performing the above-described operation. Each function of fig. 9 is mainly realized by the CPU10 by reading a program stored in the ROM11 onto the RAM12 and executing the program by the CPU10 of the server 100. However, a part of the functions may be realized by other hardware (not shown) such as hardware shown in fig. 2 or an electric circuit.

Referring to fig. 9, the HDD13 of the server 100 includes: an order information storage part 131 as a storage area for storing the order information (list) of fig. 6, and a sound information storage part 132 as a storage area for storing the sound information (list) of fig. 7.

Further, referring to fig. 9, CPU10 of server 100 includes order input unit 101 for accepting input of order placement information from another device such as refrigerator 300 or terminal device 500. The order input unit 101 includes a determination unit 108. The determination unit 108 determines whether or not the timing at which the order placing information is input is within the order receivable period.

The CPU10 includes a management unit 102 for managing orders. When the order placing information received by the order input unit 101 is within the order receivable period, the management unit 102 registers information indicating the order with the order information stored in the order information storage unit 131.

Further, the CPU10 includes: the order issuing device comprises an order issuing unit 103 for issuing an order for a product to a PC700, which is a device for managing orders of products, and a product information input unit 104 for receiving input of information on the acceptance and ordering status of the ordered product from the PC 700. The ordering unit 103 orders the product by transmitting ordering information to the PC 700. Preferably, the management section 102 registers the record of the order placement made by the order placement section 103 to the order information. Further, the management unit 102 additionally registers the scheduled date of shipment included in the product information received by the product information input unit 104 in the order information.

Further, CPU10 includes generation unit 105, and generation unit 105 generates a message based on the order information and generates sound emission information, which is information for outputting the message by sound. The generation unit 105 registers the generated message in the utterance information storage unit 132.

CPU10 includes detection unit 106 for detecting opening/closing of a door, which is an example of a user operation involving contact with refrigerator 300, detection unit 106. As an example, detection unit 106 receives a notification of the presence of a door from refrigerator 300, and thereby detects the presence of the door.

Further, the CPU10 includes a transmission section 107 for reading the sound information of the corresponding message from the sound information storage section 132 and transmitting it to the refrigerator 300. When detecting portion 106 detects that there is an open/close of the door of refrigerator 300, transmitting portion 107 reads a message not transmitted to refrigerator 300 among messages registered in the spoken information stored in spoken information storage portion 132, and transmits the message to refrigerator 300.

< operation flow >

Fig. 10 is a flowchart showing an example of the flow of the operation of the refrigerator 300. The operations shown in the flowchart of fig. 10 are realized by the CPU30 of the refrigerator 300 reading and executing a program stored in the ROM31 on the RAM32, and performing the functions of fig. 8.

Referring to fig. 10, the CPU30 of the refrigerator 300 detects the opening and closing of the door according to a sensor signal input from the sensor 37. If the door is detected to be opened and closed (yes in step S101), the CPU30 notifies the server 100 (step S103).

When the CPU30 receives an input of a message from the server 100 (yes in step S105), the message is output from the speaker 35 by voice (step S107).

When the CPU30 accepts an input of order from the user by voice input to the microphone 34 (yes in step S109), it transmits order placing information to the server 100 (step S111).

The CPU30 repeats the above operations.

Fig. 11 is a flowchart showing an example of the flow of the operation of the server 100. The operations shown in the flowchart of fig. 11 are realized by the CPU10 of the server 100 reading and executing a program stored in the ROM11 on the RAM12, and performing the functions of fig. 9.

Referring to fig. 11, when CPU10 of server 100 receives an input of order placing information from refrigerator 300 or terminal device 500 (yes in step S201), it determines whether or not the order is an order within an acceptable period of the order. In the case where the order of the article is a new order, the CPU10 determines that the order is within the acceptable period. When the order of the product is added to the order made before, the CPU10 determines whether the order is within an acceptable period. The period during which additional ordering is possible is, for example, a period until the shipment of the product related to the ordering is completed.

If the accepted order is an order within the period in which the order can be accepted (yes in step S203), the CPU10 executes processing for managing the accepted order (step S205). Specifically, in step S205, the CPU10 registers the information of the ordered commodity in the order information.

The CPU10 outputs the order information to the PC700 that is the device managing the order of the product (step S207). Further, the CPU10 generates a message indicating acceptance of the order of the newly ordered product (step S209). Then, the CPU10 transmits a message to the refrigerator 300 (step S211). Thus, in refrigerator 300, at the timing when the order of the product is received, it is reported by voice that server 100 receives the order.

When the input of the product information is received from the PC700 (no in step S201, yes in step S213), the CPU10 executes a process for managing the corresponding order (step S215). Specifically, in step S215, the CPU10 adds the scheduled shipment date included in the commodity information to the order information to update the order information.

The CPU10 generates a message for the commodity, which reports the predetermined date of shipment of the commodity, based on the updated order information (step S217). Then, the CPU10 registers the generated message to the utterance information (step S219). When the commodity information includes information notifying the end of shipment, the CPU10 sets the end of the period during which the additional order to the order is acceptable as the end date of shipment (step S221).

If the opening and closing of the door of refrigerator 300 is detected (no in step S201, no in step S213, yes in step S223), CPU10 confirms whether or not there is a message that is not transmitted to refrigerator 300 among the sound emission information (step S225). Then, the CPU10 extracts a message that has not been transmitted to the refrigerator 300, and transmits it to the refrigerator 300 (yes in step S225, step S227). Further, the CPU10 sets the end of the period in which the additional order to the order can be accepted as the end date of shipment (step S229).

< effects of the embodiment >

By performing the above operations with the system according to embodiment 1, in the present system, when the user is in the vicinity of the refrigerator 300, such as when the door of the refrigerator 300 is opened or closed, information relating to the order of a product (food) is reported by voice. This enables the system to realize effective reporting for the user.

Further, in the present system, additional subscription can be performed for a predetermined period from the report. Therefore, the convenience of the user can be greatly improved.

[ 2 nd embodiment ]

In embodiment 1, the report is made by sound from the refrigerator 300. Therefore, it is considered that it is effective for the report that the user exists in the vicinity of the refrigerator 300. However, the report is not limited to being based on sound. For example, in the system according to embodiment 2, the report is based on the display on the touch panel 36. Since each device included in the system according to embodiment 2 is the same as each device included in the system according to embodiment 1, description of hardware and the like will not be repeated.

In the system according to embodiment 2, the server 100 generates a message for display in the refrigerator 300. Then, at a timing when the occurrence of a user action accompanied by contact such as opening and closing of the door of refrigerator 300 is detected, server 100 transmits the above-described message to refrigerator 300. When refrigerator 300 receives an input of a message from server 100, a process of displaying the message on touch panel 36 is performed. As a result, in the system according to embodiment 2, as in the system according to embodiment 1, the user is displayed on the touch panel 36 when the user is in the vicinity of the refrigerator. Therefore, efficient reporting can be achieved for the user.

Similarly, in embodiment 2, refrigerator 300 may receive an additional order from the user through touch panel 36. In this case, as in the system according to embodiment 1, the server 100 sets the timing at which additional ordering is acceptable until the end of shipment of the product after detecting the opening/closing of the door of the refrigerator 300 and transmitting a message for display. As a result, the system according to embodiment 2 can greatly improve the convenience for the user, as with the system according to embodiment 1.

[ embodiment 3 ]

In embodiment 1 and embodiment 2, the report is made by the refrigerator 300. Therefore, it is considered that it is effective for the report that the user exists in the vicinity of the refrigerator 300. However, the report is not limited to the refrigerator 300. For example, in the system according to embodiment 3, the report is made by the terminal device 500 that can communicate with the refrigerator 300. Since each device included in the system according to embodiment 3 is also the same as each device included in the system according to embodiment 1, description of hardware and the like will not be repeated.

Steps S31 and S32 in fig. 5 show the operation of the system according to embodiment 3. That is, in the system according to embodiment 3, when refrigerator 300 receives the transmission of the message from server 100 (step S18), the message is transmitted to terminal device 500 in a range in which communication can be performed by communication device 39 (step S31). Then, the terminal device 500 that received the message displays or outputs the message in voice to notify the user (step S32).

Fig. 12 is a block diagram showing an example of a functional configuration of the terminal device 500 for performing the above-described operation. The functions of fig. 12 are mainly implemented by the CPU50, which reads and executes a program stored in the ROM51 onto the RAM52 by the CPU50 of the terminal apparatus 500. However, a part of the functions may be realized by other hardware (not shown) such as hardware or an electric circuit shown in fig. 4.

Referring to fig. 12, CPU50 of terminal apparatus 500 includes: a placing order input section 501 for accepting input of placing an order, and a placing section 502 for placing an order for the server 100. The order input unit 501 accepts an input of an order based on a touch on the touch panel 53. The order entry unit 502 receives order entry information from the order entry unit 501. Then, the ordering section 502 transmits ordering information to the server 100 via the network controller 54.

The CPU50 includes: a report information input section 503 for accepting input of a message received by the communication device 55 from the communication device 39 of the refrigerator 300, and a display processing section 504 for executing processing for display of the touch panel 53. For example, when the report information input unit 503 receives an input of a message from the server 100, the display processing unit 504 executes processing for displaying the message on the touch panel 53.

In the system according to embodiment 3, the server 100 generates a message for displaying the terminal device 500. Then, server 100 transmits the message to refrigerator 300 at a timing when the occurrence of a user motion accompanied by contact, such as the opening and closing of the door of refrigerator 300, is detected. When receiving an input of a message from server 100, refrigerator 300 transmits the message to terminal device 500 in a range where communication can be performed by communication device 39. When receiving an input of a message from refrigerator 300, terminal device 500 displays the message on touch panel 53. As a result, in the system according to embodiment 3 as well, as in the system according to embodiment 1, when the user is in the vicinity of the refrigerator, the display is performed on the touch panel 53 of the terminal device 500 carried by the user. Therefore, effective reporting can be achieved for the user.

[ 4 th embodiment ]

In the above description, when the refrigerator 300 detects the opening and closing of the door, a message is transmitted from the server 100 and reported. However, the message may be transmitted from server 100 to refrigerator 300 at a predetermined timing such as the timing of generating the message. Further, if the refrigerator 300 stores a message and detects opening and closing of the door, a report based on the message not output may be performed. Since each device included in the system according to embodiment 4 is also the same as each device included in the system according to embodiment 1, description of hardware and the like will not be repeated.

In this case, the server 100 may not include the detection unit 106. When the message is generated, the transmission unit 107 transmits the message to the refrigerator 300 via the network controller 14. RAM32 of refrigerator 300 includes sound information storage unit 132 (fig. 9) described above. When CPU30 of refrigerator 300 receives a message from server 100, it registers the message with the utterance information. When the detection unit 301 detects opening and closing of the door, the output control unit 304 of the refrigerator extracts a message not output from the messages registered in the sound emission information and controls the output of the message through the speaker 35. As a result, the system according to embodiment 4 can greatly improve the convenience of the user, as with the system according to embodiment 1.

[ 5 th embodiment ]

Further, the program may be provided to cause the CPU10 of the server 100 to execute the above-described operation. By providing such a program, a general-purpose PC can be operated as the server 100. The program may be provided to cause the CPU50 of the terminal device 500 to execute the above-described operations. By providing such a program, a general-purpose terminal device can be operated as the terminal device 500.

Such a program can also be provided as a program product by being recorded on a computer-readable recording medium such as a flexible Disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a Memory card attached to a computer. Alternatively, the program may be provided by being recorded on a recording medium such as a hard disk incorporated in the computer. Further, the program can also be provided by downloading via a network.

The program according to the present invention may be a program for calling and executing modules necessary for a call at a predetermined timing in a predetermined arrangement among program modules provided as a part of an Operating System (OS) of a computer. In this case, the program itself does not include the above-described module and executes processing in cooperation with the OS. Such a program not including a module can be included in the program according to the present invention.

The program according to the present invention may be provided by being embedded in a part of another program. In this case, the program itself does not include the module included in the other program, and executes the processing in cooperation with the other program. The program embedded in another program can be included in the program according to the present invention.

The supplied program product is installed in a program storage unit such as a hard disk and executed. Additionally, the program product includes: the program itself and a recording medium on which the program is recorded.

[ 6 th embodiment ]

In the system according to embodiment 1 (hereinafter, also referred to as "food management system"), as shown in fig. 5, refrigerator 300 accepts an order addition from the user by voice input (order input after step S11), and transmits the accepted order addition to server 100 (step S15). The details of this processing will be described below.

Refrigerator 300 accepts an additional order from the user on condition that the voice recognition function determines that the content of the utterance of the user is a predetermined term. For example, if it is recognized that the user's utterance is "order addition", refrigerator 300 shifts to an operation mode for accepting order addition. In this way, refrigerator 300 sets a prescribed term as input (recognized) as a trigger to shift to an operation mode of accepting an additional order.

In more detail, when the user says "order addition", the refrigerator 300 performs "learning order addition". What is subscribed to? "sound production. The user can make an additional order by responding to the sound of the refrigerator by voice.

In the above description, the refrigerator 300 accepts the additional order based on the user uttering a predetermined term, but the refrigerator 300 may be configured to inquire of the user whether the additional order is present or not. For example, the refrigerator 300 may be configured to receive an additional order to the user by triggering the user to open the door of the refrigerator 300.

[ 7 th embodiment ]

After the user has made the additional order (step S15 of fig. 5), the server 100 needs to perform settlement processing based on input processing for settlement performed by the user. As input processing for settlement, for example: input processing by voice, input processing other than voice such as touch operation to the terminal device 500 or other communication devices not shown. Hereinafter, a process executed in the food management system (system including the server 100, the refrigerator 300, and the terminal device 500) will be described in a case where an input process by voice is performed as an input process for settlement.

< Pre-registration of password >

When the terminal device 500 makes an order (step S0 in fig. 5), the terminal device 500 is used to register a password (keyword) as a password. The password is transmitted together with the order placing information from the terminal device 500 to the server 100. When an additional order for the order is made within the predetermined period, the user speaks the password registered in refrigerator 300 to perform a settlement process for the additional order in server 100. Hereinafter, such a process will be described in detail.

Fig. 13 is a diagram showing an example of a screen 510 (user interface) displayed when the terminal device 500 accepts an order (step S0 in fig. 5). Referring to fig. 13, the terminal device 500 displays a menu display field 511, a settlement store selection field 512, a password selection field 513, and a plurality of selectable objects 514 to 517 on the touch panel 53 (specifically, a display constituting the touch panel).

The menu display field 511 is used for the user to select the ordered goods. The menu display field 511 displays a plurality of product names. The menu display field 511 is used to accept selection of a displayed product. Specifically, the menu display field 511 displays: a column for inputting an identification number of a product, a product name, a unit price, a number, a total amount (subtotal) for each product, and a total amount of all products. Specifically, the menu display field 511 receives an input of a desired number of items that the user desires to purchase.

When the user selects the object 515, the terminal device 500 displays a menu display field (previous menu) one page before the currently displayed menu display field 511. When the user selects the object 516, the terminal device 500 displays a menu display field (next menu) next to the currently displayed menu display field 511.

The settlement store selection field 512 is used for a user to select a settlement store. The settlement store is typically a network online shopping company.

The password selection field 513 is used for the user to enter a password (password, keyword). As an example, the terminal apparatus 500 accepts input of a password every time a subscription (step S0 of fig. 5) is made.

The object 514 is used to cancel the input of the menu display field 511, the settlement store selection field 512, and the password selection field 513. Specifically, when the user selects the object 514, the terminal device 500 deletes the information on the number of menu display fields 511. In the settlement store selection field 512, the terminal device 500 is in a state in which the settlement store is not selected. Further, the terminal device 500 sets the password selection field 513 to be not described (blank field).

The object 517 is used to make the user determine the input information in the screen shown in fig. 13. When object 517 is selected, terminal device 500 switches the screen to be displayed from screen 510 in fig. 13 to screen 520 for ordering (see fig. 14).

Fig. 14 is a diagram showing an example of a screen 520 (user interface) displayed when an order is placed in the terminal device 500 (step S1 in fig. 5). Specifically, the screen 520 shown in fig. 14 is a screen displayed after the object 517 in fig. 13 is selected.

Referring to fig. 14, the terminal device 500 displays a selected product display field 521, a settlement store display field 522, a password display field 523, and a plurality of

selectable objects

524 and 525 on the touch panel 53 (specifically, a display constituting the touch panel).

The object 524 is used by the user when the user desires to change the content shown on the screen 520. When the user selects object 524, terminal apparatus 500 switches the screen to be displayed from screen 520 to screen 510 shown in fig. 13.

The object 525 is used to order the content shown in the selected item display field 521 of the screen 520. When the user selects object 525, terminal device 500 transmits various information shown in screen 520 to server 100. Specifically, the terminal device 500 associates the product selected by the user with the number of products, information on the settlement store, and the password, and transmits the associated information to the server 100. In other words, terminal device 500 transmits information input by the user using screen 510 shown in fig. 13 to server 100.

Through the above process, the order placing information (step S1 of fig. 5) based on the user' S ordering operation (step S0 of fig. 5) is transmitted to the server 100 in a state in which the association with the password is established. Typically, the server 100 stores order information based on the order information in a state including the password in a predetermined area of the HDD 13. As described above, the order information includes information on the product ordered by the user for each user associated with refrigerator 300.

Fig. 15 is a diagram showing an example of order information (list) including a password. Specifically, fig. 15 is a diagram for explaining the subscription information stored in the server 100, instead of the subscription information shown in fig. 6. Referring to fig. 15, server 100 associates an order ID, which is information for identifying 1-time order, and registers, for each ordered product, at least the date and time when the order was accepted, the specified product (food), and a keyword. Further, the server 100 places an order for the ordered goods by transmitting the order placing information to the PC700 (step S3 of fig. 5). In addition, the server 100 does not need to transmit the password.

Through the above processing, the password for the order using the terminal apparatus 500 is registered in the server 100.

< settlement Using password >

After the user makes an additional order (order input after step S11 in fig. 5), the user speaks a keyword to be registered in advance in the server 100 using the terminal device 500 to the refrigerator 300. Specifically, after the user inputs the product and the number to be added by voice input, the user speaks a keyword registered in advance in server 100 to refrigerator 300.

The refrigerator 300 recognizes the sound-uttered contents by a voice recognition technique. The refrigerator 300 transmits the recognition result to the server 100.

The server 100 performs settlement of the order added on condition that the recognition result matches the keyword registered in advance in the server 100. In the case where the settlement processing itself is configured by a server other than the server 100, the server 100 may request the settlement processing to the other server.

Through the above processing, in the food management system, as the input processing for settlement, the input processing by voice can be performed using the password.

< summary of the present embodiment >

As a premise, the food management system (i) detects the presence of a user in the vicinity of the refrigerator 300, (ii) makes a report based on report information at a timing based on the detection, and (iii) receives an order input of food for a predetermined period after the report, as described in embodiment 1 and the like.

The food management system according to the present embodiment further includes the following configuration in the above configuration. First, the order input accepted within a predetermined period is an additional order input to the order input performed in the terminal device 500 before the report. The terminal device 500 receives the input of the keyword at the time of placing an order prior to the report, and transmits the received keyword to the server. Refrigerator 300 receives an input of a keyword by voice at the time of receipt input received within the predetermined period, and transmits the received keyword to server 100. Server 100 notifies PC700, which manages the placing of food items, of the placing input received within the predetermined period on the condition that the keyword received from terminal device 500 matches the keyword received from refrigerator 300. According to such a system configuration, as described above, as the input processing for settlement, it is possible to perform the input processing by voice using the password.

< modification example >

(1) In the above, the configuration in which the password is registered for each order has been described as an example, but the present invention is not limited thereto. The food management system may be configured to register a password for each refrigerator 300, and re-registration of the password may not be required at the time of ordering. According to this configuration, the user does not need to register a password every order. In this case, the server 100 needs to associate the refrigerator 300 with the password.

(2) In the above, the configuration in which the terminal device 500 is used to receive registration of a keyword or the like has been described as an example, but the touch panel 36 of the refrigerator 300 may be used to receive registration of a keyword.

(3) Instead of selecting a settlement store, a credit company that performs settlement may be selected from a plurality of credit companies.

[ 8 th embodiment ]

In each of the above embodiments, the configuration in which refrigerator 300 having the voice recognition function executes various processes based on the result of voice recognition has been described as an example. However, the refrigerator 300 does not necessarily have a voice recognition function.

The server 100 may be equipped with a voice recognition function, and the server 100 may perform voice recognition processing instead of the refrigerator 300. Specifically, the refrigerator 300 uploads sound data of sound input to the microphone 34 of the refrigerator 300 to the server 100. The server 100 performs a voice recognition process on the voice data uploaded from the refrigerator 300. An example of the functional configurations of the refrigerator 300 and the server 100 having such a configuration will be described below.

Fig. 16 is a block diagram showing an example of a functional configuration of the refrigerator 300 according to the present embodiment. The refrigerator 300 according to the present embodiment includes a CPU30A instead of the CPU 30. Further, the respective functions of fig. 16 are mainly realized by the CPU30A by the CPU30A of the refrigerator 300 reading and executing a program stored in the ROM31 onto the RAM 32. However, a part of the functions may be realized by other hardware (not shown) such as hardware and an electric circuit shown in fig. 3.

Referring to fig. 16, CPU30A includes: a detection unit 301, a notification unit 302, a message input unit 303, an output control unit 304, a voice input unit 308, and a voice transmission unit 309. Thus, the CPU30A is different from the CPU30 (see fig. 8) in that it includes the audio input unit 308 and the audio transmission unit 309 instead of the drop sheet input unit 305 and the drop sheet unit 306.

The voice input unit 308 receives voice (analog data) collected by the microphone 34 and converts the voice into digital data (hereinafter, also referred to as "voice data"). The audio input unit 308 sends the audio data to the audio transmission unit 309.

The audio transmitter 309 transmits the audio data received from the audio input unit 308 to the server 100 via the network controller 38. Thereby, the server 100 can receive sound data based on the utterance content of the user from the refrigerator 300.

Fig. 17 is a block diagram showing an example of a functional configuration of the server 100 according to the present embodiment. The server 100 according to the present embodiment includes a CPU10A instead of the CPU 10.

Each function of fig. 17 can be realized mainly by the CPU10A by the CPU10A of the server 100 reading a program stored in the ROM11 onto the RAM12 and executing it. However, a part of the functions may be realized by other hardware (not shown) such as hardware shown in fig. 2 or an electric circuit.

Referring to fig. 17, the CPU10A includes: a management unit 102, a ordering unit 103, a product information input unit 104, a generation unit 105, a detection unit 106, a transmission unit 107, and a sound reception unit 109. The voice receiver 109 includes a voice recognizer 1091 and an order determiner 1092. Thus, the CPU10A differs from the CPU10 (see fig. 9) in that it includes the sound receiving unit 109 instead of the order input unit 101.

The sound receiving unit 109 receives sound data from the refrigerator 300 via the network controller 14. In detail, the voice recognition unit 1091 of the voice receiving unit 109 performs voice recognition processing on the voice data received from the refrigerator 300.

The order determination unit 1092 of the audio receiving unit 109 determines the order content (order placing information) based on the audio recognition result of the audio recognition unit 1091. The order determination unit 1092 sends the determined order content to the management unit 102.

Further, refrigerator 300 and server 100 may perform the voice recognition processing separately. In this case, based on the recognition result of the voice recognition performed in advance in refrigerator 300 and server 100, refrigerator 300 may execute various processes such as a voice response and a transition to an operation mode for accepting an additional order. With this configuration, the process in the refrigerator 300 can be performed earlier.

[ conclusion ]

One aspect of the present disclosure can be expressed as follows.

(1)

A food management system is provided with: a server (server 100); and a refrigerator (refrigerator 300) capable of communicating with the server, the server including a storage unit (sound information storage unit 132) for storing report information in the refrigerator, the refrigerator including a report device (speaker 35) and an input device (microphone 34, touch panel 36), the food management system further including: a detection unit (sensor 37, detection section 106, 301) for detecting the presence of a user in the vicinity of the refrigerator; report control means (output control unit 304) for performing a report by the reporting apparatus based on the report information at a timing based on the detection performed by the detection means; and an input unit (ordering input unit 305) for receiving an ordering input of the food items by the input device for a predetermined period after the report.

(2)

According to the food management system described in (1), the detection unit detects the presence of the user near the refrigerator by detecting the occurrence of the user action accompanying the contact with the refrigerator.

(3)

According to the food management system described in (2), the detection means detects opening and closing of the door of the refrigerator as a user operation for the refrigerator.

(4)

According to the food management system of any one of (1) to (3), the reporting means has a voice output function, and the report includes a report by voice.

(5)

The food management system according to any one of (1) to (4), wherein the input device has a voice input function, and the ordering input of the food includes a voice-based input.

(6)

According to the food management system of any one of (1) to (5), the reporting device can communicate with the terminal device (terminal device 500) within the predetermined range, and the report includes the transmission of the report information by the reporting device to the terminal device within the predetermined range.

(7)

According to the food management system of any one of (1) to (6), the input device can communicate with a terminal device within a predetermined range, and the ordering input of the food includes an input of ordering information received by the input device from the terminal device within the predetermined range.

(8)

The food management system according to any one of (1) to (7), wherein the server further includes: a communication unit (network controller 14) for communicating with a device (PC700) for managing ordering of foods; and an ordering unit (ordering unit 103) for ordering the food items by transferring an ordering input of the food items accepted by the input device to the device for managing ordering of the food items, wherein the storage unit further stores information on an order acceptance and ordering status of the food items ordered by the ordering unit, the information being input from the device for managing ordering of the food items, and the report information includes information on the order acceptance and ordering status of the food items ordered by the ordering unit.

(9)

The food management system according to (8), wherein the predetermined period is a period until shipment of the ordered food item is completed before the report.

(10)

The food management system according to any one of (1) to (5), further comprising a terminal device (500) capable of communicating with the server, the order input accepted in the predetermined period is an additional order input to the order input made in the terminal device before the report, and the terminal device, when making the order input made before the report, receiving an input of a keyword, transmitting the received keyword to a server, receiving a placing input received by the refrigerator within the predetermined period, the server receives an input of a keyword by voice, transmits the received keyword to the server, and notifies an apparatus for managing food ordering of an order accepted in a predetermined period of time on the condition that the keyword received from the terminal apparatus matches the keyword received from the refrigerator.

(11)

A refrigerator (refrigerator 300) capable of communicating with a server (server 100), the refrigerator comprising: a detection unit (sensor 37, detection section 301) for detecting the presence of a user in the vicinity of the refrigerator; a reporting unit (speaker 35, output control unit 304) for reporting the report information acquired from the server at a timing based on the detection by the detection unit; an input unit (order input section 305) for accepting order input of food after the report; and an ordering unit (ordering part 306) for ordering the food by transmitting the ordering information accepted by the input unit to the server.

(12)

According to the refrigerator described in (11), the detection unit detects the presence of the user in the vicinity of the refrigerator by detecting the occurrence of the user action accompanying the contact with the refrigerator.

(13)

The refrigerator according to (11) or (12), wherein the report by the report unit includes a report by sound.

(14)

The refrigerator according to any one of (10) to (13), wherein the order placing input by the input unit includes a sound-based input.

(15)

The refrigerator according to any one of (11) to (14), further comprising a communication unit (communication device 39) for communicating with a terminal device within a predetermined range, wherein the report by the report unit includes transmission of report information to the terminal device within the predetermined range.

(16)

The refrigerator according to any one of (11) to (15), further comprising a communication means (communication device 39) for communicating with a terminal device within a predetermined range, wherein the order placing input by the input means includes an input of receiving order placing information from the terminal device within the predetermined range.

(17)

The refrigerator according to any one of (11) to (16) further includes a notification unit (notification unit 302) for notifying the server of the detection by the detection unit, and the notification unit notifies the server of the report information transmitted from the server in accordance with the notification.

(18)

The refrigerator according to any one of (11) to (16), further comprising: an acquisition unit (message input unit 303) for acquiring report information from a server at a predetermined timing; and a storage unit (RAM32) for storing report information, the report unit reading the report information from the storage unit and reporting at a timing based on the detection by the detection unit.

(19)

The refrigerator according to any one of (11) to (14), wherein the food order input by the input means is an additional order input to an order input performed by the terminal device (500) before the report, the input means accepts an input of a keyword by voice at the order input accepted after the report, and the refrigerator further comprises a transmission means for transmitting the accepted keyword to the server.

(20)

A server capable of communicating with a refrigerator (refrigerator 300) is provided with: a storage unit (sound information storage section 132) for storing the report information in the ice box; a detection unit (detection section 106) for detecting the presence of a user in the vicinity of the refrigerator; a transmission unit (transmission section 107) for reading the report information from the storage unit and transmitting it to the refrigerator at a timing based on the detection by the detection unit; and an input unit (order input part 101) for accepting an input of ordering of food items from the refrigerator for a predetermined period after the transmission.

(21)

The server according to (20), further comprising: a communication unit (network controller 14) for communicating with a device (PC700) for managing ordering of foods; and an ordering unit (ordering unit 103) for ordering the food items by transmitting the ordering input of the food items accepted by the input unit to the device for managing ordering of the food items, wherein the storage unit further stores information on the ordering status of acceptance of the food items ordered by the ordering unit, the information being input from the device for managing ordering of the food items, and the report information includes information on the ordering status of acceptance of the food items ordered by the ordering unit.

(22)

The server according to (21), wherein the predetermined period is a period until shipment of the ordered food item is completed before the transfer.

(23)

The server according to any one of (20) to (22), wherein the server is capable of communicating with a terminal device (500), the order entry accepted during the predetermined period is an additional order entry to the order entry made in the terminal device before the transmission, the server receives a keyword accepted by the terminal device from the terminal device at the order entry made before the transmission, receives the order entry accepted by the terminal device from the refrigerator during the predetermined period, and notifies the apparatus for managing orders for food of the order entry accepted during the predetermined period to the refrigerator on condition that the keyword accepted by the terminal device matches the keyword received from the refrigerator by a keyword accepted by voice from the refrigerator during the predetermined period.

(24)

A terminal device (terminal device 500) capable of communicating with a refrigerator (refrigerator 300) within a predetermined range, comprising: an input unit (ordering input section 501) for accepting ordering input of food; a transmission unit (transmission section 502) for transmitting information indicating the ordering input to the refrigerator; an acquisition unit (report information input section 503) for acquiring input of report information from the refrigerator; and a display unit (display processing unit 504) for displaying based on the report information.

(25)

A control program for a server (server 100) capable of communicating with a refrigerator (refrigerator 300), the server having a memory (sound information storage unit 132) for storing report information in the refrigerator, the control program causing the server to execute: a step (S223) of detecting the presence of a user in the vicinity of the refrigerator; a step (S227) of reading the report information from the memory and transmitting it to the refrigerator at the timing based on the detection; and a step (S229, S201) of receiving the order input of the food from the refrigerator in a predetermined period after the transmission.

(26)

A control program for a terminal device (PC700) capable of communicating with a refrigerator (refrigerator 300) within a predetermined range, the control program causing the terminal device to execute: a step (S0) of accepting an order input of the food; a step (S1) of transmitting information indicating the order placing input to the refrigerator; a step (S31) of acquiring input of report information from the refrigerator; and a step (S32) for displaying the report information.

The embodiments disclosed herein are considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the description above, and is intended to include meanings equivalent to the claims and all modifications within the scope.

-description of symbols-

10. 30, 50 CPU, 11, 31, 51 ROM, 12, 32, 52 RAM, 13 HDD, 14, 38, 54 network controller, 33 driving mechanism, 34 microphone, 35 speaker, 36, 53 touch panel, 37 sensor, 39, 55 communication device, 100 server, 101 order input section, 102 management section, 103, 306, 502 order section, 104 commodity information input section, 105 generation section, 106, 301 detection section, 107 transmission section, 108 judgment section, 131 order information storage section, 132 sound information storage section, 300 refrigerator, 302 notification section, 303 message input section, 304 output control section, 305, 501 order input section, 500 terminal device, 503 report information input section, 504 display processing section, 700 PC.

Claims

1. A food management system is provided with:

a server; and

a refrigerator capable of communicating with the server,

the server includes a storage unit for storing report information in the refrigerator,

the refrigerator includes a reporting device and an input device,

the food management system further includes:

a detection unit for detecting the presence of a user near the refrigerator;

a report control unit configured to perform a report by the reporting apparatus based on the report information at a timing based on the detection by the detection unit;

an input unit configured to accept ordering input of the food items by the input device for a predetermined period after the report; and

a terminal device capable of communicating with the server,

the order entry input accepted within the predetermined period is an additional order entry based on voice for an order entry made by a key input or a touch input in the terminal device prior to the report,

the terminal device accepts input of a keyword at the time of order placement input performed before the report, transmits the accepted keyword to the server,

the refrigerator receives an input of a keyword by voice at the time of the order input received within the predetermined period,

sending the accepted keyword to the server,

the server notifies a device that manages food ordering of an order received during the predetermined period of time on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

2. The food management system of claim 1,

the detection unit detects the presence of a user in the vicinity of the refrigerator by detecting the occurrence of a user action accompanying contact with the refrigerator.

3. The food management system of claim 2,

the detection unit detects opening and closing of a door of the refrigerator as a user action for the refrigerator.

4. The food management system according to any one of claims 1 to 3,

the reporting means has a sound output function and,

the report includes a report by sound.

5. The food management system according to any one of claims 1 to 3,

the reporting means is capable of communicating with terminal devices within a prescribed range,

the reporting includes the reporting device transmitting the reporting information to the terminal devices within the prescribed range.

6. The food management system according to any one of claims 1 to 3,

the input device is capable of communicating with terminal devices within a prescribed range,

the ordering input of the food includes an input of ordering information received by the input device from the terminal device within the predetermined range.

7. The food management system according to any one of claims 1 to 3,

the server further includes:

a communication unit for communicating with a device for managing ordering of food;

an ordering unit for ordering the food items by transmitting an ordering input for the food items accepted by the input device to a device that manages ordering of the food items,

the storage means further stores information relating to the order acceptance status of the food ordered by the ordering means, which is input from a device for managing the ordering of the food,

the report information includes information on the food ordering status accepted by the ordering unit.

8. The food management system of claim 7, wherein,

the predetermined period is a period from the end of shipment of the ordered food item before the report.

9. A refrigerator capable of communicating with a server, comprising:

a detection unit for detecting the presence of a user in the vicinity of the refrigerator;

a reporting unit configured to report the report information acquired from the server at a timing based on the detection by the detecting unit;

an input unit for accepting an order input for the food item after the report; and

an ordering unit for ordering the food by transmitting ordering information accepted by the input unit to the server,

the order input of the food based on the input unit is an additional order input based on sound for an order input made by a key input or a touch input in a terminal device before the report,

the input unit receives an input of a keyword by voice at the time of the order input accepted after the report,

the refrigerator further includes a transmission unit that transmits the received keyword to the server.

10. The refrigerator of claim 9, wherein,

11. The refrigerator of claim 9 or 10,

the report by the report means includes a report by sound.

12. The refrigerator of claim 9 or 10,

the refrigerator further includes: a communication unit for communicating with a terminal device within a prescribed range,

the reporting by the reporting unit includes transmitting the report information to the terminal apparatuses within the predetermined range.

13. The refrigerator of claim 9 or 10,

the order placing input by the input means includes an input of receiving order placing information from the terminal device within the predetermined range.

14. The refrigerator of claim 9 or 10,

the refrigerator further includes: a notification unit for notifying the server of the detection by the detection unit,

the reporting unit reports the report information transmitted from the server according to the notification.

15. The refrigerator of claim 9 or 10,

the refrigerator further includes:

an acquisition unit configured to acquire the report information from the server at a predetermined timing; and

a storage unit for storing the report information,

the reporting unit reads the report information from the storage unit and reports it at a timing based on the detection by the detecting unit.

16. A server capable of communicating with a refrigerator, comprising:

a storage unit for storing report information in the refrigerator;

a detection unit for detecting the presence of a user near the refrigerator;

a transmission unit for reading the report information from the storage unit and transmitting the report information to the refrigerator at a timing based on the detection by the detection unit; and

an input unit for accepting an input of ordering of food items from the refrigerator for a predetermined period after the transmission,

the server is capable of communicating with the terminal device,

the order entry input accepted within the predetermined period is an additional order entry based on voice for an order entry made by a key input or a touch input in the terminal device before the transmission,

the server receiving a keyword accepted by the terminal device from the terminal device at a place input made before the transmission,

receiving a keyword accepted by sound from the refrigerator at the time of the order placing input accepted within the predetermined period,

and notifying a device for managing food ordering of an order input accepted within the predetermined period on the condition that the keyword received from the terminal device matches the keyword received from the refrigerator.

17. The server according to claim 16, wherein,

the server further includes:

a communication unit for communicating with a device for managing ordering of food; and

an ordering unit for ordering the food items by transmitting an ordering input of the food items accepted by the input unit to a device for managing ordering of the food items,

18. The server according to claim 17, wherein,

the predetermined period is a period from the end of shipment of the ordered food items before the transfer.

19. A recording medium storing a control program of a server capable of communicating with a refrigerator,

the server has a memory for storing the report information in the refrigerator,

the control program causes the server to execute the steps of:

detecting the presence of a user in the vicinity of the refrigerator;

a step of reading the report information from the memory and transmitting it to the refrigerator at a timing based on the detection;

a step of receiving an input of ordering of food from the refrigerator for a predetermined period after the transfer;

a step in which the server receives, from a terminal device, a keyword accepted by the terminal device at the time of order placement performed before the transmission;

receiving a keyword accepted by sound from the refrigerator when the order is received within the predetermined period; and