JP2022026180A - Foodstuff management system - Google Patents

Abstract

To provide a foodstuff management system that can improve convenience.SOLUTION: In a foodstuff management system, a server 400 includes a first server device 410 and a second server device 420. The second server device 420 includes an instruction reception unit 421, a registration management unit 422, a response control unit 423, a setting unit 424, and a storage unit 425. The instruction reception unit 421 receives a user's instruction. The registration management unit 422 deletes, when there are a plurality of stock registrations for a foodstuff in the same category and an instruction to delete stock registrations for the foodstuff in which a deletion target is unknown is received by the instruction reception unit 421, one or more stock registrations out of the plurality of stock registrations on the basis of predetermined priorities.SELECTED DRAWING: Figure 5

Description

Embodiments of the present invention relate to a foodstuff management system.

A foodstuff management system for managing foodstuffs stored in a refrigerator has been proposed. Such a foodstuff management system is expected to improve convenience.

Japanese Unexamined Patent Publication No. 2018-146120

An object to be solved by the present invention is to provide a food material management system capable of improving convenience.

The foodstuff management system of the embodiment has a reception unit and a registration management unit. The reception unit receives a user's instruction. When the registration management unit has a plurality of inventory registrations for foodstuffs of the same category and the reception department receives an instruction to delete an inventory registration whose deletion target is unknown for the foodstuffs, the registration management unit sets the priority order set in advance. Based on this, one or more inventory registrations out of the plurality of inventory registrations are deleted.

The figure which shows the whole structure of the food material management system of an embodiment. The front view which shows the refrigerator of an embodiment. The figure which shows the structure of the cooling apparatus of embodiment. The figure which shows the change of the air temperature of a chilled chamber when the control mode of "special chilled" of embodiment is executed. The block diagram which shows the system configuration of the server of an embodiment. The figure which shows an example of the contents of the inventory list DB of an embodiment. The figure which shows an example of the contents of the shopping list DB of an embodiment. The figure which shows an example of the contents of the trash can DB of an embodiment. The figure which shows an example of the contents of the candidate list DB of an embodiment. The figure which shows an example of the contents of the food material DB of an embodiment. The figure which shows an example of the content of the image of the top page of the foodstuff management of an embodiment. The figure which shows an example of the content of the image which displayed the ingredient list of an embodiment. The figure which shows one control example about the deletion of inventory registration of an embodiment. The figure which shows another control example about the deletion of inventory registration of an embodiment. The figure which shows still another control example about the deletion of inventory registration of an embodiment. The flowchart which shows the process about the deletion of the inventory registration of an embodiment. The figure which shows an example of the content of the ingredient priority information of an embodiment. A flowchart showing a process relating to an instruction to add or delete registrations of a plurality of ingredients of the embodiment at the same time. The figure which shows an example of the contents of the refrigerator registration information of an embodiment. The flowchart which shows the processing when the number of refrigerators which can be set as the target of foodstuff management of an embodiment is changed.

Hereinafter, the food material management system of the embodiment will be described with reference to the drawings. In the following description, configurations having the same or similar functions are designated by the same reference numerals. Then, the duplicate description of those configurations may be omitted. "Based on XX" means "based on at least XX" and may include cases based on other factors in addition to XX. The term "based on XX" is not limited to the case where XX is used directly, but may include the case where it is based on a calculation or processing performed on XX. The term "XX or YY" is not limited to the case of either XX or YY, and may include both cases of XX and YY. "XX" and "YY" are arbitrary elements (for example, arbitrary information). Hereinafter, the "database" is referred to as "DB". Each of the "best-by date" and "expiration date" is an example of the "intake deadline". "Temperature of the storage room" means the air temperature of the storage room. "Answer", "notify", "output an error", or other "output" means an information indicating an answer, a notification, an error, or other contents (for example, a voice dialogue device and a voice dialogue device and). / Or it means to output from the display device). Further, "answer" may be read as "response".

<1. Overall configuration>
FIG. 1 is a diagram showing an overall configuration of the food material management system 1 of the embodiment. The foodstuff management system 1 includes, for example, one or more refrigerators 100, a voice dialogue device 200, a terminal device 300, and a server 400. However, the function of the foodstuff management system 1 described below may be realized only by the refrigerator 100 or only by the server 400. The network NW described later includes, for example, one or more of the Internet, a cellular network, a Wi-Fi network, a WAN (Wide Area Network), a LAN (Local Area Network), a public line, a telephone line, a wireless base station, and the like.

The refrigerator 100 is installed in the residence of the user U. The refrigerator 100 is connected to the network NW via, for example, a router R in the house, and can communicate with the server 400. In the present embodiment, a plurality of (for example, two) refrigerators 100A and 100B are installed in the residence of the user U. Three refrigerators 100A, 100B, 100C may be installed in the residence of the user U. The refrigerators 100A, 100B and 100C may have different sizes and functions from each other. Hereinafter, when the refrigerators 100A, 100B, and 100C are not distinguished from each other, they are simply referred to as "refrigerator 100". The refrigerator 100 will be described in detail later.

The voice dialogue device 200 is arranged in the residence of the user U. The voice dialogue device 200 is connected to the network NW via, for example, the router R, and can communicate with the server 400. The voice dialogue device 200 acquires the voice (voice input) uttered by the user U by the microphone, and transmits the acquired voice of the user U as voice data to the server 400. The voice dialogue device 200 receives the voice data for response from the server 400, and outputs the voice corresponding to the received voice data from the speaker to the outside. The voice dialogue device 200 is, for example, a smart speaker arranged independently of the refrigerator 100. However, the voice dialogue device 200 may be provided as a part of the refrigerator 100 or another home electric appliance. When the terminal device 300 has a voice dialogue function, the terminal device 300 may correspond to an example of the "voice dialogue device". In this case, the "voice dialogue device 200" in the following description may be read as "terminal device 300". The voice dialogue device 200 is an example of a “notifying unit”.

The terminal device 300 is, for example, a mobile terminal device owned by the user U, such as a smartphone or a tablet terminal device. The terminal device 300 is connected to the network NW and can communicate with the server 400. The terminal device 300 has a display device 310. The display device 310 includes a display screen capable of displaying an image or a video, and a touch sensor provided on the display screen. The display device 310 is another example of the "notifying unit". An application program (hereinafter, may be referred to as an "application") for performing food management and remote control of the refrigerator 100, which will be described later, is installed in the terminal device 300. The terminal device 300 is not limited to the above example, and may be a personal computer, a television receiver having an input function, or the like.

The server 400 provides various services related to foodstuff management. The server 400 may be referred to as a "server system". The server 400 is composed of, for example, one or more server devices (cloud servers). In this embodiment, the server 400 is composed of a first server device 410 and a second server device 420. The first server device 410 is a server device for voice dialogue that controls the voice dialogue device 200. In this case, the first server device 410 does not have to be included in the foodstuff management system 1. The second server device 420 is a server device for managing foodstuffs and remotely controlling the refrigerator 100. The second server device 420 may be separately provided as a server device for managing foodstuffs and a server device for remotely controlling the refrigerator. The server 400 may include an information processing unit that performs edge computing or fog computing, such as an information processing unit included in the router R and / or an information processing unit included in a router in the network NW. The server 400 will be described in detail later.

<2. Refrigerator ＞
<2.1 Refrigerator configuration>
FIG. 2 is a front view showing the refrigerator 100. The refrigerator 100 includes, for example, a housing 10, a plurality of doors 20, a display device 30, a cooling device 40 (see FIG. 3), and a control device 50. A plurality of storage rooms (preservation rooms) 11 are provided inside the housing 10. The plurality of storage chambers 11 include a refrigerator compartment 11A, a chilled chamber 11B, a vegetable compartment 11C, an ice making chamber 11D, a small freezer compartment 11E1, and a main freezer compartment 11E2. These storage chambers 11 are closed by a door 20 so as to be openable and closable. In the following, when the small freezing room 11E1 and the main freezing room 11E2 are not distinguished, they are simply referred to as "freezing room 11E".

The refrigerating chamber 11A is a storage chamber 11 having an average temperature of 3 ° C. to 5 ° C. The chilled chamber 11B is a storage chamber 11 having an average temperature of 0 ° C. to 3 ° C. The chilled room 11B is an example of a "special function room". However, the special function room is not limited to the chilled room, but may be a partial room, a switching room, or the like. The special function chamber is a storage chamber 11 having a function of lowering the average temperature than the refrigerating chamber 11A at least in a certain control mode (operation mode). The vegetable compartment 11C is a storage chamber 11 having an average temperature of about 6 ° C. The freezing chamber 11E is a storage chamber 11 having an average temperature of -18 ° C. or lower. That is, the temperature zones of these storage chambers 11 are lowered in the order of the vegetable compartment 11C, the refrigerating chamber 11A, the chilled chamber 11B, and the freezing chamber 11E. Here, for any element X, Y, Z, "lowering in the order of X, Y, Z" means that X is high, Y is medium, and Z is low. This definition is similar below. The small freezing chamber 11E1 and the main freezing chamber 11E2 are storage chambers 11 in the same temperature range.

The display device 30 includes a display screen capable of displaying an image or a video, and a touch sensor provided on the display screen. The display device 30 is still another example of the “notifying unit”. Hereinafter, when the display device 310 of the terminal device 300 and the display device 30 of the refrigerator 100 are not distinguished from each other, they are simply referred to as "display device DD".

The cooling device 40 is a device for cooling the storage chamber 11, and includes a compressor, a blower, and the like. The cooling device 40 will be described later. The control device 50 controls the entire refrigerator 100. For example, the control device 50 controls the display device 30 to display the information received from the server 400 on the display device 30. The control device 50 cools the storage chamber 11 of the refrigerator 100 by controlling the cooling device 40.

FIG. 3 is a diagram showing the configuration of the cooling device 40. The cooling device 40 includes a compressor 41, a condenser 42, a dryer 43, a three-way valve 44, a capillary tubes 45A and 45B, coolers 46A and 46B, suction pipes 47A and 47B, and a check valve 48 in the order of refrigerant flow. .. A refrigerating capillary tube 45A, a refrigerating cooler 46A, and a refrigerating suction pipe 47A are connected to one of the two outlets of the three-way valve 44. A freezing capillary tube 45B, a freezing cooler 46B, a freezing suction pipe 47B, and a check valve 48 are connected to the other outlet of the two outlets of the three-way valve 44.

In the above cooling device 40, the three-way valve 44 is controlled by the control device 50, and has a flow path (hereinafter referred to as “flow path A”) for supplying the refrigerant to the refrigerating cooler 46A and a refrigerating cooler 46B for the refrigerant. (Hereinafter referred to as "flow path B") is selectively selected. By controlling the three-way valve 44, the control device 50 alternately switches between the flow path A and the flow path B as the flow path of the refrigerant. When the refrigerant is flowing in the flow path A, the refrigerating chamber 11A, the chilled chamber 11B, and the vegetable chamber 11C are cooled. When the refrigerant is flowing in the flow path B, the ice making chamber 11D and the freezing chamber 11E are cooled. For example, the control device 50 has a refrigerating operation in which the refrigerant flows through the flow path A for 20 minutes to cool the refrigerating chamber 11A, the chilled chamber 11B, and the vegetable compartment 11C, and the refrigerant flows in the flow path B for 40 minutes. The refrigerating operation of flowing and cooling the ice making chamber 11D and the freezing chamber 11E is repeated alternately. Therefore, as shown in FIG. 4, which will be described later, the temperature in the storage chamber 11 fluctuates in a sawtooth pattern.

<2.2 Chilled room control mode>
Next, the control mode (operation mode) of the chilled chamber 11B that can be executed by the control device 50 will be described.

<Normal chilled>
The "normal chilled" control mode is a control mode in which the chilled chamber 11B is cooled by the basic operation of the refrigerator 100. In the "normal chilled" control mode, the temperature of the chilled chamber 11B is kept in a constant temperature range, for example, an average temperature of 0.5 to 1.0 ° C.

<Rapid chilled>
The "rapid chilled" control mode is a control mode that lowers the temperature of the chilled chamber 11B faster than the "normal chilled" control mode. In the "rapid chilled" control mode, the operating frequency of the compressor 41 and the rotation speed of the blower (not shown) are set high over a predetermined time. As a result, a large amount of cold air is sent into the chilled chamber 11B, and the temperature of the chilled chamber 11B is lowered at once. From one point of view, the "normal chilled" control mode is an example of a "first operating mode". The control mode of "rapid chilled" is an example of "second operation mode".

<Decompression>
The "thaw" control mode is a control mode in which the temperature of the chilled chamber 11B is higher than that of the "normal chilled" control mode. The control mode of "thawing" is a control mode in which the temperature of the chilled chamber 11B is raised to promote the thawing of the foodstuff in the chilled chamber 11B. In the "defrosting" control mode, the operating frequency of the compressor 41 and the rotation speed of the blower (not shown) are set low for a predetermined time. As a result, relatively warm air is sent to the chilled chamber 11B, and the temperature of the chilled chamber 11B is raised. In the "thaw" control mode, the temperature of the chilled chamber 11B falls within a certain temperature range where, for example, the average temperature is 1.5 ° C. From another point of view, the "decompression" control mode is an example of the "first operation mode". The "normal chilled" control mode is an example of the "second operation mode".

<Special chilled>
The control mode of the "special chilled" is a control mode in which the time for cooling the chilled chamber 11B in the low temperature zone and the time for cooling the chilled chamber 11B in the high temperature zone are repeated in order. The control mode of such a "special chilled" will be described in detail below.

FIG. 4 is a diagram showing a change in temperature of the chilled chamber 11B when the “special chilled” control mode is executed. In the "special chilled" control mode, the control device 50 has a low-temperature cooling control (first cooling control) in which the chilled chamber 11B is cooled in the first temperature zone Ta, and a chilled chamber 11B having a higher temperature than the first temperature zone Ta. High-temperature cooling control (second cooling control) for cooling in the two temperature zones Tb is alternately repeated. Here, "cooling" in the above-mentioned refrigerating operation and refrigerating operation means that the refrigerant is supplied to the cooler (refrigerating cooler 46A or refrigerating cooler 47B). On the other hand, "cooling" in the low temperature cooling control and the high temperature cooling control means that the refrigerator 100 is operated so as to maintain the temperature in the first temperature zone Ta or the second temperature zone Tb. "The low temperature cooling control (first cooling control) and the high temperature cooling control (second cooling control) are repeated in order" means that the refrigerating operation is performed a plurality of times during the low temperature cooling control (first cooling control). After that, when the refrigerating operation is performed multiple times during the high temperature cooling control (second cooling control), and then the refrigerating operation is performed multiple times during the low temperature cooling control (first cooling control), etc. Also includes.

The average temperature of the first temperature zone Ta is, for example, −5 ° C. The average temperature of the first temperature zone Ta is a temperature below the freezing point, for example, a temperature of less than 0 ° C. The first temperature zone Ta is a temperature at which the surface of the food material in the chilled chamber 11B is slightly frozen. The first temperature zone Ta is a temperature zone lower than the "normally chilled" temperature zone. The low temperature cooling control is carried out over a predetermined time Sa (for example, 2 hours).

The second temperature zone Tb is a set temperature zone of the chilled chamber 11B during high temperature cooling control. The average temperature of the second temperature zone Tb is, for example, + 1 ° C. The average temperature of the second temperature zone Tb is a temperature higher than the freezing point, for example, a temperature of 0 ° C. or higher. The second temperature zone Tb is a temperature at which the slightly frozen layer formed on the surface of the food material in the chilled chamber 11B can be thawed. The high temperature cooling control is carried out over a predetermined implementation time Sb (for example, 5 hours) longer than the implementation time Sa of the low temperature cooling control.

According to such a "special chilled" control mode, the low temperature cooling control over the predetermined implementation time Sa and the high temperature cooling control over the predetermined implementation time Sb are alternately repeated, so that only the surface of the food is fine. By freezing, it is possible to suppress the drying and oxidation of foodstuffs. As a result, the freshness of the food can be maintained longer than that of chilled food.

In the "special chilled" control mode, the average temperature is in the temperature range of minus 0.5 when viewed through the low temperature cooling control and the high temperature cooling control. That is, the "special chilled" control mode is a control mode in which the temperature zone of the chilled chamber 11B is lower than that of the "normal chilled" control mode. The "normal chilled" control mode is an example of the "first operation mode". The "special chilled" control mode is an example of the "second operation mode".

<3. Server ＞
FIG. 5 is a block diagram showing a system configuration of the server 400. As described above, the server 400 is composed of, for example, a first server device 410 and a second server device 420.

The first server device 410 has, for example, a voice processing unit 411, a response generation unit 412, and a storage unit 413. All or part of these functional units are realized by executing a program (software) by one or more hardware processors such as a CPU (Central Processing Unit) mounted on the first server device 410. However, all or part of these functional parts are realized by hardware (circuit part; including circuitry) such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field Programmable Gate Array). It may be realized by the cooperation of software and hardware. The storage unit 413 is realized by a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, or a combination of a plurality of these. The storage unit 413 stores the voice DB 511. In the voice DB 511, a dictionary for interpreting the meaning of the utterance of the user U and voice information for generating voice data for response are registered.

The voice processing unit 411 receives the voice data acquired based on the utterance of the user U from the voice dialogue device 200. The voice processing unit 411 analyzes the voice data received from the voice dialogue device 200. For example, the voice processing unit 411 converts the voice data into text by performing voice recognition processing, and performs semantic interpretation by performing natural language processing on the text-converted voice data. The voice processing unit 411 transmits the analysis result of the voice data to the second server device 420.

The response generation unit 412 receives information indicating the utterance content output from the voice dialogue device 200 to the user U from the second server device 420. By referring to the voice DB 511, the response generation unit 412 generates voice data to be output to the user U based on the information received from the second server device 420. The response generation unit 412 transmits the generated voice data to the voice dialogue device 200. The voice dialogue device 200 operates the speaker based on the voice data received from the first server device 410 to give a voice response or notification to the user U.

The second server device 420 includes, for example, an instruction receiving unit 421, a registration management unit 422, a response control unit 423, a setting unit 424, and a storage unit 425. All or part of these functional units are realized by executing a program (software) by one or more hardware processors such as a CPU mounted on the second server device 420. However, all or part of these functional parts may be realized by hardware such as ASIC, PLD, or FPGA (circuit part; including circuitry), or by cooperation between software and hardware. May be good. The storage unit 425 is realized by a RAM, a ROM, an HDD, a flash memory, or a combination of a plurality of these. The storage unit 425 stores an inventory list DB 521, a shopping list DB 522, a trash can DB 523, a candidate list DB 524, a food material DB 525, a regular item DB 526, a food material priority information 527, a response priority information 528, and a refrigerator registration information 259. The inventory list DB521, the shopping list DB522, the trash can DB523, the candidate list DB524, the regular items DB526, and the refrigerator registration information 529 are prepared for each user U.

The instruction receiving unit 421 receives the user U's instructions regarding food management, setting change of the refrigerator 100, and the like. For example, the instruction receiving unit 421 receives an instruction based on the voice input of the user U by receiving the analysis result of the voice data of the user U spoken to the voice dialogue device 200 from the first server device 410. Further, the instruction receiving unit 421 obtains information indicating the operation of the user U performed on the refrigerator 100 and / or the terminal device 300 (for example, the user's operation on the display device DD) from the refrigerator 100 and / or the terminal device 300. Receive. The instruction receiving unit 421 receives the instruction of the user U based on the information received from the refrigerator 100 and / or the terminal device 300. The instruction receiving unit 421 outputs the received instruction of the user U to the registration management unit 422, the response control unit 423, and the setting unit 424. The instruction reception unit 421 is an example of the "reception unit".

The registration management unit 422 manages various DBs (inventory list DB 521, shopping list DB 522, candidate list DB 524, trash can DB 523, regular goods DB 526, etc.) described later based on the information received by the instruction reception unit 421. For example, the registration management unit 422 processes addition of registration of ingredients to various DBs, deletion of registration, and confirmation (viewing) of registration. The specific function of the registration management unit 422 will be described later. In the following description, the "user's instruction" means the instruction of the user U received by the instruction receiving unit 421.

The response control unit 423 generates information to be notified to the user U regarding foodstuff management and others based on the instruction of the user U received by the instruction reception unit 421 and / or the information managed by the registration management unit 422. When the response control unit 423 notifies the user U by voice from the voice dialogue device 200, the response control unit 423 transmits the generated information and a predetermined control signal to the first server device 410. When the response control unit 423 notifies the user U by the display of the refrigerator 100 and / or the display device DD of the terminal device 300, the response control unit 423 transmits the generated information and a predetermined control signal to the refrigerator 100 and / or the terminal device 300. do. The specific function of the response control unit 423 will be described later.

When there are a plurality of refrigerators 100 in the same house, the setting unit 424 sets the refrigerator 100 to be instructed to manage the ingredients from among the plurality of refrigerators 100 based on the instruction received by the instruction receiving unit 421. The specific function of the setting unit 424 will be described later.

<4. Various DBs>
<4.1 Inventory list DB>
FIG. 6 is a diagram showing an example of the contents of the inventory list DB 521. In the inventory list DB 521, the ingredients existing in stock in the residence of the user U are registered. Not only the foodstuffs stored in the refrigerator 100 but also the foodstuffs stored outside the refrigerator 100 (for example, stored at room temperature) can be registered in the inventory list DB 521.

In the inventory list DB 521, registration R1 (hereinafter referred to as “inventory registration R1”) indicating inventory of foodstuffs is managed. In each inventory registration R1, "management ID", "food name", "food classification", "storage location", "purchase date", "best-by date" (or "expiration date"), "quantity", "unit" , And "history" are associated. In the inventory list DB 521, the same kind of foodstuffs (foodstuffs with the same name) purchased at the same time are registered as one inventory registration R1. In other words, even if the same kind of foodstuff (foodstuff with the same name) is used, the foodstuff purchased at a certain date and time and the foodstuff purchased at another date and time are registered as different inventory registration R1. The "purchase date" here refers to the registration date when a specific ingredient is newly registered, that is, the date when the inventory amount increases, and is used in the sense that the acquisition route of the ingredient is not the purchase. Ingredients of the same type (ingredients with the same name) are an example of "ingredients in the same category". The foodstuffs in the same category are not limited to the foodstuffs having the same name, and may include a plurality of types of foodstuffs preset in the same category. This will be described later.

"Ingredient classification" means the classification of ingredients. In this embodiment, as "foodstuff classification", "vegetables", "fruits", "meat", "seafood / seaweeds", "eggs / dairy products", "beans / bean products", "processed foods", " There are 16 kinds of food classifications such as "rice / bread", "noodles", "beverage", "frozen food", "sweets", "seasoning", "spices", "side dish", and "others". It is set. However, the above classification is an example, and the classification of foodstuff classification can be set as appropriate.

"Preservation place" means the place where the ingredients are stored. In the present embodiment, five types of storage locations, which are a "refrigerator room", a "vegetable room", a "chilled room", a "freezing room", and a "other", are set as the "storage place". The "refrigerating room" corresponds to the refrigerating room 11A. The "vegetable room" corresponds to the vegetable room 11C. The "chilled room" corresponds to the chilled room 11B. The "freezing room" corresponds to the area where the small freezing room 11E1 and the main freezing room 11E2 are put together. “Other” corresponds to an external storage location of the refrigerator 100. The latest quantity of ingredients is registered in "quantity". In the "history", when the amount of foodstuffs is reduced, information indicating the quantity after the reduction and the date and time of the reduction is registered.

<4.2 Shopping list DB>
FIG. 7 is a diagram showing an example of the contents of the shopping list DB522. The shopping list DB522 is a DB that can be referred to by the user U at the time of shopping in order to prevent forgetting to buy. In the shopping list DB522, the foodstuffs for which the purchase schedule (for example, explicit purchase intention) of the user U is confirmed are registered. In the shopping list DB522, ingredients having a higher possibility of purchase than the candidate list DB524 described later are registered. In the shopping list DB522, not only the user U's explicit purchase intention but also the foodstuff may be registered by estimation based on the user U's regular intention (intention to hold a certain foodstuff as a regular item). In the shopping list DB522, registration R2 (hereinafter referred to as “shopping registration R2”) indicating shopping candidates is managed. In each shopping registration R2, a "management ID", a "food ingredient name", a "food ingredient classification", a "quantity", and a "unit" are associated with each other.

<4.3 Trash DB>
FIG. 8 is a diagram showing an example of the contents of the trash can DB 523. In the trash can DB 523, the ingredients deleted from the inventory list DB 521 are temporarily registered. For example, the foodstuffs registered in the inventory list DB521 are consumed in the trash can DB523, and the foodstuffs deleted from the inventory list DB521 are registered based on the deletion instruction of the user U. The ingredients registered in the trash can DB 523 can be re-registered in the inventory list DB 521 according to the instruction of the user U. In the trash can DB 523, registration R3 (hereinafter referred to as “deletion registration R3”) indicating deleted foodstuffs is managed. In each deletion registration R3, a "management ID", a "food ingredient name", a "food ingredient classification", and a "registration date in the trash can DB 523" are associated with each other.

<4.4 Candidate list DB>
FIG. 9 is a diagram showing an example of the contents of the candidate list DB 524. The candidate list DB 524 is a DB that the user U can supplementarily refer to in order to prevent forgetting to buy. In the candidate list DB 524, the ingredients of the purchase candidate whose purchase schedule (for example, explicit purchase intention) of the user U has not been confirmed are registered. In the candidate list DB 524, the registration R4 (hereinafter referred to as “proposal registration R4”) indicating the foodstuff for which the purchase is proposed is managed. In each proposal registration R4, a "management ID", a "food ingredient name", a "food ingredient classification", and a "registration date in the candidate list DB 524" are associated with each other. The candidate list DB 524 is generated by using, for example, the deregistration of the ingredients registered in the inventory list DB 521. In the present embodiment, when the quantity of the ingredients registered in the inventory list DB 521 decreases and a predetermined condition is satisfied (for example, when the inventory becomes zero), the ingredients are automatically added to the candidate list DB 524. be registered. The instruction receiving unit 421 can accept the instruction of the user U to move the ingredients registered in the candidate list DB 524 to the shopping list DB 522.

<4.5 Ingredient DB>
FIG. 10 is a diagram showing an example of the contents of the food material DB 525. The food material DB 525 is a default DB commonly set for a plurality of users. A large number of commonly distributed foodstuffs are registered in the foodstuff DB 525. In the food material DB 525, a registration R5 (hereinafter referred to as "food material registration R5") indicating information on food materials used for automatic input of food material information is registered. In each ingredient registration R5, "ingredient name", "candidate for accepting ingredient name (synonym of ingredient name)", "ingredient classification", "ingredient classification icon", "default storage location (recommended storage location)""," Expiration date (or expiration date) "is associated.

<4.6 Regular equipment DB>
In the regular item DB 526, the foodstuffs often used by the user U (for example, the foodstuffs that the user U does not want to run out of stock) are registered. In the regular item DB 526, the foodstuff instructed by the user U to request the regular item is registered.

<4.7 Display examples of various DBs>
FIG. 11 shows an example of the contents of the image IM1 on the top page of foodstuff management. The content displayed in the image IM1 is generated based on the inventory list DB 521. Image IM1 includes refrigerating chambers 11A, chilled chambers 11B, vegetable compartments 11C, freezing chambers 11E, and display boxes D1 to D5 corresponding to other locations. The display boxes D1 to D5 display the number of ingredients (the number of inventory registration R1) stored in the refrigerator compartment 11A, the chilled chamber 11B, the vegetable compartment 11C, the freezing chamber 11E, and other places. The image IM1 is displayed on the display device DD of the refrigerator 100 and / or the terminal device 300 under the control of the server 400.

FIG. 12 is a diagram showing an example of the contents of the image IM2 of the foodstuff list. The food ingredient list shown in FIG. 12 is a list in which all inventory registrations R1 registered in the inventory list DB 521 are displayed. In the foodstuff list, an icon indicating the foodstuff classification, a foodstuff name, a purchase date, an expiration date (or expiration date), a quantity, and a unit are displayed for each inventory registration R1. The inventory registration R1 is arranged in a predetermined order regardless of which storage location the inventory registration R1 of the food material is stored in. The "predetermined order" is, for example, the order of the names of the ingredients (in the order of AIUEO), the order of the oldest (or newest) purchase date, and the order of the closest (or the farthest) of the expiration date (expiration date). The user can change the predetermined order by operating the operation unit IM2a included in the image IM2 (the display order of the inventory registration R1 can be rearranged).

The server 400 generates an image IM2a of the foodstuff list and displays it on the display device DD of the refrigerator 100 and / or the terminal device 300. In addition to the foodstuff list, the server 400 can generate a foodstuff list showing the inventory registration R1 of each storage room 11 and display it on the display device DD. The server 400 can generate a similar list and display the contents registered in the shopping list DB 522, the trash can DB 523, the candidate list DB 524, and the regular item DB 526 on the display device DD.

<5. Control example by voice input>
The server 400 can execute the following control based on the instruction by the user's utterance (voice input) to the voice dialogue device 200. Details of control examples other than those described below are described in Japanese Patent Application No. 2020-022905 (filed on February 13, 2nd year of Reiwa) and Japanese Patent Application No. 2020-022912 (filed on February 13, 2nd year of Reiwa). Has been done. The specification of these applications is incorporated herein by reference in their entirety.

<5.1 Addition of inventory>
First, the addition of the inventory registration R1 to the inventory list DB 521 will be described. This content is the same for the addition of the shopping registration R2 in the shopping list DB522.

The instruction receiving unit 421 can receive an additional instruction of the inventory registration R1 specifying the food material and the storage room 11, and an additional instruction of the inventory registration R1 designating only the food material not accompanied by the designation of the storage room 11. "Additional instructions for inventory registration that specifies the ingredients and storage room" are the names of the ingredients, such as "Put one horse mackerel opening in the freezing room" and "Register 5 cucumbers and 2 packs of enoki in the vegetable room". It is an additional instruction of inventory registration R1 with the quantity of foodstuffs and the name of the storage room 11. The utterance order of the food material name and the name of the storage room 11 is not restricted, and the name of the storage room 11 may be spoken first. The registration management unit 422 adds the inventory registration R1 of the designated food material in relation to the designated storage room 11.

On the other hand, the "additional instruction for inventory registration that specifies only the ingredients that do not specify the storage room" is an additional instruction for inventory registration R1 that does not involve the name of the storage room 11, such as "add 3 eggs". be. When such an additional instruction is received, the registration management unit 422 registers the stock of the designated food material in relation to the storage room 11 set as the default storage place according to the food material based on the food material DB 525. Add R1.

The instruction receiving unit 421 of the present embodiment can register or delete a plurality of ingredients by the end of one reception of the voice dialogue function. In other words, the instruction receiving unit 421 can continuously receive a plurality of instructions (for example, "register 5 cucumbers and 2 packs of enoki mushrooms in the vegetable room") included in one group of utterances of the user U. Details of this process are described in the above-mentioned Japanese Patent Application No. 2020-022912 (filed on February 13, 2nd year of Reiwa).

In the present embodiment, the registration management unit 422 manages the maximum number of registered foodstuffs that can be registered in each inventory registration R1 as 999 points and the maximum number of registered items in the inventory registration R1 as 100. Therefore, when the registration management unit 422 receives the instruction to add the inventory registration R1, the registration management unit 422 "completes the addition (no room designation) (A1)" and "completes the addition (room designation)" for the ingredients to be added to the inventory registration R1. Yes) (A2) ”,“ Quantity 1000 points over (A3) ”,“ Ingredients over 100 (A4) ”,“ System error (A5) ”is determined.

In the case of the above (A1), the response control unit 423 adds the inventory registration R1 by indicating the name, ingredient name and quantity of the storage chamber 11 such as "A horse mackerel opening has been added to the freezing chamber." Answer that has been completed. In the case of the above (A2), the response control unit 423 does not speak the name of the storage chamber 11 like "3 eggs have been added." Answer that has been completed. However, in the case of the above (A2), the response control unit 423 attaches the name of the storage room 11 to which the inventory registration R1 is added (the name of the storage room 11 set as the default storage room according to the foodstuff). You may answer.

In the case of the above (A3), for example, when an additional instruction for inventory registration R1 such as "add 1500 grams of beef to the refrigerator compartment" is received, the registration management unit 422 maximizes the quantity of the foodstuff to be added. Inventory registration R1 is added with a predetermined quantity of the registered quantity (999 grams) or less. In the present embodiment, the registration management unit 422 adds the inventory registration R1 with the quantity of the food material to be added as the maximum registration quantity (999 grams). Then, the response control unit 423 sets the quantity of ingredients as the maximum registered quantity (999 grams) and sets the quantity of ingredients as the maximum registered quantity (999 grams), such as "The maximum quantity that can be registered is 999. 999 grams of beef has been added to the refrigerator compartment." Answer that the addition has been made and that an error regarding the maximum registered quantity (first error described later) has occurred. This will be described in detail later. The above-mentioned predetermined quantity is not limited to the maximum registered quantity, and may be a smaller quantity. For example, when an instruction to add inventory registration R1 such as "Add 1500 cabbage to the refrigerator" is received, inventory is in stock in a predetermined quantity (for example, 20 in the case of cabbage) preset according to the ingredients. Registration R1 may be added.

In the case of the above (A4), for example, when an instruction to add the inventory registration R1 is received while there are already 100 inventory registrations R1 in the inventory list DB 521, the registration management unit 422 does not add the inventory registration R1. .. Then, the response control unit 423 replied that an error related to the maximum number of registrations (second error described later) occurred, such as "The maximum number of registered foods in the food list is 100. Please delete the foods." do. This will also be described in detail later. In the case of the above (A5), the response control unit 423 replies that the process has failed, such as "I'm sorry. It failed. Please try again."

<5.2 Inventory deletion>
Next, the deletion of the inventory registration R1 in the inventory list DB 521 will be described. This content is the same for the deletion of the shopping registration R2 in the shopping list DB522.

The instruction receiving unit 421 can receive an instruction to delete the inventory registration R1 in which the foodstuff and the storage room 11 are designated, and an instruction to delete the inventory registration R1 in which only the foodstuff without the designation of the storage room 11 is specified. The "instruction to delete the inventory registration specifying the foodstuff and storage room" is the foodstuff name and storage room 11 such as "turn off the ice cream from the freezing room" and "pull out two paprika and one Chinese cabbage from the vegetable room". It is an instruction to delete the inventory registration R1 accompanied by the name of. The utterance order of the food material name and the name of the storage room 11 is not restricted, and the name of the storage room 11 may be uttered later. On the other hand, the "instruction to delete the inventory registration that specifies only the ingredients that do not specify the storage room" means the deletion of the inventory registration R1 that does not accompany the name of the storage room 11, such as "delete 100 grams of chicken thigh". It is an instruction.

When these deletion instructions are received, the registration management unit 422 regarding the inventory registration R1 of the foodstuff subject to the deletion instruction, "can be deleted (B1)", "there is no stock of foodstuff (B2)", and "foodstuff". It is determined whether the product corresponds to "insufficient quantity (B3)", "the unit specified by the food is different (B4)", or "system error (B5)".

In the case of the above (B1), the response control unit 423 indicates the name, foodstuff name and quantity of the storage chamber 11 and completes the deletion of the inventory registration R1 as in "Deleted one ice cream from the freezing chamber." Answer what you did. However, the name and quantity of the storage room do not have to be spoken. In the case of (B2) above, reply that the deletion of inventory registration R1 has failed, such as "There is no ice in the freezer." In the case of (B3) above, for example, when the refrigerating room 11A has only 100 grams of chicken thighs and the deletion instruction "Delete 200 grams of chicken thighs in the refrigerating room" is received, the registration management unit 422 , Delete 100 grams of chicken thigh inventory registration R1 for refrigerating room 11A. Then, the response control unit 423 replied that the inventory registration R1 was deleted within the range of the registered inventory amount, such as "There is only 100 grams of chicken thigh in the refrigerator compartment. All deleted." do. In the case of the above (B3), the response control unit 423 replies that the processing has failed, such as "The unit is different from the registration, so change it." In the case of the above (B5), the response control unit 423 replies that the process has failed, such as "I'm sorry. It failed. Please try again."

Here, the priority of the response by the response control unit 423 is (B1), (B3), (B2), (B4) in the order when two or more of the above (B1) to (B4) occur at the same time. It will be low. That is, the priority of (B1) is the highest, and the priority of (B4) is the lowest. The "response priority" is the priority of the output order of the processing results (which processing result is output first). In the present embodiment, when two errors of "there is no stock of ingredients (B2)" and "insufficient quantity of ingredients (B3)" occur when the deletion instruction regarding a plurality of ingredients is received, "the ingredients". The error related to "insufficient quantity (B3)" is output first, and the error related to "there is no stock of ingredients (B2)" is output later. For example, if there is an inventory registration R1 for 2 tomatoes and there is no inventory registration R1 for cabbage, and a deletion instruction is received saying "Delete 3 cabbage and 3 tomatoes", "There are only 2 tomatoes. I have deleted everything. There is no cabbage. "

<5.3 Inventory check>
<5.3.1 Inventory check with specified ingredients>
In the present embodiment, the instruction receiving unit 421 can accept inventory confirmation with designated ingredients. "Inventory check with specified ingredients" means "Do you have eggs?", "Do you have chicken thighs and milk?", "Do you have two eggs?", "How many dried horse mackerel?" It is an instruction to check inventory with a name.

In this case, the registration management unit 422 has "inventory (C1)", "out of stock for all ingredients (C2)", and "out of stock for some ingredients (C2)" for inventory confirmation based on the inventory list DB521. C3) ”is determined.

In the case of the above (C1), the response control unit 423 indicates that the food is in stock by indicating the name and quantity of the ingredients, such as "There are two eggs." In the case of the above (C2), the response control unit 423 replies that all the ingredients to be checked for inventory are not available, such as "Well, there is no chicken thigh and milk". It is not necessary to have a connecting word such as "um". In the case of (C3) above, the response control unit 423 answers the ingredients that are in stock and the ingredients that are not in stock, such as "There is chicken thigh. There is no milk."

<5.3.2 Inventory check with designated storage room>
In the present embodiment, the instruction receiving unit 421 can receive the inventory confirmation in which the storage room 11 is designated. "Inventory confirmation with a designated storage room" is an instruction for inventory confirmation with the name of the storage room 11, such as "what is in the vegetable room?" And "is there dried horse mackerel in the freezer?".

In this case, based on the inventory list DB 521, the registration management unit 422 states that "there is one or more inventories in the designated storage room (D1)" and "there is no inventory in the designated storage room" for the inventory check target (D1). It is determined whether it corresponds to "D2)", "there is a designated ingredient in the designated storage room (D3)", or "there is no designated ingredient in the designated storage chamber (D4)".

In the case of (D1) above, the response control unit 423 says, "There are 7 registrations in the vegetable room. There are 1 for XX, 2 for XX, .... The other 2 points can be confirmed with the app. The number of inventory registration R1s in the specified storage room, the number of ingredients registered up to the specified number (for example, 5 points), the number of inventory registration R1s other than the aloud ingredients, and the confirmation method are answered. The reading of a predetermined number of ingredients is, for example, in the order of oldest purchase date or the closest ingestion deadline. In the case of the above (D2), the response control unit 423 replies that there is no food in the designated storage room 11 such as "Oh, there is no food in the vegetable room 11C". It is not necessary to have a connecting word such as "that". In the case of (D3) above, the response control unit 423 replies that the designated storage room 11, the name of the foodstuff, and the quantity are in stock, such as "There are two dried horse mackerel in the freezer." .. In the case of the above (D4), the response control unit 423 indicates the designated storage room 11 such as "There is no dried horse mackerel in the freezer" and replies that the designated foodstuff name is out of stock.

<5.3.3 Inventory check without specifying ingredients and storage room>
In the present embodiment, the instruction receiving unit 421 can accept inventory confirmation without designating the foodstuff and the storage room 11. "Inventory confirmation without specifying ingredients and storage room" is an instruction for inventory confirmation of all ingredients registered in the inventory list DB521, such as "what is in the refrigerator?" And "read out the ingredient list".

In this case, the registration management unit 422 determines whether it corresponds to "there is one or more inventories (E1)" or "there is no inventory (E2)" based on the inventory list DB 521. In the case of the above (E1), the response control unit 423 says, "There are 12 registered points. There is 1 for XX, 2 for XX, .... The other 7 points can be confirmed with the app." Answer the number of all inventory registration R1, the number of ingredients registered up to a predetermined number (for example, 5 points), the number of inventory registration R1 other than the read ingredients, and the confirmation method. The reading of a predetermined number of ingredients is, for example, in the order of oldest purchase date or the closest ingestion deadline. In the case of the above (E2), the response control unit 423 replies that there is no stock, such as "out of stock".

<5.4 Out of stock confirmation>
In the present embodiment, the instruction receiving unit 421 can accept the out-of-stock confirmation. "Check out of stock" is an instruction to check the ingredients that are out of stock among the ingredients set in the regular item DB256, such as "Tell me what is out of stock" and "Frequently used ingredients that are not available now". ..

In this case, the registration management unit 422 has "there is inventory registration R1 in the inventory list DB 521 for all the ingredients registered in the regular product DB 526 (F1)" based on the comparison between the inventory list DB 521 and the regular product DB 526. It is determined which of "there is no inventory registration R1 in the inventory list DB 521 (F2) for some or all of the ingredients registered in the regular product DB 526".

In the case of the above (F1), the response control unit 423 replies, "There are all regular foods." In the case of the above (F2), the response control unit 423 says, "There are 7 registered ingredients that are not in the refrigerator. There are no 〇〇, 〇〇, .... You can check the other 2 points with the app." Answer the number of out-of-stock ingredients, the number of out-of-stock ingredients up to a predetermined number (for example, 5 points), the number of out-of-stock ingredients other than the read-out ingredients, and the confirmation method. The reading of a predetermined number of ingredients is, for example, in the order of oldest registration in the regular goods DB 526. In the case of the above (F2), the response control unit 423 outputs a question "Do you want to add it to the shopping list?". Then, when the positive answer of the user U to the question is received by the instruction receiving unit 421, the registration management unit 422 does not have the inventory registration in the inventory list DB 521 among the ingredients registered in the regular item DB 526. All ingredients are added to the shopping list DB522.

<5.5 Check shopping list>
In the present embodiment, the instruction receiving unit 421 can accept confirmation (browsing) of the shopping list. "Confirming the shopping list" is an instruction to confirm the contents of the shopping list, such as "what is in the shopping list?" And "what should I buy?". In this case, the response control unit 423 puts the shopping list DB522 on the basis of the shopping list DB522, such as "There are 6 points registered. There are 〇〇, 〇〇, .... The other 1 point can be confirmed by the application." Answer the number of registered shopping registration R2, the number of ingredients up to a predetermined number (for example, 5 points), the number of shopping registration R2 other than the read ingredients, and the confirmation method. For reading aloud a predetermined number of ingredients, for example, registration in the shopping list DB522 is in the new order. That is, the most recently registered shopping registration R2 is read aloud earlier. However, the reading of a predetermined number of ingredients may be performed in the order of oldest registration in the shopping list DB522, for example.

<5.6 Confirmation of regular equipment list>
In the present embodiment, the instruction receiving unit 421 can accept confirmation (browsing) of the regular equipment list. "Confirmation of regular food list" is an instruction to confirm the contents registered in the regular food DB 526 such as "what are the frequently used ingredients?" And "tell me the regular food". In this case, the response control unit 423 is based on the regular product DB 526, such as "There are 15 registration points. There are 〇〇, 〇〇, .... The other 10 points can be confirmed with the application." Answer the number of registered registrations, the number of registered ingredients up to the specified number (for example, 5 points), the number of registrations other than the read ingredients, and the confirmation method. The reading of a predetermined number of ingredients is, for example, in the order of oldest registration in the regular goods DB 526.

Next, some control examples related to the addition and deletion of registrations will be described. In the following description, "when the instruction is accepted" means the case where the instruction of the user U is accepted by the instruction receiving unit 421.

<6. Control example related to deletion instruction whose deletion target is not clear>
<6.1 Processing content>
As shown in FIG. 12, the inventory list DB 521 may have a plurality of inventory registrations R1 for ingredients having the same name (ingredients of the same type). In the example shown in FIG. 12, there are a plurality of inventory registrations R1 having different purchase dates for “pork”. In the following, a plurality of inventory registration R1s relating to foodstuffs having the same name may be simply referred to as “plurality inventory registration RS”.

When the registration management unit 422 has a plurality of inventory registration RSs for ingredients having the same name and the deletion instruction of the user U who has specified the deletion target is received, the registration management unit 422 registers the inventory to be deleted from among the plurality of inventory registration RSs. Delete R1. The "deletion instruction of the user U for which the deletion target is specified" is a deletion instruction that can uniquely identify the inventory registration R1 to be deleted from among a plurality of inventory registration RSs. The deletion instruction of the user U who specified the deletion target distinguishes multiple inventory registration RSs from each other, such as "Delete XX whose purchase date is X-month and X-day" and "Delete the oldest XX". Possible deletion instructions.

On the other hand, the registration management unit 422 of the present embodiment sets in advance when there are a plurality of inventory registration RSs for foodstuffs having the same name and a deletion instruction for inventory registration R1 whose deletion target is unknown for the foodstuffs is received. One or more stock registration R1s out of a plurality of stock registration RSs are deleted based on the given priority. For example, when the registration management unit 422 receives the deletion instruction of the inventory registration R1 whose deletion target is unknown, the registration management unit 422 deletes one inventory registration R1 having the highest priority in the above-mentioned priority among the plurality of inventory registration R1s. ..

Here, the foodstuff with the same name is an example of "foodstuff in the same category". The foodstuffs in the same category are not limited to the foodstuffs having the same name, and may include a plurality of types of foodstuffs preset in the same category. For example, "tomato" and "petit tomato" may be preset as ingredients in the same category. Further, the classification may be preset for each group of ingredients, not for each ingredient. For example, when "salmon", "tuna", "sea bream", etc. are set as "fish" as ingredients in the same category, and the user U's deletion instruction "delete fish" is accepted, "" One or more of the multiple inventory registrations R1 related to "fish" (for example, "salmon", "tuna", and "sea bream" inventory registration R1) are based on the above priority (for example, chronological order of purchase date). It may be deleted. "Category" may be read as "classification". In the following, an example in which the classification is set for each ingredient having the same name will be described.

In the present embodiment, the above-mentioned priority is in the order of oldest purchase date of the ingredients. However, the priority may be in the order of earliest ingestion deadline instead of the above example. The order of "intake deadline" is the order in which the ingestion deadline arrives earlier.

FIG. 13 is a diagram showing one control example regarding deletion of inventory registration R1. In the example shown in FIG. 13, as a plurality of inventory registration RSs related to "pork", there are inventory registration R1 on "purchase date: May 31" and inventory registration R1 on "purchase date: June 2". In this case, when the user U's deletion instruction (for example, the deletion instruction by utterance) of "delete pork" is received, the registration management unit 422 will "delete the pork" based on the priority of the purchase date of the ingredients in the oldest order. The inventory registration R1 of "purchase date: May 31" is deleted, and the inventory registration R1 of "purchase date: June 2" is maintained as it is.

Here, a plurality of inventory registration RSs may have different inventory amounts from each other. The registration management unit 422 has the first registration indicating that the plurality of inventory registration RSs relating to a certain food material have the first amount of the above foodstuff, and the above-mentioned first registration has a lower priority than the above-mentioned first registration. Including the second registration indicating that there is a second amount of the above-mentioned foodstuff more than one amount, the deletion instruction to delete the above-mentioned foodstuff in an amount larger than the first amount of the above-mentioned foodstuff whose deletion target is unknown. Is accepted, the first registration is deleted, but the second registration is maintained in the second amount. In this case, the response control unit 423 may notify the user U that the second registration is maintained as the second quantity.

FIG. 14 is a diagram showing another control example regarding the deletion of inventory registration. In the example shown in FIG. 14, as a plurality of inventory registration RSs related to "pork", inventory registration R1 of "purchase date: May 31st, inventory amount: 200 grams" and "purchase date: June 2nd, inventory amount" There is an inventory registration R1 of ": 300 grams". In this case, when the user U's deletion instruction (for example, deletion instruction by utterance) "Delete 300 grams of pork" is received, the registration management unit 422 "purchase date: May 31, inventory amount: 200". The inventory registration R1 of "gram" is deleted, and the inventory registration R1 of "purchase date: June 2, inventory amount: 300 grams" is maintained as it is.

Furthermore, in the same situation as above, the registration management unit 422 of the present embodiment receives a deletion instruction for deleting the above-mentioned foodstuff in an amount larger than the above-mentioned second amount, for which the deletion target of the above-mentioned foodstuff is unknown. However, the first registration is deleted, but the second registration is maintained as the second amount. That is, as in the example shown in FIG. 14, as a plurality of inventory registration RSs related to "pork", inventory registration R1 of "purchase date: May 31st, inventory amount: 200 grams" and "purchase date: June 2nd". If there is an inventory registration R1 of "day, inventory amount: 300 grams" and the user U's deletion instruction (for example, deletion instruction by speech) "delete 400 grams of pork" is received, the registration management unit 422 Deletes the inventory registration R1 of "purchase date: May 31, inventory amount: 200 grams" and keeps the inventory registration R1 of "purchase date: June 2, inventory amount: 300 grams" as it is.

By performing such a process, it is possible to prevent the inventory registration R1 that is not the deletion target from being unintentionally deleted when the user U mistakenly specifies a large amount of the inventory registration R1 to be deleted. Can be done. On the other hand, if the amount of the deletion instruction is correct (when it is desired to delete the inventory registration R1 having a new purchase date together), the inventory amount of the inventory registration R1 having a new purchase date does not decrease appropriately, but the inventory registration R1 Is in a state where the remaining user U can be easily confirmed in the inventory list DB 521. Therefore, the user U can easily correct the inventory amount of the inventory registration R1 having a new purchase date to the correct amount by issuing an additional deletion instruction. ..

In the present embodiment, the response control unit 423 of the inventory registration R1 whose deletion target is unknown regarding the foodstuff in the case where a part or all of the plurality of inventory registration RSs related to the foodstuff to be deleted is the stock registration related to the freezing room 11E. When the deletion instruction is received, a question indicating which inventory registration R1 is to be deleted is output from the notification unit (voice dialogue device 200, the display device 30 of the refrigerator 100, or the display device 310 of the terminal device 300).

In the present embodiment, when the question is output, the response control unit 423 sends a predetermined control signal to the first server device 410 to output the question by voice from the voice dialogue device 200. In this case, the response control unit 423 attaches different identification information to a plurality of inventory registration RSs related to the foodstuff to be deleted and outputs the voice. The identification information is, for example, a different number or a different alphabet, but is not limited to the above example as long as it can respond with a short utterance or is easily distinguishable (easy to recognize). The registration management unit 422 identifies the inventory registration R1 to be deleted based on the voice input instruction of the user U who specifies the identification information received by the instruction reception unit 421. On the other hand, the registration management unit 422 specifies the food material name when the instruction reception unit 421 receives an instruction based on the voice input for designating the food material name in addition to the instruction based on the voice input for designating the identification information. The instruction based on the voice input to be deleted is not used for specifying the inventory registration R1 to be deleted, or is used with a smaller weighting than the above identification information. The identification information may be managed as a part of each inventory registration R1 in association with the information indicating the food material (food material information) in the inventory list DB 521, for example.

FIG. 15 is a diagram showing still another control example regarding the deletion of the inventory registration R1. In the example shown in FIG. 15, as a plurality of inventory registration RSs, inventory registration R1 of "purchase date: May 31, storage room: freezing room" and "purchase date: June 2, storage room: refrigerating room". There is an inventory registration R1 of. In this case, when the user U's deletion instruction (for example, the deletion instruction by utterance) of "Delete the pork" is received, the response control unit 423 "No. 1, the pork on the purchase date May 31 and 2 The voice dialogue device 200 outputs the question "Which one do you want to delete, the number, the pork on June 2, the purchase date?" In addition, the response control unit 423 asks, "Which one should be deleted, No. 1, purchase date May 31, freezer room pork or No. 2, purchase date June 2, refrigeration room pork?" The question with the storage chamber 11 may be output from the voice dialogue device 200.

Then, the instruction receiving unit 421 waits for the additional instruction by the voice of the user U. For example, when there is a voice response from the user U saying "Delete No. 1", the instruction reception unit 421 deletes the inventory registration R1 of "Purchase date: May 31st, Storage room: Freezing room". Specified as inventory registration R1. In this case, the registration management unit 422 deletes the inventory registration R1 to be deleted specified by the instruction reception unit 421 from the inventory list DB 521.

<6.2 Control flow>
FIG. 16 is a flowchart showing a process related to deletion of inventory registration R1. First, the instruction receiving unit 421 receives an instruction to delete the inventory registration R1 by the user U (S101). Next, when the deletion instruction is received by the instruction receiving unit 421, the registration management unit 422 determines whether or not the inventory registration R1 corresponding to the target of the deletion instruction is in the inventory list DB 521 (S102). When the inventory registration R1 corresponding to the target of the deletion instruction is not in the inventory list DB 521 (S102: NO), the response control unit 423 notifies the user U that there is no inventory registration R1 corresponding to the target of the deletion instruction (S103). ), End the process.

When the inventory registration R1 corresponding to the target of the deletion instruction is in the inventory list DB 521 (S102: YES), the registration management unit 422 indicates whether or not there are two or more inventory registration R1s corresponding to the target of the deletion instruction in the inventory list DB 521. (S104). When there is only one inventory registration R1 corresponding to the target of the deletion instruction in the inventory list DB 521 (S104: NO), the registration management unit 422 deletes the inventory registration R1 corresponding to the target of the deletion instruction (S105). In this case, the response control unit 423 notifies the user U of the deleted inventory registration R1 (S109), and ends the process.

When the inventory registration R1 corresponding to the target of the deletion instruction is two or more in the inventory list DB 521 (S104: YES), the registration management unit 422 can specify the inventory registration R1 to be deleted based on the instruction of the user U. Whether or not (that is, whether or not the deletion instruction can uniquely identify the deletion target) is determined (S105). When the registration management unit 422 can specify the inventory registration R1 to be deleted (S105: YES), the registration management unit 422 deletes the specified inventory registration R1 (S107). In this case, the response control unit 423 notifies the user U of the deleted inventory registration R1 (S109), and ends the process.

On the other hand, when the registration management unit 422 cannot specify the inventory registration R1 to be deleted (S105: NO), the registration management unit 422 deletes one inventory registration R1 corresponding to the target of the deletion instruction based on the above priority order (S105: NO). S108). In this case, the response control unit 423 notifies the user U of the deleted inventory registration R1 (S109), and ends the process.

<6.3 Advantages>
In the present embodiment, when the deletion instruction of the inventory registration R1 whose deletion target is unknown is received, one or more inventory registration R1s among the plurality of inventory registration RSs are deleted based on the preset priority order. According to such a configuration, even if there are a plurality of inventory registration R1s of ingredients having the same name, it is possible to prevent the user U from requesting a detailed deletion instruction or inquiring the user U many times. The inventory registration R1 can be deleted, and the burden on the user U can be reduced. As a result, the convenience of the user U can be improved.

In the present embodiment, the order of priority is the oldest purchase date of the food or the earliest intake deadline. Since there is a high possibility that ingredients with an old purchase date or ingredients with an ingestion deadline will be used preferentially in cooking, the intention of the user U is to preferentially delete the ingredients with an old purchase date or ingredients with an ingestion deadline. The street deletion process can be performed with higher accuracy.

In the present embodiment, when a part or all of the plurality of inventory registration RSs is the inventory registration R1 related to the freezing chamber 11E, a question indicating which inventory registration R1 is to be deleted is output. Since the ingredients stored in the freezer 11E may be used later even if the purchase date is old, by asking the user a confirmation question, the deletion process as intended by the user U can be performed with higher accuracy. It can be carried out.

In the present embodiment, when the above question is output, different identification information is attached to a plurality of inventory registration RSs and output by voice, and the inventory to be deleted is based on the instruction by the voice input of the user who specifies the identification information. Registration R1 is specified. With such a configuration, it is possible to reduce erroneous recognition in voice input. As a result, the deletion process as intended by the user U can be performed with higher accuracy.

In the above-mentioned control example, when the deletion instruction of the inventory registration R1 whose deletion target is unknown is received, one inventory registration R1 having the highest priority in the above priority among the plurality of inventory registration R1s is deleted. To. Instead of this, when the amount instructed to be deleted by the user U's deletion instruction is equal to or greater than the predetermined amount, the registration management unit 422 has the above-mentioned priority among the plurality of inventory registration R1s according to the amount instructed to delete. It is also possible to delete two or three or more inventory registrations R1 having a high priority in.

<6.4 Modification example>
(First modification)
The registration management unit 422 of the first modification received a deletion instruction for which the deletion target is unknown for the foodstuff in the case where a part of the plurality of inventory registration RSs for the foodstuff to be deleted is the inventory registration R1 for the freezing room 11E. In this case, at least a part of the inventory registration R1 related to the freezing chamber 11E is excluded, and one or more inventory registration R1 among the plurality of inventory registration RSs is deleted. That is, in this modification, at least a part of the inventory registration R1 related to the freezing chamber 11E is automatically excluded, and the inventory registration to be deleted from the inventory registration R1 of the foodstuff stored in the storage chamber 11 different from the freezing chamber 11E. R1 is specified. According to such a configuration, when the user U wants to delete the foodstuff stored in the freezing chamber 11E, the user U can perform the deletion processing according to the deletion instruction specifying the storage chamber 11, and the other storage chamber 11 can be deleted. If you want to delete the saved ingredients, you can delete them with a simpler deletion instruction. This makes it possible to further enhance the convenience of the user. The term "excluding at least a part" here means, for example, if there are inventory registrations R1 for the freezing room 11E that satisfy specific conditions, they are not excluded from the candidates to be deleted, and they are the refrigerating room 11A. It means that it may be determined whether or not it is a deletion target based on the same criteria as the inventory registration R1 related to. In "inventory registration satisfying specific conditions", the purchase date of the inventory registration R1 in which the foodstuff stored in the freezing room 11E corresponds to a specific food category (for example, fruit) or the foodstuff stored in the freezing room 11E is a predetermined period. Inventory registration R1 older than the date, but not limited to these.

(Second modification)
The registration management unit 422 of the second modification is instructed to delete the inventory registration R1 whose deletion target is unknown for the foodstuff in the case where the plurality of inventory registration RSs for the foodstuff to be deleted are the registration for the storage room in the same temperature zone. Is accepted, one or more of the plurality of inventory registrations R1 are deleted based on the priority of the first criterion, which is the order of the oldest purchase date or the earliest intake deadline of the above-mentioned ingredients. On the other hand, the registration management unit 422 of this modification is the inventory registration R1 in which the deletion target is unknown for the food material in the case where the plurality of inventory registration RSs for the food material to be deleted are the registration for the storage chamber 11 in different temperature zones. When the deletion instruction is received, one or more of the plurality of inventory registration R1s are deleted based on the priority order based on the second criterion different from the first criterion. These first and second criteria are stored in the storage unit 425 as food material priority information 527.

The second criterion is, for example, a preset priority according to the type of the storage chamber 11. For example, in the second criterion, the lower the temperature zone of the storage chamber 11, the lower the priority. For example, the priority order is lower in the order of the refrigerating room 11A and the freezing room 11E. As described above, in the present specification, "lowering in the order of X and Y" means that X is high and Y is low. That is, when the plurality of inventory registration RSs are the inventory registration R1 for the different refrigerating room 11A and the inventory registration R1 for the freezing room 11E, the registration management unit 422 preferentially deletes the inventory registration R1 for the refrigerating room 11A. The foodstuff stored in the refrigerator compartment 11A is likely to be used earlier than the foodstuff stored in the freezer chamber 11E. Therefore, according to the above processing, it may be possible to perform the deletion processing as intended by the user U with higher accuracy.

In another example, the priority of the second criterion is lower in the order of the chilled chamber 11B, the refrigerating chamber 11A, and the freezing chamber 11E. The foodstuff stored in the chilled chamber 11B is likely to be used earlier than the foodstuff stored in the refrigerator compartment 11A and the freezing chamber 11E. Therefore, according to the above processing, it may be possible to perform the deletion processing as intended by the user U with higher accuracy.

FIG. 17 is a diagram showing an example of the contents of the food material priority information 527. In the example shown in FIG. 17, the priority of the second criterion is lower in the order of the chilled chamber 11B, the refrigerating chamber 11A, the vegetable chamber 11C, and the freezing chamber 11E. Vegetables stored in the chilled room 11B and the refrigerating room 11A are likely to be used earlier than the vegetables stored in the vegetable room 11C. Therefore, according to the above processing, it may be possible to perform the deletion processing as intended by the user U with higher accuracy.

However, the first criterion and the second criterion in this modification are not limited to the above examples. In the above-described modification, the refrigerating chamber 11A, the vegetable compartment 11C, and the chilled chamber 11B are classified as storage chambers 11 in different temperature zones. However, from a large point of view, the refrigerating room 11A and the vegetable room 11C can be regarded as the storage room 11 in the same temperature range. In this case, even if a plurality of inventory registration RSs related to the foodstuff to be deleted are registered separately in the refrigerator compartment 11A and the vegetable compartment 11C, the deletion instruction of the inventory registration R1 whose deletion target is unknown regarding the foodstuff is accepted. If so, the inventory registration R1 of the foodstuff with the oldest purchase date (or the foodstuff with the earliest intake deadline) may be deleted from the stock registration R1 of the foodstuffs stored in the refrigerating room 11A and the vegetable room 11C.

(Third modification example)
When the registration management unit 422 of the third modification has a plurality of inventory registration RSs related to the foodstuff to be deleted and the deletion instruction of the inventory registration R1 whose deletion target is unknown is received for the foodstuff, the purchase date of the foodstuff And, regardless of the intake deadline, one or more of the plurality of inventory registrations R1 are deleted based only on the priority set in advance according to the type of the storage chamber 11. That is, the registration management unit 422 of the third modification determines the inventory registration R1 to be deleted based only on the priority of the second criterion described above. The details of the priority of the present modification are the same as the priority of the second criterion of the second modification.

(Fourth modification)
In the fourth modification, the priority set in advance according to the type of the storage chamber 11 differs depending on the food material. That is, when a plurality of inventory registration RSs include a first registration in which the foodstuff is in the first storage chamber and a second registration in which the foodstuff is in the second storage chamber having a lower temperature zone than the first storage chamber. When the food material is the first food material, the priority is lowered in the order of the first storage room and the second storage room, and when the food material is a second food material different from the first food material, the above The order of priority is lower in the order of the second storage chamber and the first storage chamber.

In one example, the first storage chamber is a refrigerating chamber 11A, the second storage chamber is a chilled chamber 11B, the first foodstuff is meat or seafood, and the second foodstuff is vegetables. Is. That is, when the inventory registration R1 to be deleted is meat or fish and shellfish, the registration management unit 422 preferentially deletes the inventory registration R1 related to the refrigerating room 11A over the inventory registration R1 related to the chilled room 11B. On the other hand, when the inventory registration R1 to be deleted is a vegetable, the registration management unit 422 preferentially deletes the inventory registration R1 related to the chilled room 11B over the inventory registration R1 related to the refrigerating room 11A. This is because the meat and seafood stored in the refrigerator compartment 11A are likely to be used earlier than the meat and seafood stored in the chilled chamber 11B, while some vegetables are stored in the chilled chamber 11B. This is because they are often cooked (eg, cut) vegetables and are more likely to be used earlier than vegetables stored in the refrigerator compartment 11A.

In another example, the first storage room is a refrigerating room 11A, a chilled room 11B, or a vegetable room 11C, the second storage room is a freezing room 11E, and the first foodstuff is vegetables, meat, and the like. Alternatively, it is seafood, and the second foodstuff is fruit. That is, when the inventory registration R1 to be deleted is vegetables, meat, or seafood, the registration management unit 422 has more inventory related to the refrigerating room 11A, the chilled room 11B, or the vegetable room 11C than the inventory registration R1 related to the freezing room 11E. Priority is given to the registration R1 and deleted. On the other hand, when the inventory registration R1 to be deleted is a fruit, the registration management unit 422 gives priority to the inventory registration R1 related to the freezing room 11E over the inventory registration R1 related to the refrigerating room 11A, the chilled room 11B, or the vegetable room 11C. And delete it. This is because the vegetables, meats, and seafood stored in the refrigerator compartment 11A, chilled chamber 11B, or vegetable compartment 11C are likely to be used earlier than the vegetables, meats, and seafood stored in the freezer chamber 11E. On the other hand, the fruits stored in the freezing chamber 11E are likely to be eaten as frozen fruits early.

(Fifth modification)
The registration management unit 422 of the fifth modification includes a first registration indicating that the plurality of inventory registration RSs have the ingredients in the chilled chamber 11B and a second registration indicating that the refrigerating chamber 11A has the ingredients. In this case, when the operation mode for cooling the chilled chamber 11B is the first operation mode, the priority is lowered in the order of the chilled chamber 11B and the refrigerating chamber 11A, and the operation mode for cooling the chilled chamber 11B is the first operation mode. In the case of the second operation mode in which the temperature zone is lower than that of the above, the priority is lowered in the order of the refrigerating chamber 11A and the chilled chamber 11B. This is because when operated in the operation mode in which the temperature zone of the chilled chamber 11B is low, the foodstuff stored in the refrigerating room 11A is likely to be used earlier than the foodstuff stored in the chilled chamber 11B. be.

For example, when the operation mode for cooling the chilled room 11B is the "normal chilled" operation mode, the registration management unit 422 preferentially deletes the inventory registration R1 for the chilled room 11B over the inventory registration R1 for the refrigerating room 11A. do. On the other hand, when the operation mode for cooling the chilled chamber 11B is the "rapid chilled" operation mode, the registration management unit 422 gives priority to the inventory registration R1 for the refrigerating chamber 11A over the inventory registration R1 for the chilled chamber 11B. delete.

In another example, when the operation mode for cooling the chilled room 11B is the "thaw" operation mode, the registration management unit 422 gives priority to the inventory registration R1 for the chilled room 11B over the inventory registration R1 for the refrigerating room 11A. And delete it. On the other hand, when the operation mode for cooling the chilled chamber 11B is the "normal chilled" operation mode, the registration management unit 422 gives priority to the inventory registration R1 for the refrigerating chamber 11A over the inventory registration R1 for the chilled chamber 11B. delete.

In yet another example, when the operation mode for cooling the chilled room 11B is the "normal" operation mode, the registration management unit 422 gives priority to the inventory registration R1 for the chilled room 11B over the inventory registration R1 for the refrigerating room 11A. And delete it. On the other hand, when the operation mode for cooling the chilled room 11B is the "special chilled" operation mode, the registration management unit 422 gives priority to the inventory registration R1 for the refrigerating room 11A over the inventory registration R1 for the chilled room 11B. delete.

Although some modified examples have been described above, the modified examples are not limited to the above-mentioned examples. For example, when a plurality of inventory registration RSs are divided into a plurality of storage chambers 11, the response control unit 423 may ask the user U which inventory registration R1 to delete each time. Further, even if the registration management unit 422 determines the inventory registration R1 to be deleted only in the storage room 11 in which the door 20 is opened, based on the detection result of the open / close switch (not shown) of the door 20 of the refrigerator 100. good.

<7. Control example regarding error reporting order>
<7.1 Processing content>
As described above, the instruction receiving unit 421 of the present embodiment can receive an instruction based on the voice input of the user U who simultaneously adds or deletes the registration of a plurality of ingredients. As used herein, the term "addition or deletion at the same time" does not mean an exact time match, but means an addition or deletion instructed in a group of utterances of the user U. When such an instruction is received, the processing of some of the plurality of ingredients may be completed normally, but the processing of some of the other ingredients may fail. In this case, the response control unit 423 notifies the user U of the error in the following reporting order. The priority of the response including the reporting order of these errors is preset and stored in the storage unit 425 as the response priority information 528. As used herein, the term "normal" means a state in which an error is not notified to the user U.

More specifically, when the response control unit 423 does not normally accept the instruction of the user U regarding the addition or deletion of the registration of some of the plurality of ingredients by the instruction receiving unit 421 (that is, of the plurality of ingredients). (When an error is output regarding the registration of some of the ingredients), regardless of the order in which the plurality of ingredients are spoken in the voice input, the ingredients for which the above instruction is normally accepted among the plurality of ingredients (that is, the above error). The processing result for the foodstuff that is not the target) is output first, and the processing result for the foodstuff that the above instruction is not normally accepted among the plurality of foodstuffs (that is, the foodstuff that is the target of the error) is output later. The term "registration" here is not limited to inventory registration R1, but also includes shopping registration R2, deletion registration R3, proposal registration R4, and the like.

For example, if the removal instruction "Delete 3 cabbage and 1 tomato" is accepted and there is only 1 cabbage, the response control unit 423 "Deleted 1 tomato. Cabbage." There is only one. I deleted all of them. ”Even if the response is related to the ingredients specified earlier in one utterance, the response related to the ingredients with an error is output later.

As described above, the registration management unit 422 manages the maximum number of registered ingredients in each inventory registration R1 as 999 points and the maximum number of registered items in inventory registration R1 as 100. The response control unit 423 described above when the first error regarding the maximum registered quantity of ingredients and the second error regarding the maximum number of registered items of inventory registration R1 occur at the same time in the process related to the instruction to add the registration of a plurality of ingredients at the same time. The first error is output first, and the second error is output later. The first error is an error that occurs when an attempt is made to add an inventory registration R1 having a quantity exceeding the maximum registration quantity. The second error is an error that occurs when an attempt is made to further add the inventory registration R1 while the inventory registration R1 having the maximum number of registrations has already been registered. As used herein, "occurs at the same time" does not mean an exact time match, but means that a plurality of errors occur with respect to the contents instructed in a group of utterances of the user U.

Here, as described above, when the first error occurs, the registration management unit 422 of the present embodiment registers the food material in which the first error occurs in a predetermined quantity equal to or less than the maximum registration quantity. That is, as described above, when an additional instruction for inventory registration R1 such as "add 1500 grams of beef to the refrigerator compartment" is received, the registration management unit 422 sets the quantity of the foodstuff to be added to the maximum registered quantity ( Add inventory registration R1 as (999 grams). The predetermined quantity is not limited to the maximum registered quantity, and may be a smaller quantity. As described above, when an additional instruction for inventory registration R1 such as "add 1500 cabbage to the refrigerator" is received, a predetermined quantity (for example, 20 cabbage in the case of cabbage) preset according to the foodstuff is received. ) May add inventory registration R1.

Therefore, in the present embodiment, when the first error and the second error occur at the same time in the process related to the instruction to add the registration of a plurality of ingredients at the same time, the registration management unit 422 causes the first error. The foodstuff is registered in the predetermined quantity (for example, the maximum registered quantity), and the stock registration R1 is not registered for the foodstuff in which the second error occurs. Then, the response control unit 423 outputs that the first food material has been registered in the predetermined quantity (for example, the maximum registered quantity) first together with the first error, and outputs the second error later.

For example, if the instruction "add 1500 grams of beef, add one cabbage" is received and there are already 99 inventory registrations R1 at that time, the response control unit 423 will "maximize the quantity that can be registered." Is 999. 999 grams of beef has been added. The maximum number of registered ingredients is 100. Please delete the ingredients. "

Furthermore, the registration management unit 422 of the present embodiment causes the first error with respect to the first foodstuff among the plurality of foodstuffs, normally processes the second foodstuff among the plurality of foodstuffs, and the plurality of foodstuffs. When the second error regarding the third food material occurs, the registration management unit 422 registers the first food material with the predetermined quantity (for example, the maximum registered quantity), and normally registers the second food material. , The above third ingredient is not registered. Then, the response control unit 423 first outputs that the second food material has been normally processed, and that the first food material has been registered in the predetermined quantity (for example, the maximum registered quantity). It is output next together with the error, and the second error regarding the above third ingredient is output later.

For example, if the instruction "add 3 eggs, add 1500 grams of beef, add 1 cabbage" is received, and there are already 98 inventory registrations R1 at that time, the response control unit 423 will change to ". 3 eggs have been added. The maximum quantity that can be registered is 999. 999 grams of beef has been added. The maximum number of registered ingredients is 100. Please delete the ingredients. "

In the present embodiment, when an error occurs in three or more foodstuffs contained in the plurality of foodstuffs, the registration management unit 422 does not process all of the plurality of foodstuffs. Then, the response control unit 423 outputs a response comprehensively indicating that the processing has failed for the plurality of foodstuffs. In this case, the response control unit 423 does not output the individual contents (contents of the error for each of the above three or more foodstuffs) for the three or more foodstuffs.

For example, when the instruction "delete 200 grams of pork, delete 200 grams of beef, delete two carrots" is accepted, "pork", "beef", for any of the reasons (B1) to (B5) described above, And when the deletion of the stock registration R1 of "carrot" fails, the response control unit 423 responds as "All processing failed. Please give instructions separately."

However, if the above-mentioned plurality of ingredients include four or more ingredients and an error occurs in three or more of them, but one or more other ingredients can be processed normally, the registration management unit 422 may use the registration management unit 422. , The other one or more foodstuffs may be processed normally, and the response control unit 423 may notify the user U that the other one or more foodstuffs have been normally processed.

<7.2 Control flow>
FIG. 18 is a flowchart showing a process related to an instruction of the user U to add or delete registrations of a plurality of ingredients at the same time. First, the instruction receiving unit 421 receives an instruction by the user U (S201). Next, the registration management unit 422 starts the process of adding or deleting the registration based on the instruction by the instruction receiving unit 421 (S202).

Next, the registration management unit 422 determines whether or not any error has occurred in the three or more foodstuffs contained in the plurality of foodstuffs (S203). When some error occurs in the three or more foodstuffs (S203: YES), the response control unit 423 outputs a comprehensive response indicating that the processing has failed for the plurality of foodstuffs (S204), and performs the processing. finish.

If no error has occurred in the above three or more foodstuffs (including the case where the number of foodstuffs to be referred is two or less in the first place) (S203: NO), the registration management unit 422 may add or register multiple foodstuffs at the same time. With respect to the instruction of the user U to be deleted, it is determined whether or not there is an instruction processed normally (S205). When there is a normally processed instruction (S205: YES), the registration management unit 422 assigns the identifier "i" to the normally processed instruction (S206), and proceeds to S207. On the other hand, the registration management unit 422 proceeds to S207 when there is no normally processed instruction (S205: NO).

Next, the registration management unit 422 determines whether or not there is an instruction in which the first error has occurred with respect to the instruction of the user U to add or delete the registration of a plurality of ingredients at the same time (S207). When there is an instruction in which the first error has occurred (S207: YES), the registration management unit 422 assigns the identifier “j” to the instruction in which the first error has occurred (S208), and proceeds to S209. On the other hand, the registration management unit 422 proceeds to S209 when there is no instruction in which the first error has occurred (S207: NO).

Next, the registration management unit 422 determines whether or not there is an instruction in which a second error has occurred with respect to the instruction of the user U to add or delete the registration of a plurality of ingredients at the same time (S209). When there is an instruction in which the second error has occurred (S209: YES), the registration management unit 422 assigns the identifier “k” to the instruction in which the second error has occurred (S210), and proceeds to S211. On the other hand, the registration management unit 422 proceeds to S211 when there is no instruction that the second error has occurred (S209: NO).

Next, the response control unit 423 rearranges the response order to the instruction in the order of the identifiers “i”, “j”, and “k” (S211). Next, the response control unit 423 outputs the response of the processing result to the instruction of the user U based on the response order rearranged in S211 (S212).

<7.3 Advantages>
As a comparative example, consider a foodstuff management system that responds only to the instruction of the user U that the processing has failed. Such a response may cause discomfort to the user U and may complicate the processing of the user U. As a result, the convenience of the user U may decrease.

Therefore, in the foodstuff management system of the present embodiment, when the instruction regarding some foodstuffs among the plurality of foodstuffs is not normally processed, the above-mentioned above-mentioned multiple foodstuffs among the above-mentioned plurality of foodstuffs regardless of the order of speech of the above-mentioned plurality of foodstuffs in the voice input. The processing result for the foodstuff for which the instruction was normally processed is output first, and the processing result for the foodstuff for which the above instruction is not normally processed is output later among the plurality of foodstuffs. According to such a configuration, as compared with the above comparative example, the discomfort of the user U when the processing fails can be reduced, and the subsequent smooth processing can be promoted. Thereby, the convenience of the user U can be enhanced.

In the present embodiment, when the first error regarding the maximum number of registered foodstuffs and the second error regarding the maximum number of registered foodstuffs occur at the same time, the response control unit 423 outputs the first error first, and the above-mentioned The second error is output later. According to such a configuration, by outputting the second error that the user U needs to pay more attention to later than the first error, it is easy to draw the user U's attention to the second error strongly (user U's consciousness). It becomes easy to remain in). This makes it possible to further enhance the convenience of the user U.

Here, when an error occurs in all of three or more ingredients, if all the contents of the error are output, the response becomes long and it becomes difficult to draw the user U's attention to the details of the response. Therefore, in the present embodiment, when an error occurs in three or more foodstuffs, the response control unit 423 outputs a response comprehensively indicating that the processing has failed for the three or more foodstuffs. With such a configuration, the response can be shortened as compared with the case where all errors are output. This makes it possible to further enhance the convenience of the user U.

<7.4 Modification example>
(First modification)
When the response control unit 423 of the first modification receives the instruction of the user U to add or delete the registration of a plurality of foodstuffs at the same time, an error occurs in two or more foodstuffs contained in the plurality of foodstuffs. In this case, a response that comprehensively indicates that the processing has failed for the above-mentioned plurality of ingredients is output. In this case, the response control unit 423 does not output the individual contents (contents of the error for each of the above two or more foodstuffs) for the two or more foodstuffs. As a result, the response can be shortened as compared with the case where all the errors are output. As a result, the convenience of the user U may be further enhanced.

(Second modification)
In the registration management unit 422 of the second modification, the instruction regarding the first foodstuff among the plurality of foodstuffs is not normally recognized by the instruction reception unit 421, and the first error regarding the second foodstuff among the plurality of foodstuffs and the above-mentioned first error. When the second error related to the third foodstuff occurs at the same time among the plurality of foodstuffs, the first foodstuff is not registered, and the second foodstuff is registered in the predetermined quantity (for example, the maximum registered quantity). No registration is made for the above third ingredient. Then, the response control unit 423 outputs that the second food material has been registered in the predetermined quantity (for example, the maximum registered quantity) first together with the first error, and causes the second error regarding the third food material. Next, it is output, and a third error indicating that the first food material was not recognized normally is output later.

For example, when the instruction "add 3 eggs, add 1500 grams of beef, add 1 cabbage" is accepted, there are already 99 inventory registrations R1 at that time, and the instruction regarding "eggs" is normally recognized. If not, the response control unit 423 says, "The maximum quantity that can be registered is 999. 999 grams of beef has been added. The maximum number of registered ingredients is 100. Delete the ingredients. First instruction. Could not be recognized. "

(Third modification example)
In the third modification, along with the analysis result of the voice of the user U from the first server device 410, the likelihood information indicating the likelihood for the recognition result of each instruction of the user U is transmitted to the instruction receiving unit 421 of the second server device 420. It is an example to be done.

When the user U's instruction to add or delete the registration of a plurality of ingredients at the same time is received, the registration management unit 422 of the third modification is likely to be the recognition result of the instruction regarding the first ingredient among the plurality of ingredients. When the degree is less than a preset threshold value and the first error regarding the second ingredient among the plurality of ingredients and the second error regarding the third ingredient among the plurality of ingredients occur at the same time, the above The first food material is registered with the estimated food material (the food material with the highest probability), the second food material is registered with the predetermined quantity (for example, the maximum registered quantity), and the third food material is not registered. Then, the response control unit 423 outputs that the second food material has been registered in the predetermined quantity (for example, the maximum registered quantity) first together with the first error, and causes the second error regarding the third food material. Next, it is output, and it is output later that the first ingredient is registered as the estimated ingredient.

For example, when the instruction "add 3 eggs, add 1500 grams of beef, add 1 cabbage" is accepted, there are already 98 inventory registrations R1 at that time, and the instruction regarding "eggs" shows the recognition result. If the likelihood is less than a preset threshold, the response control unit 423 says, "The maximum quantity that can be registered is 999. Added 999 grams of beef. The maximum number of registered ingredients is 100. Deleted ingredients. Please do. Was it okay if the first ingredient was an egg? I added 3 eggs. " According to such a response, since the response regarding the estimated and registered foodstuff is the last, it is easy to draw the user U's attention to the estimated and registered foodstuff strongly (it is easy to remain in the user U's consciousness). Therefore, if the estimated and registered foodstuff is incorrect, it is possible to increase the possibility that the user U will remember to make a correction.

Although some modified examples have been described above, the modified examples are not limited to the above-mentioned examples. For example, when the instruction of the user U to add or delete the registration of a plurality of ingredients is received and the instruction regarding a part of the plurality of ingredients cannot be recognized, the response control unit 423 cannot recognize the instruction. A response to the effect that the contents could not be recognized or a question to the user U may be output. In this case, the response to the effect that it could not be recognized or the question to the user U is output at the end of the above-mentioned error reporting order (for example, after the notification of the first error and the second error).

<8. Control example when there are multiple refrigerators>
<8.1 Processing content>
As described above, when there are a plurality of refrigerators 100 (for example, refrigerators 100A and 100B) in the same house, the setting unit 424 manages foodstuffs from among the plurality of refrigerators 100 based on the instruction received by the instruction receiving unit 421. Set the refrigerator 100 to be the referent of. "Setting the refrigerator to be the referent of food management" is not limited to the case of newly setting the refrigerator 100 to be the referent of food management, and the refrigerator 100 to be the referent of food management is a certain refrigerator 100. Also includes the case of changing from to another refrigerator 100.

Here, the "referent of foodstuff management" is, for example, a voice instruction of a user U who does not specify the refrigerator 100 for foodstuff management in a voice operation through the voice dialogue device 200 (addition of stock registration R1 of stock list DB521, The refrigerator 100 is the target of addition, deletion, or confirmation of inventory registration R1 when there is a deletion or confirmation). From another point of view, the "referent of foodstuff management" means that, for example, in the operation through the display device 310 of the terminal device 300, the foodstuff management operation can be performed on the foodstuff management top page first displayed after the application is started. Refrigerator 100. In other words, the "referent of foodstuff management" is the refrigerator 100 having the highest priority of foodstuff management among the plurality of refrigerators 100 in the same residence.

In the present embodiment, the setting unit 424 sets the refrigerator 100, which is the target of food management, from among the plurality of refrigerators 100, based on the instruction by the voice input of the user U received by the instruction reception unit 421. In the present embodiment, when the response control unit 423 outputs information indicating a plurality of refrigerators 100 that can be set as a target of food management, the response control unit 423 attaches different identification information to the plurality of refrigerators 100 and outputs them by voice. The identification information is, for example, a different number or a different alphabet, but is not limited to the above example as long as it can respond with a short utterance or is easily distinguishable (easy to recognize). Then, the setting unit 424 sets the refrigerator 100 to be the target of food management based on the instruction based on the voice input of the user U who specifies the identification information.

In the present embodiment, the setting unit 424 can accept the registration of an arbitrary nickname for each of the plurality of refrigerators 100 through the instruction receiving unit 421. Arbitrary names are, for example, "Dad's Refrigerator" and "Mom's Refrigerator", "Large Refrigerator" and "Small Refrigerator", "Kitchen Refrigerator" and "Living Room Refrigerator". This is a name that allows the user U to distinguish between a plurality of refrigerators 100.

FIG. 19 is a diagram showing an example of the contents of the refrigerator registration information 529. In the refrigerator registration information 529, a user ID that can identify the user U, a refrigerator ID that can identify the refrigerator 100, an arbitrary name registered for the refrigerator 100, and which refrigerator 100 is being set as the target of food management. It is associated with information indicating whether or not it is. In the present specification, "a plurality of refrigerators 100 in the same residence" or "a plurality of refrigerators 100 that can be set as a target of foodstuff management" are registered in association with, for example, the same user U (same user ID). It means a plurality of refrigerators 100. Instead, the "multiple refrigerators 100 in the same house" or the "multiple refrigerators 100 that can be set as the target of food management" may be a plurality of refrigerators 100 that communicate with the server 400 through the same router R. good.

In the present embodiment, when the refrigerator 100 to be the referent of the foodstuff management is set (for example, when newly set or changed), the response control unit 423 is referred to as the above-mentioned name given to the plurality of refrigerators 100. The above identification information (for example, a number or an alphabet) is set and output by voice. Then, the setting unit 424 sets the refrigerator 100 to be the target of food management based on the instruction based on the voice input of the user U who specifies the identification information. On the other hand, in the setting unit 424, in addition to the instruction based on the voice input for designating the identification information, when the instruction based on the voice input for designating the nickname is received by the instruction receiving unit 421, the voice for designating the nickname is received. The instruction based on the input is not used for specifying the refrigerator 100 that is the target of food management, or is used with a weighting smaller than that of the above identification information.

For example, when the refrigerator registration information 529 as shown in FIG. 19 is registered, a refrigerator such as "change the refrigerator for food management", "switch the refrigerator", or "want to change to a different refrigerator". When an instruction based on the voice input of the user U indicating the switching of 100 is received by the instruction receiving unit 421, the response control unit 423 has "No. 1, mother's refrigerator, No. 2, father's refrigerator. Ask the voice dialogue device 200 to output the question "Do you want to use the food management function or tell me by number?" Then, the instruction receiving unit 421 waits for an additional instruction by voice of the user U, for example. For example, when there is a voice response from the user U of "No. 1", the setting unit 424 specifies the refrigerator 100 of "ID: 100214" as the refrigerator 100 to be instructed to manage the ingredients. Then, the setting unit 424 switches the refrigerator 100 to be instructed to manage the ingredients by updating the refrigerator registration information 529 based on the information indicating the specified refrigerator 100.

In the present embodiment, the setting unit 424 maintains the setting regarding the referent of the food management until the instruction of the user U who changes the refrigerator 100 to be the referent of the food management is received by the instruction receiving unit 421. That is, once the refrigerator 100 to be the referent of food management is set, the registration of the refrigerator 100 to be the referent of food management is deleted or changed even after the operation through the voice dialogue device 200 or the terminal device 300 is completed. The referent for food management is fixed in the same refrigerator 100 until there is an additional instruction.

<8.2 Example when a new refrigerator is installed>
<8.2.1 Example when a new refrigerator is installed>
When the number of refrigerators 100 that can be set as referents for foodstuff management increases, the response control unit 423 outputs a question indicating which refrigerator 100 is set as the referent for foodstuff management. For example, the response control unit 423 says, "The refrigerator 100 registered in the app has been changed." No. 1, mom's refrigerator, second, dad's refrigerator, third, living room refrigerator. Please use the food management function or tell me by number. " Then, the setting unit 424 sets the refrigerator 100 to be instructed to manage the ingredients based on the answer of the user U to the above question.

<8.2.2 Modification example when a new refrigerator is installed>
In the modified example, when the number of refrigerators 100 that can be set as the referent for food management increases, the setting unit 424 automatically sets the refrigerator 100 to which the registration was added last as the referent for food management. In yet another modification, when the number of refrigerators 100 that can be set as the referent for food management increases, the setting unit 424 is setting the refrigerator 100 to which the registration was added last as the referent for food management. If it is newer than the refrigerator 100 and / or has a larger capacity, the refrigerator 100 to which the registration was added last is automatically set as the referent for food management. The comparison of the novelty or the capacity of the plurality of refrigerators 100 can be performed based on the refrigerator ID registered in the refrigerator registration information 529 and the product information (not shown).

<8.3 Example when the refrigerator is thrown away>
<8.3.1 An example of when the refrigerator is thrown away>
When the first refrigerator (for example, refrigerator 100A) and the second refrigerator (for example, refrigerator 100B) are registered as the refrigerator 100 that can be set as the instruction target for food management, the setting unit 424 is setting as the instruction target for food management. When the registration of the first refrigerator is deleted (for example, when the registration of the first refrigerator is deleted from the refrigerator registration information 529), the inventory registration of the foodstuff related to the first refrigerator is changed to the inventory registration related to the second refrigerator. In this case, the setting unit 424 changes the inventory registration R1 of the first refrigerator to the inventory registration R1 of the second refrigerator while maintaining the information indicating the storage chamber 11 to which each inventory registration R1 is associated. That is, the inventory registration R1 relating to the refrigerating chamber 11A of the first refrigerator is changed to the inventory registration R1 relating to the refrigerating chamber 11A of the second refrigerator, and the inventory registration R1 relating to the freezing chamber 11E of the first refrigerator is the freezing of the second refrigerator. It is changed to inventory registration R1 for room 11E.

For example, when the refrigerator registration information 529 as shown in FIG. 19 is registered, the "dad's refrigerator 100" is set as the referent for food management, and the inventory registration R1 for the "dad's refrigerator 100" is set. The case where the refrigerator compartment 11A has the inventory registration R1 of "200 grams of pork" and the freezer compartment 11E has the inventory registration R1 of "two ice creams" will be described as an example. In this case, if the registration of "Dad's refrigerator 100" is deleted, the inventory registration R1 of "200 grams of pork" is added to the refrigerating room 11A as the inventory registration R1 of "Mother's refrigerator 100", and the freezing room 11E The inventory registration R1 of "2 ice creams" is added.

<8.3.2 Another example when the refrigerator is thrown away>
A plurality of refrigerators 100 that can be set as food management instruction targets include a first refrigerator (for example, refrigerator 100A), a second refrigerator (for example, refrigerator 100B), and a third refrigerator (for example, refrigerator 100C), and are instructed for food management. When the registration of the second refrigerator is deleted when the second refrigerator is set as the target, the response control unit 423 manages the refrigerator 100 of either the first refrigerator or the third refrigerator as the food material. Output a question indicating whether to set it as an instruction target. For example, if there are "Mother's refrigerator", "Dad's refrigerator", and "Living room refrigerator", and the registration of "Dad's refrigerator" that is set as the referent for food management is deleted, the response control unit 423 "The refrigerator 100 registered in the app has been changed." There are No. 1, mother's refrigerator, No. 2, and living room refrigerator. Please tell us which ingredient management function to use by number. Is output. Then, the setting unit 424 sets the refrigerator 100 to be instructed to manage the ingredients based on the answer of the user U to the above question.

<8.4 Control flow>
FIG. 20 is a flowchart showing a process when the number of refrigerators 100 that can be set as a target of foodstuff management is changed. When the number of refrigerators 100 that can be set as the target of foodstuff management is changed, the response control unit 423 determines whether the number of refrigerators 100 after the change is one or two or more (S301). .. When the number of refrigerators 100 after the change is one (S301: 1), the response control unit 423 reads out the name of the refrigerator 100 that can be used at that time (S302). For example, the response control unit 423 outputs a response such as "Currently, the refrigerator of the father can be used."

On the other hand, when the number of refrigerators 100 after the change is two or more (S301: two or more), the response control unit 423 outputs a question indicating which refrigerator 100 is set as the referent for food management (S301: two or more). S303). Next, the instruction receiving unit 421 receives the answer of the user U to the above question (S304). Next, the setting unit 424 sets the refrigerator 100 to be the target of food management based on the response of the user U received by the instruction reception unit 421 (S305). Next, the response control unit 423 reads out the refrigerator 100 set as the target of food management (S306). This ends a series of processes.

<8.5 Advantages>
In the present embodiment, when there are a plurality of refrigerators 100 in the same house, the refrigerator 100 to be instructed to manage the ingredients is set from among the plurality of refrigerators 100 based on the instruction received by the instruction receiving unit 421. According to such a configuration, when a plurality of refrigerators 100 are owned, the food material management function can be assigned to any refrigerator 100. As a result, the management burden on the user U can be reduced as compared with the case where the food material management functions of the plurality of refrigerators 100 are managed separately. As a result, the convenience of the user U can be improved.

In the present embodiment, when the response control unit 423 outputs information indicating a plurality of refrigerators 100 that can be set as a target of food management, the response control unit 423 attaches different identification information to the plurality of refrigerators 100 and outputs them by voice. Then, the setting unit 424 sets the refrigerator 100 to be the target of food management based on the instruction based on the voice of the user U who specifies the identification information. With such a configuration, it is possible to reduce erroneous recognition in voice input. As a result, the deletion process as intended by the user U can be performed with higher accuracy.

According to at least one embodiment described above, when the foodstuff management system receives an instruction to delete an inventory registration whose deletion target is unknown for a certain foodstuff, the foodstuff management system is out of a plurality of inventory registrations based on a preset priority. Delete one or more inventory registrations. With such a configuration, it is possible to improve the usability of the foodstuff management system.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope of the invention described in the claims and the equivalent scope thereof, as are included in the scope and gist of the invention.

1 ... Foodstuff management system, 30 ... Display device (notification unit), 100, 100A, 100B, 100C ... Refrigerator, 200 ... Voice dialogue device (notification unit), 300 ... Terminal equipment, 310 ... Display device (notification unit), 400 ... server, 421 ... instruction reception unit, 422 ... registration management unit, 423 ... response control unit, 424 ... setting unit.

Claims (13)

The reception department that accepts user instructions and
When there are multiple inventory registrations for foodstuffs in the same category and the reception unit receives an instruction to delete inventory registrations for which the deletion target is unknown for the foodstuffs, the plurality of inventory registrations are based on preset priorities. The registration management department that deletes one or more inventory registrations,
Food management system equipped with. The order of priority is the oldest purchase date of the ingredients or the earliest intake deadline.
The foodstuff management system according to claim 1. When a part or all of the plurality of inventory registrations are inventory registrations related to the freezing room, a response control unit for outputting a question indicating which inventory registration is to be deleted in response to the acceptance of the deletion instruction is further provided. Prepared
The foodstuff management system according to claim 1 or 2. When the response control unit outputs the question, the plurality of inventory registrations are attached with different identification information and output by voice.
The registration management unit identifies the inventory registration to be deleted based on the voice input instruction of the user who specifies the identification information.
The foodstuff management system according to claim 3. When the deletion instruction is received when a part of the plurality of inventory registrations is inventory registration related to the freezing room, the registration management unit excludes at least a part of the inventory registration related to the freezing room. Delete one or more inventory registrations in
The foodstuff management system according to any one of claims 1 to 4. The priority is
When the plurality of inventory registrations are inventory registrations for storage rooms in the same temperature range, the priority is based on the first criterion, which is the order of the oldest purchase date or the earliest intake deadline of the ingredients.
When the plurality of inventory registrations are inventory registrations for storage rooms in different temperature zones, the priority is based on the second criterion different from the first criterion.
The foodstuff management system according to claim 1. The second criterion is a preset priority according to the type of the storage chamber.
The foodstuff management system according to claim 6. The priorities are preset according to the type of storage room.
The foodstuff management system according to claim 1. The priority is lower in the order of the refrigerator compartment and the freezer compartment.
The foodstuff management system according to claim 8. The priority is lower in the order of special function room, refrigerating room, and freezing room.
The foodstuff management system according to claim 8 or 9. The priority set in advance according to the type of the storage chamber differs depending on the food material.
The foodstuff management system according to claim 8. When the plurality of inventory registrations include a first registration indicating that the foodstuff is present in the special function room and a second registration indicating that the foodstuff is present in the refrigerating room.
When the operation mode for cooling the special function room is the first operation mode, the priority is lowered in the order of the special function room and the refrigerating room.
When the operation mode for cooling the special function room is the second operation mode in which the temperature zone is lower than that of the first operation mode, the priority is lowered in the order of the refrigerating room and the special function room.
The foodstuff management system according to any one of claims 1 to 11. The plurality of inventory registrations are the first registration indicating that the first quantity of the foodstuff is present, and the second quantity having a priority in the priority order lower than that of the first registration and higher than that of the first quantity. When the deletion instruction for deleting the foodstuff in an amount larger than the first amount is received in the case of including the second registration indicating that the foodstuff is present, the registration management unit performs the first registration. Delete, but keep the second registration in the second amount,
The foodstuff management system according to any one of claims 1 to 12.

Images