TWI764138B - Refrigerator ingredients management system and control method thereof - Google Patents

Abstract

An ingredient management system for a refrigerator includes a refrigerator, an ingredient management server, and a radio device. The ingredient management server stores an ingredient database including a plurality of pre-stored ingredient names and a plurality of storage time lengths, and a storage list including a plurality of ingredient storage data. Database, the radio module is used to receive the voice data and generate a voice recognition result including the name of the specific ingredient according to the voice data, and transmit the voice recognition result to the ingredient management server. When the ingredient management server determines the name of the specific ingredient and the name of the pre-stored ingredient, among them If the names of the pre-stored ingredients that are the target ingredient names match, the target ingredient expiration date will be generated according to the storage time length corresponding to the target ingredient name and the current time, and an ingredient storage data will be added to the storage list database according to the target ingredient name and the target ingredient expiration date.

Description

Refrigerator ingredients management system and control method thereof

The present invention relates to a refrigerator material management system, in particular to a refrigerator material management system with a voice recognition function. The present invention also relates to a control method of a refrigerator material management system.

In the existing refrigerator food management system, the user manually enters the relevant information of the food in and out of the refrigerator, such as the name and shelf life, into the application of the mobile phone or tablet, so that the user can obtain the information in the subsequent operation of the application. Know the information of all the ingredients in the refrigerator at present, but because the above method requires the user to manually enter the information into the application, if the user is lazy or forgets to enter the relevant information, the application will not be able to know the preservation of all the ingredients in the refrigerator in time. If you forget to enter the information once or twice, it may lead to users who cannot fully control the relevant information of all the ingredients in the refrigerator or lack motivation to enter the information because they need to add too much relevant information when they want to fill in the relevant information later. application, which makes the existing refrigerator material management system lose its proper function. Therefore, the existing refrigerator material management system still has room for improvement.

Therefore, the purpose of the present invention is to provide a refrigerator material management system to solve the problem of manual input of data in the existing refrigerator material management system.

Another object of the present invention is to provide a control method of a refrigerator material management system.

Therefore, in some embodiments, the present invention includes a refrigerator, an ingredient management server, and a sound-receiving device.

The refrigerator includes a door switch sensing unit, a communication unit, and a processing unit electrically connected to the door switch sensing unit and the communication unit.

The ingredient management server stores an ingredient database and a storage list database, the ingredient database includes a plurality of pre-stored ingredient names and a plurality of storage time lengths corresponding to the pre-stored ingredient names, and the storage list database includes A plurality of ingredient storage information, each ingredient storage information includes a storage ingredient name and an ingredient expiration date.

The radio device is electrically connected with the food management server and the refrigerator, and includes a radio module, a communication module, and a processing module electrically connected to the radio module and the communication module. The radio module uses In order to receive a voice data of a user, the voice data includes an action information of an instruction to put in or take out and a name of a specific ingredient.

When the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates opening, the processing unit transmits a door opening notification to the sound-receiving device via the communication unit.

After the processing module of the sound-receiving device receives the opening notification of the box door via the communication module, the processing module controls the sound-receiving module to pick up sound.

After the voice receiving module receives the voice data from the user, the processing module generates a voice recognition result according to the voice data, and transmits the voice recognition result to the ingredient management server, and the voice recognition result includes The action information and the name of the specific ingredient.

After receiving the voice recognition result and judging that the action instruction is put in, the ingredient management server determines whether the specific ingredient name of the voice recognition result matches one of the pre-stored ingredient names in the ingredient database.

When the ingredient management server determines that the specific ingredient name in the voice recognition result matches one of the pre-stored ingredient names in the ingredient database as a pre-stored ingredient name as a target ingredient name, the ingredient management server determines the target ingredient name according to the target ingredient name. The storageable time length corresponding to the name and the current time generate a target ingredient expiration date.

After generating the target ingredient expiration date, the ingredient management server adds a new item of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date.

In some implementations, the ingredient management server further stores a user database, the user database includes a plurality of pre-stored user names and a plurality of pre-stored user voiceprints corresponding to the pre-stored user names respectively .

After the voice recording module receives the voice data from the user, the processing module also generates a voiceprint data to be identified according to the voice data, and transmits the voiceprint data to be identified to the food material management server; the After the ingredient management server receives the to-be-identified voiceprint data, the ingredient management server determines whether the to-be-identified voiceprint data matches one of the pre-stored user voiceprints in the user database.

When the food management server determines that the to-be-identified voiceprint data is consistent with one of the pre-stored user voiceprints in the user database as a pre-stored user voiceprint as a target voiceprint, the food management server determines according to the The pre-stored user name corresponding to the target voiceprint generates an operation user name.

The ingredient storage data generated by the ingredient management server further includes the operation user name.

In some implementations, the ingredient management server is adapted to communicate with a web server.

When the ingredient management server determines that the specific ingredient name in the voice recognition result does not match any of the pre-stored ingredient names in the ingredient database, the ingredient management server uses web crawling technology to serve the web page Collecting with the device to obtain a collection result indicating the length of the shelf life of the food whose name matches the name of the specific food.

The ingredient management server generates the target ingredient expiration date according to the collection result and the current time; after generating the target ingredient expiration date, the ingredient management server adds an ingredient storage data to the storage based on the specific ingredient name and the target ingredient expiration date List database.

In some implementations, after the ingredient management server obtains the collection result, the specific ingredient name and the collection result are respectively added to the ingredient database as the pre-stored ingredient name and the storageable time length corresponding to each other.

In some embodiments, the radio device further includes a speaker module electrically connected to the processing module, and the processing module of the radio device receives the notification of opening the box door, and controls the processing module in the process module. Before the sound-receiving module collects the sound, the speaker module will be controlled to send out a voice prompt message for prompting the user to express the voice data.

In some implementations, the radio device is a smart speaker.

In some implementations, the ingredient management server is adapted to communicate with a consumer electronic device operated by the user.

When the ingredient management server determines that one of the ingredient storage data in the storage list database is one of the ingredient storage data of an immediate ingredient data, the difference between the ingredient expiration date and the current time is less than a threshold, the ingredient management server Sending an on-demand reminder message related to the on-demand food material data to the consumer electronic device for display by the consumer electronic device.

In some implementations, after receiving the voice recognition result and judging that the action information instructs to take out, the ingredient management server determines whether the name of the specific ingredient in the voice recognition result is the same as the name of the specific ingredient in the storage list database The name of the stored ingredient in one of the ingredient storage data matches.

When the ingredient management server determines that the specific ingredient name of the voice recognition result matches the stored ingredient name of the ingredient storage data in one of the ingredient storage data in the storage list database as a target storage data, the ingredient management server The server will delete the target deposit data from the deposit list database.

The control method of the refrigerator ingredient management system of the present invention is implemented by a refrigerator ingredient management system. The refrigerator ingredient management system includes a refrigerator, an ingredient management server, and a radio device. The refrigerator includes a door switch sensing unit and a communication unit. , and a processing unit electrically connected to the door switch sensing unit and the communication unit, the food material management server stores a food material database and a storage list database, the food material database includes a plurality of pre-stored food material names and a plurality of Corresponding to the storage time lengths of the names of the pre-stored ingredients respectively, the storage list database contains a plurality of ingredient storage data, each ingredient storage data includes a storage ingredient name and an ingredient expiration date, the radio device and the ingredient management server It is electrically connected with the refrigerator, and includes a radio module, a communication module and a processing module electrically connected to the radio module and the communication module, and the radio module is used for receiving a voice data of a user , the voice data includes an action information indicating putting in or taking out and a name of a specific food material, and the method includes: when the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates opening, the processing unit Send a box door opening notification to the sound-receiving device through the communication unit; after the processing module of the sound-receiving device receives the box door opening notification via the communication module, the processing module controls the sound-receiving module to pick up sound; After the radio module receives the voice data from the user, the processing module generates a voice recognition result according to the voice data, and transmits the voice recognition result to the ingredient management server, and the voice recognition result includes the action information and the name of the specific ingredient; after receiving the voice recognition result and judging that the action instruction is put in, the ingredient management server determines whether the name of the specific ingredient in the voice recognition result matches the pre-stored ingredients in the ingredient database One of the names matches; when the ingredient management server determines that the specific ingredient name in the voice recognition result matches one of the pre-stored ingredient names in the ingredient database as a target ingredient name, the ingredient management The server generates a target ingredient expiration date according to the storageable time length and the current time corresponding to the target ingredient name; the ingredient management server adds an ingredient according to the target ingredient name and the target ingredient expiration date after generating the target ingredient expiration date Store data to the deposit list database.

The present invention has at least the following effects: receiving the voice data from the user through the radio module and generating the voice recognition result according to the voice data, and then transmitting the voice recognition result including the name of the specific ingredient to the ingredient management server , and the specific ingredient name of the voice recognition result is determined by the ingredient management server to match one of the pre-stored ingredient names in the ingredient database as the pre-stored ingredient name of the target ingredient name, and then the target ingredient name corresponds to The available storage time length and the current time generate the target ingredient expiration date, and add an ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date, so that the user can store the ingredients in the refrigerator. Adding food storage data to the storage list database by means of voice, in addition, the processing unit of the refrigerator determines that the sensing result of the door switch sensing unit indicates that the door is opened and then transmits the door opening notification to the refrigerator. When the sound pickup device is used, the processing module of the sound pickup device controls the sound pickup module to collect sound, so that the sound pickup module will only pick up sound when the user turns on the refrigerator, so as to reduce the energy consumption of the sound pickup device and avoid the sound pickup. The mod received incorrectly this voice data such as conversations in everyday life.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are designated by the same reference numerals.

Referring to FIG. 1 , an embodiment of a refrigerator food management system 100 of the present invention includes a refrigerator 1 , a food management server 2 , a radio device 3 , a web server 800 and a user electronic device 900 .

The refrigerator 1 includes a door switch sensing unit 11 , a communication unit 12 , and a processing unit 13 electrically connected to the door switch sensing unit 11 and the communication unit 12 . The ingredient management server 2 stores a user database, an ingredient database and a storage list database. The user database includes a plurality of pre-stored user names and a plurality of pre-stored user voiceprints respectively corresponding to the pre-stored user names. The ingredient database includes a plurality of names of pre-stored ingredients (for example, toast) and a plurality of storage periods (eg, 14 days) respectively corresponding to the names of the pre-stored ingredients. The storage list database includes a plurality of ingredient storage data, and each ingredient storage data includes an operating user name, a storage ingredient name, and an ingredient expiration date (eg, 2020/3/1).

The sound-receiving device 3 is, for example, a smart speaker, but not limited thereto, the sound-receiving device 3 is electrically connected with the food management server 2 and the refrigerator 1 , and includes a sound-receiving module 31 and a communication module 32 , a processing module 33 electrically connected to the radio module 31 and the communication module 32 , and a speaker module 34 electrically connected to the processing module 33 . The sound-receiving module 31 is used for receiving a voice data from a user, and the voice data includes an action information for instructing to put in or take out and a specific ingredient name indicating the ingredient name of the ingredient in this operation.

Referring to FIG. 1 to FIG. 3 , the steps performed by the refrigerator material management system 100 in this embodiment are described below. First, as shown in step S01, the processing unit 13 of the refrigerator 1 determines whether a sensing result of the door switch sensing unit 11 indicates opening, if the processing unit 13 of the refrigerator 1 determines that the sensing result indicates opening ( A user opens the door of the refrigerator 1 ), then step S02 is executed, and if the processing unit 13 determines that the sensing result does not indicate opening, the process ends.

As shown in step S02 , the processing unit 13 of the refrigerator 1 transmits a door opening notification to the sound receiving device 3 via the communication unit 12 .

Next, as shown in step S03, after receiving the box door opening notification via the communication module 32, the processing module 33 of the sound-receiving device 3 will control the speaker module 34 to issue a message for prompting the user to express The action information and the voice prompt message of the name of the specific ingredient required by the voice data, for example, the voice prompt message can be "please say the action to take out or put in the food?", "please say the name of the operation What is the name of the ingredient?" etc., but not limited to the foregoing examples.

Next, as shown in step S04, the processing module 33 of the sound pickup device 3 controls the sound pickup module 31 to pick up sound.

Next, as shown in step S05, after the radio module 31 receives the voice data from the user, the processing module 33 generates a voice recognition result according to the voice data, and the voice recognition result includes the action information and the specific voice Food name.

Next, as shown in step S06, the processing module 33 also generates a voiceprint data to be recognized according to the voice data.

Next, as shown in step S07 , the processing module 33 transmits the voice recognition result generated in step S05 and the to-be-recognized voiceprint data generated in step S06 to the ingredient management server 2 .

Next, as shown in step S08, the ingredient management server 2 determines whether the voiceprint data to be identified matches one of the pre-stored user voiceprints in the user database, and if the two are consistent, then executes the execution Step S09, if the above two do not match, the process ends.

As shown in step S09, the ingredient management server 2 generates an operation user name according to the pre-stored user name corresponding to the target voiceprint. If the pre-stored user voiceprint of the management server 2 and the corresponding pre-stored user name is Xiao Ming matches, an instruction indicating that Xiao Ming is the user name of the operation is generated.

Next, as shown in step S10, the ingredient management server 2 will determine whether the action information of the voice recognition result is an instruction to put in or take out. If the action information is an instruction to put in, then step S11 is executed. If yes, it indicates to take out, then step S17 is executed next.

As shown in step S11, after receiving the voice recognition result and judging that the action instruction is put in, the ingredient management server 2 will determine whether the specific ingredient name of the voice recognition result matches the pre-stored names of the ingredient database. One of the names of the ingredients matches, if the above two match, then step S12 is executed, and if the above two do not match, then step S14 is executed.

As shown in step S12, the ingredient management server 2 generates a target ingredient expiration date according to the storable duration corresponding to the target ingredient name and the current time. For example, if the storable duration is 7 days, and the current time is On January 1, 2020, the target ingredient expiration date is January 1, 2020 plus 7 days, that is, January 8, 2020, but the recording format of the target ingredient expiration date is not limited to the above example, and the target ingredient expiration date can be "2020/1/7", "2020/01/07", etc.

As shown in step S13, after generating the target ingredient expiration date, the ingredient management server 2 adds a new item of ingredient storage data to the storage list database according to the target ingredient name, the target ingredient expiration date and the operating user name.

On the other hand, when the ingredient management server 2 determines that the specific ingredient name in the speech recognition result does not match one of the pre-stored ingredient names in the ingredient database, for example, if the specific ingredient name is "egg" , but the name of the pre-stored ingredient named "egg" is not pre-stored in the ingredient database, then in step S14, the ingredient management server 2 communicates with a web server 800, and uses the web crawler technology to access the web page The server 800 collects data to obtain a collection result indicating the storage period of the food whose name matches the name of the specific food. For example, the food management server 2 can obtain the name from the web server 800 using the web crawling technology. The shelf life of "egg" ingredients is 7 days.

Next, as shown in step S15, the ingredient management server 2 generates the target ingredient expiration date according to the collection result and the current time.

Next, as shown in step S16, the ingredient management server 2 adds the specific ingredient name and the collection result to the ingredient database as the pre-stored ingredient name and the storageable time length corresponding to each other, respectively. After step S16 is executed, step S13 is then executed, that is, the ingredient management server 2 adds an ingredient storage data to the storage list database according to the specific ingredient name, the target ingredient expiration date and the operation user name.

On the other hand, when the ingredient management server 2 determines that the action information of the voice recognition result is fetching, then in step S17, the ingredient management server 2 determines the name of the specific ingredient and the storage list of the voice recognition result One of the food material storage data in the database matches the name of the stored food material of the food material storage data as a target storage data. If the above two match, then step S18 is executed. If the above two do not match, the process ends.

As shown in step S18, the ingredient management server 2 will delete the target storage data from the storage list database. For example, if the ingredient management server 2 determines that the name of the specific ingredient is "egg", and the If the storage list database contains the storage data of the ingredient as the target storage data and the name of the storage ingredient is "egg", the target storage data is deleted from the storage list database.

Referring to FIG. 4 , the steps performed by the refrigerator material management system 100 in this embodiment are described below. The material management server 2 communicates with a consumer electronic device 900 for the user to operate. First, as shown in step S101, the ingredient management server 2 will determine whether the difference between the expiration date of the ingredient and the current time of one of the ingredient storage data in the storage list database is less than a threshold, and if the difference is less than a If the difference is not less than a threshold, then step S102 is executed, and if the difference is not less than a threshold, the process ends.

As shown in step S102, when the ingredient management server 2 determines that one of the ingredient storage data in the storage list database is the ingredient storage data of an immediate ingredient data, the difference between the ingredient expiration date and the current time is less than the threshold , the ingredient management server 2 sends an immediate reminder message related to the immediate ingredient data to the consumer electronic device 900 .

Next, as shown in step S103, after receiving the prompt reminder message, the user electronic device 900 will display and remind the user.

To sum up, the refrigerator ingredient management system 100 of the present invention receives the voice data from the user through the radio module 31, generates the voice recognition result according to the voice data, and then transmits the voice recognition result including the name of the specific ingredient to the ingredient management server 2, and the specific ingredient name of the voice recognition result is determined by the ingredient management server 2 to match the pre-stored ingredient name of the target ingredient name as one of the pre-stored ingredient names in the ingredient database After that, the target ingredient expiration date is generated according to the storable time length and the current time corresponding to the target ingredient name, and a new item of ingredient storage data is added to the storage list database according to the target ingredient name and the target ingredient expiration date, so that the user can When the food is put into the refrigerator 1, the food storage data can be added to the storage list database by voice. In addition, the processing unit 13 of the refrigerator 1 can determine the sensing of the door switch sensing unit 11. After the result indicates that the box door is opened, a notification is sent to the sound pickup device 3, the processing module 33 of the sound pickup device 3 controls the sound pickup module 31 to pick up sound, so that the sound pickup module is only when the user opens the refrigerator 1. 31 will only pick up sound, so as to reduce the energy consumption of the sound pickup device 3 and prevent the sound pickup module 31 from receiving the wrong voice data such as conversations in daily life, so the object of the present invention can indeed be achieved.

However, the above are only examples of the present invention, and should not limit the scope of the present invention. Any simple equivalent changes and modifications made according to the scope of the application for patent of the present invention and the content of the patent specification are still within the scope of the present invention. within the scope of the invention patent.

1: refrigerator 11: Door switch sensing unit 12: Communication unit 13: Processing unit 2: Ingredients management server 3: Radio device 31: Radio module 32: Communication module 33: Processing modules 34: Speaker module 100: Refrigerator ingredients management system 800: web server 900: Consumer electronics S01~S18: Steps S101~S103: Steps

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: FIG. 1 is a schematic diagram of a hardware connection relationship of an embodiment of a refrigerator food management system of the present invention; and 2 to 4 are a flow chart of this embodiment.

1: refrigerator

11: Door switch sensing unit

12: Communication unit

13: Processing unit

2: Ingredients management server

3: Radio device

31: Radio module

32: Communication module

33: Processing modules

34: Speaker module

100: Refrigerator ingredients management system

800: web server

900: Consumer electronics

Claims (8)

An ingredient management system for a refrigerator, comprising: a refrigerator, including a door switch sensing unit, a communication unit, and a processing unit electrically connected to the door switch sensing unit and the communication unit; an ingredient management server adapted to communicate with A web server communicates with and stores an ingredient database and a storage list database, the ingredient database includes a plurality of names of pre-stored ingredients and a plurality of storage time lengths corresponding to the names of the pre-stored ingredients, the storage list database It includes a plurality of food material storage data, and each food material storage data includes a name of the stored food material and a food material expiration date; and a radio device, which is electrically connected to the food material management server and the refrigerator, and includes a radio module and a communication module. , a processing module electrically connected to the radio module and the communication module, and a speaker module electrically connected to the processing module, the radio module is used to receive a voice data of a user, the The voice data includes an action information indicating putting in or taking out and a name of a specific ingredient; when the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates opening, the processing unit transmits a message via the communication unit. The box door opening notification is sent to the sound-receiving device; after the processing module of the sound-receiving device receives the box door opening notification via the communication module, the processing module immediately controls the speaker module to issue a message for guiding the user expressing the voice prompt message of the voice data; after the processing module controls the speaker module to send out the voice prompt message, the processing module controls the radio module to receive sound; After the voice receiving module receives the voice data from the user, the processing module generates a voice recognition result according to the voice data, and transmits the voice recognition result to the ingredient management server, and the voice recognition result includes the action information and the name of the specific ingredient; after receiving the voice recognition result and judging that the action instruction is put in, the ingredient management server determines whether the name of the specific ingredient in the voice recognition result is the same as the name of the specific ingredient in the ingredient database One of the names of the pre-stored ingredients matches; when the ingredient management server determines that the specific ingredient name of the voice recognition result matches one of the names of the pre-stored ingredients in the ingredient database as a pre-stored ingredient name of a target ingredient name, the The ingredient management server generates a target ingredient expiration date according to the storable time length and the current time corresponding to the target ingredient name; when the ingredient management server determines that the specific ingredient name of the voice recognition result is not consistent with the ingredient database Any one of the names of the pre-stored ingredients matches, the ingredient management server uses the web crawler technology to collect on the web server to obtain a collection result indicating the length of storage time of the ingredient whose name matches the name of the specific ingredient, The ingredient management server generates the target ingredient expiration date according to the collection result and the current time; after generating the target ingredient expiration date, the ingredient management server adds an ingredient storage data to the storage based on the target ingredient name and the target ingredient expiration date List database. The refrigerator ingredient management system according to claim 1, wherein the ingredient management server further stores a user database, and the user database includes multiple a pre-stored user name and a plurality of pre-stored user voiceprints respectively corresponding to the pre-stored user names; when the audio-receiving module receives the voice data from the user, the processing module also generates the voice data according to the voice data Once the voiceprint data to be recognized is transmitted, the voiceprint data to be recognized is sent to the food management server; after the food management server receives the voiceprint data to be recognized, the food management server determines the voiceprint data to be recognized Whether it matches one of the pre-stored user voiceprints in the user database; when the food management server determines that the to-be-identified voiceprint data is one of the pre-stored user voiceprints in the user database As a pre-stored user voiceprint of a target voiceprint, the food management server generates an operation user name according to the pre-stored user name corresponding to the target voiceprint; the food storage data generated by the food management server also Contains the operation username. The refrigerator ingredient management system according to claim 1, wherein after obtaining the collection result, the ingredient management server treats the specific ingredient name and the collection result as the pre-stored ingredient name and the storageable time length corresponding to each other respectively. And join the food database. The refrigerator material management system according to claim 1, wherein the sound-receiving device is a smart speaker. The refrigerator ingredient management system according to claim 1, wherein the ingredient management server is adapted to communicate with a consumer electronic device operated by the user information; when the ingredient management server determines that one of the ingredient storage data in the storage list database is one of the ingredient storage data of an immediate ingredient data, the difference between the ingredient expiration date and the current time is less than a threshold, the ingredient management The server sends an on-demand reminder message related to the on-demand food material data to the consumer electronic device for the consumer electronic device to display. The refrigerator ingredient management system according to claim 1, wherein after receiving the voice recognition result and judging that the action information instructs to take out, the ingredient management server determines whether the name of the specific ingredient in the voice recognition result is related to the storage The name of the stored ingredient in one of the ingredient storage data in the list database matches the name of the stored ingredient; when the ingredient management server determines that the name of the specific ingredient in the voice recognition result is the same as the name of the ingredient stored in the storage list database. If the name of the stored ingredient in the ingredient storage data as a target storage data matches the name of the stored ingredient, the ingredient management server will delete the target storage data from the storage list database. A control method of a refrigerator material management system is implemented by a refrigerator material management system. The refrigerator material management system includes a refrigerator, an material management server and a sound-receiving device. The refrigerator includes a door switch sensing unit and a communication unit. and a processing unit electrically connected to the door switch sensing unit and the communication unit, the food material management server is adapted to communicate with a web server and store a food material database and a storage list database, the food material database includes Multiple pre-stored ingredient names and multiple corresponding to The storage time length of the names of the pre-stored ingredients, the storage list database contains a plurality of ingredient storage data, each ingredient storage data includes a storage ingredient name and an ingredient expiration date, the radio device, the ingredient management server and the refrigerator. It is electrically connected, and includes a radio module, a communication module, a processing module electrically connected to the radio module and the communication module, and a speaker module electrically connected to the processing module. The module is used for receiving a voice data of a user, and the voice data includes an action information indicating putting in or taking out and a name of a specific ingredient. The method includes: when the processing unit of the refrigerator determines that the door switch senses A sensing result of the unit indicates opening, and the processing unit transmits a box door opening notification to the sound radio device via the communication unit; after the processing module of the sound pickup device receives the box door opening notification via the communication module, the The processing module immediately controls the speaker module to issue a voice prompt message for guiding the user to express the voice data; after the processing module controls the speaker module to issue the voice prompt message, the processing module controls The radio module picks up sound; after the radio module receives the voice data from the user, the processing module generates a voice recognition result according to the voice data, and transmits the voice recognition result to the ingredient management server , the voice recognition result includes the action information and the name of the specific ingredient; the ingredient management server, after receiving the voice recognition result and judging that the action instruction is put in, determines whether the name of the specific ingredient in the voice recognition result is the same as the name of the specific ingredient. One of the names of the pre-stored ingredients in the ingredient database matches; When the ingredient management server determines that the specific ingredient name in the voice recognition result matches one of the pre-stored ingredient names in the ingredient database as a pre-stored ingredient name of a target ingredient name, the ingredient management server determines according to the target ingredient name. The storageable time length and the current time corresponding to the name generate a target ingredient expiration date; when the ingredient management server determines that the specific ingredient name of the voice recognition result does not match any of the pre-stored ingredient names in the ingredient database If it matches, the food management server uses the web crawler technology to collect on the web server to obtain a collection result indicating the storage period of the food whose name matches the specific food name, and the food management server collects the data according to the collection result The result and the current time generate the target ingredient expiration date; after generating the target ingredient expiration date, the ingredient management server adds a new item of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date. The control method for a refrigerator material management system according to claim 7, wherein the material management server further stores a user database, the user database includes a plurality of pre-stored user names and a plurality of corresponding user names respectively. Pre-stored user voiceprints of pre-stored user names, the method further includes: after the radio module receives the voice data from the user, the processing module further generates a voiceprint data to be identified according to the voice data, and Send the to-be-identified voiceprint data to the ingredient management server; after the ingredient management server receives the to-be-identified voiceprint data, the ingredient management server determines whether the to-be-identified voiceprint data is related to the user One of the pre-stored user voiceprints in the database matches; when the food management server determines that the to-be-identified voiceprint data and one of the pre-stored user voiceprints in the user database are used as a target voiceprint matches the pre-stored user voiceprint, the ingredient management server generates an operation user name according to the pre-stored user name corresponding to the target voiceprint; the ingredient storage data generated by the ingredient management server also includes the operation user name.

Images