TW202141377A - Refrigerator food material management system and control method thereof with which a voice recognition function is provided to facilitate management of food materials - Google Patents

Refrigerator food material management system and control method thereof with which a voice recognition function is provided to facilitate management of food materials Download PDF

Info

Publication number
TW202141377A
TW202141377A TW109114042A TW109114042A TW202141377A TW 202141377 A TW202141377 A TW 202141377A TW 109114042 A TW109114042 A TW 109114042A TW 109114042 A TW109114042 A TW 109114042A TW 202141377 A TW202141377 A TW 202141377A
Authority
TW
Taiwan
Prior art keywords
food
ingredient
name
management server
user
Prior art date
Application number
TW109114042A
Other languages
Chinese (zh)
Other versions
TWI764138B (en
Inventor
游德榮
劉志昀
林哲民
陳玠融
Original Assignee
台灣松下電器股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 台灣松下電器股份有限公司 filed Critical 台灣松下電器股份有限公司
Priority to TW109114042A priority Critical patent/TWI764138B/en
Publication of TW202141377A publication Critical patent/TW202141377A/en
Application granted granted Critical
Publication of TWI764138B publication Critical patent/TWI764138B/en

Links

Images

Abstract

Provided is a refrigerator food material management system, which includes a refrigerator, a food material management server and a sound pickup apparatus. The food material management server stores a food material database including a plurality of pre-stored food material names and a plurality of preservation time lengths, and a storage list database including a plurality of food material storage data. The sound pickup module is used for receiving voice data, and generating a voice recognition result including a specific food material name according to the voice data for being transmitted to the food material management server. When the food material management server determines that the specific food material name is consistent with the pre-stored food material name, serving as a target food material name, in the plurality of pre-stored food material names, a target food material expiration date is generated according to the preservation time length corresponding to the target food material name and the current time, and one item of food material storage data is newly added to the storage list database according to the target food material name and the target food material expiration date.

Description

冰箱食材管理系統及其控制方法Refrigerator food material management system and control method thereof

本發明是有關於一種冰箱食材管理系統,特別是指一種具有語音辨識功能的冰箱食材管理系統。本發明還有關於一種冰箱食材管理系統的控制方法。The invention relates to a refrigerator food management system, in particular to a refrigerator food management system with a voice recognition function. The invention also relates to a control method of a refrigerator food management system.

現有冰箱食材管理系統的使用方式是由使用者手動將放入及取出冰箱之食材的相關資訊如名稱與保存期限鍵入至手機或平板的應用程式中,以在後續操作應用程式時,才可以得知目前冰箱內所有食材的資訊,但因前述方法需要由使用者手動將資料鍵入應用程式中,若使用者一時偷懶或忘記鍵入相關資訊,便無法及時由應用程式得知冰箱內所有食材的保存期限,且只要忘記鍵入一兩次,可能就會導致使用者因無法完全掌控冰箱內的所有食材的相關資訊或若要後續補齊相關資料時會因為需要補充過多相關資訊而缺乏動機將資料鍵入應用程式,進而使得現有冰箱食材管理系統失去應有的功能,因此,現有的冰箱食材管理系統仍有改善的空間。The existing refrigerator food management system is used by the user to manually enter and take out the relevant information of the food in and out of the refrigerator, such as the name and shelf life, into the application of the mobile phone or tablet, so that it can be obtained when the application is subsequently operated. Know the information of all the ingredients in the refrigerator at present, but because the aforementioned method requires the user to manually enter the data into the application, if the user is lazy or forgets to enter the relevant information, the application will not be able to know the preservation of all the ingredients in the refrigerator in time Time limit, and as long as you forget to type it once or twice, it may cause the user to be unable to fully control the relevant information of all the ingredients in the refrigerator or to supplement the relevant information later because of the need to add too much relevant information and lack the motivation to enter the data The application program makes the existing refrigerator food management system lose its proper function. Therefore, the existing refrigerator food management system still has room for improvement.

因此,本發明之目的,即在提供一種冰箱食材管理系統,以解決現有的冰箱食材管理系統需要手動鍵入資料的問題。Therefore, the purpose of the present invention is to provide a refrigerator food management system to solve the problem that the existing refrigerator food management system needs to manually enter data.

本發明的另一目的,在於提供一種冰箱食材管理系統的控制方法。Another object of the present invention is to provide a control method of a refrigerator food management system.

於是,本發明在一些實施態樣中,包含一冰箱、一食材管理伺服器及一收音裝置。Therefore, in some embodiments, the present invention includes a refrigerator, a food management server, and a radio device.

該冰箱包括一門開關感測單元、一通訊單元,及一電連接於該門開關感測單元與該通訊單元的處理單元。The refrigerator includes a door switch sensing unit, a communication unit, and a processing unit electrically connected to the door switch sensing unit and the communication unit.

該食材管理伺服器儲存一食材資料庫及一存放清單資料庫,該食材資料庫包含多個預存食材名稱及多個分別對應於該等預存食材名稱的可保存時間長度,該存放清單資料庫包含多個食材存放資料,每一食材存放資料包含一存放食材名稱及一食材期限。The ingredient management server stores an ingredient database and a storage list database. The ingredient database includes a plurality of pre-stored ingredient names and a plurality of storage time lengths corresponding to the names of the pre-stored ingredients. The storage list database includes Multiple food storage data, each food storage data includes a storage food name and a food period.

該收音裝置與該食材管理伺服器及該冰箱電連接,並包括一收音模組、一通訊模組及一電連接於該收音模組與該通訊模組的處理模組,該收音模組用以接收一使用者的一語音資料,該語音資料包含一指示放入或取出的動作資訊及一特定食材名稱。The radio device is electrically connected to the food management server and the refrigerator, and includes a radio module, a communication module, and a processing module electrically connected to the radio module and the communication module. The radio module is used for In order to receive a user's voice data, the voice data includes an instruction to put in or take out action information and a specific food ingredient name.

當該冰箱的該處理單元判斷出該門開關感測單元的一感測結果指示開啓,該處理單元經由該通訊單元傳送一箱門開啓通知給該收音裝置。When the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates that it is turned on, the processing unit transmits a door opening notification to the radio device via the communication unit.

該收音裝置的該處理模組經由該通訊模組接收到該箱門開啓通知後,該處理模組控制該收音模組收音。After the processing module of the radio device receives the notification of opening the box door via the communication module, the processing module controls the radio module to receive sound.

當該收音模組自該使用者接收到該語音資料後,該處理模組根據該語音資料,產生一語音辨識結果,且將該語音辨識結果傳送給該食材管理伺服器,該語音辨識結果包含該動作資訊及該特定食材名稱。When the radio module receives the voice data from the user, the processing module generates a voice recognition result based on the voice data, and sends the voice recognition result to the food management server, the voice recognition result includes The action information and the name of the specific ingredient.

該食材管理伺服器在接收到該語音辨識結果且判斷出該動作指示放入後,判斷該語音辨識結果的該特定食材名稱是否與該食材資料庫的該等預存食材名稱其中一者相符。After the food management server receives the voice recognition result and determines that the action instruction is placed, it determines whether the specific food name of the voice recognition result matches one of the pre-stored food names in the food database.

當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為一目標食材名稱的預存食材名稱相符,該食材管理伺服器根據該目標食材名稱對應的該可保存時間長度及當前時間產生一目標食材期限。When the ingredient management server determines that the name of the specific ingredient in the voice recognition result matches the name of one of the stored ingredients in the ingredient database as a target ingredient name, the ingredient management server matches the name of the target ingredient according to the target ingredient The length of the saveable time corresponding to the name and the current time produce a target ingredient expiration date.

該食材管理伺服器於產生該目標食材期限後,根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫。After the ingredient management server generates the target ingredient expiration date, it adds a piece of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date.

在一些實施態樣中,該食材管理伺服器還儲存一使用者資料庫,該使用者資料庫包含多個預存使用者名稱及多個分別對應於該等預存使用者名稱的預存使用者聲紋。In some implementation aspects, the food management server also stores a user database that includes a plurality of pre-stored user names and a plurality of pre-stored user voiceprints corresponding to the pre-stored user names. .

當該收音模組自該使用者接收到該語音資料後,該處理模組還根據該語音資料產生一待辨認聲紋資料,且將該待辨認聲紋資料傳送給該食材管理伺服器;該食材管理伺服器接收到該待辨認聲紋資料後,該食材管理伺服器判斷該待辨認聲紋資料是否與該使用者資料庫的該等預存使用者聲紋其中一者相符。After the radio module receives the voice data from the user, the processing module also generates a voiceprint data to be recognized based on the voice data, and sends the voiceprint data to be recognized to the food management server; After the food management server receives the voiceprint data to be recognized, the food management server determines whether the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database.

當該食材管理伺服器判斷出該待辨認聲紋資料與該使用者資料庫的該等預存使用者聲紋其中一個作為一目標聲紋的預存使用者聲紋相符,該食材管理伺服器根據與該目標聲紋對應的該預存使用者名稱產生一操作使用者名稱。When the food management server determines that the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database as a target voiceprint, the food management server matches The pre-stored user name corresponding to the target voiceprint generates an operation user name.

該食材管理伺服器產生的該食材存放資料還包含該操作使用者名稱。The food storage data generated by the food management server also includes the operation user name.

在一些實施態樣中,該食材管理伺服器適於與一網頁伺服器通訊。In some implementation aspects, the food management server is adapted to communicate with a web server.

當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱並未與該食材資料庫的該等預存食材名稱其中任一者相符,該食材管理伺服器使用網路爬蟲技術於該網頁伺服器蒐集而獲得一指示出名稱符合該特定食材名稱的食材的可保存時間長度的一蒐集結果。When the food management server determines that the name of the specific food in the voice recognition result does not match any of the pre-stored food names in the food database, the food management server uses web crawling technology to serve the web page The device collects and obtains a collection result indicating the storage time length of the ingredient whose name matches the name of the specific ingredient.

該食材管理伺服器根據該蒐集結果及當前時間產生該目標食材期限;該食材管理伺服器於產生該目標食材期限後,根據該特定食材名稱及該目標食材期限新增一食材存放資料至該存放清單資料庫。The ingredient management server generates the target ingredient expiration date based on the collected results and the current time; after the ingredient management server generates the target ingredient expiration date, it adds an ingredient storage data to the storage based on the specific ingredient name and the target ingredient expiration date List database.

在一些實施態樣中,該食材管理伺服器獲得該蒐集結果後,將該特定食材名稱及該蒐集結果分別當作彼此對應的該預存食材名稱及該可保存時間長度而加入該食材資料庫。In some implementation aspects, after the food management server obtains the collection result, the specific food name and the collection result are respectively regarded as the corresponding pre-stored food name and the storage time length and added to the food database.

在一些實施態樣中,該收音裝置還包含一電連接於該處理模組的揚聲模組,該收音裝置的該處理模組在接收到該箱門開啓通知,並在該處理模組控制該收音模組收音前,會控制該揚聲模組發出一用於提示使用者表達該語音資料的語音提示訊息。In some embodiments, the radio device further includes a speaker module electrically connected to the processing module, and the processing module of the radio device receives the notification of opening the box door and controls the processing module Before the radio module receives the sound, it controls the speaker module to send out a voice prompt message for prompting the user to express the voice data.

在一些實施態樣中,該收音裝置為一智慧型音箱。In some embodiments, the radio device is a smart speaker.

在一些實施態樣中,該食材管理伺服器適於與一供該使用者操作的使用端電子裝置通訊。In some embodiments, the food management server is adapted to communicate with a consumer electronic device for the user to operate.

當該食材管理伺服器判斷出該存放清單資料庫的該等食材存放資料其中一個作為一即期食材資料的食材存放資料的該食材期限與當前時間的差值小於一閾值,該食材管理伺服器發送一相關於該即期食材資料的即期提醒訊息至該使用端電子裝置以供該使用端電子裝置顯示。When the food material management server determines that one of the food material storage data in the storage list database is used as a current food material data of the food material storage data, the difference between the period of the food material and the current time is less than a threshold value, the food material management server Send a current reminder message related to the current food information to the consumer electronic device for display by the consumer electronic device.

在一些實施態樣中,該食材管理伺服器在接收到該語音辨識結果且判斷出該動作資訊指示取出後,判斷該語音辨識結果的該特定食材名稱是否與該存放清單資料庫中的該等食材存放資料其中一者的該存放食材名稱相符。In some implementations, the food management server, after receiving the voice recognition result and determining that the action information instruction is taken out, determines whether the name of the specific food in the voice recognition result matches the storage list database. The name of the stored food in one of the food storage data matches.

當該食材管理伺服器判斷該語音辨識結果的該特定食材名稱與該存放清單資料庫中的該等食材存放資料其中一個作為一目標存放資料的食材存放資料的該存放食材名稱相符,該食材管理伺服器會將該目標存放資料自該存放清單資料庫中刪除。When the food management server determines that the name of the specific food in the voice recognition result matches the name of the stored food in one of the food storage data in the storage list database as a target storage data of the food storage data, the food management The server will delete the target storage data from the storage list database.

本發明冰箱食材管理系統的控制方法,藉由一冰箱食材管理系統實施,該冰箱食材管理系統包含一冰箱、一食材管理伺服器及一收音裝置,該冰箱包括一門開關感測單元、一通訊單元,及一電連接於該門開關感測單元與該通訊單元的處理單元,該食材管理伺服器儲存一食材資料庫及一存放清單資料庫,該食材資料庫包含多個預存食材名稱及多個分別對應於該等預存食材名稱的可保存時間長度,該存放清單資料庫包含多個食材存放資料,每一食材存放資料包含一存放食材名稱及一食材期限,該收音裝置與該食材管理伺服器及該冰箱電連接,並包括一收音模組、一通訊模組及一電連接於該收音模組與該通訊模組的處理模組,該收音模組用以接收一使用者的一語音資料,該語音資料包含一指示放入或取出的動作資訊及一特定食材名稱,該方法包含:當該冰箱的該處理單元判斷出該門開關感測單元的一感測結果指示開啓,該處理單元經由該通訊單元傳送一箱門開啓通知給該收音裝置;該收音裝置的該處理模組經由該通訊模組接收到該箱門開啓通知後,該處理模組控制該收音模組收音;當該收音模組自該使用者接收到該語音資料後,該處理模組根據該語音資料,產生一語音辨識結果,且將該語音辨識結果傳送給該食材管理伺服器,該語音辨識結果包含該動作資訊及該特定食材名稱;該食材管理伺服器在接收到該語音辨識結果且判斷出該動作指示放入後,判斷該語音辨識結果的該特定食材名稱是否與該食材資料庫的該等預存食材名稱其中一者相符;當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為一目標食材名稱的預存食材名稱相符,該食材管理伺服器根據該目標食材名稱對應的該可保存時間長度及當前時間產生一目標食材期限;該食材管理伺服器於產生該目標食材期限後,根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫。The control method of the refrigerator food management system of the present invention is implemented by a refrigerator food management system. The refrigerator food management system includes a refrigerator, an food management server and a radio device. The refrigerator includes a door switch sensing unit and a communication unit , And a processing unit electrically connected to the door switch sensing unit and the communication unit. The food management server stores a food material database and a storage list database. The food material database includes a plurality of pre-stored food names and a plurality of Corresponding to the storage time length of the names of the pre-stored ingredients, the storage list database contains multiple ingredient storage data, and each ingredient storage data includes a stored ingredient name and an ingredient expiration date, the radio device and the ingredient management server It is electrically connected to the refrigerator, and includes a radio module, a communication module, and a processing module electrically connected to the radio module and the communication module. The radio module is used to receive a user's voice data , The voice data includes an instruction to put in or take out action information and a specific ingredient name, the method includes: when the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates that the door switch is turned on, the processing unit Send a box door opening notification to the radio device via the communication unit; after the processing module of the radio device receives the box door opening notification via the communication module, the processing module controls the radio module to receive radio; After the radio module receives the voice data from the user, the processing module generates a voice recognition result based on the voice data, and sends the voice recognition result to the food management server, and the voice recognition result includes the action Information and the name of the specific ingredient; after the ingredient management server receives the voice recognition result and determines that the action instruction is placed, it determines whether the name of the specific ingredient in the voice recognition result is the same as the pre-stored ingredients in the ingredient database One of the names matches; when the food management server determines that the name of the specific food in the voice recognition result matches one of the stored food names in the food database as a target food name, the food management The server generates a target ingredient expiration date according to the storage time length and the current time corresponding to the target ingredient name; after the ingredient management server generates the target ingredient expiration date, it adds an ingredient based on the target ingredient name and the target ingredient expiration date Save data to the storage list database.

本發明至少具有以下功效:藉由該收音模組接收來自該使用者的該語音資料並根據該語音資料產生該語音辨識結果後傳送包含該特定食材名稱的該語音辨識結果給該食材管理伺服器,且藉由該食材管理伺服器判斷該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為該目標食材名稱的預存食材名稱相符後,根據該目標食材名稱對應的該可保存時間長度及當前時間產生該目標食材期限,並根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫,使得使用者可在將食材放入冰箱時藉由語音的方式新增食材存放資料於該存放清單資料庫,此外,藉由該冰箱的該處理單元判斷該門開關感測單元的該感測結果指示開啓後傳送該箱門開啓通知給該收音裝置時,該收音裝置的該處理模組才控制該收音模組收音,使得只有在使用者開啓該冰箱時該收音模組才會收音,以降低該收音裝置的耗能,且避免該收音模組接收到錯誤的該語音資料如日常生活中的對話。The present invention has at least the following effects: receiving the voice data from the user through the radio module, generating the voice recognition result based on the voice data, and sending the voice recognition result including the name of the specific food to the food management server , And after the food management server determines that the name of the specific food in the voice recognition result matches one of the pre-stored food names in the food database as the pre-stored food name of the target food name, it corresponds to the target food name The length of the storage time and the current time generate the target ingredient expiration date, and add a piece of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date, so that the user can put the ingredients in the refrigerator Add food storage data to the storage list database by voice. In addition, the processing unit of the refrigerator determines that the sensing result of the door switch sensing unit indicates that the door is opened and then sends the box door open notification to the In the case of a radio device, the processing module of the radio device controls the radio module to receive the sound, so that the radio module can only receive the sound when the user opens the refrigerator, so as to reduce the energy consumption of the radio device and avoid the radio The module receives the wrong voice data such as conversations in daily life.

在本發明被詳細描述之前,應當注意在以下的說明內容中,類似的元件是以相同的編號來表示。Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same numbers.

參閱圖1,本發明冰箱食材管理系統100之一實施例,包含一冰箱1、一食材管理伺服器2、一收音裝置3、一網頁伺服器800及一使用端電子裝置900。1, an embodiment of a refrigerator food management system 100 of the present invention includes a refrigerator 1, a food management server 2, a radio device 3, a web server 800, and a consumer electronic device 900.

該冰箱1包括一門開關感測單元11、一通訊單元12,及一電連接於該門開關感測單元11與該通訊單元12的處理單元13。該食材管理伺服器2儲存一使用者資料庫、一食材資料庫及一存放清單資料庫。該使用者資料庫包含多個預存使用者名稱及多個分別對應於該等預存使用者名稱的預存使用者聲紋。該食材資料庫包含多個預存食材名稱(例如吐司)及多個分別對應於該等預存食材名稱的可保存時間長度(例如14天)。該存放清單資料庫包含多個食材存放資料,每一食材存放資料包含一操作使用者名稱、一存放食材名稱及一食材期限(例如2020/3/1)。The refrigerator 1 includes a door switch sensing unit 11, a communication unit 12, and a processing unit 13 electrically connected to the door switch sensing unit 11 and the communication unit 12. The food management server 2 stores a user database, a food database and a storage list database. The user database includes a plurality of pre-stored user names and a plurality of pre-stored user voiceprints respectively corresponding to the pre-stored user names. The food material database includes a plurality of pre-stored food names (for example, toast) and a plurality of storage time lengths (for example, 14 days) corresponding to the names of the pre-stored food materials. The storage list database contains multiple food storage data, and each food storage data includes an operating user name, a storage food name, and a food period (for example, 2020/3/1).

該收音裝置3,舉例為一智慧型音箱,但不以此為限,該收音裝置3與該食材管理伺服器2及該冰箱1電連接,並包括一收音模組31、一通訊模組32、一電連接於該收音模組31與該通訊模組32的處理模組33,及一電連接於該處理模組33的揚聲模組34。該收音模組31用以接收一使用者的一語音資料,該語音資料包含一指示放入或取出的動作資訊及一指示本次操作之食材的食材名稱之特定食材名稱。The radio device 3 is, for example, a smart speaker, but not limited to this. The radio device 3 is electrically connected to the food management server 2 and the refrigerator 1, and includes a radio module 31 and a communication module 32 A processing module 33 electrically connected to the radio module 31 and the communication module 32, and a speaker module 34 electrically connected to the processing module 33. The radio module 31 is used to receive a voice data from a user, and the voice data includes an action information indicating putting in or taking out and a specific ingredient name indicating the name of the ingredient of the current operation.

參閱圖1至圖3,以下說明本實施例中該冰箱食材管理系統100所執行的步驟。首先,如步驟S01所示,該冰箱1的該處理單元13判斷該門開關感測單元11的一感測結果是否指示開啓,若該冰箱1的該處理單元13判斷該感測結果指示開啓(一使用者開啓了該冰箱1的箱門),則接著執行步驟S02,若該處理單元13判斷該感測結果並非指示開啓,則結束流程。1 to 3, the following describes the steps executed by the refrigerator food management system 100 in this embodiment. First, as shown in step S01, the processing unit 13 of the refrigerator 1 determines whether a sensing result of the door switch sensing unit 11 indicates opening, and if the processing unit 13 of the refrigerator 1 determines that the sensing result indicates opening ( A user opens the door of the refrigerator 1), then step S02 is executed. If the processing unit 13 determines that the sensing result does not indicate opening, the process ends.

如步驟S02所示,該冰箱1的該處理單元13經由該通訊單元12傳送一箱門開啓通知給該收音裝置3。As shown in step S02, the processing unit 13 of the refrigerator 1 transmits a door opening notification to the radio device 3 via the communication unit 12.

接著,如步驟S03所示,該收音裝置3的該處理模組33經由該通訊模組32接收到該箱門開啓通知後,會控制該揚聲模組34發出一用於提示該使用者表達該語音資料所需之該動作資訊及該特定食材名稱的語音提示訊息,該語音提示訊息舉例可為「請說出本次動作要取出或放入食材?」、「請說出本次操作的食材名稱為何?」等等,但不以前述舉例為限。Then, as shown in step S03, after the processing module 33 of the radio device 3 receives the box door opening notification via the communication module 32, it will control the speaker module 34 to send out a message for prompting the user to express The action information required by the voice data and the voice prompt message for the name of the specific ingredient. Examples of the voice prompt message can be "Please tell me how to take out or put the ingredients in this action?" What is the name of the ingredients?" etc., but not limited to the aforementioned examples.

接著,如步驟S04所示,該收音裝置3的該處理模組33會控制該收音模組31收音。Then, as shown in step S04, the processing module 33 of the radio device 3 controls the radio module 31 to receive sound.

接著,如步驟S05所示,該收音模組31自該使用者接收到該語音資料後,該處理模組33根據該語音資料產生一語音辨識結果,該語音辨識結果包含該動作資訊及該特定食材名稱。Then, as shown in step S05, after the radio module 31 receives the voice data from the user, the processing module 33 generates a voice recognition result based on the voice data. The voice recognition result includes the action information and the specific The name of the ingredient.

接著,如步驟S06所示,該處理模組33還根據該語音資料產生一待辨認聲紋資料。Then, as shown in step S06, the processing module 33 also generates a voiceprint data to be recognized based on the voice data.

接著,如步驟S07所示,該處理模組33將步驟S05所產生的該語音辨識結果及步驟S06所產生的該待辨認聲紋資料傳送給該食材管理伺服器2。Then, as shown in step S07, the processing module 33 transmits the voice recognition result generated in step S05 and the to-be-recognized voiceprint data generated in step S06 to the food management server 2.

接著,如步驟S08所示,該食材管理伺服器2判斷該待辨認聲紋資料是否與該使用者資料庫的該等預存使用者聲紋其中一者相符,若前述兩者相符,則接著執行步驟S09,若前述兩者不相符,則結束流程。Then, as shown in step S08, the food management server 2 determines whether the to-be-identified voiceprint data matches one of the pre-stored user voiceprints in the user database, and if the foregoing two match, it then executes Step S09, if the foregoing two do not match, the process ends.

如步驟S09所示,該食材管理伺服器2根據與該目標聲紋對應的該預存使用者名稱產生一操作使用者名稱,舉例而言若該待辨認聲紋資料與一預先被儲存於該食材管理伺服器2且對應的該預存使用者名稱為小明的預存使用者聲紋相符,則產生指示小明為該操作使用者名稱的指令。As shown in step S09, the food management server 2 generates an operation user name according to the pre-stored user name corresponding to the target voiceprint. For example, if the voiceprint data to be recognized and a pre-stored in the food If the management server 2 matches the voiceprint of the corresponding pre-stored user whose name is Xiaoming, an instruction instructing Xiaoming to be the name of the operating user is generated.

接著,如步驟S10所示,該食材管理伺服器2會判斷該語音辨識結果的該動作資訊是指示放入或取出,若該動作資訊是指示放入,則接著執行步驟S11,若該動作資訊是指示取出,則接著執行步驟S17。Next, as shown in step S10, the food management server 2 will determine whether the action information of the voice recognition result is an instruction to put in or take out. If the action information is an instruction to put in, then step S11 is executed, if the action information If it is an instruction to take out, then step S17 is executed next.

如步驟S11所示,該食材管理伺服器2在接收到該語音辨識結果且判斷出該動作指示放入後,會判斷該語音辨識結果的該特定食材名稱是否與該食材資料庫的該等預存食材名稱其中一者相符,若前述兩者相符,則接著執行步驟S12,若前述兩者不相符,則接著執行步驟S14。As shown in step S11, after the food management server 2 receives the voice recognition result and determines that the action instruction is inserted, it will determine whether the name of the specific food in the voice recognition result matches the pre-stored food database One of the names of the ingredients matches, if the foregoing two match, then step S12 is executed, and if the foregoing two do not match, then step S14 is executed next.

如步驟S12所示,該食材管理伺服器2根據該目標食材名稱對應的該可保存時間長度及當前時間產生一目標食材期限,舉例而言若該可保存時間長度為7日,且當前時間為2020年1月1日,則該目標食材期限為2020年1月1日加7日,也就是2020年1月8日,但目標食材期限的記載格式不以前述舉例為限,目標食材期限可以「2020/1/7」、「2020/01/07」等方式記載。As shown in step S12, the food management server 2 generates a target food expiration date according to the storable time length and the current time corresponding to the target food name. For example, if the storable time length is 7 days and the current time is On January 1, 2020, the deadline for the target ingredient is January 1, 2020 plus 7 days, that is, January 8, 2020, but the record format of the target ingredient deadline is not limited to the aforementioned examples, and the target ingredient deadline can be Record in "2020/1/7", "2020/01/07", etc.

如步驟S13所示,該食材管理伺服器2於產生該目標食材期限後,根據該目標食材名稱、該目標食材期限及該操作使用者名稱新增一筆食材存放資料至該存放清單資料庫。As shown in step S13, after the ingredient management server 2 generates the target ingredient expiration date, it adds a piece of ingredient storage data to the storage list database according to the target ingredient name, the target ingredient expiration date, and the operating user name.

另一方面,當該食材管理伺服器2判斷該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一者不相符,舉例而言若該特定食材名稱為「雞蛋」,但食材資料庫中並未預先儲存名稱為「雞蛋」的預存食材名稱,則接著在步驟S14中,該食材管理伺服器2與一網頁伺服器800通訊,並使用網路爬蟲技術於該網頁伺服器800蒐集資料以獲得一指示出名稱符合該特定食材名稱的食材的可保存時間長度的一蒐集結果,舉例而言該食材管理伺服器2可使用網路爬蟲技術自網頁伺服器800取得名稱為「雞蛋」的食材之可保存時間長度為7天。On the other hand, when the food management server 2 determines that the name of the specific food in the voice recognition result does not match one of the names of the pre-stored food in the food database, for example, if the name of the specific food is "egg" , But the name of the pre-stored ingredient named "egg" is not pre-stored in the ingredient database, then in step S14, the ingredient management server 2 communicates with a web server 800, and uses web crawling technology on the web page The server 800 collects data to obtain a collection result indicating the storage time of an ingredient whose name matches the name of the specific ingredient. For example, the ingredient management server 2 can use web crawling technology to obtain the name from the web server 800 The storage time of "egg" ingredients is 7 days.

接著,如步驟S15所示,該食材管理伺服器2根據該蒐集結果及當前時間產生該目標食材期限。Then, as shown in step S15, the food management server 2 generates the target food expiration date according to the collection result and the current time.

接著,如步驟S16所示,該食材管理伺服器2將該特定食材名稱及該蒐集結果分別當作彼此對應的該預存食材名稱及該可保存時間長度而加入該食材資料庫。步驟S16執行完之後則接著執行步驟S13,也就是該食材管理伺服器2根據該特定食材名稱、該目標食材期限及該操作使用者名稱新增一食材存放資料至該存放清單資料庫。Then, as shown in step S16, the food management server 2 regards the name of the specific food and the collection result as the name of the pre-stored food and the length of storage time corresponding to each other, and adds it to the food database. After step S16 is executed, step S13 is executed, that is, the food management server 2 adds a food storage data to the storage list database according to the specific food name, the target food expiration date, and the operating user name.

另一方面,當該食材管理伺服器2判斷該語音辨識結果的該動作資訊是取出,則接著在步驟S17中,該食材管理伺服器2判斷該語音辨識結果的該特定食材名稱與該存放清單資料庫中的該等食材存放資料其中一個作為一目標存放資料的食材存放資料的該存放食材名稱相符,若前述兩者相符,則接著執行步驟S18,若前述兩者不相符,則結束流程。On the other hand, when the food management server 2 determines that the action information of the voice recognition result is fetched, then in step S17, the food management server 2 determines the name of the specific food and the storage list of the voice recognition result One of the food storage data in the database matches the storage food name of the food storage data as a target storage data. If the foregoing two are consistent, then step S18 is performed. If the foregoing two do not match, the process ends.

如步驟S18所示,該食材管理伺服器2會將該目標存放資料自該存放清單資料庫中刪除,舉例而言,若該食材管理伺服器2判斷該特定食材名稱為「雞蛋」,且該存放清單資料庫包含作為該目標存放資料的該食材存放資料的該存放食材名稱為「雞蛋」,則將該目標存放資料自該存放清單資料庫中刪除。As shown in step S18, the food management server 2 deletes the target storage data from the storage list database. For example, if the food management server 2 determines that the name of the specific food is "egg", and the The storage list database contains the food storage data as the target storage data and the name of the stored food material is "egg", then the target storage data is deleted from the storage list database.

參閱圖4,以下說明該實施例中該冰箱食材管理系統100所執行的步驟,該食材管理伺服器2與一供該使用者操作的使用端電子裝置900通訊。首先,如步驟S101所示,該食材管理伺服器2會判斷該存放清單資料庫的該等食材存放資料其中一者的該食材期限與當前時間的差值是否小於一閾值,若差值小於一閾值,則接著執行步驟S102,若差值不小於一閾值,則結束流程。Referring to FIG. 4, the steps performed by the refrigerator food management system 100 in this embodiment are described below. The food management server 2 communicates with a user-end electronic device 900 for the user to operate. First, as shown in step S101, the food management server 2 determines whether the difference between the expiration date of the food and the current time of one of the food storage data in the storage list database is less than a threshold, and if the difference is less than one If the difference is not less than a threshold, then step S102 is executed. If the difference is not less than a threshold, the process ends.

如步驟S102所示,當該食材管理伺服器2判斷該存放清單資料庫的該等食材存放資料其中一個作為一即期食材資料的食材存放資料的該食材期限與當前時間的差值小於該閾值,該食材管理伺服器2發送一相關於該即期食材資料的即期提醒訊息至該使用端電子裝置900。As shown in step S102, when the food management server 2 determines that one of the food storage data in the storage list database is used as a current food storage data, the difference between the expiration date of the food and the current time is less than the threshold , The food management server 2 sends a current reminder message related to the current food data to the consumer electronic device 900.

接著,如步驟S103所示,該使用端電子裝置900接收到該即期提醒訊息後,會顯示並提醒該使用者。Then, as shown in step S103, after the consumer electronic device 900 receives the spot reminder message, it will display and remind the user.

綜上所述,本發明冰箱食材管理系統100藉由該收音模組31接收來自該使用者的該語音資料並根據該語音資料產生該語音辨識結果後傳送包含該特定食材名稱的該語音辨識結果給該食材管理伺服器2,且藉由該食材管理伺服器2判斷該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為該目標食材名稱的預存食材名稱相符後,根據該目標食材名稱對應的該可保存時間長度及當前時間產生該目標食材期限,並根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫,使得使用者可在將食材放入冰箱1時藉由語音的方式新增食材存放資料於該存放清單資料庫,此外,藉由該冰箱1的該處理單元13判斷該門開關感測單元11的該感測結果指示開啓後傳送該箱門開啓通知給該收音裝置3時,該收音裝置3的該處理模組33才控制該收音模組31收音,使得只有在使用者開啓該冰箱1時該收音模組31才會收音,以降低該收音裝置3的耗能,且避免該收音模組31接收到錯誤的該語音資料如日常生活中的對話,故確實能達成本發明之目的。In summary, the refrigerator food management system 100 of the present invention receives the voice data from the user through the radio module 31, generates the voice recognition result based on the voice data, and then transmits the voice recognition result including the name of the specific food. To the food management server 2, and the food management server 2 determines that the name of the specific food in the voice recognition result matches one of the pre-stored food names in the food database as the target food name. Then, the target ingredient expiration date is generated according to the storage time length and the current time corresponding to the target ingredient name, and a piece of ingredient storage data is added to the storage list database according to the target ingredient name and target ingredient expiration date, so that the user The food storage data can be added to the storage list database by voice when the food is put into the refrigerator 1. In addition, the processing unit 13 of the refrigerator 1 determines the sensing of the door switch sensing unit 11 After the result indicates that the door opening notification is sent to the radio device 3 after the result indicates that the door is opened, the processing module 33 of the radio device 3 controls the radio module 31 to receive the sound, so that the radio module is only used when the user opens the refrigerator 1 31 will receive the sound, so as to reduce the energy consumption of the radio device 3 and prevent the radio module 31 from receiving wrong voice data such as conversations in daily life, so it can indeed achieve the purpose of the invention.

惟以上所述者,僅為本發明之實施例而已,當不能以此限定本發明實施之範圍,凡是依本發明申請專利範圍及專利說明書內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。However, the above are only examples of the present invention, and should not be used to limit the scope of implementation of the present invention, all simple equivalent changes and modifications made in accordance with the scope of the patent application of the present invention and the content of the patent specification still belong to This invention patent covers the scope.

1:冰箱 11:門開關感測單元 12:通訊單元 13:處理單元 2:食材管理伺服器 3:收音裝置 31:收音模組 32:通訊模組 33:處理模組 34:揚聲模組 100:冰箱食材管理系統 800:網頁伺服器 900:使用端電子裝置 S01~S18:步驟 S101~S103:步驟1: refrigerator 11: Door switch sensing unit 12: Communication unit 13: Processing unit 2: Food management server 3: Radio device 31: Radio module 32: Communication module 33: Processing module 34: Speaker module 100: Refrigerator food management system 800: web server 900: Consumer electronics S01~S18: steps S101~S103: steps

本發明之其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中: 圖1是本發明冰箱食材管理系統的一實施例的一硬體連接關係示意圖;及 圖2至圖4是該實施例的一流程圖。Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, in which: FIG. 1 is a schematic diagram of a hardware connection relationship of an embodiment of the refrigerator food management system of the present invention; and Figures 2 to 4 are a flowchart of this embodiment.

1:冰箱1: refrigerator

11:門開關感測單元11: Door switch sensing unit

12:通訊單元12: Communication unit

13:處理單元13: Processing unit

2:食材管理伺服器2: Food management server

3:收音裝置3: Radio device

31:收音模組31: Radio module

32:通訊模組32: Communication module

33:處理模組33: Processing module

34:揚聲模組34: Speaker module

100:冰箱食材管理系統100: Refrigerator food management system

800:網頁伺服器800: web server

900:使用端電子裝置900: Consumer electronics

Claims (10)

一種冰箱食材管理系統,包含: 一冰箱,包括一門開關感測單元、一通訊單元,及一電連接於該門開關感測單元與該通訊單元的處理單元; 一食材管理伺服器,儲存一食材資料庫及一存放清單資料庫,該食材資料庫包含多個預存食材名稱及多個分別對應於該等預存食材名稱的可保存時間長度,該存放清單資料庫包含多個食材存放資料,每一食材存放資料包含一存放食材名稱及一食材期限;及 一收音裝置,與該食材管理伺服器及該冰箱電連接,並包括一收音模組、一通訊模組及一電連接於該收音模組與該通訊模組的處理模組,該收音模組用以接收一使用者的一語音資料,該語音資料包含一指示放入或取出的動作資訊及一特定食材名稱; 當該冰箱的該處理單元判斷出該門開關感測單元的一感測結果指示開啓,該處理單元經由該通訊單元傳送一箱門開啓通知給該收音裝置; 該收音裝置的該處理模組經由該通訊模組接收到該箱門開啓通知後,該處理模組控制該收音模組收音; 當該收音模組自該使用者接收到該語音資料後,該處理模組根據該語音資料,產生一語音辨識結果,且將該語音辨識結果傳送給該食材管理伺服器,該語音辨識結果包含該動作資訊及該特定食材名稱; 該食材管理伺服器在接收到該語音辨識結果且判斷出該動作指示放入後,判斷該語音辨識結果的該特定食材名稱是否與該食材資料庫的該等預存食材名稱其中一者相符; 當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為一目標食材名稱的預存食材名稱相符,該食材管理伺服器根據該目標食材名稱對應的該可保存時間長度及當前時間產生一目標食材期限; 該食材管理伺服器於產生該目標食材期限後,根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫。A refrigerator food management system, including: A refrigerator including a door switch sensing unit, a communication unit, and a processing unit electrically connected to the door switch sensing unit and the communication unit; An ingredient management server, which stores an ingredient database and a storage list database. The ingredient database includes a plurality of pre-stored ingredient names and a plurality of storage time lengths corresponding to the names of the pre-stored ingredients. The storage list database Contains multiple food storage data, each food storage data includes a storage food name and a food period; and A radio device, electrically connected to the food management server and the refrigerator, and includes a radio module, a communication module, and a processing module electrically connected to the radio module and the communication module, the radio module Used to receive a user's voice data, the voice data includes an instruction to put in or take out action information and a specific food name; When the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates that it is turned on, the processing unit transmits a door opening notification to the radio device via the communication unit; After the processing module of the radio device receives the notification that the box door is opened via the communication module, the processing module controls the radio module to receive sound; When the radio module receives the voice data from the user, the processing module generates a voice recognition result based on the voice data, and sends the voice recognition result to the food management server, the voice recognition result includes The action information and the name of the specific ingredient; After the food management server receives the voice recognition result and determines that the action instruction is inserted, it determines whether the specific food name of the voice recognition result matches one of the pre-stored food names in the food database; When the ingredient management server determines that the name of the specific ingredient in the voice recognition result matches the name of one of the stored ingredients in the ingredient database as a target ingredient name, the ingredient management server matches the name of the target ingredient according to the target ingredient The length of the storage time corresponding to the name and the current time produce a target ingredient expiration date; After the ingredient management server generates the target ingredient expiration date, it adds a piece of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date. 如請求項1所述的冰箱食材管理系統,其中,該食材管理伺服器還儲存一使用者資料庫,該使用者資料庫包含多個預存使用者名稱及多個分別對應於該等預存使用者名稱的預存使用者聲紋; 當該收音模組自該使用者接收到該語音資料後,該處理模組還根據該語音資料產生一待辨認聲紋資料,且將該待辨認聲紋資料傳送給該食材管理伺服器; 該食材管理伺服器接收到該待辨認聲紋資料後,該食材管理伺服器判斷該待辨認聲紋資料是否與該使用者資料庫的該等預存使用者聲紋其中一者相符; 當該食材管理伺服器判斷出該待辨認聲紋資料與該使用者資料庫的該等預存使用者聲紋其中一個作為一目標聲紋的預存使用者聲紋相符,該食材管理伺服器根據與該目標聲紋對應的該預存使用者名稱產生一操作使用者名稱; 該食材管理伺服器產生的該食材存放資料還包含該操作使用者名稱。The refrigerator food management system according to claim 1, wherein the food management server further stores a user database, and the user database includes a plurality of pre-stored user names and a plurality of user names corresponding to the pre-stored users. Pre-stored user voiceprint of the name; After the radio module receives the voice data from the user, the processing module also generates a voiceprint data to be recognized based on the voice data, and sends the voiceprint data to be recognized to the food management server; After the food management server receives the voiceprint data to be recognized, the food management server determines whether the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database; When the food management server determines that the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database as a target voiceprint, the food management server matches The pre-stored user name corresponding to the target voiceprint generates an operation user name; The food storage data generated by the food management server also includes the operation user name. 如請求項1或2所述的冰箱食材管理系統,其中,該食材管理伺服器適於與一網頁伺服器通訊; 當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱並未與該食材資料庫的該等預存食材名稱其中任一者相符,該食材管理伺服器使用網路爬蟲技術於該網頁伺服器蒐集而獲得一指示出名稱符合該特定食材名稱的食材的可保存時間長度的一蒐集結果; 該食材管理伺服器根據該蒐集結果及當前時間產生該目標食材期限;該食材管理伺服器於產生該目標食材期限後,根據該特定食材名稱及該目標食材期限新增一食材存放資料至該存放清單資料庫。The refrigerator food management system according to claim 1 or 2, wherein the food management server is adapted to communicate with a web server; When the food management server determines that the name of the specific food in the voice recognition result does not match any of the pre-stored food names in the food database, the food management server uses web crawling technology to serve the web page A collection result indicating the storage time length of the ingredient whose name matches the name of the specific ingredient; The ingredient management server generates the target ingredient expiration date based on the collected results and the current time; after the ingredient management server generates the target ingredient expiration date, it adds an ingredient storage data to the storage based on the specific ingredient name and the target ingredient expiration date List database. 如請求項3所述的冰箱食材管理系統,其中,該食材管理伺服器獲得該蒐集結果後,將該特定食材名稱及該蒐集結果分別當作彼此對應的該預存食材名稱及該可保存時間長度而加入該食材資料庫。The refrigerator food material management system according to claim 3, wherein after the food material management server obtains the collection result, the specific food material name and the collection result are respectively regarded as the name of the pre-stored food material and the storage time length corresponding to each other And join the ingredient database. 如請求項1所述的冰箱食材管理系統,其中,該收音裝置還包含一電連接於該處理模組的揚聲模組,該收音裝置的該處理模組在接收到該箱門開啓通知,並在該處理模組控制該收音模組收音前,會控制該揚聲模組發出一用於提示該使用者表達該語音資料的語音提示訊息。The refrigerator food management system according to claim 1, wherein the radio device further includes a speaker module electrically connected to the processing module, and the processing module of the radio device receives the notification of opening the box door, And before the processing module controls the radio module to receive the sound, the speaker module is controlled to send out a voice prompt message for prompting the user to express the voice data. 如請求項1所述的 冰箱食材管理系統,其中,該收音裝置為一智慧型音箱。The refrigerator food management system according to claim 1, wherein the radio device is a smart speaker. 如請求項1所述的冰箱食材管理系統,其中,該食材管理伺服器適於與一供該使用者操作的使用端電子裝置通訊; 當該食材管理伺服器判斷出該存放清單資料庫的該等食材存放資料其中一個作為一即期食材資料的食材存放資料的該食材期限與當前時間的差值小於一閾值,該食材管理伺服器發送一相關於該即期食材資料的即期提醒訊息至該使用端電子裝置以供該使用端電子裝置顯示。The refrigerator food management system according to claim 1, wherein the food management server is adapted to communicate with a user-end electronic device operated by the user; When the food material management server determines that one of the food material storage data in the storage list database is used as a current food material data of the food material storage data, the difference between the period of the food material and the current time is less than a threshold value, the food material management server Send a current reminder message related to the current food information to the consumer electronic device for display by the consumer electronic device. 如請求項1所述的冰箱食材管理系統,其中,該食材管理伺服器在接收到該語音辨識結果且判斷出該動作資訊指示取出後,判斷該語音辨識結果的該特定食材名稱是否與該存放清單資料庫中的該等食材存放資料其中一者的該存放食材名稱相符; 當該食材管理伺服器判斷該語音辨識結果的該特定食材名稱與該存放清單資料庫中的該等食材存放資料其中一個作為一目標存放資料的食材存放資料的該存放食材名稱相符,該食材管理伺服器會將該目標存放資料自該存放清單資料庫中刪除。The refrigerator food management system according to claim 1, wherein, after the food management server receives the voice recognition result and determines that the action information instruction is taken out, it determines whether the name of the specific food in the voice recognition result is the same as the storage One of the food storage data in the inventory database matches the storage food name; When the food management server determines that the name of the specific food in the voice recognition result matches the name of the stored food in one of the food storage data in the storage list database as a target storage data of the food storage data, the food management The server will delete the target storage data from the storage list database. 一種冰箱食材管理系統的控制方法,藉由一冰箱食材管理系統實施,該冰箱食材管理系統包含一冰箱、一食材管理伺服器及一收音裝置,該冰箱包括一門開關感測單元、一通訊單元,及一電連接於該門開關感測單元與該通訊單元的處理單元,該食材管理伺服器儲存一食材資料庫及一存放清單資料庫,該食材資料庫包含多個預存食材名稱及多個分別對應於該等預存食材名稱的可保存時間長度,該存放清單資料庫包含多個食材存放資料,每一食材存放資料包含一存放食材名稱及一食材期限,該收音裝置與該食材管理伺服器及該冰箱電連接,並包括一收音模組、一通訊模組及一電連接於該收音模組與該通訊模組的處理模組,該收音模組用以接收一使用者的一語音資料,該語音資料包含一指示放入或取出的動作資訊及一特定食材名稱,該方法包含: 當該冰箱的該處理單元判斷出該門開關感測單元的一感測結果指示開啓,該處理單元經由該通訊單元傳送一箱門開啓通知給該收音裝置; 該收音裝置的該處理模組經由該通訊模組接收到該箱門開啓通知後,該處理模組控制該收音模組收音; 當該收音模組自該使用者接收到該語音資料後,該處理模組根據該語音資料,產生一語音辨識結果,且將該語音辨識結果傳送給該食材管理伺服器,該語音辨識結果包含該動作資訊及該特定食材名稱; 該食材管理伺服器在接收到該語音辨識結果且判斷出該動作指示放入後,判斷該語音辨識結果的該特定食材名稱是否與該食材資料庫的該等預存食材名稱其中一者相符; 當該食材管理伺服器判斷出該語音辨識結果的該特定食材名稱與該食材資料庫的該等預存食材名稱其中一個作為一目標食材名稱的預存食材名稱相符,該食材管理伺服器根據該目標食材名稱對應的該可保存時間長度及當前時間產生一目標食材期限; 該食材管理伺服器於產生該目標食材期限後,根據該目標食材名稱及該目標食材期限新增一筆食材存放資料至該存放清單資料庫。A control method of a refrigerator food management system is implemented by a refrigerator food management system. The refrigerator food management system includes a refrigerator, an food management server and a radio device. The refrigerator includes a door switch sensing unit and a communication unit, And a processing unit electrically connected to the door switch sensing unit and the communication unit. The food management server stores a food database and a storage list database. The food database includes a plurality of pre-stored food names and a plurality of respective Corresponding to the length of time that the names of the pre-stored ingredients can be stored, the storage list database contains multiple ingredient storage data, and each ingredient storage data includes a stored ingredient name and an ingredient expiration date. The radio device and the ingredient management server and The refrigerator is electrically connected and includes a radio module, a communication module, and a processing module electrically connected to the radio module and the communication module. The radio module is used for receiving a voice data of a user, The voice data contains an instruction to put in or take out action information and a specific food ingredient name, the method includes: When the processing unit of the refrigerator determines that a sensing result of the door switch sensing unit indicates that it is turned on, the processing unit transmits a door opening notification to the radio device via the communication unit; After the processing module of the radio device receives the notification that the box door is opened via the communication module, the processing module controls the radio module to receive sound; After the radio module receives the voice data from the user, the processing module generates a voice recognition result based on the voice data, and sends the voice recognition result to the food management server, the voice recognition result includes The action information and the name of the specific ingredient; After the food management server receives the voice recognition result and determines that the action instruction is placed, it determines whether the specific food name of the voice recognition result matches one of the pre-stored food names in the food database; When the ingredient management server determines that the name of the specific ingredient in the voice recognition result matches the name of one of the stored ingredients in the ingredient database as a target ingredient name, the ingredient management server matches the name of the target ingredient according to the target ingredient The length of the storage time corresponding to the name and the current time produce a target ingredient expiration date; After the ingredient management server generates the target ingredient expiration date, it adds a piece of ingredient storage data to the storage list database according to the target ingredient name and the target ingredient expiration date. 如請求項9所述的冰箱食材管理系統的控制方法,其中,該食材管理伺服器還儲存一使用者資料庫,該使用者資料庫包含多個預存使用者名稱及多個分別對應於該等預存使用者名稱的預存使用者聲紋,該方法還包含: 當該收音模組自該使用者接收到該語音資料後,該處理模組還根據該語音資料產生一待辨認聲紋資料,且將該待辨認聲紋資料傳送給該食材管理伺服器; 該食材管理伺服器接收到該待辨認聲紋資料後,該食材管理伺服器判斷該待辨認聲紋資料是否與該使用者資料庫的該等預存使用者聲紋其中一者相符; 當該食材管理伺服器判斷出該待辨認聲紋資料與該使用者資料庫的該等預存使用者聲紋其中一個作為一目標聲紋的預存使用者聲紋相符,該食材管理伺服器根據與該目標聲紋對應的該預存使用者名稱產生一操作使用者名稱; 該食材管理伺服器產生的該食材存放資料還包含該操作使用者名稱。The control method of a refrigerator food management system according to claim 9, wherein the food management server further stores a user database, the user database includes a plurality of pre-stored user names and a plurality of user names corresponding to the Pre-stored user's voiceprint with pre-stored user name, the method also includes: After the radio module receives the voice data from the user, the processing module also generates a voiceprint data to be recognized based on the voice data, and sends the voiceprint data to be recognized to the food management server; After the food management server receives the voiceprint data to be recognized, the food management server determines whether the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database; When the food management server determines that the voiceprint data to be recognized matches one of the pre-stored user voiceprints in the user database as a target voiceprint, the food management server matches The pre-stored user name corresponding to the target voiceprint generates an operation user name; The food storage data generated by the food management server also includes the operation user name.
TW109114042A 2020-04-27 2020-04-27 Refrigerator ingredients management system and control method thereof TWI764138B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109114042A TWI764138B (en) 2020-04-27 2020-04-27 Refrigerator ingredients management system and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109114042A TWI764138B (en) 2020-04-27 2020-04-27 Refrigerator ingredients management system and control method thereof

Publications (2)

Publication Number Publication Date
TW202141377A true TW202141377A (en) 2021-11-01
TWI764138B TWI764138B (en) 2022-05-11

Family

ID=80783184

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109114042A TWI764138B (en) 2020-04-27 2020-04-27 Refrigerator ingredients management system and control method thereof

Country Status (1)

Country Link
TW (1) TWI764138B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI771224B (en) * 2021-11-10 2022-07-11 台灣松下電器股份有限公司 Smart temperature control system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWM527082U (en) * 2016-04-11 2016-08-11 Probe Jet Tech Intelligent refrigerator
CN207835482U (en) * 2017-12-07 2018-09-07 天津艾特麦克斯商务信息咨询有限公司 A kind of intelligent refrigerator automatic identification system
CN108302892A (en) * 2017-12-29 2018-07-20 青岛海尔股份有限公司 Intelligent refrigerator and the information prompting method based on intelligent refrigerator

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI771224B (en) * 2021-11-10 2022-07-11 台灣松下電器股份有限公司 Smart temperature control system

Also Published As

Publication number Publication date
TWI764138B (en) 2022-05-11

Similar Documents

Publication Publication Date Title
CN105055173B (en) Intelligent medicine box
RU2569804C2 (en) System and method for user interface intended for detection and publication of information on presence in network
WO2019119976A1 (en) Method and apparatus for pickup from storage terminal, and electronic device
WO2018188587A1 (en) Voice response method and device, and smart device
CN111464402B (en) Control method of intelligent household equipment, terminal equipment and medium
CN103634770B (en) A key based on smart mobile phone is sought help and information management platform and its implementation
CN103929537A (en) Real-time reminding method based on messages of different levels
CN107465595B (en) Equipment message playing control method and device, message playing equipment and storage medium
US9619995B2 (en) Multi-party wireless notification system
CN110896376B (en) Message reminding method, message sending method, related device and equipment
TW200539609A (en) Data delivery device and alteration method of data delivery time
US20210255269A1 (en) Electronic system, electronic device and method for controlling electronic device
CN108334651A (en) Collect method, apparatus and storage medium that user's end data realizes preset need
CN108206998A (en) Obtain the method and device of end message
CN106411694B (en) System and method for using XMPP that content is broadcast to recipient's device
TW202141377A (en) Refrigerator food material management system and control method thereof with which a voice recognition function is provided to facilitate management of food materials
CN107272460A (en) The intelligent robot and its long-range control method, storage medium controlled based on cloud
CN111583605A (en) Remote controller position reminding method and remote controller
CN112291419A (en) Method and device for displaying message reminding of terminal, terminal and computer readable storage medium
TW200824408A (en) Methods and systems for information retrieval during communication, and machine readable medium thereof
CN107885307A (en) Apparatus control method and device
CN109545209A (en) Operation executes method, apparatus and storage medium
CN109658070B (en) Memorandum reminding method, terminal and storage medium for memorandum event
US8983040B2 (en) Method and device for consulting a voice message
CN109274825A (en) A kind of message prompt method and device