CN115077162A - Refrigerator and intelligent refrigerator system - Google Patents
Refrigerator and intelligent refrigerator system Download PDFInfo
- Publication number
- CN115077162A CN115077162A CN202110262128.5A CN202110262128A CN115077162A CN 115077162 A CN115077162 A CN 115077162A CN 202110262128 A CN202110262128 A CN 202110262128A CN 115077162 A CN115077162 A CN 115077162A
- Authority
- CN
- China
- Prior art keywords
- voice
- refrigerator
- consumption
- food material
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 235000013305 food Nutrition 0.000 claims abstract description 235
- 239000000463 material Substances 0.000 claims abstract description 234
- 238000012545 processing Methods 0.000 claims abstract description 68
- 238000003860 storage Methods 0.000 claims abstract description 35
- 238000004891 communication Methods 0.000 claims description 12
- 238000002360 preparation method Methods 0.000 claims 1
- 238000007726 management method Methods 0.000 description 110
- 230000003993 interaction Effects 0.000 description 14
- 238000003672 processing method Methods 0.000 description 13
- 238000013523 data management Methods 0.000 description 10
- 241000220225 Malus Species 0.000 description 9
- 235000013601 eggs Nutrition 0.000 description 9
- 238000000034 method Methods 0.000 description 9
- 241000219094 Vitaceae Species 0.000 description 8
- 235000021021 grapes Nutrition 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 235000021016 apples Nutrition 0.000 description 6
- 241000219095 Vitis Species 0.000 description 4
- 235000009754 Vitis X bourquina Nutrition 0.000 description 4
- 235000012333 Vitis X labruscana Nutrition 0.000 description 4
- 235000014787 Vitis vinifera Nutrition 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 239000002699 waste material Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 235000014443 Pyrus communis Nutrition 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 235000013527 bean curd Nutrition 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005672 electromagnetic field Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 235000012631 food intake Nutrition 0.000 description 1
- 235000012055 fruits and vegetables Nutrition 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 235000013372 meat Nutrition 0.000 description 1
- 235000013622 meat product Nutrition 0.000 description 1
- 239000008267 milk Substances 0.000 description 1
- 235000013336 milk Nutrition 0.000 description 1
- 210000004080 milk Anatomy 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2400/00—General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
- F25D2400/36—Visual displays
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention discloses a refrigerator and an intelligent refrigerator system, wherein the refrigerator comprises: the refrigerator comprises a refrigerator main body, a microphone and a loudspeaker which are arranged on the refrigerator main body, and a voice processing circuit which is arranged in the refrigerator main body and is electrically connected with the microphone and the loudspeaker, wherein the voice processing circuit comprises a voice processing module which generates voice data by coding according to voice information collected by the microphone; the voice recognition module is used for generating a voice instruction after matching the voice data generated by the voice processing module with a pre-embedded voice command vocabulary; and the in-store management module records and stores the food material data information of the food materials stored in the main body of the refrigerator according to the voice instruction. The food material data information at least comprises food material consumption time limit information which is associated with food material types and is pre-recorded and stored in the storage management module.
Description
Technical Field
The invention relates to the technical field of intelligent household appliances, in particular to a refrigerator with a voice interaction function and an intelligent refrigerator system.
Background
Refrigerators, which are main storage appliances for fresh food materials, are closely related to daily life from the purchase, storage, and use of food materials, the distribution of food materials to daily in-store management, and maintenance of breakdown. With the development of the intelligent technology trend, an intelligent refrigerator for performing data management on food materials is attracting more and more attention.
In the prior art, for example, an intelligent refrigerator disclosed in chinese patent document CN109059410A uses a radio frequency tag identification scheme or an image identification scheme to implement data management of food materials in a warehouse.
Regarding the method for identifying the radio frequency tag, in order to cooperate with the intelligent refrigerator, a supplier of the food material needs to attach the corresponding radio frequency tag to the surface of the food material outer package for the intelligent refrigerator to read. The radio frequency tags can increase the cost of food material suppliers, and once the radio frequency tags are not attached to part of food materials provided by the suppliers or the radio frequency tags are not easily attached to part of fresh foods, the food materials are difficult to read by an in-warehouse management system, so that the food materials from various sources cannot be comprehensively subjected to data management. On the other hand, the refrigerator body needs to be additionally provided with a radio frequency reading device which emits an electromagnetic field towards the inside of the refrigerator, and the manufacturing cost and the design difficulty of the refrigerator body are also increased.
The image recognition method depends on image recognition of food materials or food material outer packages, an image database with large data volume needs to be established in advance or a complex matching model needs to be trained, the error rate of the image recognition is high, and the image recognition is difficult to popularize and use in the field of intelligent refrigerators at present for diversified food materials. On the other hand, the refrigerator body also needs to be provided with a special camera for reading food materials, a relevant processor and a relevant memory, and the manufacturing cost and the design difficulty of the refrigerator body are also increased.
In addition, in any of the prior art, a display screen for displaying the refrigerator stock information or the fault information is required to be provided for the user to confirm the refrigerator stock, establish a purchase or use plan, or know the fault information. And the inventory information of the refrigerator is usually shown in a complex list form, and the operation of a display screen by a user is required from the purchase, storage, taking and matching of food materials to daily in-store management, fault maintenance and the like, and the operation and the user lack of interaction and the human-computer interface lack of friendly interaction.
Therefore, it is a problem in the prior art to provide a low-cost intelligent refrigerator that does not require additional hardware devices, can accurately perform data management on a wide variety of food material information, and is user-friendly.
Disclosure of Invention
In view of the above problems, the invention provides a refrigerator and an intelligent refrigerator system, which can accurately manage the food material information in a datamation manner without installing a radio frequency reading device or a camera device and a display screen, and particularly can simply and quickly manage the consumption time limit information of food materials.
The refrigerator provided by the invention comprises: a refrigerator main body; a microphone and a speaker arranged on the refrigerator main body; set up at the inside voice processing circuit who is connected with microphone and speaker electricity of refrigerator main part, wherein, voice processing circuit includes:
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
the voice recognition module is used for generating a voice instruction after matching the voice data generated by the voice processing module with a pre-embedded voice command vocabulary;
and the in-store management module is used for recording and storing the food material data information stored in or taken out from the refrigerator main body according to the voice command sent from the voice recognition module.
The food material data information at least comprises food material consumption time limit information which is associated with food material types and is pre-recorded and stored in the storage management module.
According to the refrigerator provided by the invention, firstly, the speed of voice recognition on information processing is high, the efficiency is high, a user can put in or take out food materials and read out voice information at the same time, and also can read out the voice information in a mode of reading documents or counting the food materials after all the food materials are put in or taken out, so that the data input, update or deletion mode suitable for the refrigerator is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food material names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the data and software cost which needs to be input can be effectively reduced.
Moreover, compared with a radio frequency tag identification method, the method of voice identification does not need to increase the cost of consumables, and equipment such as a loudspeaker and a microphone collects sound or broadcasts sound towards the outside of the refrigerator and is installed in the refrigerator main body, so that the refrigerator is not easily influenced by the cold environment in the refrigerator, and the cost and the design difficulty of the refrigerator body are lower than those of a radio frequency reading device.
And finally, after the voice processing module collects the food material information and the quantity reported and read by the voice of the user, the voice recognition module recognizes and matches the voice command vocabulary which is embedded in advance according to the voice data generated by the voice module, and the in-store management module records and stores the food material information of the refrigerator main body on the basis of the voice command which is generated after the voice recognition module processes, namely the current food material data information. The food material data information at least comprises food material consumption time limit information which is associated with food material types and is pre-recorded and stored in the library management module.
Therefore, the refrigerator provided by the invention can realize data management of the refrigerator food material information by adopting simple equipment such as a loudspeaker, a microphone, a voice processing circuit and the like, a radio frequency reading device or a camera device and a display screen do not need to be additionally arranged, and the manufacturing and management cost of the refrigerator is lower. And, realize the data management of the food material consumption deadline information of the food material in the storehouse based on loudspeaker, microphone and speech processing circuit. The user only needs to input the food material information through voice operation, the consumption time limit of the food materials in the warehouse can be subjected to data management based on the preset default consumption time limit information, the consumption time limit information does not need to be input through the user voice, and the human-computer interface is friendly.
In a preferred technical scheme of the invention, the food material consumption deadline information is generated by taking the date of the voice command generated by the voice recognition module as the calculation date and superposing the preset storage days of the food material. According to the better technical scheme, the user voice input date is taken as the starting date, the food material consumption time limit information of the food materials in the warehouse can be managed more accurately based on the default consumption time limit information of different types of preset food materials of the warehouse management module, the user can know the food material consumption time limit of the food materials in the warehouse conveniently, and the human-computer interaction interface is friendly.
In a preferred technical solution of the present invention, the voice processing circuit further includes a consumption term management module and a voice output module. The consumption time limit management module generates a consumption time limit reminding instruction according to the comparison between the food material consumption time limit information and the current date. And the voice output module is used for converting the consumption deadline reminding instruction into voice data and outputting the voice data to the loudspeaker. According to the better technical scheme, after the database management module records and stores the food material data information, the consumption period management module takes the date of the voice command generated by the voice recognition module as the starting date and the storage days of the superposed preset food materials, namely the food material consumption period information is compared with the current date to generate a consumption period reminding command. The voice output module converts the consumption time limit reminding instruction into voice data to remind the user in a voice mode through the loudspeaker, so that the user can know the in-store food materials close to the consumption time limit or the in-store food materials which have passed the consumption time limit conveniently. Meanwhile, the user can utilize or clean the food materials according to the voice consumption time limit reminding information, the user does not need to mentally record the consumption time limit of various food materials in the warehouse, and a human-computer interaction interface is convenient.
In a preferred technical scheme of the invention, the voice processing circuit further comprises a triggering module, and the triggering module sends a triggering command for outputting a consumption term reminding instruction to the consumption term management module when a preset specified condition is met. According to the better technical scheme, only when the refrigerator senses that the user is located near the refrigerator, the triggering module can send a triggering command for outputting the consumption time limit reminding instruction to the consumption time limit management module, the consumption time limit reminding instruction output by the consumption time limit management module can prompt the user of the in-store food materials close to the consumption time limit or the in-store food materials with the consumption time limit, when the preset specified condition of the triggering module is met, the active voice prompt of the food material consumption time limit information of the in-store food materials close to the consumption time limit or the in-store food materials with the consumption time limit is triggered, and the consumption time limit reminding information can be efficiently received by the user.
Preferably, the triggering module comprises a door body touch switch circuit of the refrigerator main body, or a touch screen switch circuit or a microswitch circuit ON the surface of the refrigerator main body, and when the door body touch switch circuit, the touch screen switch circuit or the microswitch circuit is turned ON/OFF, the triggering module sends a triggering command for outputting a consumption term reminding instruction to the consumption term management module. According to the more preferred technical scheme, only when a user opens or closes a refrigerator door and performs close-range operations such as pressing a key or touching a screen, a door body of the refrigerator main body triggers a switch circuit, or a touch screen switch circuit or a microswitch circuit ON the surface of the refrigerator main body is changed from an OFF state to an ON state, and a trigger module sends a trigger command for outputting a consumption term reminding instruction to a consumption term management module, so that the trigger for reminding the consumption term of the refrigerator is further limited, the user is ensured to be prepared to perform operations related to the refrigerator when receiving the consumption term reminding information, the phenomenon that a loudspeaker sends the consumption term reminding information when the user performs other activities unrelated to the refrigerator nearby the refrigerator is avoided, troubles are caused to the user, and the man-machine interaction is more humanized.
In the preferred technical scheme of the invention, when the voice recognition module generates a specified voice command according to the voice data generated by the voice processing module, the triggering module sends a triggering command for outputting the consumption term reminding command to the consumption term management module. According to the preferred technical scheme, when a user wants to know the consumption deadline information of a certain specific in-store food material, only when the user inputs inquiry of the consumption deadline information of the food material by voice, the triggering module sends a triggering command for outputting a consumption deadline reminding instruction of the food material to the consumption deadline management module, and then the triggering command is converted into voice data by the voice output module and sent to the speaker, and the speaker broadcasts the consumption deadline of the food material by voice, so that the user can conveniently master the consumption deadline information of the certain specific in-store food material, and the human-computer interaction is more accurate.
In a preferred technical solution of the present invention, the voice processing circuit in the refrigerator further includes a recipe management module storing recipe information including at least a type and a number of food materials, and when the trigger module sends a trigger command for outputting a consumption term reminding instruction to the consumption term management module, the consumption term management module calculates and outputs a recipe suggestion instruction after associating and matching the recipe information stored in the recipe management module based on the food material information associated with the consumption term reminding instruction. According to the better technical scheme, the refrigerator can provide the menu suggestions related to the food materials for the user while reporting the food materials in the storage near the consumption time limit for the user through voice, so that convenience is provided for the user to fully utilize the food materials, and the human-computer interaction is more intelligent.
In a preferred technical solution of the present invention, when the type of the food material related to the voice instruction generated by the voice recognition module of the refrigerator is the same as the type of the food material recorded in the consumption time limit management module, the consumption time limit management module generates a prompt instruction, and the voice output module converts the prompt instruction into voice data and outputs the voice data to the speaker. According to the better technical scheme, when the food materials which have passed the consumption period are not processed in the food materials in the warehouse and the user adds the same type of food materials by voice, the refrigerator can prompt the user by voice, so that the user can better manage the food materials in the warehouse.
In a preferred technical scheme of the invention, the invention further provides an intelligent refrigerator system, which comprises any one of the refrigerators related to the technical scheme of the invention, and further comprises an intelligent terminal in communication connection with the refrigerator. Because the intelligent terminal is in communication connection with the consumption time limit management module of the refrigerator, the consumption time limit management module can record and store the food material consumption time limit information of the food materials in the refrigerator main body according to the input of the intelligent terminal. According to the better technical scheme, the user can manually modify the consumption time limit of the food materials through the intelligent terminal according to the actual state, such as freshness and the like, of the stored food material voice input date, so that the user can flexibly adjust the consumption time limit information of the food materials according to the actual state of the food materials, and the food material consumption time limit information of all the food materials can be successfully input and subjected to refined management. Therefore, the intelligent refrigerator system provides two ways of food material consumption time limit information management modes, a user can conveniently adjust and use the intelligent refrigerator system according to the actual state of food materials, troubles of the user due to the fact that the preset default consumption time limit of the refrigerator is single in selection are avoided, the reliability is guaranteed, and the user experience is improved.
Drawings
FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention;
fig. 2 is a schematic view of an external structure of a refrigerator according to an embodiment of the present invention;
fig. 3 is a structural diagram of a voice processing circuit of a refrigerator according to a first embodiment of the present invention;
FIG. 4 is a flow chart of a speech processing method provided by a first embodiment of the present invention;
fig. 5 is a structural view of a voice processing circuit of a refrigerator according to a second embodiment of the present invention;
FIG. 6 is a flowchart of a speech processing method according to a second embodiment of the present invention;
fig. 7 is a structural view of a voice processing circuit of a refrigerator according to a third embodiment of the present invention;
FIG. 8 is a flow chart of a speech processing method according to a third embodiment of the present invention;
fig. 9 is a flowchart of a speech processing method according to a fourth embodiment of the present invention.
Reference numerals:
1-a user; 2-a refrigerator; 20-a refrigerator main body; 21-a microphone; 22-a loudspeaker;
23-a speech processing circuit; 231-a speech processing module; 232-a speech recognition module;
233-library-in management module; 234-consumption term management module; 235-a voice output module;
236-a trigger module; 237-recipe management module; and 3, an intelligent terminal.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
[ terms and explanations ]
In some embodiments, the term "consumption period" is generated by overlapping preset storage days of the food material with the date of generating the voice command by the voice recognition module 232 as a calculation day, for example, for fresh food materials such as vegetables and meat products, a refrigerator may assume that the food material is fresh when being put in the refrigerator, so that the consumption period of the food material is obtained by overlapping the storage days corresponding to the pre-stored food material. In other embodiments, the "consumption period" may be other time amounts related to the storage time of the food material, for example, the expiration date is well documented for the deep processing of milk, tofu and the like, and the consumption period may be the expiration date of the food material outer package printing.
[ APPLICATION SCENES ]
Fig. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.
Referring to fig. 1, an application scenario of the present invention involves communication and interaction between a user 1, a refrigerator 2, and an intelligent terminal 3. In other embodiments of the present invention, some or all of the modules of the voice processing circuit 23 in the refrigerator 2 may also be disposed in a cloud server, and these embodiments should be regarded as simple changes of the technical solution of the present invention and are included in the protection scope of the present invention without departing from the spirit of the present invention.
Fig. 2 is a schematic external structural diagram of a refrigerator 2 according to an embodiment of the present invention, and as can be seen from fig. 2, a microphone 21 and a speaker 22 are disposed on a front side surface of a refrigerator main body 20, and the microphone 21 is used for picking up sound, especially, picking up voice information sent by a user 1 and sending the sound information to a voice processing circuit 23; the loudspeaker 22 is used for broadcasting, in particular for playing voice data returned by the voice processing circuit 23. The voice processing circuit 23 is disposed inside the refrigerator main body 20, is electrically connected to the microphone 21 and the speaker 22, processes the voice information picked up by the microphone 21, obtains voice data to be played by the speaker 22, and forms voice interaction with the user 1.
The refrigerator 2 according to the embodiment of the present invention does not need to have any other technical means capable of interacting with the user 1, other than the voice interaction. However, the present invention is not limited thereto, and in some other embodiments of the present invention, the refrigerator 2 may have other technical means capable of interacting with the user 1 besides voice interaction. For example, the refrigerator 2 may include a touch screen for receiving a touch input of the user 1. As another example, the refrigerator 2 may include a camera for acquiring images or videos of the user 1. As another example, the refrigerator 2 may include a biometric sensor for acquiring biometric information of the user 1, such as fingerprint or iris information. In addition, the refrigerator 2 may be provided with technical means capable of communicating with the terminal and/or the cloud server, including, for example, a wired or wireless communication module, so as to be capable of transmitting and receiving information or data to and from the terminal and/or the cloud server based on various wired or wireless communication protocols.
The refrigerator 2 of the present invention may further include or be replaced with various intelligent appliances, such as food or beverage storage devices, for example, a food cabinet, a refrigerator, a wine cabinet, etc., according to practical application scenarios.
In the embodiment of the invention, an intelligent refrigerator system comprising a refrigerator 2 is also provided, the intelligent refrigerator system further comprises an intelligent terminal 3 in communication connection with the refrigerator 2, and the intelligent terminal 3 is provided with a display screen for displaying instructions or data sent by the refrigerator 2.
[ first embodiment ] to provide a liquid crystal display device
Fig. 3 is a configuration diagram of the voice processing circuit 23 of the refrigerator 2 according to the first embodiment of the present invention.
Referring to fig. 3, in the present embodiment, the voice processing circuit 23 includes a voice processing module 231, a voice recognition module 232, and a library management module 233.
The voice processing module 231 is configured to generate voice data by encoding according to the voice information collected by the microphone 21. In this embodiment, the voice processing module 231 may be an analog-to-digital converter for converting the analog signal sampled by the microphone 21 into a digital signal for subsequent analysis and processing. The voice processing module 231 may be located outside the microphone 21 and communicatively connected to the microphone 21, or may be integrated in a chip of the microphone 21.
The voice recognition module 232 is configured to generate a voice instruction after matching the voice data generated by the voice processing module 231 with the pre-embedded voice command vocabulary. The speech recognition module 232 may use an existing speech recognition module 232, such as an HBR-series speech recognition module 232, and an input port of the speech recognition module 232 may be communicatively connected to the speech processing module 231 using a standard RS232 serial port to receive speech data from the speech processing module 231. The voice recognition module 232 stores a voice command vocabulary in advance, and generates a voice instruction by matching voice data with the voice command vocabulary.
For example, the voice recognition module 232 stores in advance voice command words such as "put in", "take out", "apple", "pear", "grape", "person", "jin", "kg", and "g". When a user 1 sends voice information of '3 apples are placed in the refrigerating chamber', the microphone 21 samples the voice information to obtain an analog signal, and the voice processing module 231 converts the code of the analog signal into digital voice data and sends the digital voice data to the voice recognition module 232; the voice recognition module 232 matches the voice data with the voice command vocabularies to obtain a matching result that the matching degree of the voice data with five voice command vocabularies of 'put in', 'apple', '3', 'individual' and 'cold room' in sequence according to the time sequence reaches a threshold value or more, generates voice instructions reflecting 'cold room apple + 3', and sends the voice instructions to the in-store management module 233.
The inventory management module 233 is configured to record and store the food material data information stored in or taken out from the refrigerator main body 20 according to the voice command sent from the voice recognition module 232. Specifically, the library management module 233 includes a memory (not shown) in which current food material data information including at least food material consumption term information, which is generated by superimposing the number of days of storage of a preset food material, on the date of generation of the voice command by the voice recognition module 232 as the calculation date, and food material data information of the history of storage or retrieval are stored.
The food material data information includes at least one or more of the kind, the number, and the storage location in the refrigerator main body 20 of the food material in addition to the food material consumption term information which is previously recorded and stored in the library management module 233 in association with the kind of the food material. The in-store management module 233 records and stores the type, quantity and storage location of food materials, so as to obtain more complete and reliable in-store management data; the consumption period is recorded and stored, the user 1 can be informed before the expiration of the food materials or about to expire, and the waste of the food materials is reduced; the storage position of the food material in the refrigerator main body 20 is recorded and stored, so that the user 1 can find the target food material more quickly, the heat loss caused by opening and closing the door 2 of the refrigerator is reduced, and the energy consumption is reduced. The storage location in the refrigerator main body 20 may be, for example, a storage location of a refrigerating compartment, a freezing compartment, a garden stuff compartment, a temperature changing compartment, a fresh freezing compartment, or the like.
In addition, the consumption time limit of the food material is generally related to the temperature of the storage position of the food material, and the consumption time limit of the food material is different because the temperature and the humidity of different storage positions are different. By associating the consumption term with the storage location in the refrigerator main body 20, it is possible to more precisely manage the consumption term of the food material and reduce waste of the food material. In other embodiments, the food material data information may also be any other suitable data information related to food materials, and the selection of the kind of the food material data information does not limit the present invention, and is not described herein again.
In the food material data information, the current food material data information is a state quantity, which reflects the current storage state of each food material in the refrigerator main body 20, and is, for example, information that 10 apples (number of apples) (type of apples) are currently stored in the refrigerator main body 20. The stored or retrieved food material data information is a variation, which is a variation of the inventory of food materials in the refrigerator 2 reflected by the voice command sent by the voice recognition module 232, for example, a variation of the inventory of apples increased by 3 reflected by the voice command "cold storage apples + 3".
Fig. 4 is a flowchart of a speech processing method according to a first embodiment of the present invention. Referring to fig. 4, the speech processing method provided by the first embodiment includes:
a voice acquisition step, in which a microphone 21 acquires voice information input by a user 1;
a voice processing step of encoding the voice information collected by the microphone 21 to generate voice data;
a voice recognition step, wherein a voice instruction is generated after matching with a pre-embedded voice command vocabulary according to the voice data generated in the voice processing step;
in the step of managing the warehouse, the food material data information stored or taken out by the refrigerator main body 20 is recorded and stored according to the voice command generated in the step of recognizing the voice, wherein the food material data information at least includes the food material consumption time limit information which is associated with the type of the food material and is pre-recorded and stored in the warehouse management module 233.
In this embodiment, the voice processing step is performed by the voice processing module 231, the voice recognition step is performed by the voice recognition module 232, and the library-in management step is performed by the library-in management module 233. In other embodiments of the present invention, a part of the independent modules in the speech processing circuit 23 may also perform two or more steps of the speech processing method. In some other embodiments, the voice processing circuit 23 may also include one or more processors (not shown), and a memory (not shown) communicatively connected to the processors, where processor-readable instructions are stored in the memory, and the processor performs all the steps of the voice processing method provided in the first embodiment by executing the processor-readable instructions. In addition, the processor and the memory can also be arranged in a cloud server or other intelligent terminal 3 devices in communication connection with the refrigerator 2.
According to the refrigerator 2 and the voice processing method provided by the embodiment, since the speed of the voice recognition on the information processing is high and the efficiency is high, the user 1 can put in or take out the food material and read out the voice information at the same time, and can send out the voice information for the microphone 21 to collect through reading the documents or counting the food material after all the food material is put in or taken out, so that the data management of the food material in the refrigerator 2 can be realized at low cost only by the normal microphone 21, the normal loudspeaker 22 and the voice processing circuit 23 without depending on other hardware equipment including a display screen, and the usable data recording, updating or deleting mode of the refrigerator 2 is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the data and software cost which needs to be invested can be effectively reduced.
Moreover, compared with the method of radio frequency tag identification, the method of voice identification does not need to increase the cost of consumables, and the devices such as the speaker 22 and the microphone 21 are arranged on the outer surface of the refrigerator main body 20 or near the outer surface of the refrigerator main body to pick up sound or broadcast sound, so that the refrigerator main body 2 is not easily affected by the cold environment inside the refrigerator 2, and the cost and the design difficulty of the refrigerator main body 2 are lower than those of the radio frequency reading device. Therefore, in the refrigerator 2 provided in the present embodiment, the data management of the food material information of the refrigerator 2, particularly the consumption time limit information management of the food materials in the refrigerator 2, can be realized by using simple devices such as the speaker 22, the microphone 21, and the voice processing circuit 23, and the manufacturing and management costs of the refrigerator 2 are low because a radio frequency reading device, an imaging device, and a display screen do not need to be additionally installed. Moreover, the data management of the consumption time limit information of the food materials in the refrigerator 2 is realized based on the loudspeaker 22, the microphone 21 and the voice processing circuit 23, so that the user 1 only needs to input the type of the food materials through voice operation, other operations are not needed, and the human-computer interface is friendly.
[ second embodiment ]
Compared with the refrigerator 2 provided in the first embodiment, the voice processing circuit 23 of the refrigerator 2 provided in the present embodiment includes a voice processing module 231, a voice recognition module 232, and an inventory management module 233. In this embodiment, the voice processing circuit 23 further includes a consumption term management module 234, a voice output module 235, and a trigger module 236.
Fig. 5 is a configuration diagram of a voice processing circuit 23 of the refrigerator 2 according to the second embodiment of the present invention.
Referring to fig. 5, in the present embodiment, the voice processing circuit 23 includes the voice processing module 231, the voice recognition module 232, the library management module 233, the consumption term management module 234, the voice output module 235, and the trigger module 236.
The functions and descriptions of the voice processing module 231, the voice recognition module 232, and the library management module 233 refer to the first embodiment of the present invention, and are not described herein again.
The consumption time limit management module 234 in fig. 5 is configured to record and generate a consumption time limit reminding instruction according to the comparison between the food material consumption time limit information and the current date. Specifically, the consumption time limit management module 234 includes a memory (not shown) in which default consumption time limit information preset for different types of food materials is stored.
The voice output module 235 is used for converting the consumption term reminding instruction into voice data and outputting the voice data to the speaker 22. The voice output module 235 is configured to receive the consumption term reminding instruction generated by the consumption term management module 234 and output the consumption term reminding instruction to the speaker 22, so as to remind the user 1 of the consumption term reminding information from the consumption term management module 234 and the voice output module 235 in a form of voice. The voice output module 235 may be a voice output module 235 of the prior art, such as the bay GST-LD-8305 or SAN1800 series.
The trigger module 236 is a trigger command for issuing an instruction to output the consumption term reminder to the consumption term management module 234 when a predetermined condition is satisfied. The execution of the trigger module 236 is not called by a program, is not manually initiated, but is triggered by an event, and may be a contact type or an induction type, and the trigger module 236 may be a trigger or other device with equivalent effect, such as a silicon controlled trigger or other electronic trigger.
Specifically, the triggering module 236 includes a door touch switch circuit (not shown) of the refrigerator main body 20, or a touch screen switch circuit (not shown) or a micro switch circuit (not shown) ON the surface of the refrigerator main body 20, and when the door touch switch circuit, the touch screen switch circuit or the micro switch circuit is turned ON/OFF, the triggering module 236 sends a triggering command for outputting a consumption term reminding instruction to the consumption term management module 234. For example, the door body touch switch circuit, or the touch screen switch circuit or the micro switch circuit may be a bistable touch switch circuit, and as long as the door body touch switch circuit touches a button or a screen or the refrigerator main body 20, the circuit is turned over once and is changed from an OFF state to an ON state to control the ON and OFF of the load circuit, and the trigger may be when the door of the refrigerator 2 is opened or closed or when a key or a touch screen is operated.
Fig. 6 is a flowchart of a voice processing method according to a second embodiment of the present invention, referring to fig. 6, in the refrigerator 2 according to the present embodiment, after the microphone 21 collects the voice message of the user 1, the voice processing module 231 sends the encoded voice data to the voice recognition module 232, and after the voice recognition module 232 matches with the pre-embedded voice command vocabulary, the consumption term of the food in the library is calculated and recorded in the library management module 233 with the voice entry date of the user 1 as the starting date. The consumption time limit management module 234 compares the food material consumption time limit information with the current date, and judges whether the consumption time limit is close to or is expired for the food materials in the warehouse. If the consumption deadline is not close to, the library management module 233 updates and records the consumption deadline data of the food material; if the consumption deadline is close to or the consumption deadline has passed, it is continuously determined whether the specified conditions preset by the trigger module 236 are met, such as whether the user 1 switches on or off the door of the refrigerator 2, or whether a key or touch screen operation is performed, or whether the query of the voice recognition module 232 recognizes whether the user 1 has the consumption deadline information about a specific food material in the library. If the specified condition preset by the triggering module 236 is not met, the in-store management module 233 updates the consumption time limit data recorded and stored in the store food material; if the specified condition preset by the trigger module 236 is met, the trigger module 236 sends a trigger command for outputting a consumption term reminding instruction to the consumption term management module 234, the consumption term management module 234 generates a consumption term reminding instruction of the food materials in the warehouse close to the consumption term or having passed the consumption term after receiving the trigger command, the voice output module 235 converts the consumption term reminding instruction and sends the converted consumption term reminding instruction to the loudspeaker 22, and the user 1 receives the consumption term reminding voice message from the loudspeaker 22. In some embodiments, when the consumption term management module 234 determines that the consumption term is close to or has passed the consumption term, the consumption term reminding instruction may be directly sent to the voice output module 235 without passing through the trigger module 236.
For example, the preset default consumption period of eggs in the stock materials of the refrigerator 2 is 15 days, the date of the user 1 inputting the material data information of the eggs is taken as the starting date, the preset storage days for generating the eggs in a superposition mode are 15 days, and if the date of the user 1 inputting the data information of the material of the eggs in a voice mode is 2021, 2, 4, 12: 00, if the date is used as the starting date and the preset storage days of the eggs are superposed for 15 days, the eggs will be consumed in 2021, 2 months, 18 days 12: 00 expires. If the day before the consumption period of the eggs is defined as the adjacent consumption period, the specific meaning of the day before the consumption period is as follows: such as 2 months and 18 days 00: 00 expired, then 2 months, 00 on day 18: 23 on days 00 to 2/18: 59 is the day before expiration. Further, if user 1 is at 2 months and 18 days 00: 23 on days 00 to 2/18: 59, the door of the refrigerator 2 is opened or closed, or the refrigerator 2 is pressed or touched, the door body touch switch circuit of the refrigerator 2 or the touch screen switch circuit or the microswitch circuit ON the surface of the refrigerator main body 20 is changed from the OFF state to the ON state, the triggering module 236 of the refrigerator 2 sends a triggering command of a consumption term reminding instruction to the consumption term management module 234, after the consumption term management module 234 receives the triggering command, the consumption time limit reminding instruction is generated and sent to the voice output module 235, the consumption time limit reminding instruction comprises information such as placing date and storage position or food material name, the consumption time limit reminding instruction is converted into voice data through the voice output module 235 and then sent to the loudspeaker 22, and the user 1 receives similar voice prompts such as that the next day of eggs placed on the fresh-keeping layer in 2, 4 and 2021 is about to expire soon, and the user is asked to enjoy the eggs as soon as possible. The user can know the food materials in the refrigerator 2 near the consumption period or in the storage after the consumption period.
The specific time near the consumption deadline is not limited, and may be set to, for example, one day or three days before the consumption deadline according to a specific food material; the content of the trigger command and the consumption term reminding instruction is only an example for explanation, and the content of the trigger command and the consumption term reminding instruction is not limited.
According to this embodiment, when the user 1 does not know or forgets the consumption time limit of the in-store food material, the consumption time limit management module 234 may send a consumption time limit reminding instruction to remind the user 1 of the in-store food material approaching the consumption time limit or having passed the consumption time limit in the refrigerator 2, so that the user 1 can utilize the in-store food material approaching the consumption time limit in time or clear the in-store food material having passed the consumption time limit, and waste and pollution of the food material are avoided.
For another example, when the user 1 wants to know the consumption deadline information of a specific food material in the storage, and the user 1 inputs the query-type voice information about the consumption deadline information of the food material, the voice recognition module 232 processes the voice data generated by the voice processing module 231, and generates a corresponding voice command after performing fuzzy matching with the vocabulary of the generated predetermined voice command, the trigger module 236 may issue a trigger command for outputting the consumption deadline prompt command to the consumption deadline management module 234.
Specifically, for example, when the user 1 wants to know the consumption term information of grapes stored in the refrigerator 2, the user 1 makes a voice input "ask for how long the shelf life of grapes in the refrigerator remains? Or when the user wants to know the shelf life of the grapes in the refrigerator, and other voice information, the voice recognition module 232 performs fuzzy matching on the data generated by the voice processing module 231 and the specified voice command vocabularies such as the grapes, the consumption period, the shelf life, the storage days, the expiration and the like related to the consumption period, the trigger module 236 sends a trigger command for outputting a consumption period reminding instruction to the consumption period management module 234, the consumption period management module 234 generates a consumption period reminding instruction of the grapes in the refrigerator 2 and outputs the consumption period reminding instruction through the voice output module 235 by comparing the consumption period information of the grapes with the current date according to the voice data matched with the grapes and the shelf life, so that the user 1 can know the consumption period information of certain food materials in the refrigerator conveniently, and a human-computer interaction interface is more intelligent and accurate.
In the present embodiment, the form in which the consumption term management module 234 is independent of the speech recognition module 232 and the consumption term management module 234 generates the consumption term reminding instruction has been described, but the present invention is not limited thereto, and the consumption term management module 234 may be included in the speech recognition module 232, or the speech recognition module 232 may generate the consumption term reminding instruction instead of the consumption term management module 234.
In addition, although the present embodiment has been described in the form of the consumption term management module 234 and the trigger module 236, the present invention is not limited thereto, and the trigger module 236 satisfying the predetermined condition may be provided separately or simultaneously, and the setting form is not limited as long as the trigger module 236 can transmit the trigger command to the consumption term management module 234.
[ third embodiment ]
Compared with the refrigerator 2 provided in the first and second embodiments, the voice processing circuit 23 of the present embodiment further includes a recipe management module 237 in the refrigerator 2 provided in the present embodiment.
Fig. 7 is a configuration diagram of a voice processing circuit 23 of the refrigerator 2 according to the third embodiment of the present invention.
Referring to fig. 7, in the present embodiment, the voice processing circuit 23 includes the voice processing module 231, the voice recognition module 232, the library management module 233, the consumption term management module 234, the voice output module 235, the trigger module 236, and further includes the menu management module 237.
The functions and descriptions of the voice processing module 231, the voice recognition module 232, the in-store management module 233 consumption term management module 234, the voice output module 235, and the trigger module 236 refer to the first embodiment and the second embodiment of the present invention, and are not described herein again.
In this embodiment, the recipe management module 237 stores recipe information including at least the type and the number of food materials, and when the trigger module 236 sends a trigger command for outputting a consumption term reminding instruction to the consumption term management module 234, the consumption term management module 234 calculates and outputs a recipe suggestion instruction after managing and matching the food material information associated with the consumption term reminding instruction with the recipe information stored in the recipe management module 237 based on the consumption term reminding instruction. Specifically, the recipe management module 237 includes a memory (not shown) in which recipe information is stored. Since the recipe information of the recipe management module 237 may be associated and matched with the food material data information of the in-store food material near the consumption time limit or having passed the consumption time limit of the consumption time limit management module 234, when the consumption time limit reminding instruction of the in-store food material near the consumption time limit generated by the consumption time limit management module 234 is received, the recipe information of the in-store food material near the consumption time limit, or the recipe information of the in-store food material near the consumption time limit or the recipe combined with the in-store food material may be recommended to the user 1 based on the recipe information of the in-store food material near the consumption time limit, or after being associated and matched with the current in-store food material data information stored by the in-store management module 233.
Fig. 8 is a flowchart of a voice processing method according to a third embodiment of the present invention, and referring to fig. 8, the refrigerator 2 automatically calculates and updates the consumption time limit of the food materials in the storage based on the food material consumption time limit information, the type of the food materials, and the date of start of the calculation, which are previously recorded and stored in the storage management module 233. The consumption time limit management module 234 compares the preset food material consumption time limit information of the food materials in the warehouse with the current date, and judges whether the consumption time limit of the food materials in the warehouse is close to the preset consumption time limit of the refrigerator 2 or exceeds the preset consumption time limit. If the consumption time limit of the in-store food material is in accordance with the preset food material consumption time limit information, that is, within the preset consumption time limit of the refrigerator 2, the in-store management module 233 records and stores the food material consumption time limit information of the in-store food material; if the food material consumption time limit information does not accord with the preset food material consumption time limit information, the food material in the warehouse is close to the consumption time limit or the consumption time limit is over. When the user 1 opens or closes the door of the refrigerator 2 or presses a button or touches a touch screen to operate under the condition that the storehouse food material does not accord with the preset food material consumption time limit information, if the preset specified condition of the triggering module 236 is also met, the triggering module 236 will issue a triggering command for outputting a consumption term reminding instruction to the consumption term management module 234, and while the consumption term management module 234 outputs the consumption term reminding instruction, the recipe management module 237 associated with the consumption term management module 234 is based on the food material information associated with the consumption term reminding instruction, after being associated and matched with the menu information stored by the menu management module 237, the menu suggestion instruction is calculated and output, the menu suggestion instruction is converted into voice data by the voice output module 235 and then transmitted to the loudspeaker 22, and then the user 1 is made aware of the menu associated with the food materials in the library near the consumption deadline through the form of voice.
For example, when the food material near the consumption deadline related to the consumption deadline prompt instruction output by the consumption deadline management module 234 is "agaric", the recipe suggestion instruction of "cold mix agaric" or the recipe suggestion instruction of "agaric stir-fried meat" is provided after matching with the recipe information stored in the recipe management module 237. Here, the contents of the recipe suggestion instruction are not limited.
In this embodiment, the recipe suggestion associated with the time limit of consumption close to is output by the recipe management module 237, so that the user 1 can make full use of the food material according to the type and the quantity of the food material in the warehouse close to the time limit of consumption, waste of the food material in the warehouse close to the time limit of consumption is avoided, common recipe making steps can be recommended for the user 1, and the experience of the user 1 is enhanced.
[ fourth embodiment ]
Fig. 9 is a flowchart of a speech processing method according to a fourth embodiment of the present invention. The flowchart is a flowchart of a voice processing method when the user 1 adds the same kind of food material by voice when the consumption time limit of the stock food material in the refrigerator 2 is close or the expired food material is not cleaned.
Referring to fig. 9, when the type of the food material related to the voice command generated by the voice recognition module 232 is the same as the type of the food material recorded in the consumption time limit management module 234, the consumption time limit management module 234 generates a prompt command, and the voice output module 235 converts the prompt command into voice data and outputs the voice data to the speaker 22.
For example, when the user 1 opens the door of the refrigerator 2 to prepare to enter a newly purchased "grape" after the "grape" serving as the warehouse material in the refrigerator 2 has expired for three days, the consumption term management module 234 generates a prompt instruction, such as a prompt instruction of "there are three days old grapes in the fruit and vegetable chamber in the refrigerator, please put the newly purchased grape after cleaning as soon as possible" and outputs the prompt instruction after conversion by the voice output module 235. Therefore, the user 1 can know that the overdue food materials which are not cleaned in time exist in the refrigerator 2 without checking the actual states of all the food materials in the refrigerator 2 one by one, and the situation that the same food materials are repeatedly input by the user 1 when the food materials are stored in the refrigerator 2 and the quality of the food materials in the refrigerator 2 cannot be guaranteed is avoided.
Therefore, the prompt instruction generated by the consumption term management module 234 enables the user 1 to know the conditions of the food materials of the same type in the refrigerator 2, so that the user 1 can better manage the food materials in the refrigerator, and the human-computer interaction reliability is higher.
[ fifth embodiment ] A
In this embodiment, an intelligent refrigerator system is provided, which further includes an intelligent terminal 3 in communication connection with the refrigerator 2, and the refrigerator 2 of this embodiment has the same structure and function as any of the refrigerators 2 described in the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment, and therefore, description thereof is omitted.
In this embodiment, the consumption time limit management module 234 is in communication connection with the intelligent terminal 3, and the consumption time limit management module 234 records and stores the food material consumption time limit information of the food material in the refrigerator main body 20 according to the input of the intelligent terminal 3. Therefore, the food consumption time limit information of the food material input by the user 1 through the smart terminal 3 may be recorded and stored in the consumption time limit management module 234.
For example, when the food material purchased by the user 1 is not fresh, or the consumption time limit of the purchased food material is longer than the preset consumption time limit in the refrigerator 2 after being specially processed, or a new food material needs to be stored, the intelligent terminal 3 manually inputs or modifies the food material consumption time limit information of the food material, so that the user 1 can flexibly adjust the consumption time limit of the food material according to the actual state of the food material during storage. Therefore, the refrigerator 2 in this embodiment can automatically input the consumption time limit information through the intelligent terminal 3 according to the actual state of the food material during storage or the requirements of the user 1 on the quality of different food materials.
The intelligent terminal 3 may be a mobile phone APP in communication connection with the refrigerator 2, or may be an applet, or a web page version management system where the refrigerator 2 is located, or the like.
According to the intelligent refrigerator system provided by the embodiment, the intelligent terminal 3 is in communication connection with the refrigerator 2, the user 1 can manually modify the consumption time limit of the stored food materials according to the actual state of the stored food material voice input day, such as freshness and the like, and the refrigerator 2 can be ensured to flexibly adjust the consumption time limit information of the food materials according to the actual state of the food materials. Therefore, the intelligent refrigerator system provides two ways of food material consumption time limit information management modes, the user 1 can conveniently adjust and use the food material according to the actual state of the food material, troubles brought to the user 1 due to the fact that the default consumption time limit preset by the refrigerator 2 is too single are avoided, the reliability is ensured, and meanwhile the user experience is improved.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalents and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. A refrigerator, characterized by comprising:
a refrigerator main body;
a microphone and a speaker provided in the refrigerator main body;
a voice processing circuit arranged in the refrigerator main body and electrically connected with the microphone and the loudspeaker, wherein the voice processing circuit comprises,
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
the voice recognition module is used for generating a voice instruction after matching with a pre-embedded voice command vocabulary according to the voice data generated by the voice processing module;
the in-store management module records and stores food material data information of food materials stored in the refrigerator main body according to the voice instruction,
the food material data information at least comprises food material consumption time limit information which is associated with the food material types and is pre-recorded and stored in the inventory management module.
2. The refrigerator according to claim 1,
the food material consumption deadline information is generated by taking the date of the voice command generated by the voice recognition module as the starting date and superposing the preset storage days of the food material.
3. The refrigerator according to claim 1 or 2, wherein the voice processing circuit further comprises:
the consumption time limit management module is used for recording and generating a consumption time limit reminding instruction according to the comparison between the food material consumption time limit information and the current date;
and the voice output module is used for converting the consumption deadline reminding instruction into voice data and outputting the voice data to the loudspeaker.
4. The refrigerator of claim 3, wherein the voice processing circuit further comprises:
and the triggering module is used for sending a triggering command for outputting the consumption term reminding instruction to the consumption term management module when a preset specified condition is met.
5. The refrigerator according to claim 4,
the trigger module comprises a door body trigger switch circuit of the refrigerator main body, or a touch screen switch circuit or a microswitch circuit on the surface of the refrigerator main body,
and when the door body touches the switch circuit, or touches the screen switch circuit, or the microswitch circuit is ON/OFF, the triggering module sends a triggering command for outputting the consumption term reminding instruction to the consumption term management module.
6. The refrigerator according to claim 4,
the voice recognition module generates a specified voice command according to the voice data generated by the voice processing module,
and the triggering module sends a triggering command for outputting the consumption term reminding instruction to the consumption term management module.
7. The refrigerator according to any one of claims 4 to 6, wherein the voice processing circuit further comprises:
a menu management module for storing menu information at least including food material types and quantities,
when the triggering module sends a triggering command for outputting the consumption term reminding instruction to the consumption term management module,
and the consumption time limit management module calculates and outputs a menu suggestion instruction after the food material information associated with the consumption time limit reminding instruction is associated and matched with the menu information stored by the menu management module.
8. The refrigerator according to claim 3,
the food material type related to the voice command generated by the voice recognition module is the same as the food material type recorded in the consumption time limit management module,
the consumption term management module generates a prompt instruction,
and the voice output module converts the prompt instruction into voice data and outputs the voice data to the loudspeaker.
9. An intelligent refrigerator system comprises
The refrigerator of any one of claims 1-8;
an intelligent terminal in communication connection with the refrigerator,
it is characterized in that the preparation method is characterized in that,
and the consumption time limit management module records and stores the food material consumption time limit information of the food materials in the refrigerator main body according to the input of the intelligent terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110262128.5A CN115077162A (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110262128.5A CN115077162A (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115077162A true CN115077162A (en) | 2022-09-20 |
Family
ID=83241718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110262128.5A Pending CN115077162A (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115077162A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN110168298A (en) * | 2017-01-03 | 2019-08-23 | 三星电子株式会社 | Refrigerator and its information display method |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
-
2021
- 2021-03-10 CN CN202110262128.5A patent/CN115077162A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| CN110168298A (en) * | 2017-01-03 | 2019-08-23 | 三星电子株式会社 | Refrigerator and its information display method |
| US20190348044A1 (en) * | 2017-01-03 | 2019-11-14 | Samsung Electronics Co., Ltd. | Refrigerator and information display method thereof |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107403248A (en) | Article control method, device, intelligent storage equipment and operating system | |
| CN110168298A (en) | Refrigerator and its information display method | |
| CN103196277B (en) | Refrigerator food managing method and system, server, refrigerator | |
| CN105723635B (en) | Household electrical appliance and mobile terminal | |
| US8032430B2 (en) | Method and apparatus for mapping content descriptions to reusable containers | |
| CN201368632Y (en) | Network refrigerator | |
| CN113494792A (en) | Refrigerator with a door | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| CN109471382A (en) | Water dispenser response method, device, equipment and storage medium | |
| CN102708864A (en) | Conversation-based household electronic equipment and control method thereof | |
| CN107403249A (en) | Article control method, device, intelligent storage equipment and operating system | |
| CN107852535A (en) | Cooperative system, machine management server device, control object machine and terminal installation | |
| CN201467242U (en) | Mobile phone with network application and capable of remotely controlling television/DVD/set top box | |
| CN109600309A (en) | Exchange method, device, intelligent gateway and the storage medium of intelligent gateway | |
| JP2006317109A (en) | Refrigerator | |
| CN112417282B (en) | Information recommendation method, food storage equipment and server | |
| CN115077162A (en) | Refrigerator and intelligent refrigerator system | |
| CN112199406A (en) | Information recommendation method, food material storage device and server | |
| CN115077158A (en) | Refrigerator, intelligent refrigerator system | |
| CN201689423U (en) | System used for managing refrigerator | |
| CN115077157B (en) | Refrigerator and intelligent refrigerator system | |
| CN206891030U (en) | Intelligent refrigerator control device and refrigerator | |
| CN115077161B (en) | Refrigerator and intelligent refrigerator system | |
| CN113915843B (en) | Refrigerator and management method of food material information of refrigerator | |
| CN101126573B (en) | Food management refrigerator using RFID |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240620 Address after: 214028 No.1, Xixin 1st Road, Wuxi City, Jiangsu Province Applicant after: Panasonic Home Appliances Refrigerator(Wuxi) Co.,Ltd. Country or region after: China Address before: 215123 No. 300, Zhongnan street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Applicant before: PANASONIC R&D CENTER SUZHOU Co.,Ltd. Country or region before: China |