CN115077160A - Refrigerator, intelligent refrigerator system - Google Patents
Refrigerator, intelligent refrigerator system Download PDFInfo
- Publication number
- CN115077160A CN115077160A CN202110262125.1A CN202110262125A CN115077160A CN 115077160 A CN115077160 A CN 115077160A CN 202110262125 A CN202110262125 A CN 202110262125A CN 115077160 A CN115077160 A CN 115077160A
- Authority
- CN
- China
- Prior art keywords
- food material
- voice
- instruction
- refrigerator
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000000463 material Substances 0.000 claims abstract description 380
- 235000013305 food Nutrition 0.000 claims abstract description 361
- 238000012545 processing Methods 0.000 claims abstract description 52
- 230000001502 supplementing effect Effects 0.000 claims abstract description 20
- 239000013589 supplement Substances 0.000 claims description 121
- 238000004364 calculation method Methods 0.000 claims description 33
- 238000004891 communication Methods 0.000 claims description 19
- 238000007726 management method Methods 0.000 abstract description 60
- 230000003993 interaction Effects 0.000 abstract description 14
- 238000013523 data management Methods 0.000 abstract description 6
- 230000005611 electricity Effects 0.000 abstract description 2
- 241000220225 Malus Species 0.000 description 14
- 238000003672 processing method Methods 0.000 description 11
- 235000017166 Bambusa arundinacea Nutrition 0.000 description 10
- 235000017491 Bambusa tulda Nutrition 0.000 description 10
- 241001330002 Bambuseae Species 0.000 description 10
- 235000015334 Phyllostachys viridis Nutrition 0.000 description 10
- 239000011425 bamboo Substances 0.000 description 10
- 235000021016 apples Nutrition 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 235000015241 bacon Nutrition 0.000 description 7
- 238000000034 method Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 244000291564 Allium cepa Species 0.000 description 4
- 235000010167 Allium cepa var aggregatum Nutrition 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 235000015872 dietary supplement Nutrition 0.000 description 4
- 235000013601 eggs Nutrition 0.000 description 4
- 239000002699 waste material Substances 0.000 description 4
- 235000015277 pork Nutrition 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000013479 data entry Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 235000013336 milk Nutrition 0.000 description 2
- 239000008267 milk Substances 0.000 description 2
- 210000004080 milk Anatomy 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 241000272525 Anas platyrhynchos Species 0.000 description 1
- 206010034203 Pectus Carinatum Diseases 0.000 description 1
- 235000014443 Pyrus communis Nutrition 0.000 description 1
- 244000077233 Vaccinium uliginosum Species 0.000 description 1
- 235000011720 Vaccinium uliginosum Nutrition 0.000 description 1
- 235000009754 Vitis X bourquina Nutrition 0.000 description 1
- 235000012333 Vitis X labruscana Nutrition 0.000 description 1
- 240000006365 Vitis vinifera Species 0.000 description 1
- 235000014787 Vitis vinifera Nutrition 0.000 description 1
- 244000273928 Zingiber officinale Species 0.000 description 1
- 235000006886 Zingiber officinale Nutrition 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 235000013527 bean curd Nutrition 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005672 electromagnetic field Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 235000008397 ginger Nutrition 0.000 description 1
- 235000013622 meat product Nutrition 0.000 description 1
- 235000015097 nutrients Nutrition 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention relates to the technical field of intelligent household appliances, and provides a refrigerator and an intelligent refrigerator system, which can realize accurate data management on various food materials without additionally installing too many hardware devices, and a human-computer interface can realize friendly interaction. The refrigerator includes the speech processing circuit who is connected with microphone and speaker electricity, and wherein, speech processing circuit includes: the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone; the voice recognition module is used for generating a voice instruction after matching the voice data generated by the voice processing module with a pre-embedded voice command vocabulary; the in-store management module records and stores food material data information of food materials stored in or taken out of the refrigerator main body according to the voice instruction sent from the voice recognition module; and the food material calculating module calculates and outputs a food material supplementing instruction based on the voice instruction sent from the voice recognition module and the current food material data information stored by the in-store management module.
Description
Technical Field
The invention relates to the technical field of intelligent household appliances, in particular to a refrigerator with a voice interaction function and an intelligent refrigerator system.
Background
As a main storage device for fresh food materials, a refrigerator is closely related to daily life from purchase, storage, taking, matching, daily in-store management, failure maintenance and the like of food materials. With the development of the intelligent technology trend, an intelligent refrigerator for performing data management on food materials is attracting more and more attention.
In the prior art, for example, an intelligent refrigerator disclosed in chinese patent document CN109059410A uses a radio frequency tag identification scheme or an image identification scheme to implement data management of food materials in a warehouse.
Regarding the method for identifying the radio frequency tag, in order to cooperate with the intelligent refrigerator, a supplier of the food material needs to attach the corresponding radio frequency tag to the surface of the food material outer package for the intelligent refrigerator to read. The radio frequency tags can increase the cost of food material suppliers, and once the radio frequency tags are not attached to part of food materials provided by the suppliers or the radio frequency tags are not easily attached to part of fresh foods, the food materials are difficult to read by an in-warehouse management system, so that the food materials from various sources cannot be comprehensively subjected to data management. On the other hand, the refrigerator body needs to be additionally provided with a radio frequency reading device which emits electromagnetic field towards the inside of the refrigerator, and the manufacturing cost and the design difficulty of the refrigerator body are increased.
The image recognition method depends on image recognition of food materials or food material outer packages, an image database with large data volume needs to be established in advance or a complex matching model needs to be trained, the error rate of the image recognition is high, and the image recognition is difficult to popularize and use in the field of intelligent refrigerators at present for diversified food materials. On the other hand, the refrigerator body also needs to be additionally provided with a special camera for reading food materials, a relevant processor and a relevant memory, and the manufacturing cost and the design difficulty of the refrigerator body are increased.
In addition, in any of the prior art, a display screen for displaying the stock information or the fault information of the refrigerator is required to be provided for the user to confirm the refrigerator, establish a purchase or use plan, or know the fault information. And the refrigerator inventory information is usually shown in a complex list form, and the operation of a display screen by a user is required from the purchase, storage, taking and matching of food materials to the daily in-store management, fault maintenance and the like, and the operation and the user lack interaction and the friendly interaction of a human-computer interface.
Therefore, it is a problem in the prior art how to provide a low-cost intelligent refrigerator which does not need to add too many hardware devices, can perform accurate data management on a variety of food materials, and is friendly to human-computer interface.
Disclosure of Invention
In order to solve the problems, the invention provides a refrigerator and an intelligent refrigerator system, which can realize accurate data management on various food materials without additionally installing too many hardware devices, and have friendly human-computer interfaces.
The refrigerator provided by the invention comprises: a refrigerator main body; a microphone and a speaker arranged on the refrigerator main body; set up at the inside voice processing circuit who is connected with microphone and speaker electricity of refrigerator main part, wherein, voice processing circuit includes:
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
the voice recognition module is used for generating a voice instruction after matching the voice data generated by the voice processing module with a pre-embedded voice command vocabulary;
the in-store management module records and stores food material data information of food materials stored in or taken out of the refrigerator main body according to the voice instruction sent from the voice recognition module;
and the food material calculating module calculates and outputs a food material supplementing instruction based on the voice instruction sent from the voice recognition module and the current food material data information stored by the in-store management module.
According to the refrigerator provided by the invention, firstly, the speed of voice recognition on information processing is high, the efficiency is high, a user can put in or take out food materials and send out voice for the microphone to collect voice information, and can send out the voice information for the microphone to collect through reading documents or counting the food materials after all the food materials are put in or taken out, so that the intelligent management on the food materials in the refrigerator can be realized at low cost only by a common microphone, a loudspeaker and a voice processing circuit without additionally arranging too many hardware devices including a display screen, and the usable data entry, update or deletion mode of the refrigerator is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food material names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the cost of data and software which need to be recorded can be effectively reduced.
Moreover, compared with a radio frequency tag identification method, the method of voice identification does not need to increase the cost of consumables of the radio frequency tag, and equipment such as a loudspeaker and a microphone collects sound or broadcasts sound towards the outside of the refrigerator and is installed on the outer side surface of the refrigerator main body or nearby, so that the refrigerator is not easily affected by the cold environment inside the refrigerator, and the cost and the design difficulty of the refrigerator body are lower than those of an additionally-installed radio frequency reading device.
Finally, the food material calculating module can calculate and output a food material supplement instruction based on the current food material data information, so that a user does not need to actively calculate information such as the type or the quantity of food material supplement, and the food material supplement of the user is facilitated. Moreover, the calculation and the output of the food material supplement instruction can be triggered by voice information input from the outside, namely when the user sends out voice information to inquire what food material needs to be supplemented or what purchasing suggestion is made, the food material supplement instruction is output to inform the user, the user can know what food material needs to be supplemented without opening a refrigerator door or operating any equipment, the convenience degree of the refrigerator is improved while energy is saved, the human-computer interface is friendly, and the user experience is improved.
In a preferred technical solution of the present invention, the voice processing circuit further includes a voice output module, which receives the food material supplement instruction output by the food material calculation module, converts the food material supplement instruction into voice data, and outputs the voice data to the speaker. According to the better technical scheme, the food material supplementing instruction is played through the loudspeaker, a user does not need to open a refrigerator door, and can know the relevant information to be supplemented of the food materials in the refrigerator through voice without looking up a display screen and the like, so that the use convenience degree of the food material supplementing function is improved.
In a preferred embodiment of the present invention, the food material data information at least includes any one or more of a kind, a quantity, a consumption term, and a storage location in the refrigerator main body.
According to the better technical scheme, the in-store management module records and stores the types and the quantity of the food materials by analyzing the voice instructions obtained by the voice processing module and the voice recognition module, so that more complete and reliable in-store management data can be obtained; the consumption period is recorded and stored, so that the user can be informed before the expiration of the food materials or about to expire, and the waste of the food materials is reduced; the storage position of the food material in the refrigerator main body is recorded and stored, so that a user can find the target food material more quickly, the heat loss caused by opening and closing the refrigerator door is reduced, and the energy consumption is reduced.
In addition, the consumption time limit of the food material is generally related to the temperature of the storage position of the food material, and the consumption time limit of the food material is different because the temperature and the humidity of different storage positions are different. By associating the consumption time limit of the food material with the storage location in the refrigerator main body, the consumption time limit of the food material can be managed more accurately, and waste of the food material is reduced.
In a preferred technical scheme of the present invention, the library management module stores user consumption attribute information generated according to the access time attribute of the food material, and the food material calculation module further calculates and outputs a food material supplement instruction according to the user consumption attribute information.
In the preferred technical scheme, the access time attribute of the food material can reflect the consumption habit of the user to a certain extent, so that the user consumption attribute information can be generated accordingly. According to the user consumption attribute information, the food material supplement instruction is calculated and output, the supplement strategy can be designed in a targeted manner according to the consumption habit of the user on food materials, the sufficient supply of the stock food materials is preferentially ensured, and the management efficiency of the food materials is improved.
In a preferred technical solution of the present invention, the refrigerator further includes a recipe management module, the recipe management module stores recipe information including at least a type and a number of food materials, and the food material calculation module calculates and outputs a food material supplement instruction and a recipe suggestion instruction after associating and matching the current food material data information with the recipe information stored by the recipe management module based on the current food material data information stored by the in-store management module.
According to the preferred technical scheme, the menu information of the menu management module can be associated and matched with the current food material data information stored in the library management module, so that when the menu is inquired by external voice information, the menu can be recommended based on the current food material data information, and when part of food materials related to the recommended menu is deficient, a food material supplement instruction can be output at the same time, so that a user can determine whether to determine supplement of food materials according to the recommended menu according to needs, inventory, supplement and menu recommendation of the food materials can be managed in a mutual combination mode, and the automation degree and accuracy of food material library management are effectively improved.
In a preferred technical scheme of the invention, the recipe information stored in the recipe management module further includes auxiliary material information of auxiliary materials required for making the recipe, and the food material calculation module outputs the auxiliary material information associated with the recipe suggestion instruction together according to the recipe suggestion instruction.
The auxiliary material information such as the quantity and the type of the auxiliary materials required by the menu is changed according to the food material data information such as the quantity and the type of the food materials, and some auxiliary materials required by the menu are stored in the refrigerator, and some auxiliary materials are not stored in the refrigerator, so according to the better technical scheme, the auxiliary material information associated with the menu is output together, a user can be helped to make dishes according to the menu correctly, the condition that the taste of the dishes and the standard of the menu have overlarge deviation is avoided, and the user can be reminded to confirm whether the auxiliary materials required by the menu are stored or not and whether the auxiliary materials are stored in the refrigerator or not is avoided.
In a preferred technical scheme of the invention, the refrigerator also comprises a wireless communication module, the wireless communication module is at least in communication connection with the voice recognition module, and the voice command vocabulary stored in the voice recognition module is downloaded and updated from an external server periodically or aperiodically.
The capacity of the extension pack is limited because the number of voice command vocabulary related to the food material that is initially entered may be limited. Therefore, according to the preferred technical scheme, the refrigerator can download the updated voice command vocabulary from the external server by using the wireless communication module through a mode of providing the extension packet at the external server, so that the types of the voice command vocabulary which can be recognized by the refrigerator are enriched, and for example, the types of food material names, sentence patterns, languages, dialects and the like can be matched.
In a preferred technical solution of the present invention, the food material calculating module calculates and outputs the second food material supplement instruction according to the output food material supplement instruction, the voice instruction sent from the voice recognition module received after the food material supplement instruction is output, and the current food material data information stored in the library management module.
According to the preferred technical scheme, after the food material supplement instruction is output, the user can give voice feedback to the output food material supplement instruction, for example, the food material supplement instruction can be modified or the food material supplement instruction can be denied. When the user modifies or rejects the food material supplement command, the food material calculation module can update and form a new food material supplement command as a second food material supplement command to be output according to the modification or negative feedback content of the user. Through the mode, the refrigerator can update and re-send out the new food material supplement instruction according to the feedback of the user on the food material supplement instruction, a good man-machine interaction mode is provided, more selection opportunities are given to the user, and the user experience is enhanced.
In a preferred technical scheme of the invention, the voice output module receives the second food material supplement instruction output by the food material calculation module, converts the second food material supplement instruction into voice data and outputs the voice data to the loudspeaker.
According to the preferred technical scheme, the second food material supplement instruction is output through the loudspeaker, so that a user can directly know new food material supplement suggestion information, namely the information such as the amount and the type of food materials to be supplemented in the refrigerator, through voice without opening a refrigerator door and checking a display screen, and the use convenience degree of the food material supplement function is improved.
In a preferred technical solution of the present invention, the food material calculation module calculates and outputs the second food material supplement instruction and/or the second recipe suggestion instruction according to the output food material supplement instruction and the recipe suggestion instruction, the voice instruction sent from the voice recognition module and received after the food material supplement instruction and the recipe suggestion instruction are output, and the current food material data information stored by the inventory management module.
According to the preferred technical scheme, after the food material supplement instruction and the recipe suggestion instruction are output, the user can give feedback to the output food material supplement instruction and the recipe suggestion instruction, for example, the food material supplement instruction and the recipe suggestion instruction can be modified or denied. When the user modifies or rejects the food material supplement instruction or the recipe suggestion instruction, the food material calculation module may calculate and output the second food material supplement instruction and/or the second recipe suggestion instruction according to modification or negative feedback of the user. Through the mode, the refrigerator can update and re-send the second food material supplement instruction and/or the second recipe suggestion instruction according to the feedback of the user on the food material supplement instruction and the recipe suggestion instruction, so that a substitute scheme for the food material supplement and the recipe suggestion is given, a good man-machine interaction mode is provided, more selection opportunities are given to the user, and the user experience is enhanced.
In a preferred technical scheme of the invention, the voice output module receives the second food material supplement instruction and/or the second menu suggestion instruction output by the food material calculation module, converts the second food material supplement instruction and/or the second menu suggestion instruction into voice data, and outputs the voice data to the loudspeaker. According to the preferred technical scheme, the second food material supplementing instruction and/or the second menu suggesting instruction can be played through the loudspeaker, so that a user can directly know the menu suitable for the current stock in the refrigerator, the amount and the type of the food materials to be supplemented and other information through voice under the condition that a refrigerator door is not opened and a display screen does not need to be checked, and the using convenience degree of the food material supplementing function is improved.
The invention also provides an intelligent refrigerator system which comprises any refrigerator provided by the invention and an intelligent terminal in communication connection with the voice processing circuit of the refrigerator.
According to the intelligent refrigerator system, the food material supplementing instruction generated by the food material calculating module can be sent to the intelligent terminal and displayed on the display screen of the intelligent terminal. Therefore, the food material supplement instruction can be output to the intelligent terminal and displayed besides the voice output food material supplement instruction, an output mode is added, so that the food material supplement instruction output to the intelligent terminal can be further shared with other servers and the like during data processing while human-computer interaction operation cannot be performed during voice output failure, or an order is generated according to the food material supplement instruction and a purchase instruction is sent to a network seller, and efficient and convenient food material supplement is further achieved.
Drawings
FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention;
fig. 2 is a schematic view of an external structure of a refrigerator according to an embodiment of the present invention;
fig. 3 is a structural diagram of a voice processing circuit of a refrigerator according to a first embodiment of the present invention;
FIG. 4 is a flow chart of a speech processing method provided by a first embodiment of the present invention;
FIG. 5 is a flow chart of a speech processing method according to a second embodiment of the present invention;
fig. 6 is a structural view of a voice processing circuit of a refrigerator according to a third embodiment of the present invention;
fig. 7 is a flowchart of a speech processing method according to a third embodiment of the present invention.
Reference numerals:
1-a user; 2-a refrigerator; 20-a refrigerator main body; 21-a microphone; 22-a loudspeaker; 23-a speech processing circuit; 231-a speech processing module; 232-a speech recognition module; 233-library-in management module; 234-food material calculation module; 235-a voice output module; 236-menu management module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
[ terms and explanations ]
The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
The term "a and/or B" denotes a union of the individual a, the individual B, A and the individual B, for example, "calculate and output the second food supplement instruction and/or the second recipe suggestion instruction" includes three cases of calculating and outputting only the second food supplement instruction, calculating and outputting only the second recipe suggestion instruction, calculating and outputting the second food supplement instruction and the second recipe suggestion instruction.
In some embodiments, the term "consumption period" is generated by overlapping preset storage days of the food material with the date of the voice command generated by the voice recognition module as the starting date, for example, for fresh food materials such as vegetables and meat products, the food material may be assumed to be fresh when being put into the date, so that the consumption period of the food material is obtained by overlapping the storage days corresponding to the pre-stored food materials. In other embodiments, the "consumption period" may be other time periods related to the storage days of the food material, for example, the expiration date of milk, tofu, or the like, which has been well documented in deep processing, and the "consumption period" may be the expiration date of food material outer package printing. In this case, the "consumption term" is input by the user through voice.
[ application scenarios ]
Fig. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.
Referring to fig. 1, an application scenario of the present invention involves communication and interaction between a user 1 and a refrigerator 2. In other embodiments of the present invention, some or all of the modules of the voice processing circuit 23 in the refrigerator 2 may also be disposed in a cloud server, and these embodiments should be regarded as simple changes of the technical solution of the present invention and are included in the protection scope of the present invention without departing from the spirit of the present invention.
Fig. 2 is a schematic external structural diagram of a refrigerator 2 according to an embodiment of the present invention, and as can be seen from fig. 2, a microphone 21 and a speaker 22 are disposed on a front side surface of a refrigerator main body 20, and the microphone 21 is used for picking up sound, especially picking up voice information uttered by a user, and sending the sound information to a voice processing circuit 23; the loudspeaker 22 is used for broadcasting, in particular for playing voice data returned by the voice processing circuit 23. The voice processing circuit 23 is disposed inside the refrigerator main body 20, is electrically connected to the microphone 21 and the speaker 22, processes the voice information picked up by the microphone 21, obtains voice data to be played by the speaker 22, and forms voice interaction with the user 1.
The refrigerator 2 according to the embodiment of the present invention does not need to have any other technical means capable of interacting with the user 1, other than the voice interaction. However, the present invention is not limited thereto, and in some other embodiments of the present invention, the refrigerator 2 may have other technical means capable of interacting with the user 1 besides voice interaction. For example, the refrigerator 2 may include a touch screen for receiving a touch input of the user 1. As another example, the refrigerator 2 may include a camera for acquiring images or videos of the user 1. As another example, the refrigerator 2 may include a biometric sensor for acquiring biometric information of the user 1, such as fingerprint or iris information. Further, the refrigerator 2 may be provided with technical means capable of communicating with the terminal and/or the cloud server, including, for example, a wired or wireless communication module, so as to be capable of transmitting and receiving information or data to and from the terminal and/or the cloud server based on various wired or wireless communication protocols.
The refrigerator 2 of the present invention may further include or be replaced with various intelligent appliances, such as food or beverage storage devices, for example, a food cabinet, a refrigerator, a wine cabinet, etc., according to practical application scenarios.
In the embodiment of the invention, an intelligent refrigerator system comprising the refrigerator 2 is further provided, and the intelligent refrigerator system further comprises an intelligent terminal in communication connection with the refrigerator 2, wherein the intelligent terminal is provided with a display screen and used for displaying instructions or data sent by the refrigerator 2.
[ first embodiment ]
Fig. 3 is a configuration diagram of the voice processing circuit 23 of the refrigerator 2 according to the first embodiment of the present invention.
Referring to fig. 3, in the present embodiment, the voice processing circuit 23 includes a voice processing module 231, a voice recognition module 232, a library management module 233, and a food material calculation module 234.
The voice processing module 231 is configured to generate voice data by encoding according to the voice information collected by the microphone 21. In this embodiment, the voice processing module 231 may be an analog-to-digital converter for converting the analog signal sampled by the microphone 21 into a digital signal for subsequent analysis and processing. The voice processing module 231 may be located outside the microphone 21 and communicatively connected to the microphone 21, or may be integrated into the microphone chip.
The voice recognition module 232 is configured to generate a voice instruction after matching the voice data generated by the voice processing module 231 with a pre-embedded voice command vocabulary. The speech recognition module 232 may use an existing speech recognition module 232, such as an HBR-series speech recognition module 232, and an input port of the speech recognition module 232 may be communicatively connected to the speech processing module 231 using a standard RS232 serial port to receive speech data from the speech processing module 231. The voice recognition module 232 stores a voice command vocabulary in advance, and generates a voice instruction by matching voice data with the voice command vocabulary.
For example, the voice recognition module 232 stores in advance voice command words such as "put in", "take out", "apple", "pear", "grape", "person", "jin", "kg", and "g". When a user 1 sends voice information of '3 apples are placed in the refrigerating chamber', the microphone 21 samples the voice information to obtain an analog signal, and the voice processing module 231 converts the code of the analog signal into digital voice data and sends the digital voice data to the voice recognition module 232; the voice recognition module 232 matches the voice data with the voice command vocabularies to obtain matching results that the matching degrees of the voice data with the five voice command vocabularies of "put in", "apple", "3", "individual", and "refrigerating chamber" in sequence according to the time sequence are all above a threshold value, generates voice instructions reflecting "refrigerating chamber apple + 3", and sends the voice instructions to the in-store management module 233.
The inventory management module 233 is configured to record and store the food material data information stored in or taken out from the refrigerator main body 20 according to the voice command sent from the voice recognition module 232. Specifically, the library management module 233 includes a memory (not shown) in which the current food material data information and the food material data information of the history of the storage or the extraction are stored.
The food material data information may be one or more of the kind, number, consumption term, storage location in the refrigerator main body 20 of the food material. The in-store management module 233 records and stores the type, quantity and storage location of food materials, so as to obtain more complete and reliable in-store management data; the consumption period is recorded and stored, the user 1 can be informed before the expiration of the food materials or about to expire, and the waste of the food materials is reduced; the storage position of the food material in the refrigerator main body 20 is recorded and stored, so that the user 1 can find the target food material more quickly, the heat loss caused by opening and closing the refrigerator door is reduced, and the energy consumption is reduced. The storage location in the refrigerator main body 20 may be, for example, a storage location of a refrigerating compartment, a freezing compartment, a garden stuff compartment, a temperature changing compartment, a fresh freezing compartment, or the like.
In addition, the consumption time limit of the food material is generally related to the temperature of the storage position of the food material, and the consumption time limit of the food material is different because the temperature and the humidity of different storage positions are different. By associating the consumption term with the storage location in the refrigerator main body 20, the consumption term of the food material can be more accurately managed to reduce waste of the food material. In other embodiments, the food material data information may also be any other suitable data information related to food materials, and the selection of the type of the food material data information does not limit the present invention, and is not described herein again.
In the food material data information, the current food material data information is a state quantity, which reflects the current storage state of each food material in the refrigerator main body 20, and is, for example, information that 10 apples (number of apples) (type of apples) are currently stored in the refrigerator main body 20. The stored or retrieved food material data information is a variation, which is a variation of the food material inventory in the refrigerator main body 20 reflected by the voice command sent by the voice recognition module 232, for example, a variation of the apple inventory amount increased by 3 reflected by the voice command "cold storage apple + 3".
The food material calculating module 234 can calculate and output a food material supplement instruction based on the voice instruction transmitted from the voice recognition module 232 and the current food material data information stored in the library management module 233. The food material calculating module 234 comprises a processor (not shown) for calculating a food material supplement instruction, and the specific calculation method may be to determine the food material supplement instruction by a difference value obtained by subtracting the current food material data information of each food material from the corresponding stock quantity threshold.
For example, when the user 1 asks the refrigerator 2 "what should be bought? When the food material calculation module 234 receives the voice command, it can responsively send a query request to the in-store management module 233 to query the current food material data information of each food material in the in-store management module 233. After the current food material data information of each food material is inquired, the current food material data information can be compared with the respective inventory threshold value. If the current food material data information of part of food materials is smaller than the corresponding stock threshold, classifying the food materials into the types of the food materials to be supplemented, and generating a food material supplementing instruction according to the stock threshold of the food materials. For example, if the query shows that the stock threshold of the apples is 10, and if the actual stock of the apples is 8 in the current food data information, the apples are classified into the food types to be supplemented, and the calculation is performed according to the difference between the stock threshold and the actual stock to obtain that the user is recommended to purchase more than 2 apples. Then, a food material supplement instruction including a "buy 2 apples" instruction is further output.
Fig. 4 is a flowchart of a speech processing method according to a first embodiment of the present invention. Referring to fig. 4, the speech processing method provided by the first embodiment includes:
a voice processing step, namely encoding the voice information collected by the microphone to generate voice data;
a voice recognition step, wherein a voice instruction is generated after matching with a pre-embedded voice command vocabulary according to the voice data generated in the voice processing step;
a storage management step, namely recording and storing the food material data information stored or taken out by the refrigerator main body according to the voice command generated in the voice recognition step;
and a food material calculation step, calculating and outputting a food material supplement instruction based on the voice instruction generated in the voice recognition step and the current food material data information stored in the in-store management step.
In this embodiment, the voice processing step is completed by the voice processing module 231, the voice recognition step is completed by the voice recognition module 232, the in-store management step is completed by the in-store management module 233, and the food material calculation step is completed by the food material calculation module 234. In other embodiments of the present invention, a part of the independent modules in the speech processing circuit 23 may also perform two or more steps of the speech processing method. In other embodiments, the voice processing circuit 23 may also include one or more processors (not shown), and a memory (not shown) communicatively connected to the processors, where processor-readable instructions are stored in the memory, and the processor performs all the steps of the voice processing method provided in the first embodiment by executing the processor-readable instructions. In addition, the processor and the memory may be disposed in a cloud server or other terminal devices communicatively connected to the refrigerator 2.
According to the refrigerator 2 and the voice processing method provided by the embodiment, since the speed of the voice recognition on the information processing is high and the efficiency is high, the user 1 can put in or take out the food material and send out the voice information collected by the microphone 21 at the same time, and can send out the voice information collected by the microphone 21 in a mode of reading documents or counting the food material after all the food material is put in or taken out, so that the intelligent management on the food material in the refrigerator 2 can be realized at low cost only by the common microphone 21, the common loudspeaker 22 and the voice processing circuit 23 without depending on other hardware equipment including a display screen, and the usable data entry, update or deletion mode of the refrigerator 2 is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food material names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the cost of data and software which need to be recorded can be effectively reduced.
Moreover, compared with the method of radio frequency tag identification, the method of voice identification does not need to increase the cost of consumables of the radio frequency tag, and the devices such as the speaker 22 and the microphone 21 are arranged on the outer side surface of the refrigerator main body 20 or near the outer side surface of the refrigerator main body 20 for picking up sound or broadcasting sound, so that the refrigerator main body 20 is not easily affected by the cold environment inside the refrigerator 2, and the cost and the design difficulty of the refrigerator main body 20 are lower than those of the radio frequency reading device.
Finally, the food material calculating module 234 can calculate and output a food material supplement instruction based on the current food material data information, and the user does not need to actively calculate information such as the type or the number of the food material supplement, thereby facilitating the food material supplement of the user. Moreover, the calculation and output of the food material supplement instruction can be triggered by voice information input from the outside, namely when the user 1 sends out voice information to inquire what food material needs to be supplemented or what purchasing suggestion is made, the food material supplement instruction is output to inform the user 1 without opening a refrigerator door or operating any equipment to know what food material needs to be supplemented, the convenience of using the refrigerator is improved while energy is saved, the human-computer interface is friendly, and the experience of the user 1 in using the refrigerator 2 is improved.
In this embodiment, the refrigerator 2 may also include a voice output module (not shown), which receives the food material supplement instruction output by the food material calculating module 234, converts the food material supplement instruction into voice data, and outputs the voice data to the speaker 22. Through above mode, the user need not to open the refrigerator door, also need not to touch refrigerator 2 or look over the display screen, can learn the information that 2 inside edible materials of refrigerator are waited to supply through pronunciation distantly, improves the degree of convenience in use who eats material supplement function. Of course, in some other embodiments, the refrigerator 2 may also include a printing device or a display device, and the food supplement instructions are displayed to the user 1 by being printed on paper or displayed on a screen.
[ second embodiment ]
Compared with the refrigerator 2 provided in the first embodiment, the voice processing circuit 23 of the refrigerator 2 provided in the present embodiment has substantially the same circuit connection structure as that shown in fig. 3. The difference is that the speech processing method executed by the library management module 233 and the food material calculation module 234 in this embodiment is different from the first embodiment, and fig. 5 is a flowchart of the speech processing method provided in this embodiment.
Referring to fig. 5, the library management step performed by the library management module 233 includes a step of generating user consumption attribute information according to an access time of the food material, and a step of storing the user consumption attribute information in the library management module 233. In addition, in the food material calculating step executed by the food material calculating module 234, a food material supplement instruction is calculated and output according to the user consumption attribute information.
The access time attribute of the food material includes information that the type, the number and the access time of the food material are related to each other, and the access time attribute may be a storage time attribute, a retrieval time attribute, or both the storage time attribute and the retrieval time attribute. The access time attribute of the food material can reflect the consumption habit of the user to a certain extent, so that the user consumption attribute information can be generated accordingly.
The user consumption attribute information may be tag information of part of food material types, or information such as storage cycle, taking-out cycle, access cycle, etc. of each food material type. For example, for the types of food materials that are frequently stored and taken out, such as milk, shallot, ginger, etc., they may be marked as "stock food materials", and the types of food materials marked as "stock food materials" are consumed quickly if the amount of food materials is too small due to their large consumption and high consumption speed, and therefore need to be replenished frequently and timely. According to the user consumption attribute information, the food material supplement instruction is calculated and output, the supplement strategy can be designed in a targeted manner according to the consumption habit of the user on food materials, the sufficient supply of the stock food materials is preferentially ensured, and the management efficiency of the food materials is improved.
In addition, in the embodiment, the food material calculating module 234 calculates and outputs a second food material supplement instruction according to the output food material supplement instruction, the voice instruction transmitted from the voice recognition module received after the output food material supplement instruction, and the current food material data information stored in the library management module.
After the speaker 22 outputs the food material supplement instruction, the user 1 may give voice feedback to the output food material supplement instruction, for example, modify the food material supplement instruction or deny the food material supplement instruction. When the user 1 modifies or rejects the food material supplement instruction, the food material calculating module 234 may update and form a new food material supplement instruction as a second food material supplement instruction to be output according to the modification or negative feedback content of the user 1. For example, after the speaker 22 outputs the food material supplement instruction of "buy 10 egg bars", if the user 1 determines that the current number of eggs has met the demand, the voice message of "no eggs needed" may be sent. After the voice information of the negative food material supplement instruction collected by the microphone 21, the food material calculating module 234 may update and form a new food material supplement instruction according to the negative feedback content of the user 1, such as proposing to buy the same kind of product ("that buys 5 duck egg bars") or a substitute with similar nutrients (protein ") (" that buys 500g chicken breast bars "). Then, the voice output module converts the second food material supplement instruction into voice data, and outputs the voice data to the speaker 22.
Through the mode, the refrigerator 2 can update and reissue a new food material supplement instruction according to the feedback of the user 1 on the food material supplement instruction, a good man-machine interaction mode is provided, more selection opportunities are given to the user 1, and the user experience is enhanced. The second food material supplement instruction is also output through the loudspeaker 22, so that the user 1 can directly know new food material supplement suggestion information, namely the information such as the amount and the type of the food materials to be supplemented in the refrigerator 2, through voice without opening a refrigerator door and looking up a display screen, and the use convenience degree of the food material supplement function is improved.
[ third embodiment ]
The present embodiment provides a refrigerator 2, and fig. 6 is a schematic diagram of a partial circuit configuration of the refrigerator 2 according to the present embodiment, which is associated with sound collection, broadcast, and voice processing. Referring to fig. 6, the voice processing circuit 23 provided in this embodiment includes a voice processing module 231, a voice recognition module 232, an inventory management module 233, a food material calculation module 234, a voice output module 235, and a menu management module 236. The functions and connection relationships of the voice processing module 231, the voice recognition module 232, the inventory management module 233, and the food material calculation module 234 may refer to the first embodiment, which is not described herein again.
Fig. 7 is a flowchart of the voice processing method according to the present embodiment, and as shown in fig. 6 and 7, in the present embodiment, recipe information at least including the types and the numbers of food materials is stored in the recipe management module 236 of the voice processing circuit 23, and the food material calculating module 234 calculates and outputs a food material supplementing instruction and a recipe suggesting instruction after associating and matching the current food material data information with the recipe information stored in the recipe management module 236 based on the current food material data information stored in the library management module 233.
For example, the recipe management module 236 stores recipe information of a plurality of recipes, for example, the fresh food material required for making two servings of "salted vaccinium uliginosum" includes: "streaky pork 200g, spring bamboo shoot 125g, bacon 200g, and shallot 10 g", when the recipe management module 236 recommends the recipe to the user 1, the types and the number (weight) of the food materials contained in the recipe are compared with the current food material data information. And if the current food material data information reflects that the needed food materials in all the recipes are sufficient, outputting a recipe suggestion instruction and suggesting the user to make dishes according to the recipe. And if the current food material data information reflects that part of food materials in the menu are lacked, calculating the types or the number of the lacked food materials and outputting a food material supplement instruction. For example, if the current food material data information reflects that the food materials currently in the warehouse include "streaky pork 500g, spring-less bamboo shoot, bacon 100g, and shallot 100 g", it is calculated and determined that spring bamboo shoot 125g and bacon 100g are currently absent, and thus the food material supplement command of "purchase spring bamboo shoot 125g or more and bacon 100g or more" is converted into voice data and reported to the user 1.
Because the recipe information of the recipe management module 236 can be associated and matched with the current food material data information stored in the library management module 233, when the recipe is inquired by external voice information, the recipe can be recommended based on the current food material data information, and when part of the food materials related to the recommended recipe is absent, a food material supplement instruction can be simultaneously output, so that a user can determine whether to determine supplement of the food materials according to the recommended recipe according to needs, so that the inventory, supplement and recipe recommendation of the food materials can be managed in a mutual combination manner, and the automation degree and accuracy of the food material library management can be effectively improved.
With continuing reference to fig. 7, the food material calculating step executed by the food material calculating module 234 in the present embodiment further includes the following substeps: and calculating and outputting a second food material supplementing instruction and/or a second recipe suggesting instruction according to the output food material supplementing instruction and the recipe suggesting instruction, the voice instruction sent from the voice recognition module 232 and received after the food material supplementing instruction and the recipe suggesting instruction are output, and the current food material data information stored in the library management module 233.
Through the above manner, after the food material supplement instruction and the recipe suggestion instruction are output, the user 1 may give feedback to the output food material supplement instruction and the recipe suggestion instruction, for example, may modify or deny the food material supplement instruction and the recipe suggestion instruction. When the user 1 modifies or rejects the food material supplement instruction or the recipe recommendation instruction, the food material calculation module 234 may calculate and output a second food material supplement instruction and/or a second recipe recommendation instruction according to the modification or rejection feedback of the user 1.
For example, after the speaker outputs the instruction of "purchase of above 125g spring bamboo shoot and above 100g bacon", the user 1 gives feedback of "change to winter bamboo shoot bar", and after receiving the feedback of the user 1, the food material calculation module may give up purchase of spring bamboo shoot after calculation according to the feedback of "change to winter bamboo shoot bar" in combination with the current food material data information of "200 g winter bamboo shoot" stored in the library management module 233, and output a second food material supplement instruction of "purchase of above 100g bacon", and a second recipe suggestion instruction of "200 g streaky pork, 125g winter bamboo shoot, 200g bacon, 10 g shallot".
Through the mode, the refrigerator 2 can update and resend the second food material supplement instruction and/or the second menu suggestion instruction according to the feedback of the user 1 on the food material supplement instruction and the menu suggestion instruction, so that a substitute scheme for food material supplement and menu suggestion is provided, a good man-machine interaction mode is provided, more selection opportunities are provided for the user 1, and the user experience is enhanced.
In this embodiment, the voice processing circuit 23 further includes a voice output module 235, and the voice output module 235 is in communication connection with the inventory management module 233 and the food material calculating module 234, and is configured to receive the food material supplement instruction, the recipe suggestion instruction, the second food material supplement instruction and/or the second recipe suggestion instruction output by the food material calculating module 234, convert the received food material supplement instruction, the recipe suggestion instruction, the second food material supplement instruction and/or the second recipe suggestion instruction into voice data, and output the voice data to the speaker 22. The food material supplementing instruction, the recipe recommending instruction, the second food material supplementing instruction and the second recipe recommending instruction are all output through the loudspeaker 22, the user 1 can directly interact with the refrigerator 2 through voice without opening a refrigerator door and checking a display screen, food material supplementing and recipe recommending information which is constantly refreshed is known, and the using convenience degree of the food material supplementing function and the recipe recommending function is improved.
In addition, the recipe information stored in the recipe management module 236 further includes auxiliary material information of auxiliary materials required for making the recipe, and the food material calculation module 234 outputs the auxiliary material information associated with the recipe suggestion instruction together according to the recipe suggestion instruction. Because the quantity, the type and other auxiliary material information of the auxiliary materials required by the menu can be changed according to the food material data information such as the quantity, the type and the like of the food materials, and some auxiliary materials required by the menu are stored in the refrigerator and some auxiliary materials are not stored in the refrigerator 2, the auxiliary material information associated with the menu is output together, the user 1 can be helped to make dishes according to the menu correctly, the phenomenon that the taste of the dishes and the standard of the menu are greatly deviated is avoided, and the user 1 can be reminded to confirm whether the auxiliary materials required by the menu are stored or not and whether the auxiliary materials are stored in the refrigerator 2 or not.
In the above embodiment of the present invention, the refrigerator 2 may further include a wireless communication module (not shown) which is at least in communication connection with the voice recognition module 232 and downloads and updates the voice command vocabulary stored in the voice recognition module 232 from an external server periodically or aperiodically. The capacity of the extension pack is limited because the number of voice command vocabulary related to the food material that is initially entered may be limited. Therefore, according to the preferred embodiment, the refrigerator 2 can download the updated voice command vocabulary from the external server by using the wireless communication module in a manner of providing the extension packet from the external server, so as to enrich the types of the voice command vocabulary that can be recognized, for example, to match with a wider variety of food names, sentences, languages, dialects, and the like. In addition, the wireless communication module may also download and update the recipe information stored in the recipe management module 236 from an external server periodically or non-periodically.
In the above embodiment of the present invention, the food material supplement instruction generated by the food material calculating module 234 may be sent to an intelligent terminal in the intelligent refrigerator system and displayed on a display screen of the intelligent terminal. According to the embodiment, the output mode of the intelligent refrigerator system is increased, so that the food material supplement instruction output to the intelligent terminal is avoided when the human-computer interaction operation cannot be carried out during voice output failure, the food material supplement instruction can be further shared by data processing, such as other servers, or an order is generated according to the food material supplement instruction, a purchase instruction is sent to a network seller, and efficient and convenient food material supplement is further realized.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (14)
1. A refrigerator, characterized by comprising:
a refrigerator main body;
a microphone and a speaker provided in the refrigerator main body;
a voice processing circuit arranged in the refrigerator main body and electrically connected with the microphone and the loudspeaker, wherein the voice processing circuit comprises,
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
the voice recognition module is used for generating a voice instruction after matching with a pre-embedded voice command vocabulary according to the voice data generated by the voice processing module;
the in-store management module is used for recording and storing food material data information of food materials stored in or taken out of the refrigerator main body according to the voice command sent from the voice recognition module;
and the food material calculating module calculates and outputs a food material supplementing instruction based on the voice instruction sent from the voice recognition module and the current food material data information stored by the in-store management module.
2. The refrigerator of claim 1, further comprising
And the voice output module receives the food material supplement instruction output by the food material calculation module, converts the food material supplement instruction into voice data and outputs the voice data to the loudspeaker.
3. The refrigerator of claim 1 or 2, wherein the food material data information includes at least one or more of a kind, a quantity, a consumption term, and a storage location in the refrigerator main body.
4. The refrigerator of claim 3, wherein the in-store management module stores user consumption attribute information generated according to an access time attribute of food material,
and the food material calculating module is also used for calculating and outputting a food material supplementing instruction according to the user consumption attribute information.
5. The refrigerator according to claim 1 or 2, further comprising a recipe management module storing recipe information including at least a kind and a number of the food materials,
and the food material calculating module is used for calculating and outputting a food material supplementing instruction and a recipe suggesting instruction after the current food material data information is associated and matched with the recipe information stored by the recipe management module based on the current food material data information stored by the in-store management module.
6. The refrigerator of claim 5, wherein the recipe information stored in the recipe management module further includes supplementary material information of supplementary materials required for making the recipe,
and the food material calculation module outputs auxiliary material information associated with the menu suggestion instruction together according to the menu suggestion instruction.
7. The refrigerator according to claim 6,
and the voice output module receives the food material supplement instruction and the menu suggestion instruction output by the food material calculation module, converts the food material supplement instruction and the menu suggestion instruction into voice data and outputs the voice data to the loudspeaker.
8. The refrigerator according to claim 1 or 2, further comprising
And the wireless communication module is at least in communication connection with the voice recognition module and downloads and updates the voice command vocabulary stored in the voice recognition module from an external server periodically or aperiodically.
9. The refrigerator of claim 5, further comprising
And the wireless communication module is at least in communication connection with the menu management module and downloads and updates menu information stored in the menu management module from an external server periodically or aperiodically.
10. The refrigerator according to claim 2,
the food material calculation module calculates and outputs a second food material supplement instruction according to the output food material supplement instruction, the voice instruction which is received after the food material supplement instruction is output and sent from the voice recognition module, and the current food material data information stored by the in-store management module.
11. The refrigerator according to claim 10,
and the voice output module receives the second food material supplement instruction output by the food material calculation module, converts the second food material supplement instruction into voice data and outputs the voice data to the loudspeaker.
12. The refrigerator according to claim 7,
the food material calculation module calculates and outputs a second food material supplement instruction and/or a second recipe suggestion instruction according to the output food material supplement instruction and the recipe suggestion instruction, the voice instruction sent from the voice recognition module and received after the food material supplement instruction and the recipe suggestion instruction are output, and the current food material data information stored by the in-store management module.
13. The refrigerator according to claim 12,
and the voice output module receives the second food material supplement instruction and/or the second menu suggestion instruction output by the food material calculation module, converts the second food material supplement instruction and/or the second menu suggestion instruction into voice data and outputs the voice data to the loudspeaker.
14. An intelligent refrigerator system comprises a refrigerator body, a refrigerator door, a door,
the refrigerator of any one of claims 1-13;
the intelligent terminal is in communication connection with the refrigerator and is characterized in that,
and the food material supplementing instruction generated by the food material calculating module is sent to the intelligent terminal and displayed on a display screen of the intelligent terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110262125.1A CN115077160A (en) | 2021-03-10 | 2021-03-10 | Refrigerator, intelligent refrigerator system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110262125.1A CN115077160A (en) | 2021-03-10 | 2021-03-10 | Refrigerator, intelligent refrigerator system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115077160A true CN115077160A (en) | 2022-09-20 |
Family
ID=83240462
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110262125.1A Pending CN115077160A (en) | 2021-03-10 | 2021-03-10 | Refrigerator, intelligent refrigerator system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115077160A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105509394A (en) * | 2015-05-05 | 2016-04-20 | 万军 | Refrigerator |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN110168298A (en) * | 2017-01-03 | 2019-08-23 | 三星电子株式会社 | Refrigerator and its information display method |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
-
2021
- 2021-03-10 CN CN202110262125.1A patent/CN115077160A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN105509394A (en) * | 2015-05-05 | 2016-04-20 | 万军 | Refrigerator |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| CN110168298A (en) * | 2017-01-03 | 2019-08-23 | 三星电子株式会社 | Refrigerator and its information display method |
| US20190348044A1 (en) * | 2017-01-03 | 2019-11-14 | Samsung Electronics Co., Ltd. | Refrigerator and information display method thereof |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10239094B2 (en) | Systems and methods for scanning information from storage area contents | |
| US8032430B2 (en) | Method and apparatus for mapping content descriptions to reusable containers | |
| CN1636215B (en) | Machine readable label system with offline capture and processing | |
| CN109631486A (en) | A kind of food monitoring method, refrigerator and the device with store function | |
| US8226414B2 (en) | Generating policy driven meal plans | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| CN103884152B (en) | Refrigerator and the system of health index are provided | |
| CN110168298A (en) | Refrigerator and its information display method | |
| EP3232379A1 (en) | Smart refrigerator | |
| CN107403248A (en) | Article control method, device, intelligent storage equipment and operating system | |
| CN108224896A (en) | Refrigerator management equipment, system, refrigerator and mobile terminal | |
| US20100106521A1 (en) | Consumables inventory management method | |
| CN107525341A (en) | The food storage voice record and based reminding method that a kind of suitable refrigerator uses | |
| US20100106624A1 (en) | Method of inventory management | |
| CN105205323A (en) | User sign data-based healthy diet guide system and method | |
| CN101140130A (en) | Refrigerator and control method thereof with food product information management device | |
| CN107796172A (en) | Food expiration early warning method and device, storage medium and food storage equipment | |
| JP2006317109A (en) | Refrigerator | |
| WO2018045839A1 (en) | Shopping trigger method and device for intelligent refrigerator, and computer-readable storage medium | |
| CN115077160A (en) | Refrigerator, intelligent refrigerator system | |
| CN115077157B (en) | Refrigerator and intelligent refrigerator system | |
| JP2004348445A (en) | Foodstuff management system | |
| CN115077159A (en) | Refrigerator and intelligent refrigerator system | |
| CN115077158A (en) | Refrigerator, intelligent refrigerator system | |
| CN115077155A (en) | Refrigerator and intelligent refrigerator system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240620 Address after: 214028 No.1, Xixin 1st Road, Wuxi City, Jiangsu Province Applicant after: Panasonic Home Appliances Refrigerator(Wuxi) Co.,Ltd. Country or region after: China Address before: 215123 No. 300, Zhongnan street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Applicant before: PANASONIC R&D CENTER SUZHOU Co.,Ltd. Country or region before: China |