CN106679321A - Intelligent refrigerator food management method and intelligent refrigerator - Google Patents
Intelligent refrigerator food management method and intelligent refrigerator Download PDFInfo
- Publication number
- CN106679321A CN106679321A CN201611176845.1A CN201611176845A CN106679321A CN 106679321 A CN106679321 A CN 106679321A CN 201611176845 A CN201611176845 A CN 201611176845A CN 106679321 A CN106679321 A CN 106679321A
- Authority
- CN
- China
- Prior art keywords
- intelligent refrigerator
- food
- refrigerator
- type
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2500/00—Problems to be solved
- F25D2500/06—Stock management
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention discloses an intelligent refrigerator food management method and an intelligent refrigerator. The intelligent refrigerator food management method includes the steps of photographing images of the storing and taking operation conducted by a user through a camera arranged in the intelligent refrigerator when an intelligent refrigerator door is opened; identifying the images, and when the identification fails, prompting the user to input the type of the storing and taking operation and the name of a corresponding food through voice; and monitoring voice information input by a microphone arranged on the refrigerator and updating a preset food list according to the voice information. According to the intelligent refrigerator food management method and the intelligent refrigerator, the camera is used for collecting the images of the food storing operation conducted by the user, the image identification is combined with the voice input so as to obtain food information related to the storing operation, the food list is updated according to the food information, the operation of manually inputting the food information by the user is avoided, and convenience is brought to the use for the user.
Description
Technical field
The present invention relates to intelligent appliance technical field, more particularly to a kind of intelligent refrigerator food management method and intelligent ice
Case.
Background technology
With the intelligentized development of household electrical appliances, refrigerator also begins to intellectuality, when increasingly busy people often remove supermarket shopping
Can not remember what food family refrigerator has, thus result in repeat buying or food is bought in leakage.Thus, occur in that in the market
Refrigerator with food materials typing and expired prompting function.But existing intelligent refrigerator typically uses hand in terms of food is managed
The modes such as dynamic or bar code are manually entered food information.These modes are required for the manually operated typing information of user, according to typing
Information generates food list, cumbersome.Especially, it is to be required for manual modification food that user is put into or takes out food every time
List, so not only changes the use habit of user, and be also inconvenient in actually used terminal.
Thus prior art could be improved and improve.
The content of the invention
The technical problem to be solved in the present invention is, in view of the shortcomings of the prior art, there is provided a kind of intelligent refrigerator food channel
Reason method and intelligent refrigerator, are brought with cumbersome and to user the use that the control method for solving current refrigerator food is present
The problem of inconvenience.
In order to solve the above-mentioned technical problem, the technical solution adopted in the present invention is as follows：
A kind of intelligent refrigerator food management method, it includes：
When intelligent refrigerator opens the door, the image that user performs accessing operation is shot by the camera in intelligent refrigerator；
The type and corresponding food title to obtain the accessing operation are identified to described image；
When recognition failures, user is pointed out by the type of accessing operation described in phonetic entry and corresponding food title, its
In, the type of the accessing operation includes depositing operation and extract operation；
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates default food row according to the voice messaging
Table.
The intelligent refrigerator food management method, wherein, it is described when recognition failures, point out user to pass through phonetic entry institute
The type and corresponding food title of accessing operation are stated, wherein, the type of the accessing operation includes depositing operation and extract operation
Including：
When recognition failures, the intelligent refrigerator sends to remote server described image；
The remote server is identified type and corresponding the food name to obtain the accessing operation to described image
Claim；
When the remote server recognition failures, by the feedback of the information of the recognition failures to the intelligent refrigerator；
The intelligent refrigerator prompting user passes through the type of accessing operation described in phonetic entry and corresponding food title, its
In, the type of the accessing operation includes depositing operation and extract operation.
The intelligent refrigerator food management method, it also includes：
When recognizing successfully, the type and food title of the accessing operation obtained according to identification update default food row
Table.
The intelligent refrigerator food management method, wherein, it is described when intelligent refrigerator opens the door, by intelligent refrigerator
Camera shoot user perform accessing operation image specifically include：
When intelligent refrigerator opens the door, the type of the storeroom that intelligent refrigerator is opened is obtained, wherein, the type of the storeroom includes
Refrigerating chamber and refrigerating chamber；
When intelligent refrigerator opens refrigerating chamber, intelligent refrigerator is shot by camera in intelligent refrigerator and is opened the door to closing the door
User performs the image of accessing operation in journey.
The intelligent refrigerator food management method, wherein, it is described when intelligent refrigerator opens the door, by intelligent refrigerator
Camera shoot user perform accessing operation image also include：
When intelligent refrigerator opens refrigerating chamber, user is pointed out by the type of accessing operation described in phonetic entry and corresponding food
Name claims；And
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates the default food according to the voice messaging
Thing list, end operation.
The intelligent refrigerator food management method, wherein, the monitoring is arranged at the microphone input on refrigerator
Voice messaging, and also include after updating default food list according to the voice messaging：
The intelligent refrigerator is connected by network with external equipment, and receives the food information of external equipment push；And by ice
Case internal device state information and food demand feedback of the information to external equipment, wherein, the external equipment include operator clothes
Business device and user terminal.
A kind of intelligent refrigerator, it includes：
Camera, for when intelligent refrigerator opens the door, shooting the image that user performs accessing operation；
Microphone, the voice messaging for receiving user input；
Control device, for being identified to described image, and when recognition failures, points out user by being deposited described in phonetic entry
The type of extract operation and corresponding food title, wherein, the type of the accessing operation includes depositing operation and extract operation；And
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates default food row according to the voice messaging
Table.
The intelligent refrigerator, wherein, the update module is additionally operable to：
When recognizing successfully, the type and corresponding food title of the accessing operation obtained according to identification update default
Food list.
The intelligent refrigerator, wherein, the control device also includes：
Acquisition module, for when intelligent refrigerator opens the door, obtaining the type of the storeroom that intelligent refrigerator is opened, wherein, the storage
The type for hiding room includes refrigerating chamber and refrigerating chamber；
First control module, for when intelligent refrigerator opens refrigerating chamber, camera of the control in intelligent refrigerator to shoot intelligence
User performs the image of accessing operation in energy refrigerator open to door closing procedure.
The intelligent refrigerator, wherein, the control device also includes：
Reminding module, for when intelligent refrigerator opens refrigerating chamber, pointing out user the class by accessing operation described in phonetic entry
Type and corresponding food title；
The update module is additionally operable to：
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates the default food according to the voice messaging
Thing list, end operation.
Beneficial effect：Compared with prior art, the invention provides a kind of intelligent refrigerator food management method and intelligent ice
Case, methods described includes：Opened the door into door closing procedure in intelligent refrigerator, shoot described by the camera in intelligent refrigerator
During user perform accessing operation image；Described image is identified, and when recognition failures, points out user to pass through language
Sound is input into the type and corresponding food title of the accessing operation；Monitoring is arranged at the voice of the microphone input on refrigerator
Information, and default food list is updated according to the voice messaging.The present invention is entered by the way that camera is gathered into user to food
The image of capable deposit operation process, and image recognition is combined with phonetic entry, to obtain what the deposit operation was related to
Food information, be updated according to the food information to food list, it is to avoid user is manually entered the operation of food information,
Use to user brings convenience.
Brief description of the drawings
The flow chart of the intelligent refrigerator food management method preferably implementation that Fig. 1 is provided for the present invention.
The structural representation of the intelligent refrigerator that Fig. 2 is provided for the present invention.
The structure principle chart of the control device of the intelligent refrigerator that Fig. 3 is provided for the present invention.
Specific embodiment
The present invention provides a kind of intelligent refrigerator food management method and intelligent refrigerator, to make the purpose of the present invention, technical side
Case and effect are clearer, clear and definite, and the present invention is described in more detail for the embodiment that develops simultaneously referring to the drawings.It should be appreciated that
Specific embodiment described herein is only used to explain the present invention, is not intended to limit the present invention.
In the present invention, using the suffix of such as " module ", " part " or " unit " for representing element only for favourable
In explanation of the invention, itself do not have specific meaning.Therefore, module ", " part " or " unit " can mixedly make
With.
Additionally, in the specification and in the claims, term " first ", " second " etc. are used to be carried out between analogous element
Distinguish, and if the order of time sequencing, spatial order, hierarchal order or any other mode may not be described, be should be appreciated that
These terms for using are interchangeable under appropriate environment, and embodiments of the invention described herein can be being described herein
Or other beyond showing sequentially are operated.
It should be noted that use in detail in the claims term " including " should not be construed as limited to hand listed below
Section, it is not precluded from other elements or step.Thus, it should be interpreted specify such as relating to the feature, numeral, step
Or the presence of part, but it is not excluded that the presence of one or more other features, numeral, step or parts or its combination
Or addition.Therefore, the scope of word " including equipment of device A and B " should not be limited to the device being only made up of component A and B.
This means for the present invention, the associated component of equipment is A and B.
The reference of " one embodiment " or " embodiment " is meaned in the whole text in this specification to be described with reference to the embodiment
Special characteristic, structure or characteristic include at least one embodiment of the present invention.Thus, everywhere occurring in specification
Phrase " in one embodiment " or " in embodiment " are not necessarily all referring to same embodiment, but may be so.Additionally, root
Disclosed it will be readily apparent to one skilled in the art that in one or more embodiments according to the present invention, special characteristic, knot
Structure or characteristic can be combined in any suitable manner.
Below in conjunction with the accompanying drawings, by the description to embodiment, the content of the invention is described further.
Refer to the stream of the preferred embodiment of the intelligent refrigerator food management method that Fig. 1 and Fig. 2, Fig. 1 are provided for the present invention
Cheng Tu.Methods described includes：
S100, when intelligent refrigerator opens the door, the figure that user performs accessing operation is shot by camera in intelligent refrigerator
Picture.
Specifically, the intelligent refrigerator opens the door to door closing procedure and refers to being opened to intelligent refrigerator door from intelligent refrigerator door
The process that pent operation, i.e. user are operated to the intelligent refrigerator.As shown in Fig. 2 the intelligent refrigerator at least sets
A camera 1 is put, the camera 1 opens the door to door closing procedure terminal user execution accessing operation for shooting intelligent refrigerator
Image.That is, the camera starts when refrigerator doors 6 are opened, closed when intelligent refrigerator door 6 is closed.
Exemplary, it is described to be opened the door into door closing procedure in intelligent refrigerator, clapped by the camera in intelligent refrigerator
The image of user's execution accessing operation can specifically include during described in taking the photograph：
S10, when listening to intelligent refrigerator and opening the door, control is arranged at camera in intelligent refrigerator and starts；
S20, the camera shoot the image in its coverage, and the control information that real-time detection intelligent refrigerator is closed the door；
S30, when the control information that intelligent refrigerator is closed the door is detected, the camera is closed and opened the door with obtaining the intelligent refrigerator
The image of accessing operation is performed to door closing procedure user.
Specifically, the switch of the refrigerator doors 6 of the intelligent refrigerator can be provided with refrigerator doors on the intelligent refrigerator
Limit switch 5, the ON/OFF of refrigerator doors is detected by the limit switch 5, and the ON/OFF signal for detecting is sent to shooting
First 1, to cause that the camera 1 controls the on/off of its own according to the ON/OFF signal.In the present embodiment, it is described
Camera 1 is 1, is installed on the middle above refrigerating chamber.Accordingly, the refrigerator doors 6 refer to intelligent refrigerator refrigerating chamber
Door, and the both sides of the camera 1 can also be respectively arranged with two row's LED light sources, and light filling is carried out to the camera 1,
To ensure that the camera shoots the definition of photo.The limit switch 5 also can be to be arranged at refrigeration top.Certainly, by
It is certain in a monitoring range for camera, in order to the food materials in conduct monitoring at all levels refrigerator, multiple can be installed in refrigerator
Camera.The camera can be installed on top or the side wall of the refrigerating chamber for needing monitoring, can be monitored with camera
The picture of looking down in target monitoring space is advisable.
In the variant embodiment of embodiment, the startup camera can be with other modes control, for example, when control is filled
Put when having detected human body near refrigerator, start the camera.Specifically, human inductor is installed on outcase of refrigerator, when
When the human inductor has sensed human body near refrigerator, an indication signal is sent to control device, control device is being received
Start camera after to the indication signal.
In another embodiment of the present invention, because the camera 1 is arranged in refrigerating chamber, so that described in intelligence
In refrigerator open to door closing procedure, by camera in intelligent refrigerator shoot it is described during user perform accessing operation
Image can also specifically include：
S101, when intelligent refrigerator opens the door, obtain intelligent refrigerator open storeroom type, wherein, the class of the storeroom
Type includes refrigerating chamber and refrigerating chamber；
S102, when intelligent refrigerator opens refrigerating chamber, by camera in intelligent refrigerator shoot intelligent refrigerator open the door to
User performs the image of accessing operation in door closing procedure；
S103, when intelligent refrigerator opens refrigerating chamber, point out user by the type and phase of accessing operation described in phonetic entry
The food title answered；
S104, monitoring are arranged at the voice messaging of the microphone input on refrigerator, and update described pre- according to the voice messaging
If food list, end operation.
Specifically, the type for obtaining the storeroom that intelligent refrigerator is opened can be by judging the ice that intelligent refrigerator is opened
Chamber door determines.In actual applications, the intelligent refrigerator can be respectively provided with spacing in the position that intelligent refrigerator body phase is contacted
Switch, the control signal produced according to limit switch determines the type of refrigerator doors opened, and the type of the refrigerator doors includes
Refrigerating-chamber door and refrigerating chamber door, and then it is refrigerating chamber or refrigerating chamber to obtain the type of the storeroom that intelligent refrigerator is opened.When for cold
When hiding room, control camera starts and obtains image, when for refrigerating chamber, is then directly stored in described in the input of prompting user speech
Type and corresponding food title.So the food in intelligent refrigerator refrigerating chamber and refrigerating chamber can be controlled simultaneously,
Improve to the comprehensive of food control.Meanwhile, the camera is only in refrigerating chamber area during the door of cold compartment of refrigerator is opened
The action for putting, taking out food in domain into user is taken pictures, and can so reduce the quantity and reduction treatment for shooting picture
The operational data amount of device image recognition analysis, reduces to the high requirements of processor performance, so as to reduce intelligent refrigerator into
This.
Loudspeaker 4 can be set on the intelligent refrigerator, and the prompt tone of the prompting user speech input can be by institute
Loudspeaker 4 is stated to play.Also, microphone is additionally provided with the intelligent refrigerator, the microphone is omnidirectional microphone, it is possible to
It is arranged in the shop front of intelligent refrigerator, facilitates user by the microphone input voice messaging.
The intelligent refrigerator can also include memory, such as embedded multi-media card (English full name：embedded
Multi Media Card, English abbreviation：EMMC), safe digital card (English full name：Secure Digital Memory
Card, English abbreviation：The memory device such as SD).Camera newly shoots the photo for obtaining and can store local, by refrigerator controller
User's access procedure that photo according to being locally stored is recorded sets food materials shelf-life label.Certainly, the memory may be used also
Including presetting the food list for setting, comparison reference is played a part of during for being subsequently identified according to image.
S200, the type and corresponding food title for being identified to described image to obtain the accessing operation.
It is specifically, described that described image is identified to be identified described image by image recognition software,
If recognizing successfully, first determine whether out that user is stored in or takes out food, i.e., the type of described accessing operation, then judge to be deposited
Enter or take out the type of food, i.e., the title of described food.The type for judging to be stored in or take out food will can be obtained
Recognition result compared one by one with the data in default food image database respectively, and filter out similarity and be more than
90% recognition result as represented food title.If recognition failures, the food image of recognition failures is sent to
Remote server is assisted in identifying；Assisting in identifying can include that image recognition software further know by identification and/or human assistance
Not；Manual service provisioned in remote server, can be that professional is assisted in identifying, or user is carried out manually
The result for assisting in identifying is fed back to intelligent refrigerator by identification, the remote server.The intelligent refrigerator is to the auxiliary
Recognition result is analyzed, if it is the type for successfully obtaining the accessing operation that the recognition result is carried to assist in identifying result
And food title；If it is identification to assist in identifying result, it is determined that the result of image recognition is failure.
It is exemplary, the type being identified to described image to obtain the accessing operation and corresponding food
Title can specifically include：
S201, the intelligent refrigerator are identified to described image, and to obtain the type of the accessing operation and corresponding
Food title；
S202, when recognition failures, when the remote server recognition failures, by the feedback of the information of the recognition failures to institute
State intelligent refrigerator；
S203, intelligent refrigerator prompting user are by the type of accessing operation described in phonetic entry and corresponding food name
Claim, wherein, the type of the accessing operation includes depositing operation and extract operation.
Specifically, the recognition result of the remote server feedback carries the information that identification state and identification are obtained.
That is, processed when remote server is recognized successfully, in the recognition result of its feedback and carried outside the successful information of identification, also take
Type and food title with the corresponding accessing operation of described image.
S300, when recognition failures, point out user by the type of accessing operation described in phonetic entry and corresponding food
Name claims, wherein, the type of the accessing operation includes depositing operation and extract operation.
Specifically, the recognition result is unsuccessfully to illustrate that the image gathered according to camera cannot determine the accessing operation
Type and corresponding food title.At this moment in order to accurately manage the food of refrigerator, then by being arranged at raising on refrigerator
The playing alert tones of sound device 4 pass through the class of the type of accessing operation described in phonetic entry and corresponding food title to point out user
Type.The prompt tone can repeating playing with fixed time intervals, untill user input voice messaging.In practical application
In, the prompt tone can also accessing operation described in direct access inquiry user to be stored in operation or taking out operation, and further inquire
It is stored in/takes out the title of food.Can so cause that user is fast and accurately input into the voice messaging of needs.
S400, monitoring are arranged at the voice messaging of the microphone input on refrigerator, and update pre- according to the voice messaging
If food list.
Specifically, when the voice for receiving microphone input is believed, the voice messaging is identified, and will be described
The content of identification is associated record with described image.So after being closed in intelligent refrigerator door, can according to voice messaging and
Image related information, the information for being stored in operation corresponding to described image carries out classification record, to update default food list.
Further, the information of food in refrigerator is quickly understood for the ease of user, the food list can also be shown
In on the display interface of refrigerator, and renewal is synchronized to the food list that display interface shows according to operation is stored in, so
Can ensure that user obtains newest food list information in real time, more accurately food is controlled.
In the present embodiment, the control system that the intelligent refrigerator can be carried by it is carried out to the image that camera is gathered
Identification and reception phonetic entry, and default food list is updated according to image recognition result/speech input information.In this implementation
In the variant embodiment of example, the intelligent refrigerator can be set with smart machine, such as PAD devices.The PAD terminals are configured at
In the shop front of intelligent refrigerator, the PAD is connected with the USB camera, and the camera sends to described the image of shooting
PAD terminals, the PAD terminals, and by refrigerator food presentation of information in PAD terminals so that user shows boundary by PAD terminals
The APP clients of face or the mobile phone being connected with the PAD terminals can obtain all relevant informations.At the same time it can also pass through
PAD terminals connection network can obtain the information pushing of retailer or operator, enter food order, warranty failure etc. on line.
Present invention also offers a kind of intelligent refrigerator, as shown in Fig. 2 the intelligent refrigerator includes：
Camera 1, for when intelligent refrigerator opens the door, shooting the image that user performs accessing operation；
Microphone 2, the voice messaging for receiving user input；
Control device 3, for being identified to described image, and when recognition failures, points out user by described in phonetic entry
The type of accessing operation and corresponding food title, wherein, the type of the accessing operation includes depositing operation and extract operation；With
And
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates default food row according to the voice messaging
Table.
The intelligent refrigerator, wherein, as shown in figure 3, the control device 3 includes：
Identification module 301, for being identified to described image；
First performing module 302, for when recognition failures, described image being sent into described long-range to cause to remote server
Server is identified to described image；
Update module 303, for when remote server feedback identifying fails, monitoring to be arranged at the microphone input on refrigerator
Voice messaging, and default food list is updated according to the voice messaging.
The intelligent refrigerator, wherein, the update module is additionally operable to：
For when recognizing successfully, the type and food title of the accessing operation obtained according to identification to update default food
Thing list.
The intelligent refrigerator food management system, wherein, control device also includes：
Acquisition module, for when intelligent refrigerator opens the door, obtaining the type of the storeroom that intelligent refrigerator is opened, wherein, the storage
The type for hiding room includes refrigerating chamber and refrigerating chamber；
First control module, for when intelligent refrigerator opens refrigerating chamber, camera of the control in intelligent refrigerator to shoot intelligence
User performs the image of accessing operation in energy refrigerator open to door closing procedure.
The intelligent ice, wherein, the control device also includes：
Reminding module, for when intelligent refrigerator opens refrigerating chamber, pointing out user the class by accessing operation described in phonetic entry
Type and corresponding food title；
The update module is additionally operable to：
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates the default food according to the voice messaging
Thing list, end operation.
The modules of above-mentioned intelligent refrigerator have been described in detail in the above-mentioned methods, just no longer state one by one herein.
In embodiment provided by the present invention, it should be understood that disclosed system and method, can be by other
Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the module, is only
A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces
Connect, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit can both be realized in the form of hardware, it would however also be possible to employ hardware adds the form of SFU software functional unit to realize.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can store and be deposited in an embodied on computer readable
In storage media.Above-mentioned SFU software functional unit storage is in a storage medium, including some instructions are used to so that a computer
Equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention each
The part steps of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
The present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those within the art that：It still may be used
Modified with to the technical scheme described in foregoing embodiments, or equivalent is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (10)
1. a kind of intelligent refrigerator food management method, it is characterised in that it includes：
When intelligent refrigerator opens the door, the image that user performs accessing operation is shot by the camera in intelligent refrigerator；
The type and corresponding food title to obtain the accessing operation are identified to described image；
When recognition failures, user is pointed out by the type of accessing operation described in phonetic entry and corresponding food title, its
In, the type of the accessing operation includes depositing operation and extract operation；
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates default food row according to the voice messaging
Table.
2. intelligent refrigerator food management method according to claim 1, it is characterised in that described when recognition failures, points out
User passes through the type of accessing operation described in phonetic entry and corresponding food title, wherein, the type of the accessing operation
Include including depositing operation and extract operation：
When recognition failures, the intelligent refrigerator sends to remote server described image；
The remote server is identified type and corresponding the food name to obtain the accessing operation to described image
Claim；
When the remote server recognition failures, by the feedback of the information of the recognition failures to the intelligent refrigerator；
The intelligent refrigerator prompting user passes through the type of accessing operation described in phonetic entry and corresponding food title, its
In, the type of the accessing operation includes depositing operation and extract operation.
3. intelligent refrigerator food management method according to claim 1 or claim 2, it is characterised in that methods described also includes：
When recognizing successfully, the type and food title of the accessing operation obtained according to identification update default food row
Table.
4. intelligent refrigerator food management method according to claim 1, it is characterised in that when intelligent refrigerator opens the door, pass through
The image that camera in intelligent refrigerator shoots user's execution accessing operation is specifically included：
When intelligent refrigerator opens the door, the type of the storeroom that intelligent refrigerator is opened is obtained, wherein, the type of the storeroom includes
Refrigerating chamber and refrigerating chamber；
When intelligent refrigerator opens refrigerating chamber, intelligent refrigerator is shot by camera in intelligent refrigerator and is opened the door to closing the door
User performs the image of accessing operation in journey.
5. intelligent refrigerator food management method according to claim 4, it is characterised in that described when intelligent refrigerator opens the door,
The image for shooting user's execution accessing operation by the camera in intelligent refrigerator also includes：
When intelligent refrigerator opens refrigerating chamber, user is pointed out by the type of accessing operation described in phonetic entry and corresponding food
Name claims；And
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates the default food according to the voice messaging
Thing list, end operation.
6. the intelligent refrigerator food management method according to claim 1, it is characterised in that the monitoring is arranged at refrigerator
On microphone input voice messaging, and also include after updating default food list according to the voice messaging：
The intelligent refrigerator is connected by network with external equipment, and receives the food information of external equipment push；And by ice
Case internal device state information and food demand feedback of the information to external equipment, wherein, the external equipment include operator clothes
Business device and user terminal.
7. a kind of intelligent refrigerator, it is characterised in that it includes：
Camera, for when intelligent refrigerator opens the door, shooting the image that user performs accessing operation；
Microphone, the voice messaging for receiving user input；
Control device, for being identified to described image, and when recognition failures, points out user by being deposited described in phonetic entry
The type of extract operation and corresponding food title, wherein, the type of the accessing operation includes depositing operation and extract operation；And
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates default food row according to the voice messaging
Table.
8. intelligent refrigerator according to claim 7, it is characterised in that the update module is additionally operable to：
When recognizing successfully, the type and corresponding food title of the accessing operation obtained according to identification update default
Food list.
9. the intelligent refrigerator according to claim 7, it is characterised in that the control device also includes：
Acquisition module, for when intelligent refrigerator opens the door, obtaining the type of the storeroom that intelligent refrigerator is opened, wherein, the storage
The type for hiding room includes refrigerating chamber and refrigerating chamber；
First control module, for when intelligent refrigerator opens refrigerating chamber, camera of the control in intelligent refrigerator to shoot intelligence
User performs the image of accessing operation in energy refrigerator open to door closing procedure.
10. the intelligent refrigerator according to claim 9, it is characterised in that the control device also includes：
Reminding module, for when intelligent refrigerator opens refrigerating chamber, pointing out user the class by accessing operation described in phonetic entry
Type and corresponding food title；
The update module is additionally operable to：
Monitoring is arranged at the voice messaging of the microphone input on refrigerator, and updates the default food according to the voice messaging
Thing list, end operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611176845.1A CN106679321A (en) | 2016-12-19 | 2016-12-19 | Intelligent refrigerator food management method and intelligent refrigerator |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611176845.1A CN106679321A (en) | 2016-12-19 | 2016-12-19 | Intelligent refrigerator food management method and intelligent refrigerator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106679321A true CN106679321A (en) | 2017-05-17 |
Family
ID=58871000
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611176845.1A Pending CN106679321A (en) | 2016-12-19 | 2016-12-19 | Intelligent refrigerator food management method and intelligent refrigerator |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106679321A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107328164A (en) * | 2017-05-27 | 2017-11-07 | 北京京东尚科信息技术有限公司 | Monitoring method, device, electronic equipment and the storage medium of article storage period |
| CN107752584A (en) * | 2017-10-13 | 2018-03-06 | 戴静 | Storage system based on database Intelligent Recognition article |
| CN107763958A (en) * | 2017-09-27 | 2018-03-06 | 珠海格力电器股份有限公司 | Intelligent refrigerator |
| CN108204711A (en) * | 2017-12-15 | 2018-06-26 | 北京京东尚科信息技术有限公司 | For the method, system and electronic equipment of electronic equipment |
| CN109114877A (en) * | 2018-08-13 | 2019-01-01 | 长虹美菱股份有限公司 | A kind of food management system based on refrigerator Dynamic Recognition |
| CN109631456A (en) * | 2017-10-06 | 2019-04-16 | 东芝生活电器株式会社 | Refrigerator |
| CN111102797A (en) * | 2018-10-25 | 2020-05-05 | 上海瀚强信息科技有限公司 | Wisdom refrigerator based on artificial intelligence |
| CN111473589A (en) * | 2020-04-23 | 2020-07-31 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| WO2020181748A1 (en) * | 2019-03-13 | 2020-09-17 | 青岛海尔电冰箱有限公司 | Speech data interaction method and interaction system for use when adding food material into refrigerator |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111750605A (en) * | 2019-03-28 | 2020-10-09 | 合肥华凌股份有限公司 | Food storage device, control method of food storage, and readable storage medium |
| CN112912940A (en) * | 2019-10-04 | 2021-06-04 | Ism机电工业及贸易股份公司 | Intelligent small refrigerator system and method thereof |
| CN113124633A (en) * | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Refrigerator with a door |
| CN113139402A (en) * | 2020-01-17 | 2021-07-20 | 海信集团有限公司 | A kind of refrigerator |
| CN113566490A (en) * | 2021-08-25 | 2021-10-29 | 四川虹美智能科技有限公司 | Refrigerator food management method and refrigerator |
| CN113883818A (en) * | 2021-09-30 | 2022-01-04 | 创维电器股份有限公司 | Method for realizing food tracking and food management of refrigerator freezing chamber |
| CN113959136A (en) * | 2020-07-06 | 2022-01-21 | 海信视像科技股份有限公司 | Refrigerator and food material management interface display method |
| CN114724555A (en) * | 2020-12-22 | 2022-07-08 | 深圳Tcl新技术有限公司 | Food replacement prompting method and device based on voice instruction, terminal equipment and storage medium |
| CN115077157A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077162A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077155A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077161A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077160A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator, intelligent refrigerator system |
| CN115077158A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator, intelligent refrigerator system |
| US12105775B2 (en) | 2021-09-24 | 2024-10-01 | Haier Us Appliance Solutions, Inc. | Inventory management system in a refrigerator appliance |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104091201A (en) * | 2014-07-04 | 2014-10-08 | 四川长虹电器股份有限公司 | Article management method based on voice input |
| CN104482715A (en) * | 2014-12-31 | 2015-04-01 | 合肥华凌股份有限公司 | Method for managing food in refrigerator and refrigerator |
| CN104896868A (en) * | 2015-06-18 | 2015-09-09 | 合肥美菱股份有限公司 | Method for identifying and managing refrigerator food list according to remote images |
| CN105135782A (en) * | 2015-08-31 | 2015-12-09 | 合肥格易集成电路有限公司 | Intelligent refrigerator management system based on internet of things |
| CN105164481A (en) * | 2013-04-10 | 2015-12-16 | Lg电子株式会社 | Method for managing storage product in refrigerator using image recognition, and refrigerator for same |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
-
2016
- 2016-12-19 CN CN201611176845.1A patent/CN106679321A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105164481A (en) * | 2013-04-10 | 2015-12-16 | Lg电子株式会社 | Method for managing storage product in refrigerator using image recognition, and refrigerator for same |
| CN104091201A (en) * | 2014-07-04 | 2014-10-08 | 四川长虹电器股份有限公司 | Article management method based on voice input |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN104482715A (en) * | 2014-12-31 | 2015-04-01 | 合肥华凌股份有限公司 | Method for managing food in refrigerator and refrigerator |
| CN104896868A (en) * | 2015-06-18 | 2015-09-09 | 合肥美菱股份有限公司 | Method for identifying and managing refrigerator food list according to remote images |
| CN105135782A (en) * | 2015-08-31 | 2015-12-09 | 合肥格易集成电路有限公司 | Intelligent refrigerator management system based on internet of things |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107328164A (en) * | 2017-05-27 | 2017-11-07 | 北京京东尚科信息技术有限公司 | Monitoring method, device, electronic equipment and the storage medium of article storage period |
| CN107763958A (en) * | 2017-09-27 | 2018-03-06 | 珠海格力电器股份有限公司 | Intelligent refrigerator |
| CN109631456A (en) * | 2017-10-06 | 2019-04-16 | 东芝生活电器株式会社 | Refrigerator |
| CN109631456B (en) * | 2017-10-06 | 2021-04-13 | 东芝生活电器株式会社 | Refrigerator with a door |
| CN107752584B (en) * | 2017-10-13 | 2021-03-05 | 戴静 | Storage system based on database intelligent identification article |
| CN107752584A (en) * | 2017-10-13 | 2018-03-06 | 戴静 | Storage system based on database Intelligent Recognition article |
| CN108204711A (en) * | 2017-12-15 | 2018-06-26 | 北京京东尚科信息技术有限公司 | For the method, system and electronic equipment of electronic equipment |
| CN109114877A (en) * | 2018-08-13 | 2019-01-01 | 长虹美菱股份有限公司 | A kind of food management system based on refrigerator Dynamic Recognition |
| CN111102797A (en) * | 2018-10-25 | 2020-05-05 | 上海瀚强信息科技有限公司 | Wisdom refrigerator based on artificial intelligence |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| WO2020181748A1 (en) * | 2019-03-13 | 2020-09-17 | 青岛海尔电冰箱有限公司 | Speech data interaction method and interaction system for use when adding food material into refrigerator |
| CN111692829B (en) * | 2019-03-13 | 2022-02-01 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111750605A (en) * | 2019-03-28 | 2020-10-09 | 合肥华凌股份有限公司 | Food storage device, control method of food storage, and readable storage medium |
| CN112912940A (en) * | 2019-10-04 | 2021-06-04 | Ism机电工业及贸易股份公司 | Intelligent small refrigerator system and method thereof |
| CN113124633A (en) * | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Refrigerator with a door |
| CN113139402A (en) * | 2020-01-17 | 2021-07-20 | 海信集团有限公司 | A kind of refrigerator |
| CN113139402B (en) * | 2020-01-17 | 2023-01-20 | 海信集团有限公司 | A kind of refrigerator |
| CN111473589A (en) * | 2020-04-23 | 2020-07-31 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| CN111473589B (en) * | 2020-04-23 | 2021-06-01 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| CN113959136B (en) * | 2020-07-06 | 2022-11-25 | 海信视像科技股份有限公司 | Refrigerator and food material management interface display method |
| CN113959136A (en) * | 2020-07-06 | 2022-01-21 | 海信视像科技股份有限公司 | Refrigerator and food material management interface display method |
| CN114724555A (en) * | 2020-12-22 | 2022-07-08 | 深圳Tcl新技术有限公司 | Food replacement prompting method and device based on voice instruction, terminal equipment and storage medium |
| CN115077160A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator, intelligent refrigerator system |
| CN115077162A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077155A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077161A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077157A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077158A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator, intelligent refrigerator system |
| CN115077155B (en) * | 2021-03-10 | 2023-12-22 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077161B (en) * | 2021-03-10 | 2024-04-23 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115077157B (en) * | 2021-03-10 | 2024-04-23 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN113566490A (en) * | 2021-08-25 | 2021-10-29 | 四川虹美智能科技有限公司 | Refrigerator food management method and refrigerator |
| US12105775B2 (en) | 2021-09-24 | 2024-10-01 | Haier Us Appliance Solutions, Inc. | Inventory management system in a refrigerator appliance |
| CN113883818A (en) * | 2021-09-30 | 2022-01-04 | 创维电器股份有限公司 | Method for realizing food tracking and food management of refrigerator freezing chamber |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106679321A (en) | Intelligent refrigerator food management method and intelligent refrigerator | |
| WO2019119976A1 (en) | Method and apparatus for pickup from storage terminal, and electronic device | |
| CN102779509B (en) | Voice processing equipment and voice processing method | |
| US11184582B2 (en) | Terminal and operating method thereof | |
| WO2017071070A1 (en) | Speech control method and apparatus for smart device, control device and smart device | |
| CN109379261A (en) | Control method, device, system, equipment and the storage medium of smart machine | |
| CN110460905A (en) | The automatic continuous playing method of video, device and storage medium based on more equipment | |
| CN105206275A (en) | Device control method, apparatus and terminal | |
| CN104896868A (en) | Method for identifying and managing refrigerator food list according to remote images | |
| CN109269041B (en) | Air conditioner, air conditioner control method, and computer-readable storage medium | |
| CN112053683A (en) | Voice instruction processing method, device and control system | |
| CN101316324A (en) | Terminal and image processing method thereof | |
| CN110824940A (en) | Method and device for controlling intelligent household equipment, electronic equipment and storage medium | |
| CN107871001B (en) | Audio playing method and device, storage medium and electronic equipment | |
| CN109597313A (en) | Method for changing scenes and device | |
| CN105093980B (en) | Control the method and device of smart machine start and stop | |
| CN108632796A (en) | Bluetooth connecting method, device, terminal and computer readable storage medium | |
| CN109034106B (en) | Face data cleaning method and device | |
| CN105354284A (en) | Template processing method and apparatus and short message identification method and apparatus | |
| CN107480037A (en) | Behavior recording method and apparatus, intelligent device and storage medium | |
| US10691717B2 (en) | Method and apparatus for managing data | |
| CN107580132B (en) | Information sending method, information sending device, storage medium and electronic equipment | |
| CN104917994A (en) | Audio and video calling system and method | |
| CN108124130A (en) | A kind of doorbell based reminding method, device, computer equipment and readable storage medium storing program for executing | |
| CN105515923A (en) | Equipment control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170517 |