CN108154078A - Food materials managing device and method - Google Patents
Food materials managing device and method Download PDFInfo
- Publication number
- CN108154078A CN108154078A CN201711160013.5A CN201711160013A CN108154078A CN 108154078 A CN108154078 A CN 108154078A CN 201711160013 A CN201711160013 A CN 201711160013A CN 108154078 A CN108154078 A CN 108154078A
- Authority
- CN
- China
- Prior art keywords
- food materials
- refrigerator
- information
- image information
- action
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2700/00—Means for sensing or measuring; Sensors therefor
- F25D2700/02—Sensors detecting door opening
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2700/00—Means for sensing or measuring; Sensors therefor
- F25D2700/06—Sensors detecting the presence of a product
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
This application discloses a kind of food materials managing device and method, wherein device includes：Door sensor inductor, for detecting the refrigerator door state of refrigerator；Detector, for detecting the disengaging action event of the refrigerator；Imaging sensor, for according to the refrigerator doors state acquisition image information；Processor, for obtaining food materials change information in the refrigerator after determining the direction of action of the disengaging action event；And the corresponding food materials information of identification described image information.Present application addresses general refrigerator can not intelligent management food materials the problem of, realize food materials change information in refrigerator and obtain and the identification of food materials information.In addition, user arbitrarily installs food materials managing device also on refrigerator, user experience is improved.
Description
Technical field
This application involves built-in field, in particular to a kind of food materials managing device and method.
Background technology
Intelligent refrigerator is that microprocessor, sensor technology, network communication technology are introduced to the household electrical appliances formed after refrigerator apparatus
Product.Intelligent appliance in household appliances uses embedded system, i.e., the identification of included food materials and management function substantially.But
For lacking food materials management function in general refrigerator product.
For refrigerator product in the relevant technologies can not intelligent management food materials the problem of, not yet propose effective solution party at present
Case.
Invention content
The main purpose of the application is to provide a kind of food materials managing device, with solve general refrigerator can not intelligent recognition eat
Material problem.
To achieve these goals, according to the one side of the application, a kind of food materials managing device is provided, feature exists
In the food materials managing device is installed on refrigerator for detachable, and the food materials managing device includes：Door sensor senses
Device, for detecting the refrigerator door state of refrigerator；Detector, for detecting the disengaging action event of the refrigerator；Imaging sensor,
For according to the refrigerator doors state acquisition image information；Processor, for determining the direction of action of the disengaging action event
The food materials change information in the refrigerator is obtained afterwards；And the corresponding food materials information of identification described image information.
Further, the processor includes：First processing units, second processing unit and third processing unit, it is described
First processing units, for obtaining the first image information in locally pretreatment and described first image information being sent to distal end；
The second processing unit, for identifying described first image information in distal end；The third processing unit, for local true
Surely the direction of action of action event is passed in and out.
To achieve these goals, according to the another aspect of the application, a kind of food management method is provided, is used to implement
The function of the detachable food materials managing device for being installed on refrigerator, the method includes：Detect the refrigerator gate-shaped of refrigerator
The disengaging action event of state and the refrigerator；According to the refrigerator doors state acquisition image information；Identify described image information pair
The food materials information answered；Determine the direction of action of the disengaging action event；And the refrigerator is obtained according to the direction of action
In food materials change information；Wherein, it detects the refrigerator door state of the refrigerator and the disengaging action event of the refrigerator includes：It obtains
Take the refrigerator doors first state of the refrigerator；Moving object is detected in the refrigerator doors first state；Obtain the refrigerator
The second state of refrigerator doors；And terminate to detect in second state of refrigerator doors.
Further, identify that the corresponding food materials information of described image information includes according to described image information：Described in judgement
Whether there is object in image information；If having object in described image information, the coordinate position of the object is detected；
Judge the coordinate position whether in the preset range of described image information；And if the coordinate position in described image
In the preset range of information, then food materials information corresponding with the object is matched.
Further, according to the disengaging action event, direction of action is determined；The ice is obtained according to the direction of action
Food materials change information in case includes：Judge whether the disengaging action event is the first action event into the refrigerator；
First direction of action is obtained according to first action event；The first food into the refrigerator is determined by the first direction of action
Material change information；Judge whether the disengaging action event is the second action event taken out from the refrigerator；According to described
Two action events obtain the second direction of action；And the second food materials for determining to take out from the refrigerator as direction by second change
Information；Wherein, the first food materials change information and the second food materials change information include：It detects in the first food materials change information
Food materials are accelerated；The food materials are accelerated as the first food materials change information；It detects in the second food materials change information
Food materials reduce quantity；It is the second food materials change information that the food materials, which reduce quantity,.
Further, it after the food materials change information in the refrigerator is obtained according to the direction of action, further includes：Judge institute
Food materials are stated whether within the preset quality guarantee period；If the food materials close on the preset quality guarantee period, the first prompting letter is sent
Breath；If the food materials send the second prompt message within the preset quality guarantee period；It is according to prompt message judgement
It is no to increase food materials into the refrigerator；And if it is determined that increase food materials into the refrigerator, then the food materials are reconfigured
Quality guarantee period.
Further, it before identifying the corresponding food materials information of described image information according to described image information, further includes：Judge
Whether the corresponding first food materials information of described image information can recognize that；If the corresponding first food materials information of described image information is not
It is recognizable, then increase by the second food materials information；The first food materials information according to the second food materials information correction；Wherein, first
Food materials information is image information, and the second food materials information is voice messaging.
To achieve these goals, according to the another aspect of the application, a kind of food materials managing device is provided, feature exists
In, including：Detection module, identification module, state management module, the detection module, for detecting the refrigerator doors of the refrigerator
The disengaging action event of state and the refrigerator, wherein, detect the refrigerator door state and the disengaging action event of the refrigerator
Including：Obtain the refrigerator doors first state；Moving object is detected in the refrigerator doors first state；Obtain the refrigerator doors
Second state；And terminate to detect in second state of refrigerator doors；The identification module, for according to the refrigerator gate-shaped
State acquires image information；And determine the direction of action of the disengaging action event；The state management module, for according to institute
State the corresponding food materials information of image information identification described image information；And it is obtained in the refrigerator according to the direction of action
Food materials change information.
Further, the state management module is additionally operable to, and judges whether there is object in described image information；If institute
Stating has object in image information, then detects the coordinate position of the object；Judge the coordinate position whether in the figure
As information preset range in；And if the coordinate position in the preset range of described image information, matches and institute
State the corresponding food materials information of object.
Further, the state management module is additionally operable to, and judges whether the disengaging action event is into the ice
First action event of case；First direction of action is obtained according to first action event；By the first direction of action determine into
Enter the first food materials change information of the refrigerator；Judge whether the disengaging action event is that second taken out from the refrigerator moves
Make event；Second direction of action is obtained according to second action event；And it is determined by second as direction from the refrigerator
The the second food materials change information taken out；Wherein, the first food materials change information and the second food materials change information include：Detect described
Food materials in one food materials change information are accelerated；The food materials are accelerated as the first food materials change information；Detect described
The middle food materials of two food materials change informations reduce quantity；It is the second food materials change information that the food materials, which reduce quantity,.
In the embodiment of the present application, so as to which to specific installation site, there is no limit pass through by the way of detachable
Door sensor inductor, detector, imaging sensor have achieved the purpose that detect and acquire, it is achieved thereby that the food materials in refrigerator become
Change acquisition of information and the technique effect of food materials information identification, so solve general refrigerator can not the technologies of intelligent management food materials ask
Topic.
Description of the drawings
The attached drawing for forming the part of the application is used for providing further understanding of the present application so that the application's is other
Feature, objects and advantages become more apparent upon.The illustrative examples attached drawing and its explanation of the application is for explaining the application, not
Form the improper restriction to the application.In the accompanying drawings：
Fig. 1 is the food materials managing device hardware architecture diagram according to the embodiment of the present application；
Fig. 2 is the preferred structure schematic diagram according to the processor of the embodiment of the present application；
Fig. 3 is the food management method flow diagram according to the embodiment of the present application；
Fig. 4 is the preferred food management method flow diagram according to the embodiment of the present application；
Fig. 5 is the another preferred food management method flow diagram according to the embodiment of the present application；
Fig. 6 is another preferred food management method flow diagram according to the embodiment of the present application；
Fig. 7 is another preferred food management method flow diagram according to the embodiment of the present application；And
Fig. 8 is the food materials managing device structure diagram according to the embodiment of the present application.
Specific embodiment
In order to which those skilled in the art is made to more fully understand application scheme, below in conjunction in the embodiment of the present application
The technical solution in the embodiment of the present application is clearly and completely described in attached drawing, it is clear that described embodiment is only
The embodiment of the application part, instead of all the embodiments.Based on the embodiment in the application, ordinary skill people
Member's all other embodiments obtained without making creative work should all belong to the model of the application protection
It encloses.
It should be noted that term " first " in the description and claims of this application and above-mentioned attached drawing, "
Two " etc. be the object for distinguishing similar, and specific sequence or precedence are described without being used for.It should be appreciated that it uses in this way
Data can be interchanged in the appropriate case, so as to embodiments herein described herein.In addition, term " comprising " and " tool
Have " and their any deformation, it is intended that cover it is non-exclusive include, for example, containing series of steps or unit
Process, method, system, product or equipment are not necessarily limited to those steps or unit clearly listed, but may include without clear
It is listing to Chu or for the intrinsic other steps of these processes, method, product or equipment or unit.
In this application, term " on ", " under ", "left", "right", "front", "rear", " top ", " bottom ", " interior ", " outer ",
" in ", " vertical ", " level ", " transverse direction ", the orientation of the instructions such as " longitudinal direction " or position relationship be based on orientation shown in the drawings or
Position relationship.These terms are not intended to limit indicated dress primarily to preferably describe the application and embodiment
It puts, element or component must have particular orientation or constructed and operated with particular orientation.
Also, above-mentioned part term is other than it can be used to indicate that orientation or position relationship, it is also possible to for representing it
His meaning, such as term " on " also be likely used for representing certain relations of dependence or connection relation in some cases.For ability
For the those of ordinary skill of domain, the concrete meaning of these terms in this application can be understood as the case may be.
In addition, term " installation ", " setting ", " being equipped with ", " connection ", " connected ", " socket " should be interpreted broadly.For example,
Can be fixedly connected, be detachably connected or monolithic construction；Can be mechanical connection or electrical connection；It can be direct phase
It is indirectly connected even or by intermediary or is the connections of two inside between device, element or component.
For those of ordinary skills, the concrete meaning of above-mentioned term in this application can be understood as the case may be.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the application can phase
Mutually combination.The embodiment of the present application is mainly used in refrigerator, and the related family of progress food materials management can be also needed in oven, micro-wave oven etc.
It is applied on electricity.In following embodiment by taking refrigerator as an example, and refer to the attached drawing and it is described in detail the application in conjunction with the embodiments.
It must utmostly ensure the independence and integrality of food materials managing device in the application, devise a kind of apply in traditional home appliance
Food materials managing device.Food materials managing device is easy for installation, and module independence is strong, can flexibly move.The pattern of the candid photograph of image is new
Grain husk can make ordinary electrical home appliance become an intelligent appliance.
In addition, food materials managing device can capture and identify fortune work(in image information, and judge food materials be into or go out,
And then management of the realization to food materials.
As shown in Figure 1, the food materials managing device includes following composition：Door sensor inductor 12, for detecting the ice of refrigerator
Chamber door state；Detector 11, for detecting the disengaging action event of the refrigerator；Imaging sensor 21, for according to the ice
Chamber door state acquisition image information；Processor 31, for determine it is described disengaging action event direction of action after obtain the ice
Food materials change information in case；And the corresponding food materials information of identification described image information.The refrigerator door state for open or
Person closes.The disengaging action event can be that hand enters refrigerator or takes out the motion event of refrigerator.Imaging sensor 21
It can detect that hand enters refrigerator or while taking out the motion event of refrigerator starts to acquire image information in detector 11.Image
Sensor 21 is used to capture the image of food materials, and processor 31 is for take pictures logic control, image preprocessing and transmission.
For example, food materials managing device is not limited to specific installation site.Preferably, user can be by food materials managing device
Removably it is placed in the position at the top of refrigerator.
Specifically, detector 11 either door sensor inductor 12 include but not limited to using ultrasonic wave or infrared induction or
Other can realize that the device of sensing makes the mode of array to person, and according to time difference of different location signal to hand exercise
Direction is perceived.
Specifically, imaging sensor 21 includes but not limited to, and camera, camera etc. have the device of image collecting function.
It can also include：Wireless router, for image and identification information to be transferred to outer net.Detector 11 can be replaced burning and be based on
The imaging sensor of the moving object segmentation algorithm of video frame, for detecting the movement of hand and cooperation algorithm of target detection
It determines the direction of hand exercise, so as to obtain suitable picture, is uploaded to background server later.
Specifically, management process includes：
Step S1, the signal that door sensor inductor 12 is waited for transmit；
Whether step S2, detector 11 sense moving object；Door sensor inductor 12 is continued waiting for if not to transmit
Signal；
Step S3 if receiving the signal of the transmission of door sensor inductor 12, triggers imaging sensor 21 and starts acquisition figure
Picture；
Step S4, processor 31 receives the image of the acquisition of imaging sensor 21 and detector 11 senses moving object thing
Part；
Step S5 is uploaded to background server or cloud server by wireless routing, continues waiting for door sensor inductor
12 signals transmitted.
For example, background server end is interacted with the client on user mobile phone, background server end upon receiving the image,
Dispatching distribution resource quickly identifies image.Then the client result after identification being sent on user mobile phone.With
Client on the mobile phone of family can be with the state of the picture of the newest upload of real time inspection, and can manage and inquire the food in a period of time
Quality guarantee period of material etc..
As in the present embodiment preferably, as shown in Fig. 2, the processor 21 includes：First processing units 311, second
Processing unit 312 and third processing unit 313, the first processing units 311, for obtaining the first image in locally pretreatment
Described first image information is simultaneously sent to distal end by information；The second processing unit 312, for distally identifying described first
Image information；The third processing unit 313, in the direction of action for locally determining disengaging action event.By described first
The method that image information is sent to distal end can be by router, and the router is wireless router, as in data
Turn station.Distal end can be beyond the clouds, background server.Food materials/the hand being put into is realized in back-end server or high in the clouds for operation
The software application of portion's movement identification.
As preferred in the present embodiment, the second processing unit is additionally operable to the storage of recognition result, analysis and quick
Search function.Meanwhile in the case where the processing capacity of the second processing unit allows, depositing for result can be locally completed
Storage, analysis and quick-searching function.Retrieval result can be synchronized to pre-installation and have in the terminal of application program simultaneously.
Specifically, it is opened when door sensor inductor 12 detects refrigerator doors, operating circuit is connected, when hand or other moving objects
When body passes through the range of detector 11, triggering imaging sensor 21 is continuously taken pictures after detector 11 senses moving object.When hand from
After opening 21 visual field of imaging sensor, detector 11 senses moving object and leaves, and camera stopping is taken pictures.Sequence image is sent to food materials pipe
In reason dress, processor 31 picks out optimal picture with calculating by analysis.For example, picture does not obscure clearly, contrast is higher
It can be optimal picture.For another example, the texture color feature of food materials is apparent, and food materials target is alternatively optimal in picture centre position
Picture.Preferably, the image data of acquisition is reached via radio network gateway in the background server equipment of outer net or distal end.
For example, by taking refrigerator as an example, food materials managing device is mounted at the top position of refrigerator, when door sensor inductor 12
It detects family refrigerator doors to open, connects operating circuit, when the range of detector 11 is passed through in hand or other moving objects, detection
Triggering imaging sensor 21 is continuously taken pictures after device 11 senses moving object.After hand leaves 21 visual field of imaging sensor, detector
11 sensing moving objects are left, and camera stopping is taken pictures.Sequence image is sent in food materials managing device, processor 31 by analysis and
Optimal picture is picked out in calculating.For example, picture does not obscure clearly, higher contrast is optimal picture.For another example, food materials
Texture color feature it is apparent, food materials target is alternatively optimal picture in picture centre position.Preferably, the picture number of acquisition
According in the background server equipment that outer net or distal end are reached via radio network gateway.
It can be seen from the above description that the present invention realizes following technique effect：
In the embodiment of the present application, it by the way of detachable, is passed by door sensor inductor 12, detector 11, image
Sensor 21 has achieved the purpose that detect and acquire, it is achieved thereby that the food materials change information in refrigerator obtains and food materials information is known
Other technique effect, so solve general refrigerator can not intelligent management food materials the technical issues of.The application casts aside refrigerator in itself
Mechanism design, utmostly guarantee system independence and integrality, easy for installation by the way of detachable, food materials pipe
The module independence for managing device is strong.Detector 11 and imaging sensor 21 coordinate, and the image in the processing fortune work(of processor 31
Information, while can also judge the disengaging of food materials, so as to food materials management, general refrigerator be made to become an intelligent refrigerator.
It should be noted that step shown in the flowchart of the accompanying drawings can be in such as a group of computer-executable instructions
It is performed in computer system, although also, show logical order in flow charts, it in some cases, can be with not
The sequence being same as herein performs shown or described step.
According to embodiments of the present invention, a kind of functional method for being used to implement food materials managing device described above is additionally provided,
As shown in figure 3, this method includes：
Step S100 detects the refrigerator door state of refrigerator and the disengaging action event of the refrigerator；
The refrigerator door state of refrigerator is detected, can be door sensor inductor, detect the disengaging action event of refrigerator, can visit
Survey device.
For example, the refrigerator door state of detection refrigerator is by closing-opening, then it is assumed that is to trigger refrigerator doors.Detect refrigerator
Refrigerator door state be opening-closing, then it is assumed that and trigger refrigerator doors.Detect refrigerator door state by closing-opening or
When under opening-closed state, if having the hand motion for being externally entering, being taken out from content.
Step S101, according to the refrigerator doors state acquisition image information；
Image information can be the image information of unspecified angle shooting, and can the subsequent identification of acquisition sequence image progress.
For example, when hand either other moving objects by and the operation of triggering collection image information after when hand or
When other moving objects enter preset range, can continuously it be taken pictures by sensing to trigger after moving object.When hand leaves default model
After enclosing, sensing moving object is left, and camera stopping is taken pictures.
Step S102, the corresponding food materials information of identification described image information；
Identification food materials information includes but not limited to, the title of food materials, the type of food materials, the color of food materials, the quantity of food materials
Deng.Wherein most importantly identification is any food materials, i.e., the food materials in image information is compared with the food materials information to prestore
Afterwards, the title of food materials is obtained.
For example, by identifying image information, corresponding food materials title can be quickly found out in the gap for opening refrigerator doors.
Step S103 determines the direction of action of the disengaging action event；
Action event can be the action event of event detection either other triggering infrared detections of hand exercise.Sentencing
Can be by preset sensor location and angle during the direction of action of disconnected disengaging action event.Judging to pass in and out action event
Direction of action when can also be through preset Target Recognition Algorithms, identify outgoing direction.Direction of action can be blur direction
Judge either precisely direction judgement.
For example, first detecting whether the hand exercise into refrigerator, when there is the hand exercise into refrigerator, then pass through figure
As recognizer calculates the intention of specific hand exercise, and one group of image for selecting confidence level maximum the most finally judges
Foundation.
Step S104 obtains the food materials change information in the refrigerator according to the direction of action；
Food materials change information can be that the quantity of food materials is being reduced or increased.Can also be the type of food materials newly-increased or
Person adds.It can also be the relative position variation of current refrigerator storage space and food materials.
Wherein, by taking refrigerator as an example, in the step S100, detect the refrigerator refrigerator door state and the refrigerator into
Go out to act event package and include：Obtain the refrigerator doors first state of the refrigerator；Moving object is detected in the refrigerator doors first state
Body；Obtain the second state of refrigerator doors of the refrigerator；And terminate to detect in second state of refrigerator doors.
As preferred in the present embodiment, the step S103 determines the direction of action of the disengaging action event, for
The sensing of hand exercise, the sensing of hand exercise can be realized by sensors such as infrared, ultrasonic waves, if processor receives spy
The signal that device returns is surveyed, then starts imaging sensor at once and takes pictures.It preferably, can be by the aperture time of imaging sensor
If must be relatively short, within ms, the image that can be effectively prevented imaging sensor acquisition moves aperture time unit
Fuzzy situation.Preferably, the lens aperture in imaging sensor set it is relatively large so as to ensure light-inletting quantity while, ensure
The brightness of image of acquisition is unlikely to too dark.In addition, multiple image combination can be collected by the several frame images of consecutive image continuous acquisition
Into one group of sequence chart as input.
As preferred in the present embodiment, the judgement about food materials disengaging, it is preferable that can be by ultrasonic wave or infrared sense
It answers or other can realize that the device of sensing makes the mode of array, and hand is transported according to the time difference of different location signal
Dynamic direction is perceived.
According to embodiments of the present invention, as shown in figure 4, identifying the corresponding food materials of described image information according to described image information
Information includes：
Step S200 judges whether there is object in described image information；
The selection of object can be determined by setting the tracking of target frame.
Step S201 if having object in described image information, detects the coordinate position of the object；
Coordinate position can be center position coordinates.
Whether step S202 judges the coordinate position in the preset range of described image information；
If beyond preset range, can not continue to handle image information.
Step S203, if the coordinate position in the preset range of described image information, matches and the target
The corresponding food materials information of object.
Matched mode can compare or access network and real-time update in cloud database with local data base
Data information compares.
As preferred in above-described embodiment, it is assumed that n sequence of pictures numbers are I1,I2,I3...In, traverse this n figures
Piece uses the food materials in the algorithm detection picture of target detection；Assuming that algorithm calculates the picture I of gained1,I2,I3...InMiddle food
The coordinate of target's center's point of material is (x respectively1,y1),(x2,y2),(x3,y3)...(xn,yn), and corresponding confidence level is respectively
c1,c2,c3...cn(0<c1,c2,c3...cn<1) picture I, then need to only be found outi(1<i<N) so that
Wherein α is constant, and w, h are that the width of picture is high respectively.
According to embodiments of the present invention, as shown in figure 5, according to the disengaging action event, direction of action is determined；According to described
The food materials change information that direction of action is obtained in the refrigerator includes：
Step S300 judges whether the disengaging action event is the first action event into the refrigerator；
Step S301 obtains the first direction of action according to first action event；By the first direction of action determine into
Enter the first food materials change information of the refrigerator；
Step S302 judges whether the disengaging action event is the second action event taken out from the refrigerator；
Step S303 obtains the second direction of action according to second action event；It is determined by second as direction from institute
State the second food materials change information that refrigerator is taken out；
In the step S301 and step S303, the first food materials change information and the second food materials change information
Including：The food materials detected in the first food materials change information are accelerated；The food materials are accelerated to be changed for the first food materials
Information；The middle food materials for detecting the second food materials change information reduce quantity；The food materials reduce quantity to be changed for the second food materials
Information.
For example, by taking refrigerator as an example, the first direction of action can be generated into the first action event of the refrigerator, be the
Two direction of action can be that the second action event taken out from the refrigerator generates.It can be food materials number that the food materials, which are accelerated,
Amount increase, the increase of food materials type or the increase of food materials density.It can be that food materials quantity is reduced, eaten that the food materials, which reduce quantity,
The reduction of material type or the reduction of food materials density.
It can be seen from the above description that the present embodiment realizes following technique effect：
In the embodiment of the present application, it is accelerated by the first direction of action and the second direction of action with food materials, food materials subtract
Small number is associated, so as to by the first food materials change information and the second food materials change information, realize the dynamic management of food materials.
According to embodiments of the present invention, as shown in fig. 6, the food materials obtained according to the direction of action in the refrigerator change letter
After breath, further include：
Whether step S400 judges the food materials within the preset quality guarantee period；
Step S401 if the food materials close on the preset quality guarantee period, sends the first prompt message；
By judging whether food materials close on the preset quality guarantee period, user can be reminded in advance, prevented due to missing food
The retainer of material and influence eating mouth feel and nutrient absorption.The mode of first prompt message includes but not limited to, and short massage notice pushes away
Send message, sound prompting etc..
For example, obtain the apple in the refrigerator according to the direction of action increases to 3 from 2,3 have also been newly increased
After pear, it can further judge whether apple or pear in refrigerator close on preset 5 day quality guarantee period, if apple
Fruit has housed 4 days, that is, is up to the quality guarantee period, then can remind user before 4 days by way of being pushed in terminal message
The apple being put into refrigerator i.e. will be expired.
Step S402, if the food materials send the second prompt message within the preset quality guarantee period；
By the food materials within the preset quality guarantee period, it is to remind to use that can have been subjected to the holding time limit in food materials
Family prevents from influencing edible due to expired.The mode of second prompt message includes but not limited to, short massage notice, PUSH message, sound
Sound prompting etc..
For example, obtain the apple in the refrigerator according to the direction of action increases to 3 from 2,1 pear is also reduced
After son, it can further judge whether the pear taken out from refrigerator closes on preset 7 day quality guarantee period, if from refrigerator
The pear taken out has housed 8 days, has been over the quality guarantee period, then can be carried by way of being pushed in terminal message
User's pear of waking up, which is had been placed in refrigerator, to be housed 8 days, has had been subjected to the preset holding time limit.
Step S403 judges whether to increase food materials into the refrigerator according to the prompt message；
Increase food materials to include but not limited to, increase the quantity of food materials, the type of food materials, food materials space density etc..
Step S404 if it is determined that increasing food materials into the refrigerator, then reconfigures the quality guarantee period of the food materials.
Whenever judging to increase food materials newly into refrigerator, need that user is reminded to reset the corresponding retention period of the food materials
Limit.In addition, whenever judging to take out food materials from refrigerator, also to judge food materials storage quality guarantee period whether have exceeded it is default
Quality guarantee period.
As preferred in above-described embodiment, the expired prompting for food materials, foundation is looked into according to the data of background server
It askes result and judges the food materials whether within the preset quality guarantee period, while the intelligence that can also and be connect with food materials managing device
Whether food materials described in simultaneous display are within the preset quality guarantee period on mobile terminal.Preferably, when user is close to refrigerator or use
When family triggering is mounted on the voice reminder switch in food materials managing device, the voice playing module on fore device provides food materials
Expired voice reminder.In addition, if being judged as increasing food materials into the refrigerator, then can again be set by food materials managing device
Put the quality guarantee period of food materials.
According to embodiments of the present invention, as shown in fig. 7, identifying the corresponding food materials of described image information according to described image information
Before information, further include：
Step S500, judges whether the corresponding first food materials information of described image information can recognize that；
If can not directly judge corresponding first food materials information according to image information, need to carry out auxiliary knowledge
Not.Can not judge corresponding first food materials information may be acquisition image None- identified, acquisition image in there is no mesh
It identifies in other object or the image of acquisition due to influences such as pixels, object recognition rate is caused to reduce.First food materials information can be
Image information.
Step S501 if the corresponding first food materials information of described image information not can recognize that, increases the second food materials letter
Breath；
If image information None- identified, increase by the second food materials information, the second food materials information can be with voice messaging.
Step S502, the first food materials information according to the second food materials information correction.
Image information is corrected by voice messaging, so as to improve the accuracy rate of food materials identification.For example, using refrigerator as
Example, after user is put into food materials into refrigerator, when food materials managing device or coupled background server None- identified, then
Food materials classification is inputted by user speech, judges whether the food materials information matches with user speech input, background server
Recognition result will take this as the standard, the image information that food materials voice messagings corrects the food materials is inputted by the user speech,
So as to which the technology to original artificial intelligence identification food materials carries out supplement correction.
Obviously, those skilled in the art should be understood that each module of the above-mentioned present invention or each step can be with general
Computing device realize that they can concentrate on single computing device or be distributed in multiple computing devices and be formed
Network on, optionally, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored
In the storage device by computing device come perform either they are fabricated to respectively each integrated circuit modules or by they
In multiple modules or step be fabricated to single integrated circuit module to realize.In this way, the present invention is not limited to any specific
Hardware and software combines.
As shown in figure 8, be the food materials managing device structure diagram according to the embodiment of the present application, food materials managing device packet
It includes：Detection module 10, identification module 20, state management module 30, the detection module 10, for detecting the refrigerator of the refrigerator
The disengaging action event of door state and the refrigerator, wherein, detect the refrigerator door state of the refrigerator and the disengaging of the refrigerator
Action event includes：Obtain the refrigerator doors first state of the refrigerator；Moving object is detected in the refrigerator doors first state；
Obtain the second state of refrigerator doors of the refrigerator；And terminate to detect in second state of refrigerator doors；The identification module
20, for according to the refrigerator doors state acquisition image information；And determine the direction of action of the disengaging action event；It is described
State management module 30, for identifying the corresponding food materials information of described image information according to described image information；And according to institute
State the food materials change information in the direction of action acquisition refrigerator.
In the detection module 10 of the embodiment of the present application, the refrigerator door state of refrigerator is detected, can be door sensor inductor, is examined
The disengaging action event of refrigerator is surveyed, can be detector.
For example, the refrigerator door state of detection refrigerator is by closing-opening, then it is assumed that is to trigger refrigerator doors.Detect refrigerator
Refrigerator door state be opening-closing, then it is assumed that and trigger refrigerator doors.Detect refrigerator door state by closing-opening or
When under opening-closed state, if having the hand motion for being externally entering, being taken out from content.
In the identification module 20 of the embodiment of the present application, image information can be the image letter of unspecified angle shooting
Breath, and can the subsequent identification of acquisition sequence image progress.
For example, when hand either other moving objects by and the operation of triggering collection image information after when hand or
When other moving objects enter preset range, can continuously it be taken pictures by sensing to trigger after moving object.When hand leaves default model
After enclosing, sensing moving object is left, and camera stopping is taken pictures.
Identify that food materials information includes but not limited in the identification module 20 of the embodiment of the present application, the title of food materials,
The type of food materials, the color of food materials, quantity of food materials etc..Wherein most importantly identification is any food materials, i.e., by image information
In food materials be compared with the food materials information to prestore after, obtain the title of food materials.
For example, by identifying image information, corresponding food materials title can be quickly found out in the gap for opening refrigerator doors.
In the identification module 20 of the embodiment of the present application action event can be hand exercise event detection or
It is the action event of other triggering infrared detections.Can be by preset sense in the direction of action for judging disengaging action event
Answer device position and angle.It can also be in the direction of action for judging disengaging action event through preset Target Recognition Algorithms,
Identify outgoing direction.Direction of action can be the judgement for judging either accurate direction of blur direction.
For example, first detecting whether the hand exercise into refrigerator, when there is the hand exercise into refrigerator, then pass through figure
As recognizer calculates the intention of specific hand exercise, and one group of image for selecting confidence level maximum the most finally judges
Foundation.
Food materials change information can be that the quantity of food materials is subtracting in the state management module 30 of the embodiment of the present application
Less or increase.Can also be the type of food materials newly-increased or add.It can also be current refrigerator storage space and food materials
Relative position variation.
Wherein, by taking refrigerator as an example, in the step S100, detect the refrigerator refrigerator door state and the refrigerator into
Go out to act event package and include：Obtain the refrigerator doors first state of the refrigerator；Moving object is detected in the refrigerator doors first state
Body；Obtain the second state of refrigerator doors of the refrigerator；And terminate to detect in second state of refrigerator doors.
As preferred in the present embodiment, the step S103 determines the direction of action of the disengaging action event, for
The sensing of hand exercise, the sensing of hand exercise can be realized by sensors such as infrared, ultrasonic waves, if processor receives spy
The signal that device returns is surveyed, then starts imaging sensor at once and takes pictures.It preferably, can be by the aperture time of imaging sensor
If must be relatively short, within ms, the image that can be effectively prevented imaging sensor acquisition moves aperture time unit
Fuzzy situation.Preferably, the lens aperture in imaging sensor set it is relatively large so as to ensure light-inletting quantity while, ensure
The brightness of image of acquisition is unlikely to too dark.In addition, multiple image combination can be collected by the several frame images of consecutive image continuous acquisition
Into one group of sequence chart as input.
As preferred in the present embodiment, the judgement about food materials disengaging, it is preferable that can be by ultrasonic wave or infrared sense
It answers or other can realize that the device of sensing makes the mode of array, and hand is transported according to the time difference of different location signal
Dynamic direction is perceived.
The food materials managing device is installed on refrigerator for detachable, and solving general refrigerator can not intelligent management
The technical issues of food materials.The application casts aside the mechanism design of refrigerator in itself, utmostly obtains the independence and integrality of guarantee system,
Easy for installation by the way of detachable, the module independence of food materials managing device is strong.Detection module 10, identification module 20 are matched
It closes, and the image information in the processing fortune work(of state management module 30, while can also judge the disengaging of food materials, so as to food
Material management can make general refrigerator become an intelligent refrigerator.
Preferably, the state management module 30 is additionally operable to judge whether have object in described image information；If institute
Stating has object in image information, then detects the coordinate position of the object；Judge the coordinate position whether in the figure
As information preset range in；And if the coordinate position in the preset range of described image information, matches and institute
State the corresponding food materials information of object.
As preferred in above-described embodiment, it is assumed that n sequence of pictures numbers are I1,I2,I3...In, traverse this n figures
Piece uses the food materials in the algorithm detection picture of target detection；Assuming that algorithm calculates the picture I of gained1,I2,I3...InMiddle food
The coordinate of target's center's point of material is (x respectively1,y1),(x2,y2),(x3,y3)...(xn,yn), and corresponding confidence level is respectively
c1,c2,c3...cn(0<c1,c2,c3...cn<1) picture I, then need to only be found outi(1<i<N) so that
Wherein α is constant, and w, h are that the width of picture is high respectively.
Preferably, the state management module 30 is additionally operable to judge whether the disengaging action event is into the refrigerator
The first action event；First direction of action is obtained according to first action event；It determines to enter by the first direction of action
First food materials change information of the refrigerator；Judge whether the disengaging action event is the second action taken out from the refrigerator
Event；Second direction of action is obtained according to second action event；And it determines to take from the refrigerator as direction by second
The the second food materials change information gone out；Wherein, the first food materials change information and the second food materials change information include：Detect described first
Food materials in food materials change information are accelerated；The food materials are accelerated as the first food materials change information；Detect described second
The middle food materials of food materials change information reduce quantity；It is the second food materials change information that the food materials, which reduce quantity,.
For example, by taking refrigerator as an example, the first direction of action can be generated into the first action event of the refrigerator, be the
Two direction of action can be that the second action event taken out from the refrigerator generates.It can be food materials number that the food materials, which are accelerated,
Amount increase, the increase of food materials type or the increase of food materials density.It can be that food materials quantity is reduced, eaten that the food materials, which reduce quantity,
The reduction of material type or the reduction of food materials density.
It can be seen from the above description that the present embodiment realizes following technique effect：
In the embodiment of the present application, it is accelerated by the first direction of action and the second direction of action with food materials, food materials subtract
Small number is associated, so as to by the first food materials change information and the second food materials change information, realize the dynamic management of food materials.
In the state management module 30 of the embodiment of the present application, it is additionally operable to judge the food materials whether in the preset quality guarantee period
It is interior；If the food materials close on the preset quality guarantee period, the first prompt message is sent；
By judging whether food materials close on the preset quality guarantee period, user can be reminded in advance, prevented due to missing food
The retainer of material and influence eating mouth feel and nutrient absorption.The mode of first prompt message includes but not limited to, and short massage notice pushes away
Send message, sound prompting etc..
For example, obtain the apple in the refrigerator according to the direction of action increases to 3 from 2,3 have also been newly increased
After pear, it can further judge whether apple or pear in refrigerator close on preset 5 day quality guarantee period, if apple
Fruit has housed 4 days, that is, is up to the quality guarantee period, then can remind user before 4 days by way of being pushed in terminal message
The apple being put into refrigerator i.e. will be expired.
In the state management module 30 of the embodiment of the present application, if being additionally operable to the food materials beyond the preset quality guarantee period
It is interior, then send the second prompt message；
By the food materials within the preset quality guarantee period, it is to remind to use that can have been subjected to the holding time limit in food materials
Family prevents from influencing edible due to expired.The mode of second prompt message includes but not limited to, short massage notice, PUSH message, sound
Sound prompting etc..
For example, obtain the apple in the refrigerator according to the direction of action increases to 3 from 2,1 pear is also reduced
After son, it can further judge whether the pear taken out from refrigerator closes on preset 7 day quality guarantee period, if from refrigerator
The pear taken out has housed 8 days, has been over the quality guarantee period, then can be carried by way of being pushed in terminal message
User's pear of waking up, which is had been placed in refrigerator, to be housed 8 days, has had been subjected to the preset holding time limit.
In the state management module 30 of the embodiment of the present application, it is additionally operable to be judged whether to the ice according to the prompt message
Increase food materials in case；
Increase food materials to include but not limited to, increase the quantity of food materials, the type of food materials, food materials space density etc..
In the state management module 30 of the embodiment of the present application, it is additionally operable to if it is determined that increase food materials into the refrigerator,
Then reconfigure the quality guarantee period of the food materials.
Whenever judging to increase food materials newly into refrigerator, need that user is reminded to reset the corresponding retention period of the food materials
Limit.In addition, whenever judging to take out food materials from refrigerator, also to judge food materials storage quality guarantee period whether have exceeded it is default
Quality guarantee period.
As preferred in above-described embodiment, the expired prompting for food materials, foundation is looked into according to the data of background server
It askes result and judges the food materials whether within the preset quality guarantee period, while the intelligence that can also and be connect with food materials managing device
Whether food materials described in simultaneous display are within the preset quality guarantee period on mobile terminal.Preferably, when user is close to refrigerator or use
When family triggering is mounted on the voice reminder switch in food materials managing device, the voice playing module on fore device provides food materials
Expired voice reminder.In addition, if being judged as increasing food materials into the refrigerator, then can again be set by food materials managing device
Put the quality guarantee period of food materials.
Food materials managing device further includes：Voice supplementary module, if identification module 20 judges that described image information is corresponding
Whether the first food materials information can recognize that；If the corresponding first food materials information of described image information not can recognize that, increase by second
Food materials information.If can not directly judge corresponding first food materials information according to image information, need to carry out auxiliary knowledge
Not.Can not judge corresponding first food materials information may be acquisition image None- identified, acquisition image in there is no mesh
It identifies in other object or the image of acquisition due to influences such as pixels, object recognition rate is caused to reduce.First food materials information can be
Image information.
If the voice supplementary module for image information None- identified, increases the second food materials information, the second food materials
Information can be with voice messaging.And the first food materials described in the second food materials information correction in voice supplementary module are believed
Breath.
Image information is corrected by voice messaging, so as to improve the accuracy rate of food materials identification.For example, using refrigerator as
Example, after user is put into food materials into refrigerator, when food materials managing device or coupled background server None- identified, then
Food materials classification is inputted by user speech, judges whether the food materials information matches with user speech input, background server
Recognition result will take this as the standard, the image information that food materials voice messagings corrects the food materials is inputted by the user speech,
So as to which the technology to original artificial intelligence identification food materials carries out supplement correction.
The foregoing is merely the preferred embodiments of the application, are not limited to the application, for the skill of this field
For art personnel, the application can have various modifications and variations.It is all within spirit herein and principle, made any repair
Change, equivalent replacement, improvement etc., should be included within the protection domain of the application.
Claims (10)
1. a kind of food materials managing device, which is characterized in that the food materials managing device is installed on refrigerator for detachable,
The food materials managing device includes：
Door sensor inductor, for detecting the refrigerator door state of refrigerator；
Detector, for detecting the disengaging action event of the refrigerator；
Imaging sensor, for according to the refrigerator doors state acquisition image information；
Processor, for obtaining food materials change information in the refrigerator after determining the direction of action of the disengaging action event；
And the corresponding food materials information of identification described image information.
2. food materials managing device according to claim 1, which is characterized in that the processor includes：First processing units,
Second processing unit and third processing unit,
The first processing units, for obtaining the first image information in locally pretreatment and sending described first image information
To distal end；
The second processing unit, for identifying described first image information in distal end；
The third processing unit, in the direction of action for locally determining disengaging action event.
3. a kind of food management method, which is characterized in that be used to implement the detachable food materials management for being installed on refrigerator
The function of device, the method includes：
Detect the refrigerator door state of refrigerator and the disengaging action event of the refrigerator；
According to the refrigerator doors state acquisition image information；
Identify the corresponding food materials information of described image information；
Determine the direction of action of the disengaging action event；And
Food materials change information in the refrigerator is obtained according to the direction of action；
Wherein, it detects the refrigerator door state of the refrigerator and the disengaging action event of the refrigerator includes：
Obtain the refrigerator doors first state of the refrigerator；
Moving object is detected in the refrigerator doors first state；
Obtain the second state of refrigerator doors of the refrigerator；And
Terminate to detect in second state of refrigerator doors.
4. management method according to claim 3, which is characterized in that described image information is identified according to described image information
Corresponding food materials information includes：
Judge whether there is object in described image information；
If having object in described image information, the coordinate position of the object is detected；
Judge the coordinate position whether in the preset range of described image information；And
If the coordinate position in the preset range of described image information, matches food materials corresponding with the object
Information.
5. management method according to claim 3, which is characterized in that according to the disengaging action event, determine action side
To；The food materials change information in the refrigerator is obtained according to the direction of action to include：
Judge whether the disengaging action event is the first action event into the refrigerator；
First direction of action is obtained according to first action event；
The first food materials change information into the refrigerator is determined by the first direction of action；
Judge whether the disengaging action event is the second action event taken out from the refrigerator；
Second direction of action is obtained according to second action event；And
By second the second food materials change information taken out from the refrigerator is determined as direction；
Wherein, the first food materials change information and the second food materials change information include：
The food materials detected in the first food materials change information are accelerated；
The food materials are accelerated as the first food materials change information；
The middle food materials for detecting the second food materials change information reduce quantity；
It is the second food materials change information that the food materials, which reduce quantity,.
6. management method according to claim 3, which is characterized in that obtained in the refrigerator according to the direction of action
After food materials change information, further include：
Judge the food materials whether within the preset quality guarantee period；
If the food materials close on the preset quality guarantee period, the first prompt message is sent；
If the food materials send the second prompt message within the preset quality guarantee period；
Judged whether to increase food materials into the refrigerator according to the prompt message；And
If it is determined that increasing food materials into the refrigerator, then the quality guarantee period of the food materials is reconfigured.
7. management method according to claim 3, which is characterized in that described image information is identified according to described image information
Before corresponding food materials information, further include：
Judge whether the corresponding first food materials information of described image information can recognize that；
If the corresponding first food materials information of described image information not can recognize that, increase by the second food materials information；
The first food materials information according to the second food materials information correction；
Wherein, the first food materials information is image information, and the second food materials information is voice messaging.
8. a kind of food materials managing device, which is characterized in that including：Detection module, identification module, state management module,
The detection module, for detecting the disengaging action event of the refrigerator door state of the refrigerator and the refrigerator, wherein, inspection
The disengaging action event for surveying the refrigerator door state and the refrigerator includes：Obtain the refrigerator doors first state；In the ice
Moving object is detected during chamber door first state；Obtain second state of refrigerator doors；And in second state of refrigerator doors
Terminate detection；
The identification module, for according to the refrigerator doors state acquisition image information；And determine the disengaging action event
Direction of action；
The state management module, for identifying the corresponding food materials information of described image information according to described image information；And
Food materials change information in the refrigerator is obtained according to the direction of action.
9. food materials managing device according to claim 8, which is characterized in that the state management module is additionally operable to,
Judge whether there is object in described image information；
If having object in described image information, the coordinate position of the object is detected；
Judge the coordinate position whether in the preset range of described image information；And
If the coordinate position in the preset range of described image information, matches food materials corresponding with the object
Information.
10. food materials managing device according to claim 8, which is characterized in that the state management module is additionally operable to,
Judge whether the disengaging action event is the first action event into the refrigerator；
First direction of action is obtained according to first action event；
The first food materials change information into the refrigerator is determined by the first direction of action；
Judge whether the disengaging action event is the second action event taken out from the refrigerator；
Second direction of action is obtained according to second action event；And
By second the second food materials change information taken out from the refrigerator is determined as direction；
Wherein, the first food materials change information and the second food materials change information include：
The food materials detected in the first food materials change information are accelerated；
The food materials are accelerated as the first food materials change information；
The middle food materials for detecting the second food materials change information reduce quantity；
It is the second food materials change information that the food materials, which reduce quantity,.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711160013.5A CN108154078A (en) | 2017-11-20 | 2017-11-20 | Food materials managing device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711160013.5A CN108154078A (en) | 2017-11-20 | 2017-11-20 | Food materials managing device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108154078A true CN108154078A (en) | 2018-06-12 |
Family
ID=62468774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711160013.5A Pending CN108154078A (en) | 2017-11-20 | 2017-11-20 | Food materials managing device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108154078A (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108895756A (en) * | 2018-06-29 | 2018-11-27 | 青岛海尔股份有限公司 | The method and apparatus of the calorie value of displaying food for refrigerator |
| CN108981277A (en) * | 2018-06-29 | 2018-12-11 | 青岛海尔股份有限公司 | The method and apparatus of modification beverage shelf-life for refrigerator |
| CN109114877A (en) * | 2018-08-13 | 2019-01-01 | 长虹美菱股份有限公司 | A kind of food management system based on refrigerator Dynamic Recognition |
| CN109726685A (en) * | 2018-12-29 | 2019-05-07 | 珠海优特智厨科技有限公司 | A kind of detection food materials launch the method, apparatus and cooking equipment of state |
| CN110619266A (en) * | 2019-08-02 | 2019-12-27 | 青岛海尔智能技术研发有限公司 | Target identification method and device and refrigerator |
| CN110689560A (en) * | 2019-10-11 | 2020-01-14 | 海信集团有限公司 | Food material management method and equipment |
| CN110779258A (en) * | 2018-07-26 | 2020-02-11 | 夏普株式会社 | Refrigerator with a door |
| CN111473589A (en) * | 2020-04-23 | 2020-07-31 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| CN111488831A (en) * | 2020-04-10 | 2020-08-04 | 海信集团有限公司 | Food association identification method and refrigerator |
| CN111524189A (en) * | 2020-05-09 | 2020-08-11 | 浙江大华技术股份有限公司 | Door opening and closing state detection method and device and computer storage medium |
| CN111767759A (en) * | 2019-04-01 | 2020-10-13 | 青岛海尔智能技术研发有限公司 | System, method, device and storage medium for food material identification |
| CN112066637A (en) * | 2020-09-10 | 2020-12-11 | 合肥美的电冰箱有限公司 | Management device and method, storage cabinet, processor, electronic device, and storage medium |
| CN112484387A (en) * | 2019-09-12 | 2021-03-12 | 海信（山东）冰箱有限公司 | Food material management method and device and food material storage equipment |
| CN112541940A (en) * | 2019-09-20 | 2021-03-23 | 杭州海康威视数字技术股份有限公司 | Article detection method and system |
| CN113124633A (en) * | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Refrigerator with a door |
| CN113124593A (en) * | 2019-12-31 | 2021-07-16 | 青岛海尔特种电冰柜有限公司 | Refrigerating apparatus and control method thereof |
| CN113139402A (en) * | 2020-01-17 | 2021-07-20 | 海信集团有限公司 | A kind of refrigerator |
| CN113465264A (en) * | 2020-04-26 | 2021-10-01 | 海信集团有限公司 | Intelligent refrigerator and food material management method |
| CN113465287A (en) * | 2020-07-14 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Intelligent refrigerator and illumination intensity adjusting method |
| CN113494804A (en) * | 2020-03-20 | 2021-10-12 | 海信集团有限公司 | Refrigerator with a door |
| CN113992744A (en) * | 2021-09-26 | 2022-01-28 | 青岛海尔科技有限公司 | Message pushing method and device, storage medium and electronic device |
| CN114087823A (en) * | 2020-08-24 | 2022-02-25 | 青岛海尔电冰箱有限公司 | Refrigerating and freezing device |
| CN114322409A (en) * | 2021-06-23 | 2022-04-12 | 海信视像科技股份有限公司 | Refrigerator and storage room interior picture display method |
| CN114857853A (en) * | 2021-08-05 | 2022-08-05 | 青岛海尔电冰箱有限公司 | Refrigeration equipment, image processing method and device |
| CN115077156A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN115773608A (en) * | 2021-09-06 | 2023-03-10 | 海信集团控股股份有限公司 | Intelligent refrigerator |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105491147A (en) * | 2015-12-21 | 2016-04-13 | 美的集团股份有限公司 | Refrigerator food material fresh-keeping prompting method, system, refrigerator and cloud server |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106907890A (en) * | 2017-02-23 | 2017-06-30 | 海信（山东）冰箱有限公司 | The food management method and intelligent refrigerator of a kind of intelligent refrigerator |
-
2017
- 2017-11-20 CN CN201711160013.5A patent/CN108154078A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN105491147A (en) * | 2015-12-21 | 2016-04-13 | 美的集团股份有限公司 | Refrigerator food material fresh-keeping prompting method, system, refrigerator and cloud server |
| CN106907890A (en) * | 2017-02-23 | 2017-06-30 | 海信（山东）冰箱有限公司 | The food management method and intelligent refrigerator of a kind of intelligent refrigerator |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108981277A (en) * | 2018-06-29 | 2018-12-11 | 青岛海尔股份有限公司 | The method and apparatus of modification beverage shelf-life for refrigerator |
| CN108981277B (en) * | 2018-06-29 | 2021-07-23 | 海尔智家股份有限公司 | Method and apparatus for modifying beverage shelf life for a refrigerator |
| CN108895756B (en) * | 2018-06-29 | 2020-11-20 | 海尔智家股份有限公司 | Method and apparatus for displaying caloric value of food for refrigerator |
| CN108895756A (en) * | 2018-06-29 | 2018-11-27 | 青岛海尔股份有限公司 | The method and apparatus of the calorie value of displaying food for refrigerator |
| CN110779258B (en) * | 2018-07-26 | 2022-02-01 | 夏普株式会社 | Refrigerator with a door |
| CN110779258A (en) * | 2018-07-26 | 2020-02-11 | 夏普株式会社 | Refrigerator with a door |
| CN109114877A (en) * | 2018-08-13 | 2019-01-01 | 长虹美菱股份有限公司 | A kind of food management system based on refrigerator Dynamic Recognition |
| CN109726685A (en) * | 2018-12-29 | 2019-05-07 | 珠海优特智厨科技有限公司 | A kind of detection food materials launch the method, apparatus and cooking equipment of state |
| CN111767759A (en) * | 2019-04-01 | 2020-10-13 | 青岛海尔智能技术研发有限公司 | System, method, device and storage medium for food material identification |
| CN110619266B (en) * | 2019-08-02 | 2024-01-19 | 青岛海尔智能技术研发有限公司 | Target object identification method and device and refrigerator |
| CN110619266A (en) * | 2019-08-02 | 2019-12-27 | 青岛海尔智能技术研发有限公司 | Target identification method and device and refrigerator |
| CN112484387A (en) * | 2019-09-12 | 2021-03-12 | 海信（山东）冰箱有限公司 | Food material management method and device and food material storage equipment |
| CN112541940B (en) * | 2019-09-20 | 2023-09-05 | 杭州海康威视数字技术股份有限公司 | Article detection method and system |
| CN112541940A (en) * | 2019-09-20 | 2021-03-23 | 杭州海康威视数字技术股份有限公司 | Article detection method and system |
| CN110689560B (en) * | 2019-10-11 | 2022-06-07 | 海信集团有限公司 | Food material management method and equipment |
| CN110689560A (en) * | 2019-10-11 | 2020-01-14 | 海信集团有限公司 | Food material management method and equipment |
| CN113124593B (en) * | 2019-12-31 | 2024-01-12 | 青岛海尔特种电冰柜有限公司 | Refrigerating device and control method thereof |
| CN113124633A (en) * | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Refrigerator with a door |
| CN113124593A (en) * | 2019-12-31 | 2021-07-16 | 青岛海尔特种电冰柜有限公司 | Refrigerating apparatus and control method thereof |
| CN113139402A (en) * | 2020-01-17 | 2021-07-20 | 海信集团有限公司 | A kind of refrigerator |
| CN113139402B (en) * | 2020-01-17 | 2023-01-20 | 海信集团有限公司 | A kind of refrigerator |
| CN113494804A (en) * | 2020-03-20 | 2021-10-12 | 海信集团有限公司 | Refrigerator with a door |
| CN111488831B (en) * | 2020-04-10 | 2023-11-03 | 海信集团有限公司 | Food association identification method and refrigerator |
| CN111488831A (en) * | 2020-04-10 | 2020-08-04 | 海信集团有限公司 | Food association identification method and refrigerator |
| CN111473589A (en) * | 2020-04-23 | 2020-07-31 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| CN111473589B (en) * | 2020-04-23 | 2021-06-01 | 海信集团有限公司 | Intelligent refrigerator and cross-media interaction method |
| CN113465264A (en) * | 2020-04-26 | 2021-10-01 | 海信集团有限公司 | Intelligent refrigerator and food material management method |
| CN111524189A (en) * | 2020-05-09 | 2020-08-11 | 浙江大华技术股份有限公司 | Door opening and closing state detection method and device and computer storage medium |
| CN113465287A (en) * | 2020-07-14 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Intelligent refrigerator and illumination intensity adjusting method |
| CN114087823B (en) * | 2020-08-24 | 2022-08-23 | 青岛海尔电冰箱有限公司 | Refrigerating and freezing device |
| CN114087823A (en) * | 2020-08-24 | 2022-02-25 | 青岛海尔电冰箱有限公司 | Refrigerating and freezing device |
| CN112066637A (en) * | 2020-09-10 | 2020-12-11 | 合肥美的电冰箱有限公司 | Management device and method, storage cabinet, processor, electronic device, and storage medium |
| CN115077156A (en) * | 2021-03-10 | 2022-09-20 | 松下电器研究开发(苏州)有限公司 | Refrigerator and intelligent refrigerator system |
| CN114322409A (en) * | 2021-06-23 | 2022-04-12 | 海信视像科技股份有限公司 | Refrigerator and storage room interior picture display method |
| CN114322409B (en) * | 2021-06-23 | 2023-09-19 | 海信视像科技股份有限公司 | Refrigerator and method for displaying indoor scenery pictures |
| CN114857853A (en) * | 2021-08-05 | 2022-08-05 | 青岛海尔电冰箱有限公司 | Refrigeration equipment, image processing method and device |
| CN115773608A (en) * | 2021-09-06 | 2023-03-10 | 海信集团控股股份有限公司 | Intelligent refrigerator |
| CN113992744A (en) * | 2021-09-26 | 2022-01-28 | 青岛海尔科技有限公司 | Message pushing method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108154078A (en) | Food materials managing device and method | |
| CN111104910B (en) | Garbage delivery behavior supervision method and related products | |
| CN106020227B (en) | The control method of unmanned plane, device | |
| CN107770438B (en) | A kind of photographic method and mobile terminal | |
| CN109241933A (en) | Video linkage monitoring method, monitoring server, video linkage monitoring system | |
| CN108540724A (en) | A kind of image pickup method and mobile terminal | |
| CN107707825B (en) | A kind of panorama shooting method, mobile terminal and computer readable storage medium | |
| CN107404617A (en) | A kind of image pickup method and terminal, computer-readable storage medium | |
| CN109639969A (en) | A kind of image processing method, terminal and server | |
| CN108848294A (en) | A kind of shooting parameter adjustment method, terminal and computer readable storage medium | |
| CN106911914A (en) | Infrared thermal imaging animal activity tracing system | |
| CN107948360A (en) | Image pickup method, terminal and the computer-readable recording medium of flexible screen terminal | |
| CN207166656U (en) | Towards the supervising device of unmanned invigilator | |
| CN108833709A (en) | A kind of the starting method and mobile terminal of camera | |
| CN109525782A (en) | A kind of image pickup method, terminal and computer readable storage medium | |
| CN106664519A (en) | Determining a context-dependent virtual distance using measurements of stigmergic interference | |
| CN106845738A (en) | Crowd's number method for pushing and device | |
| CN108848309A (en) | A kind of camera programm starting method and mobile terminal | |
| CN107808691A (en) | A kind of intelligent CT data diagnosis system | |
| CN109525783A (en) | A kind of exposure image pickup method, terminal and computer readable storage medium | |
| CN110047249A (en) | Human body attitude identification sensor, human posture recognition method and system | |
| CN108965589A (en) | A kind of screen brightness control method, terminal and computer readable storage medium | |
| CN109246351A (en) | A kind of patterning process and terminal device | |
| CN110472458A (en) | A kind of unmanned shop order management method and system | |
| CN107995417A (en) | A kind of method taken pictures and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190219 Address after: 266101 Haier Road, Laoshan District, Qingdao, Qingdao, Shandong Province, No. 1 Applicant after: QINGDAO HAIER SMART TECHNOLOGY R&D Co.,Ltd. Address before: 3rd floor, No. 19 Building, 498 Guoshoujing Road, Pudong New Area Free Trade Pilot Area, Shanghai, 200120 Applicant before: AITULING (SHANGHAI) INFORMATION TECHNOLOGY CO.,LTD. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180612 |