CN106642981A - Refrigerator stored article management system based on image recognition - Google Patents
Refrigerator stored article management system based on image recognition Download PDFInfo
- Publication number
- CN106642981A CN106642981A CN201710056579.7A CN201710056579A CN106642981A CN 106642981 A CN106642981 A CN 106642981A CN 201710056579 A CN201710056579 A CN 201710056579A CN 106642981 A CN106642981 A CN 106642981A
- Authority
- CN
- China
- Prior art keywords
- camera
- refrigerator
- receiving material
- management system
- chamber door
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D23/00—General constructional features
- F25D23/02—Doors; Covers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2700/00—Means for sensing or measuring; Sensors therefor
- F25D2700/06—Sensors detecting the presence of a product
Abstract
The invention belongs to the field of intelligent household electrical appliances and particularly provides a refrigerator stored article management system based on image recognition. The refrigerator stored article management system aims at solving the problem that existing refrigerator management systems cannot manage articles stored in refrigerators well. The refrigerator stored article management system based on image recognition comprises an image acquisition device, an angle sensor and a master control module. The image acquisition device comprises a first camera and a second camera, wherein the first camera is arranged on a refrigerator door, and the second camera is arranged on a refrigerator body. The angle sensor is arranged on a rotating shaft used for connecting the refrigerator door with the refrigerator body and can detect the pivoted rotation angle, relative to the refrigerator body, of the refrigerator door. The master control module communicates with the first camera, the second camera and the angle sensor and can control the pivoted rotation angle of the first camera and the pivoted rotation angle of the second camera according to angle information detected by the angle sensor, and thus images of the articles stored in a refrigerator can be acquired in the optimum distance and at the optimum angle.
Description
Technical field
The invention belongs to intelligent appliance field, specifically provides a kind of refrigerator receiving material management system based on image recognition.
Background technology
Internet of Things is the important component part of generation information technology, is also the important development stage in " informationization " epoch,
Internet of Things is even known as the third wave of the world information industry development after computer, internet.In recent years, with
The progressively rise of Internet of Things concept, household electric appliances also move towards rapidly therewith the direction of intelligent development, many traditional home appliance enterprises
Industry is all added to one after another the ranks of smart home exploitation.Since rising from smart home, number of types of intelligence has been occurred in that on the market
Energy household, wherein, same kind of smart home has polytype intelligence system, for example, the management system of intelligent refrigerator again
System just has polytype.
At present, on the market with various intelligent refrigerators for being provided with image collecting function, in the chamber door of such intelligent refrigerator
Side is provided with camera, and the camera can complete the IMAQ to chamber door and casing in the state of chamber door is closed.But
It is that, when the chamber door of intelligent refrigerator is closed, the camera being arranged on the inside of chamber door is too small with the distance between casing, now, takes the photograph
As head cannot intactly collect the image information of all memory spaces in intelligent refrigerator.Therefore, such intelligent refrigerator is in reality
Consumer's Experience during the use of border is not very good.Additionally, being also provided with radio frequency recognition function with some on the market
Intelligent refrigerator, but during actually used, such intelligent refrigerator can not sufficiently accurately recognize each receiving material
Bar code or label information, cause such intelligent refrigerator well to manage the receiving material of refrigerator memory storage.
Correspondingly, this area needs a kind of new above-mentioned asking to be solved based on the refrigerator receiving material management system of image recognition
Topic.
The content of the invention
In order to solve the problems referred to above of the prior art, being the management system of solution current refrigerator can not manage well
The problem of the receiving material of storage in reason refrigerator, the invention provides a kind of refrigerator receiving material management system based on image recognition,
The refrigerator includes chamber door, casing and the rotating shaft for connecting the chamber door and the casing, it is characterised in that the receiving
Thing management system includes image collecting device and angular transducer, and described image harvester includes being arranged on the chamber door
First camera, the angular transducer is arranged in the rotating shaft, for detecting pivot of the chamber door relative to the casing
Gyration, first camera can be pivoted with the change of the pivoting angle relative to the chamber door, so as to the case
The entrance of body keeps alignment simultaneously therefore to gather the image information of the receiving material in the casing.
It will be appreciated to those of skill in the art that the opening angle of chamber door is detected due to being provided with angular transducer,
And the camera on chamber door is arranged to (pivot/shoot) with angular transducer linkage, the refrigerator receiving material management system of the present invention
System can be shot with best angle and distance when chamber door is opened to the receiving material in refrigerator, it is to avoid prior art raising middle flask
Camera and receiving material hypotelorism when door is closed and cannot effectively gather the problem of image information.Additionally, above-mentioned " alignment "
Mean, the coverage of the first camera can cover the whole entrance of casing.Preferably, when the first camera and casing
Entrance be aligned when, the plane that the first camera is located with tank inlet is substantially vertical, so can farthest photograph
Receiving material in refrigerator.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, described image collection dress
The second camera for also including being arranged on the casing is put, the second camera can be with the change phase of the pivoting angle
For the casing is pivoted, the receiving material on the inside of the chamber door is gathered to be aligned with the holding of the inner surface of the chamber door and therefore
Image information.
Similarly, it is of the invention because the camera on casing is also configured to (pivot/shoot) with angular transducer linkage
Refrigerator receiving material management system can be shot with best angle and distance when chamber door is opened to the receiving material on the inside of chamber door,
Solve the technical problem that prior art cannot be shot to chamber door inner side receiving material.When with above-mentioned chamber door on first
When camera is used in combination, the comprehensive shooting to all receiving materials at each position in refrigerator can be realized.Additionally, above-mentioned " right
It is accurate " mean, the coverage of second camera can cover the whole inner surface of chamber door.Preferably, when the second shooting
When head is aligned with the inner surface of chamber door, second camera is substantially vertical with chamber door inner surface, so can farthest shoot
Receiving material on the inside of chamber door.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, the receiving material management
System also includes main control module, the main control module and first camera, the second camera and the angle sensor
Device is connected, the angle information that the main control module can be detected according to the angular transducer control first camera and
The pivoting angle of the second camera.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, first camera
The remote of the casing is arranged on installed in the side away from the rotating shaft of the chamber door, and/or the second camera
From the side of the rotating shaft.
It will be appreciated to those of skill in the art that when the first camera be arranged on chamber door away from rotating shaft side when,
If user opens refrigerator doors, the first camera will pull open certain distance with the receiving material in casing, especially when chamber door is opened
During to about 60 degree, the first camera is right up to optimal shooting distance, simultaneously as the effect of main control module, even if in case
In the case that door turns over certain angle, the first camera also can keep all the time being aligned with the surface of tank inlet, therefore, it is possible to
Optimum distance is shot with best angle.It is similar with the first camera, when second camera installed in casing away from rotating shaft
Side when, if user opens refrigerator doors, second camera will pull open certain distance, especially work as case with the inner surface of chamber door
When door is opened to about 60 degree, optimal shooting distance is right up between second camera and chamber door inner surface, simultaneously as main
Control module effect, even if in the case where chamber door turns over certain angle, second camera also can all the time with the table of tank inlet
Face keeps alignment, therefore, it is possible to be shot with best angle in optimum distance.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, when the angle sensor
Device detects the chamber door when opening to 60 ° relative to the casing, and the first camera described in the master control module controls is relative
60 ° are pivoted in the chamber door and taken pictures, while control the second camera and pivoting 60 ° relative to the casing and clapping
According to；Or when the angular transducer detects the chamber door and pivots relative to the casing, the master control module controls institute
Dynamic is pivoted with the angle change between the chamber door and the casing to state the first camera and the second camera, so as to
Make first camera keep being aligned with the entrance of the casing, and make the interior table of the second camera and the chamber door
Face keeps alignment, and when the angular transducer detects the chamber door and opens to 60 ° relative to the casing, the master
Control module controls first camera and the second camera is taken pictures.
It will be appreciated to those of skill in the art that this providing the mould of two kinds of cameras and angular transducer linkage
Formula, in the first mode, until chamber door is opened to 60 ° relative to casing, camera is just rotated under the control of main control module
60 ° and shot, before this, even if chamber door is rotated, camera is not also rotated.In the second mode, once chamber door phase
For casing start rotate, camera will rotate with the rotation of chamber door under the control of main control module so that camera with
Target shooting area remains substantially vertical, and camera is just triggered and starts to shoot when chamber door and casing are into 60 ° of angles.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, the receiving material management
System also includes the light sensor being arranged on the refrigerator and the Lighting control for controlling the illuminating lamp on the refrigerator
Module, when first camera and second camera collection image, the lighting control module can be according to described
The monochrome information that light sensor is detected selectively turns on the illuminating lamp, so as to first camera and described second
Camera can collect apparent image.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, the receiving material management
System also includes temperature control modules, the image information that the main control module can be collected according to described image harvester come
Judge receiving material type, the temperature control modules can according to the receiving material Type Control refrigerator operating temperature.
When receiving material type is judged, main control module can hold the object image that accommodates for collecting with the standard for prestoring
Object image of receiving carries out aspect ratio pair, and when the matching degree of the two reaches certain threshold value, determines the receiving of the collected image
The type of thing.On this basis, temperature control modules can be adjusted to the operating temperature of refrigerator most according to the receiving material type
It is adapted to the receiving material refrigeration or the scope for freezing.As can be seen here, this set causes the refrigerator receiving material management system of the present invention
The automatic management of receiving material only just can be realized by image taking, with extraordinary Consumer's Experience.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, first camera
And/or heating plate is provided with the second camera, the heating plate can heat first camera and/or described
The eyeglass of two cameras, so as to demisting and defrosting.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, first camera
And/or the second camera is wide-angle high speed camera.
In the above-mentioned optimal technical scheme based on the refrigerator receiving material management system of image recognition, the receiving material management
System also includes the background server with main control module networking, and user can check the main control module by mobile terminal
And/or the information in the background server and the receiving material in the refrigerator is managed accordingly；And the main control module and/or
The background server can recognize the receiving material in the refrigerator according to the image information that described image harvester is collected,
And record the receiving material in the refrigerator takes out and be put into information, and forms receiving material information list, while by described
The receiving material information list is supplied to user by mobile terminal, so that user can check and manage the receiving material information row
Information in table.
It will be appreciated to those of skill in the art that in the inventive solutions, the refrigerator based on image recognition holds
Thing management system of receiving includes image collecting device, angular transducer and main control module, and described image harvester includes being arranged on
The first camera on chamber door is arranged on for connecting chamber door with the second camera being arranged on casing, the angular transducer
In the rotating shaft of casing, main control module is connected with the first camera, second camera and angular transducer, and can be according to angle
The angle information that detects of degree sensor controls the pivoting angle of the first camera and second camera, so as to the first camera/
The inner surface of second camera and the entrance/chamber door of casing keeps be directed at, and therefore preferably vasculum body it is interior/chamber door in appearance
Receive the image information of thing.The refrigerator receiving material management system also includes temperature control modules, and main control module can be according to image
Judging receiving material type, temperature control modules being capable of basis for the image information of the receiving material in the refrigerator that harvester is collected
The operating temperature of refrigerator is adjusted to optimal values by the receiving material type in refrigerator.In addition, user can be looked into by mobile terminal
See main control module and/or with main control module networking background server in information, and accordingly manage refrigerator in receiving material.
Description of the drawings
Fig. 1 is the signal with the refrigerator being used in combination based on the refrigerator receiving material management system of image recognition of the present invention
Figure.
Fig. 2 is the System Control Figure of the refrigerator receiving material management system based on image recognition of the present invention.
Specific embodiment
The preferred embodiment of the present invention is described with reference to the accompanying drawings and with reference to food materials management system.People in the art
Member is it should be appreciated that these embodiments are used only for explaining the know-why of the present invention, it is not intended that limit the present invention's
Protection domain.Those skilled in the art can make adjustment as needed to it, to adapt to specific application scenario.For example,
Although the management system based on image recognition described in specification is used to be managed food materials, the technology of the present invention
Scheme obviously can be also used for managing other non-food materials class refrigerator receiving materials, and the change of this application is without departing from the present invention
General principle, therefore fall within protection scope of the present invention.
It should be noted that in describing the invention, term " on ", D score, "left", "right", " interior ", " outward ", " hang down
Directly ", the direction of instruction such as " horizontal ", " vertical " or the term of position relationship are to be based on direction shown in the drawings or position relationship,
This is intended merely to facilitate description, rather than indicates or imply that described device or element must be with specific orientation, with specific
Azimuth configuration and operation, therefore be not considered as limiting the invention.Additionally, term " first ", " second " are only used for retouching
Purpose is stated, and it is not intended that indicating or implying relative importance.
In addition it is also necessary to explanation, in describing the invention, unless otherwise clearly defined and limited, term " peace
Dress ", " connected ", " connection ", " cooperation " should be interpreted broadly, for example, it may be fixedly connected, or be detachably connected,
Or be integrally connected；Can be joined directly together, it is also possible to be indirectly connected to by intermediary, can be the company of two element internals
It is logical.To those skilled in the art, above-mentioned term concrete meaning in the present invention can as the case may be understood.
As shown in figure 1, the figure is the ice being used in combination based on the refrigerator food materials management system of image recognition with the present invention
The schematic diagram of case.The refrigerator includes casing 1, chamber door 2 and the rotating shaft 5 for connecting casing 1 and chamber door 2.The base of the present invention
Include angular transducer (not showing in Fig. 1) and image collecting device, the figure in the refrigerator food materials management system of image recognition
As harvester includes the first camera 101 being arranged on chamber door 2 and the second camera 102 being arranged on casing 1.It is described
Angular transducer is arranged in rotating shaft 5, for detecting pivoting angle of the chamber door 2 relative to casing 1.First camera 101 is installed
In the inner side of chamber door 2, and installation site is arranged far from the side of rotating shaft 5.Additionally, the first camera 101 can be with the pivot
The change of angle is pivoted relative to chamber door 2, to keep be directed at the entrance of casing 1, and therefore collection casing 1 in food materials
Image information.Second camera 102 is arranged on casing 1, and installation site is arranged far from the side of rotating shaft 5, i.e. near peace
Side equipped with the first camera 101.Additionally, second camera 102 can be with the change of the pivoting angle relative to casing 1
Pivot, so as to the inner surface of chamber door 2 keep be directed at, and therefore collection chamber door 2 in food materials image information.Need explanation
Be, " alignment " both can be vertical with the inner surface holding of the entrance of casing 1 or chamber door 2, or the entrance with casing 1 or
The inner surface of chamber door 2 is into other angles, as long as the second camera 102 of the first camera 101/ can clearly collect chamber door 2/
The image of the food materials in casing 1.It will be appreciated to those of skill in the art that the first camera 101 and second camera
102 installation site is set to so that when chamber door 2 is opened to a certain extent relative to casing 1, the first camera 101/ second
Camera 102 can be shot in optimum distance with best angle such that it is able to most clearly be collected in the chamber door 1 of chamber door 2/
Food materials image information.It will be appreciated to those of skill in the art that preferably, the first camera 101 and/or second is imaged
102 is wide-angle high speed camera.
Referring next to Fig. 2, the figure is the System Control Figure of the refrigerator food materials management system based on image recognition of the present invention.
As shown in Fig. 2 except image collecting device 100 and angular transducer 6, the refrigerator food materials management system also includes main control module
10, main control module 10 is connected with image collecting device 100 and angular transducer 6, specifically, the camera of main control module 10 and first
101st, second camera 102 is connected with angular transducer 6.Angular transducer 6 can detect pivot of the chamber door 2 relative to casing 1
Angle, and in real time the data of the pivoting angle are transferred into main control module 10.Meanwhile, main control module 10 can be passed according to angle
The angle information that sensor 6 is detected controls the pivoting angle of the first camera 101 and second camera 102.In addition, the refrigerator food
Material management system also includes lighting control module 20 and the light sensor 30 being arranged on the refrigerator, lighting control module 20
The illuminating lamp 50 being arranged on for control in the refrigerator, when the first camera 101 and the collection image of second camera 102,
The ambient brightness that lighting control module 20 can be detected according to light sensor 30 selectively turns on the photograph in the refrigerator
Bright lamp 50, so that the first camera 101 and second camera 102 can collect apparent image information.Need explanation
It is, when the control image collecting device 100 of main control module 10 gathers the image information in the refrigerator, the energy of lighting control module 20
The brightness in the refrigerator is enough detected by light sensor 30.Meanwhile, when lighting control module 20 passes through light sensor 30
When detecting the brightness in the refrigerator less than certain threshold value, the illuminating lamp 50 that lighting control module 20 is controlled in the refrigerator is opened
Open, so that image collecting device 100 can collect enough clearly image informations.
With continued reference to Fig. 2, the refrigerator food materials management system also includes temperature control modules 40, and main control module 10 being capable of basis
The image information that image collecting device 100 is collected is calculated or inquired and be taken food materials most judging food materials type
Good storage temperature, so by temperature control modules 40 by the temperature setting in the refrigerator be adapted to the food materials optimal storage
Deposit temperature.In addition, being provided with heating plate on the first camera 101 and/or second camera 102, the heating plate can be heated
The eyeglass of the first camera 101 and/or second camera 102, so as to demisting and defrosting, so that the He of the first camera 101
Second camera 102 can more clearly collect the image information in the refrigerator.
Again Fig. 1 is referred to, in a preferred embodiment, when user opens the chamber door 2 of the refrigerator, angular transducer
20 by the chamber door 2 for detecting relative to casing 1 pivoting angle real-time Transmission to main control module 10.When main control module 10 passes through angle
When degree sensor 20 detects chamber door 2 and opens to 60 ° relative to casing 1, main control module 10 control the first camera 101 relative to
Chamber door 2 pivots 60 ° so that the first camera 101 keeps substantially vertical with the plane of inlet of casing 1.Meanwhile, main control module 10 is controlled
Second camera processed 102 pivots 60 ° relative to casing 1 so that second camera 102 keeps hanging down substantially with the inner surface of chamber door 2
Directly.Additionally, the brightness in the refrigerator that detected according to light sensor 30 of lighting control module 20 selectively turns on institute
State the illuminating lamp 50 in refrigerator, be arranged on the first camera 101 and/or second camera 102 on heating plate select as needed
The eyeglass of the first camera 101 and/or second camera 102 is heated to selecting property, the function of demisting and defrosting is realized.Now, it is main
The control control image collecting device 100 of module 10 gathers the image information in the refrigerator.Skilled artisans appreciate that
It is symbol relative to the moment that casing 1 pivots 60 ° in chamber door 2 by the set of time that image collecting device 100 gathers image information to be
Base of principle of human engineering is closed, specifically, because most users all can be when chamber door 2 be opened to 60 ° relative to casing 1
Food materials are taken out or are put into, therefore, the image information that image capture module 7 is gathered at the moment in the refrigerator can be increased substantially
The recognition accuracy of the food materials of turnover refrigerator.
With continued reference to Fig. 1, another preferred embodiment in, when user opens the chamber door 2 of the refrigerator, angle
Sensor 20 by detect chamber door 2 relative to casing 1 pivoting angle real-time Transmission to main control module 10, main control module 10 is controlled
Dynamic is pivoted with the angle change between chamber door 2 and casing 1 for first camera 101 and second camera 102, to make first
Camera 101 keeps being aligned (such as generallyperpendicular) with the entrance of casing 1, and makes second camera 102 interior with chamber door 2
Surface keeps alignment (such as generallyperpendicular).When angular transducer 20 detects chamber door 2 to be opened to 60 ° relative to casing 1,
First camera 101 is with chamber door 2 substantially into 30 ° (that is, having turned over 60 °), and second camera 102 is big with the inlet surface of casing 1
Cause into 30 ° (that is, having turned over 60 °), main control module 10 controls the first camera 101 and second camera 102 gathers the refrigerator
In food materials image information.Meanwhile, the ice that lighting control module 20 is optionally detected according to light sensor 30
Light intensity in case selectively turns on the illuminating lamp 50 in the refrigerator, is arranged on the first camera 101 and/or second takes the photograph
Heating plate on picture 102 heats the eyeglass of the first camera 101 and/or second camera 102, realizes the work(of demisting and defrosting
Energy.As described above, the set of time that image collecting device 100 gathers image information is pivoted into 60 ° relative to casing 1 in chamber door 2
Moment be it is ergonomical, specifically, due to most users all can by chamber door 2 equivalent to casing 1
Food materials are taken out or are put into when opening to 60 °, therefore, image capture module 7 gathers at the moment the image information energy in the refrigerator
Enough increase substantially the definition of described image information.
With continued reference to Fig. 2, the food materials management system also includes Wifi radio-frequency modules 60, and main control module 10 passes through Wifi radio frequencies
Module 60 is connected with router 70, and then is connected with mobile terminal 80, while being connected with background server 90 by Internet
It is logical so that information exchange can be realized between main control module 10, mobile terminal 80 and background server 90.Meanwhile, user can
Information in checking main control module 10 and/or background server 90 by mobile terminal 80, and manage accordingly in the refrigerator
Food materials.In addition, the image information that main control module 10 and/or background server 90 can be collected according to image collecting device 100
Recognize the food materials in the refrigerator, and record the food materials in the refrigerator take out and be put into information, and form food materials information
List, while the food materials information list is supplied to by user by mobile terminal 80, so that user can check and manage institute
State the information in food materials information list.It should be noted that between main control module 10, mobile terminal 80 and background server 90
Connected mode can also be wired connection or wireless connection, if main control module 10, mobile terminal 80 and background server 90 it
Between can realize information exchange.
It is last it should be noted that, although above with reference to food materials describing, but in technical scheme
Receiving material can also be that other need refrigeration or the article for freezing.In addition, when certain food materials in the refrigerator are taken out and are put into
Number of times when reaching certain threshold value, main control module 10 can automatically record this kind of food materials, and according to the storage feelings of this kind of food materials
Condition provides the user buying suggestion, is supplied to user to refer to while automatically Shopping List is formed in electric business.
So far, the technical scheme already in connection with Description of Drawings, but, skilled addressee readily understands that
It is that protection scope of the present invention is expressly not limited to these specific embodiments.On the premise of the principle without departing from the present invention,
Those skilled in the art can make the change or replacement of equivalent to correlation technique feature, these technologies after changing or replacing it
Scheme is fallen within protection scope of the present invention.
Claims (10)
1. a kind of refrigerator receiving material management system based on image recognition, the refrigerator includes chamber door, casing and for connecting
The rotating shaft of the chamber door and the casing,
Characterized in that, the receiving material management system includes image collecting device and angular transducer, described image collection dress
Put including the first camera being arranged on the chamber door, the angular transducer is arranged in the rotating shaft, for detecting
Pivoting angle of the chamber door relative to the casing is stated, first camera can be with the change of the pivoting angle relative to institute
Chamber door pivot is stated, to keep being directed at and therefore gather the image letter of the receiving material in the casing with the entrance of the casing
Breath.
2. the refrigerator receiving material management system based on image recognition according to claim 1, it is characterised in that described image
Harvester also includes the second camera being arranged on the casing, and the second camera can be with the pivoting angle
Change is pivoted relative to the casing, to keep being aligned with the inner surface of the chamber door, and therefore is gathered on the inside of the chamber door
Receiving material image information.
3. the refrigerator receiving material management system based on image recognition according to claim 2, it is characterised in that the receiving
Thing management system also includes main control module, the main control module and first camera, the second camera and the angle
Degree sensor connection, the main control module can be taken the photograph according to the angle information control described first that the angular transducer is detected
As head and the pivoting angle of the second camera.
4. the refrigerator receiving material management system based on image recognition according to claim 3, it is characterised in that described first
Camera is arranged on the side away from the rotating shaft of the chamber door, and/or the second camera is arranged on the case
The side away from the rotating shaft of body.
5. the refrigerator receiving material management system based on image recognition according to claim 4, it is characterised in that when the angle
When degree sensor detects the chamber door and opens to 60 ° relative to the casing, the first shooting described in the master control module controls
Head pivots 60 ° and takes pictures relative to the chamber door, while control the second camera pivots 60 ° simultaneously relative to the casing
And take pictures；Or
When the angular transducer detects the chamber door to be pivoted relative to the casing, described in the master control module controls
Dynamic is pivoted with the angle change between the chamber door and the casing for one camera and the second camera, to make
State the first camera to keep being aligned with the entrance of the casing, and the second camera is protected with the inner surface of the chamber door
Alignment is held, and when the angular transducer detects the chamber door and opens to 60 ° relative to the casing, the master control mould
Block controls first camera and the second camera is taken pictures.
6. the refrigerator receiving material management system based on image recognition according to claim 5, it is characterised in that the receiving
Thing management system also includes the light sensor being arranged on the refrigerator and the photograph for controlling the illuminating lamp on the refrigerator
Bright control module, when first camera and second camera collection image, the lighting control module being capable of root
The monochrome information detected according to the light sensor selectively turns on the illuminating lamp, so as to first camera and institute
Stating second camera can collect apparent image.
7. the refrigerator receiving material management system based on image recognition according to claim 6, it is characterised in that the receiving
Thing management system also includes temperature control modules, the image that the main control module can be collected according to described image harvester
Information judging receiving material type, the temperature control modules can according to the receiving material Type Control refrigerator work temperature
Degree.
8. the refrigerator receiving material management system based on image recognition according to claim 7, it is characterised in that described first
Be provided with heating plate on camera and/or the second camera, the heating plate can heat first camera and/or
The eyeglass of the second camera, so as to demisting and defrosting.
9. the refrigerator receiving material management system based on image recognition according to claim 8, it is characterised in that described first
Camera and/or the second camera are wide-angle high speed cameras.
10. the refrigerator receiving material management system based on image recognition according to any one of claim 1 to 9, its feature
It is that the receiving material management system also includes the background server with main control module networking, user can be by movement
Terminal check the main control module and/or the background server in information and manage the receiving material in the refrigerator accordingly；
And
The main control module and/or the background server can be known according to the image information that described image harvester is collected
Receiving material in not described refrigerator, and record receiving material in the refrigerator take out and be put into information, and form receiving material
Information list, while the receiving material information list is supplied to by user by the mobile terminal, so that user can check
With the information in the management receiving material information list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056579.7A CN106642981A (en) | 2017-01-25 | 2017-01-25 | Refrigerator stored article management system based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056579.7A CN106642981A (en) | 2017-01-25 | 2017-01-25 | Refrigerator stored article management system based on image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106642981A true CN106642981A (en) | 2017-05-10 |
Family
ID=58842447
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710056579.7A Pending CN106642981A (en) | 2017-01-25 | 2017-01-25 | Refrigerator stored article management system based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106642981A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395954A (en) * | 2017-06-12 | 2017-11-24 | 海信（山东）冰箱有限公司 | A kind of refrigerator positioning image pickup method and system |
| CN108469148A (en) * | 2018-05-31 | 2018-08-31 | 上海理工大学 | The refrigerator of intelligent inventory management |
| CN110418051A (en) * | 2018-04-28 | 2019-11-05 | 北京京东尚科信息技术有限公司 | Image processing apparatus, intelligent refrigerator and intelligent helmet for intelligent refrigerator |
| CN111031238A (en) * | 2019-11-29 | 2020-04-17 | 海尔优家智能科技（北京）有限公司 | Image acquisition method and device for image recognition and household appliance |
| CN111795972A (en) * | 2020-07-17 | 2020-10-20 | 上海撬动网络科技有限公司 | Container image acquisition method, mobile acquisition equipment and storage medium |
| CN111928571A (en) * | 2019-05-13 | 2020-11-13 | 青岛海尔智能技术研发有限公司 | System, method and device for image acquisition in refrigeration equipment and storage medium |
| CN113124593A (en) * | 2019-12-31 | 2021-07-16 | 青岛海尔特种电冰柜有限公司 | Refrigerating apparatus and control method thereof |
| CN113269208A (en) * | 2021-06-12 | 2021-08-17 | 四川虹美智能科技有限公司 | Food material identification system based on Internet of things refrigerator |
| CN113465287A (en) * | 2020-07-14 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Intelligent refrigerator and illumination intensity adjusting method |
| CN114076491A (en) * | 2020-08-17 | 2022-02-22 | 青岛海尔电冰箱有限公司 | Refrigerator, control method of refrigerator, and readable storage medium |
| CN114076433A (en) * | 2020-08-17 | 2022-02-22 | 青岛海尔电冰箱有限公司 | Refrigerator with a door |
| CN114500832A (en) * | 2021-12-31 | 2022-05-13 | 合肥美的智能科技有限公司 | Storage cabinet, image acquisition method, readable storage medium and computer program product |
| EP4020341A1 (en) | 2020-12-23 | 2022-06-29 | Red Bull GmbH | Product authenticity testing system |
| US11844443B1 (en) | 2018-10-03 | 2023-12-19 | Anthony, Inc. | Display case door with interior facing camera |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203454515U (en) * | 2013-06-17 | 2014-02-26 | 河南新飞电器有限公司 | Visual refrigerator based on imaging technology |
| CN103673495A (en) * | 2012-09-25 | 2014-03-26 | 海尔集团公司 | Refrigerating illumination device and method |
| CN104019615A (en) * | 2014-05-16 | 2014-09-03 | 上海尖顶信息技术有限公司 | Method for checking food materials in refrigerator |
| CN203908183U (en) * | 2014-06-25 | 2014-10-29 | 宁波梵科电子科技有限公司 | Refrigerator with camera shooting function |
| CN204513879U (en) * | 2015-01-31 | 2015-07-29 | 沈天如 | A kind of Intelligent visible refrigerator |
| CN105135811A (en) * | 2015-07-10 | 2015-12-09 | 合肥美的电冰箱有限公司 | Refrigerator and lighting device for refrigerator |
| CN204880958U (en) * | 2015-08-19 | 2015-12-16 | Tcl智能科技（合肥）有限公司 | Refrigerator lighting device and refrigerator |
| CN205174963U (en) * | 2015-09-11 | 2016-04-20 | 叶星雄 | Novel visual refrigerator of intelligence |
| CN105605879A (en) * | 2016-02-25 | 2016-05-25 | 合肥华凌股份有限公司 | Refrigerator and control method thereof |
| CN105758109A (en) * | 2016-04-07 | 2016-07-13 | 合肥海尔电冰箱有限公司 | Refrigerator refrigerating time control method and apparatus based on food |
| CN106091557A (en) * | 2016-06-24 | 2016-11-09 | 青岛海尔电冰箱有限公司 | A kind of antifog control method of the photographic head for refrigerator |
| CN106123475A (en) * | 2016-06-27 | 2016-11-16 | 青岛海尔特种电冰箱有限公司 | A kind of antifog control method of the photographic head for refrigerator |
| CN206817873U (en) * | 2017-01-25 | 2017-12-29 | 北京海尔云厨科技有限公司 | Refrigerator receiving material management system based on image recognition |
-
2017
- 2017-01-25 CN CN201710056579.7A patent/CN106642981A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103673495A (en) * | 2012-09-25 | 2014-03-26 | 海尔集团公司 | Refrigerating illumination device and method |
| CN203454515U (en) * | 2013-06-17 | 2014-02-26 | 河南新飞电器有限公司 | Visual refrigerator based on imaging technology |
| CN104019615A (en) * | 2014-05-16 | 2014-09-03 | 上海尖顶信息技术有限公司 | Method for checking food materials in refrigerator |
| CN203908183U (en) * | 2014-06-25 | 2014-10-29 | 宁波梵科电子科技有限公司 | Refrigerator with camera shooting function |
| CN204513879U (en) * | 2015-01-31 | 2015-07-29 | 沈天如 | A kind of Intelligent visible refrigerator |
| CN105135811A (en) * | 2015-07-10 | 2015-12-09 | 合肥美的电冰箱有限公司 | Refrigerator and lighting device for refrigerator |
| CN204880958U (en) * | 2015-08-19 | 2015-12-16 | Tcl智能科技（合肥）有限公司 | Refrigerator lighting device and refrigerator |
| CN205174963U (en) * | 2015-09-11 | 2016-04-20 | 叶星雄 | Novel visual refrigerator of intelligence |
| CN105605879A (en) * | 2016-02-25 | 2016-05-25 | 合肥华凌股份有限公司 | Refrigerator and control method thereof |
| CN105758109A (en) * | 2016-04-07 | 2016-07-13 | 合肥海尔电冰箱有限公司 | Refrigerator refrigerating time control method and apparatus based on food |
| CN106091557A (en) * | 2016-06-24 | 2016-11-09 | 青岛海尔电冰箱有限公司 | A kind of antifog control method of the photographic head for refrigerator |
| CN106123475A (en) * | 2016-06-27 | 2016-11-16 | 青岛海尔特种电冰箱有限公司 | A kind of antifog control method of the photographic head for refrigerator |
| CN206817873U (en) * | 2017-01-25 | 2017-12-29 | 北京海尔云厨科技有限公司 | Refrigerator receiving material management system based on image recognition |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395954A (en) * | 2017-06-12 | 2017-11-24 | 海信（山东）冰箱有限公司 | A kind of refrigerator positioning image pickup method and system |
| CN110418051A (en) * | 2018-04-28 | 2019-11-05 | 北京京东尚科信息技术有限公司 | Image processing apparatus, intelligent refrigerator and intelligent helmet for intelligent refrigerator |
| CN110418051B (en) * | 2018-04-28 | 2024-03-08 | 北京京东尚科信息技术有限公司 | Image processing device for intelligent refrigerator, intelligent refrigerator and intelligent helmet |
| CN108469148A (en) * | 2018-05-31 | 2018-08-31 | 上海理工大学 | The refrigerator of intelligent inventory management |
| US11844443B1 (en) | 2018-10-03 | 2023-12-19 | Anthony, Inc. | Display case door with interior facing camera |
| CN111928571A (en) * | 2019-05-13 | 2020-11-13 | 青岛海尔智能技术研发有限公司 | System, method and device for image acquisition in refrigeration equipment and storage medium |
| CN111031238A (en) * | 2019-11-29 | 2020-04-17 | 海尔优家智能科技（北京）有限公司 | Image acquisition method and device for image recognition and household appliance |
| CN111031238B (en) * | 2019-11-29 | 2021-12-28 | 海尔优家智能科技（北京）有限公司 | Image acquisition method and device for image recognition and household appliance |
| CN113124593A (en) * | 2019-12-31 | 2021-07-16 | 青岛海尔特种电冰柜有限公司 | Refrigerating apparatus and control method thereof |
| CN113124593B (en) * | 2019-12-31 | 2024-01-12 | 青岛海尔特种电冰柜有限公司 | Refrigerating device and control method thereof |
| CN113465287A (en) * | 2020-07-14 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Intelligent refrigerator and illumination intensity adjusting method |
| CN111795972A (en) * | 2020-07-17 | 2020-10-20 | 上海撬动网络科技有限公司 | Container image acquisition method, mobile acquisition equipment and storage medium |
| CN114076491A (en) * | 2020-08-17 | 2022-02-22 | 青岛海尔电冰箱有限公司 | Refrigerator, control method of refrigerator, and readable storage medium |
| CN114076491B (en) * | 2020-08-17 | 2023-10-24 | 青岛海尔电冰箱有限公司 | Refrigerator, control method of refrigerator and readable storage medium |
| CN114076433B (en) * | 2020-08-17 | 2023-11-03 | 青岛海尔电冰箱有限公司 | Refrigerator with a refrigerator body |
| CN114076433A (en) * | 2020-08-17 | 2022-02-22 | 青岛海尔电冰箱有限公司 | Refrigerator with a door |
| EP4020341A1 (en) | 2020-12-23 | 2022-06-29 | Red Bull GmbH | Product authenticity testing system |
| WO2022136639A1 (en) | 2020-12-23 | 2022-06-30 | Red Bull Gmbh | System for checking the authenticity of products |
| CN113269208A (en) * | 2021-06-12 | 2021-08-17 | 四川虹美智能科技有限公司 | Food material identification system based on Internet of things refrigerator |
| CN114500832A (en) * | 2021-12-31 | 2022-05-13 | 合肥美的智能科技有限公司 | Storage cabinet, image acquisition method, readable storage medium and computer program product |
| CN114500832B (en) * | 2021-12-31 | 2024-04-09 | 合肥美的智能科技有限公司 | Locker, image acquisition method, readable storage medium and computer program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106642981A (en) | Refrigerator stored article management system based on image recognition | |
| CN206817873U (en) | Refrigerator receiving material management system based on image recognition | |
| CN202486609U (en) | intelligent household control system | |
| US11521391B2 (en) | Refrigerator, server and method of controlling thereof | |
| US9860491B2 (en) | Refrigerator having a camera and method of operating the same based on position of a door | |
| CN108520594B (en) | Vending machine and control method thereof | |
| CN105222503B (en) | Refrigerator and its control method | |
| CN104279705B (en) | Air conditioning control method, system and air-conditioning equipment | |
| CN102621956A (en) | Intelligent household control system | |
| US10867217B1 (en) | Fusion of visual and non-visual information for training deep learning models | |
| JP4196914B2 (en) | refrigerator | |
| JP6305207B2 (en) | Refrigerator and network system | |
| CN105120226A (en) | Image collecting device and method, and refrigerator | |
| CN105180344B (en) | The control method of air conditioner and air conditioner | |
| CN104279710A (en) | Air conditioner control method, air conditioner control system and air conditioner | |
| US11493222B2 (en) | Advanced monitoring of an HVAC system | |
| CN106247561A (en) | A kind of air-conditioning and long-range control method thereof and device | |
| CN107767564A (en) | Automatic vending machine automatic defrosting system and method based on image recognition | |
| CN105783413A (en) | Method of obtaining information of articles stored in refrigerator and refrigerator | |
| CN105474618A (en) | Imaging system and imaging device | |
| CN106766019B (en) | Air conditioner defrosting control system and air conditioner defrosting control method | |
| CN104422074A (en) | Air conditioner | |
| US20200404137A1 (en) | Refrigerator and control method thereof | |
| CN104279727A (en) | Air conditioner control method, air conditioner control system and air conditioner | |
| CN104266312B (en) | Air conditioner and control method and system thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100016 Beijing Chaoyang District Jiuxianqiao Road 12 Electronic City Science and Technology Building 4 layer Applicant after: Beijing Haier cloud kitchen Technology Co., Ltd. Address before: 100016 Beijing Chaoyang District Jiuxianqiao Road 12 Electronic City Science and Technology Building 4 layer Applicant before: Beijing Tongyuan Technology Co. Ltd. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200628 Address after: No. 1, Hong Kong City Road, Jiangbei District, Chongqing City, Chongqing Applicant after: CHONGQING HAIER REFRIGERATION ELECTRIC Co.,Ltd. Address before: 100016, Beijing, Jiuxianqiao, Chaoyang District Road, No. 12, electronic city, science and technology building, 4 floor Applicant before: BEIJING HAIER LINKCOOK TECHNOLOGY Co.,Ltd. |