The content of the invention
It is contemplated that at least solving one of technical problem in correlation technique to a certain extent.
Therefore, the present invention needs to propose a kind of control method of the camera arrangement of refrigerator, the control method of the camera arrangement,
Success rate of taking pictures can be improved, energy consumption is reduced.
The present invention also proposes refrigerator, food recognition methods and identifying system.
In order to solve the above problems, the control method of the camera arrangement for the refrigerator that one aspect of the present invention is proposed, including:In inspection
After the enabling signal for measuring the refrigerator, electricity on the camera arrangement is controlled;Detect the refrigerator close the door signal it
Afterwards, control the camera arrangement take pictures and described in multi collect in refrigerator monitor area food information;And, in information
After collection terminates, electricity under the camera arrangement is controlled.
The control method of the camera arrangement of the refrigerator of the embodiment of the present invention, in the case where no enabling picks and places thing, is clapped
Be in power-down state according to device, it is electric under camera arrangement after the completion of taking pictures, so as to extend camera arrangement service life and
Energy consumption is reduced, and is picking and placeing camera arrangement multi collect food information after food is closed the door, i.e., is repeatedly taken pictures, raising is taken pictures
Success rate.
In some embodiments of the invention, the camera arrangement includes monitoring the multiple of different zones in the refrigerator and adopted
Collect unit, control the camera arrangement taken pictures and multi collect described in refrigerator the food information of monitor area include:According to
The multiple collecting unit of secondary control starts;And, the food of each collecting unit multi collect correspondence monitor area is controlled respectively
Product information, starts, can reduce energy consumption simultaneously compared to multiple collecting units.
In some embodiments of the invention, the refrigerator includes light servicing unit, and the control method also includes:Root
According to the monitor area and the distance of the light servicing unit of the collecting unit in information gathering state, the light is adjusted auxiliary
The intensity of light of device is helped, it is thus possible to obtain the food image become apparent from.
In some embodiments of the invention, after signal of closing the door is detected, in addition to:Calculate from detecting described open
The time interval that gate signal is closed the door described between signal;When the time interval reaches the first preset time, control is described
Camera arrangement carries out information gathering;Or, when the time interval is less than first preset time, dress of being taken pictures described in control
Holding holding state is put, the interference of abnormal conditions can be avoided.
In some embodiments of the invention, the control method also includes:If taken pictures in the camera arrangement
The enabling signal is detected, controls the camera arrangement to terminate and takes pictures and lower electricity, reduce energy consumption.
In some embodiments of the invention, after signal of closing the door is detected, the control method also includes:Detection institute
State the upstate of camera arrangement;When the camera arrangement can with when control the camera arrangement to be taken pictures.
In order to solve the above problems, the food recognition methods that another aspect of the present invention is proposed, including:Obtain taking pictures for refrigerator
Food information in the refrigerator of device collection, wherein, the camera arrangement is controlled using control method described above;And, according to
Food information carries out food identification in the refrigerator.
The food recognition methods of the embodiment of the present invention, by using the control of the camera arrangement of the refrigerator of above-mentioned aspect embodiment
Mode processed controls camera arrangement, and providing data for food identification supports.
In order to solve the above problems, the refrigerator that further aspect of the present invention is proposed, including:Camera arrangement, it is described for gathering
The food information of monitor area in refrigerator;Control device, for after enabling signal is detected, controlling on the camera arrangement
Electricity, and after signal of closing the door is detected, control the camera arrangement take pictures and food information described in multi collect, with
And, after information gathering terminates, control electricity under the camera arrangement.
The refrigerator of the embodiment of the present invention, in the case where no enabling picks and places thing, camera arrangement is in power-down state, with
And it is electric under camera arrangement after the completion of taking pictures, so as to extend the service life and reduction energy consumption of camera arrangement, and picking and placeing
Complete food controls camera arrangement multi collect food information after closing the door, i.e., repeatedly taken pictures, can improve success rate of taking pictures.
In some embodiments of the invention, the camera arrangement includes monitoring the multiple of different zones in the refrigerator and adopted
Collect unit, the control module controls the multiple collecting unit to start successively after the signal of closing the door is detected, and point
The food information of each collecting unit multi collect correspondence monitor area is not controlled, can improve success rate of taking pictures.
In some embodiments of the invention, the refrigerator also includes:Light servicing unit;Adjusting means, for basis
The monitor area of collecting unit in information gathering state and the distance of the light servicing unit, adjust the light auxiliary
The intensity of light of device, it is ensured that acquisition image clearly of taking pictures.
In some embodiments of the invention, the refrigerator also includes:Computing device, for calculating from detecting described open
The time interval that gate signal is closed the door described between signal;The control device, the time interval reach first it is default when
Between when, control the camera arrangement to be taken pictures, or, when the time interval is less than first preset time, control
The camera arrangement keeps holding state, it is to avoid the interference of abnormal conditions.
In some embodiments of the invention, the control device, the detection when the camera arrangement carries out information gathering
To the enabling signal, control the camera arrangement to terminate and take pictures and lower electricity, reduce energy consumption.
In some embodiments of the invention, the refrigerator also includes:Detection means, for detecting the letter of closing the door
After number, detect the upstate of the camera arrangement, the control device the camera arrangement can with when control the bat
Taken pictures according to device, success rate of taking pictures can be improved.
The food identifying system proposed based on the refrigerator of above-mentioned aspect, another aspect of the invention, including:Described refrigerator;
With, identification equipment, the food information for obtaining the camera arrangement collection, and according to food information progress food knowledge
Not.
The food identifying system of the embodiment of the present invention, can extend the life-span of the camera arrangement of refrigerator and reduce its work(
Consumption, it is possible to recognize food information in refrigerator.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and be not considered as limiting the invention.
The control method of the camera arrangement of refrigerator according to embodiments of the present invention is described with reference to the accompanying drawings.
Fig. 1 is the flow chart of the control method of the camera arrangement of refrigerator according to embodiments of the present invention, as shown in figure 1, should
Control method includes:
S1, after the enabling signal of refrigerator is detected, electricity on control camera arrangement.Chamber door is not turned in user to put
Before thing, camera arrangement such as camera is in power-down state, can reduce energy consumption.
S2, after the signal of closing the door of refrigerator is detected, control camera arrangement take pictures and supervised in multi collect refrigerator
Control the food information in region.
Wherein, monitor area is that camera arrangement can collect the region of image.Control camera arrangement, which repeatedly starts, takes pictures,
Obtain its can in pickup area food multiple images, once photo taking can be avoided to obtain food information well so that
Success rate of taking pictures can be improved.The scheme of installation of camera arrangement according to an embodiment of the invention is illustrated in figure 2, its
In, camera arrangement can gather the food image on its corresponding monitor area i.e. shelf of refrigerator.
In order to ensure success rate of taking pictures, in some embodiments of the invention, the state of camera arrangement is also detected, specifically
Ground, after signal of closing the door is detected, detects the upstate of camera arrangement, for example, repeatedly sending detection signal to dress of taking pictures
Put, if any return state that once receives can use, judge that camera arrangement can use.When camera arrangement can with when control take pictures
Device carries out information gathering, and repeatedly startup is taken pictures, so as to ensure success rate of taking pictures.
S3, after information gathering terminates, electricity under control camera arrangement can reduce energy consumption.
The control method of the camera arrangement of the refrigerator of the embodiment of the present invention, in the case where no enabling picks and places thing, is clapped
Be in power-down state according to device, it is electric under camera arrangement after the completion of taking pictures, so as to extend camera arrangement service life and
Energy consumption is reduced, and is picking and placeing camera arrangement multi collect food information after food is closed the door, i.e., is repeatedly taken pictures, raising is taken pictures
Success rate.
Normally, multiple food placement regions are set in refrigerator, for example, as shown in figure 3, for according to the embodiment of the present invention
For the sectional view in A-A faces in Fig. 2, wherein, multiple shelves are included in refrigerator, for placing food.In some realities of the present invention
Apply in example, camera arrangement includes multiple collecting units of different zones in monitoring refrigerator, for example, each shelf of correspondence sets one
Collecting unit such as camera, is easy to shoot the food image on correspondence glass shelf.After signal of closing the door is detected, successively
Control multiple collecting units to start, worked simultaneously compared to multiple collecting units, power consumption can be reduced, and control is each adopted respectively
Collect the food information of unit multi collect correspondence monitor area, to ensure success rate of taking pictures.For example, starting successively in correspondence refrigerator
Multiple cameras of multiple glass shelfs, each camera obtains the food on multiple collectable glass shelfs of its set location
Image, to ensure success of taking pictures.
Further, in order to ensure the image clearly taken pictures, refrigerator can also set light servicing unit, and according in
The monitor area of the collecting unit of information gathering state and the distance of light servicing unit, the light for adjusting light servicing unit are strong
Degree, it is excessively quick-fried or excessively dark with the food image for avoiding camera arrangement from gathering, become apparent from.Shown in reference picture 3, wherein, at the top of refrigerator
Illuminating lamp is installed, camera arrangement includes camera and its light compensating lamp of side, and camera shoots the picture of food on glass shelf,
In principle, how many shelf of refrigerator inside, can be correspondingly arranged how many cameras.As shown in figure 4, for according to the present invention's
The schematic diagram of the shelf glazed thread intensity distribution of the refrigerator of one embodiment.If when taking pictures, only starting the light filling of camera
Lamp, then often cause one end light of the close light compensating lamp of shelf relatively strong and one end light away from light compensating lamp is weaker, so,
The illumination intensity of illuminating lamp when taking pictures at the top of regulation simultaneously.
In addition, in some embodiments of the invention, the abnormal conditions for switch gate control camera arrangement to reduce energy
Consumption.For example, for open the door it is too short be, for example, less than 4 seconds in the case of, do not start camera arrangement.Specifically, signal of closing the door is being detected
Afterwards, calculate from enabling signal is detected to the time interval signal of closing the door;When the time interval reach first it is default when
Between when, it is believed that the food materials that user is picked and placeed in action, refrigerator have renewal, then control camera arrangement carry out information gathering, with realize
Food materials change is identified;When the time interval is less than the first preset time, it is considered as refrigerator inside food materials and does not update, then
Camera arrangement is controlled to keep holding state, to reduce power consumption.For another example not taken pictures also for the too short i.e. camera of lockup
The situation of enabling signal is completed and detected, camera is closed immediately, that is, is sayed, when camera arrangement carries out information gathering, detection
To enabling signal, the collection of control camera arrangement termination message and lower electricity can improve service life and the reduction of camera arrangement
Power consumption.
Based on foregoing description, the control method of the camera arrangement of the refrigerator of the present invention is carried out below by specific embodiment
Explanation.
Fig. 5 is the flow chart taken pictures according to the camera arrangement of the refrigerator of one embodiment of the present of invention, where it is assumed that
Refrigerator includes N layers of glass shelf, and every layer of shelf sets a camera arrangement, and N is positive integer.Wherein, each shooting is controlled successively
The food for the glass shelf that head starts to monitor it carries out IMAQ, and the bat of following process is carried out for each camera
According to.As shown in figure 5, this is taken pictures, control process includes:
S10, refrigerator control system detects enabling signal at the T1 moment.
Electricity on S11, control camera N.
S12, refrigerator control system detects signal of closing the door at the T2 moment.
S13, judges whether to meet T2-T1>Preset time such as 4 seconds, if yes then enter step S14, is otherwise considered as ice
Food materials do not update inside case, into step S17.
S14, detection camera N state.Specifically, number of times is set such as 5 times to the detection of each camera, if therebetween
Once return to state can use, that abandons not carrying out retries, otherwise continue in this circulation flow below, if all failures, jump
Go out this circulation, into the processing of next camera.
S15, control camera N takes pictures.Wherein, if there is abnormal conditions, for example, enabling signal is detected in taking pictures,
Then terminate and take pictures, it is electrically operated under camera.
S16, preserves image, uploads high in the clouds identification, and return food materials recognition result.
S17, camera N, which does not start, to take pictures.
Wherein, control electricity on camera again after enabling signal is detected, can be dropped compared to power-up state is in real time
Low energy consumption, closes the door signal and when switch gate reaches prefixed time interval, just starting can be taken pictures with camera, bat detecting
The lower electricity according to after the completion of, can extend camera life-span and reduction energy consumption, it is to avoid anomaly occurs, it is ensured that the success taken pictures
Rate.
It is the process for controlling camera to take pictures for above-mentioned steps S15, each camera is required for undergoing this process, specifically
Ground, as shown in fig. 6, being the flow chart for process of being taken pictures according to the progress of the control camera of one embodiment of the present of invention, this is taken pictures
Process includes:
S100, opens light compensating lamp.
Illuminating lamp at the top of S110, regulation.Wherein, taken pictures for the camera in first layer shelf region, the light of illuminating lamp
Line is partially dark, to prevent exposure, and the camera in second layer shelf region is taken pictures, and illuminating lamp can be with normal brightness, third layer shelf area
The camera in domain is taken pictures, and can suitably increase the light intensity of illuminating lamp, the like.
S120, control camera is taken pictures.Specifically, camera data are read, are retried twice, if once returning to state
Success, then abandon not carrying out retries, and otherwise jumps out this circulation, carries out taking pictures for next camera.
S130, closes light compensating lamp.
It is electric under S140, camera.
It can ensure to gather the definition of image by the light regulation of light servicing unit, improve success rate of taking pictures.
In short, the control method of the camera arrangement of the refrigerator of the embodiment of the present invention, is opened successively after refrigerator is closed the door
Move multiple cameras to take pictures flow, multiple cameras can be reduced while power consumption during work;Take when opening the door on camera
Electricity, detects state, is taken pictures after closing the door, and lower electric flow of taking pictures after the completion of taking pictures, can extend the camera life-span with
And lower power consumption;Head status is each imaged using repeated detection, it is ensured that camera is in upstate, and condition can be used in camera
Under, take repeatedly to start and take pictures, it is ensured that camera is taken pictures success rate;For abnormal conditions, for example, opening time is too short, then not
Start camera to take pictures, the use functional lifetime and reduction power consumption of camera can be improved;For another example lockup is too short
When, camera is not taken pictures also the situation for completing and opening the door, then closes camera immediately, improve camera service life and
Reduce power consumption.
The control method of the camera arrangement of refrigerator based on above-mentioned aspect embodiment, another aspect of the present invention embodiment is proposed
A kind of food recognition methods.
Fig. 7 is the flow chart of food recognition methods according to embodiments of the present invention, wherein, refrigerator includes being used to gather refrigerator
The camera arrangement of interior food information, as shown in fig. 7, the food recognition methods includes:
Food information in S1000, the refrigerator for the camera arrangement collection for obtaining refrigerator, wherein, using above-mentioned aspect embodiment
Refrigerator camera arrangement control method come control camera arrangement carry out information gathering, to obtain food information in refrigerator, enter
And, food information can be sent to identification equipment such as server or mobile terminal, server or mobile terminal are obtained
The food information.
S1100, food identification is carried out according to food information in refrigerator.Specifically, identification equipment is to food information in refrigerator
Analyzed and then recognize food in refrigerator, for example, determining the information such as species, quantity, the placement location of food.
The food recognition methods of the embodiment of the present invention, by using the control of the camera arrangement of the refrigerator of above-mentioned aspect embodiment
Mode processed controls camera arrangement, and providing data for food identification supports.
The refrigerator of embodiment according to a further aspect of the invention is described with reference to the accompanying drawings.
As shown in figure 8, being the block diagram of the refrigerator according to the embodiment of the present invention, as shown in figure 8, the refrigerator 100 includes taking pictures
Device 10 and control device 20.Certainly, refrigerator 100 also includes casing, door body and refrigeration system etc. ensure normal work zero
Part.
Wherein, camera arrangement 10 is used for the food information for gathering monitor area in refrigerator.Control device 20 is used in detection
To after enabling signal, electricity on control camera arrangement, after signal of closing the door is detected, control camera arrangement 10 is taken pictures simultaneously
The food information of monitor area in multi collect refrigerator, and, after information gathering terminates, 10 times electricity of control camera arrangement
The refrigerator 100 of the embodiment of the present invention, in the case where no enabling picks and places thing, camera arrangement 10 is in lower electric shape
State, and 10 times electricity of camera arrangement after the completion of taking pictures, so as to extend the service life and reduction energy consumption of camera arrangement 10,
And picking and placeing the control multi collect food information of camera arrangement 10 after food is closed the door, i.e., repeatedly taken pictures, bat can be improved
According to success rate.
In order to ensure success rate of taking pictures, in some embodiments of the invention, the state of camera arrangement, such as Fig. 9 are also detected
Shown, control device 100 also includes detection means 30, and detection means 30 is used for after signal of closing the door is detected, and detection is taken pictures
The upstate of device 10, control device 20 camera arrangement 10 can with when control camera arrangement 10 taken pictures, and repeatedly open
It is dynamic to take pictures, so as to improve success rate of taking pictures.
Normally, multiple food placement regions are set in refrigerator 100, as shown in figure 3, include multiple shelves in refrigerator 100,
For placing food.In some embodiments of the invention, camera arrangement 10 includes monitoring the multiple of different zones in refrigerator and adopted
Collect unit, for example, correspond to each shelf and one camera is set, control device 20 is controlled successively after signal of closing the door is detected
Multiple collecting units start, and are worked simultaneously compared to multiple collecting units, can reduce power consumption, and control each collection single respectively
The food information of first multi collect correspondence monitor area, to ensure success rate of taking pictures.
In order to ensure the image clearly taken pictures, can also by light auxiliary, further, as shown in figure 9, refrigerator
100 also include light servicing unit 40 and adjusting means 50, and adjusting means 50 is used for according to the collection for being in information gathering state
The monitor area of unit and the distance of light servicing unit 40, the intensity of light of regulation light servicing unit 40, to avoid taking pictures
The food image that device 10 is gathered is excessively quick-fried or excessively dark, becomes apparent from.Normally, if only starting its light filling when camera is taken pictures
Lamp, then on shelf light distribution as shown in figure 4, obtain image effect it is undesirable, then can pass through the illumination at the top of regulation
The light intensity of lamp so that image of taking pictures becomes apparent from, specific regulation process is with reference to the embodiment explanation in above-mentioned control method.
In addition, in some embodiments of the invention, the abnormal conditions for switch gate control camera arrangement 10 with reduction
Energy consumption.Specifically, as shown in figure 9, control device 100 also includes computing device 60, computing device 60 is used to calculate from detecting
Enabling signal is to the time interval between signal of closing the door;Control device 20 is when time interval reaches the first preset time, it is believed that
The food materials that user is picked and placeed in action, refrigerator have renewal, and control camera arrangement 10 is taken pictures;Or, it is less than in time interval
During the first preset time, it is considered as the inside food materials of refrigerator 100 and does not update, control camera arrangement 10 keeps holding state, reduces
Power consumption.For another example control device 20 detects enabling signal when camera arrangement 10 carries out information gathering, camera arrangement 10 is controlled
Termination is taken pictures and lower electricity, can improve the service life and reduction power consumption of camera arrangement 10.
Based on the refrigerator 100 of above-mentioned aspect embodiment, Figure 10 is the frame of food identifying system according to embodiments of the present invention
Figure, as illustrated, the food identifying system 1000 includes refrigerator 100 and identification equipment 200, wherein, identification equipment 200, for example
Server or mobile terminal, the food information for obtaining camera arrangement collection, and food identification is carried out according to food information.
The food identifying system 1000 of the embodiment of the present invention, can extend life-span and the drop of the camera arrangement of refrigerator 100
Its low power consumption, it is possible to recognize food information in refrigerator.
It should be noted that in the description of this specification, any mistake described otherwise above in flow chart or herein
Journey or method description are construed as, and expression includes one or more for the step of realizing specific logical function or process
Executable instruction code module, fragment or part, and the preferred embodiment of the present invention scope include it is other
Realize, wherein can not by order that is shown or discussing, including according to involved function by it is basic simultaneously in the way of or press
Opposite order, carrys out perform function, and this should be understood by embodiments of the invention person of ordinary skill in the field.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list for the executable instruction for realizing logic function, it may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress for combining these instruction execution systems, device or equipment and using
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following:Electricity with one or more wirings
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, can even is that can be in the paper of printing described program thereon or other are suitable for computer-readable medium
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized:With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
Rapid to can be by program to instruct the hardware of correlation to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means to combine specific features, structure, material or the spy that the embodiment or example are described
Point is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the not be the same as Example or the feature of example and non-be the same as Example or example described in this specification
Close and combine.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.