CN103592227A - System for detecting surface color quality consistency of foodstuff at end of cooking and detection method - Google Patents
System for detecting surface color quality consistency of foodstuff at end of cooking and detection method Download PDFInfo
- Publication number
- CN103592227A CN103592227A CN201310523386.XA CN201310523386A CN103592227A CN 103592227 A CN103592227 A CN 103592227A CN 201310523386 A CN201310523386 A CN 201310523386A CN 103592227 A CN103592227 A CN 103592227A
- Authority
- CN
- China
- Prior art keywords
- frame
- color
- ripe
- latter end
- food
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses a system for detecting surface color quality consistency of foodstuff at the end of cooking. The system comprises a color monitoring touch screen on a universal steam oven operation panel, a cooking mode selection button, a cooking control system, a video acquisition system in a universal steam oven and a cooked color processing system. The video acquisition system is arranged on an internal wallboard of the universal steam oven hearth. The video acquisition system contains a camera device and an LED lamp which is placed right below the camera device. By the adoption of the system for detecting surface color quality consistency of foodstuff at the end of cooking, surface color of foodstuff can be monitored at real time. The invention also provides a method for detecting surface color quality consistency of various batches of foodstuff at the end of cooking. According to the method, intelligent control of cooking termination time is realized by a computer vision technology so as to make surface color quality of foodstuff meet the predetermined consistency requirement of a chef.
Description
Technical field
The present invention relates to food appearance Color Quality consistency detection system and detection method in omnipotent steaming and baking box cooking process, belong to food technology field.
Background technology
The appearance of omnipotent steaming and baking box met people to " steam, bake, decoct, fried " and between newcomer in the needs ，Ta Shi baking box family of the culinary art pattern such as various combination, represent the development trend of oven product.Existing baking box is mainly to control food process process by " Time-temperature " dual mode, its control to food appearance quality quality lacks direct detection means, mainly relies on the baking box use experience of chef and " Time-temperature " dual mode indirectly to control the satisfied appearance quality of food.And along with the raising of people's quality of the life, people more and more focus on the prepared food appearance quality quality after processing, the sensory evaluation of food appearance quality quality is embodied directly in " color " three aspects, especially at millet cake, cure, the aspect such as meat scorches, food frying, the psychology expection of people to this class cuisines quality, first be embodied in the color and luster of cooked product, therefore, cook's must pay attention to coming out of the stove first Color Quality of food, the food color quality consistency in the time of also will paying attention to different batches and come out of the stove.
At present, the research that detects matter based on computer vision conducting food product is in the starting stage, take in omnipotent steaming and baking box food as object conducts a research more aobvious scarcity.In existing omnipotent steaming and baking box culinary art control system, both do not weighed the quantizating index that food color culinary art changes, ripe colourity also realizes without corresponding detection system.Therefore, cannot meet the actual needs of omnipotent steaming and baking box food color character surveillance.
Summary of the invention
The conforming detection system of food appearance Color Quality when problem to be solved by this invention is to provide culinary art termination, it can be monitored in real time to food appearance color and luster.The conforming detection method of food appearance Color Quality when the present invention provides different batches food cooking to stop simultaneously, it utilizes intelligent control of computer vision technique to cook the termination time, makes food appearance Color Quality reach the predetermined conforming demand of chef.
The conforming detection system of food appearance Color Quality when the present invention cooks and stops, it comprises video acquisition system and ripe chrominance processing system in color and luster monitoring touch-screen on omnipotent steaming and baking box guidance panel, culinary art model selection button, culinary art control system, omnipotent steaming and baking box; Video acquisition system is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, comprises camera head, LED light fixture, and LED light fixture is under camera head.
Wherein, camera head comprises camera, resistant to elevated temperatures clear glass, and camera is arranged on the inboard wall of burner hearth side plate of omnipotent steaming and baking box, and resistant to elevated temperatures clear glass covers on camera.After the thermostable transparent glass of LED lamp installation on the inboard wall of burner hearth side plate of omnipotent steaming and baking box, it comprises high temperature resistant ground glass, flexible graphite sealing ring, LED paster 7 and has the cast aluminium lampshade of radiator structure, the outside connection stabilized voltage supply of LED light fixture.
The present invention cooks the detection method of food appearance Color Quality while stopping, its concrete steps are: 1) by color and luster, monitor touch-screen and fix in the satisfied food color image of the last frame of latter end video, delineate food in-profile as covering plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate; 2) for the latter end video of the unknown Color Quality index of another batch, by color and luster, monitoring touch-screen arbitrarily selects a frame to delineate food in-profile as covering plate in the cooking process middle and later periods in advance, then, ripe chrominance processing system calculates the ripe colourity of every frame in latter end video according to covering plate; 3) the latter end video to unknown Color Quality index in ripe chrominance processing system, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard that the match is successful as, then, send early warning signal to culinary art control system, thus the mode of secession culinary art; 4) that latter end video end frame that the match is successful is passed to color and luster monitoring touch-screen, for user, observe predefine satisfied color and luster image and the successful color and luster image of unknown Color Quality index video matching.
Wherein, complete the predefined color and luster that is satisfied with operate by chef, the end-frame image that color and luster monitoring touch-screen fixes delineates food in-profile and as the illiteracy plate in latter end video extraction food region, ripe chrominance processing system is according to the sequence number of last frame, and backward is got continuous
x 1 two field picture is as latter end video; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; While extracting the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram is pressed to height descending sort, calculate the
mthe ripe chromaticity index of frame
, formula is
,
nfor the post number in histogram prostatitis 20%,
ifor post sequence number,
for corresponding post value,
for corresponding intensity value.For
x 1 two field picture,
m=1,2 ...,
x 1 , for
x 2 two field picture,
m=1,2 ...,
x 2 .If
x 1 for the stable maximum frame number of the picture frame eye-observation food color of latter end duration (getting a frame by 2 seconds intervals), calculate the core values of the satisfied ripe chromaticity index value of chef
s t with fluctuation radius
r,
,
.The detection that is completed another latter end video of unknown color and luster by non-chef personnel operates, and at the fix random two field picture of culinary art middle and later periods video of color and luster monitoring touch-screen, delineates food in-profile and as the illiteracy plate in latter end video extraction food region; The frame number of front 4-5 minute that ripe chrominance processing system is set the end time according to culinary art is
nframe as the start frame of latter end video, latter end video length
x 2 be made as the frame number (getting a frame by 2 seconds intervals) of time half a minute; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; Calculate successively latter end video
mthe ripe chromaticity index of frame
; If detect latter end 70-90%'s
s n ripe chromaticity index does not meet the core values of the satisfied ripe chromaticity index value of predefine chef
s t with fluctuation radius
rscope, successively from
n + 1 frame is start frame, continues
x 2 frame detects, and the match is successful for papery.
Apparatus and method of the present invention have been utilized computer vision technique, and intelligent control cooked the termination time, thereby guarantee the Color Quality of food appearance in baking box burner hearth.
Accompanying drawing explanation
Fig. 1 is video acquisition system device schematic diagram;
Fig. 2 is the work relationship schematic diagram of five systems of omnipotent steaming and baking box;
Fig. 3 is that the monitoring of different batches color and luster stops culinary art workflow diagram automatically;
Fig. 4 is Color Quality consistance matching detection algorithm flow chart;
Fig. 5 is omnipotent steaming and baking box man-machine interactive interface functional schematic;
Fig. 6 is ripe chromaticity index
s n oscillogram.
Embodiment
As can be seen from Figure 1, video acquisition system of the present invention is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, comprises camera head, LED light fixture, and LED light fixture is under camera head.
Wherein, camera head comprises camera 2, resistant to elevated temperatures clear glass, and camera 2 is arranged on the inboard wall of burner hearth side plate 3 of omnipotent steaming and baking box, and resistant to elevated temperatures clear glass covers on camera 2.
As a modification of the present invention mode, camera 2 is between two cross bars of bracket, and over against the food court that needs monitoring in burner hearth.Like this, the place ahead of camera does not have cross bar and blocks the middle section of finding a view, and can easily clearly to the food of culinary art, take.
After LED light fixture 4 is arranged on the thermostable transparent glass on the inboard wall of burner hearth side plate 3 of omnipotent steaming and baking box, it comprises high temperature resistant ground glass 5, flexible graphite sealing ring 6, LED paster 7 and has the cast aluminium lampshade 8 of radiator structure, the outside connection stabilized voltage supply of LED light fixture 4.Wherein, cast aluminium lampshade 8 is stainless steel inner lining reflection shield.
The gold-tinted sending due to traditional incandescent lamp bulb can affect the judgement of chef to the true color and luster of food materials, and the light source stability that incandescent lamp bulb provides is poor, therefore, the present invention uses the LED lamp emitting white light instead, observes food color in simulated hearth and is similar to outside burner hearth observing effect under natural light.Due to after LED light fixture is placed in the resistant to elevated temperatures clear glass on inwall, and itself also there is one deck ground glass to contribute to the background light efficiency that provides soft, double glazing can effectively separate the high-temperature hot air from burner hearth inside simultaneously, and light fixture itself adopts the aluminium matter structure with heat dissipation characteristics, guarantee that LED paster environment temperature in light fixture is in 60 ℃, also can carry out vacuum coating in LED paster region, improve heat-resistant quality, contribute to extend LED mission life.LED light fixture 4 provides the white light colour temperature of burner hearth illumination at 6200K-6500K.Camera collection postpones to start after 2 seconds start-up time after LED lamp is lighted, and stops video acquisition when culinary art stops; LED lamp is lighted shutting behind the door when culinary art starts, and when opening, extinguishes.
When culinary art stops, in the conforming detection system of food appearance Color Quality, the work relationship of 5 systems is as shown in Figure 2, it is the former omnipotent steaming and baking box mode of operation control culinary art control system of culinary art model selection button succession on man-machine interactive interface, video acquisition system is delivered to the color and luster monitoring touch-screen on ripe chrominance processing system and man-machine interactive interface by burner hearth scene video, the early warning information that ripe chrominance processing system draws is delivered to culinary art control system, unknown video end frame and the predefine video end frame of simultaneously ripe chrominance processing system coupling pass to color and luster monitoring touch-screen, color and luster monitoring touch screen operation information on man-machine interactive interface passes to ripe chrominance processing system.
The original culinary art model selection of omnipotent steaming and baking box button is almost constant, only increased the termination time function of vernier control culinary art, because affect the time period of foodstuff surface color and luster satisfaction most critical, be that cooking process is about to the last 3-5 minute stopping, if culinary art control system when this time period receives the early warning signal of ripe chrominance processing system, enters " the mode of secession " in advance, cooking system is stopped.The effect of video acquisition system is by improving the lighting environment of baking box burner hearth, and convenient operation personnel are across the true color and luster of kitchen door glass observation food appearance, ripe chrominance processing system, acceptance is from monitoring food region information and the food color image being satisfied with in touch-screen selected digital image with color and luster, through image, process, extract the ripe chromaticity index of food region based on saturation degree (S), then, adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end, after the match is successful, send early warning signal to culinary art control system, make to cook device work device and enter cooking system " the mode of secession ", and make the color and luster monitoring touch-screen of man-machine interactive interface show predefine and this image that the match is successful.
Use the present invention automatically to stop culinary art workflow diagram as shown in Figure 3 to the monitoring of different batches color and luster: food is put into after omnipotent steaming and baking box, and culinary art control system normally starts, and selects culinary art pattern; Gather the image in cooking process, first by chef predefine, cooked first the image of rear satisfaction, and automatically calculate predefined latter end video Color Quality index; Then, remaining cooking process, can be operated by general personnel, automatically calculates the ripe colourity of unknown latter end frame of video by system, and with the comparison of predefined video Color Quality index; During coupling, send culinary art early warning signal, feed back to normal culinary art control procedure, thereby stop cooking process.
The conforming detection method of food appearance Color Quality of the present invention, its concrete steps are: 1) by color and luster, monitor touch-screen and fix in the satisfied food color image of the last frame of latter end video, delineate food in-profile as covering plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate, the satisfied food color image of last frame of the latter end video is here the color and luster image of baked food of last consignment of, is predefined ripe colourity; 2) by color and luster, monitor touch-screen for the latter end video of another unknown Color Quality index, at a random frame of the middle and later periods of cooking process, delineate food in-profile in advance, then, ripe chrominance processing system calculates the ripe colourity of every frame in latter end video according to covering plate, the latter end video of the unknown Color Quality index here refers to the latter end video of the food of roasting, and is undefined ripe colourity; 3) in ripe chrominance processing system to unknown latter end video, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard that the match is successful as, then, send early warning signal to culinary art control system, thus the mode of secession culinary art; 4) that fragment end frame that the match is successful is passed to color and luster monitoring touch-screen, for user, observe predefine satisfied color and luster image and the successful color and luster image of unknown video matching.
Wherein, ripe chrominance processing system is a dsp system, and the concrete steps of this system executing arithmetic are: 1) first process the food color image that predefine is satisfied with standard: i.e. 1-1) input predefine latter end video is continuous
x 1 frame; 1-2) it is converted to HSV model by RGB; 1-3) extract S passage and cover plate inner region; 1-4) the histogram of S value in zoning; 1-5) press descending and extract front n the post of histogram, calculate weighted mean
s n as ripe chromaticity index; 1-6) calculate the ripe colourity average of latter end frame of video
s t and fluctuation radius R is as the scope of predefine latter end video Color Quality; 2) another latter end video of the unknown lustre index of aftertreatment, 2-1) inputs another unknown video last continuous
x 2 two field picture; 2-2) it is converted to HSV model by RGB; 2-3) extract S passage and cover plate inner region; 2-4) the histogram of S value in zoning; 2-5) press descending and extract front n the post of histogram, calculate
s n as ripe chromaticity index; 2-6) adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end: judge Xn frame 70-90%'s
s n in the scope of predefine latter end video Color Quality, if so, the match is successful, sends early warning signal, finishes culinary art; If not, the frame of postponing, re-enters unknown video last continuous
x 2 two field picture, repeating step 2), until the match is successful, finish culinary art.The process flow diagram of algorithm as shown in Figure 4.
In ripe chrominance processing system: because hsv color model triple channel component is independent, and saturation degree S component can objectively respond the color and luster that the raw ripe process of food causes and change, and therefore, take S as parameter, constructs ripe chromaticity index.
During concrete operations, monitor touch-screen fix in the satisfied food color image of the last frame of latter end video by color and luster, delineate food in-profile as covering plate, then, backward is got continuous
x 1 frame is as latter end video; Every two field picture is all pressed and is covered web wheel exterior feature as initial profile, adopt Level Set Method (Li C, Xu C, Gui C, et al. Distance regularized level set evolution and its application to image segmentation[J]. Image Processing, IEEE Transactions on. 2010,19 (12): 3243-3254.) expand outward to border, extract food area image.Extract the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram is pressed to height descending sort, calculate the
mthe ripe chromaticity index of frame
, formula is
,
nfor the post number in histogram prostatitis 20%,
ifor post sequence number,
for corresponding post value,
for corresponding intensity value.For
x 1 frame latter end video,
m=1,2 ...,
x 1 , for
x 2 frame latter end video,
m=1,2 ...,
x 2 .If
x 1 for the stable maximum frame number of latter end video eye-observation food color (getting a frame by 2 seconds intervals), calculate the core values of the satisfied ripe chromaticity index value of chef
s t with fluctuation radius
ras predefine video Color Quality indication range,
,
.If
x 2 for the frame number (getting a frame by 2 seconds intervals) of another latter end video time half a minute of the unknown, the start frame of latter end
nfor the distance front 4-5 minute of setting end time, by previous methods, calculate this
x 2 individual ripe chromaticity index, if should
x 2 individual ripe chromaticity index drops on the proportion threshold value of a setting of less than in predefined scope, abandons first frame, increases a new frame after last frame as last frame, and calculates the new ripe chromaticity index of last frame, so constantly statistics
x 2 individual ripe chromaticity index drops on the actual ratio in predefined scope, until actual ratio is not less than the proportion threshold value of setting, show that in unknown video image, food color meets predefined category, to culinary art control system, send early warning signal, finish in advance cooking process, and by current
x 2 the last frame of individual frame is passed to color and luster monitoring touch-screen, for user, observes the satisfied color and luster image of predefine and the unknown satisfied color and luster image of coupling that automatically detects.
Man-machine interactive interface function as shown in Figure 5, be divided into culinary art model selection button and color and luster monitoring touch-screen two parts, wherein on color and luster monitoring touch-screen, provide video playback capability, be convenient to chef and observe the burner hearth video material that comes from video acquisition system and the food color image that shows chef satisfaction, and provide chef to define its satisfied food color quality function; Cook model selection button simultaneously the operating function of various routines is provided, be convenient to chef and according to food materials, select suitable culinary art pattern in man-machine interactive interface.
After the work of culinary art preorder completes, once shut oven door, start culinary art button, color and luster monitoring touch-screen starts to show the real-time video of scene in burner hearth, Deng culinary art finish after, display video end-frame image, if chef is satisfied to food color on this image, can predefine latter end video food color quality as under same cooked mode, the satisfied pattern of appearance color and luster after such food materials, need it on color and luster monitoring touch-screen, with finger, in food, to delineate a closed region, on screen, show the region contour line that it is delineated, if dissatisfied, can again delineate, after satisfied, confirm that this Confined outline curve is as the illiteracy plate of latter end Video processing.Ripe chrominance processing system monitors and covers the Color Quality indication range that completes latter end video after plate and calculate.If while again cooking such food materials, select same culinary art pattern, because same food materials are because volume and shape there are differences with predefined food materials, same cooking time can not guarantee same color and luster, because the present invention has the function that enters in advance cooking system " the mode of secession ", therefore, culinary art control system automatically prolongs and finishes the terminal time 1-2 minute of culinary art, because causing physics and chemistry attribute because being heated, the early stage food materials at cooking process change, there is the phenomenon (as roasting whole chicken) of volume and change of shape, for the variability that reduces frame sequence image food materials position is on covering the impact of plate, need food materials shape that the stage of significant change no longer occurs, cook the middle and later periods and get at random a frame by other users (can liberate chef), on color and luster monitoring touch-screen, again delineate food interior zone profile as the illiteracy plate of latter end Video processing.Ripe chrominance processing system adopts the coupling of the unknown video image of mode identification method fuzzy reasoning and predefine video image, after the match is successful, display screen shows predefine image and this latter end video end-frame image side by side, due to screen size limitations, only show normal picture horizontal width half, the automatic topography of intercepting center district inclusion food materials.
Process of establishing below by roast chicken description of test the inventive method.
Buy a collection of 600～800g, the pawl light chicken that decaptitates, stand-by after pickled flavouring is processed.
Dark culinary art pattern in selected roast chicken on the touch screen operation button of man-machine interactive operation system, culinary art duration is predisposed to 25 minutes.Omnipotent steaming and baking box carries out burner hearth preheating after starting, then first light chicken (704g) is placed on the tray rack that pallet central authorities put into burner hearth camera watch region, and pass upper furnace door, cooking process starts.The touch screen interface of man-machine interactive operation system shows scene video in burner hearth, and after cooking process finishes, video freezing, in last frame, is assumed to be the satisfied color and luster image of chef, with pointing at roast chicken border inside-paint one circle.Ripe chrominance processing system frame sampling speed was 0.5 frame/second, established
x 1 =36 seconds, this latter end was in the time, because the satisfied food color picture frame of eye-observation almost cannot differentiation, therefore, calculated and comprised the last frame backward ripe chromaticity index of totally 18 frames
s n , deduce out the core values of ripe chromaticity index
s t =0.8686 and fluctuation radius R=0.0074, be the satisfied color and luster standard of predefine roast chicken.
Second light chicken (680g) still adopt existing in dark culinary art pattern, culinary art duration system automatically prolongs 2 minutes, to guarantee that grace time guarantees that may meet with slightly large light chicken also obtains same processing quality, after closing upper furnace door, in the time of about culinary art to 15 minute, we arbitrarily specify a frame on scene video in color and luster monitoring touch-screen demonstration burner hearth, with finger, on two field picture, delineate roast chicken in-profile as covering plate, ripe chrominance processing system started to calculate the ripe chromaticity index of every frame in the time of 20 minutes, established
x 2 =10, meeting the proportion threshold value that predefined roast chicken is satisfied with color and luster standard is 0.8, adds up this 10 frame
s n , detect and meet the ratio that predefined roast chicken is satisfied with color and luster standard, when culinary art proceeds to 22 minutes and 18 seconds, ripe chrominance processing system sends early warning signal, finishes cooking process.The color and luster monitoring touch-screen of man-machine interactive interface shows that left half figure is region, predefine scene last frame image level center, region, end-frame image level center when right half figure is unknown video latter end Color Quality coupling.
The 3rd (653g), the 4th light chicken (795g) mode of operation, with second, are just cooked end time difference.The 3rd light chicken cooked 22 minutes and 56 seconds, and the 4th light chicken cooked end in 25 minutes 22 seconds.Eye-observation, four roast chicken appearance color and lusters are similar, several indifferences.
The 5th (690g) light chicken selected same culinary art pattern above, and it is 25 minutes that the termination time is just set, and the middle operation of not taking the ripe colourity of automatic discrimination and premature termination culinary art, has guaranteed the cooking process of 25 minutes.
The 6th (742g) light chicken selected look culinary art pattern in roast chicken, and it is 25 minutes that the termination time is just set, and the middle operation of not taking the ripe colourity of automatic discrimination and premature termination culinary art, has guaranteed the cooking process of 25 minutes.
Take out the burner hearth scene video of first, the 5th and the 6th roast chicken, at Matlab2011 platform, carrying out the ripe colourity of emulation processes, frame of video sampling rate was 0.5 frame/second, every section of video is got last 70 frames, three sections of video image initial profiles adopt the circle of same radius as the illiteracy plate of latter end Video processing, the level set parameter of same characteristic, makes circle be extended to a closed curve that approaches food border, calculates the ripe chromaticity index in this region
s n , as shown in Figure 6.A1 line and a2 line are the index of first and the 5th roast chicken, because culinary art pattern is identical, color grade is middle dark color, a1 line and a2 line weave in, a3 line is the index of the 6th roast chicken, and the 6th roast chicken culinary art pattern color grade select in look, so a3 line away from it two, verify that ripe chromaticity index can monitor the quality of food color, at front 15 frames and last 25 frames of a1 line and a2 line itself
s n approach, can judge that front 10 frames of a2 line are consistent with the predefined Color Quality of a1 line, therefore, the cooking time that checking reaches same Color Quality is not an equal time length, can finish in advance cooking process.
The good effect of patent of the present invention is: by the video acquisition system in omnipotent steaming and baking box, be captured in the surface color image in the raw ripe change procedure of the food materials in burner hearth in actual cooking process, can follow the tracks of the ripe chromaticity index parameter of food materials in burner hearth, make omnipotent steaming and baking box possess the function of memory food color, meet the needs that gather parameter monitoring in culinary art control procedure, thereby realize the analysis of its cooked mode and research.In addition, food materials appearance Color Quality detection method when culinary art stops makes the user of omnipotent steaming and baking box elect veteran chef, color and luster in the time of only need to once defining intuitively food maturation by image, even inexperienced new cook also can operate the food that omnipotent steaming and baking box is cooked same quality later, reduced the culinary art of food repeatability and added the degree of dependence of man-hour to experienced cook.
Claims (10)
1. the conforming detection system of food appearance Color Quality when culinary art stops, is characterized in that: it comprises video acquisition system and ripe chrominance processing system in color and luster monitoring touch-screen on omnipotent steaming and baking box guidance panel, culinary art model selection button, culinary art control system, omnipotent steaming and baking box; Video acquisition system is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, comprises camera head, LED light fixture, and LED light fixture is under camera head.
2. detection system according to claim 1, it is characterized in that: camera head comprises camera (2), resistant to elevated temperatures clear glass, camera (2) is arranged on the inboard wall of burner hearth side plate (3) of omnipotent steaming and baking box, and resistant to elevated temperatures clear glass covers on camera (2).
3. detection system according to claim 1, is characterized in that: camera (2) is between (1) two cross bar of bracket, and over against the food court that needs monitoring in burner hearth.
4. detection system according to claim 1, it is characterized in that: after LED light fixture (4) is arranged on the thermostable transparent glass on the inboard wall of burner hearth side plate (3) of omnipotent steaming and baking box, it comprises high temperature resistant ground glass (5), flexible graphite sealing ring (6), LED paster (7) and has the cast aluminium lampshade (8) of radiator structure, the outside connection stabilized voltage supply of LED light fixture (4).
5. detection system according to claim 1, is characterized in that: cast aluminium lampshade (8) is stainless steel inner lining reflection shield; LED paster environment temperature is in 60 ℃, and vacuum coating can be carried out in LED paster region; LED light fixture (4) provides the white light colour temperature of burner hearth illumination at 6200K-6500K.
6. the conforming detection method of food appearance Color Quality when culinary art stops, its concrete steps are:
1) by color and luster, monitoring touch-screen fixes in the satisfied food color image of the last frame of latter end video, delineate food in-profile as covering plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate;
2) for the latter end video of the unknown Color Quality index of another batch, by color and luster, monitoring touch-screen arbitrarily selects a frame to delineate food in-profile as covering plate in the cooking process middle and later periods in advance, then, ripe chrominance processing system calculates the ripe colourity of every frame in latter end video according to covering plate;
3) the latter end video to unknown Color Quality index in ripe chrominance processing system, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard that the match is successful as, then, send early warning signal to culinary art control system, thus the mode of secession culinary art;
4) that latter end video end frame that the match is successful is passed to color and luster monitoring touch-screen, for user, observe predefine satisfied color and luster image and the successful color and luster image of unknown Color Quality index video matching.
7. detection method according to claim 6, is characterized in that: ripe chrominance processing system is a dsp system, and the concrete steps of this system executing arithmetic are:
1) first process the food color image that predefine is satisfied with standard: i.e. 1-1) input predefine latter end video is continuous
x 1 frame; 1-2) it is converted to HSV model by RGB; 1-3) extract S passage and cover plate inner region; 1-4) the histogram of S value in zoning; 1-5) press descending and extract front n the post of histogram, calculate weighted mean
s n as ripe chromaticity index; 1-6) calculate the ripe colourity average of latter end frame of video
s t and fluctuation radius R is as the scope of predefine latter end video Color Quality;
2) another latter end video of the unknown lustre index of aftertreatment, 2-1) inputs another unknown video last continuous
x 2 two field picture; 2-2) it is converted to HSV model by RGB; 2-3) extract S passage and cover plate inner region; 2-4) the histogram of S value in zoning; 2-5) press descending and extract front n the post of histogram, calculate
s n as ripe chromaticity index; 2-6) adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end: judge Xn frame 70-90%'s
s n in the scope of predefine latter end video Color Quality, if so, the match is successful, sends early warning signal, finishes culinary art; If not, the frame of postponing, re-enters unknown video last continuous
x 2 two field picture, repeating step 2), until the match is successful, finish culinary art.
8. detection method according to claim 7, is characterized in that: hsv color model is that triple channel component is independent, and saturation degree S component can objectively respond the color and luster that the raw ripe process of food causes and change, and therefore, take S as parameter, constructs ripe chromaticity index.
9. according to the detection method described in claim 6 or 7, it is characterized in that: in step 1: by chef, complete the predefined color and luster that is satisfied with and operate, be that end-frame image that color and luster monitoring touch-screen fixes is delineated food in-profile and as the illiteracy plate in latter end video extraction food region, ripe chrominance processing system is according to the sequence number of last frame, and backward is got continuous
x 1 two field picture is as latter end video; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; While extracting the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram is pressed to height descending sort, calculate the
mthe ripe chromaticity index of frame
, formula is
,
nfor the post number in histogram prostatitis 20%,
ifor post sequence number,
for corresponding post value,
for corresponding intensity value.For
x 1 two field picture,
m=1,2 ...,
x 1 , for
x 2 two field picture,
m=1,2 ...,
x 2 .If
x 1 for the stable maximum frame number of the picture frame eye-observation food color of latter end duration (getting a frame by 2 seconds intervals), calculate the core values of the satisfied ripe chromaticity index value of chef
s t with fluctuation radius
r,
,
.
10. according to the detection method described in claim 6 or 7, it is characterized in that: in step 2: the detection that is completed another latter end video of unknown color and luster by non-chef personnel operates, at the fix random two field picture of culinary art middle and later periods video of color and luster monitoring touch-screen, delineate food in-profile and as the illiteracy plate in latter end video extraction food region; The frame number of front 4-5 minute that ripe chrominance processing system is set the end time according to culinary art is
nframe as the start frame of latter end video, latter end video length
x 2 be made as the frame number (getting a frame by 2 seconds intervals) of time half a minute; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; Calculate successively latter end video
mthe ripe chromaticity index of frame
; If detect latter end 70-90%'s
s n ripe chromaticity index does not meet the core values of the satisfied ripe chromaticity index value of predefine chef
s t with fluctuation radius
rscope, successively from
n+ 1 frame is start frame, continues
x 2 frame detects, and the match is successful for papery.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310523386.XA CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310523386.XA CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103592227A true CN103592227A (en) | 2014-02-19 |
| CN103592227B CN103592227B (en) | 2016-02-03 |
Family
ID=50082454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310523386.XA Active CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103592227B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851182A (en) * | 2015-12-04 | 2017-06-13 | 彭翔 | The intelligent visual surveillance system of laser-processing system |
| CN107340718A (en) * | 2017-06-30 | 2017-11-10 | 北京小米移动软件有限公司 | The method of adjustment and device of intelligent lamp parameter |
| CN109447938A (en) * | 2017-08-31 | 2019-03-08 | 宁波方太厨具有限公司 | A kind of detection method and detection device of oven baking performance |
| CN110234040A (en) * | 2019-05-10 | 2019-09-13 | 九阳股份有限公司 | A kind of the food materials image acquiring method and cooking equipment of cooking equipment |
| CN110887069A (en) * | 2019-11-20 | 2020-03-17 | 广东美的厨房电器制造有限公司 | Cooking apparatus, control method of cooking apparatus, and computer-readable storage medium |
| CN111345699A (en) * | 2018-12-20 | 2020-06-30 | 九阳股份有限公司 | Control method of cooking equipment and cooking equipment |
| US10739013B2 (en) | 2015-05-05 | 2020-08-11 | June Life, Inc. | Tailored food preparation with an oven |
| US10801734B2 (en) | 2015-05-05 | 2020-10-13 | June Life, Inc. | Connected food preparation system and method of use |
| CN111990902A (en) * | 2020-09-30 | 2020-11-27 | 广东美的厨房电器制造有限公司 | Cooking control method and device, electronic equipment and storage medium |
| WO2021098474A1 (en) * | 2019-11-20 | 2021-05-27 | 广东美的厨房电器制造有限公司 | Cooking apparatus, control method thereof, heating control method, and server |
| US11058132B2 (en) | 2019-11-20 | 2021-07-13 | June Life, Inc. | System and method for estimating foodstuff completion time |
| US20220117274A1 (en) * | 2020-10-20 | 2022-04-21 | June Life, Inc. | Intelligent cooking system and method |
| CN114652177A (en) * | 2022-04-06 | 2022-06-24 | 江苏狼王机械科技有限公司 | Spiral steaming and baking machine equipment and control system |
| USD978600S1 (en) | 2021-06-11 | 2023-02-21 | June Life, Inc. | Cooking vessel |
| US11593717B2 (en) | 2020-03-27 | 2023-02-28 | June Life, Inc. | System and method for classification of ambiguous objects |
| US11680712B2 (en) | 2020-03-13 | 2023-06-20 | June Life, Inc. | Method and system for sensor maintenance |
| US11765798B2 (en) | 2018-02-08 | 2023-09-19 | June Life, Inc. | High heat in-situ camera systems and operation methods |
| USD1007224S1 (en) | 2021-06-11 | 2023-12-12 | June Life, Inc. | Cooking vessel |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101234381A (en) * | 2008-03-07 | 2008-08-06 | 天津市华核科技有限公司 | Granular material sorting classifying method based on visual sense recognition |
| CN101561402A (en) * | 2009-05-07 | 2009-10-21 | 浙江大学 | Machine vision-based real-time detection and grading method and machine vision-based real-time detection and grading device for pork appearance quality |
| CN102563578A (en) * | 2011-11-30 | 2012-07-11 | 厦门市松竹精密科技有限公司 | Application of flexible graphite to field of radiating of LED lamp |
| CN102829456A (en) * | 2011-06-17 | 2012-12-19 | 上海衍易电气设备科技有限公司 | LED lamp cooling component and production method thereof |
| CN203101258U (en) * | 2013-01-29 | 2013-07-31 | 安徽华菱西厨装备股份有限公司 | Testing device for testing color and luster changing process of foods in steam oven |
| CN103322436A (en) * | 2012-03-22 | 2013-09-25 | 武汉南格尔科技有限公司 | Structure of LED lamp |
-
2013
- 2013-10-30 CN CN201310523386.XA patent/CN103592227B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101234381A (en) * | 2008-03-07 | 2008-08-06 | 天津市华核科技有限公司 | Granular material sorting classifying method based on visual sense recognition |
| CN101561402A (en) * | 2009-05-07 | 2009-10-21 | 浙江大学 | Machine vision-based real-time detection and grading method and machine vision-based real-time detection and grading device for pork appearance quality |
| CN102829456A (en) * | 2011-06-17 | 2012-12-19 | 上海衍易电气设备科技有限公司 | LED lamp cooling component and production method thereof |
| CN102563578A (en) * | 2011-11-30 | 2012-07-11 | 厦门市松竹精密科技有限公司 | Application of flexible graphite to field of radiating of LED lamp |
| CN103322436A (en) * | 2012-03-22 | 2013-09-25 | 武汉南格尔科技有限公司 | Structure of LED lamp |
| CN203101258U (en) * | 2013-01-29 | 2013-07-31 | 安徽华菱西厨装备股份有限公司 | Testing device for testing color and luster changing process of foods in steam oven |
Non-Patent Citations (7)
| Title |
|---|
| CHUNMING LI ET.AL: "Distance Regularized Level Set Evolution and Its Application to Image Segmentation", 《IEEE TRANSACTIONS ON IMAGE PROCESSING》 * |
| TADHG BROSNAN, DA-WEN SUN: "Improving quality inspection of food products by computer vision——a review", 《JOURNAL OF FOOD ENGINEERING》 * |
| 全国照明电器标准化技术委员会编: "《照明用LED系列标准宣贯教材》", 30 April 2010 * |
| 刘祖明: "《LED照明技术与灯具设计》", 31 March 2012, 机械工业出版社 * |
| 周志敏: "《零基础学LED工程应用》", 30 September 2011, 机械工业出版社 * |
| 樊凌涛，陈健: "图象和视频的检索技术", 《计算机工程与应用》 * |
| 黄硕，王明亮: "一种新的LED 灯具散热技术", 《现代显示》 * |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11268703B2 (en) | 2015-05-05 | 2022-03-08 | June Life, Inc. | Connected food preparation system and method of use |
| US11767984B2 (en) | 2015-05-05 | 2023-09-26 | June Life, Inc. | Connected food preparation system and method of use |
| US11221145B2 (en) | 2015-05-05 | 2022-01-11 | June Life, Inc. | Connected food preparation system and method of use |
| US11788732B2 (en) | 2015-05-05 | 2023-10-17 | June Life, Inc. | Connected food preparation system and method of use |
| US11506395B2 (en) | 2015-05-05 | 2022-11-22 | June Life, Inc. | Tailored food preparation with an oven |
| US11421891B2 (en) | 2015-05-05 | 2022-08-23 | June Life, Inc. | Connected food preparation system and method of use |
| US11415325B2 (en) | 2015-05-05 | 2022-08-16 | June Life, Inc. | Connected food preparation system and method of use |
| US10801734B2 (en) | 2015-05-05 | 2020-10-13 | June Life, Inc. | Connected food preparation system and method of use |
| US10845060B2 (en) | 2015-05-05 | 2020-11-24 | June Life, Inc. | Connected food preparation system and method of use |
| US11300299B2 (en) | 2015-05-05 | 2022-04-12 | June Life, Inc. | Connected food preparation system and method of use |
| US10739013B2 (en) | 2015-05-05 | 2020-08-11 | June Life, Inc. | Tailored food preparation with an oven |
| US11079117B2 (en) | 2015-05-05 | 2021-08-03 | June Life, Inc. | Connected food preparation system and method of use |
| US11060735B2 (en) | 2015-05-05 | 2021-07-13 | June Life, Inc. | Connected food preparation system and method of use |
| CN106851182A (en) * | 2015-12-04 | 2017-06-13 | 彭翔 | The intelligent visual surveillance system of laser-processing system |
| CN107340718A (en) * | 2017-06-30 | 2017-11-10 | 北京小米移动软件有限公司 | The method of adjustment and device of intelligent lamp parameter |
| CN109447938A (en) * | 2017-08-31 | 2019-03-08 | 宁波方太厨具有限公司 | A kind of detection method and detection device of oven baking performance |
| CN109447938B (en) * | 2017-08-31 | 2022-01-25 | 宁波方太厨具有限公司 | Detection method and detection device for baking performance of oven |
| US11765798B2 (en) | 2018-02-08 | 2023-09-19 | June Life, Inc. | High heat in-situ camera systems and operation methods |
| CN111345699A (en) * | 2018-12-20 | 2020-06-30 | 九阳股份有限公司 | Control method of cooking equipment and cooking equipment |
| CN110234040B (en) * | 2019-05-10 | 2022-08-09 | 九阳股份有限公司 | Food material image acquisition method of cooking equipment and cooking equipment |
| CN110234040A (en) * | 2019-05-10 | 2019-09-13 | 九阳股份有限公司 | A kind of the food materials image acquiring method and cooking equipment of cooking equipment |
| US11058132B2 (en) | 2019-11-20 | 2021-07-13 | June Life, Inc. | System and method for estimating foodstuff completion time |
| WO2021098474A1 (en) * | 2019-11-20 | 2021-05-27 | 广东美的厨房电器制造有限公司 | Cooking apparatus, control method thereof, heating control method, and server |
| CN110887069A (en) * | 2019-11-20 | 2020-03-17 | 广东美的厨房电器制造有限公司 | Cooking apparatus, control method of cooking apparatus, and computer-readable storage medium |
| US11680712B2 (en) | 2020-03-13 | 2023-06-20 | June Life, Inc. | Method and system for sensor maintenance |
| US11593717B2 (en) | 2020-03-27 | 2023-02-28 | June Life, Inc. | System and method for classification of ambiguous objects |
| US11748669B2 (en) | 2020-03-27 | 2023-09-05 | June Life, Inc. | System and method for classification of ambiguous objects |
| CN111990902A (en) * | 2020-09-30 | 2020-11-27 | 广东美的厨房电器制造有限公司 | Cooking control method and device, electronic equipment and storage medium |
| US20220117274A1 (en) * | 2020-10-20 | 2022-04-21 | June Life, Inc. | Intelligent cooking system and method |
| USD978600S1 (en) | 2021-06-11 | 2023-02-21 | June Life, Inc. | Cooking vessel |
| USD1007224S1 (en) | 2021-06-11 | 2023-12-12 | June Life, Inc. | Cooking vessel |
| CN114652177A (en) * | 2022-04-06 | 2022-06-24 | 江苏狼王机械科技有限公司 | Spiral steaming and baking machine equipment and control system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103592227B (en) | 2016-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103592227B (en) | The food conforming detection system of appearance Color Quality and detection method when culinary art stops | |
| CN107806656B (en) | Food heating control method and food heating device | |
| CN108309021B (en) | Intelligent regulation automatic cooker and intelligent control method thereof | |
| CN109213015B (en) | A kind of control method and cooking apparatus of cooking apparatus | |
| CN107504524A (en) | Processing method, device, processor and the lampblack absorber of gas-cooker abnormal work | |
| CN110462292A (en) | Run cooking apparatus | |
| CN108742170B (en) | Intelligent recognition cooking system of oven | |
| CA1236174A (en) | Microwave ovens and methods of cooking food | |
| EP3821682B1 (en) | In-oven camera and computer vision systems and methods | |
| CN104042124A (en) | Intelligent oven and work control method thereof | |
| CN113167721A (en) | Cooking appliance and method for operating a cooking appliance | |
| CN110657460B (en) | Kitchen safety assistance, screen-off control and health reminding system and working method | |
| CN108872245A (en) | A kind of intelligence dining table oily waste degradation method | |
| CN204254706U (en) | The smoke exhaust of automatic control | |
| CN109579071B (en) | Air inlet pipe air inflow adjusting system | |
| CN105030085A (en) | Cooking stage display control method for baking machine | |
| CN102406456B (en) | Human vision principle-based method and device for automatically controlling egg frying fire | |
| CN110916533B (en) | Baking control method and device for baking equipment, baking equipment and toaster | |
| CN202649750U (en) | Electric oven controller | |
| CN106691153A (en) | Cooking state display method of electric cooker | |
| CN211268335U (en) | Full-automatic moon cake baking device based on machine vision | |
| CA1279378C (en) | Microwave ovens | |
| CN206973629U (en) | Energy-efficient premixed large stove | |
| CN112835299A (en) | Intelligent baking control system based on deep learning | |
| CN110007699A (en) | A kind of the intelligent recognition cooking system and method for oven |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |