CN103592227B - The food conforming detection system of appearance Color Quality and detection method when culinary art stops - Google Patents
The food conforming detection system of appearance Color Quality and detection method when culinary art stops Download PDFInfo
- Publication number
- CN103592227B CN103592227B CN201310523386.XA CN201310523386A CN103592227B CN 103592227 B CN103592227 B CN 103592227B CN 201310523386 A CN201310523386 A CN 201310523386A CN 103592227 B CN103592227 B CN 103592227B
- Authority
- CN
- China
- Prior art keywords
- frame
- color
- ripe
- latter end
- food
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 235000013305 food Nutrition 0.000 title claims abstract description 66
- 238000001514 detection method Methods 0.000 title claims abstract description 26
- 239000002932 luster Substances 0.000 claims abstract description 56
- 238000000034 method Methods 0.000 claims abstract description 46
- 238000012545 processing Methods 0.000 claims abstract description 34
- 238000012544 monitoring process Methods 0.000 claims abstract description 32
- 238000010411 cooking Methods 0.000 claims abstract description 27
- 235000019601 food appearance Nutrition 0.000 claims abstract description 20
- 235000002864 food coloring agent Nutrition 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 24
- 239000000463 material Substances 0.000 claims description 17
- 239000000284 extract Substances 0.000 claims description 10
- 230000008878 coupling Effects 0.000 claims description 8
- 238000010168 coupling process Methods 0.000 claims description 8
- 238000005859 coupling reaction Methods 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 238000013316 zoning Methods 0.000 claims description 4
- 201000007094 prostatitis Diseases 0.000 claims description 3
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 claims description 2
- 238000010025 steaming Methods 0.000 abstract description 26
- 241000287828 Gallus gallus Species 0.000 description 23
- 230000002452 interceptive effect Effects 0.000 description 10
- 239000011521 glass Substances 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 4
- 229910052782 aluminium Inorganic materials 0.000 description 4
- 239000004411 aluminium Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 239000005337 ground glass Substances 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 229910002804 graphite Inorganic materials 0.000 description 2
- 239000010439 graphite Substances 0.000 description 2
- 230000002028 premature Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000007789 sealing Methods 0.000 description 2
- 206010021703 Indifference Diseases 0.000 description 1
- 244000062793 Sorghum vulgare Species 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 230000017525 heat dissipation Effects 0.000 description 1
- 235000013372 meat Nutrition 0.000 description 1
- 235000019713 millet Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 229910001220 stainless steel Inorganic materials 0.000 description 1
- 239000010935 stainless steel Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 238000001771 vacuum deposition Methods 0.000 description 1
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses food appearance Color Quality conforming detection system when culinary art stops, its comprises video acquisition system in color and luster monitoring touch-screen on omnipotent steaming and baking box guidance panel, culinary art mode selecting button, culinary art control system, omnipotent steaming and baking box and ripe chrominance processing system; Video acquisition system is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, and comprise camera head, LED lamp, LED lamp is in immediately below camera head.Food appearance Color Quality conforming detection system when the present invention cooks termination, it can be monitored in real time to food appearance color and luster.Invention also provides food appearance Color Quality conforming detection method when different batches food cooking stops, it utilizes computer vision technique intelligentized control method to cook the termination time, makes food appearance Color Quality reach chef and makes a reservation for conforming demand.
Description
Technical field
The present invention relates to the food appearance Color Quality consistency detection system in omnipotent steaming and baking box cooking process and detection method, belong to food technology field.
Background technology
The appearance of omnipotent steaming and baking box meet people to " steam, bake, decoct, fried " and between the needs of the culinary art pattern such as various combination, it is the newcomer in baking box family, represents the development trend of oven product.Existing baking box mainly controls food preparation process by " Time-temperature " dual mode, it lacks direct detection means to the control of food appearance quality quality, and the main baking box use experience of chef and " Time-temperature " dual mode of relying on controls the satisfied appearance quality of food indirectly.And along with the raising of people's quality of the life, people more and more focus on the prepared food appearance quality quality after processing, the sensory evaluation of food appearance quality quality is embodied directly in " color " three aspects, especially cure at millet cake, meat scorches, in food frying etc., people are to the in-mind anticipation of this kind of cuisines quality, first the color and luster of cooked product is embodied in, therefore, cook must pay attention to coming out of the stove first the Color Quality of food, also will pay attention to food color quality consistency when different batches is come out of the stove.
At present, based on computer vision conducting food product detect Quality Research be in the starting stage, with food in omnipotent steaming and baking box for object conducts a research more aobvious scarcity.In existing omnipotent steaming and baking box culinary art control system, both do not weighed the quantizating index of food color culinary art change, ripe colourity also realizes without corresponding detection system.Therefore, the actual needs of omnipotent steaming and baking box food color character surveillance cannot be met.
Summary of the invention
Problem to be solved by this invention is to provide food appearance Color Quality conforming detection system when culinary art stops, and it can be monitored in real time to food appearance color and luster.Invention also provides food appearance Color Quality conforming detection method when different batches food cooking stops, it utilizes computer vision technique intelligentized control method to cook the termination time, makes food appearance Color Quality reach chef and makes a reservation for conforming demand.
Food appearance Color Quality conforming detection system when the present invention cooks termination, its comprises video acquisition system in color and luster monitoring touch-screen on omnipotent steaming and baking box guidance panel, culinary art mode selecting button, culinary art control system, omnipotent steaming and baking box and ripe chrominance processing system; Video acquisition system is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, and comprise camera head, LED lamp, LED lamp is in immediately below camera head.
Wherein, camera head comprises camera, resistant to elevated temperatures clear glass, and camera is arranged on the inboard wall of burner hearth side plate of omnipotent steaming and baking box, and resistant to elevated temperatures clear glass covers on camera.After LED lamp is arranged on the thermostable transparent glass on the inboard wall of burner hearth side plate of omnipotent steaming and baking box, it comprises high temperature resistant ground glass, flexible graphite sealing ring, LED paster 7 and has the cast aluminium lampshade of radiator structure, and the outside of LED lamp connects stabilized voltage supply.
The detection method of food appearance Color Quality when the present invention cooks termination, its concrete steps are: 1) fix in the food color image of the last frame satisfaction of latter end video by color and luster monitoring touch-screen, delineate food product profile as illiteracy plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate; 2) for the latter end video of the unknown Color Quality index of another batch, a frame is arbitrarily selected to delineate food product profile as illiteracy plate in the cooking process middle and later periods in advance by color and luster monitoring touch-screen, then, ripe chrominance processing system is according to the ripe colourity of every frame of covering in plate calculating latter end video; 3) in ripe chrominance processing system to the latter end video of unknown Color Quality index, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, then abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard as that the match is successful, then, send early warning signal to culinary art control system, thus the mode of secession culinary art; 4) that latter end video end frame that the match is successful is passed to color and luster monitoring touch-screen, observe the satisfied color and luster image of predefine and the successful color and luster image of unknown Color Quality index video matching for user.
Wherein, complete the predefined color and luster that is satisfied with operate by chef, namely the end-frame image that fixes of color and luster monitoring touch-screen delineates food product profile and as the illiteracy plate in latter end video extraction food region, ripe chrominance processing system is according to the sequence number of last frame, and backward gets continuous print
x 1 two field picture is as latter end video; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; When extracting the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram press height descending sort, calculating the
mthe ripe chromaticity index of frame
, formula is
,
nfor the post number in histogram prostatitis 20%,
ifor post sequence number,
for the post value of correspondence,
for the intensity value of correspondence.For
x 1 two field picture,
m=1,2 ...,
x 1 , for
x 2 two field picture, then
m=1,2 ...,
x 2 .If
x 1 for the maximum frame number (getting a frame by 2 seconds intervals) that the picture frame eye-observation food color of latter end duration is stable, calculate the core values of the satisfied ripe chromaticity index value of chef
s t with fluctuation radius
r,
,
.The detection being completed another latter end video of unknown color and luster by non-chef personnel operates, a random two field picture of the culinary art middle and later periods video that namely fixes at color and luster monitoring touch-screen, delineates food product profile and as the illiteracy plate in latter end video extraction food region; Before ripe chrominance processing system sets the end time according to culinary art, the frame number of 4-5 minute is
nframe as the start frame of latter end video, latter end video length
x 2 be set to the frame number (getting a frame by 2 seconds intervals) of time half a minute; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; Calculate latter end video the successively
mthe ripe chromaticity index of frame
; If detect latter end 70-90%'s
s n ripe chromaticity index does not meet the core values of the satisfied ripe chromaticity index value of predefine chef
s t with fluctuation radius
rscope, then successively from
n+ 1 frame is start frame, continues
x 2 frame detects, until the match is successful.
Apparatus and method of the present invention make use of computer vision technique, the intelligentized control method culinary art termination time, thus ensure the Color Quality of food appearance in baking box burner hearth.
Accompanying drawing explanation
Fig. 1 is video acquisition system device schematic diagram;
Fig. 2 is the work relationship schematic diagram of omnipotent steaming and baking box five systems;
Fig. 3 is that the monitoring of different batches color and luster stops culinary art workflow diagram automatically;
Fig. 4 is Color Quality consistance matching detection algorithm flow chart;
Fig. 5 is omnipotent steaming and baking box man-machine interactive interface functional schematic;
Fig. 6 is ripe chromaticity index
s n oscillogram.
Embodiment
As can be seen from Figure 1, video acquisition system of the present invention is arranged in omnipotent steaming and baking box burner hearth inner side wall plate, and comprise camera head, LED lamp, LED lamp is in immediately below camera head.
Wherein, camera head comprises camera 2, resistant to elevated temperatures clear glass, and camera 2 is arranged on the inboard wall of burner hearth side plate 3 of omnipotent steaming and baking box, and resistant to elevated temperatures clear glass covers on camera 2.
As a modification of the present invention mode, camera 2 is between bracket two cross bars, and just to the food court needing in burner hearth to monitor.Like this, the front of camera does not have cross bar and blocks middle section of finding a view, and can easily clearly take the food of culinary art.
After LED lamp 4 is arranged on the thermostable transparent glass on the inboard wall of burner hearth side plate 3 of omnipotent steaming and baking box, it comprises high temperature resistant ground glass 5, flexible graphite sealing ring 6, LED paster 7 and has the cast aluminium lampshade 8 of radiator structure, and the outside of LED lamp 4 connects stabilized voltage supply.Wherein, cast aluminium lampshade 8 is stainless steel inner lining reflection shield.
The gold-tinted sent due to traditional incandescent lamp bulb can affect the judgement of chef to the true color and luster of food materials, and the light source stability that incandescent lamp bulb provides is poor, therefore, the present invention uses the LED emitted white light instead, observes food color and be similar to observing effect under the outer natural light of burner hearth in simulated hearth.Be placed in the resistant to elevated temperatures clear glass on inwall due to LED lamp after, and itself also have the background light efficiency that one deck ground glass contributes to providing soft, double glazing effectively can separate the high-temperature hot air from burner hearth inside simultaneously, and light fixture itself adopts the aluminium matter structure with heat dissipation characteristics, guarantee that LED paster environment temperature in light fixture is in 60 DEG C, also can carry out vacuum coating in LED paster region, improve heat-resistant quality, contribute to extending LED mission life.The white light colour temperature that LED lamp 4 provides burner hearth to throw light on is at 6200K-6500K.Start after camera collection postponed for 2 seconds start-up time after LED is lighted, stop video acquisition when cooking and stopping; LED is lighted shutting when culinary art starts behind the door, extinguishes when to open.
Cook the work relationship of 5 systems in the conforming detection system of food appearance Color Quality when stopping as shown in Figure 2, namely the culinary art mode selecting button on man-machine interactive interface is inherited former omnipotent steaming and baking box mode of operation and is controlled culinary art control system, burner hearth scene video is delivered to the color and luster monitoring touch-screen on ripe chrominance processing system and man-machine interactive interface by video acquisition system, the early warning information that ripe chrominance processing system draws is delivered to culinary art control system, simultaneously the unknown video end frame of ripe chrominance processing system coupling and predefine video end frame pass to color and luster monitoring touch-screen, color and luster monitoring touch screen operation information on man-machine interactive interface passes to ripe chrominance processing system.
Omnipotent steaming and baking box original culinary art mode selecting button is almost constant, only increase the termination time function of vernier control culinary art, because the time period affecting foodstuff surface color and luster satisfaction most critical is cooking process be about to stop last 3-5 minute, if culinary art control system, when this time period receives the early warning signal of ripe chrominance processing system, enters " the mode of secession " in advance and makes cooking system stop.The effect of video acquisition system is the lighting environment by improving baking box burner hearth, and convenient operation personnel are across the true color and luster of kitchen door glass observation food appearance, ripe chrominance processing system, accept to monitor food region information and satisfied food color image in touch-screen selected digital image from color and luster, through image procossing, extract the ripe chromaticity index of food region based on saturation degree (S), then, adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end, after the match is successful, send early warning signal to culinary art control system, culinary art device work device is made to enter cooking system " the mode of secession ", and make color and luster monitoring touch-screen display predefine and this image that the match is successful of man-machine interactive interface.
Use the present invention automatically to stop culinary art workflow diagram as shown in Figure 3 to the monitoring of different batches color and luster: after food is put into omnipotent steaming and baking box, culinary art control system normally starts, and selects culinary art pattern; Gather the image in cooking process, first cooked the image of rear satisfaction by chef predefine first, and automatically calculate predefined latter end video Color Quality index; Then, remaining cooking process, by general human users, can calculate the ripe colourity of unknown latter end frame of video automatically by system, and with predefined video Color Quality Indexes Comparison; Send culinary art early warning signal during coupling, feed back to and normally cook control procedure, thus stop cooking process.
The conforming detection method of food appearance Color Quality of the present invention, its concrete steps are: 1) fix in the food color image of the last frame satisfaction of latter end video by color and luster monitoring touch-screen, delineate food product profile as illiteracy plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate, the food color image of the last frame satisfaction of latter end video is here the color and luster image of the baked food of last consignment of, is predefined ripe colourity; 2) by the latter end video of color and luster monitoring touch-screen for another unknown Color Quality index, food product profile is delineated in advance at the middle and later periods of a cooking process random frame, then, ripe chrominance processing system is according to the ripe colourity of every frame of covering in plate calculating latter end video, the latter end video of unknown Color Quality index here refers to and is undefined ripe colourity by the latter end video of the food roasted; 3) in ripe chrominance processing system to the latter end video of the unknown, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, then abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard as that the match is successful, then, send early warning signal to culinary art control system, thus the mode of secession culinary art; 4) that fragment end frame that the match is successful is passed to color and luster monitoring touch-screen, observe the satisfied color and luster image of predefine and the successful color and luster image of unknown video matching for user.
Wherein, ripe chrominance processing system is a dsp system, and the concrete steps of this system cloud gray model algorithm are: 1) first process the food color image that predefine is satisfied with standard: i.e. 1-1) input predefine latter end video continuous print
x 1 frame; 1-2) it is converted to HSV model by RGB; 1-3) extract channel S and cover plate inner region; 1-4) the histogram of S value in zoning; 1-5) by n post before descending extraction histogram, calculate weighted mean
s n as ripe chromaticity index; 1-6) calculate the ripe colourity average of latter end frame of video
s t and fluctuation radius R is as the scope of predefine latter end video Color Quality; 2) another latter end video of the unknown lustre index of aftertreatment, 2-1) input the last continuous print of another unknown video
x 2 two field picture; 2-2) it is converted to HSV model by RGB; 2-3) extract channel S and cover plate inner region; 2-4) the histogram of S value in zoning; 2-5) by n post before descending extraction histogram, calculate
s n as ripe chromaticity index; 2-6) adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end: namely judge Xn frame 70-90%'s
s n whether in the scope of predefine latter end video Color Quality, if so, then the match is successful, sends early warning signal, terminates culinary art; If not, then a frame of postponing, re-enters the last continuous print of unknown video
x 2 two field picture, repeats step 2), until the match is successful, terminate culinary art.The process flow diagram of algorithm as shown in Figure 4.
In ripe chrominance processing system: because hsv color model triple channel component is independent, and saturation degree S component can objectively respond the color and luster change that the raw ripe process of food causes, and therefore, take S as parameter, constructs ripe chromaticity index.
During concrete operations, fixed in the food color image of the last frame satisfaction of latter end video by color and luster monitoring touch-screen, delineate food product profile as illiteracy plate, then, backward gets continuous print
x 1 frame is as latter end video; Every two field picture is all pressed and is covered web wheel exterior feature as initial profile, adopt Level Set Method (LiC, XuC, GuiC, etal.Distanceregularizedlevelsetevolutionanditsapplicati ontoimagesegmentation [J] .ImageProcessing, IEEETransactionson.2010,19 (12): 3243-3254.) expand outward to border, extract food area image.Extracting the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram press height descending sort, calculating the
mthe ripe chromaticity index of frame
, formula is
,
nfor the post number in histogram prostatitis 20%,
ifor post sequence number,
for the post value of correspondence,
for the intensity value of correspondence.For
x 1 frame latter end video,
m=1,2 ...,
x 1 , for
x 2 frame latter end video, then
m=1,2 ...,
x 2 .If
x 1 for the maximum frame number (getting a frame by 2 seconds intervals) that latter end video eye-observation food color is stable, calculate the core values of the satisfied ripe chromaticity index value of chef
s t with fluctuation radius
ras predefine video Color Quality indication range,
,
.If
x 2 for the frame number (getting a frame by 2 seconds intervals) of another latter end video time half a minute of the unknown, the start frame of latter end
nfor 4-5 minute before the distance setting end time, calculate this by previous methods
x 2 individual ripe chromaticity index, if should
x 2 individual ripe chromaticity index drops on the proportion threshold value less than a setting in predefined scope, then abandon first frame, increase the new frame after last frame as last frame, and calculate the new ripe chromaticity index of last frame, so constantly statistics
x 2 individual ripe chromaticity index drops on the actual ratio in predefined scope, until actual ratio is not less than the proportion threshold value of setting, shows that in unknown video image, food color meets predefined category, then send early warning signal to culinary art control system, terminate cooking process in advance, and by current
x 2 the last frame of individual frame passes to color and luster monitoring touch-screen, observes the satisfied color and luster image of predefine and the unknown detects the satisfied color and luster image of coupling automatically for user.
Man-machine interactive interface function as shown in Figure 5, be divided into culinary art mode selecting button and color and luster monitoring touch-screen two part, wherein color and luster monitoring touch-screen provides video playback capability, be convenient to the food color image that chef observes burner hearth video material and the display chef satisfaction coming from video acquisition system, and provide chef to define its satisfied food color quality function; Cook the operating function that mode selecting button provides various routine simultaneously, be convenient to chef and select suitable culinary art pattern according to food materials in man-machine interactive interface.
After the work of culinary art preorder completes, once shut oven door, start culinary art button, color and luster monitoring touch-screen starts to show the real-time video of scene in burner hearth, after terminating Deng culinary art, display video end-frame image, if chef is satisfied to food color on this image, then can predefine latter end video food color quality as under same cooked mode, the pattern that after such food materials, appearance color and luster is satisfied, namely need it on color and luster monitoring touch-screen, in food, delineate a closed region with finger, screen shows the region contour line that it is delineated, if dissatisfied, can again delineate, the illiteracy plate of this Confined outline curve as latter end Video processing is confirmed after satisfied.Ripe chrominance processing system completes latter end video Color Quality indication range after monitoring and covering plate calculates.If when again cooking such food materials, select same culinary art pattern, due to same food materials because volume and shape there are differences with predefined food materials, same cooking time can not ensure same color and luster, because the present invention has the function entering cooking system " the mode of secession " in advance, therefore, culinary art control system automatically prolongs and terminates the terminal time 1-2 minute of culinary art, because the early stage food materials at cooking process cause physics and chemistry attribute to change because being heated, there is the phenomenon (as roasting whole chicken) of volume and change of shape, for reducing the variability of frame sequence image food materials position to the impact of covering plate, need food materials shape that the stage of significant change no longer occurs, namely cook the middle and later periods and get a frame at random by other users (can chef be liberated), color and luster monitoring touch-screen delineates the illiteracy plate of food therein region contour as latter end Video processing again.Ripe chrominance processing system adopts the coupling of the unknown video image of mode identification method fuzzy reasoning and predefine video image, after the match is successful, display screen shows predefine image and this latter end video end-frame image side by side, due to screen size restriction, only display normal picture horizontal width half, intercepts the topography that region, center comprises food materials automatically.
Below by the process of establishing of roast chicken description of test the inventive method.
Buy a collection of 600 ~ 800g, decaptitate pawl light chicken, stand-by after pickled flavouring process.
Dark culinary art pattern in selected roast chicken on the touch screen operation button of man-machine interactive operation system, culinary art duration is predisposed to 25 minutes.Omnipotent steaming and baking box carries out burner hearth preheating after starting, and then first light chicken (704g) is placed in pallet central authorities and puts on the tray rack of burner hearth camera watch region, close upper furnace door, cooking process starts.Scene video in the touch screen interface display burner hearth of man-machine interactive operation system, after cooking process terminates, video freezing, in last frame, is assumed to be the color and luster image that chef is satisfied, encloses at roast chicken border inside-paint one with finger.Ripe chrominance processing system frame sampling speed is 0.5 frame/second, if
x 1 =36 seconds, in this latter end time, because the satisfied food color picture frame of eye-observation almost cannot differentiation, therefore, calculate the ripe chromaticity index comprising last frame backward totally 18 frames
s n , deduce out the core values of ripe chromaticity index
s t =0.8686 and fluctuation radius R=0.0074, be the standard color that predefine roast chicken is satisfied.
Second light chicken (680g) still adopt existing in dark culinary art pattern, culinary art duration system automatically prolongs 2 minutes, to ensure that grace time ensures that may meet with slightly large light chicken also obtains same processing quality, when after the upper furnace door of pass, when culinary art was by about 15 minutes, we in color and luster monitoring touch-screen display burner hearth, scene video arbitrarily specify a frame, on two field picture, roast chicken in-profile is delineated as illiteracy plate with finger, ripe chrominance processing system started the ripe chromaticity index calculating every frame 20 minutes time, if
x 2 =10, meeting the proportion threshold value that predefined roast chicken is satisfied with standard color is 0.8, adds up this 10 frame
s n , detect and meet the ratio that predefined roast chicken is satisfied with standard color, when culinary art proceeds to 22 points and 18 seconds, ripe chrominance processing system sends early warning signal, terminates cooking process.Left half figure of color and luster monitoring touch-screen display of man-machine interactive interface is region, predefine scene last frame image level center, region, end-frame image level center when right half figure is unknown video latter end Color Quality coupling.
3rd (653g), the 4th light chicken (795g) mode of operation are with second, and just the culinary art end time is different.3rd light chicken cook 22 points 56 seconds, the 4th light chicken is cooked 25 points and terminates for 22 seconds.Eye-observation, four roast chicken appearance color and lusters are similar, a few indifference.
5th (690g) light chicken is selected with culinary art pattern above, and just arranging the termination time is 25 minutes, and the middle operation not taking the ripe colourity of automatic discrimination and premature termination culinary art, has guaranteed the cooking process of 25 minutes.
6th (742g) light chicken selects look culinary art pattern in roast chicken, and just arranging the termination time is 25 minutes, and the middle operation not taking the ripe colourity of automatic discrimination and premature termination culinary art, has guaranteed the cooking process of 25 minutes.
Take out the burner hearth scene video of first, the 5th and the 6th roast chicken, carry out emulating ripe colourity process at Matlab2011 platform, frame of video sampling rate is 0.5 frame/second, every section of video gets last 70 frames, three sections of video image initial profiles adopt the illiteracy plate of circle as latter end Video processing of same radius, the level set parameter of same characteristic, the closed curve that circle is extended to close to food border, calculates the ripe chromaticity index in this region
s n , as shown in Figure 6.A1 line and a2 line are the index of first and the 5th roast chicken, because culinary art pattern is identical, color grade is middle dark color, a1 line and a2 line weave in, a3 line is the index of the 6th roast chicken, and the 6th roast chicken culinary art pattern color grade select in look, so a3 line away from it two, verify that ripe chromaticity index can monitor the quality of food color, 15 frames and last 25 frames before a1 line and a2 line itself
s n close, can judge that front 10 frames of a2 line are consistent with the predefined Color Quality of a1 line, therefore, the cooking time that checking reaches same Color Quality is not an equal time length, can terminate cooking process in advance.
The good effect of patent of the present invention is: by the video acquisition system in omnipotent steaming and baking box, be captured in the surface color image in the raw ripe change procedure of food materials in actual cooking process in burner hearth, the ripe chromaticity index parameter of food materials in burner hearth can be followed the tracks of, omnipotent steaming and baking box is made to possess the function of memory food color, meet the needs gathering parameter monitoring in culinary art control procedure, thus the analysis realized its cooked mode and research.In addition, food materials appearance Color Quality detection method when culinary art stops makes the user of omnipotent steaming and baking box elect veteran chef, only need once by image define intuitively food ripe time color and luster, even later inexperienced new cook also can operate the food that omnipotent steaming and baking box cooks same quality, the degree of dependence to experienced cook when decreasing food repeatability cooking techniques.
Claims (5)
1. food appearance Color Quality conforming detection method when culinary art stops, its concrete steps are:
1) fix in the food color image of the last frame satisfaction of latter end video by color and luster monitoring touch-screen, delineate food product profile as illiteracy plate, then, ripe chrominance processing system calculates the ripe colourity of the every frame of latter end video and the Color Quality index of latter end video food according to covering plate;
2) for the latter end video of the unknown Color Quality index of another batch, a frame is arbitrarily selected to delineate food product profile as illiteracy plate in the cooking process middle and later periods in advance by color and luster monitoring touch-screen, then, ripe chrominance processing system is according to the ripe colourity of every frame of covering in plate calculating latter end video;
3) in ripe chrominance processing system to the latter end video of unknown Color Quality index, detect the degree that the ripe colourity of its frame meets predefined latter end video Color Quality index, if do not meet, then abandon the first frame of latter end, increase a new last frame, detect the degree that the new ripe colourity of latter end frame meets predefined latter end video Color Quality index, until meet predefined Color Quality indication range, regard as that the match is successful, then, send early warning signal to culinary art control system, thus the mode of secession culinary art;
4) that latter end video end frame that the match is successful is passed to color and luster monitoring touch-screen, observe the satisfied color and luster image of predefine and the successful color and luster image of unknown Color Quality index video matching for user.
2. detection method according to claim 1, is characterized in that: ripe chrominance processing system is a dsp system, and the concrete steps of this system cloud gray model algorithm are:
1) the food color image that predefine is satisfied with standard is first processed: i.e. 1-1) input predefine latter end video continuous print X
1frame; 1-2) it is converted to HSV model by RGB; 1-3) extract channel S and cover plate inner region; 1-4) the histogram of S value in zoning; 1-5) by n post before descending extraction histogram, calculate weighted mean S
nas ripe chromaticity index; 1-6) calculate the ripe colourity average S of latter end frame of video
tand fluctuation radius R is as the scope of predefine latter end video Color Quality;
2) another latter end video of the unknown lustre index of aftertreatment, 2-1) input the last continuous print X of another unknown video
2two field picture; 2-2) it is converted to HSV model by RGB; 2-3) extract channel S and cover plate inner region; 2-4) the histogram of S value in zoning; 2-5) by n post before descending extraction histogram, calculate S
nas ripe chromaticity index; 2-6) adopt the some frame video images of latter end of mode identification method fuzzy reasoning the unknown and the coupling of the some frame video images of predefine latter end: the S namely judging Xn frame 70-90%
nwhether in the scope of predefine latter end video Color Quality, if so, then the match is successful, sends early warning signal, terminates culinary art; If not, then a frame of postponing, re-enters the last continuous print X of unknown video
2two field picture, repeats step 2), until the match is successful, terminate culinary art.
3. detection method according to claim 2, is characterized in that: hsv color model is that triple channel component is independent, and saturation degree S component can objectively respond the color and luster change that the raw ripe process of food causes, and therefore, take S as parameter, constructs ripe chromaticity index.
4. detection method according to claim 1 and 2, it is characterized in that: in step 1: complete the predefined color and luster that is satisfied with by chef and operate, namely the end-frame image that fixes of color and luster monitoring touch-screen delineates food product profile and as the illiteracy plate in latter end video extraction food region, ripe chrominance processing system is according to the sequence number of last frame, and backward gets continuous print X
1two field picture is as latter end video; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; When extracting the histogram of S component, because the food colour of main flow is in the great majority, for avoiding variegated interference, histogram being pressed height descending sort, calculating the ripe chromaticity index of m frame
formula is
n is the post number in histogram prostatitis 20%, and i is post sequence number, p
ifor the post value of correspondence, s
ifor the intensity value of correspondence.For X
1two field picture, m=1,2 ..., X
1, for X
2two field picture, then m=1,2 ..., X
2.If X
1for the maximum frame number (getting a frame by 2 seconds intervals) that the picture frame eye-observation food color of latter end duration is stable, calculate the core values S of the satisfied ripe chromaticity index value of chef
twith fluctuation radius R,
5. detection method according to claim 1 and 2, it is characterized in that: in step 2: the detection being completed another latter end video of unknown color and luster by non-chef personnel operates, namely fix at color and luster monitoring touch-screen the random two field picture of culinary art middle and later periods video, delineates food product profile and as the illiteracy plate in latter end video extraction food region; Before ripe chrominance processing system sets the end time according to culinary art, the frame number of 4-5 minute is the start frame of frame as latter end video of N, latter end video length X
2be set to the frame number (getting a frame by 2 seconds intervals) of time half a minute; Food materials interior zone covers the closed outline of plate as initial profile, adopts Level Set Method to expand outward to border, extracts food area image; Calculate the ripe chromaticity index of latter end video m frame successively
if the S of latter end 70-90% detected
nripe chromaticity index does not meet the core values S of the satisfied ripe chromaticity index value of predefine chef
twith fluctuation radius R scope, be then start frame from N+1 frame successively, continue X
2frame detects, until the match is successful.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310523386.XA CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310523386.XA CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103592227A CN103592227A (en) | 2014-02-19 |
| CN103592227B true CN103592227B (en) | 2016-02-03 |
Family
ID=50082454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310523386.XA Active CN103592227B (en) | 2013-10-30 | 2013-10-30 | The food conforming detection system of appearance Color Quality and detection method when culinary art stops |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103592227B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3292738B1 (en) | 2015-05-05 | 2020-12-30 | June Life, Inc. | A connected oven |
| US10739013B2 (en) | 2015-05-05 | 2020-08-11 | June Life, Inc. | Tailored food preparation with an oven |
| US12222107B2 (en) | 2015-06-01 | 2025-02-11 | June Life, Llc | Thermal management system and method for a connected oven |
| CN106851182B (en) * | 2015-12-04 | 2024-06-18 | 彭翔 | Intelligent vision monitoring system of laser processing system |
| CN107340718B (en) * | 2017-06-30 | 2021-05-18 | 北京小米移动软件有限公司 | Method and device for adjusting parameters of intelligent lamp |
| CN109447938B (en) * | 2017-08-31 | 2022-01-25 | 宁波方太厨具有限公司 | Detection method and detection device for baking performance of oven |
| US11116050B1 (en) | 2018-02-08 | 2021-09-07 | June Life, Inc. | High heat in-situ camera systems and operation methods |
| CN111345699B (en) * | 2018-12-20 | 2022-06-28 | 九阳股份有限公司 | Control method of cooking equipment and cooking equipment |
| CN110234040B (en) * | 2019-05-10 | 2022-08-09 | 九阳股份有限公司 | Food material image acquisition method of cooking equipment and cooking equipment |
| DK4061187T3 (en) | 2019-11-20 | 2025-06-30 | June Life Llc | Method for assessing cooking time for food |
| EP4046551A4 (en) * | 2019-11-20 | 2023-02-22 | Guangdong Midea Kitchen Appliances Manufacturing Co., Ltd. | Cooking apparatus, control method thereof, heating control method, and server |
| CN110887069A (en) * | 2019-11-20 | 2020-03-17 | 广东美的厨房电器制造有限公司 | Cooking apparatus, control method of cooking apparatus, and computer-readable storage medium |
| WO2021184003A1 (en) | 2020-03-13 | 2021-09-16 | June Life, Inc. | Method and system for sensor maintenance |
| US11593717B2 (en) | 2020-03-27 | 2023-02-28 | June Life, Inc. | System and method for classification of ambiguous objects |
| WO2022036321A1 (en) | 2020-08-14 | 2022-02-17 | June Life, Inc. | System and method for targeted heating element control |
| CN111990902A (en) * | 2020-09-30 | 2020-11-27 | 广东美的厨房电器制造有限公司 | Cooking control method and device, electronic equipment and storage medium |
| US20220117274A1 (en) * | 2020-10-20 | 2022-04-21 | June Life, Inc. | Intelligent cooking system and method |
| USD978600S1 (en) | 2021-06-11 | 2023-02-21 | June Life, Inc. | Cooking vessel |
| USD1007224S1 (en) | 2021-06-11 | 2023-12-12 | June Life, Inc. | Cooking vessel |
| CN114652177A (en) * | 2022-04-06 | 2022-06-24 | 江苏狼王机械科技有限公司 | A kind of spiral steamer equipment and control system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101234381A (en) * | 2008-03-07 | 2008-08-06 | 天津市华核科技有限公司 | Granular material sorting classifying method based on visual sense recognition |
| CN101561402A (en) * | 2009-05-07 | 2009-10-21 | 浙江大学 | Machine vision-based real-time detection and grading method and machine vision-based real-time detection and grading device for pork appearance quality |
| CN102563578A (en) * | 2011-11-30 | 2012-07-11 | 厦门市松竹精密科技有限公司 | Application of flexible graphite to field of radiating of LED lamp |
| CN102829456A (en) * | 2011-06-17 | 2012-12-19 | 上海衍易电气设备科技有限公司 | LED lamp cooling component and production method thereof |
| CN203101258U (en) * | 2013-01-29 | 2013-07-31 | 安徽华菱西厨装备股份有限公司 | Testing device for testing color and luster changing process of foods in steam oven |
| CN103322436A (en) * | 2012-03-22 | 2013-09-25 | 武汉南格尔科技有限公司 | Structure of LED lamp |
-
2013
- 2013-10-30 CN CN201310523386.XA patent/CN103592227B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101234381A (en) * | 2008-03-07 | 2008-08-06 | 天津市华核科技有限公司 | Granular material sorting classifying method based on visual sense recognition |
| CN101561402A (en) * | 2009-05-07 | 2009-10-21 | 浙江大学 | Machine vision-based real-time detection and grading method and machine vision-based real-time detection and grading device for pork appearance quality |
| CN102829456A (en) * | 2011-06-17 | 2012-12-19 | 上海衍易电气设备科技有限公司 | LED lamp cooling component and production method thereof |
| CN102563578A (en) * | 2011-11-30 | 2012-07-11 | 厦门市松竹精密科技有限公司 | Application of flexible graphite to field of radiating of LED lamp |
| CN103322436A (en) * | 2012-03-22 | 2013-09-25 | 武汉南格尔科技有限公司 | Structure of LED lamp |
| CN203101258U (en) * | 2013-01-29 | 2013-07-31 | 安徽华菱西厨装备股份有限公司 | Testing device for testing color and luster changing process of foods in steam oven |
Non-Patent Citations (4)
| Title |
|---|
| Distance Regularized Level Set Evolution and Its Application to Image Segmentation;Chunming Li et.al;《IEEE Transactions On Image Processing》;20101231;第19卷(第12期);3242-3254 * |
| Improving quality inspection of food products by computer vision——a review;Tadhg Brosnan, Da-Wen Sun;《Journal of Food Engineering》;20041231;第61卷;3-16 * |
| 一种新的LED 灯具散热技术;黄硕，王明亮;《现代显示》;20100531(第112期);1 现有LED灯具散热结构第1段，图1 * |
| 图象和视频的检索技术;樊凌涛，陈健;《计算机工程与应用》;20010930;71-76，83 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103592227A (en) | 2014-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103592227B (en) | The food conforming detection system of appearance Color Quality and detection method when culinary art stops | |
| CN108309021B (en) | Intelligent regulation automatic cooker and intelligent control method thereof | |
| CN109445485B (en) | Cooking appliance control method and cooking appliance | |
| CN109213015B (en) | A kind of control method and cooking apparatus of cooking apparatus | |
| WO2020207293A1 (en) | Method and device for automatically cooking food | |
| US20180202667A1 (en) | Dynamic heat adjustment of a spectral power distribution configurable cooking instrument | |
| CN107504524A (en) | Method and device for processing abnormal work of gas stove, processor and range hood | |
| US4647746A (en) | Microwave ovens and methods of cooking food | |
| CN104042124A (en) | Intelligent oven and work control method thereof | |
| CN108742170A (en) | A kind of intelligent recognition cooking system of oven | |
| CN114839896A (en) | Intelligent cooking method and intelligent cooking utensil based on the maturity of ingredients | |
| CN110916533B (en) | Baking control method and device for baking equipment, baking equipment and toaster | |
| CN114305153B (en) | Food heating temperature control method and device of intelligent oven and storage medium | |
| CN204254706U (en) | The smoke exhaust of automatic control | |
| CN113167721A (en) | Cooking appliance and method for operating a cooking appliance | |
| WO2016131109A1 (en) | System to monitor foodstuff cooking | |
| CN208822472U (en) | A kind of steaming and baking box of controllable food therein temperature | |
| CN108513104A (en) | Intelligent dining table oily waste degradation platform | |
| DE102019107828B4 (en) | Method for operating a cooking appliance and cooking appliance | |
| CN114840039B (en) | Intelligent instant cooking method and intelligent instant cooking device thereof | |
| CN114222517B (en) | Operation of a household cooking appliance having at least one camera | |
| CN114831501A (en) | Method for acquiring surface maturity curve of food material and intelligent cooking appliance thereof | |
| CN114840038A (en) | Intelligent cooking sharing method and cooking device | |
| CN211268335U (en) | A fully automatic baking device for moon cakes based on machine vision | |
| CA1279378C (en) | Microwave ovens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |