WO2022156707A1 - Light supplementing method and light supplementing apparatus for dishwasher, and dishwasher - Google Patents

Light supplementing method and light supplementing apparatus for dishwasher, and dishwasher Download PDF

Info

Publication number
WO2022156707A1
WO2022156707A1 PCT/CN2022/072725 CN2022072725W WO2022156707A1 WO 2022156707 A1 WO2022156707 A1 WO 2022156707A1 CN 2022072725 W CN2022072725 W CN 2022072725W WO 2022156707 A1 WO2022156707 A1 WO 2022156707A1
Authority
WO
WIPO (PCT)
Prior art keywords
brightness
light
image
value
brightness value
Prior art date
Application number
PCT/CN2022/072725
Other languages
French (fr)
Chinese (zh)
Inventor
范志恒
全永兵
魏中科
陈蔚
王彩霞
Original Assignee
佛山市顺德区美的洗涤电器制造有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110071263.1A external-priority patent/CN112890727A/en
Priority claimed from CN202110071265.0A external-priority patent/CN112911162B/en
Priority claimed from CN202110071269.9A external-priority patent/CN112890728A/en
Priority claimed from CN202110069559.XA external-priority patent/CN112890714A/en
Application filed by 佛山市顺德区美的洗涤电器制造有限公司 filed Critical 佛山市顺德区美的洗涤电器制造有限公司
Publication of WO2022156707A1 publication Critical patent/WO2022156707A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/42Details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene

Definitions

  • the present application relates to the technical field of kitchen and bathroom appliances, and in particular, to a light-filling method, a light-filling device and a dishwasher for dishwashers.
  • the washing area of the inner cavity of the dishwasher is usually provided with a fill light.
  • the current common design scheme is to make the camera and the fill light into an integral component, that is, the inner hole is the opening of the camera, and the outer ring is the design of the fill light. This not only facilitates the leads, but also reduces the number of openings.
  • this design also has disadvantages, because its size cannot be made very large, and its proportion is too small relative to the inner cavity of the dishwasher, which is equivalent to a point light source. Due to the structural characteristics of the fill light, it is easy to cause the edge area to be relatively dark, which leads to the loss of part of the information in the collected image, which eventually leads to inaccurate image recognition and does not meet the user's expected experience.
  • the purpose of the present application is to provide a light-filling method, a light-filling device and a dishwasher for a dishwasher.
  • a method for supplementing light for a dishwasher includes an image acquisition device for acquiring an image of a cleaning area in the dishwasher; a main supplementary light , used to fill light on the image; at least one secondary fill light is used to fill the edge area of the image; the fill light method includes: acquiring an image; obtaining a first brightness value of the image according to the image; In the case of being within the preset first brightness range, obtain the second brightness value of the edge area of the image according to the image; when the second brightness value is outside the preset second brightness range, adjust the secondary fill light brightness to adjust the second brightness value.
  • the method further includes: when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value.
  • adjusting the brightness of the main fill light to adjust the first brightness value includes: when the first brightness value is smaller than the first brightness range In the case of the limit value, increase the brightness of the main fill light to increase the first brightness value; when the first brightness value is greater than the upper limit of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value. a brightness value.
  • obtaining the first brightness value of the image according to the image includes: obtaining a brightness histogram of the image; and weighting and summing the brightness values of each pixel in the brightness histogram to obtain the first brightness value.
  • the at least one auxiliary supplementary light includes a first auxiliary supplementary light and a second auxiliary supplementary light, and the first auxiliary supplementary light and the second auxiliary supplementary light are respectively disposed on the left and right sides of the image capturing device.
  • adjusting the brightness of the auxiliary fill light to adjust the second brightness value includes: In the case where the second brightness value on the left side of the left edge area is outside the second brightness range, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left side; in the right edge area, the second brightness value on the right side is adjusted When the value is outside the second brightness range, adjust the brightness of the second auxiliary light to adjust the second brightness value on the right.
  • obtaining the second brightness value of the edge region of the image according to the image includes: dividing the image into multiple regions; extracting edge regions in the multiple regions according to the field of view angle of the main fill light; determining the edge region The second brightness value of ; wherein the second brightness value is the average value of the brightness values of the edge region.
  • the main supplementary light and the auxiliary supplementary light are individually controlled through different pulse width modulation signals.
  • a light supplement device for a dishwasher comprising: an image acquisition device for acquiring an image of a cleaning area; a main supplement light lamp, arranged around the image acquisition device and used for cleaning In the area, the area corresponding to the central area of the image is filled with light; at least one auxiliary fill light is arranged on at least one side of the main fill light, and is used to fill in the area corresponding to the edge area of the image in the cleaning area; a processor configured to: acquire an image; obtain a first brightness value of the image according to the image; and obtain a second brightness value of an edge region of the image according to the image when the first brightness value is within a preset first brightness range ; In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
  • the processor is further configured to adjust the brightness of the main fill light to adjust the first brightness value when the first brightness value is outside the first brightness range.
  • the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes that the processor is configured to: in the case that the first brightness value is less than the lower limit value of the first brightness range, The brightness of the main fill light is increased to increase the first brightness value; when the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is decreased to reduce the first brightness value.
  • the processor is configured to obtain the first brightness value of the image according to the image, and is configured to: obtain a brightness histogram of the image; weight and sum the brightness values of each pixel in the brightness histogram to obtain the first brightness value of the image. a brightness value.
  • the supplementary light device includes: a first secondary supplementary light, which is arranged on the left side of the image acquisition device; a second supplementary supplementary light, which is provided on the right side of the image acquisition device; the processor is configured to In the case where the second brightness value is not located in the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes that the processor is configured to: the second brightness value on the left side of the left edge area is located in the second brightness range If the brightness is outside the range of the second brightness, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left; if the second brightness value on the right edge of the right edge area is outside the second brightness range, adjust the second brightness The brightness of the fill light to adjust the second brightness value on the right.
  • the configuration of the processor to acquire the second brightness value of the edge region of the image includes that the processor is configured to: divide the image into a plurality of regions; extract a plurality of an edge region in the region; determining a second brightness value of the edge region; wherein the second brightness value is an average value of the brightness values of the edge region.
  • it further includes: a first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; a second pulse width modulation device, which is electrically connected to The first auxiliary light is used to adjust the brightness of the first auxiliary light by controlling the duty ratio; the third pulse width modulation device, which is electrically connected to the second auxiliary light, is used to adjust the first auxiliary light by controlling the duty cycle.
  • the brightness of the second fill light is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio.
  • a dishwasher including the above-mentioned light supplement device for a dishwasher.
  • a machine-readable storage medium is provided, and instructions are stored on the machine-readable storage medium, and when executed by a processor, the instructions are used to enable the processor to execute the above-mentioned method for a dishwasher. fill light method.
  • a computer program product including a computer program, wherein the computer program, when executed by a processor, implements the above-mentioned light supplement method for a dishwasher.
  • the supplementary light method provided by the embodiments of the present application uses a secondary supplementary light to supplement light in the washing area of the dishwasher, thereby solving the existing problems in the design of using supplementary light to surround the image acquisition device in the prior art.
  • the edge area is dark, by acquiring the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, the brightness of the edge area is checked.
  • Evaluation that is, obtaining the second brightness value, and in the case that the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the sub-fill light, so as to improve the brightness balance of the image, so that The information of image recognition is not missing, the accuracy of image recognition is improved, and the user experience is improved.
  • FIG. 1 schematically shows a schematic structural diagram of a dishwasher under conventional conditions
  • FIG. 2 schematically shows a schematic structural diagram of a dishwasher light-filling device to which the light-filling method for dishwashers provided according to the first embodiment of the present application is applied;
  • FIG. 3 is a flow chart of a light supplement method for a dishwasher provided by the first embodiment of the present application
  • FIG. 4 is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the application;
  • FIG. 5 is a flowchart of step S15 in the light supplement method for a dishwasher provided by the first embodiment of the application;
  • FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
  • FIG. 7 is a schematic diagram of an exemplary demonstration step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
  • FIG. 8 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
  • FIG. 9 is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
  • FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the application.
  • FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
  • step S24 is a further flow chart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
  • FIG. 13 is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the application;
  • FIG. 14 schematically shows a schematic structural diagram of a dishwasher light-filling device applied by a light-filling method for a dishwasher provided according to the third embodiment of the present application;
  • FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by the third embodiment of the application.
  • FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the application;
  • FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
  • FIG. 18 is a flowchart of a light supplement method for a dishwasher provided by the fourth embodiment of the present application.
  • FIG. 19 is another flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application.
  • FIG. 20 is a further flow chart of the light supplement method for dishwashers provided by the fourth embodiment of the present application; and FIG. 21 is the light supplement method for dishwashers provided by the fourth embodiment of the present application. It is a schematic diagram for demonstrating step S494.
  • Lighting device 11. Image acquisition equipment;
  • the embodiments of the present application provide a solution for fill light and image recognition for a dishwasher, the solution includes multiple embodiments, respectively including image acquisition of the cleaning area in the dishwasher, image discrimination, and control of fill lights Various aspects such as supplementary light are performed, and various aspects in the embodiments of the present application are described in detail below.
  • the first embodiment of the present application provides a fill light method for a dishwasher, which can fill light in a washing area in the dishwasher to better capture images, and the method aims to solve the problem of existing dishwashers.
  • the fill light surrounding the image acquisition device is used for fill light
  • the structural characteristics of the fill light easily lead to the problem that the edge area is relatively dark. This problem will lead to the lack of some information in the collected images, and the final image recognition process will be inaccurate, which will not meet the user's expected experience.
  • FIG. 1 schematically shows a schematic structural diagram of a dishwasher in a conventional situation.
  • the dishwasher 100 includes an image capture device 11 and a fill light 12 .
  • the image capturing device 11 and the fill light 12 are formed into an integral annular assembly.
  • the lead wires are convenient, and the number of openings in the inner wall of the dishwasher 100 can be reduced.
  • the inner hole is the opening of the image acquisition device 11
  • the outer ring is the fill light 12 .
  • this design also has disadvantages, because its size cannot be designed as large as the rectangular fill light.
  • the proportion of the fill light 12 is very small.
  • the light lamp 12 is equivalent to a point light source. Because the light has an incident angle (field of view) relative to the object rather than a parallel light, but the image capture device 11 captures the overall image of the cleaning area, this way of filling light will make the captured image of the cleaning area filled with
  • the central area covered by the light lamp 11 will be brighter than the peripheral area of the central area, that is, the central area is brighter than the peripheral area. If tableware is placed in the edge area, the image capturing device 11 may not be able to capture the image of the edge area well, which may result in partial information loss of the captured image.
  • FIG. 2 schematically shows a schematic structural diagram of a light supplementing device for a dishwasher to which the light supplementing method for a dishwasher provided according to the first embodiment of the present application is applied.
  • the supplementary light device 1 of the dishwasher 100 may include:
  • the image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
  • the main fill light 121 is used to emit light to the cleaning area to fill the cleaning area of the dishwasher 100;
  • the area corresponding to the central area (which can be called the central area) is filled with light;
  • At least one auxiliary supplementary light 122 is used for emitting light to the edge of the cleaning area to fill in the area (may be referred to as the edge area) in the cleaning area corresponding to the edge area of the image captured by the image acquisition device 11 .
  • the edge regions may be peripheral regions of the central region.
  • the main fill light 121 may be disposed around the image capturing device 11 , and the auxiliary fill light 122 may be disposed on one side of the main fill light 121 .
  • a general inventive concept provided by the embodiments of the present application is to add a secondary supplementary light 122 around the main supplementary light 121 to brighten the darker edge areas of the cleaning area not covered by the main supplementary light 121 .
  • the number of auxiliary supplementary lights 122 may not be limited, and the more auxiliary supplementary lights 122 are, the more uniform the illumination will be.
  • the secondary fill light 122 may face the same direction as the image capturing device 11 . In one example, the image acquisition device 11 may be on 4 sides of the lumen.
  • the image capturing device 11 may include a visible light camera; the main fill light 121 and the auxiliary fill light 122 may be white lights.
  • the image acquisition device 11 can be an infrared camera, and the main fill light 121 and the auxiliary fill light 122 can be infrared fill lights.
  • the applicable image acquisition device 11 described in this embodiment adopts a visible light camera, and the main fill light 121 and the auxiliary fill light 122 use white lights.
  • the supplementary light device 1 may include:
  • the first auxiliary light 122a is arranged on the left side of the image capturing device
  • the second auxiliary light 122b is arranged on the right side of the image capturing device.
  • the edge area can be filled with light by the first auxiliary light 122a and the second auxiliary light 122b, wherein the first auxiliary light 122a and the second auxiliary light 122b can be relative to the image acquisition device 11. They are arranged at intervals to prevent excessive interference between the light of the first supplementary light 122a and the second supplementary light 122b and the light of the main supplementary light 121 .
  • FIG. 3 is a flowchart of a method for supplementing light for a dishwasher provided by the first embodiment of the present application; based on the structure of the dishwasher described in the above embodiments, Light methods can include:
  • Step S11 acquiring an image
  • Step S12 obtaining the first brightness value of the image according to the image
  • Step S13 in the case that the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
  • Step S14 In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the secondary fill light to adjust the second brightness value.
  • the image acquisition device is first initialized, and waits for a signal that triggers the acquisition of the image acquisition device to perform acquisition.
  • the first brightness value of the image can be calculated according to the image.
  • the brightness distribution of the image can be evaluated, and then the first brightness value of the image can be evaluated.
  • the second brightness value and the second brightness range of the edge area can be evaluated according to the second brightness value of the edge area. It is determined that when the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
  • the first brightness range can be understood as the image in the first brightness range is neither overexposed nor overdark overall.
  • the first brightness range can be set according to requirements. Assume that the first brightness threshold for over-darkness is d1, and the second brightness threshold for over-exposure is d2, that is, when the brightness of the image is less than the first brightness threshold d1, the image as a whole is too dark, and when the brightness is greater than the second brightness threshold d2, At this point the entire image is overexposed. At this time, the first luminance range is d1 to d2. When the first brightness value is within the preset first brightness range, it is only considered that the image as a whole is not overexposed or too dark at this time. The covered edge areas will still be locally too dark.
  • the cleaning area can be divided into an area that can be covered by the main fill light (eg, a central area) and an edge area that cannot be covered by the main fill light.
  • the overall image of the area that can be covered by the main fill light can be judged, and when the first brightness value of the overall image satisfies the condition, the edge area in the image can be judged whether it is necessary to supplement the edge area. Light.
  • FIG. 4 is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the present application.
  • Obtaining the first brightness value of the image according to the image in step S12 may include:
  • Step S121 obtaining a grayscale histogram of the image
  • Step S122 Weighting and summing the luminance values of each pixel in the grayscale histogram to obtain a first luminance value.
  • a grayscale histogram can be counted on the overall image, where the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level.
  • the initial gray level of the gray histogram is set to 0, the x-axis of the histogram represents the gray value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the gray level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32.
  • the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram represents the number of intervals on the grayscale range of the image to be imaged, and can also be understood as the dimension of the one-dimensional array of the histogram.
  • step S122 is entered: weighted summation is performed on the luminance values of each pixel in the grayscale histogram to obtain a first luminance value.
  • Weighted summation involves averaging methods that include weights; usually in a set of data, the number of times a piece of data occurs is called a weight. The specific method is as follows: according to each brightness value (gray value) in the histogram, different weights are given; then the weights are multiplied by the number of pixels falling in the area, and all the results are added to obtain the above
  • the first brightness value obtained in step S12 is only a brightness reference value for judging the overall image, and can be calculated in other ways. Two mean operations are performed to obtain the first luminance value, which all belong to the protection scope covered by the embodiments of the present application.
  • the image can be transformed into an integer multiple of the image by imresize (imresize: zoom processing), so that the image can be easily displayed. identify.
  • the supplementary light method further includes: Step S15 : adjusting the brightness of the main supplementary light to adjust the first brightness value when the first brightness value is outside the first brightness range.
  • the first brightness value of the image is within the first brightness range
  • the first brightness value of the entire image can be calculated, and when the first brightness value is within the first brightness range, the edge region can be discriminated. If the first brightness value is outside the first brightness range, the brightness of the main fill light may continue to be adjusted until the first brightness value falls within the first brightness range.
  • step 15 when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value includes:
  • Step S151 when the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
  • Step S152 When the first brightness value is greater than the upper limit value of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value.
  • steps S151 to S152 when the image is overexposed or too dark, the overall image is filled or reduced by adjusting the brightness of the main fill light.
  • the adjustment method may be to adjust the brightness of the main fill light. Input voltage or adjust the duty cycle of the PWM signal used to control the main fill light.
  • FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
  • step S13 obtaining the second brightness value of the edge region of the image according to the image includes:
  • Step S131 Divide the image into multiple regions
  • Step S132 extracting edge regions in multiple regions according to the field of view of the main fill light
  • Step S133 Determine the second brightness value of the edge area.
  • the image is divided into multiple areas through image segmentation, and the range that can be covered by the main fill light is determined according to the field of view of the main fill light (you can obtain the cleaning area after the main fill light is lit separately. image, so as to obtain the range that the main fill light can cover), and according to the area covered by the main fill light, it will be removed from the entire area (multiple areas), thereby extracting multiple edge areas. Then, the second luminance value of the edge area is counted.
  • the second luminance value may be a weighted summation of the luminance values of each of the edge regions, and then an average value of the edge regions is calculated.
  • step S14 is performed: in the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
  • the first auxiliary fill light 122a and the second auxiliary fill light 122b are respectively arranged on the left and right sides of the image acquisition device, and are respectively used for image acquisition.
  • the left edge area and the right edge area of are filled with light.
  • adjusting the brightness of the sub-fill light to adjust the second brightness value includes: at the left side of the left edge area where the second brightness value is outside the second brightness range
  • adjust the brightness of the first auxiliary fill light 122a to adjust the second brightness value on the left side
  • adjust the second auxiliary fill light The brightness of the lamp 122b is adjusted to the right second brightness value.
  • the left second brightness value may refer to the second brightness value of the left edge region
  • the right second brightness value may refer to the second brightness value of the right edge region.
  • the adjustment method may include: if the second brightness value on the left is outside the second brightness range, in the case that the second brightness value on the left is less than the lower limit value of the second brightness range, adding a first auxiliary light When the brightness of 122a is greater than the lower limit of the second brightness range, the brightness of the first auxiliary light 122b is reduced.
  • the second auxiliary light 122b on the right can be adjusted according to the second brightness value and the second brightness range on the right, so as to keep the second brightness value of the edge area not too dark and not overexposed.
  • the main fill light and the auxiliary fill light are individually controlled by different pulse width modulation signals, and the brightness is controlled by controlling the duty ratio of the pulse width modulation signals.
  • the pulse width modulation signal is abbreviated as PWM signal, which modulates the bias of the transistor base or the gate of the MOS tube according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS tube, so as to realize the switching regulated power supply. Changes in output.
  • the adjustment is the adjustment of the duty cycle. By controlling the main fill light and the auxiliary fill light separately, it can adjust multiple areas of the cleaning area.
  • An embodiment of the present application further provides a light supplementing device for a dishwasher, where the supplementary light device includes an image acquisition device, a main supplementary light lamp, at least one auxiliary supplementary light lamp, and a processor.
  • the supplementary light device includes an image acquisition device, a main supplementary light lamp, at least one auxiliary supplementary light lamp, and a processor.
  • the image acquisition device is used to acquire the image of the washing area of the dishwasher
  • the main supplementary light is arranged around the image acquisition device and used to supplement the image
  • at least one auxiliary supplementary light is provided at least one of the main supplementary lights.
  • One side used to fill the edge area of the image.
  • the processor is configured to execute all or part of the steps of the light supplement method of the above embodiments.
  • the at least one auxiliary supplementary light includes: a first auxiliary supplementary light, which is arranged on the left side of the image acquisition device; and a second supplementary supplementary light, which is arranged on the right side of the image acquisition device.
  • the supplementary light device further includes an independently set first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; the second pulse width modulation The device is electrically connected to the first auxiliary supplementary light for adjusting the brightness of the first auxiliary supplementary light by controlling the duty cycle; the third pulse width modulation device is electrically connected to the second auxiliary supplementary light for controlling the The duty cycle adjusts the brightness of the second supplementary light.
  • the independently set first pulse width modulation device, second pulse width modulation device, and third pulse width modulation device the brightness of the main supplementary light, the first auxiliary supplementary light and the second supplementary supplementary light are respectively independent. control.
  • the supplementary light method provided by the embodiment of the present application uses the auxiliary supplementary light to supplement the light in the washing area of the dishwasher, thereby solving the problem of the existing edge area in the design of using supplementary light to surround the image acquisition device in the prior art.
  • For the problem of darkness by obtaining the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, evaluate the brightness of the edge area, that is, obtain The second brightness value, when the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the auxiliary light, thereby improving the brightness balance of the image, so that the information of image recognition can be improved. Not missing, improve the accuracy of image recognition, thereby improving the user experience.
  • the second embodiment of the present application provides a light supplement method for a dishwasher, which can supplement light in a washing area in the dishwasher faster and save energy.
  • the cameras of dishwashers Due to cost considerations in existing dishwashers, the cameras of dishwashers generally use ordinary cameras without AI auto-focus and exposure adaptive algorithms.
  • image processing technology is usually used to fine-tune the image, such as image brightness balance adjustment, so that the brightness of the image is more balanced to prevent overexposure or too dark, but the processing technology used for the image is often prone to distortion, resulting in poor results. And it cannot adapt to all environments, especially the inner cavity of the dishwasher is a closed environment. For example, when the user places the dishwasher in an environment with poor light, it is difficult for the image processing to achieve the expected effect, which is not expected by the user. experience.
  • the embodiments of the present application provide a method for supplementing light for a dishwasher, wherein the dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher.
  • FIG. 8 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
  • the fill light method may include:
  • Step S21 controlling the fill light to fill light with the initial brightness
  • Step S22 acquiring an image of the cleaning area in the dishwasher
  • Step S23 perform gray histogram statistics on the image to determine whether the image is too dark or overexposed
  • Step S24 when the image is overexposed or too dark, control the fill light to adjust the initial brightness
  • Step S25 in the case that the image is not overexposed or too dark, determine the current initial brightness as the target fill light brightness
  • Step S26 take the target fill light brightness as the next initial brightness default value.
  • the supplementary light is controlled to perform supplementary light with a default initial brightness, and when the supplementary light is the initial brightness, an image of the cleaning area in the dishwasher is acquired.
  • the initial brightness may be the median value of the maximum brightness of the fill light, which may be a more appropriate value obtained through experiments based on the dishwasher being located in different environments, so as to adapt to most environments and increase the number of dishwashers. scope of application.
  • the image acquisition device may acquire an image of the cleaning area, and the image acquisition device may be set in the same direction as the fill light to obtain a better fill light effect.
  • step S23 the grayscale histogram statistics are performed on the image, wherein the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level.
  • the starting gray level of the grayscale histogram is set to 0, the x-axis of the histogram represents the grayscale value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the grayscale level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32.
  • the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram indicates the number of intervals on the grayscale range of the image to be imaged, which can also be understood as the dimension of the one-dimensional array of the histogram.
  • step S23 is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
  • performing histogram statistics on the image to determine whether the image is too dark or overexposed may include:
  • Step S231 Determine the ratio of the number of pixels whose gray value corresponds to the white area in the gray histogram to the average number of pixels;
  • Step S232 in the case that the ratio is smaller than the first ratio threshold, determine that the image is too dark;
  • Step S233 When the ratio is greater than the second ratio threshold, determine that the image is overexposed.
  • the grayscale value corresponding to the horizontal axis coordinate in the grayscale histogram is 250 ⁇ x (that is, the ordinate (number of pixels) corresponding to the white area in step S231 ) accounts for the average number of pixels (the total number of pixels divided by the grayscale value)
  • the ratio of is much larger than other gray values, it proves that the white area of the image accounts for a large proportion, and the image corresponds to overexposure.
  • the proportion of the ordinate (number of pixels) near the grayscale coordinate 250 is very low, and the number of pixels at the coordinate 50 (corresponding to the black area of the grayscale histogram) is relatively high, such an image is not bright enough, that is, the above image is too dark.
  • the first ratio threshold is 1:3, and the second ratio threshold is 3:1
  • the grayscale value corresponds to 250 ⁇ x, that is, the number of pixels in the white area is
  • the ratio of the average number of pixels is between 1:3 and 3:1.
  • the image is not exposed and not too dark. If the ratio is greater than 3:1, the image is considered to be overexposed, and if it is less than 1:3, the image is considered bright. Too dark, that is, the above-mentioned steps S232 to S233.
  • FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application.
  • controlling the fill light to adjust the initial brightness includes:
  • Step S241 when the image is overexposed, control the fill light to increase the initial brightness
  • Step S242 When the image is too dark, control the fill light to reduce the initial brightness.
  • the brightness of the fill light can be adjusted by adjusting the duty cycle of the pulse width modulation signal used to control the fill light.
  • Pulse width modulation modulates the bias voltage of the controllable switch (for example, transistor base or MOS transistor gate) according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS transistor, so as to realize the output of the switching regulated power supply. Change.
  • the method of controlling the fill light to increase or decrease the initial brightness may include: periodically increasing or decreasing the duty cycle of the pulse width modulation signal according to time, for example, it may increase or decrease the pulse width modulation signal at a rate of 10% every 1 second. duty cycle.
  • the brightness can be changed by changing the voltage of the fill light.
  • the image capture device is controlled to capture the image again, and the loop goes to step S23 until the image is not overexposed or too dark, and then goes to step S25.
  • step S23 the process proceeds directly from step S23 to step S25.
  • FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
  • controlling the fill light to adjust the initial brightness in step 24 includes:
  • Step S241' Divide the brightness of the fill light into multiple levels from zero to the maximum
  • Step S242' Decrease or increase the brightness level sequentially from the level corresponding to the initial brightness.
  • the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal, for example, the brightness from zero to the maximum brightness of the rated power can be divided into is 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, then the first level corresponds to the duty cycle of the pulse width modulation signal is 10%, and so on.
  • the initial brightness may correspond to the fifth level, that is, the duty cycle corresponding to the PWM signal is 50%, and the level may be increased or decreased in turn according to whether the image is overexposed or too dark, such as increasing to the duty cycle corresponding to the PWM signal.
  • the sixth level with a ratio of 60% can be adjusted in this way to speed up the adjustment of the brightness of the fill light, thereby speeding up the response of subsequent image recognition.
  • FIG. 12 is a further flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
  • the fill light method can also include:
  • Step S243' after reducing or increasing the initial brightness each time, acquire the image of the cleaning area in the dishwasher again;
  • Step S244' Circularly perform grayscale histogram statistics on the image, and when the ratio is between the first proportional threshold and the second proportional threshold, determine the current initial brightness as the target fill light brightness.
  • the image acquisition device is controlled to acquire the image again, and the process jumps to step S23 again until the image is not overexposed or too dark, at which time the currently adjusted initial brightness is used as the target fill light brightness.
  • step S26 is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the present application.
  • the target fill light brightness is used as the next initial brightness default value including:
  • Step S261 record the target fill light brightness and the adjustment time corresponding to the target fill light brightness
  • Step S262 take the target fill light brightness as the default initial brightness value corresponding to the next adjustment time.
  • this step mainly considers that when users use the dishwasher, they usually place the dishwasher in a fixed position. In most cases, the lighting environment of the same position is the same. Based on this feature, By recording the target brightness value and the adjustment time corresponding to the target fill light brightness, such as 100cd/ m2 and 12:00, 150cd/ m2 and 9:00, the next time the dishwasher is used, if the user uses the washing machine at 9:00 In the bowl machine, the default value of the initial brightness of the fill light is the target fill light brightness corresponding to the last time, that is, 150cd/m 2 .
  • steps S21 to S23 if the fill light is the initial brightness
  • the images captured under the default value are not overexposed or too dark, so there is no need to adjust, thereby reducing the time to obtain a suitable image, and the fill light does not need to be adjusted multiple times, which can save energy and be more intelligent.
  • the fill light method controls the fill light to fill light with the initial brightness and acquires an image of the cleaning area, and adjusts the output brightness of the fill light to a certain level by making statistics on the grayscale histogram of the image. Determine the appropriate target fill light brightness, and finally achieve that the image is not overexposed and not too dark.
  • the target fill light brightness as the next initial brightness default value
  • the number of times the dishwasher adjusts the brightness of the fill light can be reduced, thereby reducing the time to obtain a suitable image, saving energy consumption, and speeding up the response of image recognition.
  • the third embodiment of the present application also provides a light supplement method for a dishwasher, which can perform more energy-efficient and fast supplement light for the cleaning area in the dishwasher.
  • Existing dishwashers generally include lighting lamps, and when a user opens the door of the dishwasher, the lighting lamps are automatically turned on to facilitate the user to place tableware.
  • Some dishwashers are also equipped with a fill light, but the fill light and the lighting only realize the switch function, and the brightness cannot be adjusted linearly. Therefore, the brightness provided by the lighting lamp and the fill light is a fixed brightness, and cannot be adjusted intelligently and adaptively according to the actual brightness of the washing area inside the dishwasher. Therefore, whether it is day or night, its brightness is the same, and the lack of intelligence leads to poor user use.
  • FIG. 14 exemplarily shows a schematic structural diagram of a light-filling device for a dishwasher to which the light-filling method for a dishwasher provided according to the third embodiment of the present application is applied.
  • the light-filling device may include: :
  • the image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
  • the fill light 12 is used to emit light to the cleaning area to fill the image collected by the image acquisition device 11;
  • the lighting lamp 13 is used for emitting light to the cleaning area to achieve lighting effect.
  • the processor (not shown) is electrically connected to the fill light 12 and the lighting lamp 13 for controlling the fill light 12 and the lighting lamp 13 to emit light.
  • the light 13 and the fill light 12 may be located on the same side of the interior space of the dishwasher.
  • the illumination light 13 and the supplementary light 12 may be located on different sides to provide illumination from multiple directions, so as to facilitate the image capturing device 11 to obtain a more complete and clearer image.
  • the fill light 12 can be in the shape of a ring, and is arranged around the image capture device 11 to facilitate lead wires, and the number of openings in the inner wall of the dishwasher can also be reduced, thereby increasing the washing area of the dishwasher Space.
  • FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by a third embodiment of the present application.
  • the dishwasher includes a fill light and an illuminating lamp for fill light in the cleaning area, the dishwasher further includes a cabinet door, and the fill light method includes:
  • Step S31 determine the opening and closing state of the cabinet door
  • Step S32 when the open and closed state is determined to be that the cabinet door is opened, the lighting lamp is controlled to be turned on, and the supplementary light is controlled to be turned off.
  • Step S33 acquiring the first image of the cleaning area
  • Step S34 obtaining the first brightness value of the first image according to the first image
  • Step S35 determining the fill light brightness required by the fill light according to the first brightness value
  • Step S36 controlling the fill light to fill the cleaning area with the required fill light brightness
  • Step S37 acquiring a second image of the cleaning area after the supplementary light
  • Step S38 determining a second brightness value according to the second image
  • Step S39 when the second brightness value is outside the preset brightness value range, control the fill light to perform secondary adjustment on the fill light brightness.
  • the opening and closing state of the cabinet door may be detected by arranging a limiter or a displacement sensor at the cabinet door.
  • the opening and closing status of the cabinet door detected by the limiter or displacement sensor can be read. If the cabinet door is opened, it can be considered that the user places tableware in the washing area.
  • the supplementary light can be controlled to keep off, and the lighting lamp can be controlled to be turned on, so as to illuminate the cleaning area and facilitate the user to place the tableware.
  • a first image of the cleaning area is acquired under the condition that the fill light is kept off.
  • the first image may be acquired by an image acquisition device (eg, a camera).
  • the first luminance value of the first image may be obtained according to the first image.
  • the first luminance value may be an average luminance of pixels in the first image.
  • the fill light brightness required by the fill light lamp may be determined according to the first brightness value.
  • the first brightness value may be the brightness value of the image captured under the condition that the supplementary light is not turned on and only relies on the light of the illuminating lamp for illumination.
  • the target brightness value can be preset.
  • the target brightness value may be the brightness value required to provide ideal illumination.
  • the target brightness value can be set according to actual applications or user preferences. Through the difference between the first brightness value and the target brightness value, the fill light brightness required by the fill light lamp can be determined.
  • FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
  • step S35 determining the fill light brightness required by the fill light according to the first brightness value includes:
  • Step S331 Divide the fill light brightness of the fill light into multiple levels from zero to the maximum
  • Step S332 Determine the difference between the first brightness value and the preset target brightness value
  • Step S333 Determine the brightness level of the supplementary light required by the supplementary light according to the difference.
  • the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal provided to the fill light.
  • the maximum brightness from zero to rated power can be divided into 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, Then, the duty cycle of the pulse width modulation signal corresponding to the first level may be 10%, and so on.
  • the target luminance value may correspond to the fifth level, that is, the duty cycle corresponding to the pulse width modulation signal is 50%.
  • the level of the fill light brightness required by the fill light can be determined.
  • the level corresponding to the first brightness value is the first level, at this time If the difference from the target brightness value is four levels, the required level of fill light brightness can be four levels.
  • step S36 to step S39 control the fill light to turn on and fill the cleaning area with the required fill light brightness.
  • a second image of the cleaned area after supplemented light may be acquired, and a second brightness value may be determined according to the second image.
  • the second brightness value may be an average brightness value of pixels in the second image. Then, it can be determined whether the second brightness value is within the preset brightness value range, and when the second brightness value is outside the brightness value range, the supplementary light is controlled to perform secondary adjustment of the supplementary light brightness.
  • the image acquisition device can be controlled again to obtain the second image, and whether the fill light brightness needs to be determined by judging whether the second brightness value is within the range of brightness values Secondary adjustment.
  • the brightness value range may be a brightness value within which the image acquired by the image acquisition device will not be overexposed (overexposed) or too dark.
  • an upper luminance value of a range of luminance values may be associated with overexposure, and a lower luminance value may be associated with overdark. If the second brightness value is outside the brightness value range, that is, it is considered that the acquired second image is overexposed or too dark, it is necessary to control the fill light to perform a secondary adjustment of the fill light brightness.
  • FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application.
  • the range of brightness values in step S38 includes a lower limit value of brightness and an upper limit value of brightness, and when the second brightness value is outside the preset range of brightness values, the fill light is controlled to adjust the brightness of the fill light.
  • Making secondary adjustments can include:
  • Step S381 when the second brightness value is greater than the upper limit value of brightness, reduce the brightness of the supplementary light;
  • Step S382 when the second brightness value is less than the lower limit value of brightness, increase the brightness of the supplementary light.
  • the adjustment method may include adjusting the input voltage of the supplementary light.
  • the input voltage can be adjusted, for example, by adjusting the duty cycle of the pulse width modulated signal.
  • the upper luminance value may be a critical value for determining whether the second image is overexposed, and the lower luminance value may be a critical value for determining whether the second image is too dark.
  • reducing the fill light brightness includes sequentially decreasing the fill light brightness levels
  • increasing the fill light brightness includes sequentially increasing the fill light brightness levels.
  • the level of fill light brightness is decreased in turn.
  • the fill light brightness is adjusted to the third level, and the first For the second image, if the second brightness value is still greater than the upper limit of brightness, continue to reduce the brightness of the fill light, and adjust the brightness of the fill light to the second level until the second brightness value is within the range of brightness values.
  • the current fill light brightness can be determined. Fill light brightness for the target.
  • the supplementary light is controlled to be turned off after a preset first time has elapsed after it is turned on.
  • step S38 After finding the target fill light brightness through step S38, wait for the door closing information, and after a preset delay time, turn off the lighting.
  • the fill light method on the basis of turning on the lighting lamp to facilitate the user to place tableware, adjusts the fill light brightness of the fill light according to the line of the lighting light, so as to perform the lighting according to the actual brightness of the cleaning area inside the dishwasher.
  • Intelligent adaptive adjustment When the user opens the door, the lighting is automatically turned on, which is convenient for the user to place tableware. At the same time, the brightness of the fill light is adjusted according to the brightness of the lighting, which is more intelligent and user-friendly, and can bring users a better experience.
  • the fourth embodiment of the present application provides a method for supplementing light for a dishwasher, which can control the brightness of the supplementary light in the dishwasher.
  • the lamp beads of the fill light will age, resulting in a weakening of its brightness, so that the image acquired during the image collection will appear too much. dark.
  • image recognition it is easy to cause the image to be too dark, and the user feels that the brightness is not enough, which affects the experience of the product.
  • the supplementary light method can solve the above problems.
  • FIG. 18 is a flowchart of a light supplement method for a dishwasher provided in Embodiment 4 of the present application; in this embodiment of the present application, the light supplement method may include:
  • Step S41 when the dishwasher is in the factory state, control the fill light to fill the washing area of the dishwasher with a first brightness corresponding to a preset first duty ratio;
  • Step S42 acquiring the first image of the cleaning area
  • Step S43 obtaining a first brightness value of the first image according to the first image
  • Step S44 when the dishwasher is in the calibration state, control the fill light to fill the washing area of the dishwasher with the second brightness corresponding to the first duty cycle;
  • Step S45 acquiring a second image of the cleaning area
  • Step S46 obtaining a second brightness value of the second image according to the second image
  • Step S47 Determine the difference between the second brightness value and the first brightness value
  • Step S48 when the difference is greater than a preset threshold, increase the duty cycle to increase the brightness of the fill light.
  • a pulse width modulation (PWM) signal may be used to control the fill light.
  • the brightness of the fill light can be controlled by adjusting the duty cycle of the PWM signal.
  • the PWM signal can modulate the bias of the transistor base or the gate of the MOS transistor according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or the MOS transistor, thereby realizing the change of the output of the switching regulated power supply.
  • a better brightness of the fill light can be set first, and the brightness can correspond to the duty cycle of the PWM signal (which can be referred to as set the duty cycle or the first duty cycle described above).
  • the duty cycle of the PWM signal used to control the fill light can be adjusted to the first duty cycle, so that the fill light can wash dishes at the first brightness corresponding to the first duty cycle. Fill light in the cleaning area of the machine.
  • a first image of the cleaning area under the first brightness can be captured by an image acquisition device (eg, a camera), a first brightness value of the first image can be obtained according to the first image, and the above-mentioned data can be saved, for example, referring to the first brightness value , the first duty cycle.
  • an image acquisition device eg, a camera
  • a first brightness value of the first image can be obtained according to the first image
  • the above-mentioned data can be saved, for example, referring to the first brightness value , the first duty cycle.
  • the fill light When the dimming calibration of the fill light is required, that is, when the dishwasher is in the calibration state, the fill light can be controlled to be turned on with the same first duty cycle pulse width modulation signal, and the image acquisition device can be started to The cleaning area is photographed and collected to obtain a second image, and a second brightness value of the second image can be obtained according to the second image. The second brightness value is then compared with the first brightness value from the factory. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light can be adjusted so that the second brightness value reaches the first brightness value.
  • the fill light can be controlled to enter the calibration state at a preset first time period and/or when there is no utensils in the washing area.
  • the first time period may be, for example, half a year, a year, that is, calibration may be performed every half year or year. It can also enter the calibration state according to the user's own trigger, so as to maintain the fill light.
  • the fill light by calibrating the fill light, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, thereby preventing the fill light from being caused by
  • the influence of the service life leads to the weakening of its brightness, which affects the subsequent image recognition effect and lighting effect, and brings a better experience to the user.
  • obtaining the first brightness value of the first image according to the first image and obtaining the second brightness value of the second image according to the second image can both be weighted and summed or averaged through a statistical grayscale histogram. Brightness value.
  • the first luminance value is obtained by weighting and summing the luminance values of each pixel in the grayscale histogram.
  • Weighted summation is an averaging method that takes weights into account; usually in a set of data, the number of times a piece of data occurs is called a weight.
  • the difference between the first brightness value and the second brightness value is 3. If the preset threshold is 2, and the difference is greater than the threshold at this time, the duty cycle of the pulse width modulation signal can be increased to maximize the brightness of the fill light.
  • the manner of increasing the duty cycle may include increasing the duty cycle by a certain percentage at a preset time. For example, every t seconds, the duty cycle of the PWM signal is increased at a rate of 5%, thereby increasing or decreasing the brightness of the fill light.
  • the image acquisition device can be controlled to acquire an image again, and the second brightness value of the image can be calculated until the difference between the second brightness value and the first brightness value is smaller than the threshold.
  • the supplementary light method for a dishwasher provided by the embodiments of the present application may further include:
  • Step S49 In the case that the difference value is smaller than the preset threshold value, determine the second duty ratio currently corresponding to the fill light.
  • the second duty cycle does not need to be adjusted, and can be Determine the adjusted second duty cycle.
  • FIG. 19 is another flowchart of the light supplement method for a dishwasher provided in Embodiment 4 of the present application. According to the determined second duty cycle, the light supplement method may further include the following steps:
  • Step S491 determine the ratio of the second duty cycle to the first duty cycle
  • Step S492 Adjust the duty cycle of the fill light and the coefficient of brightness according to the ratio.
  • the ratio of the second duty cycle to the first duty cycle if the first duty cycle is 50% and the second duty cycle is 60%, it represents the same brightness. Due to the attenuation of the fill light , brightness that previously only required a 40% duty cycle now requires a 50% duty cycle, a 60/50 ratio of 1.2.
  • FIG. 20 is a further flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application;
  • the method for supplementing light for a dishwasher is a schematic diagram illustrating step S494.
  • the supplementary light method provided in the embodiment of the present application also includes:
  • Step S493 Determine the difference between the second duty cycle and the first duty cycle
  • Step S494 Determine the service life of the fill light according to the difference.
  • the remaining service life of the fill light can be calculated by the following formula: Proportion:
  • T is the percentage of the remaining service life of the fill light.
  • indication information can be sent to the user.
  • Indication information can be sent through indicator lights or other early warning devices, such as buzzers.
  • the instruction information can be displayed on the display screen to prompt the user to replace the fill light, or the instruction information can be sent to the user terminal through the wireless network to prompt the user to replace the fill light. In this way, the dishwasher can be maintained and the reliability of the dishwasher can be guaranteed.
  • the fill light method controls the fill light of the dishwasher to fill light in the washing area of the dishwasher with the first brightness corresponding to the preset first duty cycle in the factory state of the dishwasher, And carry out image acquisition to obtain the first brightness value.
  • the fill light is controlled to fill light with the same duty cycle of the pulse width modulation signal, and image acquisition is performed to obtain the second brightness value. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light is adjusted until the first brightness value is reached.
  • the fill light By calibrating the fill light in this way, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, so as to prevent the fill light due to The influence of the service life will lead to the weakening of its brightness, which will affect the subsequent image recognition effect and lighting effect, and bring a better experience to the user.
  • a fifth embodiment of the present application provides a dishwasher, including the light supplementing device described in the foregoing embodiments.
  • Embodiments of the present application provide a machine-readable storage medium, on which a program is stored, and when the program is executed by a processor, implements a light supplement method for a dishwasher.
  • Examples of machine-readable storage media may include memory.
  • the memory may include non-persistent memory in a computer readable medium, in the form of random access memory (RAM) or non-volatile memory, such as read only memory (ROM) or flash memory (flash RAM), the memory including at least one memory chip .
  • RAM random access memory
  • ROM read only memory
  • flash RAM flash memory
  • Embodiments of the present application provide a processor for running a program, wherein, when the program is executed, the processor is configured to execute the light supplement method for a dishwasher described in the foregoing embodiments.
  • Embodiments of the present application further provide a computer program product, including a computer program, when the computer program is executed by a processor, the method for a dishwasher of the foregoing embodiments is implemented.
  • a method for supplementing light for a dishwasher includes an image acquisition device for acquiring an image of a washing area in the dishwasher; a main supplementary light for supplementing the image. light; at least one auxiliary fill light, used to fill the edge area of the image; the fill light method includes:
  • the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
  • the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
  • the supplementary light method further includes:
  • the brightness of the main fill light is adjusted to adjust the first brightness value.
  • adjusting the brightness of the main fill light to adjust the first brightness value includes:
  • the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
  • the brightness of the main fill light is reduced to reduce the first brightness value.
  • obtaining the first brightness value of the image according to the image includes:
  • the luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
  • the at least one auxiliary fill light includes a first auxiliary fill light and a second auxiliary fill light, and the first auxiliary fill light and the second auxiliary fill light are respectively disposed on the left and right sides of the image capturing device. , respectively used to fill the left edge area and right edge area of the image: when the second brightness value is outside the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes:
  • the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
  • obtaining the second brightness value of the edge region of the image according to the image includes:
  • the second brightness value is the average value of the brightness values of the edge regions.
  • the main fill light and the auxiliary fill light are individually controlled through different pulse width modulation signals.
  • a supplementary light device for a dishwasher comprising:
  • Image acquisition equipment for acquiring images of the washing area of the dishwasher
  • the main fill light which is set around the image acquisition device, is used to fill light in the area corresponding to the central area of the image in the cleaning area;
  • At least one auxiliary supplementary light which is arranged on at least one side of the main supplementary light, is used for supplementing light in the area corresponding to the edge area of the image in the cleaning area;
  • the processor configured as:
  • the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
  • the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
  • the processor is further configured to:
  • the brightness of the main fill light is adjusted to adjust the first brightness value.
  • the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes the processor being configured to:
  • the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
  • the brightness of the main fill light is reduced to reduce the first brightness value.
  • the processor is configured to obtain the first luminance value of the image from the image and is configured to:
  • the luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
  • the at least one auxiliary fill light includes:
  • the first pair of fill light is set on the left side of the image acquisition device
  • the second supplementary light is set on the right side of the image acquisition device
  • the processor is configured to adjust the brightness of the secondary fill light to adjust the second brightness value when the second brightness value is not located in the second brightness range.
  • the processor is configured to:
  • the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
  • the processor being configured to obtain the second luminance value of the edge region of the image comprises the processor being configured to:
  • the second brightness value is the average value of the brightness values of the edge regions.
  • the supplementary light device further includes:
  • the first pulse width modulation device is electrically connected to the main fill light, and is used to adjust the brightness of the main fill light by controlling the duty ratio;
  • the second pulse width modulation device is electrically connected to the first auxiliary light and is used for adjusting the brightness of the first auxiliary light by controlling the duty ratio;
  • the third pulse width modulation device is electrically connected to the second supplementary light, and is used for adjusting the brightness of the second supplementary light by controlling the duty ratio.
  • a dishwasher includes the above-mentioned light-filling device for a dishwasher.
  • a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
  • a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
  • a method for supplementing light for a dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher, and the method for supplementing light includes:
  • performing gray histogram statistics on the image to determine whether the image is too dark or overexposed includes:
  • the ratio is less than the first ratio threshold, it is determined that the image is too dark
  • controlling the fill light to adjust the initial brightness includes:
  • controlling the fill light to adjust the initial brightness includes:
  • using the target fill light brightness as the next initial brightness default value includes:
  • the brightness of the fill light is adjusted by adjusting the duty cycle of the pulse width modulation signal.
  • a supplementary light device for a dishwasher comprising:
  • an image acquisition element configured to acquire images of the wash area of the dishwasher
  • the processor configured as:
  • the processor is configured to perform grayscale histogram statistics on the image to determine whether the image is too dark or overexposed, comprising the processor being configured to:
  • the ratio is less than the first ratio threshold, it is determined that the image is too dark
  • the processor is configured to control the fill light to adjust the initial brightness when the image is overexposed or too dark.
  • the processor is configured to:
  • the processor being configured to control the fill light to adjust the initial brightness includes the processor being configured to:
  • configuring the processor to use the target fill light brightness as the next initial brightness default value includes that the processor is configured to:
  • the supplementary light device further includes:
  • the pulse width modulation signal adjustment device is used for adjusting the duty ratio of the pulse width modulation signal input to the fill light, so as to adjust the brightness of the fill light.
  • a dishwasher includes the above-mentioned light-filling device for a dishwasher.
  • a machine-readable storage medium having instructions stored on the machine-readable storage medium is used to enable the processor to perform the above-mentioned fill light for the fill light when executed by the processor. method.
  • a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a supplementary light.
  • a method for supplementing light for a dishwasher includes: a lighting lamp for illuminating a cleaning area; a supplementary light for supplementing the cleaning area in the dishwasher.
  • Light; fill light methods include:
  • the lighting lamp is controlled to be turned on, and the fill light is turned off;
  • the fill light is controlled to adjust the fill light brightness twice.
  • the supplementary light method further includes:
  • the first brightness value is an average brightness value of pixels in the first image
  • the second brightness value is an average brightness value of pixels in the second image
  • determining the fill light brightness required by the fill light according to the first brightness value includes:
  • the brightness value range includes an intensity lower limit value and an intensity upper limit value
  • the fill light is controlled to perform secondary adjustment on the fill light brightness.
  • the brightness of the fill light is increased.
  • reducing the brightness of the supplementary light includes: sequentially decreasing the level of the brightness of the supplementary light; increasing the brightness of the supplementary light includes: sequentially increasing the level of the brightness of the supplementary light.
  • a supplementary light device for a dishwasher comprising:
  • the displacement sensor is used to obtain the opening and closing status of the cabinet door according to the displacement of the cabinet door;
  • an image capture device for capturing images of the washing area within the dishwasher
  • Illuminators for illuminating the wash area
  • the processor configured as:
  • the lighting lamp is controlled to be turned on, and the fill light is turned off;
  • the supplementary light is controlled to perform a secondary adjustment of the supplementary light brightness.
  • the first brightness value is an average brightness value of pixels in the first image
  • the second brightness value is an average brightness value of pixels in the second image
  • the processor being configured to determine the fill light brightness required by the fill light according to the first brightness value includes the processor being configured to:
  • the brightness value range includes an intensity lower limit value and an intensity upper limit value
  • the processor is configured to control the fill light to fill light when the second brightness value is outside the preset brightness value range.
  • the secondary adjustment of brightness includes including the processor being configured to:
  • the brightness of the fill light is increased.
  • the processor being configured to reduce the fill light brightness includes the processor being configured to: sequentially reduce the fill light brightness levels;
  • the processor being configured to increase the brightness of the fill light includes the processor being configured to: sequentially increase the level of the brightness of the fill light.
  • a dishwasher includes the above-mentioned light-filling device for a dishwasher.
  • a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
  • a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
  • a method for supplementing light for a dishwasher the brightness of the supplementary light is adjusted by adjusting the duty cycle of a pulse width modulation signal, and the supplementary light method includes:
  • the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio
  • the first duty cycle is increased to increase the second brightness.
  • the method for supplementing light further includes:
  • the second duty ratio corresponding to the current second brightness is determined.
  • the supplementary light method further includes:
  • the supplementary light method further includes:
  • the method for supplementing light further includes: in the case that the service life is less than a preset service life threshold, sending indication information to the user.
  • the method for supplementing light further includes: controlling the supplementary light to enter a calibration state within a preset first time period and/or when there is no tableware in the washing area.
  • a supplementary light device for a dishwasher comprising:
  • an image acquisition element configured to acquire images of the wash area within the dishwasher
  • a pulse width modulation signal conditioning device for controlling the duty cycle of the pulse width modulation signal input to the fill light
  • the processor configured as:
  • the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio
  • the first duty cycle is increased to adjust the second brightness.
  • the processor is further configured to: determine a second duty cycle corresponding to the current second brightness when the difference is less than a preset threshold.
  • the processor is further configured to:
  • the processor is further configured to: send indication information to the user when the service life is less than a preset lifespan threshold.
  • the processor is further configured to: control the fill light to be in a calibration state for a preset first time period and/or when there is no tableware in the washing area.
  • a dishwasher includes the above-mentioned light-filling device for a dishwasher.
  • a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
  • a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
  • the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

A light supplementing method for a dishwasher, a light supplementing apparatus, and a dishwasher (100). The dishwasher (100) comprises: an image acquisition device (11) for acquiring an image of a cleaning area within the dishwasher (100); a main light supplementing lamp (121) for performing light supplementation on the image; and at least one secondary light supplementing lamp (122) for performing light supplementation on an edge area of the image. The light supplementing method comprises: acquiring an image (S11); obtaining a first brightness value of the image according to the image (S12); when the first brightness value is within a preset first brightness range, obtaining a second brightness value of an edge area of the image according to the image (S13); and when the second brightness value is outside of a preset second brightness range, adjusting the brightness of a secondary light supplementing lamp (122) so as to adjust the second brightness value (S14).

Description

用于洗碗机的补光方法、补光装置以及洗碗机Fill light method, fill light device and dishwasher for dishwasher
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求2021年01月19日提交的中国专利申请202110071269.9,202110069559.X,202110071263.1以及202110071265.0的权益,该申请的内容通过引用被合并于本文。This application claims the rights of Chinese patent applications 202110071269.9, 202110069559.X, 202110071263.1 and 202110071265.0 filed on January 19, 2021, the contents of which are incorporated herein by reference.
技术领域technical field
本申请涉及厨卫电器技术领域,具体涉及一种用于洗碗机的补光方法、补光装置以及洗碗机。The present application relates to the technical field of kitchen and bathroom appliances, and in particular, to a light-filling method, a light-filling device and a dishwasher for dishwashers.
背景技术Background technique
随着生活水平的提高,洗碗机的使用越来越多。智能化的应用越来越广泛,相应的对洗碗机的要求也越来越高。With the improvement of living standards, the use of dishwashers is increasing. The application of intelligence is becoming more and more extensive, and the corresponding requirements for dishwashers are also getting higher and higher.
洗碗机内腔的清洗区域通常设置有补光灯。为了兼顾成本和空间,目前常用的设计方案是将摄像头和补光灯做成一个整体的组件,即内孔是摄像头的开孔,外环则是补光灯的设计。这样既方便引线,也减少开孔的个数。但是这种设计也有缺点,因为它的尺寸不能做的很大,相对于洗碗机内腔来说它的占比太小,就相当于点光源。由于补光灯的结构特性容易导致边缘区域比较暗,从而导致所采集的图像部分信息缺失,最终导致图像识别不精准,达不到用户预期的体验。The washing area of the inner cavity of the dishwasher is usually provided with a fill light. In order to take into account the cost and space, the current common design scheme is to make the camera and the fill light into an integral component, that is, the inner hole is the opening of the camera, and the outer ring is the design of the fill light. This not only facilitates the leads, but also reduces the number of openings. However, this design also has disadvantages, because its size cannot be made very large, and its proportion is too small relative to the inner cavity of the dishwasher, which is equivalent to a point light source. Due to the structural characteristics of the fill light, it is easy to cause the edge area to be relatively dark, which leads to the loss of part of the information in the collected image, which eventually leads to inaccurate image recognition and does not meet the user's expected experience.
发明内容SUMMARY OF THE INVENTION
为解决上述技术问题,本申请的目的是提供一种用于洗碗机的补光方法、补光装置以及洗碗机。In order to solve the above-mentioned technical problems, the purpose of the present application is to provide a light-filling method, a light-filling device and a dishwasher for a dishwasher.
为了实现上述目的,在本申请第一方面,提供一种用于洗碗机的补光方法,洗碗机包括图像采集设备,用于采集洗碗机内的清洗区域的图像;主补光灯,用于对图像进行补光;至少一个副补光灯,用于对图像的边缘区域进行补光;补光方法包括:获取图像;根据图像得到图像的第一亮度值;在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。In order to achieve the above object, in a first aspect of the present application, a method for supplementing light for a dishwasher is provided, wherein the dishwasher includes an image acquisition device for acquiring an image of a cleaning area in the dishwasher; a main supplementary light , used to fill light on the image; at least one secondary fill light is used to fill the edge area of the image; the fill light method includes: acquiring an image; obtaining a first brightness value of the image according to the image; In the case of being within the preset first brightness range, obtain the second brightness value of the edge area of the image according to the image; when the second brightness value is outside the preset second brightness range, adjust the secondary fill light brightness to adjust the second brightness value.
在本申请实施例中,还包括:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。In the embodiment of the present application, the method further includes: when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value.
在本申请实施例中,在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。In the embodiment of the present application, when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value includes: when the first brightness value is smaller than the first brightness range In the case of the limit value, increase the brightness of the main fill light to increase the first brightness value; when the first brightness value is greater than the upper limit of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value. a brightness value.
在本申请实施例中,根据图像得到图像的第一亮度值包括:获取图像的亮度直方图;对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。In the embodiment of the present application, obtaining the first brightness value of the image according to the image includes: obtaining a brightness histogram of the image; and weighting and summing the brightness values of each pixel in the brightness histogram to obtain the first brightness value.
在本申请实施例中,至少一个副补光灯包括第一副补光灯和第二副补光灯,第一副补光灯和第二副补光灯分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光:在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。In the embodiment of the present application, the at least one auxiliary supplementary light includes a first auxiliary supplementary light and a second auxiliary supplementary light, and the first auxiliary supplementary light and the second auxiliary supplementary light are respectively disposed on the left and right sides of the image capturing device. are used to fill the left edge area and the right edge area of the image respectively: when the second brightness value is outside the second brightness range, adjusting the brightness of the auxiliary fill light to adjust the second brightness value includes: In the case where the second brightness value on the left side of the left edge area is outside the second brightness range, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left side; in the right edge area, the second brightness value on the right side is adjusted When the value is outside the second brightness range, adjust the brightness of the second auxiliary light to adjust the second brightness value on the right.
在本申请实施例中,根据图像得到图像的边缘区域的第二亮度值包括:将图像分割成 多个区域;根据主补光灯的视场角提取多个区域中的边缘区域;确定边缘区域的第二亮度值;其中第二亮度值为边缘区域的亮度值的平均值。In the embodiment of the present application, obtaining the second brightness value of the edge region of the image according to the image includes: dividing the image into multiple regions; extracting edge regions in the multiple regions according to the field of view angle of the main fill light; determining the edge region The second brightness value of ; wherein the second brightness value is the average value of the brightness values of the edge region.
在本申请实施例中,主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。In the embodiment of the present application, the main supplementary light and the auxiliary supplementary light are individually controlled through different pulse width modulation signals.
在本申请第二方面,还提供一种用于洗碗机的补光装置,包括:图像采集设备,用于获取清洗区域的图像;主补光灯,环绕图像采集设备设置,用于对清洗区域中与图像的中心区域对应的区域进行补光;至少一个副补光灯,设置于主补光灯的至少一侧,用于对清洗区域中与图像的边缘区域对应的区域进行补光;处理器,被配置成:获取图像;根据图像得到图像的第一亮度值;在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。In a second aspect of the present application, there is also provided a light supplement device for a dishwasher, comprising: an image acquisition device for acquiring an image of a cleaning area; a main supplement light lamp, arranged around the image acquisition device and used for cleaning In the area, the area corresponding to the central area of the image is filled with light; at least one auxiliary fill light is arranged on at least one side of the main fill light, and is used to fill in the area corresponding to the edge area of the image in the cleaning area; a processor configured to: acquire an image; obtain a first brightness value of the image according to the image; and obtain a second brightness value of an edge region of the image according to the image when the first brightness value is within a preset first brightness range ; In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
在本申请实施例中,处理器还被配置成:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。In the embodiment of the present application, the processor is further configured to adjust the brightness of the main fill light to adjust the first brightness value when the first brightness value is outside the first brightness range.
在本申请实施例中,处理器被配置成调节主补光灯的亮度以调节第一亮度值包括处理器被配置成:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。In this embodiment of the present application, the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes that the processor is configured to: in the case that the first brightness value is less than the lower limit value of the first brightness range, The brightness of the main fill light is increased to increase the first brightness value; when the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is decreased to reduce the first brightness value.
在本申请实施例中,处理器被配置成根据图像得到图像的第一亮度值被配置成:获取图像的亮度直方图;对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。In the embodiment of the present application, the processor is configured to obtain the first brightness value of the image according to the image, and is configured to: obtain a brightness histogram of the image; weight and sum the brightness values of each pixel in the brightness histogram to obtain the first brightness value of the image. a brightness value.
在本申请实施例中,补光装置包括:第一副补光灯,设置于图像采集设备的左侧;第二副补光灯,设置于图像采集设备的右侧;处理器被配置成在第二亮度值不位于第二亮度范围的情况下,调节副补光灯的亮度以调节第二亮度值包括处理器被配置成:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。In the embodiment of the present application, the supplementary light device includes: a first secondary supplementary light, which is arranged on the left side of the image acquisition device; a second supplementary supplementary light, which is provided on the right side of the image acquisition device; the processor is configured to In the case where the second brightness value is not located in the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes that the processor is configured to: the second brightness value on the left side of the left edge area is located in the second brightness range If the brightness is outside the range of the second brightness, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left; if the second brightness value on the right edge of the right edge area is outside the second brightness range, adjust the second brightness The brightness of the fill light to adjust the second brightness value on the right.
在本申请实施例中,处理器被配置成获取图像的边缘区域的第二亮度值包括处理器被配置成:将图像分割成多个区域;根据主补光灯的视场角,提取多个区域中的边缘区域;确定边缘区域的第二亮度值;其中第二亮度值为边缘区域的亮度值的平均值。In this embodiment of the present application, the configuration of the processor to acquire the second brightness value of the edge region of the image includes that the processor is configured to: divide the image into a plurality of regions; extract a plurality of an edge region in the region; determining a second brightness value of the edge region; wherein the second brightness value is an average value of the brightness values of the edge region.
在本申请实施例中,还包括:第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。In the embodiment of the present application, it further includes: a first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; a second pulse width modulation device, which is electrically connected to The first auxiliary light is used to adjust the brightness of the first auxiliary light by controlling the duty ratio; the third pulse width modulation device, which is electrically connected to the second auxiliary light, is used to adjust the first auxiliary light by controlling the duty cycle. The brightness of the second fill light.
在本申请第三方面,提供一种洗碗机,包括上述的用于洗碗机的补光装置。In a third aspect of the present application, a dishwasher is provided, including the above-mentioned light supplement device for a dishwasher.
在本申请第四方面,提供一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。In a fourth aspect of the present application, a machine-readable storage medium is provided, and instructions are stored on the machine-readable storage medium, and when executed by a processor, the instructions are used to enable the processor to execute the above-mentioned method for a dishwasher. fill light method.
在本申请第五方面,提供一种计算机程序产品,包括计算机程序,其特征在于,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。In a fifth aspect of the present application, a computer program product is provided, including a computer program, wherein the computer program, when executed by a processor, implements the above-mentioned light supplement method for a dishwasher.
通过上述技术方案,本申请实施例所提供的补光方法通过采用副补光灯对洗碗机的清洗区域进行补光,解决现有技术下采用补光灯环绕图像采集设备设计下所存在的边缘区域较暗的问题,通过获取清洗区域的图像,先根据图像获取图像的第一亮度值,在第一亮度值满足位于预设的第一亮度范围内的情况下,对边缘区域的亮度进行评估,即获取第二亮度值,在第二亮度值位于预设的第二亮度范围之外的情况下,通过副补光灯的亮度调节第二亮度值,从而提高图像的亮度均衡性,使得图像识别的信息不缺失,提高图像识别的精度,提高用户的体验。Through the above technical solutions, the supplementary light method provided by the embodiments of the present application uses a secondary supplementary light to supplement light in the washing area of the dishwasher, thereby solving the existing problems in the design of using supplementary light to surround the image acquisition device in the prior art. For the problem that the edge area is dark, by acquiring the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, the brightness of the edge area is checked. Evaluation, that is, obtaining the second brightness value, and in the case that the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the sub-fill light, so as to improve the brightness balance of the image, so that The information of image recognition is not missing, the accuracy of image recognition is improved, and the user experience is improved.
本申请实施例的其它特征和优点将在随后的具体实施方式部分予以详细说明。Other features and advantages of the embodiments of the present application will be described in detail in the detailed description section that follows.
附图说明Description of drawings
附图是用来提供对本申请实施例的进一步理解,并且构成说明书的一部分,与下面的具体实施方式一起用于解释本申请实施例,但并不构成对本申请实施例的限制。在附图中:The accompanying drawings are used to provide further understanding of the embodiments of the present application, and constitute a part of the specification, and are used to explain the embodiments of the present application together with the following specific embodiments, but do not constitute limitations to the embodiments of the present application. In the attached image:
图1示意性示出了传统情况下洗碗机的结构示意图;FIG. 1 schematically shows a schematic structural diagram of a dishwasher under conventional conditions;
图2示意性示出根据本申请第一实施例所提供的用于洗碗机的补光方法所应用的洗碗机补光装置的结构示意图;FIG. 2 schematically shows a schematic structural diagram of a dishwasher light-filling device to which the light-filling method for dishwashers provided according to the first embodiment of the present application is applied;
图3为本申请第一实施例所提供的用于洗碗机的补光方法的流程图;FIG. 3 is a flow chart of a light supplement method for a dishwasher provided by the first embodiment of the present application;
图4为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S12的流程图;FIG. 4 is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the application;
图5为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S15的流程图;FIG. 5 is a flowchart of step S15 in the light supplement method for a dishwasher provided by the first embodiment of the application;
图6为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S13的流程图;FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
图7为本申请第一实施例所提供的用于洗碗机的补光方法中为示例性演示步骤S13的示意图;7 is a schematic diagram of an exemplary demonstration step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application;
图8为本申请第二实施例所提供的用于洗碗机的补光方法的流程图;FIG. 8 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application;
图9为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S23的流程图;FIG. 9 is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application;
图10为本申请第二实施例所提供的用于洗碗机的补光方法的流程图;FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the application;
图11为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24的另一流程图;FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
图12为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24进一步的流程图;12 is a further flow chart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the application;
图13为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S26的流程图;FIG. 13 is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the application;
图14示意性示出根据本申请第三实施例所提供的用于洗碗机的补光方法应用的洗碗机补光装置的结构示意图;FIG. 14 schematically shows a schematic structural diagram of a dishwasher light-filling device applied by a light-filling method for a dishwasher provided according to the third embodiment of the present application;
图15为本申请第三实施例所提供的用于洗碗机的补光方法的流程图;FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by the third embodiment of the application;
图16为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S35的流程图;FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the application;
图17为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S38的流程图;FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application;
图18为本申请第四实施例所提供的用于洗碗机的补光方法的流程图;FIG. 18 is a flowchart of a light supplement method for a dishwasher provided by the fourth embodiment of the present application;
图19为本申请第四实施例所提供的用于洗碗机的补光方法的另一流程图;FIG. 19 is another flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application;
图20为本申请第四实施例所提供的用于洗碗机的补光方法的进一步的流程图;以及图21是本申请第四实施例所提供的用于洗碗机的补光方法中为演示步骤S494的示意图。FIG. 20 is a further flow chart of the light supplement method for dishwashers provided by the fourth embodiment of the present application; and FIG. 21 is the light supplement method for dishwashers provided by the fourth embodiment of the present application. It is a schematic diagram for demonstrating step S494.
附图标记说明Description of reference numerals
1、补光装置;                               11、图像采集设备;1. Lighting device; 11. Image acquisition equipment;
12、补光灯;                                121、主补光灯;12. Fill light; 121. Main fill light;
122、副补光灯;                             13、照明灯。122. Auxiliary fill light; 13. Lighting.
具体实施方式Detailed ways
以下结合附图对本申请实施例的具体实施方式进行详细说明。应当理解的是,此处所描述的具体实施方式仅用于说明和解释本申请实施例,并不用于限制本申请实施例。The specific implementations of the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be understood that the specific implementation manners described herein are only used to illustrate and explain the embodiments of the present application, and are not used to limit the embodiments of the present application.
以下结合附图对本申请实施例的具体实施方式进行详细说明。应当理解的是,此处所描述的具体实施方式仅用于说明和解释本申请实施例,并不用于限制本申请实施例。The specific implementations of the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be understood that the specific implementation manners described herein are only used to illustrate and explain the embodiments of the present application, and are not used to limit the embodiments of the present application.
需要说明,本申请实施例中所有方向性指示(诸如上、下、左、右、前、后……)仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等,如果该特定姿态发生改变时,则该方向性指示也相应地随之改变。It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of the present application are only used to explain the relationship between various components under a certain posture (as shown in the accompanying drawings). The relative positional relationship, the movement situation, etc., if the specific posture changes, the directional indication also changes accordingly.
另外,在本申请中涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、 “第二”的特征可以明示或者隐含地包括至少一个该特征。另外,全文中出现的“或”的含义为,包括三个并列的方案,以“A或B”为例,包括A方案,或B方案,或A和B同时满足的方案。另外,各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本申请要求的保护范围之内。In addition, descriptions involving "first", "second", etc. in this application are only for descriptive purposes, and should not be construed as indicating or implying their relative importance or implicitly indicating the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In addition, the meaning of "or" in the whole text includes three parallel schemes. Taking "A or B" as an example, it includes scheme A, scheme B, or scheme that A and B satisfy at the same time. In addition, the technical solutions between the various embodiments can be combined with each other, but must be based on the realization by those of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered that the combination of such technical solutions does not exist. , is not within the scope of protection claimed in this application.
本申请实施例提供一种用于洗碗机的补光和图像识别方案,该方案包括多个实施例,分别包括对洗碗机中清洗区域的图像获取,图像的判别,以及控制补光灯进行补光等多个方面,以下具体阐述本申请实施例中的各个方面。The embodiments of the present application provide a solution for fill light and image recognition for a dishwasher, the solution includes multiple embodiments, respectively including image acquisition of the cleaning area in the dishwasher, image discrimination, and control of fill lights Various aspects such as supplementary light are performed, and various aspects in the embodiments of the present application are described in detail below.
本申请第一实施例提供一种用于洗碗机的补光方法,其可以对洗碗机内的清洗区域进行补光以更好地获取图像,该方法旨在解决现有的洗碗机采用环绕图像采集设备的补光灯在进行补光时,由于补光灯的结构特征容易导致边缘区域比较暗的问题。该问题会导致采集的图像部分信息缺失,最终图像识别的过程不精准,达不到用户预期的体验。The first embodiment of the present application provides a fill light method for a dishwasher, which can fill light in a washing area in the dishwasher to better capture images, and the method aims to solve the problem of existing dishwashers. When the fill light surrounding the image acquisition device is used for fill light, the structural characteristics of the fill light easily lead to the problem that the edge area is relatively dark. This problem will lead to the lack of some information in the collected images, and the final image recognition process will be inaccurate, which will not meet the user's expected experience.
请参阅图1,图1示意性示出了传统情况下洗碗机的结构示意图。洗碗机100包括图像采集设备11以及补光灯12。在现有技术中,为了兼顾成本和空间以及设计上的复杂度,洗碗机100中最常见的设计方案是图像采集设备11和补光灯12做成一个整体的环状组件。这样既方便引线,也可以减少在洗碗机100内壁开孔的个数。如图1中所示,内孔是图像采集设备11的开孔,外环则是补光灯12。但是这种设计也有缺点,因为它的尺寸不能像矩形补光灯一样设计较大,相对于洗碗机100的内腔(清洗区域)来说补光灯12的占比很小,此时补光灯12就相当于点光源。因为光线相对于物体是有入射角度(视场角)而非平行光线,但是图像采集设备11采集的是清洗区域的整体图像,这种补光方式会使得所采集的清洗区域的图像中被补光灯11所覆盖的中心区域会比中心区域外围的边缘区域要亮,也就是中心区域比边缘区域要亮。如果在边缘区域放置有餐具,图像采集设备11可能不能很好地采集到边缘区域的图像,会导致采集的图像部分信息缺失。Please refer to FIG. 1 , which schematically shows a schematic structural diagram of a dishwasher in a conventional situation. The dishwasher 100 includes an image capture device 11 and a fill light 12 . In the prior art, in order to take into account the cost, space and design complexity, the most common design solution in the dishwasher 100 is that the image capturing device 11 and the fill light 12 are formed into an integral annular assembly. In this way, the lead wires are convenient, and the number of openings in the inner wall of the dishwasher 100 can be reduced. As shown in FIG. 1 , the inner hole is the opening of the image acquisition device 11 , and the outer ring is the fill light 12 . However, this design also has disadvantages, because its size cannot be designed as large as the rectangular fill light. Compared with the inner cavity (cleaning area) of the dishwasher 100, the proportion of the fill light 12 is very small. The light lamp 12 is equivalent to a point light source. Because the light has an incident angle (field of view) relative to the object rather than a parallel light, but the image capture device 11 captures the overall image of the cleaning area, this way of filling light will make the captured image of the cleaning area filled with The central area covered by the light lamp 11 will be brighter than the peripheral area of the central area, that is, the central area is brighter than the peripheral area. If tableware is placed in the edge area, the image capturing device 11 may not be able to capture the image of the edge area well, which may result in partial information loss of the captured image.
请参阅图2,图2示意性示出了根据本申请第一实施例所提供的用于洗碗机的补光方法应用的洗碗机的补光装置的结构示意图。洗碗机100的补光装置1可以包括:Referring to FIG. 2 , FIG. 2 schematically shows a schematic structural diagram of a light supplementing device for a dishwasher to which the light supplementing method for a dishwasher provided according to the first embodiment of the present application is applied. The supplementary light device 1 of the dishwasher 100 may include:
图像采集设备11,用于采集洗碗机100内清洗区域的图像;The image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
主补光灯121,用于向清洗区域发射光线,以对洗碗机100的清洗区域进行补光;具体地,主补光灯121用于对清洗区域中与图像采集设备11采集的图像的中心区域对应的区域(可以称为中心区域)进行补光;The main fill light 121 is used to emit light to the cleaning area to fill the cleaning area of the dishwasher 100; The area corresponding to the central area (which can be called the central area) is filled with light;
至少一个副补光灯122,用于向清洗区域的边缘发射光线,以对清洗区域中与图像采集设备11采集的图像的边缘区域对应的区域(可以称为边缘区域)进行补光。边缘区域可以是中心区域的外围区域。At least one auxiliary supplementary light 122 is used for emitting light to the edge of the cleaning area to fill in the area (may be referred to as the edge area) in the cleaning area corresponding to the edge area of the image captured by the image acquisition device 11 . The edge regions may be peripheral regions of the central region.
在一个示例中,主补光灯121可以环绕图像采集设备11设置,副补光灯122可以设置于主补光灯121的一侧。In one example, the main fill light 121 may be disposed around the image capturing device 11 , and the auxiliary fill light 122 may be disposed on one side of the main fill light 121 .
本申请实施例所提供的一个总发明构思在于在主补光灯121的周边再增加副补光灯122,使得清洗区域未被主补光灯121光线所覆盖较暗的边缘区域变亮。在本申请实施例中,副补光灯122数量可以不予限定,副补光灯122越多,光照就会越均匀。副补光灯122可以与图像采集设备11朝向同一个方向。在一个示例中,图像采集设备11可以在内腔的4个侧面上。A general inventive concept provided by the embodiments of the present application is to add a secondary supplementary light 122 around the main supplementary light 121 to brighten the darker edge areas of the cleaning area not covered by the main supplementary light 121 . In the embodiment of the present application, the number of auxiliary supplementary lights 122 may not be limited, and the more auxiliary supplementary lights 122 are, the more uniform the illumination will be. The secondary fill light 122 may face the same direction as the image capturing device 11 . In one example, the image acquisition device 11 may be on 4 sides of the lumen.
在可选的实施例中,图像采集设备11可以包括可见光摄像头;主补光灯121和副补光灯122可为白光灯。为满足夜晚的清晰度,图像采集设备11可以为红外摄像头,主补光灯121和副补光灯122可以为红外补光灯。可选地,本实施例所阐述所适用的图像采集设备11采用可见光摄像头以及主补光灯121和副补光灯122采用白光灯。In an optional embodiment, the image capturing device 11 may include a visible light camera; the main fill light 121 and the auxiliary fill light 122 may be white lights. In order to satisfy the clarity at night, the image acquisition device 11 can be an infrared camera, and the main fill light 121 and the auxiliary fill light 122 can be infrared fill lights. Optionally, the applicable image acquisition device 11 described in this embodiment adopts a visible light camera, and the main fill light 121 and the auxiliary fill light 122 use white lights.
在一个示例中,补光装置1可以包括:In one example, the supplementary light device 1 may include:
第一副补光灯122a,设置于图像采集设备的左侧;The first auxiliary light 122a is arranged on the left side of the image capturing device;
第二副补光灯122b,设置于图像采集设备的右侧。The second auxiliary light 122b is arranged on the right side of the image capturing device.
可以理解,通过第一副补光灯122a和第二副补光灯122b可以对边缘区域进行补光,其中第一副补光灯122a和第二副补光灯122b可以相对于图像采集设备11间隔设置,以防止第一副补光灯122a和第二副补光灯122b的光线和主补光灯121的光线产生过多干涉。It can be understood that the edge area can be filled with light by the first auxiliary light 122a and the second auxiliary light 122b, wherein the first auxiliary light 122a and the second auxiliary light 122b can be relative to the image acquisition device 11. They are arranged at intervals to prevent excessive interference between the light of the first supplementary light 122a and the second supplementary light 122b and the light of the main supplementary light 121 .
请参阅图3,图3为本申请第一实施例所提供的用于洗碗机的补光方法的流程图;基于以上实施例描述的洗碗机的结构,本申请实施例所提供的补光方法可以包括:Please refer to FIG. 3. FIG. 3 is a flowchart of a method for supplementing light for a dishwasher provided by the first embodiment of the present application; based on the structure of the dishwasher described in the above embodiments, Light methods can include:
步骤S11:获取图像;Step S11: acquiring an image;
步骤S12:根据图像得到图像的第一亮度值;Step S12: obtaining the first brightness value of the image according to the image;
步骤S13:在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;Step S13: in the case that the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
步骤S14:在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。Step S14: In the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the secondary fill light to adjust the second brightness value.
具体地,首先初始化图像采集设备,等待触发采集图像采集设备进行采集的信号。在接收到信号后图像采集设备获取清洗区域的图像后,可以根据图像计算图像的第一亮度值。可以对图像进行亮度的分布评估,然后对图像的第一亮度值进行评估,当第一亮度值在预设的第一亮度范围内时,再根据边缘区域的第二亮度值和第二亮度范围进行判定,在第二亮度值位于预设的第二亮度范围之外时,调节副补光灯的亮度以调节第二亮度值。Specifically, the image acquisition device is first initialized, and waits for a signal that triggers the acquisition of the image acquisition device to perform acquisition. After the image acquisition device acquires the image of the cleaning area after receiving the signal, the first brightness value of the image can be calculated according to the image. The brightness distribution of the image can be evaluated, and then the first brightness value of the image can be evaluated. When the first brightness value is within the preset first brightness range, the second brightness value and the second brightness range of the edge area can be evaluated according to the second brightness value of the edge area. It is determined that when the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
第一亮度范围可以理解为图像在该第一亮度范围内既处于不整体过曝,也不整体过暗。第一亮度范围可以根据需求来设定。假定过暗的第一亮度阈值为d1,过曝的第二亮度阈值为d2,即当图像的亮度小于第一亮度阈值d1时,则图像整体过暗,当亮度大于第二亮度阈值d2时,此时图像整体过曝。此时第一亮度范围即为d1至d2。在第一亮度值位于预设的第一亮度范围内时,仅认为此时图像整体没有过曝或者过暗,但是由于上述的主补光灯121的结构设计,在无法被主补光灯121所覆盖的边缘区域还是会局部过暗。The first brightness range can be understood as the image in the first brightness range is neither overexposed nor overdark overall. The first brightness range can be set according to requirements. Assume that the first brightness threshold for over-darkness is d1, and the second brightness threshold for over-exposure is d2, that is, when the brightness of the image is less than the first brightness threshold d1, the image as a whole is too dark, and when the brightness is greater than the second brightness threshold d2, At this point the entire image is overexposed. At this time, the first luminance range is d1 to d2. When the first brightness value is within the preset first brightness range, it is only considered that the image as a whole is not overexposed or too dark at this time. The covered edge areas will still be locally too dark.
可以理解,可以将清洗区域分为能被主补光灯覆盖的区域(例如,中心区域)以及不能被主补光灯覆盖的边缘区域。可以对能被主补光灯所覆盖的区域的整体的图像进行判别,在整体的图像的第一亮度值满足条件的情况下,再对图像中的边缘区域进行判别是否需要对边缘区域进行补光。It can be understood that the cleaning area can be divided into an area that can be covered by the main fill light (eg, a central area) and an edge area that cannot be covered by the main fill light. The overall image of the area that can be covered by the main fill light can be judged, and when the first brightness value of the overall image satisfies the condition, the edge area in the image can be judged whether it is necessary to supplement the edge area. Light.
请参阅图4,图4为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S12的流程图。步骤S12中根据图像得到图像的第一亮度值可以包括:Please refer to FIG. 4 , which is a flowchart of step S12 in the light supplement method for a dishwasher provided by the first embodiment of the present application. Obtaining the first brightness value of the image according to the image in step S12 may include:
步骤S121:获取图像的灰度直方图;Step S121: obtaining a grayscale histogram of the image;
步骤S122:对灰度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。Step S122: Weighting and summing the luminance values of each pixel in the grayscale histogram to obtain a first luminance value.
具体地,可以对整体的图像进行灰度直方图统计,其中“灰度直方图”是反映一幅图像中各灰度级像素出现的频率与灰度级的关系。以灰度级为横坐标,频率为纵坐标,绘制频率与灰度级的关系图。通常情况下,灰度直方图起始灰度设为0,直方图x轴代表0~255的灰度值,即可以代表亮度值,直方图y轴代表对应亮度值的像素数,灰度级为灰度值的等级划分,其表示了精密程度,如8级,16级,32级。本实施例中可以为256级,因此灰度值有0~255的区间范围。可以理解,设置直方图每个间隔代表的灰度范围,表示要图像灰度范围上的间隔数目,也可以理解为直方图一维数组的维数。Specifically, a grayscale histogram can be counted on the overall image, where the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level. Usually, the initial gray level of the gray histogram is set to 0, the x-axis of the histogram represents the gray value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the gray level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32. In this embodiment, there may be 256 levels, so the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram represents the number of intervals on the grayscale range of the image to be imaged, and can also be understood as the dimension of the one-dimensional array of the histogram.
得到直方图后,进入步骤S122:对灰度直方图中各个像素的亮度值进行加权求和以得到第一亮度值。加权求和包括将权重计算在内的平均方法;通常在一组数据里,一个数据出现的次数称为权。具体方式如下:根据直方图中每个亮度值(灰度值)给予不同的权值;然后就将权值和落在该区域的像素数相乘,并把所有结果相加,即可得到上述的第一亮度值;例如,亮度值250对应权值1,亮度值100对应权值0.3。如果一张图像仅仅在亮度值250 和亮度值100处分别有10个像素点,则第一亮度值为10*1+0.3*10=13。如果第一亮度范围为8到12,则此时图像整体过曝。After the histogram is obtained, step S122 is entered: weighted summation is performed on the luminance values of each pixel in the grayscale histogram to obtain a first luminance value. Weighted summation involves averaging methods that include weights; usually in a set of data, the number of times a piece of data occurs is called a weight. The specific method is as follows: according to each brightness value (gray value) in the histogram, different weights are given; then the weights are multiplied by the number of pixels falling in the area, and all the results are added to obtain the above The first brightness value of ; for example, a brightness value of 250 corresponds to a weight value of 1, and a brightness value of 100 corresponds to a weight value of 0.3. If an image only has 10 pixels at the luminance value of 250 and the luminance value of 100, the first luminance value is 10*1+0.3*10=13. If the first brightness range is 8 to 12, the image as a whole is overexposed at this time.
需要说明的是,步骤S12所得到的第一亮度值仅为判断整体图像的一个亮度参考值,可以通过其他方式进行计算,如求取各个区域亮度值的平均值,可以通过对图像的L分量进行两次mean运算,以得到第一亮度值,这些均属于本申请实施例所涵盖的保护范围。It should be noted that the first brightness value obtained in step S12 is only a brightness reference value for judging the overall image, and can be calculated in other ways. Two mean operations are performed to obtain the first luminance value, which all belong to the protection scope covered by the embodiments of the present application.
在一些实施例中,如果图像较小难以统计直方图,即为了使其能够最大程度地显示出图像,可通过imresize(imresize:缩放处理)先将图像变成其整数倍的图像以便于图像被识别。In some embodiments, if the image is small and it is difficult to count the histogram, that is, in order to display the image to the greatest extent, the image can be transformed into an integer multiple of the image by imresize (imresize: zoom processing), so that the image can be easily displayed. identify.
进一步地,该补光方法还包括:步骤S15:在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。Further, the supplementary light method further includes: Step S15 : adjusting the brightness of the main supplementary light to adjust the first brightness value when the first brightness value is outside the first brightness range.
如果图像的第一亮度值在第一亮度范围之内,可以计算图像整体的第一亮度值,在第一亮度值在第一亮度范围内则可以判别边缘区域。如果第一亮度值位于第一亮度范围之外,则可以继续调整主补光灯的亮度,直至第一亮度值落入第一亮度范围。If the first brightness value of the image is within the first brightness range, the first brightness value of the entire image can be calculated, and when the first brightness value is within the first brightness range, the edge region can be discriminated. If the first brightness value is outside the first brightness range, the brightness of the main fill light may continue to be adjusted until the first brightness value falls within the first brightness range.
请参阅图5,图5为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S15的流程图。在步骤15中在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:Please refer to FIG. 5 , which is a flowchart of step S15 in the light supplement method for a dishwasher provided by the first embodiment of the present application. In step 15, when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value includes:
步骤S151:在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;Step S151: when the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
步骤S152:在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。Step S152: When the first brightness value is greater than the upper limit value of the first brightness range, reduce the brightness of the main fill light to reduce the first brightness value.
可以理解,步骤S151至步骤S152中,当图像过曝或者过暗时,通过调整主补光灯的亮度,对整体图像进行补光或者减光,其中调整的方式可以是调节主补光灯的输入电压或者调整用于控制主补光灯的脉冲宽度调制信号的占空比。It can be understood that in steps S151 to S152, when the image is overexposed or too dark, the overall image is filled or reduced by adjusting the brightness of the main fill light. The adjustment method may be to adjust the brightness of the main fill light. Input voltage or adjust the duty cycle of the PWM signal used to control the main fill light.
请参阅图6以及图7,图6为本申请第一实施例所提供的用于洗碗机的补光方法中步骤S13的流程图;图7为本申请第一实施例所提供的用于洗碗机的补光方法中示例性演示步骤S13的示意图。步骤S13中根据图像得到图像的边缘区域的第二亮度值包括:Please refer to FIG. 6 and FIG. 7 , FIG. 6 is a flowchart of step S13 in the light supplement method for a dishwasher provided by the first embodiment of the present application; A schematic diagram of the exemplary demonstration step S13 in the method for supplementing light in a dishwasher. In step S13, obtaining the second brightness value of the edge region of the image according to the image includes:
步骤S131:将图像分割成多个区域;Step S131: Divide the image into multiple regions;
步骤S132:根据主补光灯的视场角提取多个区域中的边缘区域;Step S132: extracting edge regions in multiple regions according to the field of view of the main fill light;
步骤S133:确定边缘区域的第二亮度值。Step S133: Determine the second brightness value of the edge area.
可以理解,通过图像分割将图像分割成多个区域,根据主补光灯的视场角,确定主补光灯所能覆盖的范围(可以根据主补光灯单独点亮后,获取清洗区域的图像,从而得到主补光灯所能覆盖的范围),将根据主补光灯覆盖的范围所在的区域从整个区域(多个区域)中剔除,从而提取出多个边缘区域。继而统计边缘区域的第二亮度值。It can be understood that the image is divided into multiple areas through image segmentation, and the range that can be covered by the main fill light is determined according to the field of view of the main fill light (you can obtain the cleaning area after the main fill light is lit separately. image, so as to obtain the range that the main fill light can cover), and according to the area covered by the main fill light, it will be removed from the entire area (multiple areas), thereby extracting multiple edge areas. Then, the second luminance value of the edge area is counted.
同样地,第二亮度值可以是对边缘区域中的每个区域的亮度值进行加权求和,然后计算边缘区域的平均值。Likewise, the second luminance value may be a weighted summation of the luminance values of each of the edge regions, and then an average value of the edge regions is calculated.
随后执行步骤S14:在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。Then step S14 is performed: in the case that the second brightness value is outside the preset second brightness range, adjust the brightness of the auxiliary light to adjust the second brightness value.
以第一副补光灯122a和第二副补光灯122b为示例,第一副补光灯122a和第二副补光灯122b分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光。在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯122a的亮度以调节左侧第二亮度值;在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯122b的亮度以调节右侧第二亮度值。这里,左侧第二亮度值可以指左边缘区域的第二亮度值,右侧第二亮度值可以指右边缘区域的第二亮度 值。Taking the first auxiliary fill light 122a and the second auxiliary fill light 122b as an example, the first auxiliary fill light 122a and the second auxiliary fill light 122b are respectively arranged on the left and right sides of the image acquisition device, and are respectively used for image acquisition. The left edge area and the right edge area of are filled with light. In the case where the second brightness value is outside the second brightness range, adjusting the brightness of the sub-fill light to adjust the second brightness value includes: at the left side of the left edge area where the second brightness value is outside the second brightness range In this case, adjust the brightness of the first auxiliary fill light 122a to adjust the second brightness value on the left side; when the second brightness value on the right side of the right edge area is outside the second brightness range, adjust the second auxiliary fill light The brightness of the lamp 122b is adjusted to the right second brightness value. Here, the left second brightness value may refer to the second brightness value of the left edge region, and the right second brightness value may refer to the second brightness value of the right edge region.
其中,调节的方式可以包括:如果左侧第二亮度值位于第二亮度范围之外,在左侧第二亮度值小于第二亮度范围的下限值的情况下,增加第一副补光灯122a的亮度,在左侧第二亮度值大于第二亮度范围的下限值的情况下,减少第一副补光灯122b的亮度。同样地,右侧的第二副补光灯122b可以根据右侧第二亮度值和第二亮度范围进行调节,从而保持边缘区域的第二亮度值保持不过暗并且不过曝。The adjustment method may include: if the second brightness value on the left is outside the second brightness range, in the case that the second brightness value on the left is less than the lower limit value of the second brightness range, adding a first auxiliary light When the brightness of 122a is greater than the lower limit of the second brightness range, the brightness of the first auxiliary light 122b is reduced. Likewise, the second auxiliary light 122b on the right can be adjusted according to the second brightness value and the second brightness range on the right, so as to keep the second brightness value of the edge area not too dark and not overexposed.
进一步地,本申请实施例中主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制,并通过控制脉冲宽度调制信号的占空比来控制亮度。Further, in the embodiment of the present application, the main fill light and the auxiliary fill light are individually controlled by different pulse width modulation signals, and the brightness is controlled by controlling the duty ratio of the pulse width modulation signals.
可以理解,脉冲宽度调制信号简称为PWM信号,其根据相应载荷的变化来调制晶体管基极或MOS管栅极的偏置,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率,例如,周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%,脉冲宽度调整就是占空比的调整,通过单独控制主补光灯和副补光灯,从而实现对清洗区域的多个区域进行调节。It can be understood that the pulse width modulation signal is abbreviated as PWM signal, which modulates the bias of the transistor base or the gate of the MOS tube according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS tube, so as to realize the switching regulated power supply. Changes in output. Duty cycle refers to the time ratio of high level in one cycle, for example, cycle T=64us, pulse width D=32us, then duty cycle=D/T=32/64=50%, pulse width The adjustment is the adjustment of the duty cycle. By controlling the main fill light and the auxiliary fill light separately, it can adjust multiple areas of the cleaning area.
本申请实施例还提供一种用于洗碗机的补光装置,该补光装置包括图像采集设备,主补光灯,至少一个副补光灯,及处理器。An embodiment of the present application further provides a light supplementing device for a dishwasher, where the supplementary light device includes an image acquisition device, a main supplementary light lamp, at least one auxiliary supplementary light lamp, and a processor.
其中,图像采集设备用于获取洗碗机的清洗区域的图像,主补光灯环绕图像采集设备设置,用于对图像进行补光,至少一个副补光灯,设置于主补光灯的至少一侧,用于对图像的边缘区域进行补光。处理器被配置成执行上述实施例的补光方法的全部步骤或者部分步骤。Wherein, the image acquisition device is used to acquire the image of the washing area of the dishwasher, the main supplementary light is arranged around the image acquisition device and used to supplement the image, and at least one auxiliary supplementary light is provided at least one of the main supplementary lights. One side, used to fill the edge area of the image. The processor is configured to execute all or part of the steps of the light supplement method of the above embodiments.
在一个实施例中,可选地,至少一个副补光灯包括:第一副补光灯,设置于图像采集设备的左侧;第二副补光灯,设置于图像采集设备的右侧。In one embodiment, optionally, the at least one auxiliary supplementary light includes: a first auxiliary supplementary light, which is arranged on the left side of the image acquisition device; and a second supplementary supplementary light, which is arranged on the right side of the image acquisition device.
在一个实施例中,该补光装置还包括独立设置的第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。通过独立设置的第一脉冲宽度调制设备、第二脉冲宽度调制设备、第三脉冲宽度调制设备,以实现对主补光灯、第一副补光灯、第二副补光灯分别独立的亮度控制。In one embodiment, the supplementary light device further includes an independently set first pulse width modulation device, which is electrically connected to the main supplementary light and used to adjust the brightness of the main supplementary light by controlling the duty ratio; the second pulse width modulation The device is electrically connected to the first auxiliary supplementary light for adjusting the brightness of the first auxiliary supplementary light by controlling the duty cycle; the third pulse width modulation device is electrically connected to the second auxiliary supplementary light for controlling the The duty cycle adjusts the brightness of the second supplementary light. Through the independently set first pulse width modulation device, second pulse width modulation device, and third pulse width modulation device, the brightness of the main supplementary light, the first auxiliary supplementary light and the second supplementary supplementary light are respectively independent. control.
综上,本申请实施例所提供的补光方法通过采用副补光灯对洗碗机的清洗区域进行补光,解决现有技术中采用补光灯环绕图像采集设备设计所存在的边缘区域较暗的问题,通过获取清洗区域的图像,先根据图像获取图像的第一亮度值,在第一亮度值位于预设的第一亮度范围内的情况下,对边缘区域的亮度进行评估,即获取第二亮度值,在第二亮度值位于预设的第二亮度范围之外的情况下,通过副补光灯的亮度调节第二亮度值,从而提高图像的亮度均衡性,使得图像识别的信息不缺失,提高图像识别的精度,从而提高用户的体验。To sum up, the supplementary light method provided by the embodiment of the present application uses the auxiliary supplementary light to supplement the light in the washing area of the dishwasher, thereby solving the problem of the existing edge area in the design of using supplementary light to surround the image acquisition device in the prior art. For the problem of darkness, by obtaining the image of the cleaning area, first obtain the first brightness value of the image according to the image, and when the first brightness value is within the preset first brightness range, evaluate the brightness of the edge area, that is, obtain The second brightness value, when the second brightness value is outside the preset second brightness range, adjust the second brightness value through the brightness of the auxiliary light, thereby improving the brightness balance of the image, so that the information of image recognition can be improved. Not missing, improve the accuracy of image recognition, thereby improving the user experience.
本申请第二实施例提供一种用于洗碗机的补光方法,其可以对洗碗机内的清洗区域进行补光且更快更节能。由于现有的洗碗机为了成本考虑,洗碗机的摄像头一般都是使用普通功能的摄像头,不带AI自动调焦以及曝光自适应算法。实现图像识别通常采用图像处理技术对图像进行微调,如图像亮度均衡调节,使得图像的亮度更为均衡以防止过曝或者过暗,但是对图像采用的处理技术往往容易失真从而导致效果不佳,且并不能适应所有的环境,特别是洗碗机内腔为封闭环境,如用户将洗碗机摆放在光线较差的环境时,图像处理很难达到预期的效果,达不到用户预期的体验。The second embodiment of the present application provides a light supplement method for a dishwasher, which can supplement light in a washing area in the dishwasher faster and save energy. Due to cost considerations in existing dishwashers, the cameras of dishwashers generally use ordinary cameras without AI auto-focus and exposure adaptive algorithms. To achieve image recognition, image processing technology is usually used to fine-tune the image, such as image brightness balance adjustment, so that the brightness of the image is more balanced to prevent overexposure or too dark, but the processing technology used for the image is often prone to distortion, resulting in poor results. And it cannot adapt to all environments, especially the inner cavity of the dishwasher is a closed environment. For example, when the user places the dishwasher in an environment with poor light, it is difficult for the image processing to achieve the expected effect, which is not expected by the user. experience.
由此,本申请实施例为解决上述问题,提供一种用于洗碗机的补光方法,洗碗机包括补光灯,用于对洗碗机的清洗区域进行补光。请参阅图8,图8为本申请第二实施例所提供的用于洗碗机的补光方法的流程图。该补光方法可以包括:Therefore, in order to solve the above problems, the embodiments of the present application provide a method for supplementing light for a dishwasher, wherein the dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher. Please refer to FIG. 8 , which is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application. The fill light method may include:
步骤S21:控制补光灯以初始亮度进行补光;Step S21: controlling the fill light to fill light with the initial brightness;
步骤S22:获取洗碗机内清洗区域的图像;Step S22: acquiring an image of the cleaning area in the dishwasher;
步骤S23:对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;Step S23: perform gray histogram statistics on the image to determine whether the image is too dark or overexposed;
步骤S24:在图像过曝或过暗的情况下,控制补光灯调节初始亮度;Step S24: when the image is overexposed or too dark, control the fill light to adjust the initial brightness;
步骤S25:在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;Step S25: in the case that the image is not overexposed or too dark, determine the current initial brightness as the target fill light brightness;
步骤S26:将目标补光亮度作为下一次的初始亮度默认值。Step S26 : take the target fill light brightness as the next initial brightness default value.
具体地,在步骤S21中,首先通过控制补光灯以默认的初始亮度进行补光,在补光灯为初始亮度下,获取洗碗机内清洗区域的图像。在一个示例中,初始亮度可以是补光灯的最大亮度的中值,具体可以根据洗碗机位于不同的环境下通过实验得到的一个较为合适的值,以适应大多数环境,增加洗碗机的适用范围。Specifically, in step S21, firstly, the supplementary light is controlled to perform supplementary light with a default initial brightness, and when the supplementary light is the initial brightness, an image of the cleaning area in the dishwasher is acquired. In one example, the initial brightness may be the median value of the maximum brightness of the fill light, which may be a more appropriate value obtained through experiments based on the dishwasher being located in different environments, so as to adapt to most environments and increase the number of dishwashers. scope of application.
在步骤S22中,图像采集设备可以获取清洗区域的图像,图像采集设备可以和补光灯同向设置,以获得更好的补光效果。In step S22, the image acquisition device may acquire an image of the cleaning area, and the image acquisition device may be set in the same direction as the fill light to obtain a better fill light effect.
在步骤S23中,对图像进行灰度直方图统计,其中“灰度直方图”是反映一幅图像中各灰度级像素出现的频率与灰度级的关系。以灰度级为横坐标,频率为纵坐标,绘制频率与灰度级的关系图。通常情况下,灰度直方图起始灰度设为0,直方图x轴代表0~255的灰度值,即可以代表亮度值,直方图y轴代表对应亮度值的像素数,灰度级为灰度值的等级划分,其表示了精密程度,如8级,16级,32级。本实施例中可以为256级,因此灰度值有0~255的区间范围。可以理解,设置直方图每个间隔代表的灰度范围,表示要图像灰度范围上的间隔数目,也可以理解为直方图一维数组的维数。In step S23, the grayscale histogram statistics are performed on the image, wherein the "grayscale histogram" reflects the relationship between the frequency of occurrence of each grayscale pixel in an image and the grayscale. Taking the gray level as the abscissa and the frequency as the ordinate, draw the relationship between the frequency and the gray level. Usually, the starting gray level of the grayscale histogram is set to 0, the x-axis of the histogram represents the grayscale value from 0 to 255, which can represent the brightness value, the y-axis of the histogram represents the number of pixels corresponding to the brightness value, and the grayscale level It is the level division of gray value, which indicates the degree of precision, such as level 8, level 16, level 32. In this embodiment, there may be 256 levels, so the grayscale value has an interval range of 0-255. It can be understood that setting the grayscale range represented by each interval of the histogram indicates the number of intervals on the grayscale range of the image to be imaged, which can also be understood as the dimension of the one-dimensional array of the histogram.
请参阅图9,图9为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S23的流程图。在步骤S23中,对图像进行直方图统计,以确定图像是否过暗或者过曝可以包括:Please refer to FIG. 9 , which is a flowchart of step S23 in the light supplement method for a dishwasher provided by the second embodiment of the present application. In step S23, performing histogram statistics on the image to determine whether the image is too dark or overexposed may include:
步骤S231:确定灰度直方图中灰度值对应为白色区域的像素数与平均像素数的比值;Step S231: Determine the ratio of the number of pixels whose gray value corresponds to the white area in the gray histogram to the average number of pixels;
步骤S232:在比值小于第一比例阈值的情况下,确定图像过暗;Step S232: in the case that the ratio is smaller than the first ratio threshold, determine that the image is too dark;
步骤S233:在比值大于第二比例阈值的情况下,确定图像过曝。Step S233: When the ratio is greater than the second ratio threshold, determine that the image is overexposed.
可以理解,当灰度直方图中横轴坐标对应的灰度值为250±Δx(即对应步骤S231的白色区域)的纵坐标(像素数)占平均像素数(总像素数除以灰度值)的比值远远大于其他的灰度值时,此时证明图像白色区域占比较多,图像对应为过曝。相反如果灰度坐标250附近的纵坐标(像素数)占比非常低,而坐标50(对应为灰度直方图的黑色区域)的像素数占比较高,这样的图像则是亮度不够,即上述的图像过暗。当250±Δx坐标的纵轴的值和平均像素数的占比不高时,此时白色区域在整张图像中的占比不高且图像亮度整体分布较为均衡,则认为不是过曝也没有过暗。It can be understood that when the grayscale value corresponding to the horizontal axis coordinate in the grayscale histogram is 250±Δx (that is, the ordinate (number of pixels) corresponding to the white area in step S231 ) accounts for the average number of pixels (the total number of pixels divided by the grayscale value) When the ratio of ) is much larger than other gray values, it proves that the white area of the image accounts for a large proportion, and the image corresponds to overexposure. On the contrary, if the proportion of the ordinate (number of pixels) near the grayscale coordinate 250 is very low, and the number of pixels at the coordinate 50 (corresponding to the black area of the grayscale histogram) is relatively high, such an image is not bright enough, that is, the above image is too dark. When the ratio of the value of the vertical axis of the 250±Δx coordinate to the average number of pixels is not high, the proportion of the white area in the whole image is not high and the overall distribution of the image brightness is relatively balanced, it is considered that there is no overexposure or no too dark.
利用上述特性,在本申请实施例中,可选地第一比例阈值为1:3,第二比例阈值为3:1,则其灰度值对应在250±Δx,即白色区域的像素数在平均像素数的比在1:3至3:1之间,此时图像是不过曝且不过暗的,如果是比值大于3:1则认为图像过度曝光,如果是小于1:3则认为图像亮度过暗,即上述的步骤S232至步骤S233。Using the above characteristics, in the embodiment of the present application, optionally the first ratio threshold is 1:3, and the second ratio threshold is 3:1, then the grayscale value corresponds to 250±Δx, that is, the number of pixels in the white area is The ratio of the average number of pixels is between 1:3 and 3:1. At this time, the image is not exposed and not too dark. If the ratio is greater than 3:1, the image is considered to be overexposed, and if it is less than 1:3, the image is considered bright. Too dark, that is, the above-mentioned steps S232 to S233.
请参阅图10,图10为本申请第二实施例所提供的用于洗碗机的补光方法的流程图。步骤S24中在图像过曝或过暗的情况下,控制补光灯调节初始亮度括:Please refer to FIG. 10 . FIG. 10 is a flowchart of a light supplement method for a dishwasher provided by the second embodiment of the present application. In step S24, when the image is overexposed or too dark, controlling the fill light to adjust the initial brightness includes:
步骤S241:在图像过曝的情况下,控制补光灯增加初始亮度;Step S241: when the image is overexposed, control the fill light to increase the initial brightness;
步骤S242:在图像过暗的情况下,控制补光灯减少初始亮度。Step S242: When the image is too dark, control the fill light to reduce the initial brightness.
进一步地,可以通过调节用于控制补光灯的脉冲宽度调制信号的占空比来调节补光灯的亮度。脉冲宽度调制根据相应载荷的变化来调制可控开关(例如,晶体管基极或MOS管栅极)的偏置电压,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率,例如周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%。脉冲宽度调整就是占空比的调整。Further, the brightness of the fill light can be adjusted by adjusting the duty cycle of the pulse width modulation signal used to control the fill light. Pulse width modulation modulates the bias voltage of the controllable switch (for example, transistor base or MOS transistor gate) according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or MOS transistor, so as to realize the output of the switching regulated power supply. Change. Duty cycle refers to the time ratio of high level in one cycle, for example, cycle T=64us, pulse width D=32us, then duty cycle=D/T=32/64=50%. Pulse width adjustment is the adjustment of the duty cycle.
控制补光灯增加或者减少初始亮度的方式可以包括:按照时间周期性增加或者减少脉 冲宽度调制信号的占空比,例如可以按照每1秒,以10%的速度增加或者减少脉冲宽度调制信号的占空比。The method of controlling the fill light to increase or decrease the initial brightness may include: periodically increasing or decreasing the duty cycle of the pulse width modulation signal according to time, for example, it may increase or decrease the pulse width modulation signal at a rate of 10% every 1 second. duty cycle.
在一些实施例中,可以通过改变补光灯的电压来改变亮度。In some embodiments, the brightness can be changed by changing the voltage of the fill light.
进一步地,在每次改变亮度时,控制图像采集设备重新采集图像,循环至步骤S23,直到图像无过曝或者过暗后进入步骤S25。Further, each time the brightness is changed, the image capture device is controlled to capture the image again, and the loop goes to step S23 until the image is not overexposed or too dark, and then goes to step S25.
可以理解,如果初始亮度无需调节此时图像已经没有过暗或者过曝,此时则直接从步骤S23进入步骤S25。It can be understood that if the initial brightness does not need to be adjusted and the image is not too dark or overexposed, then the process proceeds directly from step S23 to step S25.
请参阅图11,图11为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24的另一流程图。在一个实施例中,步骤24中控制补光灯调节初始亮度包括:Please refer to FIG. 11 . FIG. 11 is another flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application. In one embodiment, controlling the fill light to adjust the initial brightness in step 24 includes:
步骤S241':将补光灯的亮度从零至最大分为多个等级;Step S241': Divide the brightness of the fill light into multiple levels from zero to the maximum;
步骤S242':从初始亮度对应的等级依次减少或者增加亮度的等级。Step S242': Decrease or increase the brightness level sequentially from the level corresponding to the initial brightness.
具体地,可以将补光灯的亮度从零到额定功率的最大亮度分为多个等级,通过控制脉冲宽度调制信号的占空比来调节等级,例如将亮度从零到额定功率的最大亮度分为10个等级,最大亮度对应脉冲宽度调制信号的占空比为100%,亮度为0对应脉冲宽度调制信号的占空比为0%,则第一等级对应脉冲宽度调制信号的占空比为10%,依次类推。Specifically, the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal, for example, the brightness from zero to the maximum brightness of the rated power can be divided into is 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, then the first level corresponds to the duty cycle of the pulse width modulation signal is 10%, and so on.
例如,初始亮度可以对应第五等级,即对应脉冲宽度调制信号的占空比为50%,根据图像过曝或者过暗,依次提高等级或者减少等级,如增加至对应脉冲宽度调制信号的占空比为60%的第六等级,通过该类方式进行调节,可以加快补光灯亮度调节的速度,从而加快后续图像识别的响应。For example, the initial brightness may correspond to the fifth level, that is, the duty cycle corresponding to the PWM signal is 50%, and the level may be increased or decreased in turn according to whether the image is overexposed or too dark, such as increasing to the duty cycle corresponding to the PWM signal. The sixth level with a ratio of 60% can be adjusted in this way to speed up the adjustment of the brightness of the fill light, thereby speeding up the response of subsequent image recognition.
请参阅图12,图12为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S24进一步的流程图。补光方法还可以包括:Please refer to FIG. 12 . FIG. 12 is a further flowchart of step S24 in the light supplement method for a dishwasher provided by the second embodiment of the present application. The fill light method can also include:
步骤S243':在每次减少或者增加初始亮度后,再次获取洗碗机内清洗区域的图像;Step S243': after reducing or increasing the initial brightness each time, acquire the image of the cleaning area in the dishwasher again;
步骤S244':循环对图像进行灰度直方图统计,在比值位于第一比例阈值和第二比例阈值之间的情况下,确定当前的初始亮度为目标补光亮度。Step S244': Circularly perform grayscale histogram statistics on the image, and when the ratio is between the first proportional threshold and the second proportional threshold, determine the current initial brightness as the target fill light brightness.
即在每次减少或者增加初始亮度后,控制图像采集设备再次获取图像,并重新跳至步骤S23,直到图像没有过曝或者过暗,此时将当前调节后的初始亮度作为目标补光亮度。That is, after each reduction or increase of the initial brightness, the image acquisition device is controlled to acquire the image again, and the process jumps to step S23 again until the image is not overexposed or too dark, at which time the currently adjusted initial brightness is used as the target fill light brightness.
请参阅图13,图13为本申请第二实施例所提供的用于洗碗机的补光方法中步骤S26的流程图。步骤S26中将目标补光亮度作为下一次的初始亮度默认值包括:Please refer to FIG. 13 , which is a flowchart of step S26 in the light supplement method for a dishwasher provided by the second embodiment of the present application. In step S26, the target fill light brightness is used as the next initial brightness default value including:
步骤S261:记录目标补光亮度和对应目标补光亮度的调整时间;Step S261: record the target fill light brightness and the adjustment time corresponding to the target fill light brightness;
步骤S262:将目标补光亮度作为下一次对应调整时间的初始亮度默认值。Step S262 : take the target fill light brightness as the default initial brightness value corresponding to the next adjustment time.
可以理解,该步骤主要是考虑用户在使用洗碗机时,通常都是将洗碗机摆放在固定位置,在大多数情况下,同一位置的光照环境都是相同的,基于这一特点,通过记录目标亮度值以及对应目标补光亮度的调整时间,如100cd/m 2和12:00,150cd/m 2和9:00,在下一次使用洗碗机时,用户如果在9:00使用洗碗机,此时补光灯的初始亮度默认值为对应上次该时间的目标补光亮度,即150cd/m 2,此时再根据步骤S21至步骤S23,如果在补光灯为该初始亮度默认值下所采集的图像没有过曝或者过暗,则无需调整,从而减少获取合适图像的时间,且补光灯无需多次调解,可以节约能耗,更智能化。 It can be understood that this step mainly considers that when users use the dishwasher, they usually place the dishwasher in a fixed position. In most cases, the lighting environment of the same position is the same. Based on this feature, By recording the target brightness value and the adjustment time corresponding to the target fill light brightness, such as 100cd/ m2 and 12:00, 150cd/ m2 and 9:00, the next time the dishwasher is used, if the user uses the washing machine at 9:00 In the bowl machine, the default value of the initial brightness of the fill light is the target fill light brightness corresponding to the last time, that is, 150cd/m 2 . At this time, according to steps S21 to S23, if the fill light is the initial brightness The images captured under the default value are not overexposed or too dark, so there is no need to adjust, thereby reducing the time to obtain a suitable image, and the fill light does not need to be adjusted multiple times, which can save energy and be more intelligent.
综上,本申请实施例提供的补光方法通过控制补光灯以初始亮度进行补光并获取清洗区域的图像,通过对图像的灰度直方图进行统计,对补光灯的输出亮度调节以确定合适的目标补光亮度,最终实现图像不过曝且不过暗。另外通过确定目标补光亮度作为下一次的初始亮度默认值,可以减少洗碗机调节补光灯的亮度的次数,从而减少获取合适图像的时间,节约能耗,加快图像识别的响应。To sum up, the fill light method provided by the embodiments of the present application controls the fill light to fill light with the initial brightness and acquires an image of the cleaning area, and adjusts the output brightness of the fill light to a certain level by making statistics on the grayscale histogram of the image. Determine the appropriate target fill light brightness, and finally achieve that the image is not overexposed and not too dark. In addition, by determining the target fill light brightness as the next initial brightness default value, the number of times the dishwasher adjusts the brightness of the fill light can be reduced, thereby reducing the time to obtain a suitable image, saving energy consumption, and speeding up the response of image recognition.
本申请第三实施例还提供一种用于洗碗机的补光方法,可以对洗碗机内的清洗区域进 行更节能快速补光。现有的洗碗机中通常包括照明灯,当用户开洗碗机的门时,照明灯自动开启,以方便用户放置餐具。有的洗碗机还配置有补光灯,但是补光灯和照明灯仅仅实现开关功能,不能进行亮度的线性调节。所以照明灯和补光灯提供的亮度是一个固定的亮度,无法根据洗碗机内部清洗区域的实际亮度进行智能地自适应调节。因此无论是白天还是黑夜,其亮度都是一样,缺乏智能感导致用户使用效果不佳。The third embodiment of the present application also provides a light supplement method for a dishwasher, which can perform more energy-efficient and fast supplement light for the cleaning area in the dishwasher. Existing dishwashers generally include lighting lamps, and when a user opens the door of the dishwasher, the lighting lamps are automatically turned on to facilitate the user to place tableware. Some dishwashers are also equipped with a fill light, but the fill light and the lighting only realize the switch function, and the brightness cannot be adjusted linearly. Therefore, the brightness provided by the lighting lamp and the fill light is a fixed brightness, and cannot be adjusted intelligently and adaptively according to the actual brightness of the washing area inside the dishwasher. Therefore, whether it is day or night, its brightness is the same, and the lack of intelligence leads to poor user use.
请参阅图14,图14示例性示出根据本申请第三实施例所提供的用于洗碗机的补光方法所应用的洗碗机的补光装置的结构示意图,该补光装置可以包括:Please refer to FIG. 14 . FIG. 14 exemplarily shows a schematic structural diagram of a light-filling device for a dishwasher to which the light-filling method for a dishwasher provided according to the third embodiment of the present application is applied. The light-filling device may include: :
图像采集设备11,用于采集洗碗机100内清洗区域的图像;The image acquisition device 11 is used to acquire the image of the cleaning area in the dishwasher 100;
补光灯12,用于对清洗区域发射光线,以对图像采集设备11所采集的图像进行补光;The fill light 12 is used to emit light to the cleaning area to fill the image collected by the image acquisition device 11;
照明灯13,用于对清洗区域发射光线,以实现照明效果。The lighting lamp 13 is used for emitting light to the cleaning area to achieve lighting effect.
处理器(未图示),电性连接补光灯12以及照明灯13,用于控制补光灯12和照明灯13发射光线。The processor (not shown) is electrically connected to the fill light 12 and the lighting lamp 13 for controlling the fill light 12 and the lighting lamp 13 to emit light.
在一个示例中,照明灯13和补光灯12可以位于洗碗机内部空间的同一面。在另一示例中,照明灯13和补光灯12可以位于不同面,以从多个方位提供照明,从而方便图像采集设备11获取更完整和清晰的图像。In one example, the light 13 and the fill light 12 may be located on the same side of the interior space of the dishwasher. In another example, the illumination light 13 and the supplementary light 12 may be located on different sides to provide illumination from multiple directions, so as to facilitate the image capturing device 11 to obtain a more complete and clearer image.
在一个示例中,补光灯12可以采用环形的形状,并围绕图像采集设备11设置,以方便引线,也可以减少在洗碗机内壁开孔的个数,从而增大洗碗机的清洗区域的空间。In one example, the fill light 12 can be in the shape of a ring, and is arranged around the image capture device 11 to facilitate lead wires, and the number of openings in the inner wall of the dishwasher can also be reduced, thereby increasing the washing area of the dishwasher Space.
请参阅图15,图15为本申请第三实施例所提供的用于洗碗机的补光方法的流程图。在本申请实施例中,洗碗机包括补光灯以及照明灯,以用于对清洗区域进行补光,洗碗机还包括柜门,该补光方法包括:Please refer to FIG. 15 . FIG. 15 is a flowchart of a light supplement method for a dishwasher provided by a third embodiment of the present application. In the embodiment of the present application, the dishwasher includes a fill light and an illuminating lamp for fill light in the cleaning area, the dishwasher further includes a cabinet door, and the fill light method includes:
步骤S31:确定柜门的开闭状态;Step S31: determine the opening and closing state of the cabinet door;
步骤S32:在开闭状态被确定为柜门被开启的情况下,控制照明灯开启,以及控制补光灯处于关闭状态。Step S32 : when the open and closed state is determined to be that the cabinet door is opened, the lighting lamp is controlled to be turned on, and the supplementary light is controlled to be turned off.
步骤S33:获取清洗区域的第一图像;Step S33: acquiring the first image of the cleaning area;
步骤S34:根据第一图像得到第一图像的第一亮度值;Step S34: obtaining the first brightness value of the first image according to the first image;
步骤S35:根据第一亮度值确定补光灯所需的补光亮度;Step S35: determining the fill light brightness required by the fill light according to the first brightness value;
步骤S36:控制补光灯以所需的补光亮度对清洗区域进行补光;Step S36: controlling the fill light to fill the cleaning area with the required fill light brightness;
步骤S37:获取经补光后的清洗区域的第二图像;Step S37: acquiring a second image of the cleaning area after the supplementary light;
步骤S38:根据第二图像确定第二亮度值;Step S38: determining a second brightness value according to the second image;
步骤S39:在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。Step S39 : when the second brightness value is outside the preset brightness value range, control the fill light to perform secondary adjustment on the fill light brightness.
具体地,在步骤S31至步骤S32中,可以通过在柜门处设置限位器或者位移传感器来检测柜门的开闭状态。可以读取限位器或者位移传感器检测的柜门的开闭状态。如果柜门被开启,则可以认为用户向清洗区域放置餐具,此时可以控制补光灯保持关闭,控制照明灯开启,以照明清洗区域,方便用户放置餐具。Specifically, in steps S31 to S32, the opening and closing state of the cabinet door may be detected by arranging a limiter or a displacement sensor at the cabinet door. The opening and closing status of the cabinet door detected by the limiter or displacement sensor can be read. If the cabinet door is opened, it can be considered that the user places tableware in the washing area. At this time, the supplementary light can be controlled to keep off, and the lighting lamp can be controlled to be turned on, so as to illuminate the cleaning area and facilitate the user to place the tableware.
在步骤S33中,在补光灯保持关闭的情况下下获取清洗区域的第一图像,例如可以通过图像采集设备(例如相机)来采集第一图像。在步骤S34中,可以根据第一图像得到第一图像的第一亮度值。例如,第一亮度值可以是第一图像中像素点的亮度平均值。在步骤S35中可以根据第一亮度值确定补光灯所需的补光亮度。具体地,例如第一亮度值可以是在没有开启补光灯仅依靠照明灯的光线照明的情况下所采集的图像的亮度值。可以预先设定目标亮度值。该目标亮度值可以为能够提供理想照明所需的亮度值。该目标亮度值可以根据实际应用或用户偏好进行设置。通过第一亮度值和目标亮度值的差值,可以确定补光灯所需的补光亮度。In step S33, a first image of the cleaning area is acquired under the condition that the fill light is kept off. For example, the first image may be acquired by an image acquisition device (eg, a camera). In step S34, the first luminance value of the first image may be obtained according to the first image. For example, the first luminance value may be an average luminance of pixels in the first image. In step S35, the fill light brightness required by the fill light lamp may be determined according to the first brightness value. Specifically, for example, the first brightness value may be the brightness value of the image captured under the condition that the supplementary light is not turned on and only relies on the light of the illuminating lamp for illumination. The target brightness value can be preset. The target brightness value may be the brightness value required to provide ideal illumination. The target brightness value can be set according to actual applications or user preferences. Through the difference between the first brightness value and the target brightness value, the fill light brightness required by the fill light lamp can be determined.
请参阅图16,图16为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S35 的流程图。步骤S35中根据第一亮度值确定补光灯所需的补光亮度包括:Please refer to FIG. 16 . FIG. 16 is a flowchart of step S35 in the light supplement method for a dishwasher provided by the third embodiment of the present application. In step S35, determining the fill light brightness required by the fill light according to the first brightness value includes:
步骤S331:将补光灯的补光亮度从零至最大分为多个等级;Step S331: Divide the fill light brightness of the fill light into multiple levels from zero to the maximum;
步骤S332:确定第一亮度值和预设的目标亮度值的差值;Step S332: Determine the difference between the first brightness value and the preset target brightness value;
步骤S333:根据差值确定补光灯所需的补光亮度的等级。Step S333: Determine the brightness level of the supplementary light required by the supplementary light according to the difference.
具体地,可以将补光灯的亮度从零到额定功率的最大亮度分为多个等级,可以通过控制提供给补光灯的脉冲宽度调制信号的占空比来调节等级。例如,可以将亮度从零到额定功率的最大亮度分为10个等级,最大亮度对应脉冲宽度调制信号的占空比为100%,亮度为0对应脉冲宽度调制信号的占空比为0%,则第一等级对应的脉冲宽度调制信号的占空比可以为10%,依次类推。Specifically, the brightness of the fill light can be divided into multiple levels from zero to the maximum brightness of the rated power, and the levels can be adjusted by controlling the duty cycle of the pulse width modulation signal provided to the fill light. For example, the maximum brightness from zero to rated power can be divided into 10 levels, the maximum brightness corresponds to the duty cycle of the pulse width modulation signal is 100%, the brightness is 0 corresponds to the duty cycle of the pulse width modulation signal is 0%, Then, the duty cycle of the pulse width modulation signal corresponding to the first level may be 10%, and so on.
例如,目标亮度值可以对应第五等级,即对应脉冲宽度调制信号的占空比为50%。根据当前的第一亮度值所处的等级和目标亮度值的等级的等级差,可以确定补光灯所需的补光亮度的等级,如第一亮度值对应的等级为第一等级,此时和目标亮度值差距为四个等级,则所需的补光亮度的等级可以四个等级。通过该类方式进行调节,可以利用照明灯光线的影响来调控补光灯,从而加快补光灯进行调节的响应,且节省补光灯的能耗。For example, the target luminance value may correspond to the fifth level, that is, the duty cycle corresponding to the pulse width modulation signal is 50%. According to the level difference between the level of the current first brightness value and the level of the target brightness value, the level of the fill light brightness required by the fill light can be determined. For example, the level corresponding to the first brightness value is the first level, at this time If the difference from the target brightness value is four levels, the required level of fill light brightness can be four levels. By adjusting in this way, the fill light can be regulated by the influence of the lighting light, so as to speed up the adjustment response of the fill light and save the energy consumption of the fill light.
在步骤S36至步骤S39,控制补光灯开启并以所需的补光亮度对清洗区域进行补光。可以获取经补光后的清洗区域的第二图像,可以根据第二图像确定第二亮度值。例如,第二亮度值可以为第二图像中像素点的亮度平均值。然后可以判断第二亮度值是否位于预设的亮度值范围内,在第二亮度值位于亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。From step S36 to step S39, control the fill light to turn on and fill the cleaning area with the required fill light brightness. A second image of the cleaned area after supplemented light may be acquired, and a second brightness value may be determined according to the second image. For example, the second brightness value may be an average brightness value of pixels in the second image. Then, it can be determined whether the second brightness value is within the preset brightness value range, and when the second brightness value is outside the brightness value range, the supplementary light is controlled to perform secondary adjustment of the supplementary light brightness.
具体地,控制补光灯以所需补光亮度进行补光后,可以再次控制图像采集设备获取第二图像,通过判断第二亮度值是否在亮度值范围内来确定是否需要对补光亮度进行二次调整。这里,亮度值范围可以是亮度在该亮度值范围内图像采集设备获取的图像不会存在过曝(过度曝光)或者过暗。例如,亮度值范围的亮度上限值可以与过曝相关联,亮度下限值可以与过暗相关联。如果第二亮度值在亮度值范围之外,即认为获取的第二图像存在过曝或者过暗,则需要控制补光灯对补光亮度进行二次调整。Specifically, after controlling the fill light to perform fill light with the required fill light brightness, the image acquisition device can be controlled again to obtain the second image, and whether the fill light brightness needs to be determined by judging whether the second brightness value is within the range of brightness values Secondary adjustment. Here, the brightness value range may be a brightness value within which the image acquired by the image acquisition device will not be overexposed (overexposed) or too dark. For example, an upper luminance value of a range of luminance values may be associated with overexposure, and a lower luminance value may be associated with overdark. If the second brightness value is outside the brightness value range, that is, it is considered that the acquired second image is overexposed or too dark, it is necessary to control the fill light to perform a secondary adjustment of the fill light brightness.
请参阅图17,图17为本申请第三实施例所提供的用于洗碗机的补光方法中步骤S38的流程图。在一个具体实施例中,步骤S38中亮度值范围包括亮度下限值和亮度上限值,在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整可以包括:Please refer to FIG. 17 . FIG. 17 is a flowchart of step S38 in the light supplement method for a dishwasher provided by the third embodiment of the present application. In a specific embodiment, the range of brightness values in step S38 includes a lower limit value of brightness and an upper limit value of brightness, and when the second brightness value is outside the preset range of brightness values, the fill light is controlled to adjust the brightness of the fill light. Making secondary adjustments can include:
步骤S381:在第二亮度值大于亮度上限值时,减少补光亮度;Step S381: when the second brightness value is greater than the upper limit value of brightness, reduce the brightness of the supplementary light;
步骤S382:在第二亮度值小于亮度下限值时,增加补光亮度。Step S382: when the second brightness value is less than the lower limit value of brightness, increase the brightness of the supplementary light.
可以理解,通过二次调整补光灯的亮度,对整体图像进行补光或者减光,调整的方式可以包括调节补光灯的输入电压。例如可以通过调整脉冲宽度调制信号的占空比来调节输入电压。亮度上限值可以为判断第二图像是否过曝的临界值,亮度下限值可以为判断第二图像是否过暗的临界值。It can be understood that by adjusting the brightness of the supplementary light twice, the overall image is supplemented or reduced, and the adjustment method may include adjusting the input voltage of the supplementary light. The input voltage can be adjusted, for example, by adjusting the duty cycle of the pulse width modulated signal. The upper luminance value may be a critical value for determining whether the second image is overexposed, and the lower luminance value may be a critical value for determining whether the second image is too dark.
通过上述将补光灯的补光亮度从零至最大分为多个等级的策略,减少补光亮度包括:依次减少补光亮度的等级,增加补光亮度包括:依次增加补光亮度的等级。Through the above strategy of dividing the fill light brightness of the fill light into multiple levels from zero to the maximum, reducing the fill light brightness includes sequentially decreasing the fill light brightness levels, and increasing the fill light brightness includes sequentially increasing the fill light brightness levels.
例如,假设当前对应补光亮度为第四等级,此时如果第二亮度值大于亮度上限值,则依次减少补光亮度的等级,如将补光亮度调整到第三等级,再获取一次第二图像,如果第二亮度值仍然大于亮度上限值,继续降低补光亮度,将补光亮度调整到第二等级,直到第二亮度值位于亮度值范围内,此时可以确定当前补光亮度为目标补光亮度。For example, assuming that the current corresponding fill light brightness is the fourth level, at this time, if the second brightness value is greater than the upper limit value of the brightness, the level of fill light brightness is decreased in turn. For example, the fill light brightness is adjusted to the third level, and the first For the second image, if the second brightness value is still greater than the upper limit of brightness, continue to reduce the brightness of the fill light, and adjust the brightness of the fill light to the second level until the second brightness value is within the range of brightness values. At this time, the current fill light brightness can be determined. Fill light brightness for the target.
其中,在开闭状态被确定为柜门被开启的情况下,控制所述补光灯开启后经过预设的第一时间后关闭。Wherein, when the open and closed state is determined to be that the cabinet door is opened, the supplementary light is controlled to be turned off after a preset first time has elapsed after it is turned on.
进一步地,在经过步骤S38找到目标补光亮度后,等待关门信息,经过预设的延迟时 间后,关闭照明灯。Further, after finding the target fill light brightness through step S38, wait for the door closing information, and after a preset delay time, turn off the lighting.
进一步地,在接收到关门信息后,关闭补光灯,保存该次补光灯输出的目标补光亮度作为下一次的默认值。Further, after receiving the door closing information, turn off the fill light, and save the target fill light brightness output by the fill light this time as a default value for the next time.
综上,本申请实施例提供的补光方法,在开启照明灯方便用户放置餐具的基础上,根据照明灯光线调整补光灯的补光亮度,从而根据洗碗机内部清洗区域的实际亮度进行智能地自适应调节。在用户开门时自动打开照明灯,方便用户放置餐具,同时根据照明灯的亮度调节补光灯的亮度,更智能、人性化,能给用户带来更好的使用体验。To sum up, the fill light method provided by the embodiment of the present application, on the basis of turning on the lighting lamp to facilitate the user to place tableware, adjusts the fill light brightness of the fill light according to the line of the lighting light, so as to perform the lighting according to the actual brightness of the cleaning area inside the dishwasher. Intelligent adaptive adjustment. When the user opens the door, the lighting is automatically turned on, which is convenient for the user to place tableware. At the same time, the brightness of the fill light is adjusted according to the brightness of the lighting, which is more intelligent and user-friendly, and can bring users a better experience.
本申请第四实施例提供一种用于洗碗机的补光方法,可以对洗碗机内的补光灯进行亮度控制。现有技术采用补光灯进行补光下,随洗碗机使用的时间变化,其补光灯的灯珠会老化,导致其亮度变弱,以至于在图像采集的时候获取的图像会出现过暗。在进行图像识别时容易导致图像过暗,且用户觉得亮度不够,影响产品使用的体验。该补光方法可以解决上述问题。The fourth embodiment of the present application provides a method for supplementing light for a dishwasher, which can control the brightness of the supplementary light in the dishwasher. In the prior art, when the fill light is used for fill light, with the time change of the dishwasher, the lamp beads of the fill light will age, resulting in a weakening of its brightness, so that the image acquired during the image collection will appear too much. dark. When performing image recognition, it is easy to cause the image to be too dark, and the user feels that the brightness is not enough, which affects the experience of the product. The supplementary light method can solve the above problems.
请参阅图18,图18为本申请实施例四所提供的用于洗碗机的补光方法的流程图;在本申请实施例中,补光方法可以包括:Please refer to FIG. 18 . FIG. 18 is a flowchart of a light supplement method for a dishwasher provided in Embodiment 4 of the present application; in this embodiment of the present application, the light supplement method may include:
步骤S41:在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;Step S41: when the dishwasher is in the factory state, control the fill light to fill the washing area of the dishwasher with a first brightness corresponding to a preset first duty ratio;
步骤S42:获取清洗区域的第一图像;Step S42: acquiring the first image of the cleaning area;
步骤S43:根据第一图像得到第一图像的第一亮度值;Step S43: obtaining a first brightness value of the first image according to the first image;
步骤S44:在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;Step S44: when the dishwasher is in the calibration state, control the fill light to fill the washing area of the dishwasher with the second brightness corresponding to the first duty cycle;
步骤S45:获取清洗区域的第二图像;Step S45: acquiring a second image of the cleaning area;
步骤S46:根据第二图像得到第二图像的第二亮度值;Step S46: obtaining a second brightness value of the second image according to the second image;
步骤S47:确定第二亮度值和第一亮度值的差值;Step S47: Determine the difference between the second brightness value and the first brightness value;
步骤S48:在差值大于预设的阈值的情况下,增大占空比以增大补光灯亮度。Step S48 : when the difference is greater than a preset threshold, increase the duty cycle to increase the brightness of the fill light.
具体地,可以使用脉冲宽度调制(PWM)信号来控制补光灯。通过调节PWM信号的占空比可以控制补光灯的亮度。Specifically, a pulse width modulation (PWM) signal may be used to control the fill light. The brightness of the fill light can be controlled by adjusting the duty cycle of the PWM signal.
可以理解,PWM信号可以根据相应载荷的变化来调制晶体管基极或MOS管栅极的偏置,来实现晶体管或MOS管导通时间的改变,从而实现开关稳压电源输出的改变。占空比是指高电平在一个周期之内所占的时间比率。例如,周期T=64us,脉冲宽度D=32us,则占空比=D/T=32/64=50%。通过调整用于控制补光灯的脉冲宽度调制信号的占空比,可以实现亮度控制。It can be understood that the PWM signal can modulate the bias of the transistor base or the gate of the MOS transistor according to the change of the corresponding load, so as to realize the change of the conduction time of the transistor or the MOS transistor, thereby realizing the change of the output of the switching regulated power supply. The duty cycle refers to the ratio of the time the high level occupies within a cycle. For example, period T=64us, pulse width D=32us, then duty ratio=D/T=32/64=50%. Brightness control can be achieved by adjusting the duty cycle of the pulse width modulation signal used to control the fill light.
具体地,在洗碗机位于出厂状态的情况下,即洗碗机刚开始出厂时,可以先设置好补光灯较佳的亮度,该亮度可以对应于PWM信号的占空比(可以称为设定占空比或上述的第一占空比)。在洗碗机出厂时,可以将用于控制补光灯的PWM信号的占空比调整为该第一占空比,使得补光灯可以以第一占空比对应的第一亮度对洗碗机的清洗区域进行补光。然后可以通过图像采集设备(例如相机)拍摄在第一亮度下的清洗区域的第一图像,根据第一图像得到第一图像的第一亮度值,以及可以保存上述数据,例如指第一亮度值、第一占空比。Specifically, when the dishwasher is in the factory state, that is, when the dishwasher is just starting to leave the factory, a better brightness of the fill light can be set first, and the brightness can correspond to the duty cycle of the PWM signal (which can be referred to as set the duty cycle or the first duty cycle described above). When the dishwasher is shipped from the factory, the duty cycle of the PWM signal used to control the fill light can be adjusted to the first duty cycle, so that the fill light can wash dishes at the first brightness corresponding to the first duty cycle. Fill light in the cleaning area of the machine. Then, a first image of the cleaning area under the first brightness can be captured by an image acquisition device (eg, a camera), a first brightness value of the first image can be obtained according to the first image, and the above-mentioned data can be saved, for example, referring to the first brightness value , the first duty cycle.
当需要对补光灯进行调光校准的时候,即在洗碗机处于校准状态的情况下,可以控制补光灯以同样的第一占空比的脉冲宽度调制信号打开,启动图像采集设备对清洗区域进行拍照采集,以获取第二图像,根据第二图像可以得到第二图像的第二亮度值。然后将第二亮度值与出厂时的第一亮度值进行比较。如果第一亮度和第二亮度之间的差值超过一定的阈值,则可以调整补光灯的亮度,以使得第二亮度值达到第一亮度值。When the dimming calibration of the fill light is required, that is, when the dishwasher is in the calibration state, the fill light can be controlled to be turned on with the same first duty cycle pulse width modulation signal, and the image acquisition device can be started to The cleaning area is photographed and collected to obtain a second image, and a second brightness value of the second image can be obtained according to the second image. The second brightness value is then compared with the first brightness value from the factory. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light can be adjusted so that the second brightness value reaches the first brightness value.
可以以预设的第一时间周期和/或在清洗区域没有餐具的情况下,控制补光灯进入校准 状态。例如,第一时间周期可以是例如半年、一年,即可以每隔半年或者一年进行一次校准。也可以根据用户自行触发进入校准状态,从而对补光灯进行维护。The fill light can be controlled to enter the calibration state at a preset first time period and/or when there is no utensils in the washing area. For example, the first time period may be, for example, half a year, a year, that is, calibration may be performed every half year or year. It can also enter the calibration state according to the user's own trigger, so as to maintain the fill light.
可以理解,通过对补光灯进行校准,可以获取补光灯在同样脉冲宽度调制信号的占空比下的亮度差异,根据该差异可以对补光灯进行适应性调整,从而防止补光灯由于使用寿命的影响导致其亮度变弱,影响后续的图像识别效果及照明效果,给用户带来更好的体验。It can be understood that by calibrating the fill light, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, thereby preventing the fill light from being caused by The influence of the service life leads to the weakening of its brightness, which affects the subsequent image recognition effect and lighting effect, and brings a better experience to the user.
在本申请实施例中,根据第一图像得到第一图像的第一亮度值以及根据第二图像得到第二图像的第二亮度值,均可以通过统计灰度直方图加权求和,或者求平均亮度值。In this embodiment of the present application, obtaining the first brightness value of the first image according to the first image and obtaining the second brightness value of the second image according to the second image can both be weighted and summed or averaged through a statistical grayscale histogram. Brightness value.
可以理解,对灰度直方图中各个像素的亮度值进行加权求和以得到第一亮度值。加权求和是将权重计算在内的平均方法;通常在一组数据里,一个数据出现的次数称为权。具体方式如下:根据直方图中每个亮度值(灰度值)给予不同的权值;然后就将权值和落在该区域的像素数相乘,并把所有结果相加,即可得到上述的第一亮度值;例如:亮度值250对应为权值1,亮度值100对应为权值0.3,如果一张图像仅仅在亮度值250和亮度值100处分别有10个像素点,则第一亮度值为10*1+0.3*10=13。It can be understood that the first luminance value is obtained by weighting and summing the luminance values of each pixel in the grayscale histogram. Weighted summation is an averaging method that takes weights into account; usually in a set of data, the number of times a piece of data occurs is called a weight. The specific method is as follows: according to each brightness value (gray value) in the histogram, different weights are given; then the weights are multiplied by the number of pixels falling in the area, and all the results are added to obtain the above For example: the brightness value of 250 corresponds to the weight value of 1, and the brightness value of 100 corresponds to the weight value of 0.3. If an image only has 10 pixels at the brightness value of 250 and the brightness value of 100, the first brightness value The luminance value is 10*1+0.3*10=13.
如果在同样的脉冲宽度调制信号的占空比下,第二亮度值为10,则证明补光灯已经发生亮度衰减,此时第一亮度值和第二亮度值的差值为3。如果预设的阈值为2,此时差值大于阈值,则可以增大脉冲宽度调制信号的占空比以最大补光灯的亮度。If the second brightness value is 10 under the same duty cycle of the PWM signal, it proves that the brightness of the fill light has decayed. At this time, the difference between the first brightness value and the second brightness value is 3. If the preset threshold is 2, and the difference is greater than the threshold at this time, the duty cycle of the pulse width modulation signal can be increased to maximize the brightness of the fill light.
增加占空比的方式可以包括在预设的时间将占空比增加一定的比例。例如,每过t秒,以5%的速度增加PWM信号的占空比,从而增加或减少补光灯的亮度。在每次调整后,可以控制图像采集设备重新获取一张图像,计算图像的第二亮度值,直至第二亮度值和第一亮度值的差值小于阈值。The manner of increasing the duty cycle may include increasing the duty cycle by a certain percentage at a preset time. For example, every t seconds, the duty cycle of the PWM signal is increased at a rate of 5%, thereby increasing or decreasing the brightness of the fill light. After each adjustment, the image acquisition device can be controlled to acquire an image again, and the second brightness value of the image can be calculated until the difference between the second brightness value and the first brightness value is smaller than the threshold.
进一步地,本申请实施例提供的用于洗碗机的补光方法还可以包括:Further, the supplementary light method for a dishwasher provided by the embodiments of the present application may further include:
步骤S49:在差值小于预设的阈值的情况下,确定补光灯当前对应的第二占空比。Step S49: In the case that the difference value is smaller than the preset threshold value, determine the second duty ratio currently corresponding to the fill light.
可以理解,如果对用于控制补光灯的PWM信号的占空比进行调整,直到第二亮度值与第一亮度值的差值小于阈值时,则第二占空比可以无需再调整,可以确定调整后的第二占空比。It can be understood that if the duty cycle of the PWM signal used to control the fill light is adjusted until the difference between the second brightness value and the first brightness value is less than the threshold, the second duty cycle does not need to be adjusted, and can be Determine the adjusted second duty cycle.
请参阅图19,图19为本申请实施例四所提供的用于洗碗机的补光方法的另一流程图。根据所确定的第二占空比,该补光方法还可以包括以下步骤:Please refer to FIG. 19 . FIG. 19 is another flowchart of the light supplement method for a dishwasher provided in Embodiment 4 of the present application. According to the determined second duty cycle, the light supplement method may further include the following steps:
步骤S491:确定第二占空比和第一占空比的比值;Step S491: determine the ratio of the second duty cycle to the first duty cycle;
步骤S492:根据比值调整补光灯的占空比和亮度的系数。Step S492: Adjust the duty cycle of the fill light and the coefficient of brightness according to the ratio.
可以理解,根据第二占空比和第一占空比的比值,如第一占空比为50%,第二占空比为60%,则代表了同样的亮度,由于补光灯的衰减,以前仅需要占空比为40%的亮度现在需要占空比为50%,比值为60/50为1.2。It can be understood that, according to the ratio of the second duty cycle to the first duty cycle, if the first duty cycle is 50% and the second duty cycle is 60%, it represents the same brightness. Due to the attenuation of the fill light , brightness that previously only required a 40% duty cycle now requires a 50% duty cycle, a 60/50 ratio of 1.2.
在步骤S492中,通常情况下,补光灯的亮度=占空比*k,其中k为相关系数,根据该比值可以调整补光灯的占空比和亮度的系数k,如系数k提高至原先的1.2倍,从而使得补光灯在同等的占空比下运行正常。In step S492, under normal circumstances, the brightness of the fill light=duty ratio*k, where k is a correlation coefficient, according to which the duty cycle of the fill light and the coefficient k of the brightness can be adjusted, for example, the coefficient k is increased to The original 1.2 times, so that the fill light works normally under the same duty cycle.
请参阅图20以及图21,图20为本申请第四实施例所提供的用于洗碗机的补光方法的进一步的流程图;图21是本申请第四实施例四所提供的用于洗碗机的补光方法中为演示步骤S494的示意图。本申请实施例所提供的补光方法还包括:Please refer to FIG. 20 and FIG. 21 , FIG. 20 is a further flowchart of the light supplement method for a dishwasher provided by the fourth embodiment of the present application; The method for supplementing light for a dishwasher is a schematic diagram illustrating step S494. The supplementary light method provided in the embodiment of the present application also includes:
步骤S493:确定第二占空比和第一占空比的差值;Step S493: Determine the difference between the second duty cycle and the first duty cycle;
步骤S494:根据差值确定补光灯的使用寿命。Step S494: Determine the service life of the fill light according to the difference.
具体地,在得到校准状态下的补光灯的脉冲宽度调制信号的第二占空比P1,以及出厂状态下的脉冲宽度调制信号P0之后,可以通过以下公式计算补光灯的剩余使用寿命的占比:Specifically, after obtaining the second duty cycle P1 of the pulse width modulation signal of the fill light in the calibration state and the pulse width modulation signal P0 in the factory state, the remaining service life of the fill light can be calculated by the following formula: Proportion:
T=100-((|P1-P0|*100)/(100-P0)),T=100-((|P1-P0|*100)/(100-P0)),
其中,T是补光灯的剩余使用寿命的百分比。where T is the percentage of the remaining service life of the fill light.
进一步地,通过以上得到的使用寿命,可以在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。指示信息可以是通过指示灯或者其他预警设备发送,例如蜂鸣器。指示信息可以通过显示屏显示以提示用户更换补光灯,或者可以通过无限网络向用户终端发送指示信息,以提示用户更换补光灯。通过这种方式可以对洗碗机进行维护,从而保障洗碗机的可靠性。Further, according to the service life obtained above, in the case that the service life is less than the preset service life threshold, indication information can be sent to the user. Indication information can be sent through indicator lights or other early warning devices, such as buzzers. The instruction information can be displayed on the display screen to prompt the user to replace the fill light, or the instruction information can be sent to the user terminal through the wireless network to prompt the user to replace the fill light. In this way, the dishwasher can be maintained and the reliability of the dishwasher can be guaranteed.
本申请实施例提供的补光方法,在洗碗机的出厂状态下控制洗碗机的补光以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光,并进行图像采集,以得到第一亮度值。当需要进行调光校准的时候,控制补光灯以同样的脉冲宽度调制信号的占空比进行补光,并进行图像采集,以得到第二亮度值。如果第一亮度和第二亮度的差值超过一定的阈值,则调整补光灯的亮度,直到达到第一亮度值。通过这种方式对补光灯进行校准,可以获取补光灯在同样脉冲宽度调制信号的占空比下的亮度差异,根据该差异可以对补光灯进行适应性调整,从而防止补光灯由于使用寿命的影响,导致其亮度变弱,影响后续的图像识别效果及照明效果,给用户带来更好的体验。The fill light method provided by the embodiment of the present application controls the fill light of the dishwasher to fill light in the washing area of the dishwasher with the first brightness corresponding to the preset first duty cycle in the factory state of the dishwasher, And carry out image acquisition to obtain the first brightness value. When dimming calibration needs to be performed, the fill light is controlled to fill light with the same duty cycle of the pulse width modulation signal, and image acquisition is performed to obtain the second brightness value. If the difference between the first brightness and the second brightness exceeds a certain threshold, the brightness of the fill light is adjusted until the first brightness value is reached. By calibrating the fill light in this way, the brightness difference of the fill light under the same duty cycle of the PWM signal can be obtained, and the fill light can be adaptively adjusted according to the difference, so as to prevent the fill light due to The influence of the service life will lead to the weakening of its brightness, which will affect the subsequent image recognition effect and lighting effect, and bring a better experience to the user.
本申请第五实施例提供一种洗碗机,包括上述实施例中描述的补光装置。A fifth embodiment of the present application provides a dishwasher, including the light supplementing device described in the foregoing embodiments.
本领域技术人员也应当理解,只要在不违背物理原理和发明构思的情况下,可以将本申请实施例进行各种组合、变形或替换,这些组合、变形或替换同样落入本申请的保护范围。Those skilled in the art should also understand that, as long as the physical principles and the inventive concept are not violated, various combinations, deformations or substitutions of the embodiments of the present application can be carried out, and these combinations, deformations or substitutions also fall within the protection scope of the present application. .
本申请实施例提供了一种机器可读存储介质,其上存储有程序,该程序被处理器执行时实现用于洗碗机的补光方法。Embodiments of the present application provide a machine-readable storage medium, on which a program is stored, and when the program is executed by a processor, implements a light supplement method for a dishwasher.
机器可读存储介质的示例可以包括存储器。存储器可以包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM),存储器包括至少一个存储芯片。Examples of machine-readable storage media may include memory. The memory may include non-persistent memory in a computer readable medium, in the form of random access memory (RAM) or non-volatile memory, such as read only memory (ROM) or flash memory (flash RAM), the memory including at least one memory chip .
本申请实施例提供一种处理器,处理器用于运行程序,其中,程序被运行时使得处理器被配置成执行上述实施例描述的用于洗碗机的补光方法。Embodiments of the present application provide a processor for running a program, wherein, when the program is executed, the processor is configured to execute the light supplement method for a dishwasher described in the foregoing embodiments.
本申请实施例还提供一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述实施例的用于洗碗机的方法。Embodiments of the present application further provide a computer program product, including a computer program, when the computer program is executed by a processor, the method for a dishwasher of the foregoing embodiments is implemented.
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括图像采集设备,用于采集洗碗机内的清洗区域的图像;主补光灯,用于对图像进行补光;至少一个副补光灯,用于对图像的边缘区域进行补光;补光方法包括:In one embodiment, a method for supplementing light for a dishwasher, the dishwasher includes an image acquisition device for acquiring an image of a washing area in the dishwasher; a main supplementary light for supplementing the image. light; at least one auxiliary fill light, used to fill the edge area of the image; the fill light method includes:
获取洗碗机内的清洗区域的图像;Obtain an image of the wash area within the dishwasher;
根据图像得到图像的第一亮度值;obtaining the first brightness value of the image according to the image;
在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;In the case that the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。When the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
在一实施例中,补光方法还包括:In one embodiment, the supplementary light method further includes:
在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。When the first brightness value is outside the first brightness range, the brightness of the main fill light is adjusted to adjust the first brightness value.
在一实施例中,在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值包括:In one embodiment, when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the first brightness value includes:
在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;In the case that the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。When the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is reduced to reduce the first brightness value.
在一实施例中,根据图像得到图像的第一亮度值包括:In one embodiment, obtaining the first brightness value of the image according to the image includes:
获取图像的亮度直方图;Get the brightness histogram of the image;
对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。The luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
在一实施例中,至少一个副补光灯包括第一副补光灯和第二副补光灯,第一副补光灯和第二副补光灯分别设置于图像采集设备的左右两侧,分别用于对图像的左边缘区域和右边缘区域进行补光:在第二亮度值位于第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值包括:In one embodiment, the at least one auxiliary fill light includes a first auxiliary fill light and a second auxiliary fill light, and the first auxiliary fill light and the second auxiliary fill light are respectively disposed on the left and right sides of the image capturing device. , respectively used to fill the left edge area and right edge area of the image: when the second brightness value is outside the second brightness range, adjusting the brightness of the secondary fill light to adjust the second brightness value includes:
在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;In the case where the second brightness value on the left side of the left edge area is outside the second brightness range, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left side;
在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。In the case where the second brightness value on the right side of the right edge area is outside the second brightness range, the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
在一实施例中,根据图像得到图像的边缘区域的第二亮度值包括:In one embodiment, obtaining the second brightness value of the edge region of the image according to the image includes:
将图像分割成多个区域;Divide the image into multiple regions;
根据主补光灯的视场角提取多个区域中的边缘区域;Extract the edge areas in multiple areas according to the field of view of the main fill light;
确定边缘区域的第二亮度值;determining the second brightness value of the edge region;
其中第二亮度值为边缘区域的亮度值的平均值。The second brightness value is the average value of the brightness values of the edge regions.
在一实施例中,主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。In one embodiment, the main fill light and the auxiliary fill light are individually controlled through different pulse width modulation signals.
在一实施例中,一种用于洗碗机的补光装置,包括:In one embodiment, a supplementary light device for a dishwasher, comprising:
图像采集设备,用于获取洗碗机的清洗区域的图像;Image acquisition equipment for acquiring images of the washing area of the dishwasher;
主补光灯,环绕图像采集设备设置,用于对清洗区域中与图像的中心区域对应的区域进行补光;The main fill light, which is set around the image acquisition device, is used to fill light in the area corresponding to the central area of the image in the cleaning area;
至少一个副补光灯,设置于主补光灯的至少一侧,用于对清洗区域中与图像的边缘区域对应的区域进行补光;At least one auxiliary supplementary light, which is arranged on at least one side of the main supplementary light, is used for supplementing light in the area corresponding to the edge area of the image in the cleaning area;
处理器,被配置成:The processor, configured as:
获取图像;get image;
根据图像得到图像的第一亮度值;obtaining the first brightness value of the image according to the image;
在第一亮度值位于预设的第一亮度范围内的情况下,根据图像得到图像的边缘区域的第二亮度值;In the case that the first brightness value is within the preset first brightness range, obtain the second brightness value of the edge region of the image according to the image;
在第二亮度值位于预设的第二亮度范围之外的情况下,调节副补光灯的亮度以调节第二亮度值。When the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
在一实施例中,处理器还被配置成:In an embodiment, the processor is further configured to:
在第一亮度值位于第一亮度范围之外的情况下,调节主补光灯的亮度以调节第一亮度值。When the first brightness value is outside the first brightness range, the brightness of the main fill light is adjusted to adjust the first brightness value.
在一实施例中,处理器被配置成调节主补光灯的亮度以调节第一亮度值包括处理器被配置成:In one embodiment, the processor being configured to adjust the brightness of the main fill light to adjust the first brightness value includes the processor being configured to:
在第一亮度值小于第一亮度范围的下限值的情况下,增加主补光灯的亮度以增加第一亮度值;In the case that the first brightness value is less than the lower limit value of the first brightness range, increase the brightness of the main fill light to increase the first brightness value;
在第一亮度值大于第一亮度范围的上限值的情况下,减小主补光灯的亮度以减小第一亮度值。When the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is reduced to reduce the first brightness value.
在一实施例中,处理器被配置成根据图像得到图像的第一亮度值被配置成:In one embodiment, the processor is configured to obtain the first luminance value of the image from the image and is configured to:
获取图像的亮度直方图;Get the brightness histogram of the image;
对亮度直方图中各个像素的亮度值进行加权并求和以得到第一亮度值。The luminance values of each pixel in the luminance histogram are weighted and summed to obtain a first luminance value.
在一实施例中,至少一个副补光灯包括:In one embodiment, the at least one auxiliary fill light includes:
第一副补光灯,设置于图像采集设备的左侧;The first pair of fill light is set on the left side of the image acquisition device;
第二副补光灯,设置于图像采集设备的右侧;The second supplementary light is set on the right side of the image acquisition device;
处理器被配置成在第二亮度值不位于第二亮度范围的情况下,调节副补光灯的亮度以 调节第二亮度值包括处理器被配置成:The processor is configured to adjust the brightness of the secondary fill light to adjust the second brightness value when the second brightness value is not located in the second brightness range. The processor is configured to:
在左边缘区域的左侧第二亮度值位于第二亮度范围之外的情况下,调节第一副补光灯的亮度以调节左侧第二亮度值;In the case where the second brightness value on the left side of the left edge area is outside the second brightness range, adjust the brightness of the first auxiliary light to adjust the second brightness value on the left side;
在右边缘区域的右侧第二亮度值位于第二亮度范围之外的情况下,调节第二副补光灯的亮度以调节右侧第二亮度值。In the case where the second brightness value on the right side of the right edge area is outside the second brightness range, the brightness of the second auxiliary fill light is adjusted to adjust the second brightness value on the right side.
在一实施例中,处理器被配置成获取图像的边缘区域的第二亮度值包括处理器被配置成:In an embodiment, the processor being configured to obtain the second luminance value of the edge region of the image comprises the processor being configured to:
将图像分割成多个区域;Divide the image into multiple regions;
根据主补光灯的视场角提取多个区域中的边缘区域;Extract the edge areas in multiple areas according to the field of view of the main fill light;
确定边缘区域的第二亮度值;determining the second brightness value of the edge region;
其中第二亮度值为边缘区域的亮度值的平均值。The second brightness value is the average value of the brightness values of the edge regions.
在一实施例中,补光装置还包括:In one embodiment, the supplementary light device further includes:
第一脉冲宽度调制设备,电性连接主补光灯,用于通过控制占空比调节主补光灯的亮度;The first pulse width modulation device is electrically connected to the main fill light, and is used to adjust the brightness of the main fill light by controlling the duty ratio;
第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;The second pulse width modulation device is electrically connected to the first auxiliary light and is used for adjusting the brightness of the first auxiliary light by controlling the duty ratio;
第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。The third pulse width modulation device is electrically connected to the second supplementary light, and is used for adjusting the brightness of the second supplementary light by controlling the duty ratio.
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。In one embodiment, a dishwasher includes the above-mentioned light-filling device for a dishwasher.
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。In one embodiment, a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。In one embodiment, a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括补光灯,用于对洗碗机的清洗区域进行补光,补光方法包括:In one embodiment, a method for supplementing light for a dishwasher, the dishwasher includes a supplementary light for supplementing light in a washing area of the dishwasher, and the method for supplementing light includes:
控制补光灯以初始亮度进行补光;Control the fill light to fill light with the initial brightness;
获取清洗区域的图像;Get an image of the cleaned area;
对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;Perform grayscale histogram statistics on the image to determine whether the image is too dark or overexposed;
在图像过曝或过暗的情况下,控制补光灯调节初始亮度;When the image is overexposed or too dark, control the fill light to adjust the initial brightness;
在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;When the image is not overexposed or too dark, determine the current initial brightness as the target fill light brightness;
将目标补光亮度作为下一次的初始亮度默认值。Use the target fill light brightness as the next initial brightness default value.
在一实施例中,对图像进行灰度直方图统计,以确定图像是否过暗或者过曝包括:In one embodiment, performing gray histogram statistics on the image to determine whether the image is too dark or overexposed includes:
确定直方图中灰度值对应为白色区域的像素数和平均像素数的比值;Determine the ratio of the number of pixels in the histogram corresponding to the gray value of the white area to the average number of pixels;
在比值小于第一比例阈值的情况下,确定图像过暗;In the case that the ratio is less than the first ratio threshold, it is determined that the image is too dark;
在比值大于第二比例阈值的情况下,确定图像过曝。Where the ratio is greater than the second ratio threshold, it is determined that the image is overexposed.
在一实施例中,在图像过曝或过暗的情况下,控制补光灯调节初始亮度包括:In one embodiment, when the image is overexposed or too dark, controlling the fill light to adjust the initial brightness includes:
在图像过曝的情况下,控制补光灯增加初始亮度;When the image is overexposed, control the fill light to increase the initial brightness;
在图像过暗的情况下,控制补光灯减少初始亮度。When the image is too dark, control the fill light to reduce the initial brightness.
在一实施例中,控制补光灯调节初始亮度包括:In one embodiment, controlling the fill light to adjust the initial brightness includes:
将补光灯的亮度从零至最大分为多个等级;Divide the brightness of the fill light into multiple levels from zero to maximum;
从初始亮度对应的等级依次减少或者增加亮度的等级。Decrease or increase the brightness level sequentially from the level corresponding to the initial brightness.
在一实施例中,将目标补光亮度作为下一次的初始亮度默认值包括:In one embodiment, using the target fill light brightness as the next initial brightness default value includes:
记录目标补光亮度和对应目标补光亮度的调整时间;Record the target fill light brightness and the adjustment time of the corresponding target fill light brightness;
将目标补光亮度作为下一次对应调整时间的初始亮度默认值。Take the target fill light brightness as the default initial brightness value for the next adjustment time.
在一实施例中,补光灯通过调节脉冲宽度调制信号的占空比调节亮度。In one embodiment, the brightness of the fill light is adjusted by adjusting the duty cycle of the pulse width modulation signal.
在一实施例中,一种用于洗碗机的补光装置,包括:In one embodiment, a supplementary light device for a dishwasher, comprising:
图像采集元件,被配置为获取洗碗机的清洗区域的图像;an image acquisition element configured to acquire images of the wash area of the dishwasher;
补光灯,用于对清洗区域进行补光;Fill light, used to fill the cleaning area;
处理器,被配置为:The processor, configured as:
控制补光灯以初始亮度进行补光;Control the fill light to fill light with the initial brightness;
获取清洗区域的图像;Get an image of the cleaned area;
对图像进行灰度直方图统计,以确定图像是否过暗或者过曝;Perform grayscale histogram statistics on the image to determine whether the image is too dark or overexposed;
在图像过曝或过暗的情况下,控制补光灯调节初始亮度;When the image is overexposed or too dark, control the fill light to adjust the initial brightness;
在图像没有过曝或过暗的情况下,确定当前的初始亮度为目标补光亮度;When the image is not overexposed or too dark, determine the current initial brightness as the target fill light brightness;
将目标补光亮度作为下一次的初始亮度默认值。Use the target fill light brightness as the next initial brightness default value.
在一实施例中,处理器被配置为对图像进行灰度直方图统计,以确定图像是否过暗或者过曝包括处理器被配置为:In one embodiment, the processor is configured to perform grayscale histogram statistics on the image to determine whether the image is too dark or overexposed, comprising the processor being configured to:
确定直方图中灰度值对应为白色区域的像素数和平均像素数的比值;Determine the ratio of the number of pixels in the histogram corresponding to the gray value of the white area to the average number of pixels;
在比值小于第一比例阈值的情况下,确定图像过暗;In the case that the ratio is less than the first ratio threshold, it is determined that the image is too dark;
在比值大于第二比例阈值的情况下,确定图像过曝。Where the ratio is greater than the second ratio threshold, it is determined that the image is overexposed.
在一实施例中,处理器被配置为在图像过曝或过暗的情况下,控制补光灯调节初始亮度包括处理器被配置为:In one embodiment, the processor is configured to control the fill light to adjust the initial brightness when the image is overexposed or too dark. The processor is configured to:
在图像过曝的情况下,控制补光灯增加初始亮度;When the image is overexposed, control the fill light to increase the initial brightness;
在图像过暗的情况下,控制补光灯减少初始亮度。When the image is too dark, control the fill light to reduce the initial brightness.
在一实施例中,处理器被配置为控制补光灯调节初始亮度包括处理器被配置为:In one embodiment, the processor being configured to control the fill light to adjust the initial brightness includes the processor being configured to:
将补光灯的亮度从零至最大分为多个等级;Divide the brightness of the fill light into multiple levels from zero to maximum;
从初始亮度对应的等级依次减少或者增加亮度的等级。Decrease or increase the brightness level sequentially from the level corresponding to the initial brightness.
在一实施例中,将处理器被配置为将目标补光亮度作为下一次的初始亮度默认值包括处理器被配置为:In one embodiment, configuring the processor to use the target fill light brightness as the next initial brightness default value includes that the processor is configured to:
记录目标补光亮度和对应目标补光亮度的调整时间;Record the target fill light brightness and the adjustment time of the corresponding target fill light brightness;
将目标补光亮度作为下一次对应调整时间的初始亮度默认值。Take the target fill light brightness as the default initial brightness value for the next adjustment time.
在一实施例中,补光装置还包括:In one embodiment, the supplementary light device further includes:
脉冲宽度调制信号调节设备,用于调节输入至补光灯的脉冲宽度调制信号的占空比,以调节补光灯的亮度。The pulse width modulation signal adjustment device is used for adjusting the duty ratio of the pulse width modulation signal input to the fill light, so as to adjust the brightness of the fill light.
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。In one embodiment, a dishwasher includes the above-mentioned light-filling device for a dishwasher.
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于补光灯的补光方法。In one embodiment, a machine-readable storage medium having instructions stored on the machine-readable storage medium is used to enable the processor to perform the above-mentioned fill light for the fill light when executed by the processor. method.
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于补光灯的补光方法。In one embodiment, a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a supplementary light.
在一实施例中,一种用于洗碗机的补光方法,洗碗机包括:照明灯,用于对清洗区域进行照明;补光灯,用于对洗碗机内的清洗区域进行补光;补光方法包括:In one embodiment, a method for supplementing light for a dishwasher, the dishwasher includes: a lighting lamp for illuminating a cleaning area; a supplementary light for supplementing the cleaning area in the dishwasher. Light; fill light methods include:
确定柜门的开闭状态;Determine the opening and closing status of the cabinet door;
在根据开闭状态确定柜门被开启的情况下,控制照明灯开启,补光灯关闭;When it is determined that the cabinet door is opened according to the opening and closing state, the lighting lamp is controlled to be turned on, and the fill light is turned off;
获取清洗区域的第一图像;obtain the first image of the cleaning area;
根据第一图像得到第一图像的第一亮度值;obtaining a first brightness value of the first image according to the first image;
根据第一亮度值确定补光灯所需的补光亮度;Determine the fill light brightness required by the fill light according to the first brightness value;
控制补光灯以补光亮度对清洗区域进行补光;Control the fill light to fill the cleaning area with fill light brightness;
获取经补光后的清洗区域的第二图像;acquiring a second image of the cleaned area after supplemental light;
根据第二图像确定第二亮度值;determining a second brightness value according to the second image;
在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次 调整。When the second brightness value is outside the preset brightness value range, the fill light is controlled to adjust the fill light brightness twice.
在一实施例中,补光方法还包括:In one embodiment, the supplementary light method further includes:
第一亮度值为第一图像中像素点的亮度平均值,第二亮度值为第二图像中像素点的亮度平均值。The first brightness value is an average brightness value of pixels in the first image, and the second brightness value is an average brightness value of pixels in the second image.
在一实施例中,根据第一亮度值确定补光灯所需的补光亮度包括:In one embodiment, determining the fill light brightness required by the fill light according to the first brightness value includes:
将补光亮度从零至最大分为多个等级;Divide fill light brightness into multiple levels from zero to maximum;
确定第一亮度值和预设的目标亮度阈值的差值;determining the difference between the first brightness value and the preset target brightness threshold;
根据差值确定补光灯所需的补光亮度的等级。Determine the level of fill light brightness required by the fill light according to the difference.
在一实施例中,亮度值范围包括强度下限值和强度上限值,在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整包括:In one embodiment, the brightness value range includes an intensity lower limit value and an intensity upper limit value, and when the second brightness value is outside the preset brightness value range, the fill light is controlled to perform secondary adjustment on the fill light brightness. include:
在第二亮度值大于强度上限值时,减少补光亮度;When the second brightness value is greater than the upper limit value of the intensity, reduce the brightness of the fill light;
在第二亮度值小于强度下限值时,增加补光亮度。When the second brightness value is less than the lower limit value of the intensity, the brightness of the fill light is increased.
在一实施例中,减少补光亮度包括:依次减少补光亮度的等级;增加补光亮度包括:依次增加补光亮度的等级。In one embodiment, reducing the brightness of the supplementary light includes: sequentially decreasing the level of the brightness of the supplementary light; increasing the brightness of the supplementary light includes: sequentially increasing the level of the brightness of the supplementary light.
在一实施例中,一种用于洗碗机的补光装置,包括:In one embodiment, a supplementary light device for a dishwasher, comprising:
位移传感器,用于根据柜门的位移获取柜门的开闭状态;The displacement sensor is used to obtain the opening and closing status of the cabinet door according to the displacement of the cabinet door;
图像采集设备,用于采集洗碗机内的清洗区域的图像;an image capture device for capturing images of the washing area within the dishwasher;
补光灯,用于对清洗区域进行补光;Fill light, used to fill the cleaning area;
照明灯,用于对清洗区域进行照明;Illuminators for illuminating the wash area;
处理器,被配置成:The processor, configured as:
确定柜门的开闭状态;Determine the opening and closing status of the cabinet door;
在根据开闭状态确定柜门被开启的情况下,控制照明灯开启,补光灯关闭;When it is determined that the cabinet door is opened according to the opening and closing state, the lighting lamp is controlled to be turned on, and the fill light is turned off;
获取清洗区域的第一图像;obtain the first image of the cleaning area;
根据第一图像得到第一图像的第一亮度值;obtaining a first brightness value of the first image according to the first image;
根据第一亮度值确定补光灯所需的补光亮度;Determine the fill light brightness required by the fill light according to the first brightness value;
控制补光灯以补光亮度对清洗区域进行补光;Control the fill light to fill the cleaning area with fill light brightness;
获取经补光后的清洗区域的第二图像;acquiring a second image of the cleaned area after supplemental light;
根据第二图像确定第二亮度值;determining a second brightness value according to the second image;
在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整。In the case that the second brightness value is outside the preset brightness value range, the supplementary light is controlled to perform a secondary adjustment of the supplementary light brightness.
在一实施例中,第一亮度值为第一图像中像素点的亮度平均值,第二亮度值为第二图像中像素点的亮度平均值。In one embodiment, the first brightness value is an average brightness value of pixels in the first image, and the second brightness value is an average brightness value of pixels in the second image.
在一实施例中,处理器被配置成根据第一亮度值确定补光灯所需的补光亮度包括处理器被配置成:In one embodiment, the processor being configured to determine the fill light brightness required by the fill light according to the first brightness value includes the processor being configured to:
将补光亮度从零至最大分为多个等级;Divide fill light brightness into multiple levels from zero to maximum;
确定第一亮度值和预设的目标亮度阈值的差值;determining the difference between the first brightness value and the preset target brightness threshold;
根据差值确定补光亮度的等级。Determine the level of fill light brightness according to the difference.
在一实施例中,亮度值范围包括强度下限值和强度上限值,处理器被配置成在第二亮度值位于预设的亮度值范围之外的情况下,控制补光灯对补光亮度进行二次调整包括包括处理器被配置成:In one embodiment, the brightness value range includes an intensity lower limit value and an intensity upper limit value, and the processor is configured to control the fill light to fill light when the second brightness value is outside the preset brightness value range. The secondary adjustment of brightness includes including the processor being configured to:
在第二亮度值大于强度上限值时,减少补光亮度;When the second brightness value is greater than the upper limit value of the intensity, reduce the brightness of the fill light;
在第二亮度值小于强度下限值时,增加补光亮度。When the second brightness value is less than the lower limit value of the intensity, the brightness of the fill light is increased.
在一实施例中,处理器被配置成减少补光亮度包括处理器被配置成:依次减少补光亮度的等级;In one embodiment, the processor being configured to reduce the fill light brightness includes the processor being configured to: sequentially reduce the fill light brightness levels;
处理器被配置成增加补光亮度包括处理器被配置成:依次增加补光亮度的等级。The processor being configured to increase the brightness of the fill light includes the processor being configured to: sequentially increase the level of the brightness of the fill light.
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。In one embodiment, a dishwasher includes the above-mentioned light-filling device for a dishwasher.
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。In one embodiment, a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。In one embodiment, a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
在一实施例中,一种用于洗碗机的补光方法,补光灯通过调节脉冲宽度调制信号的占空比调节亮度,补光方法包括:In one embodiment, a method for supplementing light for a dishwasher, the brightness of the supplementary light is adjusted by adjusting the duty cycle of a pulse width modulation signal, and the supplementary light method includes:
在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;When the dishwasher is in the factory state, the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio;
获取清洗区域的第一图像;obtain the first image of the cleaning area;
根据第一图像得到第一图像的第一亮度值;obtaining a first brightness value of the first image according to the first image;
在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;When the dishwasher is in the calibration state, controlling the fill light to fill the washing area of the dishwasher with the second brightness corresponding to the first duty cycle;
获取清洗区域的第二图像;obtaining a second image of the cleaned area;
根据第二图像得到第二图像的第二亮度值;;obtaining a second brightness value of the second image according to the second image;
确定第二亮度值和第一亮度值的差值;determining the difference between the second brightness value and the first brightness value;
在差值大于预设的阈值的情况下,增大第一占空比以增大第二亮度。When the difference value is greater than the preset threshold, the first duty cycle is increased to increase the second brightness.
在一实施例中,补光方法,还包括:In one embodiment, the method for supplementing light further includes:
在差值小于预设的阈值的情况下,确定当前的第二亮度所对应的第二占空比。In the case that the difference value is smaller than the preset threshold value, the second duty ratio corresponding to the current second brightness is determined.
在一实施例中,补光方法还包括:In one embodiment, the supplementary light method further includes:
确定第二占空比和第一占空比的比值;determining the ratio of the second duty cycle to the first duty cycle;
根据比值调整补光灯的占空比和亮度的系数。Adjust the duty cycle of the fill light and the coefficient of brightness according to the ratio.
在一实施例中,补光方法还包括:In one embodiment, the supplementary light method further includes:
确定第二占空比和第一占空比的差值;determining the difference between the second duty cycle and the first duty cycle;
根据差值确定补光灯的使用寿命。Determine the service life of the fill light according to the difference.
在一实施例中,补光方法还包括:在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。In an embodiment, the method for supplementing light further includes: in the case that the service life is less than a preset service life threshold, sending indication information to the user.
在一实施例中,补光方法还包括:以预设的第一时间周期和/或在清洗区域没有餐具的情况下,控制补光灯进入校准状态。In an embodiment, the method for supplementing light further includes: controlling the supplementary light to enter a calibration state within a preset first time period and/or when there is no tableware in the washing area.
在一实施例中,一种用于洗碗机的补光装置,包括:In one embodiment, a supplementary light device for a dishwasher, comprising:
图像采集元件,被配置成获取洗碗机内清洗区域的图像;an image acquisition element configured to acquire images of the wash area within the dishwasher;
脉冲宽度调制信号调节设备,用于控制输入至补光灯的脉冲宽度调制信号的占空比;A pulse width modulation signal conditioning device for controlling the duty cycle of the pulse width modulation signal input to the fill light;
处理器,被配置成:The processor, configured as:
在洗碗机位于出厂状态的情况下,控制补光灯以预设的第一占空比对应的第一亮度对洗碗机的清洗区域进行补光;When the dishwasher is in the factory state, the fill light is controlled to fill the washing area of the dishwasher with the first brightness corresponding to the preset first duty ratio;
获取清洗区域的第一图像;obtain the first image of the cleaning area;
根据第一图像得到第一图像的第一亮度值;obtaining a first brightness value of the first image according to the first image;
在洗碗机位于校准状态的情况下,控制补光灯以第一占空比对应的第二亮度对洗碗机的清洗区域进行补光;When the dishwasher is in the calibration state, controlling the fill light to fill the washing area of the dishwasher with the second brightness corresponding to the first duty cycle;
获取清洗区域的第二图像;obtaining a second image of the cleaned area;
根据第二图像得到第二图像的第二亮度值;obtaining a second brightness value of the second image according to the second image;
确定第二亮度值和第一亮度值的差值;determining the difference between the second brightness value and the first brightness value;
在差值大于预设的阈值的情况下,增大第一占空比以调节第二亮度。When the difference is greater than the preset threshold, the first duty cycle is increased to adjust the second brightness.
在一实施例中,处理器还被配置成:在差值小于预设的阈值的情况下,确定当前的第 二亮度所对应的第二占空比。In an embodiment, the processor is further configured to: determine a second duty cycle corresponding to the current second brightness when the difference is less than a preset threshold.
在一实施例中,处理器还被配置成:In an embodiment, the processor is further configured to:
确定第二占空比和第一占空比的差值;determining the difference between the second duty cycle and the first duty cycle;
根据差值确定补光灯的使用寿命。Determine the service life of the fill light according to the difference.
在一实施例中,处理器还被配置成:在使用寿命小于预设的寿命阈值的情况下,向用户发送指示信息。In one embodiment, the processor is further configured to: send indication information to the user when the service life is less than a preset lifespan threshold.
在一实施例中,处理器还被配置成:以预设的第一时间周期和/或清洗区域没有餐具的情况下,控制补光灯位于校准状态。In one embodiment, the processor is further configured to: control the fill light to be in a calibration state for a preset first time period and/or when there is no tableware in the washing area.
在一实施例中,一种洗碗机,包括上述的用于洗碗机的补光装置。In one embodiment, a dishwasher includes the above-mentioned light-filling device for a dishwasher.
在一实施例中,一种机器可读存储介质,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得处理器能够执行上述的用于洗碗机的补光方法。In one embodiment, a machine-readable storage medium having instructions stored on the machine-readable storage medium for enabling the processor to execute the above-mentioned fill light for dishwashers when executed by the processor method.
在一实施例中,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现上述的用于洗碗机的补光方法。In one embodiment, a computer program product includes a computer program that, when executed by a processor, implements the above-mentioned method for supplementing light for a dishwasher.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture or apparatus that includes the element.
以上仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.

Claims (17)

  1. 一种用于洗碗机的补光方法,其特征在于,所述洗碗机包括图像采集设备,用于采集所述洗碗机内的清洗区域的图像;主补光灯,用于对所述图像进行补光;至少一个副补光灯,用于对所述图像的边缘区域进行补光;所述补光方法包括:A fill light method for a dishwasher, characterized in that the dishwasher includes an image acquisition device for collecting images of a cleaning area in the dishwasher; a main fill light for all The image is filled with light; at least one auxiliary fill light is used to fill the edge area of the image; the fill light method includes:
    获取所述洗碗机内的清洗区域的图像;acquiring an image of a wash area within the dishwasher;
    根据所述图像得到所述图像的第一亮度值;obtaining a first brightness value of the image according to the image;
    在所述第一亮度值位于预设的第一亮度范围内的情况下,根据所述图像得到所述图像的边缘区域的第二亮度值;In the case that the first brightness value is within a preset first brightness range, obtain a second brightness value of the edge region of the image according to the image;
    在所述第二亮度值位于预设的第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值。In the case that the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
  2. 如权利要求1所述的补光方法,其特征在于,还包括:The supplementary light method of claim 1, further comprising:
    在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值。When the first brightness value is outside the first brightness range, the brightness of the main fill light is adjusted to adjust the first brightness value.
  3. 如权利要求2所述的补光方法,其特征在于,所述在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值包括:The method of claim 2, wherein when the first brightness value is outside the first brightness range, adjusting the brightness of the main fill light to adjust the The first brightness value includes:
    在所述第一亮度值小于所述第一亮度范围的下限值的情况下,增加所述主补光灯的亮度以增加所述第一亮度值;In the case that the first brightness value is less than the lower limit value of the first brightness range, increasing the brightness of the main fill light to increase the first brightness value;
    在所述第一亮度值大于所述第一亮度范围的上限值的情况下,减小所述主补光灯的亮度以减小所述第一亮度值。When the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is reduced to reduce the first brightness value.
  4. 如权利要求1所述的补光方法,其特征在于,所述根据所述图像得到所述图像的第一亮度值包括:The method of claim 1, wherein the obtaining the first brightness value of the image according to the image comprises:
    获取所述图像的亮度直方图;obtaining a brightness histogram of the image;
    对所述亮度直方图中各个像素的亮度值进行加权并求和以得到所述第一亮度值。The luminance values of each pixel in the luminance histogram are weighted and summed to obtain the first luminance value.
  5. 如权利要求1所述的补光方法,其特征在于,所述至少一个副补光灯包括第一副补光灯和第二副补光灯,所述第一副补光灯和所述第二副补光灯分别设置于所述图像采集设备的左右两侧,分别用于对所述图像的左边缘区域和右边缘区域进行补光:所述在所述第二亮度值位于所述第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值包括:The method for supplementary light according to claim 1, wherein the at least one auxiliary supplementary light comprises a first supplementary light and a second supplementary light, the first supplementary light and the second supplementary light Two pairs of fill lights are respectively arranged on the left and right sides of the image acquisition device, and are respectively used to fill the left and right edge regions of the image. In the case outside the two brightness ranges, adjusting the brightness of the secondary fill light to adjust the second brightness value includes:
    在所述左边缘区域的左侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第一副补光灯的亮度以调节所述左侧第二亮度值;When the second brightness value on the left side of the left edge area is outside the second brightness range, adjusting the brightness of the first auxiliary light to adjust the second brightness value on the left side;
    在所述右边缘区域的右侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第二副补光灯的亮度以调节所述右侧第二亮度值。In the case that the right second brightness value of the right edge region is outside the second brightness range, the brightness of the second auxiliary supplementary light is adjusted to adjust the right second brightness value.
  6. 如权利要求1所述的补光方法,其特征在于,所述根据所述图像得到所述图像的边缘区域的第二亮度值包括:The method for supplementing light according to claim 1, wherein the obtaining, according to the image, the second luminance value of the edge region of the image comprises:
    将所述图像分割成多个区域;dividing the image into a plurality of regions;
    根据所述主补光灯的视场角提取所述多个区域中的边缘区域;extracting edge regions in the plurality of regions according to the field of view of the main fill light;
    确定所述边缘区域的第二亮度值;determining a second luminance value of the edge region;
    其中所述第二亮度值为所述边缘区域的亮度值的平均值。The second luminance value is an average value of luminance values of the edge region.
  7. 如权利要求1所述的补光方法,其特征在于,所述主补光灯和副补光灯分别通过不同的脉冲宽度调制信号单独控制。The supplementary light method according to claim 1, wherein the main supplementary light and the auxiliary supplementary light are individually controlled by different pulse width modulation signals.
  8. 一种用于洗碗机的补光装置,其特征在于,包括:A light supplementing device for a dishwasher, comprising:
    图像采集设备,用于获取洗碗机的清洗区域的图像;Image acquisition equipment for acquiring images of the washing area of the dishwasher;
    主补光灯,环绕所述图像采集设备设置,用于对所述清洗区域中与所述图像的中心区域对应的区域进行补光;a main fill light, arranged around the image acquisition device, and used to fill light in the area corresponding to the central area of the image in the cleaning area;
    至少一个副补光灯,设置于所述主补光灯的至少一侧,用于对所述清洗区域中与所述图像的边缘区域对应的区域进行补光;at least one auxiliary supplementary light, arranged on at least one side of the main supplementary light, for performing supplementary light on the area corresponding to the edge area of the image in the cleaning area;
    处理器,被配置成:The processor, configured as:
    获取所述图像;obtain the image;
    根据所述图像得到所述图像的第一亮度值;obtaining a first brightness value of the image according to the image;
    在所述第一亮度值位于预设的第一亮度范围内的情况下,根据所述图像得到所述图像的边缘区域的第二亮度值;In the case that the first brightness value is within a preset first brightness range, obtain a second brightness value of the edge region of the image according to the image;
    在所述第二亮度值位于预设的第二亮度范围之外的情况下,调节所述副补光灯的亮度以调节所述第二亮度值。In the case that the second brightness value is outside the preset second brightness range, the brightness of the auxiliary fill light is adjusted to adjust the second brightness value.
  9. 如权利要求8所述的补光装置,其特征在于,所述处理器还被配置成:The light supplement device of claim 8, wherein the processor is further configured to:
    在所述第一亮度值位于所述第一亮度范围之外的情况下,调节所述主补光灯的亮度以调节所述第一亮度值。When the first brightness value is outside the first brightness range, the brightness of the main fill light is adjusted to adjust the first brightness value.
  10. 如权利要求9所述的补光装置,其特征在于,所述处理器被配置成调节所述主补光灯的亮度以调节所述第一亮度值包括处理器被配置成:The supplementary light device of claim 9, wherein the processor is configured to adjust the brightness of the main supplementary light to adjust the first brightness value comprising the processor being configured to:
    在所述第一亮度值小于所述第一亮度范围的下限值的情况下,增加所述主补光灯的亮度以增加所述第一亮度值;In the case that the first brightness value is less than the lower limit value of the first brightness range, increasing the brightness of the main fill light to increase the first brightness value;
    在所述第一亮度值大于所述第一亮度范围的上限值的情况下,减小所述主补光灯的亮度以减小所述第一亮度值。When the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill light is reduced to reduce the first brightness value.
  11. 如权利要求8所述的补光装置,其特征在于,所述处理器被配置成根据所述图像得到所述图像的第一亮度值被配置成:The lighting device of claim 8, wherein the processor is configured to obtain the first brightness value of the image according to the image and is configured to:
    获取所述图像的亮度直方图;obtaining a brightness histogram of the image;
    对所述亮度直方图中各个像素的亮度值进行加权并求和以得到所述第一亮度值。The luminance values of each pixel in the luminance histogram are weighted and summed to obtain the first luminance value.
  12. 如权利要求8所述的补光装置,其特征在于,所述至少一个副补光灯包括:The supplementary light device according to claim 8, wherein the at least one auxiliary supplementary light comprises:
    第一副补光灯,设置于所述图像采集设备的左侧;a first pair of supplementary lights, arranged on the left side of the image acquisition device;
    第二副补光灯,设置于所述图像采集设备的右侧;a second pair of supplementary lights, arranged on the right side of the image acquisition device;
    所述处理器被配置成在所述第二亮度值不位于第二亮度范围的情况下,调节所述副补光灯的亮度以调节所述第二亮度值包括所述处理器被配置成:The processor being configured to adjust the brightness of the secondary fill light to adjust the second brightness value when the second brightness value is not located in the second brightness range includes the processor being configured to:
    在所述左边缘区域的左侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第一副补光灯的亮度以调节所述左侧第二亮度值;When the second brightness value on the left side of the left edge area is outside the second brightness range, adjusting the brightness of the first auxiliary light to adjust the second brightness value on the left side;
    在所述右边缘区域的右侧第二亮度值位于所述第二亮度范围之外的情况下,调节所述第二副补光灯的亮度以调节所述右侧第二亮度值。In the case that the right second brightness value of the right edge region is outside the second brightness range, the brightness of the second auxiliary supplementary light is adjusted to adjust the right second brightness value.
  13. 如权利要求8所述的补光装置,其特征在于,所述处理器被配置成获取图像的边缘区域的第二亮度值包括所述处理器被配置成:The light supplement device of claim 8, wherein the processor is configured to obtain the second luminance value of the edge region of the image comprising the processor being configured to:
    将所述图像分割成多个区域;dividing the image into a plurality of regions;
    根据所述主补光灯的视场角提取所述多个区域中的边缘区域;extracting edge regions in the plurality of regions according to the field of view of the main fill light;
    确定所述边缘区域的第二亮度值;determining a second luminance value of the edge region;
    其中所述第二亮度值为所述边缘区域的亮度值的平均值。The second luminance value is an average value of luminance values of the edge region.
  14. 如权利要求12所述的补光装置,其特征在于,还包括:The supplementary light device of claim 12, further comprising:
    第一脉冲宽度调制设备,电性连接所述主补光灯,用于通过控制占空比调节所述主补光灯的亮度;a first pulse width modulation device, electrically connected to the main fill light, for adjusting the brightness of the main fill light by controlling a duty cycle;
    第二脉冲宽度调制设备,电性连接第一副补光灯,用于通过控制占空比调节第一副补光灯的亮度;The second pulse width modulation device is electrically connected to the first auxiliary light and is used for adjusting the brightness of the first auxiliary light by controlling the duty ratio;
    第三脉冲宽度调制设备,电性连接第二副补光灯,用于通过控制占空比调节第二副补光灯的亮度。The third pulse width modulation device is electrically connected to the second supplementary light and is used for adjusting the brightness of the second supplementary light by controlling the duty cycle.
  15. 一种洗碗机,其特征在于,包括根据权利要求8至14任意一项所述的用于洗碗机的补光装置。A dishwasher, characterized in that it comprises the light supplementing device for a dishwasher according to any one of claims 8 to 14.
  16. 一种机器可读存储介质,其特征在于,该机器可读存储介质上存储有指令,该指令用于在被处理器执行时使得所述处理器能够执行根据权利要求1至7中任意一项权利要求所述的用于洗碗机的补光方法。A machine-readable storage medium, characterized in that an instruction is stored on the machine-readable storage medium, and the instruction is used to enable the processor to execute any one of claims 1 to 7 when executed by a processor. The light supplement method for a dishwasher according to the claim.
  17. 一种计算机程序产品,包括计算机程序,其特征在于,所述计算机程序在被处理器执行时实现根据权利要求1至7中任意一项所述的用于洗碗机的补光方法。A computer program product, comprising a computer program, characterized in that, when the computer program is executed by a processor, the light supplement method for a dishwasher according to any one of claims 1 to 7 is implemented.
PCT/CN2022/072725 2021-01-19 2022-01-19 Light supplementing method and light supplementing apparatus for dishwasher, and dishwasher WO2022156707A1 (en)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN202110071263.1A CN112890727A (en) 2021-01-19 2021-01-19 Light supplementing method and device for light supplementing lamp and dish washing machine
CN202110069559.X 2021-01-19
CN202110071265.0 2021-01-19
CN202110071269.9 2021-01-19
CN202110071263.1 2021-01-19
CN202110071265.0A CN112911162B (en) 2021-01-19 2021-01-19 Light supplementing method and device for dish washing machine and dish washing machine
CN202110071269.9A CN112890728A (en) 2021-01-19 2021-01-19 Light supplementing method and device for dish washing machine and dish washing machine
CN202110069559.XA CN112890714A (en) 2021-01-19 2021-01-19 Light supplementing method and device for dish washing machine and dish washing machine

Publications (1)

Publication Number Publication Date
WO2022156707A1 true WO2022156707A1 (en) 2022-07-28

Family

ID=82549292

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/072725 WO2022156707A1 (en) 2021-01-19 2022-01-19 Light supplementing method and light supplementing apparatus for dishwasher, and dishwasher

Country Status (1)

Country Link
WO (1) WO2022156707A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012185728A (en) * 2011-03-07 2012-09-27 Isuzu Motors Ltd Image recognition system
CN105222509A (en) * 2015-09-30 2016-01-06 沈阳海尔电冰箱有限公司 Room illumination control method and refrigerator between refrigerator
CN107485356A (en) * 2017-09-01 2017-12-19 佛山市顺德区美的洗涤电器制造有限公司 The control method of washing and device and dish-washing machine of dish-washing machine
CN110336954A (en) * 2019-07-11 2019-10-15 创新奇智(重庆)科技有限公司 Automatic light-supplementing adjusting method, system and storage medium
CN112890714A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112890728A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112911162A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112890727A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for light supplementing lamp and dish washing machine

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012185728A (en) * 2011-03-07 2012-09-27 Isuzu Motors Ltd Image recognition system
CN105222509A (en) * 2015-09-30 2016-01-06 沈阳海尔电冰箱有限公司 Room illumination control method and refrigerator between refrigerator
CN107485356A (en) * 2017-09-01 2017-12-19 佛山市顺德区美的洗涤电器制造有限公司 The control method of washing and device and dish-washing machine of dish-washing machine
CN110336954A (en) * 2019-07-11 2019-10-15 创新奇智(重庆)科技有限公司 Automatic light-supplementing adjusting method, system and storage medium
CN112890714A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112890728A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112911162A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for dish washing machine and dish washing machine
CN112890727A (en) * 2021-01-19 2021-06-04 佛山市顺德区美的洗涤电器制造有限公司 Light supplementing method and device for light supplementing lamp and dish washing machine

Similar Documents

Publication Publication Date Title
CN112890714A (en) Light supplementing method and device for dish washing machine and dish washing machine
JP6816097B2 (en) Methods and equipment for determining depth maps for images
CN109640442B (en) Classroom light environment control system based on NB-IOT
CN110336954B (en) Automatic light supplementing adjustment method, system and storage medium
US20150125032A1 (en) Object detection device
US20150305119A1 (en) Lighting control device and lighting system
CN111258158B (en) Projector and brightness adjusting method
US20210243353A1 (en) Image pickup apparatus capable of performing image pickup with reduced flicker influence, method for controlling the same, and storage medium
CN104202537A (en) Dimming method for infrared camera
US11533459B2 (en) Projector and brightness adjusting method
JP2005347873A (en) Imaging apparatus
KR20060003390A (en) Method and apparatus for compensating for automatic exposure
JP2002374539A (en) Camera capable of correcting white balance
Sarkar et al. Integrated daylight harvesting and occupancy detection using digital imaging
US10313601B2 (en) Image capturing device and brightness adjusting method
CN112890728A (en) Light supplementing method and device for dish washing machine and dish washing machine
CN112890727A (en) Light supplementing method and device for light supplementing lamp and dish washing machine
CN102413280A (en) Imaging apparatus and method for controlling same
KR20100097166A (en) Power saving transmissive display
CN108737740A (en) A kind of image light compensation method and system
CN112911162B (en) Light supplementing method and device for dish washing machine and dish washing machine
WO2022156707A1 (en) Light supplementing method and light supplementing apparatus for dishwasher, and dishwasher
CN113840095B (en) Light supplement lamp control method and related device
JP6853216B2 (en) How to improve image quality in images acquired by near-infrared sensitive video cameras and such cameras
JP2010004543A (en) Imaging device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22742186

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24/11/2023).