CN112890714A

CN112890714A - Light supplementing method and device for dish washing machine and dish washing machine

Info

Publication number: CN112890714A
Application number: CN202110069559.XA
Authority: CN
Inventors: 范志恒; 王彩霞; 陈蔚; 魏中科; 全永兵
Original assignee: Foshan Shunde Midea Washing Appliances Manufacturing Co Ltd
Current assignee: Foshan Shunde Midea Washing Appliances Manufacturing Co Ltd
Priority date: 2021-01-19
Filing date: 2021-01-19
Publication date: 2021-06-04

Abstract

The embodiment of the invention provides a light supplementing method and device for a dish washing machine and the dish washing machine, wherein a light supplementing lamp adjusts brightness by adjusting the duty ratio of a pulse width modulation signal, and the light supplementing method comprises the following steps: under the condition that the dish washing machine is in a factory leaving state, controlling a light supplementing lamp to supplement light to a washing area of the dish washing machine at a first brightness corresponding to a preset first duty ratio; acquiring a first image of a cleaning area; obtaining a first brightness value of the first image according to the first image; under the condition that the dish-washing machine is in a calibration state, controlling a light supplement lamp to supplement light to a washing area of the dish-washing machine at second brightness corresponding to the first duty ratio; acquiring a second image of the cleaning area; obtaining a second brightness value of the second image according to the second image; determining a difference between the second luminance value and the first luminance value; and under the condition that the difference value is larger than a preset threshold value, increasing the duty ratio to adjust the brightness of the light supplement lamp.

Description

Light supplementing method and device for dish washing machine and dish washing machine

Technical Field

The invention relates to the technical field of kitchen and bathroom appliances, in particular to a light supplementing method and device for a dish washing machine and the dish washing machine.

Background

As the living standard is improved, the use of the dish washing machine is increased. The intelligent application is more and more extensive, and the corresponding demand for the dish washer is also higher and higher.

The washing area in the known dishwasher is a semi-enclosed space, so that the interior environment is dark. Therefore, the dish washer is provided with the light supplement lamp to facilitate the placing of the tableware and the image recognition for the user. However, under the light supplement lamp carries out the light supplement, along with the time variation that dish washer used, the lamp pearl of its light supplement lamp can be ageing, leads to its luminance weak. So that the image acquired at the time of image acquisition appears too dark. When image recognition is carried out, the image is easy to be too dark, and a user feels that the brightness is not enough, so that the use experience of the product is influenced.

Disclosure of Invention

In order to solve the above technical problems, an object of the present invention is to provide a light supplement method for a dishwasher, a light supplement device and a dishwasher.

In order to achieve the above object, in a first aspect of the present invention, there is provided a supplementary lighting method for a dishwasher, the supplementary lighting lamp adjusting brightness by adjusting a duty ratio of a pulse width modulation signal, the supplementary lighting method comprising: under the condition that the dish washing machine is in a factory leaving state, controlling a light supplementing lamp to supplement light to a washing area of the dish washing machine at a first brightness corresponding to a preset first duty ratio; acquiring a first image of a cleaning area; obtaining a first brightness value of the first image according to the first image; under the condition that the dish-washing machine is in a calibration state, controlling a light supplement lamp to supplement light to a washing area of the dish-washing machine at second brightness corresponding to the first duty ratio; acquiring a second image of the cleaning area; obtaining a second brightness value of the second image according to the second image; determining a difference between the second luminance value and the first luminance value; and increasing the first duty ratio to increase the second brightness when the difference is larger than a preset threshold.

In this embodiment of the application, when the difference is smaller than the preset threshold, a second duty ratio corresponding to the current second brightness is determined.

In an embodiment of the present application, the light supplement method further includes: determining a ratio of the second duty cycle to the first duty cycle; and adjusting the duty ratio and the brightness coefficient of the light supplement lamp according to the ratio.

In an embodiment of the present application, the light supplement method further includes: determining a difference between the second duty cycle and the first duty cycle; and determining the service life of the light supplement lamp according to the difference value.

In an embodiment of the present application, the light supplement method further includes: and sending indication information to the user when the service life is less than a preset life threshold.

In the embodiment of the application, the supplementary lighting lamp is controlled to enter the calibration state at a preset first time period and/or under the condition that no tableware exists in the cleaning area.

In a second aspect of the present application, there is also provided a light supplement device for a dishwasher, including: an image acquisition element configured to acquire an image of a washing area within the dishwasher; the pulse width modulation signal adjusting device is used for controlling the duty ratio of a pulse width modulation signal input to the light supplementing lamp; a processor configured to: under the condition that the dish washing machine is in a factory leaving state, controlling a light supplementing lamp to supplement light to a washing area of the dish washing machine at a first brightness corresponding to a preset first duty ratio; acquiring a first image of a cleaning area; obtaining a first brightness value of the first image according to the first image; under the condition that the dish-washing machine is in a calibration state, controlling a light supplement lamp to supplement light to a washing area of the dish-washing machine at second brightness corresponding to the first duty ratio; acquiring a second image of the cleaning area; obtaining a second brightness value of the second image according to the second image; determining a difference between the second luminance value and the first luminance value; and increasing the first duty ratio to adjust the second brightness when the difference is larger than a preset threshold value.

In an embodiment of the application, the processor is further configured to: and under the condition that the difference value is smaller than a preset threshold value, determining a second duty ratio corresponding to the current second brightness.

In an embodiment of the application, the processor is further configured to: determining a difference between the second duty cycle and the first duty cycle; and determining the service life of the light supplement lamp according to the difference value.

In an embodiment of the application, the processor is further configured to: and sending indication information to the user when the service life is less than a preset life threshold.

In an embodiment of the application, the processor is further configured to: and controlling the light supplement lamp to be in a calibration state under the condition that the tableware is not arranged in the preset first time period and/or the cleaning area.

The embodiment of the invention provides a dish washing machine, which comprises the light supplementing device for the dish washing machine.

In another aspect, a machine-readable storage medium having instructions stored thereon for enabling a processor to perform the fill light method for a dishwasher described above when executed by the processor is provided.

In an embodiment of the present invention, a computer program product is further provided, which includes a computer program, and when the computer program is executed by a processor, the light supplement method for a dishwasher is implemented.

Through the technical scheme, the dishwasher is used for image acquisition in a factory state, the dishwasher is controlled to fill light in a cleaning area of the dishwasher with first brightness corresponding to a preset first duty ratio when the dishwasher is in the factory, when light is adjusted and calibrated, namely, the dishwasher is in a calibration state, the light filling lamp is controlled to be turned on by taking a pulse width modulation signal as the first duty ratio, the image acquisition equipment is started to photograph and acquire a second brightness value, and the first brightness value is compared with the first brightness value when the dishwasher is in the factory. And if the difference value between the first brightness and the second brightness exceeds a certain threshold value, adjusting the brightness of the supplementary lighting lamp until the brightness value is the same as the brightness value of the first image leaving the factory.

Through calibrating the light filling lamp, can acquire the luminance difference of light filling lamp under the same pulse width modulation signal's duty cycle, according to this difference, can carry out the adaptability adjustment to the light filling lamp to prevent that the light filling lamp from leading to its luminance weak because life's influence, influencing subsequent image recognition effect and illuminating effect, bring better experience for the user.

Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.

Drawings

The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the embodiments of the invention without limiting the embodiments of the invention. In the drawings:

FIG. 1 is a schematic view showing a structure of a conventional dish washer;

FIG. 2 is a schematic structural diagram illustrating an exemplary light supplement device for a dishwasher according to a light supplement method for a dishwasher in accordance with an embodiment of the present invention;

FIG. 3 is a flowchart illustrating a light supplementing method for a dishwasher according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating a step S12 of a light supplement method for a dishwasher according to an embodiment of the present invention;

fig. 5 is a flowchart illustrating a step S15 of a light supplement method for a dishwasher according to an embodiment of the present invention;

fig. 6 is a flowchart illustrating a step S13 of a light supplement method for a dishwasher according to an embodiment of the present invention;

fig. 7 is a schematic diagram illustrating an exemplary demonstration step S13 in the light supplement method for the dishwasher according to the first embodiment of the present invention;

FIG. 8 is a flowchart illustrating a supplementary lighting method for a dishwasher according to a second embodiment of the present invention;

fig. 9 is a flowchart illustrating a step S23 of the light supplement method for a dishwasher according to a second embodiment of the present invention;

FIG. 10 is a flowchart illustrating a supplementary lighting method for a dishwasher according to a second embodiment of the present invention;

fig. 11 is another flowchart illustrating a step S24 of the light supplement method for a dishwasher according to a second embodiment of the present invention;

fig. 12 is a flowchart illustrating a step S24 of the light supplement method for a dishwasher according to a second embodiment of the present invention;

fig. 13 is a flowchart illustrating a step S26 of the light supplement method for a dishwasher according to a second embodiment of the present invention;

fig. 14 is a schematic structural diagram illustrating a supplementary lighting device of a dishwasher according to a third embodiment of the present invention;

FIG. 15 is a flowchart illustrating a supplementary lighting method for a dishwasher according to a third embodiment of the present invention;

fig. 16 is a flowchart illustrating a step S35 of a supplementary lighting method for a dishwasher according to a third embodiment of the present invention;

fig. 17 is a flowchart illustrating a step S38 of a supplementary lighting method for a dishwasher according to a third embodiment of the present invention;

FIG. 18 is a flowchart illustrating a supplementary lighting method for a dishwasher according to a fourth embodiment of the present invention;

FIG. 19 is another flowchart illustrating a supplementary lighting method for a dishwasher according to a fourth embodiment of the present invention;

FIG. 20 is a flowchart illustrating a supplementary lighting method for a dishwasher according to a fourth embodiment of the present invention; and

fig. 21 is a schematic view illustrating step S494 in the light supplement method for the dishwasher according to the fourth embodiment of the present invention.

Description of the reference numerals

1. A light supplement device; 11. an image acquisition device;

12. a light supplement lamp; 121. a main light supplement lamp;

122. an auxiliary light supplement lamp; 13. an illuminating lamp.

Detailed Description

The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating embodiments of the invention, are given by way of illustration and explanation only, not limitation.

It should be noted that all the directional indicators (such as up, down, left, right, front, and rear … …) in the embodiment of the present invention are only used to explain the relative position relationship between the components, the movement situation, etc. in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indicator is changed accordingly.

In addition, the descriptions related to "first", "second", etc. in the present invention are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, the meaning of "or" appearing throughout is meant to encompass three juxtapositions, exemplified by "a or B" and including either a disposition or B disposition, or both a and B satisfied disposition. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.

The embodiment of the invention provides a light supplement and image recognition scheme for a dish washing machine, which comprises a plurality of embodiments, wherein the embodiments respectively comprise a plurality of aspects of image acquisition, image discrimination, light supplement control of a light supplement lamp and the like for a washing area in the dish washing machine, and the contents contained in the embodiments of the invention are specifically described as follows:

the invention provides a light supplement method for a dish washing machine, and particularly provides a method for supplementing light to a washing area in the dish washing machine to obtain an image better.

Referring to fig. 1, fig. 1 schematically illustrates a structure of a conventional dish washer; the dishwasher 100 includes an image capturing device 11 and a light supplement lamp 12, and in the prior art, in order to consider cost, space and complexity of design, the most design solution in the dishwasher 100 at present is to make the image capturing device 11 and the light supplement lamp 12 into an integral annular component. This facilitates wiring and reduces the number of openings in the inner wall of the dishwasher 100. As shown in fig. 1, i.e. the inner hole is an opening of the image capturing device 11, and the outer ring is the design of the fill light 12. However, this design also has a disadvantage because its size cannot be designed to be as large as a rectangular fill-in light, and the fill-in light 12 occupies a small area relative to the inner cavity of the washing area of the dishwasher 100, and at this time, the fill-in light 12 is equivalent to a point light source because the light has an incident angle (angle of view) rather than parallel light relative to the object, but the image of the washing area collected by the image collecting device 11 is the whole image of the washing area, and the image of the washing area collected by this fill-in light is that the central area covered by the fill-in light 11 will be brighter than the edge area of the peripheral area, that is, the central area will be brighter than the edge area, and if tableware is placed in the edge area, partial information of the image collected by the image collecting device 11 is lost.

Therefore, referring to fig. 2, fig. 2 is a schematic structural diagram illustrating an exemplary light supplement device for a dishwasher according to a light supplement method for a dishwasher of the present invention; the embodiment of the invention provides a light supplementing method of a dishwasher 100, which firstly improves the structure of a light supplementing device 1 of the dishwasher 100, and the light supplementing device 1 of the dishwasher 100 can comprise:

an image capturing device 11 for capturing an image of a washing area within the dishwasher 100;

a main light supplement lamp 121, configured to supplement light for an image acquired by the image acquisition device 11 by emitting light to the cleaning area;

at least one sub fill-in light lamp 122 for filling in light to an edge area (the aforementioned peripheral area) of the image by emitting light to the edge of the cleaning area; the outer ring of the image capturing device 11 surrounded by the main light supplement lamp 121 is disposed, and the auxiliary light supplement lamp 122 may be disposed on one side of the main light supplement lamp 121.

The general inventive concept provided by the embodiment of the present invention is to add the auxiliary light supplement lamps 122 around the main light supplement lamp 121, so that the dark areas of the cleaning area not covered by the light of the main light supplement lamp 121, that is, the edge areas become bright, theoretically, the number of the auxiliary light supplement lamps 122 may not be limited, and the more the auxiliary light supplement lamps 122 are, the more uniform the illumination will be. And the added auxiliary fill light 122 is preferably in the same direction as the orientation of the image capturing device 11. And the image acquisition device 11 may be on 4 sides of the lumen.

In an alternative embodiment, the image capturing device 11 may be a common camera; the main light supplement lamp 121 and the auxiliary light supplement lamp 122 can be white light lamps, in order to meet the definition at night, the image acquisition device 11 can also be an infrared camera, and the main light supplement lamp 121 and the auxiliary light supplement lamp 122 are infrared light supplement lamps; optionally, the image capturing device 11 described in this embodiment adopts a white light lamp as the main fill light lamp 121 and the auxiliary fill light lamp 122 of the general camera.

Optionally, the light supplement device 1 includes:

the first auxiliary supplementary lighting lamp 122a is arranged on the left side of the image acquisition equipment;

and the second auxiliary light supplement lamp 122b is arranged on the right side of the image acquisition equipment.

It can be understood that the edge area can be supplemented with light by the first auxiliary light supplement lamp 122a and the second auxiliary light supplement lamp 122b, wherein the first auxiliary light supplement lamp 122a and the second auxiliary light supplement lamp 122b are to be disposed at an interval relative to the image capturing device 11, so as to prevent the light of the first auxiliary light supplement lamp 122a and the second auxiliary light supplement lamp 122b and the light of the main light supplement lamp 121 from interfering too much.

Referring to fig. 3, fig. 3 is a flowchart illustrating a light supplement method for a dishwasher according to an embodiment of the present invention; based on the above structure, the light supplement method provided by the embodiment of the invention comprises the following steps:

step S11, acquiring an image;

step S12, obtaining a first brightness value of the image according to the image;

step S13, under the condition that the first brightness value is within a preset first brightness range, obtaining a second brightness value of an edge area of the image according to the image;

and step S14, when the second brightness value is outside the preset second brightness range, adjusting the brightness of the auxiliary fill-in light to adjust the second brightness value.

Specifically, firstly, initializing image acquisition equipment, waiting for a signal triggering the image acquisition equipment to acquire, and calculating a first brightness value of an image according to the image after the image is acquired by the image acquisition equipment; the method comprises the steps of evaluating the distribution of brightness of an image, evaluating a first brightness value of the image, judging according to a second brightness value of an edge area and a second brightness range when the first brightness value is within a preset first brightness range, and adjusting the brightness of an auxiliary fill-in lamp to adjust the second brightness value when the second brightness value is out of the preset second brightness range.

The first brightness range can be understood as a range in which an image is not entirely overexposed and is not entirely overexposed, and assuming that the first brightness threshold value of the image which is excessively dark is d1, and the second brightness threshold value of the image which is overexposed is d2, that is, when the brightness of the image is less than the first brightness threshold value d1, the image is entirely overexposed, and when the brightness is greater than the second brightness threshold value d2, the image is entirely overexposed. The first brightness range is d 1-d 2. When the first brightness value is within the preset first brightness range, it is only proved that the whole image is not overexposed or too dark, but due to the structural design of the main fill-in light 121, the edge area that cannot be covered by the main fill-in light 121 is still too dark.

The method and the device can divide the cleaning area into the area which can be covered by the main light supplement lamp and the edge area which cannot be covered, firstly judge the whole image of the area which can be covered by the main light supplement lamp, and then judge the edge area in the image under the condition that the first brightness value of the whole image meets the condition, so that the whole picture is uniform.

Referring to fig. 4, fig. 4 is a flowchart illustrating a step S12 of a light supplement method for a dishwasher according to an embodiment of the present invention; in a specific embodiment of step S12, the implementing step S12 of obtaining a first brightness value of the image from the image may include:

step S121, acquiring a gray level histogram of an image;

step S122, weighting and summing the brightness values of the pixels in the gray histogram to obtain a first brightness value.

Specifically, first, in step S12, a gray histogram statistics is performed on the entire image, where the "gray histogram" is a graph reflecting the relationship between the occurrence frequency of each gray-scale pixel and the gray scale in an image, and the relationship between the frequency and the gray scale is plotted with the gray scale as the abscissa and the frequency as the ordinate. In general, the initial gray level of the gray histogram is set to 0, the x-axis of the histogram represents gray values of 0 to 255, i.e. luminance values, the y-axis of the histogram represents the number of pixels corresponding to the luminance values, and the gray level is a gradation of the gray values, which represents a precision degree, such as 8-level, 16-level, 32-level, or 256-level in this embodiment, so the gray values have an interval range of 0 to 255. It can be understood that: the gray scale range represented by each interval of the histogram is set to represent the number of intervals in the gray scale range of the image, and the number can also be understood as the dimension of the one-dimensional array of the histogram.

After the histogram is obtained, the process then proceeds to step S122: and carrying out weighted summation on the brightness values of all pixels in the gray level histogram to obtain a first brightness value. Weighted summation is an averaging method that includes weights; generally, in a set of data, the number of times a data appears is referred to as a weight. The specific mode is as follows: giving different weight values according to each brightness value (gray value) in the histogram; then multiplying the weight value and the number of pixels falling in the area, and adding all the results to obtain the first brightness value; exemplary are as follows: the luminance value corresponding to 250 is given as weight 1, the luminance value corresponding to 100 is given as weight 0.3, and if an image only has 10 pixels at the luminance value 250 and the luminance value 100, respectively, the first luminance value is 10 × 1+0.3 × 10 — 13. If the first luminance range is 8 to 12, the image is excessively dark as a whole at this time.

It should be noted that the first luminance value obtained in step S12 is only one luminance reference value for determining the whole image, and may be calculated in other manners, such as calculating an average value of luminance values of each region, and obtaining the first luminance value by performing mean operation on the L component of the image twice, which all fall within the protection scope covered by the embodiment of the present invention.

In some embodiments, if the image is small and the histogram is difficult to count, i.e. in order to make it possible to display the image to the maximum, the image may be identified by first being an integer multiple of the image by an minimization process.

Further, the light supplement method further includes: step S15: and under the condition that the first brightness value is out of the first brightness range, adjusting the brightness of the main fill-in lamp to adjust the first brightness value.

It can be understood that step S15 is a parallel step of step S13, and it is first required to ensure that the first brightness value of the image meets the preset standard, that is, within the first brightness range, the first brightness value of the entire image is calculated, and if the first brightness value meets the first brightness range, the image enters the edge area for determination, and if the first brightness value does not meet the first brightness range, the brightness of the main fill-in light is continuously adjusted, so as to adjust the entire first brightness value until the entire first brightness value meets the first brightness range.

Referring to fig. 5, fig. 5 is a flowchart illustrating a step S15 of a light supplement method for a dishwasher according to an embodiment of the present invention; in step 15, in the case that the first luminance value is outside the first luminance range, adjusting the luminance of the main fill light to adjust the first luminance value includes:

step 151, increasing the brightness of the main fill-in light to increase the first brightness value when the first brightness value is smaller than the lower limit value of the first brightness range;

step S152, when the first brightness value is greater than the upper limit value of the first brightness range, the brightness of the main fill-in light is reduced to reduce the first brightness value.

It is to be understood that, in steps S151 to S152, when the image is overexposed or too dark, the brightness of the main fill light lamp is adjusted to fill light or dim the whole image, wherein the adjustment may be performed by adjusting the input voltage of the main fill light lamp or by adjusting the duty ratio of the pulse width modulation signal.

Referring to fig. 6 and 7, fig. 6 is a flowchart illustrating a step S13 of a light supplement method for a dishwasher according to an embodiment of the present invention; fig. 7 is a schematic diagram illustrating an exemplary demonstration step S13 in the light supplement method for the dishwasher according to the first embodiment of the present invention. Obtaining the second brightness value of the edge region of the image according to the image in step S13 includes:

step S131, dividing the image into a plurality of areas;

step S132, extracting edge areas in the plurality of areas according to the field angle of the main supplementary lighting lamp;

and step S133, determining a second brightness value of the edge area.

The image is divided into a plurality of areas through image division, the range which can be covered by the main light supplement lamp is determined according to the field angle of the main light supplement lamp (the image of the cleaning area can be acquired after the main light supplement lamp is independently lighted, so that the range which can be covered by the main light supplement lamp is obtained), the area which is covered by the main light supplement lamp and is located is removed from the whole area (the plurality of areas), and a plurality of edge areas are extracted. And then counting the second brightness value of the edge area.

Similarly, the second luminance value may be an average value of each of the edge regions by summing the same weights as the first luminance values.

Step S14 is then executed: and under the condition that the second brightness value is out of the preset second brightness range, adjusting the brightness of the auxiliary supplementary lighting lamp to adjust the second brightness value.

Taking the above-mentioned first auxiliary light supplement lamp 122a and the second auxiliary light supplement lamp 122b as examples, the first auxiliary light supplement lamp 122a and the second auxiliary light supplement lamp 122b are respectively disposed at the left and right sides of the image capturing device, and are respectively used for supplementing light to the left edge region and the right edge region of the image: in the case that the second brightness value is outside the second brightness range, adjusting the brightness of the auxiliary fill-in lamp to adjust the second brightness value includes: when the left second luminance value of the left edge region is outside the second luminance range, adjusting the luminance of the first auxiliary fill-in light 122a to adjust the left second luminance value; in the case that the right second luminance value of the right edge region is outside the second luminance range, the luminance of the second sub fill light 122b is adjusted to adjust the right second luminance value.

Wherein, the mode of regulation does: if the left second luminance value is outside the second luminance range, the luminance of the first sub fill-in lamp 122a is increased when the left second luminance value is smaller than the lower limit value of the second luminance range, and the luminance of the first sub fill-in lamp 122b is decreased when the left second luminance value is greater than the lower limit value of the second luminance range.

Furthermore, in the embodiment of the invention, the main fill light and the auxiliary fill light are separately controlled by different pulse width modulation signals, and the brightness is controlled by controlling the duty ratio of the pulse width modulation signals.

It can be understood that the pulse width modulation signal, referred to as PWM for short, modulates the bias of the base of the transistor or the gate of the MOS transistor according to the change of the corresponding load to implement the change of the conduction time of the transistor or the MOS transistor, thereby implementing the change of the output of the switching regulator. The duty ratio is a time ratio occupied by the high level in one period, and if the period T is 64us and the pulse width D is 32us, the duty ratio D/T is 32/64 being 50%, the pulse width adjustment is the adjustment of the duty ratio, and the adjustment of the plurality of areas of the cleaning area is realized by individually controlling the fill light lamp and the auxiliary fill light lamp.

The embodiment of the invention also provides a light supplement device for the dish washing machine, which comprises image acquisition equipment, a main light supplement lamp, at least one auxiliary light supplement lamp and a processor.

The dish washing machine comprises an image acquisition device, a main light supplement lamp, at least one auxiliary light supplement lamp and at least one auxiliary light supplement lamp, wherein the image acquisition device is used for acquiring images of a washing area of the dish washing machine, the main light supplement lamp is arranged around the image acquisition device and used for supplementing light to the images, and the at least one auxiliary light supplement lamp is arranged on at least one side of the main light supplement lamp and used for supplementing light to an edge area of the. The processor is configured to perform all or a portion of the steps described above.

In one embodiment, optionally, the at least one secondary fill light comprises: the first auxiliary light supplement lamp is arranged on the left side of the image acquisition equipment; and the second auxiliary light supplement lamp is arranged on the right side of the image acquisition equipment.

In one embodiment, the light supplement device further comprises a first pulse width modulation device which is independently arranged, is electrically connected with the main light supplement lamp, and is used for adjusting the brightness of the main light supplement lamp by controlling the duty ratio; the second pulse width modulation device is electrically connected with the first auxiliary light supplement lamp and is used for adjusting the brightness of the first auxiliary light supplement lamp by controlling the duty ratio; and the third pulse width modulation device is electrically connected with the second auxiliary light supplement lamp and is used for adjusting the brightness of the second auxiliary light supplement lamp by controlling the duty ratio. Through the first pulse width modulation equipment, the second pulse width modulation equipment and the third pulse width modulation equipment which are independently arranged, the brightness control of the main light supplement lamp, the first auxiliary light supplement lamp and the second auxiliary light supplement lamp which are respectively independent is realized.

To sum up, the supplementary lighting method provided by the embodiment of the invention uses the auxiliary supplementary lighting lamp to supplement lighting for the washing area of the dishwasher, solves the problem of darker edge area existing in the design of surrounding the image acquisition device by using the supplementary lighting lamp in the prior art, obtains the first brightness value of the image according to the image by obtaining the image of the washing area, evaluates the brightness of the edge area under the condition that the first brightness value is within the preset first brightness range, namely obtains the second brightness value, and adjusts the second brightness value through the brightness of the auxiliary supplementary lighting lamp under the condition that the second brightness value is outside the preset second brightness range, thereby improving the brightness balance of the image, preventing the information of image recognition from missing, improving the precision of image recognition and improving the experience of users.

The second embodiment of the present invention further provides a light supplement method for a dishwasher, and more particularly, to a method for supplementing light to a washing area in a dishwasher, which is faster and more energy-saving, because the existing dishwasher is cost-effective, a camera of the dishwasher generally uses a common functional camera, does not have AI auto-focusing and exposure adaptive algorithm, realizes image recognition, and generally uses an image processing technology to perform fine adjustment on an image, such as image brightness equalization adjustment, to make the brightness of the image more equalized to prevent overexposure or over-darkness, however, the image processing technology is easy to distort and is not good, and the image processing technology cannot adapt to all environments, particularly, the inner cavity of the dish-washing machine is a closed environment, when a user puts the dish-washing machine in an environment with poor light, the image processing is difficult to achieve the expected effect, and the experience effect expected by the user cannot be achieved.

Therefore, in order to solve the above problems, an embodiment of the present invention provides a light supplement method for a dishwasher, where the dishwasher includes a light supplement lamp for supplementing light to a washing area of the dishwasher, please refer to fig. 8, and fig. 8 is a flowchart of the light supplement method for the dishwasher according to a second embodiment of the present invention; the light supplement method comprises the following steps:

step S21, controlling a light supplement lamp to supplement light at an initial brightness;

step S22, acquiring an image of a cleaning area in the dishwasher;

step S23, carrying out gray histogram statistics on the image to determine whether the image is too dark or overexposed;

step S24, controlling a light supplement lamp to adjust the initial brightness under the condition that the image is over-exposed or over-dark;

step S25, under the condition that the image is not over-exposed or over-dark, determining the current initial brightness as the target fill-in light brightness;

and step S26, using the target fill-in light brightness as the default value of the next initial brightness.

Specifically, in step S21, the light supplement lamp is controlled to perform light supplement at a default initial brightness, and an image of a washing area in the dishwasher is acquired with the light supplement lamp at the initial brightness. The initial brightness can be the median of the maximum brightness of the light supplement lamp, and a more appropriate value obtained through experiments under different environments can be specifically obtained according to the fact that the dish washing machine is located, so that the dish washing machine is suitable for most of environments, and the application range of the dish washing machine is enlarged.

In step S22, an image of the cleaning region may be acquired according to an image capturing device, and the image capturing device may be set in the same direction as the light supplement lamp to obtain a better light supplement effect.

In step S23, a gray histogram is performed on the image, where the "gray histogram" is a graph reflecting the relationship between the occurrence frequency and the gray level of each gray level pixel in an image, and the relationship between the frequency and the gray level is plotted with the gray level as the abscissa and the frequency as the ordinate. Firstly, reflecting the relation between the occurrence frequency of each gray level pixel in an image and the gray level, and drawing a relation graph of the frequency and the gray level by taking the gray level as an abscissa and the frequency as an ordinate. In general, the initial gray level of the gray histogram is set to 0, the x-axis of the histogram represents gray values of 0 to 255, i.e. luminance values, the y-axis of the histogram represents the number of pixels corresponding to the luminance values, and the gray level is a gradation of the gray values, which represents a precision degree, such as 8-level, 16-level, 32-level, or 256-level in this embodiment, so the gray values have an interval range of 0 to 255. It can be understood that: the gray scale range represented by each interval of the histogram is set to represent the number of intervals in the gray scale range of the image, and the number can also be understood as the dimension of the one-dimensional array of the histogram.

Referring to fig. 9, fig. 9 is a flowchart illustrating a step S23 of a light supplement method for a dishwasher according to a second embodiment of the present invention; wherein in step S23, histogram counting the image to determine whether the image is too dark or overexposed may include:

step S231, determining that the gray value in the gray histogram corresponds to the ratio of the pixel number of the white area to the average pixel number;

step S232, under the condition that the ratio is smaller than a first ratio threshold value, determining that the image is too dark;

and step S233, determining image overexposure under the condition that the ratio is larger than the second ratio threshold.

It can be understood that, by evaluating the gray histogram of the image, as can be seen from the above, the horizontal axis represents the gray value, and the vertical axis represents the number of pixels corresponding to the gray value, and when the gray value in the horizontal axis of the gray histogram is 250 ± Δ x (i.e. the white area corresponding to step S231) and its proportion to the average number of pixels (the total number of pixels is in the gray value) is much greater than other gray values, it proves that the white area of the image accounts for a lot, and the image corresponds to overexposure. Conversely, if the vertical coordinate (number of pixels) around the gray coordinate 250 is very low and the number of pixels of the coordinate 50 (corresponding to the black area of the gray histogram) is high, such an image is insufficient in brightness, that is, the above-described image is excessively dark. If the ratio of the value of the vertical axis of the 250 ± Δ x coordinates to the average pixel number is not high, the ratio of the white area in the whole image is not high and the overall distribution of the image brightness is relatively balanced, and it is considered that the image is not excessively exploded or excessively dark.

With the above characteristics, in the embodiment of the present invention, optionally, if the first proportional threshold is 1:3 and the second proportional threshold is 3:1, the gray value corresponds to 250 ± Δ x, that is, the pixel number of the white area is within ∈ ± 3 times of the average pixel number, where the image is not overexposed and not too dark, if the ratio is greater than 3:1, the image is considered to be overexposed, and if the ratio is less than 1:3, the image is considered to be too dark in brightness, that is, the above steps S232 to S233.

Referring to fig. 10, fig. 10 is a flowchart illustrating a light supplement method for a dishwasher according to a second embodiment of the present invention; in step S24, controlling the fill-in light to adjust the initial brightness when the image is over-exposed or over-dark includes:

step 241, under the condition of image overexposure, controlling a light supplement lamp to increase initial brightness;

and step 242, controlling the supplementary lighting lamp to reduce the initial brightness under the condition that the image is too dark.

Further, the fill light adjusts the brightness by adjusting the duty ratio of the pulse width modulation signal. The pulse width modulation is an analog control mode, and modulates the bias of a transistor base or a MOS tube grid according to the change of corresponding load to realize the change of the conduction time of the transistor or the MOS tube, thereby realizing the change of the output of the switching voltage-stabilized power supply. The duty ratio is the ratio of the time occupied by the high level in one period, and if the period T is 64us and the pulse width D is 32us, the duty ratio D/T is 32/64 is 50%, and the pulse width adjustment is the adjustment of the duty ratio.

The method for controlling the light supplement lamp to increase or decrease the initial brightness may be: the duty cycle of the pwm signal may be increased or decreased at a rate of 10% every 1 second, according to the time period.

In some embodiments, the brightness of the fill-in light can be adjusted by changing the voltage of the fill-in light.

Further, the image pickup device is controlled to pick up the image again each time the brightness is changed, and the process loops to step S23 until the image goes to step S25 without overexposure or after being excessively dark.

It is to be understood that if the initial brightness does not need to be adjusted at this time when the image has not been too dark or overexposed, then the flow proceeds directly from step S23 to step S25.

Referring to fig. 11, fig. 11 is another flowchart illustrating a step S24 of a light supplement method for a dishwasher according to a second embodiment of the present invention; in one embodiment, the controlling the fill light to adjust the initial brightness in step 24 includes:

step S241', dividing the brightness of the light supplement lamp into a plurality of grades from zero to the maximum;

in step S242', the brightness level is sequentially decreased or increased from the level corresponding to the initial brightness.

Specifically, the luminance of the fill-in light is divided into a plurality of levels from zero to the maximum luminance of the rated power, the levels are adjusted by controlling the duty ratio of the pulse width modulation signal, for example, the luminance is divided into 10 levels from zero to the maximum luminance of the rated power, the maximum luminance corresponds to the duty ratio of the pulse width modulation signal being 100%, the luminance is 0 corresponds to the duty ratio of the pulse width modulation signal being 0%, the first level corresponds to the duty ratio of the pulse width modulation signal being 10%, and so on.

The initial brightness can be correspondingly the fifth grade, namely the duty ratio corresponding to the pulse width modulation signal is 50%, the grade is sequentially increased or decreased according to the overexposure or the overexposure of the image, if the duty ratio is increased to the sixth grade corresponding to the pulse width modulation signal and is 60%, the brightness adjustment speed of the light supplement lamp can be increased by adjusting in the way, and therefore the response of subsequent image identification is increased.

Referring to fig. 12, fig. 12 is a flowchart illustrating a step S24 of a light supplement method for a dishwasher according to a second embodiment of the present invention; the cleaning method further comprises the following steps:

step S243', after each reduction or increase of the initial brightness, acquiring an image of the washing area in the dishwasher again;

and step 244', circularly performing gray histogram statistics on the image, and determining the current initial brightness as the target fill-in light brightness under the condition that the ratio is between the first ratio threshold and the second ratio threshold.

That is, after each time the initial brightness is decreased or increased, the image capture device is controlled to capture the image again, and the step S23 is repeated until the image is not overexposed or too dark, and the initial brightness that has been adjusted to the current time is used as the fill-in brightness of the target.

Referring to fig. 13, fig. 13 is a flowchart illustrating a step S26 of a light supplement method for a dishwasher according to a second embodiment of the present invention; in step S26, taking the target fill-in luminance as the default value of the next initial luminance includes:

step 261, recording the target supplementary lighting brightness and the adjustment time of the corresponding target supplementary lighting brightness;

step S262, the target fill-in luminance is used as an initial luminance default corresponding to the next adjustment time.

It is understood that this step is mainly performed by considering that the user usually places the dishwasher in a fixed position when using the dishwasher, and in most cases, the lighting environment in the same position is the same, and based on this feature, the brightness value of the target and the adjustment time of the corresponding target fill-in light brightness are recorded, such as 100cd/m²And 12:00, 150cd/m²And 9:00, when the dishwasher is used next time, if the dishwasher is used at 9:00 by a user, the default value of the initial brightness of the supplementary lighting lamp is the target supplementary lighting brightness corresponding to the last time, namely 150cd/m²At this time, according to the steps S21 to S23, if the fill light is the default of the initial brightnessThe image that gathers under the value does not overexpose or excessively dark, then need not the adjustment to reduce the time of obtaining suitable image, and the light filling lamp need not to mediate many times and practice thrift the energy consumption, possesses intelligent characteristics.

In summary, the light supplement method provided by the embodiment of the invention performs light supplement at an initial brightness by controlling the light supplement lamp and acquires an image of a cleaning area, determines a suitable target light supplement brightness by adjusting the output brightness of the light supplement lamp by counting a gray histogram of the image, and finally realizes that the image is not exploded but not darkened, and reduces the number of times of adjusting the brightness of the light supplement lamp by the dishwasher by determining the target light supplement brightness as a next default value of the initial brightness, thereby reducing the time of acquiring a suitable image, saving energy consumption, and accelerating the response of image recognition.

The invention also provides a light supplement method for a dish washing machine, in particular to a method for performing energy-saving and rapid light supplement on a washing area in the dish washing machine, which aims to solve the problems that the existing dish washing machine generally comprises an illuminating lamp, when a user opens a door of the dish washing machine, the illuminating lamp is usually automatically turned on to facilitate the user to place tableware, and some dish washing machines are also provided with the light supplement lamp, but the light supplement lamp and the illuminating lamp only realize the switching function and cannot perform linear brightness adjustment. And therefore, is a fixed brightness. The intelligent self-adaptive adjustment can not be carried out according to the brightness of the washing area in the actual dish washer, the brightness is the same no matter in daytime or at night, and the use effect of a user is poor due to lack of intelligence.

Referring to fig. 14, fig. 14 is a schematic structural view illustrating a light supplement device of a dishwasher according to a third light supplement method for a dishwasher according to an embodiment of the present invention; first, a structure of a light supplement device for a dishwasher is described, and the light supplement device for the dishwasher may include:

a light supplement lamp 12 for supplementing light to the image acquired by the image acquisition device 11 by emitting light to the cleaning region;

and an illumination lamp 13 for emitting light to the washing area, thereby realizing an illumination effect.

And the processor (not shown) is electrically connected to the fill-in light 12 and the illuminating light 13, and is used for controlling the fill-in light 12 and the illuminating light 13 to emit light.

Wherein, light 13 and light filling lamp 12 can be located the same face of dish washer inner space, also can be located different faces, optionally are located different faces to provide the illumination in a plurality of positions, thereby make things convenient for image acquisition equipment 11 to obtain more complete and clear image.

In one example, the fill light 12 is disposed around the image capturing device 11 in a ring shape to facilitate the wiring, and also to reduce the number of holes on the inner wall of the dishwasher, thereby increasing the space of the washing area of the dishwasher.

Referring to fig. 15, fig. 15 is a flowchart illustrating a light supplement method for a dishwasher according to a third embodiment of the present invention; in the embodiment of the invention, the dish washing machine comprises a light supplementing lamp and an illuminating lamp for supplementing light to a washing area, and further comprises a cabinet door, wherein the light supplementing method comprises the following steps:

step S31, determining the opening and closing state of the cabinet door;

and step S32, controlling the lighting lamp to be turned on and the light supplement lamp to be turned off under the condition that the cabinet door is determined to be turned on according to the opening and closing state.

Step S33, acquiring a first image of the cleaning area;

step S34, obtaining a first brightness value of the first image according to the first image;

step S35, determining the light supplement brightness required by the light supplement lamp according to the first brightness value;

step S36, controlling a light supplement lamp to supplement light to the cleaning area at the light supplement brightness;

step S37, acquiring a second image of the cleaned area after light supplement;

step S38, determining a second brightness value according to the second image;

and step S39, controlling the fill-in light to perform secondary adjustment on the fill-in light brightness when the second brightness value is outside the preset brightness value range.

Specifically, in steps S31 to S32, the door of the cabinet is opened or closed by a position limiter or a displacement sensor disposed at the door of the cabinet to detect the open or closed state of the door of the cabinet, and if the door of the cabinet is opened, the user is considered to place tableware in the washing area.

And then, in step S33, the light supplement lamp is turned off to obtain the first image of the cleaning region, and the first image can be collected by triggering the image collection device. In step S34, a first luminance value of the first image is obtained according to the first image, where the first luminance value is an average luminance value of the pixel points in the first image, and the second luminance value is an average luminance value of the pixel points in the second image. In step S35, the fill-in luminance required by the fill-in lamp is determined according to the first luminance value. It can be understood that under the current condition that does not need the light filling lamp, only depending on the light of light, the first luminance value of the image of gathering then through the difference of first luminance value and preset target brightness value to confirm the light filling luminance of light filling lamp.

Referring to fig. 16, fig. 16 is a flowchart illustrating a step S35 of a light supplement method for a dishwasher according to a third embodiment of the present invention; therefore, the step S35 of determining the fill-in luminance required by the fill-in lamp according to the first luminance value includes:

step S331, dividing the fill-in luminance of the fill-in lamp into a plurality of grades from zero to the maximum;

step S332, determining a difference value between the first brightness value and a preset target brightness value;

and S333, determining the grade of the light supplement brightness required by the light supplement lamp according to the difference value.

The target brightness value may correspond to a fifth level, that is, the duty ratio of the corresponding pulse width modulation signal is 50%, and the level of the fill-in luminance required by the fill-in lamp is determined according to the difference between the level of the current first brightness value and the level of the target brightness value. Adjust through this type of mode, can utilize the influence of light of illuminating lamp to regulate and control the light filling lamp to accelerate the light filling lamp and carry out the response of adjusting, and save the energy consumption of light filling lamp.

Steps S36 to S39 illustrate that the light supplement lamp is controlled to supplement light to the cleaning area with the light supplement brightness based on S35; acquiring a second image of the cleaned area after light supplement; determining a second luminance value from the second image; judging whether the second brightness value is within a preset brightness value range; and under the condition that the second brightness value is out of the brightness value range, controlling the supplementary lighting lamp to perform secondary adjustment on the supplementary lighting brightness.

Specifically, after the light supplement lamp is controlled to supplement light at the light supplement brightness, the image acquisition device is controlled again to acquire the second image, whether the second image is in a brightness value range is observed through the second brightness value, the brightness value range is to measure whether the second image is still overexposed or too dark, and if the second image is still overexposed or too dark, the light supplement lamp is controlled to perform secondary adjustment, so that the final target light supplement brightness is determined.

Referring to fig. 17, fig. 17 is a flowchart illustrating a step S38 of a light supplement method for a dishwasher according to a third embodiment of the present invention; in a specific embodiment, the step S38 includes that the luminance value range includes a luminance lower limit value and a luminance upper limit value, and when the second luminance value is outside the preset luminance value range, controlling the fill-in lamp to perform the secondary adjustment on the fill-in luminance includes:

step S381, when the second brightness value is larger than the brightness upper limit value, reducing the fill-in brightness;

in step S382, when the second luminance value is smaller than the luminance lower limit, the fill-in luminance is increased.

It can be understood that the luminance of the fill-in light is adjusted twice to fill in or dim the entire image, where the adjustment may be performed by adjusting the input voltage of the main fill-in light or by adjusting the duty ratio of the pulse width modulation signal, where the upper limit of the luminance is a critical value for determining whether the second image is over-exposed, and the lower limit of the luminance is a critical value for determining whether the second image is over-dark.

Wherein, divide into the strategy of a plurality of grades through above-mentioned light filling luminance with the light filling lamp from zero to the biggest, reduce light filling luminance and include: the grade of the fill-in light brightness is reduced in sequence; increasing fill-in luminance includes: and increasing the grade of the fill-in light brightness in sequence.

And if the current corresponding fill-in luminance is the fourth level, sequentially reducing the level of the fill-in luminance if the second luminance value is greater than the luminance upper limit value, adjusting the fill-in luminance to the third level, acquiring the second image for the second time again, continuing to reduce the fill-in luminance if the second luminance value is still greater than the luminance upper limit value, adjusting the fill-in luminance to the second level until the second luminance value is within the luminance value range, and determining the current fill-in luminance to be the target fill-in luminance.

Under the condition that the cabinet door is determined to be opened according to the opening and closing state, the light supplement lamp is controlled to be opened and then closed after the preset first time.

Further, after the target fill-in light brightness is found in step S38, the door closing information is waited, and after a preset delay time, the lighting lamp is turned off.

Furthermore, after receiving the door closing information, the light supplement lamp is turned off, and the target light supplement brightness output by the light supplement lamp is saved as a next default value.

To sum up, the light supplementing method provided by the embodiment of the invention adjusts the light supplementing brightness of the light supplementing lamp according to the light of the illuminating lamp on the basis of the control that the illuminating lamp is turned on based on detection to facilitate the user to place tableware, so that the intelligent self-adaptive adjustment is carried out according to the brightness of the cleaning area inside the dish washing machine, the illuminating lamp is automatically turned on when the user opens the door, the user can place the tableware conveniently, and meanwhile, the brightness of the light supplementing lamp is adjusted according to the brightness of the illuminating lamp, so that the intelligent and humanized effects are realized, and the better use experience is brought to the.

The fourth embodiment of the invention provides a light supplementing method for a dish washing machine, in particular to a method for controlling the brightness of a light supplementing lamp in the dish washing machine, and aims to solve the problem that in the prior art, when the light supplementing lamp is used for supplementing light, the lamp bead of the light supplementing lamp is aged along with the change of the use time of the dish washing machine, so that the brightness of the light supplementing lamp is weakened. So that the image acquired at the time of image acquisition appears too dark. When image recognition is carried out, the image is easy to be too dark, and a user feels that the brightness is not enough, so that the use experience of the product is influenced.

Referring to fig. 18, fig. 18 is a flowchart illustrating a light supplement method for a dishwasher according to a fourth embodiment of the present invention; in the embodiment of the present application,

step S41, under the condition that the dish-washing machine is in a factory state, controlling a light supplementing lamp to supplement light to a washing area of the dish-washing machine at a first brightness corresponding to a preset first duty ratio;

step S42, acquiring a first image of the cleaning area;

step S43, obtaining a first brightness value of the first image according to the first image;

step S44, under the condition that the dish-washing machine is in the calibration state, controlling a light supplement lamp to supplement light to a washing area of the dish-washing machine at a second brightness corresponding to the first duty ratio;

step S45, acquiring a second image of the cleaning area;

step S46, obtaining a second brightness value of the second image according to the second image;

step S47, determining the difference between the second brightness value and the first brightness value;

and step S48, increasing the duty ratio to increase the brightness of the supplementary lighting lamp when the difference value is larger than the preset threshold value.

First, the above steps need to be controlled by a pwm signal based on the fill light, and the brightness is controlled by controlling the duty ratio of the pwm signal.

It can be understood that the pulse width modulation signal, referred to as PWM for short, modulates the bias of the base of the transistor or the gate of the MOS transistor according to the change of the corresponding load to implement the change of the conduction time of the transistor or the MOS transistor, thereby implementing the change of the output of the switching regulator. The duty ratio is a ratio of time occupied by the high level in one period, and if the period T is 64us and the pulse width D is 32us, the duty ratio D/T is 32/64 is 50%, and the pulse width adjustment is an adjustment of the duty ratio, and the luminance control is realized by controlling the duty ratio of the pulse width modulation signal input to the fill light.

Specifically, under the condition that the dish washing machine is in a factory state, namely when the dish washing machine just begins to factory, the better brightness of the light supplement lamp is set, namely the light supplement lamp is controlled to supplement light to a washing area of the dish washing machine by taking a preset pulse width modulation signal as first brightness corresponding to a first duty ratio, and a current first brightness value of the light supplement lamp is stored. Then, a first image at the time of factory shipment is shot through image acquisition, a first brightness value of the first image is obtained according to the first image, and the data (the first brightness value and the first duty ratio value) are stored to be used for later comparison.

When the calibration of adjusting luminance is carried out to needs, be located the condition of calibration state at the dish washer promptly, control light filling lamp and use pulse width modulation signal to open as first duty cycle equally, start image acquisition equipment and shoot and gather to acquire the second luminance value, through the first luminance value of contrast when leaving the factory. And if the difference value between the first brightness and the second brightness exceeds a certain threshold value, adjusting the brightness of the supplementary lighting lamp until the brightness value is the same as the brightness value of the first image leaving the factory.

The light supplement lamp can be controlled to enter the calibration state in a preset first time period and/or under the condition that no tableware exists in the cleaning area. If the calibration is performed every other half year or one year, the light supplement lamp can be triggered by the user to enter a calibration state, so that the light supplement lamp is maintained.

It can be understood that through calibrating the light filling lamp, can acquire the luminance difference of light filling lamp under the same pulse width modulation signal's duty cycle, according to this difference, can carry out the adaptability adjustment to the light filling lamp to prevent that the light filling lamp from leading to its luminance weak because life's influence, influencing subsequent image recognition effect and illuminating effect, bring better experience for the user.

The first brightness value of the first image is obtained according to the first image, and the second brightness value of the second image is obtained according to the second image, which can be weighted and summed through a statistical gray histogram, or an average brightness value is calculated.

It is to be understood that the luminance values of the respective pixels in the gray histogram are weighted and summed to obtain the first luminance value. Weighted summation is an averaging method that includes weights; generally, in a set of data, the number of times a data appears is referred to as a weight. The specific mode is as follows: giving different weight values according to each brightness value (gray value) in the histogram; then multiplying the weight value and the number of pixels falling in the area, and adding all the results to obtain the first brightness value; exemplary are as follows: the luminance value corresponding to 250 is given as weight 1, the luminance value corresponding to 100 is given as weight 0.3, and if an image only has 10 pixels at the luminance value 250 and the luminance value 100, respectively, the first luminance value is 10 × 1+0.3 × 10 — 13.

If the second brightness value is 10 under the same duty ratio of the pulse width modulation signal, it is proved that the luminance of the fill-in light is attenuated, at this time, according to the difference 3 between the first brightness value and the second brightness value, if the preset threshold value is 2, at this time, the difference is greater than the threshold value, the duty ratio is increased to increase the luminance of the fill-in light.

Wherein, the duty ratio is increased by a certain proportion in a preset time, for example, the duty ratio of the pulse width modulation signal is increased or decreased at a speed of 5% every t seconds, so as to increase the brightness of the fill-in light, after each adjustment, the image acquisition device is controlled to acquire one image again, the second brightness value of the image is calculated until the difference value between the second brightness value and the first brightness value is within the threshold value,

further, the light supplement method for the dishwasher according to the embodiment of the present invention further includes:

and step S49, determining a second duty ratio corresponding to the light supplement lamp at present under the condition that the difference value is smaller than a preset threshold value.

It will be appreciated that the difference is compared to the threshold, and that the second duty cycle does not need to be adjusted if the difference is already less than the threshold, and the second duty cycle is adjusted if the difference is greater than the threshold until the adjusted second duty cycle is determined after the difference is less than the threshold.

Referring to fig. 19, fig. 19 is another flowchart of a light supplement method for a dishwasher according to a fourth embodiment of the present invention; according to the determined second duty ratio, the fill-in method may further include:

step 491, determining the ratio of the second duty ratio to the first duty ratio;

and step S492, adjusting the duty ratio and the brightness coefficient of the light supplement lamp according to the ratio.

It will be appreciated that, depending on the ratio of the second duty cycle to the first duty cycle, e.g., 50% for the first duty cycle and 60% for the second duty cycle, the same brightness is represented, and that, due to the decay of the fill light, a brightness that previously required only 40% of the duty cycle now required 50% for the duty cycle, and a ratio of 60/50 of 1.2.

In step S492, the luminance of the fill-in light is equal to the duty cycle × k, where k is a correlation coefficient, and the duty cycle of the fill-in light and the luminance coefficient k can be adjusted according to the ratio, for example, the coefficient k is increased to 1.2 times of the original value, so that the fill-in light normally operates at the same duty cycle.

Referring to fig. 20 and 21, fig. 20 is a further flowchart of a light supplement method for a dishwasher according to a fourth embodiment of the present invention; fig. 21 is a schematic view illustrating step S494 in the light supplement method for the dishwasher according to the fourth embodiment of the present invention. The light supplement method provided by the embodiment of the invention further comprises the following steps:

step S493, determining a difference between the second duty cycle and the first duty cycle;

and S494, determining the service life of the light supplement lamp according to the difference.

Specifically, the second duty ratio P1 of the pulse width modulation signal passing through the fill light in the calibration state and the pulse width modulation signal P0 in the factory state may be used. Calculating the ratio of the remaining service life by a formula:

T＝100-((|P1-P0|*100)/(100-P0))

where the calculated T is the percentage of remaining useful life.

Furthermore, through the service life obtained above, the user can send the indication information under the condition that the service life is smaller than the preset service life threshold, the indication information can be through an indication lamp or other early warning equipment such as a honey device, and the display screen outputs information to prompt the user to change the light supplement lamp, or the information can be sent to the user terminal through a wireless network. The light supplement lamp is changed by a user, the dish washing machine is maintained, and therefore reliability of the dish washing machine is guaranteed.

To sum up, the light supplement method provided by the embodiment of the invention utilizes the dish washing machine to perform image acquisition in a factory state, controls the light supplement during the factory shipment of the dish washing machine to supplement light to a washing area of the dish washing machine at a first brightness corresponding to a preset first duty ratio, controls the light supplement lamp to be turned on with the pulse width modulation signal as the first duty ratio when the dimming calibration is required, namely, under the condition that the dish washing machine is in a calibration state, starts the image acquisition device to perform photographing acquisition, and obtains a second brightness value by comparing the first brightness value during the factory shipment. If the difference value of the difference between the first brightness and the second brightness exceeds a certain threshold value, the brightness of the light supplement lamp is adjusted until the brightness value identical to that of the first image leaving the factory is reached, the light supplement lamp is calibrated, the brightness difference of the light supplement lamp under the duty ratio of the same pulse width modulation signal can be obtained, and according to the difference, the light supplement lamp can be adaptively adjusted, so that the light supplement lamp is prevented from being weakened due to the influence of the service life, the subsequent image recognition effect and the subsequent illumination effect are influenced, and better experience is brought to a user.

It should also be understood by those skilled in the art that if the light supplement method or the light supplement device provided by the present invention is simply changed, the above methods are combined with functions, or replaced on the device, such as the replacement of model materials for each component, the replacement of use environment, the simple replacement of the position relationship of each component, etc.; or the products formed by the components are integrally arranged; or a detachable design; it is within the scope of the present invention to replace the methods and apparatus of the present invention with any method/apparatus/device that combines the components to form a method/apparatus/device with specific functionality.

The fifth embodiment of the invention also provides a dishwasher, which comprises the light supplementing device. It should be understood that the dishwasher is not limited to the size and the shape and contour, and only the corresponding components of the fill-in light device are required to achieve the same or similar functions, which also fall within the protection scope of the present invention.

The supplementary lighting device further comprises a memory, the supplementary lighting method for the dish washing machine can be stored in the memory as a program unit, and the processor executes the program unit stored in the memory to realize corresponding functions.

The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, and light supplement is carried out on the light supplement method for the dish washing machine by adjusting the kernel parameters.

The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) or a non-volatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.

An embodiment of the present invention also provides a machine-readable storage medium having a program stored thereon, which when executed by a processor, implements a light supplement method for a dishwasher.

The embodiment of the invention also provides a processor, wherein the processor is used for running the program, and the light supplement method for the dish washing machine is executed when the program runs.

Embodiments of the invention also provide a computer program product comprising a computer program which, when executed by a processor, implements the method for a dishwasher described above.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow or block of the flowchart illustrations or block diagrams, and combinations of flows or blocks in the flowchart illustrations or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processor to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processor, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processor to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processor to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A supplementary lighting method for a dish washer, wherein the supplementary lighting lamp adjusts brightness by adjusting a duty ratio of a pulse width modulation signal, the supplementary lighting method comprising:

under the condition that the dish washing machine is in a factory leaving state, controlling the light supplementing lamp to supplement light to a washing area of the dish washing machine at a first brightness corresponding to a preset first duty ratio;

acquiring a first image of the cleaning area;

obtaining a first brightness value of the first image according to the first image;

under the condition that the dish washing machine is in a calibration state, controlling a light supplement lamp to supplement light to a washing area of the dish washing machine at second brightness corresponding to the first duty ratio;

acquiring a second image of the cleaning area;

obtaining a second brightness value of the second image according to the second image; (ii) a

Determining a difference between the second luminance value and the first luminance value;

increasing the first duty ratio to increase the second brightness in a case where the difference is greater than a preset threshold.

2. The light supplement method of claim 1, further comprising:

and under the condition that the difference value is smaller than a preset threshold value, determining a second duty ratio corresponding to the current second brightness.

3. The light supplement method of claim 2, further comprising:

determining a ratio of the second duty cycle to the first duty cycle;

and adjusting the duty ratio and the brightness coefficient of the light supplement lamp according to the ratio.

4. The light supplement method of claim 2, further comprising:

determining a difference between the second duty cycle and the first duty cycle;

and determining the service life of the light supplement lamp according to the difference value.

5. The light supplement method of claim 4, further comprising: and sending indication information to a user under the condition that the service life is less than a preset life threshold.

6. The light supplement method of claim 4, further comprising: and controlling the light supplement lamp to enter a calibration state in a preset first time period and/or under the condition that no tableware exists in the cleaning area.

7. A light supplement device for a dish washer, comprising:

an image acquisition element configured to acquire an image of a washing area within the dishwasher;

the pulse width modulation signal adjusting device is used for controlling the duty ratio of a pulse width modulation signal input to the light supplementing lamp;

a processor configured to:

acquiring a first image of the cleaning area;

acquiring a second image of the cleaning area;

obtaining a second brightness value of the second image according to the second image;

increasing the first duty ratio to adjust the second brightness when the difference is greater than a preset threshold.

8. The light supplementing device of claim 7, wherein the processor is further configured to: and under the condition that the difference value is smaller than a preset threshold value, determining a second duty ratio corresponding to the current second brightness.

9. The light supplementing device of claim 7, wherein the processor is further configured to:

10. The light supplementing device of claim 7, wherein the processor is further configured to: and sending indication information to a user under the condition that the service life is less than a preset life threshold.

11. The light supplementing device of claim 7, wherein the processor is further configured to: and controlling the light supplement lamp to be in a calibration state under the condition that the tableware is not arranged in a preset first time period and/or a cleaning area.

12. A dishwasher, comprising the light supplement apparatus for a dishwasher according to any one of claims 7 to 11.

13. A machine-readable storage medium having stored thereon instructions for enabling a processor to execute the method for supplementing light for a dishwasher according to any one of claims 1 to 6 when executed by the processor.

14. A computer program product comprising a computer program, characterized in that the computer program realizes the method for supplementing light for a dishwasher according to any one of claims 1 to 6 when executed by a processor.