CN115811588A

CN115811588A - Display device and brightness adjusting method

Info

Publication number: CN115811588A
Application number: CN202111074899.8A
Authority: CN
Inventors: 邓子敬; 程志; 于江; 王丛
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-09-14
Filing date: 2021-09-14
Publication date: 2023-03-17

Abstract

The invention discloses a display device and a brightness adjusting method, which can perform a brightness adjusting process of a first adjusting mode light source when detecting that a user inputs a first adjusting mode instruction, judge whether the adjusted brightness of the light source is effective or not by combining a target depth image acquired by an image acquisition device, and improve the accuracy and the stability of the acquisition of the image acquisition device when the brightness of the adjusted light source is effective. And when detecting that the user inputs a second adjusting mode instruction, the adjusting process of the brightness of the light source in the second adjusting mode can be carried out, and whether the adjusted brightness of the light source is effective or not is judged by combining the target depth image acquired by the image acquisition device, so that the acquisition accuracy and stability of the image acquisition device can be improved when the brightness of the light source is effective.

Description

Display device and brightness adjusting method

Technical Field

The invention relates to the technical field of display, in particular to display equipment and a brightness adjusting method.

Background

At present, cameras are widely applied to life, and users often install the cameras on electronic equipment such as televisions or computers and the like so as to acquire images through the cameras. However, a display of a television or a computer is provided with a light source, and the light emitted by the light source affects the accuracy of the image collected by the camera.

Disclosure of Invention

The embodiment of the invention provides display equipment and a brightness adjusting method, which are used for solving the problem that light emitted by a light source influences the accuracy of an image acquired by a camera in the prior art.

In a first aspect, an embodiment of the present disclosure provides a display device, including:

a display having a light source;

a controller connected to the display and configured to:

when detecting that a user inputs a first adjusting mode instruction, controlling the display to display a first adjusting mode interface with a first adjusting mode button, when detecting that the user inputs the instruction through the first adjusting mode button, controlling the image collector to collect a target depth image and adjust the brightness of the light source, and when determining that the brightness of the light source after adjustment is effective according to the collected target depth images, controlling the first adjusting mode interface to display the adjusted content;

and when detecting that a user inputs a second adjusting mode instruction, controlling the image collector to collect a target depth image and adjust the brightness of the light source, and controlling the display to display a second adjusting mode interface of the adjusted content when determining that the brightness of the light source after adjustment is effective according to the collected target depth image.

The beneficial effects of the disclosed embodiment are as follows:

based on the embodiment, two different modes for adjusting the brightness of the light source can be realized, the brightness adjusting process of the light source in the first adjusting mode can be carried out when a first adjusting mode instruction input by a user is detected, whether the adjusted brightness of the light source is effective or not is judged by combining a target depth image acquired by the image acquirer, and the accuracy and the stability of the acquisition of the image acquirer can be improved when the brightness adjusting process is effective. And when detecting that the user inputs a second adjusting mode instruction, the adjusting process of the brightness of the light source in the second adjusting mode can be carried out, and whether the adjusted brightness of the light source is effective or not is judged by combining the target depth image acquired by the image acquisition device, so that the accuracy and the stability of the acquisition of the image acquisition device can be improved when the brightness is effective.

In a second aspect, an embodiment of the present disclosure provides a brightness adjustment method, including:

The beneficial effects of the disclosed embodiment are as follows:

based on the embodiment, two different modes for adjusting the brightness of the light source can be realized, the adjustment process of the brightness of the light source in the first adjustment mode can be carried out when a first adjustment mode instruction input by a user is detected, and whether the adjusted brightness of the light source is effective or not is judged by combining a target depth image acquired by the image acquisition device, so that the acquisition accuracy and stability of the image acquisition device can be improved when the adjusted brightness of the light source is effective. And when detecting that the user inputs a second adjusting mode instruction, the adjusting process of the brightness of the light source in the second adjusting mode can be carried out, and whether the adjusted brightness of the light source is effective or not is judged by combining the target depth image acquired by the image acquisition device, so that the accuracy and the stability of the acquisition of the image acquisition device can be improved when the brightness is effective.

Drawings

FIG. 1 illustrates an operational scenario of a display device according to some embodiments;

fig. 2 illustrates a block diagram of a hardware configuration of a control device according to some embodiments;

fig. 3 exemplarily shows a hardware configuration block diagram of the display device 200;

fig. 4 is a schematic view schematically illustrating a structure of a display device;

FIG. 5 illustrates a flow chart of some controller-implemented methods of determining a reference pixel point;

fig. 6a schematically shows a first detected depth image;

fig. 6b schematically shows a second detected depth image;

FIG. 7 illustrates a flow chart of some brightness adjustment methods implemented by the controller;

FIG. 8 is a flow chart illustrating another method of brightness adjustment implemented by the controller;

FIG. 9 is a schematic diagram illustrating some selection adjustment interfaces;

FIG. 10 illustrates a schematic diagram of some manual adjustment mode interfaces;

FIG. 11 is a flow chart illustrating still other brightness adjustment methods implemented by the controller;

FIG. 12 illustrates a schematic diagram of some auto-adjustment mode interfaces.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the drawings of the embodiments of the present invention. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. And the embodiments and features of the embodiments may be combined with each other without conflict. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the invention without any inventive step, are within the scope of protection of the invention.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs. The use of "first," "second," and similar terms in the present application do not denote any order, quantity, or importance, but rather the terms are used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

It should be noted that the sizes and shapes of the figures in the drawings are not to be considered true scale, but are merely intended to schematically illustrate the present invention. And the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout.

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for convenience of understanding of the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.

Fig. 1 schematically illustrates an operation scenario of a display device. As shown in fig. 1, a user may operate the display apparatus 200 through the smart device 300 or the control device 100.

For example, the control apparatus 100 may be configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation. Illustratively, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. For example: the user may input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right movement keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement a function of controlling the display device 200. Alternatively, a smart device 300, such as a mobile terminal (e.g., a mobile phone), a tablet, a computer, a notebook, etc., is used to control the display device 200. Alternatively, the display apparatus 200 and the server 400 are communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks.

Illustratively, the display apparatus 200 may have a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as: televisions, e.g., smart televisions: digital television, web television, internet Protocol Television (IPTV), and the like.

Fig. 2 exemplarily shows a configuration block diagram of the control apparatus 100. As shown in fig. 2, the control device 100 may include a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM) 111, a Read Only Memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the communicator 130 may include at least one of an infrared signal module 131, a wifi module 132, a bluetooth communication protocol module 133, a wired ethernet communication protocol module 134, and an NFC module.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user operation instruction regarding controlling the display apparatus 200 to the control device 100 through voice, touch, gesture, press, and the like.

The user output interface 150 may output a user operation instruction received by the user input interface 140 to the display apparatus 200, or output an image or voice signal received by the display apparatus 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting images, and the like.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

Fig. 3 exemplarily shows a hardware configuration block diagram of the display device 200. As shown in fig. 3, the display apparatus 200 may include at least one of a tuning demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a display 275, an audio output interface 280, and a power supply 290.

For example, the tuning demodulator 210 may receive broadcast television signals by wired or wireless manner, and may perform modulation and demodulation processes such as amplification, mixing, and resonance, so as to demodulate, from a plurality of wireless or wired broadcast television signals, audio/video signals carried in the frequency of the television channel selected by the user, and additional information (e.g., EPG data).

Illustratively, the communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 220 may include at least one of a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, a wired ethernet communication protocol module 223, and an infrared receiver.

Illustratively, the detector 230 is a component of the display device 200 for collecting signals of an external environment or interaction with the outside. Illustratively, the detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200.

Illustratively, the external device interface 240 is a component that provides the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. For example, the external device interface 240 may include, but is not limited to, the following: any one or more of a High Definition Multimedia Interface (HDMI) 241, a Composite Video Blanking Sync (CVBS) Interface 242, an analog or digital component Interface 243, and a Universal Serial Bus (USB) Interface 244.

Illustratively, the controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (e.g., an operating system and various application programs) stored on the memory 260. The controller 250 may also perform an operation related to the object selected by the control instruction in response to a received user command for selecting a UI object displayed on the display 260. For example, the controller 250 may include at least one of a Random Access Memory (RAM) 251, a Read-Only Memory (ROM) 252, a Graphics Processing Unit (GPU) 253, a processor 254 (e.g., a Central Processing Unit (CPU)), a communication interface 255, a video processor 256, an audio processor 257, and a communication bus. The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

For example, the memory 260 may be used to store various types of data, software programs, or applications that drive and control the operation of the display device 200. For example, the memory 260 may be specifically used to store an operation program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data for configuring various UIs provided by the display 275, various objects related to the UIs, and visual effect images of selectors for selecting UI objects, and the like are stored.

Illustratively, the user interface 265 may receive various user interactions. Specifically, the controller 250 is configured to transmit an operation instruction input by a user to the controller 250, or transmit a signal output from the controller 250 to the user.

For example, the User may input a User operation instruction through a User Interface (UI) displayed on the display 275, and the User Interface 265 receives a User input command through the UI. For example, the user interface 265 may receive user operation instructions for controlling the position of a selector in the UI to select different objects or items.

Illustratively, the video processor is configured to perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis on the received external video signal according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the display device 200.

Illustratively, the audio processor 257 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal played in the speaker.

Illustratively, the display 275 may be configured to receive image signals from the output of the video processor 256 in the controller 250, display video content, image content, and components of the menu manipulation interface, and user manipulation of the UI interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275 may simultaneously display a user manipulation UI generated in the display apparatus 200 and used to control the display apparatus 200. The Display 275 may be a Liquid Crystal Display (LCD), and the light source of the Display may be a backlight source in the LCD. The display 275 may also be an Organic Light Emitting Diode (OLED) display, and the Light source of the display may be an OLED Emitting Light in the OLED display.

Illustratively, the power supply 290 may be configured to provide power supply support for the display device 200 with power input from an external power source under the control of the controller 250.

Fig. 4 exemplarily shows a structural diagram of the display device. As shown in fig. 4, the image collector 232 may be disposed on the display 275, and the image collector 232 may be connected to the display 275 through a USB interface for data interaction. Of course, the image collector may be embedded in the upper border of the display 275.

In some examples, the image collector may collect a depth image and a grayscale image. For example, the image collector may be a 3D camera. The images acquired by the 3D camera may include depth images and grayscale images. Illustratively, the 3D camera may be a structured light based camera. Alternatively, the 3D camera may be a Time Of Flight (TOF) based camera.

In a smart television scene, due to the light source (e.g., backlight) of a television, the ambient light of the whole environment and the ambient temperature around the television are affected, and the accuracy and stability of the 3D camera for acquiring images are affected. For example, for a structured light camera, when ambient light is strong, laser speckles of a structured light core technology are submerged, which affects accuracy and stability of a depth image acquired by the structured light camera. For a TOF camera, a TOF depth image sensor measures depth information of a scene by using a time-of-flight technique, and obtains a distance of a target object by continuously transmitting a light pulse signal to the target, receiving a light signal returned by the target object by the depth image sensor, and calculating the time-of-flight of the light pulse signal. The transmitted optical pulse signal is generally near-infrared light of 850nm, however, the TOF depth image sensor is extremely sensitive to ambient light (such as a backlight source of a display) and in an actual situation, the infrared filter layer cannot completely filter the ambient light, and part of the ambient light is refracted to the high-resistance epitaxial layer to generate photocurrent, so that the dynamic range of the TOF depth image sensor is affected, the TOF depth image sensor is easily saturated, and the ambient light resistance is to be improved.

In view of this, the display device provided in the embodiment of the present invention adjusts the brightness of the light source to meet the requirements of the image collector on the accuracy and stability of the collection.

The following description will be given taking the display as an LCD. The light source is a backlight.

1. And determining a reference pixel point.

In some examples, controller 250 pre-stores the reference pixel points. The reference pixel point may be obtained through an experiment when the display setting is not delivered from a factory, and is burned into the controller 250. Or, after leaving the factory, when the camera is turned on for the first time, the process step of determining the reference pixel point is actively triggered by the user.

Fig. 5 illustrates a flow chart of some methods implemented by controller 250 to determine a reference pixel point. As shown in fig. 5, the controller 250 may be configured to: determining a reference pixel point by adopting the following steps;

and S01, starting a display and an image collector, and controlling the light source to be closed.

For example, when the display setting is not shipped from the factory, the operator may manually press an on/off key on the control device 100 to input a power switch signal to the controller 250 of the display through the on/off key on the control device 100, so as to control the display to start. Because the display is connected with the image collector through the USB, the image collector can be started after the display is started.

Alternatively, the operator may control the display to start through a power-on/off button provided on the display. Because the display is connected with the image collector through the USB, the image collector can be started after the display is started.

After the display is started, the backlight is also started to light. The operator may manually press a light source off button on the control device 100 to input a light source off signal to the controller 250 of the display through the light source off button on the control device 100 to control the backlight to be off. Alternatively, the controller 250 may automatically control the backlight to be turned off after the display is turned on.

And S02, controlling the image collector to collect a plurality of first detection depth images.

Illustratively, the controller 250 controls the image acquirer to successively acquire N first detected depth images. The depth image collected by the image collector is an image in a visible area of the image collector.

Wherein N may be set to 20, 30, 40 or more, and is not limited herein.

And S03, determining a first detection depth value corresponding to the same pixel point in the set area of the first detection depth image.

For example, as shown in fig. 6a, the set area CA1 of the first detected depth image X1 may be a central area of the first detected depth image. For example, the center region may be a rectangular region that expands based on the center point A1. The coordinates of the central point A1 are (x 1, y 1), and the coordinates of the four vertices of the central area are: the coordinates of the vertex at the upper left corner (x 1-delta x, y1+ delta y), the coordinates of the vertex at the lower left corner (x 1-delta x, y 1-delta y), the coordinates of the vertex at the upper right corner (x 1+ delta x, y1+ delta y), and the coordinates of the vertex at the lower right corner (x 1+ delta x, y 1-delta y). Here, Δ x = Δ y may be set so that the central region covers the pixels of Q × Q. For example, Q =50 or other values. It should be noted that Δ x and Δ y may be determined according to actual requirements, and are not limited herein.

Of course, the set region may be a region at another position in the first detected depth image, and is not limited herein.

And, Q in the set region ² Each pixel point is defined as: PX _1 pixel point, PX _2 pixel point, PX _3 pixel point, … … pixel point PX _ Q (Q is an integer, and 1. Ltoreq. Q. Ltoreq.Q ² ) … … Pixel PX _ Q ² 。

Illustratively, the first detected depth value corresponding to the same pixel point in the set area of the first detected depth image is an average value of the grayscale values corresponding to the same pixel point in the set areas of the N first detected depth images. That is, for each pixel point in the set region, the average value of the gray values of the pixel point in the N first detection depth images is determined. Illustratively, N first detection depth images continuously acquired by the image acquirer are sequentially defined as: the first detection depth image X1_1 of the 1 st, the first detection depth image X1_2 of the 2 nd, the first detection depth image X1_3 of the 3 rd, the first detection depth image X1_3 of the … … nth (N is an integer, and N is not less than 1 and not more than N), and the first detection depth image X1_ N of the … … nth.

The first detection depth value CX1_ q corresponding to the pixel point PX _ q is determined by formulas (1) and (2):

wherein cx1_ qn is a gray value corresponding to the pixel PX _ q in the nth first depth image X1_ n.

And S04, controlling the light source to be turned on, and controlling the light source to be turned off after the set time.

For example, the set time may be 1h, 2h, 5h, etc., and may be determined according to the requirements of the actual application, which is not limited herein.

And S05, controlling the image collector to collect a plurality of second detection depth images.

Illustratively, the controller 250 controls the image acquirer to successively acquire N second detected depth images. The depth image collected by the image collector is an image in a visible area of the image collector.

In order to keep the result uniform, the number of the second detection depth images may be the same as the number of the first detection depth images.

And S06, determining a second detection depth value corresponding to the same pixel point in the set area of the second detection depth image.

For example, as shown in fig. 6b, the set area CA2 of the second detected depth image X2 may be a central area of the second detected depth image. For example, the center region may be a rectangular region that expands based on the center point A1. The coordinates of the central point A1 are (x 1, y 1), and the coordinates of the four vertices of the central area are: the coordinates of the vertex at the upper left corner (x 1-delta x, y1+ delta y), the coordinates of the vertex at the lower left corner (x 1-delta x, y 1-delta y), the coordinates of the vertex at the upper right corner (x 1+ delta x, y1+ delta y), and the coordinates of the vertex at the lower right corner (x 1+ delta x, y 1-delta y). Here, Δ x = Δ y may be set so that the central region covers the pixels of Q × Q. For example, Q =50 or other values. It should be noted that Δ x and Δ y may be determined according to actual requirements, and are not limited herein.

In order to keep the result uniform, the position of the setting region of the second detected depth image is the same as the position of the setting region of the first detected depth image.

Illustratively, the second depth detection value corresponding to the pixel point in the set region of each second depth detection image is an average value of gray values corresponding to all pixel points in the set region of the second depth detection image. Illustratively, N second detection depth images continuously acquired by the image acquirer are sequentially defined as: the first 1 st second detected depth image X2_1, the second 2 nd detected depth image X2_2, the second 3 rd detected depth image X2_3, … … nth second detected depth image X2_ N (N is an integer, and N is not less than 1 and not more than N), … … nth second detected depth image X2_ N.

Wherein, the second detection depth value CX2_ q corresponding to the pixel point PX _ q is determined by formulas (3) and (4):

wherein cx2_ qn is a gray value corresponding to the pixel PX _ q in the nth second depth image X2_ n.

And S07, determining a reference pixel point from the pixel points in the set area according to the first detection depth value and the second detection depth value of the same pixel point.

For example, a detection difference between the first detection depth value and the second detection depth value of the same pixel point may be determined, and a pixel point corresponding to a detection difference satisfying a set detection difference range may be determined as the reference pixel point, for example, the set detection difference range may be 0 ± Δ CX. The Δ CX may be a value of 0.1, 0.05, 0.009, etc., which may be determined according to the requirements of the actual application, and is not limited herein.

And, the detection difference of the pixel PX _ q is: CX2_ q-CX1_ q. Taking Q =50 as an example, if the detection difference CX2_3-CX1_3 of the pixel PX _3 is between 0 ± Δ CX, the pixel PX _3 is determined as the reference pixel. If the detection difference value CX2_20-CX1_20 of the pixel PX _20 is within 0 ± Δ CX, the pixel PX _20 is determined as the reference pixel. If the detection difference CX2_100-CX1_100 of the pixel PX _100 is within 0 ± Δ CX, the pixel PX _100 is determined as the reference pixel.

For example, after the light source is controlled to be turned on, the light source can be turned on for a period of time and then turned off. As the light source is illuminated for a period of time, it may cause a change in the ambient temperature in front of the television. And acquiring a second detection depth image after the light source is turned off, and determining a second detection depth value of the pixel point in the set area. And then, obtaining a reference pixel point which is less influenced by the temperature change of the light source according to the first detection depth value and the second detection depth value.

2. It is determined whether the brightness of the light source needs to be adjusted.

In some examples, during operation of the television, it may be determined whether the brightness of the light source needs to be adjusted based on the depth values corresponding to the reference pixel points.

a. The setting category image includes a depth image and a grayscale image.

Fig. 7 illustrates a flow chart of some brightness adjustment methods implemented by controller 250. As shown in fig. 7, the controller 250 may be configured to perform the following steps:

and S11, detecting a starting instruction input by a user, and controlling the display and the image collector to start.

For example, the user may manually press an on/off button on the control device 100 to input a power switch signal to the controller 250 of the display through the on/off button on the control device 100 to control the display to start. Because the display is connected with the image collector through the USB, the image collector can be started after the display is started.

And S12, controlling the light source of the display to display and set low brightness.

Illustratively, the set low luminance may be a luminance value between 0 and 10. For example, the controller 250 may be enabled to control the backlight of the television to display a 0 brightness value, when the television display is darkest. The controller 250 may also be configured to control the backlight of the television to display 5 brightness values, where the television display is slightly brighter, but darker. The controller 250 may also be configured to control the backlight display 10 brightness value of the television, where the television display is somewhat brighter, but also darker. Of course, in practical applications, the brightness value corresponding to the low brightness may be determined according to practical application requirements, and is not limited herein.

And S13, controlling the image collector to collect the depth image and the gray level image with the correspondingly set low brightness, determining the reference depth value corresponding to the reference pixel point in the depth image with the correspondingly set low brightness, and determining the reference gray level value corresponding to the reference pixel point in the gray level image with the correspondingly set low brightness.

Illustratively, when the backlight of the television displays 0 brightness value, the image collector can be controlled to collect a depth image and a gray image. Wherein, for the depth image: and taking the depth value BZ1_3 of the reference pixel point PX _3 in the depth image as a reference depth value corresponding to the reference pixel point PX _3 in the depth image. And, taking the depth value BZ1_20 of the reference pixel PX _20 in the depth image as the reference depth value corresponding to the reference pixel PX _20 in the depth image. And taking the depth value BZ1_100 of the reference pixel point PX _100 in the depth image as the reference depth value corresponding to the reference pixel point PX _100 in the depth image. And the depth-to-reference values BZ1_3, BZ1_20, and BZ1_100 are stored.

And, for the grayscale image: and taking the gray value IR1_3 of the reference pixel point PX _3 in the gray image as a reference gray value corresponding to the reference pixel point PX _3 in the gray image. Then, the gray value IR1_20 of the reference pixel point PX _20 in the gray image is set as the reference gray value corresponding to the reference pixel point PX _20 in the gray image. And taking the gray value IR1_100 of the reference pixel PX _100 in the gray image as the reference gray value corresponding to the reference pixel PX _100 in the gray image.

And S14, controlling a light source of the display to display default brightness.

Illustratively, the default brightness may be a brightness value between 70 and 80. For example, controller 250 may be caused to control a backlight display 70 brightness value of a television. The controller 250 may also be caused to control the backlight of the television to display 75 the brightness value. The controller 250 may also be caused to control the backlight display 80 brightness value of the television. Of course, in practical applications, the brightness value corresponding to the default brightness may be determined according to practical application requirements, and is not limited herein.

S15, controlling the image collector to collect the depth image and the gray level image corresponding to the default brightness, determining the detection depth value corresponding to the reference pixel point in the depth image corresponding to the default brightness, and determining the detection gray level value corresponding to the reference pixel point in the gray level image corresponding to the default brightness.

Illustratively, when the television backlight displays 70 brightness values, the image collector can be controlled to collect a depth image and a gray scale image. Wherein, for the depth image: and taking the depth value BZ2_3 of the reference pixel point PX _3 in the depth image as the detection depth value corresponding to the reference pixel point PX _3 in the depth image. And, taking the depth value BZ2_20 of the reference pixel PX _20 in the depth image as the detected depth value corresponding to the reference pixel PX _20 in the depth image. And taking the depth value BZ2_100 of the reference pixel point PX _100 in the depth image as the detection depth value corresponding to the reference pixel point PX _100 in the depth image.

And, for the grayscale image: and taking the gray value IR2_3 of the reference pixel PX _3 in the gray image as the detection gray value corresponding to the reference pixel PX _3 in the gray image. Then, the gray value IR2_20 of the reference pixel PX _20 in the gray image is used as the detected gray value corresponding to the reference pixel PX _20 in the gray image. And taking the gray value IR2_100 of the reference pixel PX _100 in the gray image as the detected gray value corresponding to the reference pixel PX _100 in the gray image.

And S16, detecting the difference range, wherein the detection difference range comprises a detection depth difference range and a detection gray difference range. Wherein, the detection depth difference range can be 0 ± Δ SD. The detection gray scale difference value range can be 0 +/-delta IRD. In addition, Δ SD may be 0.1, 0.05, 0.009, etc., and Δ IRD may be 0.1, 0.05, 0.009, etc. In practical applications, Δ SD and Δ IRD may be determined according to the requirements of practical applications, and are not limited herein.

And judging whether the detection depth difference value between the reference depth value and the detection depth value corresponding to the same reference pixel point meets the detection depth difference value range. And whether the detection gray difference between the reference gray value and the detection gray value corresponding to the same reference pixel point meets the detection gray difference range or not. If yes, go to step S17. If not, step S18 is executed.

And S17, determining that the brightness of the light source does not need to be adjusted.

Illustratively, the detection depth difference value corresponding to the reference pixel PX _3 is: BZ1_3-BZ2_3. The detection depth difference corresponding to the reference pixel PX _20 is: BZ1_20-BZ2_20. The detection depth difference corresponding to the reference pixel PX _100 is: BZ1_100-BZ2_100. And the detection gray difference value corresponding to the reference pixel point PX _3 is as follows: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference value corresponding to the reference pixel PX _100 is: IR 1-100-IR 2-100.

If the detection depth difference corresponding to the reference pixel point PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference values corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 are: BZ1_100-BZ2_100, which all satisfy the detection depth difference range. Meanwhile, the detection gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference value corresponding to the reference pixel PX _100 is: IR1_100-IR2_100, which also satisfy the range of gray level difference, indicate that the influence of the brightness of the tv backlight on the image collector is small, so that there is no need to adjust the brightness of the tv backlight additionally.

And S18, determining that the brightness of the light source needs to be adjusted.

If the detection depth difference corresponding to the reference pixel point PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 is: BZ1_100-BZ2_100, which all satisfy the detection depth difference range. Meanwhile, the detection gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference corresponding to the reference pixel PX _100 is: if IR1_100-IR2_100 does not satisfy the range of the detected gray scale difference, it means that the influence of the brightness of the tv backlight on the image collector is large, and therefore the brightness of the tv backlight needs to be adjusted.

Or, if the detection depth difference corresponding to the reference pixel PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference values corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 are: BZ1_100-BZ2_100, which does not meet the detection depth difference range. Meanwhile, the detection gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference corresponding to the reference pixel PX _100 is: IR1_100-IR2_100, satisfying the range of the detected gray scale difference, indicates that the influence of the brightness of the tv backlight on the image collector is also large, so that the brightness of the tv backlight needs to be adjusted.

Or, if the detection depth difference corresponding to the reference pixel PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 is: BZ1_100-BZ2_100, which does not meet the detection depth difference range. Meanwhile, the detection gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference value corresponding to the reference pixel PX _100 is: if IR1_100 to IR2_100 do not satisfy the range of the detected gray scale difference, it means that the influence of the luminance of the tv backlight on the image collector is also large, and therefore the luminance of the tv backlight needs to be adjusted.

b. The setting category image includes a depth image.

In this embodiment, the controller 250 may be configured to perform the steps of: s11 to S18, wherein steps S11, S12, and S14 are substantially the same as steps S11, S12, and S14, and are not repeated herein, and only the differences will be described below.

And S13, controlling the image collector to collect the depth image with the correspondingly set low brightness, and determining the corresponding reference depth value of the reference pixel point in the depth image with the correspondingly set low brightness.

For example, when the backlight of the television displays 0 brightness value, the image collector can be controlled to collect a depth image. Wherein, for the depth image: and taking the depth value BZ1_3 of the reference pixel point PX _3 in the depth image as a reference depth value corresponding to the reference pixel point PX _3 in the depth image. And, taking the depth value BZ1_20 of the reference pixel PX _20 in the depth image as the reference depth value corresponding to the reference pixel PX _20 in the depth image. And taking the depth value BZ1_100 of the reference pixel point PX _100 in the depth image as the reference depth value corresponding to the reference pixel point PX _100 in the depth image.

And S15, controlling the image collector to collect the depth image corresponding to the default brightness, and determining the detection depth value corresponding to the reference pixel point in the depth image corresponding to the default brightness.

Illustratively, the image collector may be controlled to collect a depth image when the television backlight displays 70 brightness values. Wherein, for the depth image: and taking the depth value BZ2_3 of the reference pixel point PX _3 in the depth image as the detection depth value corresponding to the reference pixel point PX _3 in the depth image. And, taking the depth value BZ2_20 of the reference pixel PX _20 in the depth image as the detected depth value corresponding to the reference pixel PX _20 in the depth image. And taking the depth value BZ2_100 of the reference pixel point PX _100 in the depth image as the detection depth value corresponding to the reference pixel point PX _100 in the depth image.

And S16, detecting the difference range to comprise a detection depth difference range. Wherein, the detection depth difference range can be 0 ± Δ SD. In the present invention, Δ SD may be a value of 0.1, 0.05, 0.009, etc., and in practical applications, Δ SD may be determined according to requirements of practical applications, which is not limited herein.

And judging whether the detection depth difference value between the reference depth value and the detection depth value corresponding to the same reference pixel point meets the detection depth difference value range. If yes, go to step S17. If not, step S18 is executed.

Illustratively, the detection depth difference value corresponding to the reference pixel PX _3 is: BZ1_3-BZ2_3. The detection depth difference corresponding to the reference pixel PX _20 is: BZ1_20-BZ2_20. The detection depth difference corresponding to the reference pixel PX _100 is: BZ1_100-BZ2_100. If the detection depth difference corresponding to the reference pixel point PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference values corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 are: BZ1_100-BZ2_100, which all satisfy the detection depth difference range. The influence of the brightness of the television backlight on the image collector is small, so that the brightness of the television backlight does not need to be adjusted additionally.

Illustratively, the detection depth difference corresponding to the reference pixel point PX _3 is: BZ1_3-BZ2_3. The detection depth difference corresponding to the reference pixel PX _20 is: BZ1_20-BZ2_20. The detection depth difference corresponding to the reference pixel PX _100 is: BZ1_100-BZ2_100.

If the detection depth difference corresponding to the reference pixel point PX _3 is: the detection depth difference value corresponding to BZ1_3-BZ2_3 and the reference pixel point PX _20 is as follows: the detection depth difference values corresponding to BZ1_20-BZ2_20 and the reference pixel PX _100 are: if at least one of BZ1_100-BZ2_100 does not satisfy the detection depth difference range, it indicates that the influence of the brightness of the television backlight on the image collector is large, and therefore the brightness of the television backlight needs to be adjusted.

c. The setting type image includes a grayscale image.

In this embodiment, the controller 250 may be configured to perform the steps of: s11 to S18, wherein steps S11, S12, and S14 are substantially the same as steps S11, S12, and S14, which are not repeated herein, and only the differences will be described below.

And S13, controlling the image collector to collect the gray image with the correspondingly set low brightness, and determining the reference gray value corresponding to the reference pixel point in the gray image with the correspondingly set low brightness.

Illustratively, when the television backlight displays a brightness value of 0, the image collector may be controlled to collect a gray image. Wherein, for the grayscale image: and taking the gray value IR1_3 of the reference pixel PX _3 in the gray image as the reference gray value corresponding to the reference pixel PX _3 in the gray image. Then, the gray value IR1_20 of the reference pixel PX _20 in the gray image is used as the reference gray value corresponding to the reference pixel PX _20 in the gray image. And taking the gray value IR1_100 of the reference pixel PX _100 in the gray image as the reference gray value corresponding to the reference pixel PX _100 in the gray image.

And S15, controlling the image collector to collect the gray image corresponding to the default brightness, and determining the detection gray value corresponding to the reference pixel point in the gray image corresponding to the default brightness.

Illustratively, the image collector may be controlled to collect a gray image when the television backlight displays 70 brightness values. Wherein, for the grayscale image: and taking the gray value IR2_3 of the reference pixel PX _3 in the gray image as the detection gray value corresponding to the reference pixel PX _3 in the gray image. Then, the gray value IR2_20 of the reference pixel point PX _20 in the gray image is set as the detected gray value corresponding to the reference pixel point PX _20 in the gray image. And taking the gray value IR2_100 of the reference pixel PX _100 in the gray image as the detected gray value corresponding to the reference pixel PX _100 in the gray image.

And S16, detecting the difference range to comprise a detection gray difference range. The detection gray level difference range can be 0 +/-delta IRD. In addition, Δ IRD can be 0.1, 0.05, 0.009, etc. In practical applications, the Δ IRD may be determined according to the requirements of practical applications, and is not limited herein.

And judging whether the detection gray difference between the reference gray value and the detection gray value corresponding to the same reference pixel point meets the detection gray difference range. If yes, go to step S17. If not, step S18 is executed.

Illustratively, the detected gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference corresponding to the reference pixel PX _100 is: IR 1-100-IR 2-100.

If the detected gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference corresponding to the reference pixel PX _100 is: if IR1_100-IR2_100 all satisfy the range of the detected gray scale difference, it means that the influence of the brightness of the tv backlight on the image collector is small, and thus, the brightness of the tv backlight does not need to be adjusted additionally.

Illustratively, the detected gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference value corresponding to the reference pixel PX _100 is: IR 1-100-IR 2-100.

If the detected gray difference value corresponding to the reference pixel PX _3 is: IR1_3-IR2_3. The detection gray difference value corresponding to the reference pixel PX _20 is: IR 1-20-IR 2-20. The detection gray difference value corresponding to the reference pixel PX _100 is: if at least one of IR1_100 to IR2_100 does not satisfy the range of the detected gray scale difference, it means that the influence of the brightness of the backlight of the television on the image collector is large, and therefore the brightness of the backlight of the television needs to be adjusted.

3. It is determined that the brightness of the light source needs to be adjusted.

Illustratively, the first adjustment mode command may be a manual mode adjustment command. Thus, when the controller 250 detects that the user inputs the first adjustment mode command, the flow of the manual adjustment mode can be entered.

The second adjustment mode command may be an automatic mode adjustment command, for example. Thus, when the controller 250 detects that the user inputs the second adjustment mode command, the flow of the automatic adjustment mode can be entered.

Fig. 8 is a flow chart illustrating another brightness adjustment method implemented by controller 250. As shown in fig. 8, the controller 250 is further configured to perform the steps of:

and S21, when the brightness of the light source is determined to be required to be adjusted, controlling the display to display a selection adjustment interface with a manual adjustment button and an automatic adjustment button. Illustratively, as shown in FIG. 9, a television display selection adjustment interface U1 is illustrated. The selection adjustment interface U1 may be displayed in an On-screen Display (OSD).

And S22, detecting that the user inputs a manual mode adjusting instruction through a manual adjusting selection button. Illustratively, the user may enter a manual adjustment selection button by manually pressing a key on the control device 100 to input an instruction to the controller 250 of the display through the key on the control device 100 to select the manual adjustment selection button to implement the manual mode adjustment instruction input controller 250, causing the controller 250 to start the process of the manual adjustment mode.

And S23, detecting that the user inputs an automatic mode adjusting instruction through an automatic adjusting selection button. Illustratively, the user may enter the auto-adjustment selection button by manually pressing a key on the control apparatus 100 to input an instruction to the controller 250 of the display through the key on the control apparatus 100 to select the auto-adjustment selection button to implement the auto-mode adjustment instruction input controller 250, causing the controller 250 to start the process of the auto-adjustment mode.

4. The mode is adjusted manually.

FIG. 10 illustrates a schematic diagram of some manual adjustment mode interfaces. As shown in fig. 10, in some examples, the controller 250 is configured to: when a first adjusting mode instruction input by a user is detected, controlling a display to display a first adjusting mode interface U2 with a first adjusting mode button so as to manually adjust the brightness of the light source through the first adjusting mode button; and controlling the image collector to collect a plurality of target depth images and adjust the brightness of the light source when the brightness of the light source is manually adjusted, and controlling the first adjustment mode interface to display the content of the completion of the first adjustment mode when the brightness of the light source after adjustment is determined to be effective according to the collected plurality of target depth images. Illustratively, the first adjustment mode interface U2 may be displayed by an OSD. The user may select the first adjustment mode button by manually pressing a key on the control device 100 to input a command to the controller 250 of the display through the key on the control device 100 to input a command to the controller 250 through the first adjustment mode button to cause the controller 250 to initiate a process of manual adjustment.

Based on the embodiment, when the first adjusting mode instruction input by the user is detected, the brightness of the light source can be manually adjusted, and whether the adjusted brightness of the light source is effective or not is judged by combining the target depth image acquired by the image acquisition device, so that the accuracy and the stability of the acquisition of the image acquisition device can be improved when the adjusted brightness of the light source is effective.

In some examples, the controller 250 is further configured to: when the brightness of the light source is manually adjusted, the current brightness adjustment is carried out when the condition that a user inputs an instruction through a first adjustment mode button is detected. For example, the user selects the first adjustment mode button through the keys on the control device 100, and when the user presses the keys on the control device 100 once, the first adjustment mode button correspondingly flashes once, which indicates that the current brightness adjustment is turned on. In some examples, the first adjustment mode interface U2 may also display a set step brightness value. For example, if the set step brightness value is 1, the brightness of the backlight of the television decreases by 1 brightness value when the first adjustment mode button flashes once. Or, the set step brightness value is 2, and when the first adjustment mode button flashes once correspondingly, the brightness of the backlight of the television is reduced by 2 brightness values. Or, the set step brightness value is 3, and when the first adjustment mode button flashes once correspondingly, the brightness of the backlight of the television is reduced by 3 brightness values. Of course, in practical applications, the set step brightness value may be determined according to the requirements of practical applications, and is not limited herein.

Fig. 11 is a flow chart illustrating still other brightness adjustment methods implemented by the controller. In some examples, as shown in fig. 11, the controller 250 is further configured to perform the steps of:

and S31, reducing the brightness of the primary light source based on the set step brightness value when the current brightness is adjusted.

Illustratively, taking the set stepped brightness value as 1 and the brightness of the tv backlight as 70 as an example, the user selects the first adjustment mode button through a key on the control device 100, and when the user presses the key on the control device 100, the first adjustment mode button flashes once correspondingly, and the brightness of the tv backlight decreases by 1 brightness value, that is, the brightness value of the tv backlight is 69 at this time.

And S32, controlling the image collector to collect a plurality of target depth images.

Illustratively, the controller 250 controls the image collector to successively collect R target depth images. The target depth image acquired by the image acquisition device is an image in a visible area of the target depth image. Wherein R may be set to 20, 30, 40 or more, and is not limited herein.

And S33, determining the minimum variance of the depth values corresponding to the reference pixel points in the collected multiple target depth images.

Illustratively, R target depth images continuously acquired by the image acquirer are sequentially defined as: the image processing method comprises the following steps of 1 st target depth image MX _1, 2 nd target depth image MX _2, 3 rd target depth image MX _3, … … R th target depth image MX _ R (R is an integer and is not less than 1 and not more than R), … … R th target depth image MX _ R.

The depth value of the reference pixel PX _3 in the r-th target depth image MX _ r is P3_ r. And, the variance SP _3 corresponding to the reference pixel PX _3 is determined by formulas (5) and (6):

the depth value of the reference pixel PX _20 in the r-th target depth image MX _ r is P20_ r. The variance SP _20 corresponding to the reference pixel PX _20 is determined by formulas (7) and (8):

the depth value of the reference pixel PX _100 in the r-th target depth image MX _ r is P100_ r. The variance SP _100 corresponding to the reference pixel PX _100 is determined by formulas (9) and (10):

therefore, the minimum variance corresponding to the reference pixel point PX _3 is determined based on the variance SP _3. Based on the variance SP _20, the minimum variance corresponding to the reference pixel PX _20 is determined. And determining the minimum variance corresponding to the reference pixel point PX _100 based on the variance SP _100.

And S34, determining the real-time depth value when the minimum variance meets the minimum variance range.

For example, the minimum variance range may be determined according to the requirements of the practical application, and is not limited herein. When it is determined that the minimum variances corresponding to all the reference pixel points satisfy the minimum variance range, the real-time depth value may be determined. The real-time depth value is an average value of depth values corresponding to the reference pixel points in the target depth images.

For example, the depth value of the reference pixel PX _3 in the r-th target depth image MX _ r is P3_ r. Then, the real-time depth value P3_0 corresponding to the reference pixel PX _3 is determined by formula (11):

and the depth value of the reference pixel PX _20 in the r-th target depth image MX _ r is P20_ r. Then, the real-time depth value P20_0 corresponding to the reference pixel PX _20 is:

and the depth value of the reference pixel point PX _100 in the r-th target depth image MX _ r is P100_ r. Then, the real-time depth value P100_0 corresponding to the reference pixel PX _100 is determined by formula (12):

s35, determining whether a depth value difference value between the real-time depth value of each reference pixel point and the prestored reference depth value meets a set detection depth difference value range or not. If yes, executing step S36; if not, step S37 is executed.

For example, the set detection depth difference range may be 0 ± Δ P. The detection gray difference range may be 0 ± Δ P. Wherein, the delta P can be 0.1, 0.05, 0.009, etc. In practical applications, Δ P may be determined according to requirements of practical applications, and is not limited herein.

The depth value difference value corresponding to the reference pixel PX _3 is: p3_0-BZ1_3. The depth value difference corresponding to the reference pixel PX _20 is: p20_0-BZ1_20. The depth value difference corresponding to the reference pixel PX _100 is: p100_0-BZ1_100.

If, the depth value difference is: p3_0-BZ1_3, P20_0-BZ1_20 and P100_0-BZ1_100 all satisfy the set detection depth difference range, which indicates that the adjusted brightness of the TV backlight is valid, and then step S36 is executed.

If, the depth value difference is: if at least one of P3_0-BZ1_3, P20_0-BZ1_20, and P100_0-BZ1_100 does not satisfy the set detection depth difference range, it indicates that the adjusted brightness of the television backlight is invalid, and the brightness of the television backlight needs to be adjusted, so as to execute step S37.

And S36, determining that the brightness of the adjusted light source is effective.

For example, after determining that the adjusted brightness of the light source is effective, the user may be prompted that the brightness of the television backlight is adjusted at the current time, and the adjusted brightness conforms to the application environment of the image collector. For example, the controller 250 may control a speaker to perform voice broadcasting of the content currently in effect for the next adjustment, or the controller 250 may control a display to display the content currently in effect for the next adjustment on the first adjustment mode interface to display the content as the content manually adjusted and completed on the first adjustment mode interface.

For example, upon determining that the adjusted brightness of the light source is effective, the controller 250 may further control the display to display the depth-reference value and the real-time reference value at the first adjustment mode interface.

And S37, determining that the brightness of the light source after adjustment is invalid, and entering the next adjustment of the light source. For example, the next adjustment process, the above processes of steps S31 to S37 may be repeated until it is determined that the adjusted brightness of the light source is valid.

For example, upon determining that the adjusted brightness of the light source is not effective, the controller 250 may further prompt the user to input an instruction to adjust the brightness of the light source again through the first adjustment mode button until determining that the adjusted brightness of the light source is effective. For example, the controller 250 may control the speaker to perform voice announcement of the current adjustment invalidity, please input a command to adjust the brightness of the light source through the first adjustment mode button, or the controller 250 may control the display to display the content of the current adjustment invalidity on the first adjustment mode interface.

5. And (4) automatically adjusting the mode.

FIG. 12 illustrates a schematic diagram of some auto-adjustment mode interfaces. As shown in fig. 12, in some examples, the controller 250 is configured to: when a second adjusting mode instruction input by a user is detected, automatically adjusting the brightness of the light source; and when the brightness of the light source in the second adjusting mode is determined to be effective according to the collected multiple target depth images, the display is controlled to display a second adjusting mode interface U3 of the content of the completion of the second adjusting mode. Illustratively, the second adjustment mode interface U3 may be displayed by OSD.

Based on the embodiment, when the condition that the user inputs the second adjusting mode instruction is detected, the brightness of the light source can be automatically adjusted, and whether the adjusted brightness of the light source is effective or not is judged by combining the target depth image acquired by the image acquirer, so that the accuracy and the stability of acquisition by the image acquirer can be improved when the brightness is effective.

In some examples, the controller 250 is further configured to: when the brightness of the light source is automatically adjusted, when a second adjusting mode instruction input by a user is detected, the current brightness adjustment is directly carried out. For example, when the user selects the second adjustment mode button through the keys on the control device 100, the automatic adjustment mode is turned on, and the current brightness adjustment is turned on.

In this embodiment, the controller 250 may also be configured to perform the steps of: S31-S37, wherein the steps S32-S35 are substantially the same as the steps S32-S35, which are not repeated herein, and only the differences will be described below.

In some examples, the controller 250 is further configured to perform the steps of:

For example, the set step brightness value may be stored in advance. For example, if the set step brightness value is 1, the brightness of the backlight of the television is reduced by 1 brightness value when the adjustment is performed once. Or, if the set stepping brightness value is 2, the brightness of the backlight of the television is reduced by 2 brightness values when the brightness is automatically adjusted once. Or, if the set step brightness value is 3, the brightness of the backlight of the television is reduced by 3 brightness values when the adjustment is performed once. Of course, in practical applications, the preset step brightness value stored in advance may be determined according to requirements of practical applications, and is not limited herein.

For example, assuming that the step brightness value is 1 and the brightness of the tv backlight is 70, the brightness of the tv backlight is reduced by 1 brightness value at the time of the current automatic adjustment, that is, the brightness value of the tv backlight is 69 at this time.

S32 to S35, which are not described in detail herein.

For example, after determining that the adjusted brightness of the light source is effective, the user may be prompted that the brightness of the television backlight is adjusted at the current time, and the adjusted brightness conforms to the application environment of the image collector. For example, the controller 250 may control a speaker to perform voice broadcasting of the content currently effective in the adjustment, or the controller 250 may control a display to display the content currently effective in the adjustment on the second adjustment mode interface U3, so as to display the content as the content of which the automatic adjustment is completed on the second adjustment mode interface U3.

For example, upon determining that the adjusted brightness of the light source is effective, the controller 250 may further control the display to display the depth-reference value and the real-time reference value at the second adjustment mode interface U3.

For example, upon determining that the adjusted brightness of the light source is not effective, the controller 250 may control direct entry into the next adjustment of the light source until determining that the adjusted brightness of the light source is effective.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A display device, comprising:

a display having a light source;

a controller connected to the display and configured to:

2. The display device of claim 1, wherein the first adjustment mode instruction is a manual mode adjustment instruction;

the second adjustment mode command is an automatic mode adjustment command.

3. The display device of claim 2, wherein the controller is further configured to:

detecting a starting instruction input by a user, and controlling the display and the image collector to start;

controlling a light source of the display to display a set low brightness;

controlling the image collector to collect a set type image corresponding to the set low brightness, and determining a reference value corresponding to a reference pixel point in the set type image corresponding to the set low brightness; wherein the reference value includes a reference depth value when the setting type image includes a depth image; when the image collector is further configured to collect a grayscale image, the set category image includes a grayscale image, and the reference value includes a reference grayscale value;

controlling a light source of the display to display a default brightness;

controlling the image collector to collect a set type image corresponding to the default brightness, and determining a detection value corresponding to a reference pixel point in the set type image corresponding to the default brightness; wherein when the setting type image includes a depth image, the detection value includes a detection depth value; when the set type image includes a grayscale image, the detection value includes a detection grayscale value;

judging whether the detection difference values between the reference values and the detection values of the same type corresponding to the same reference pixel point meet the detection difference value range or not;

if so, determining that the brightness of the light source does not need to be adjusted;

and if not, determining that the brightness of the light source needs to be adjusted.

4. The display device of claim 1, wherein the controller is further configured to:

decreasing the brightness of the light source once based on a set step brightness value when the current brightness is adjusted;

controlling the image collector to collect a plurality of target depth images;

determining the minimum variance of the depth values corresponding to the reference pixel points in the acquired multiple target depth images;

determining a real-time depth value when it is determined that the minimum variance satisfies a minimum variance range; wherein the real-time depth value is an average value of depth values corresponding to reference pixel points in the plurality of target depth images;

determining whether a depth value difference value between the real-time depth value of each reference pixel point and a pre-stored reference depth value meets a set detection depth difference value range or not;

if so, determining that the brightness of the light source after adjustment is effective;

if not, determining that the brightness of the light source after adjustment is invalid, and entering the next adjustment of the light source.

5. The display device of claim 4, wherein the controller is further configured to:

when the user is detected to input an instruction through the first adjusting mode button, the current brightness adjustment is carried out;

and when the brightness of the light source after being adjusted is determined to be invalid, prompting the user to input an instruction again through the first adjusting mode button to adjust the brightness of the light source until the brightness of the light source after being adjusted is determined to be valid.

6. The display device of claim 5, wherein the controller is further configured to:

and when the brightness of the adjusted light source is determined to be effective, controlling the first adjustment mode interface to display the reference depth value and the real-time reference value.

7. The display device of claim 4, wherein the controller is further configured to:

when detecting that the user inputs a second adjusting mode instruction, directly adjusting the current brightness;

and when the adjusted brightness of the light source is determined to be invalid, directly entering next adjustment of the light source until the adjusted brightness of the light source is determined to be valid.

8. The display device of claim 7, wherein the controller is further configured to:

and controlling the second adjusting mode interface to display the reference depth value and the real-time depth value when the adjusted brightness of the light source is determined to be effective.

9. The display device of any one of claims 3-8, wherein the controller is further configured to: determining the reference pixel point by adopting the following steps;

controlling the display and the image collector to be started, and controlling the light source to be closed;

controlling the image collector to collect a plurality of first detection depth images;

determining a first detection depth value corresponding to the same pixel point in a set area of the first detection depth image;

controlling the light source to be turned on, and controlling the light source to be turned off after a set time;

controlling the image collector to collect a plurality of second detection depth images;

determining a second detected depth value corresponding to the same pixel point in a set area of the second detected depth image;

and determining a reference pixel point from the pixel points in the set area according to the first detection depth value and the second detection depth value of the same pixel point.

10. A luminance adjustment method, characterized by comprising: