TWI826117B - Display adjustment method and an electronic device - Google Patents

Abstract

The disclosure provides a display adjustment method and an electronic device. The method includes: obtaining a user's gaze point on a display, wherein the display includes a plurality of pixels, and each pixel has a preset brightness; reducing a brightness of each pixel based on a distance between the gaze point and each pixel; determining a gaze area including the gaze point; obtaining a plurality of specific pixels located in the gaze area from the plurality of pixels; and restoring the brightness of each specific pixel to the preset brightness.

Description

Display adjustment method and electronic device

The present invention relates to a display technology, and in particular, to a display adjustment method and an electronic device.

Monitors currently on the market (such as notebook computers and/or independent screens, etc.) all have their own monitor power-saving mechanisms. For example, some laptop monitors can reduce the backlight brightness of the screen to save power when the battery power falls within a certain range. In addition, independent display products proposed by some manufacturers can also use cameras to track the position of the user's eyes, and automatically switch the display screen to a sleep state when it is determined that the user's eyes are far away from the display.

However, if the conventional power-saving mechanism reduces the backlight brightness of the screen when the user is using the display, the user's viewing quality may be affected because the picture is not bright enough.

In view of this, the present invention provides a display adjustment method and an electronic device, which can be used to solve the above technical problems.

The present invention provides a display adjustment method, suitable for an electronic device, including: obtaining a user's gaze point on a display, wherein the display includes a plurality of pixels, and each pixel has a preset brightness; based on the gaze point and each The distance between pixels reduces the brightness of each pixel; determining a gaze area including the gaze point on the display; obtaining a plurality of specific pixels located in the gaze area from the plurality of pixels; and restoring the brightness of each specific pixel to the default brightness.

The invention provides an electronic device, including a storage circuit and a processor. The storage circuit stores a program code. The processor is coupled to the storage circuit and accesses the program code to execute: obtain a gaze point of a user on the display, where the display includes a plurality of pixels, and each pixel has a preset brightness; based on the relationship between the gaze point and each pixel reduce the brightness of each pixel by the distance between them; determine a gaze area including the gaze point on the display; obtain a plurality of specific pixels located in the gaze area from the plurality of pixels; and restore the brightness of each specific pixel to the default brightness.

Please refer to FIG. 1 , which is a schematic diagram of an electronic device and a display according to an embodiment of the present invention. In FIG. 1 , the electronic device 11 is, for example, various smart devices and/or electronic devices, and the display 12 is, for example, a screen or other display device connected to the electronic device 11 . In one embodiment, the display 12 is, for example, an external screen connected to the electronic device 11 (for example, a screen connected to a computer host). In another embodiment, the display 12 may also be a screen built into the electronic device 11 (such as the screen of a notebook computer itself), but is not limited thereto.

In FIG. 1 , the electronic device 11 includes a storage circuit 112 and a processor 114 . The storage circuit 112 is, for example, any type of fixed or removable random access memory (Random Access Memory, RAM), read-only memory (Read-Only Memory, ROM), flash memory (Flash memory), hardware disc or other similar device, or a combination of such devices, which may be used to record multiple codes or modules.

The processor 114 is coupled to the storage circuit 112 and can be a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, one or more combined digital signal processing Microprocessor, controller, microcontroller, Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), any other type of integrated circuit at the core of the processor , state machines, Advanced RISC Machine (ARM)-based processors, and the like.

In different embodiments, the display 12 may be various display devices with functions of displaying pictures/images. In the embodiment of the present invention, the display 12 is, for example, an organic light emitting diode (OLED) display with a 3D look up table (LUT) or a mini light emitting diode (Mini-LED) display, but it may not be Limited to this.

In FIG. 1 , the display 12 may have an eye tracking circuit 121 built-in. In other embodiments, the eye tracking circuit 121 may also be an eye tracking device external to the display 12 and/or the electronic device 11 , but is not limited thereto.

Please refer to FIG. 2 , which is a schematic diagram of eye tracking of the user's eyes according to an embodiment of the present invention. In FIG. 2 , the eye tracking circuit 121 may be used, for example, to perform eye tracking on the eyes 299 of the user of the display 12 to obtain the 3D coordinates of the eyes 299 . In one embodiment, the eye tracking circuit 121 may have a stereo camera, which may be used to capture images of the user's eyes 299, and may obtain the 3D coordinates of the eyes 299 by analyzing these images, but is not limited thereto.

In one embodiment, the processor 114 can obtain the 3D coordinates of the user's eyes from the eye tracking circuit 121, and convert the 3D coordinates into the user's gaze point G1 on the display 12 based on relevant conventional techniques.

In an embodiment of the present invention, the processor 114 may determine the gaze area R1 on the display 12 based on the gaze point G1, and accordingly reduce the brightness of the display area R2 other than the gaze area R1. Thereby, the power saving effect can be achieved without affecting the user's viewing of the display 12 . Relevant details will be supplemented by Figure 3 for further explanation.

In an embodiment of the present invention, the processor 114 can access the modules and program codes recorded in the storage circuit 112 to implement the display adjustment method proposed by the present invention, the details of which are described in detail below.

Please refer to FIG. 3 , which is a flow chart of a display adjustment method according to an embodiment of the present invention. The method of this embodiment can be executed by the electronic device 100 in FIG. 1 . The details of each step in FIG. 3 will be described below with reference to the components shown in FIG. 1 .

First, in step S310 , the processor 114 obtains the user's gaze point G1 on the display 12 . In embodiments of the invention, display 12 has multiple pixels. Assuming that the resolution of display 12 is WxH, there will be WxH pixels on display 12 . For example, if the resolution of display 12 is 1920x1080 (ie, W is 1920 and H is 1080), display 12 will have 1920x1080 pixels.

In embodiments of the present invention, each pixel has a preset brightness, where the preset brightness can be adjusted by a user through a control interface of the display 12 , for example. For example, the control interface of the display 12 may include a display brightness control bar, and the user can adjust the display brightness setting value of the display 12 by adjusting the display brightness control bar.

In other embodiments, the display 12 may also have a function of automatically adjusting the display brightness according to ambient light. In this case, the preset brightness of each pixel is, for example, a display brightness setting value automatically determined by the display 12 in response to the current ambient light intensity.

In embodiments of the present invention, the default brightness of each pixel is, for example, the display brightness corresponding to the display brightness setting value selected by the user, or the display brightness corresponding to the display brightness setting value automatically determined by the display 12, but it may not be limited to this.

Next, in step S320, the processor 114 decreases the brightness of each pixel based on the distance between the gaze point G1 and each pixel.

In one embodiment, for a certain pixel on the display 12, the brightness decrease amplitude of the pixel may be directly related to the distance between the pixel and the gaze point G1. In other words, the greater the distance between this pixel and the gaze point G1, the greater the magnitude of the brightness decrease of this pixel; the smaller the distance between this pixel and the gaze point G1, the smaller the magnitude of the brightness decrease of this pixel. .

In an embodiment, the display 12 may include a first pixel and a second pixel, wherein the first pixel is separated from the gaze point G1 by a first distance, and the second pixel is separated from the gaze point G1 by a second distance, and the second distance is not less than First distance. That is, the distance between the second pixel and the gaze point G1 is greater than or equal to the distance between the first pixel and the gaze point G1.

In one embodiment, when the processor 114 decreases the brightness of the first pixel and the second pixel, the processor 114 may decrease the brightness of the first pixel from the default brightness to the first brightness, and decrease the brightness of the second pixel. The brightness is reduced from the preset brightness to a second brightness, where the second brightness is not higher than the first brightness. That is, the brightness reduction amplitude of the second pixel may not be less than the brightness reduction amplitude of the first pixel.

In different embodiments, the processor 114 may use different methods to reduce the brightness of each pixel in response to different types of display 12 .

In the first embodiment, it is assumed that the display 12 is an OLED display with a 3D lookup table (ie, each pixel has the ability to emit light by itself). In this case, the processor 114 may determine the brightness adjustment factor of each pixel based on the distance between the gaze point G1 and each pixel.

Taking the first pixel as an example again, assume that the coordinates of the first pixel on the display 12 are ( , ), and the coordinates of the gaze point G1 on the display 12 are represented by ( , ). In this case, the brightness adjustment factor of the first pixel can be characterized as: Formula (1), where N is the compensation constant. In different embodiments, N can be selected as any value according to the designer's needs. In one embodiment, N is, for example, 30, but it is not limited thereto.

For other pixels on the display 12, the processor 114 can calculate corresponding brightness adjustment factors based on the above teachings, but is not limited thereto.

Afterwards, the processor 114 may reduce the brightness of each pixel based on the brightness adjustment factor of each pixel and the 3D lookup table.

In one embodiment, the processor 114 may find the first input RGB brightness combination corresponding to the first pixel in the 3D lookup table, where the first input RGB brightness combination corresponding to the first pixel may be characterized as .

Thereafter, the processor 114 based on the brightness adjustment factor of the first pixel (i.e., ) modifying the first input RGB brightness combination to the first output RGB brightness combination corresponding to the first pixel. In one embodiment, the first output RGB brightness combination corresponding to the first pixel is characterized by: Formula (2).

Next, the processor 114 may based on the first output RGB brightness combination described above (i.e., ) sets the brightness of the first pixel. In order to make the above concepts easier to understand, Figure 4 is supplemented below for illustration.

Please refer to FIG. 4 , which is a 3D search representation diagram according to an embodiment of the present invention. In Figure 4, according to the conventional use of 3D lookup tables, assuming that the input RGB brightness combination corresponding to a certain pixel A is (70, 70, 70), then its corresponding default output RGB brightness combination is, for example, (60, 60, 60). Assume that the input RGB brightness combination corresponding to a certain pixel B is (85, 90, 70), and its corresponding preset output RGB brightness combination is, for example, (75, 80, 60).

However, in the embodiment of the present invention, assume that the first input RGB brightness combination corresponding to the first pixel is (70, 70, 70) (i.e., ), the processor 114 can convert (70, 70, 70) and the corresponding Substitute into equation (2) to obtain the corresponding . In this case, the processor 114 will not set the brightness of the first pixel with (60, 60, 60) originally corresponding to (70, 70, 70) in FIG. 4, but will use the value obtained based on equation (2) Sets the brightness of the first pixel.

As another example, assume that the first input RGB brightness combination corresponding to the first pixel is (85, 90, 70) (i.e., ), the processor 114 can convert (85, 90, 70) and the corresponding Substitute into equation (2) to obtain the corresponding . In this case, the processor 114 will not set the brightness of the first pixel with (75, 80, 60) originally corresponding to (85, 90, 70) in FIG. 4, but will use the value obtained based on equation (2) Sets the brightness of the first pixel.

In an embodiment of the present invention, the processor 114 can calculate the corresponding value of each pixel in the display 12 based on the above teachings. , and set the brightness of each pixel accordingly. In this way, the effect of reducing the brightness of each pixel in the display 12 can be achieved, but it is not limited to this.

In the second embodiment, it is assumed that the display 12 is a Mini-LED display (that is, each pixel does not have the ability to emit light by itself and needs to emit light through the backlight module corresponding to each pixel). In this case, the processor 114 may determine a backlight adjustment factor for each pixel based on the distance between the gaze point G1 and each pixel.

Taking the first pixel as an example again, assume that the coordinates of the first pixel on the display 12 are ( , ), and the coordinates of the gaze point G1 on the display 12 are represented by ( , ). In this case, the backlight adjustment factor of the first pixel is characterized as: Formula (3), but it is not limited to this.

For other pixels on the display 12, the processor 114 can calculate corresponding backlight adjustment factors based on the above teachings, but is not limited thereto.

Afterwards, the processor 114 may determine the reference backlight value of each pixel based on the backlight adjustment factor of each pixel, the maximum brightness of the display 12 and the minimum brightness of the display 12 .

In an embodiment, the reference backlight value of the first pixel can be characterized as: Formula (4), where BMin is the minimum brightness of the display 12 and BMax is the maximum brightness of the display 12.

In an embodiment of the present invention, the processor 114 can calculate the reference backlight value corresponding to each pixel in the display 12 based on the above teachings. In addition, since the content of equation (4) involves logarithmic operations, the brightness of each pixel can be reduced to provide a less dazzling visual experience.

Afterwards, the processor 114 may reduce the backlight intensity of each pixel from the preset backlight value corresponding to the preset brightness to the corresponding reference backlight value. In the second embodiment, the processor 114 may, for example, control the backlight module corresponding to each pixel to change from emitting light corresponding to the preset brightness to emitting light corresponding to the reference backlight value of each pixel. In this way, the effect of reducing the brightness of each pixel in the display 12 can be achieved, but it is not limited to this.

Please refer to FIGS. 2 and 3 again. After reducing the brightness of each pixel through step S320, the processor 114 executes step S330 to determine the gaze area R1 including the gaze point G1 on the display 12. In one embodiment, the processor 114 may expand outward from the center of the gaze point G1 to form a geometric area as the gaze area R1.

In FIG. 2 , the geometric area is, for example, a rectangular area with a fixed height (indicated by H1 ) and a fixed width (indicated by W1 ). In this case, the coordinates of the upper left corner of the gaze area R1 can be characterized as ( -0.5*W1, +0.5*H1), the coordinates of the upper right corner of the gaze area R1 can be characterized as ( +0.5*W1, +0.5*H1), the coordinates of the lower left corner of the gaze area R1 can be characterized as ( -0.5*W1, -0.5*H1), the coordinates of the lower right corner of the gaze area R1 can be characterized as ( +0.5*W1, -0.5*H1), but not limited to this.

In other embodiments, the gaze area R1 can be adjusted to any size/shape according to the designer's needs. In addition, when the gaze point G1 is closer to the edge of the display 12 so that the gaze area R1 cannot be presented in the manner of FIG. 2 , the processor 114 can reduce the size of the gaze region R1 accordingly, but it is not limited thereto.

Next, in step S340, the processor 114 obtains a plurality of specific pixels located in the attention area R1 from the plurality of pixels. In one embodiment, the processor 114 may regard all pixels located in the gaze area R1 on the display 12 as belonging to the above-mentioned specific pixels, but it is not limited thereto.

In step S350, the processor 114 restores the brightness of each specific pixel to a preset brightness. That is, although the brightness of each specific pixel has been reduced from the default brightness in step S320, the processor 114 restores the brightness of each specific pixel (ie, the pixel located in the attention area R1) to the preset brightness in step S350. Set brightness. In this way, the user can still clearly see the display screen located in the attention area R1. In addition, since the display area R2 located outside the attention area R1 has been adjusted to a lower brightness, the power saving effect can be achieved.

In the first embodiment (ie, the display 12 is an OLED display), when performing step S350 on one of the above specific pixels (hereinafter referred to as the first specific pixel), the processor 114 may be configured to: find in the 3D lookup table. Obtain a second input RGB brightness combination corresponding to the first specific pixel; obtain a preset output brightness combination corresponding to the second input RGB brightness combination; set the brightness of the first specific pixel based on the preset output brightness combination.

Taking FIG. 4 as an example again, assuming that the second input RGB brightness combination corresponding to the first specific pixel is (70, 70, 70), the processor 114 finds the preset output brightness corresponding to (70, 70, 70) Combinations, such as (60, 60, 60). Afterwards, the processor 114 can then set the brightness of the first specific pixel according to the preset output brightness combination. That is, for each specific pixel located in the attention area R1, the processor 114 can directly set the brightness of each specific pixel based on the 3D lookup table of FIG. 4, but it is not limited to this.

In the second embodiment, the processor 114 can, for example, control the backlight module corresponding to each specific pixel to change from emitting light corresponding to the reference backlight value to emitting light corresponding to the preset brightness of each specific pixel, so as to restore each specific pixel. brightness, but may not be limited to this.

Please refer to FIG. 5 , which is an application scenario diagram according to an embodiment of the present invention. In FIG. 5 , the gaze area R1 will move as the user's gaze point G1 on the display 12 moves. Through the method proposed in the present invention, the display 12 can maintain the brightness within the gaze area R1 and reduce the brightness of the display area outside the gaze area R1. Thereby, the power saving effect can be achieved without affecting the user's viewing of the display 12 .

In summary, embodiments of the present invention can reduce the brightness of each pixel on the display after determining the user's gaze point on the display. Afterwards, embodiments of the present invention can determine the user's gaze area on the display and restore the brightness of the pixels located in the gaze area to the corresponding default brightness. In this way, the user can still clearly see the display screen located in the gaze area. In addition, since the display area located outside the gaze area has been adjusted to a lower brightness, the effect of power saving can be achieved.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

100: Electronic devices 11: Electronic devices 112:Storage circuit 114: Processor 12:Display 121: Eye tracking circuit 299:eyes G1: fixation point R1: Gaze area S310~S360: steps

FIG. 1 is a schematic diagram of an electronic device and a display according to an embodiment of the invention. FIG. 2 is a schematic diagram of eye tracking on both eyes of a user according to an embodiment of the present invention. FIG. 3 is a flow chart of a display adjustment method according to an embodiment of the present invention. FIG. 4 is a 3D search representation diagram according to an embodiment of the present invention. FIG. 5 is an application scenario diagram according to an embodiment of the present invention.

S310~S360: steps

Claims (11)

A display adjustment method, suitable for an electronic device, including: Obtaining a gaze point of a user on a display, wherein the display includes a plurality of pixels, and each pixel has a preset brightness; Reduce the brightness of each pixel based on the distance between the gaze point and each pixel; determining a gaze area on the display that includes the gaze point; Obtain a plurality of specific pixels located within the gaze area from the pixels; and The brightness of each specific pixel is restored to the default brightness. The method of claim 1, wherein the pixels include a first pixel and a second pixel, the first pixel is a first distance away from the gaze point, and the second pixel is a second distance away from the gaze point. distance, the second distance is not less than the first distance, and the step of reducing the brightness of each pixel based on the distance between the gaze point and each pixel includes: The brightness of the first pixel is reduced from the preset brightness to a first brightness, and the brightness of the second pixel is reduced from the preset brightness to a second brightness, wherein the second brightness is not higher than the First brightness. The method of claim 1, wherein the display is an organic light-emitting diode display with a 3D lookup table, and the step of reducing the brightness of each pixel based on the distance between the gaze point and each pixel include: Determine a brightness adjustment factor for each pixel based on the distance between the gaze point and each pixel; The brightness of each pixel is reduced based on the brightness adjustment factor of each pixel and the 3D lookup table. The method of claim 3, wherein the pixels include a first pixel, and the coordinates of the gaze point on the display are represented by ( , ), the coordinates of the first pixel on the display are represented by ( , ), and the brightness adjustment factor of the first pixel is represented by: Where W is the width of the display, H is the height of the display, and N is the compensation constant. The method of claim 4, wherein the 3D lookup table records a plurality of input RGB brightness combinations, and the step of reducing the brightness of each pixel based on the brightness adjustment factor of each pixel and the 3D lookup table includes: Find a first input RGB brightness combination corresponding to the first pixel in the 3D lookup table; Modify the first input RGB brightness combination to a first output RGB brightness combination corresponding to the first pixel based on the brightness adjustment factor of the first pixel; The brightness of the first pixel is set based on the first output RGB brightness combination. The method of claim 5, wherein the first input RGB brightness combination corresponding to the first pixel is characterized by , the first output RGB brightness combination corresponding to the first pixel is characterized by: . The method of claim 5, wherein the specific pixels include a first specific pixel, and the step of restoring the brightness of each specific pixel to the preset brightness includes: Find a second input RGB brightness combination corresponding to the first specific pixel in the 3D lookup table; Obtain a preset output brightness combination corresponding to the second input RGB brightness combination; The brightness of the first specific pixel is set based on the preset output brightness combination. The method of claim 1, wherein the display is a mini-LED display, and the step of reducing the brightness of each pixel based on the distance between the gaze point and each pixel includes: Determine a backlight adjustment factor for each pixel based on the distance between the gaze point and each pixel; Determine a reference backlight value for each pixel based on the backlight adjustment factor of each pixel, the maximum brightness of the display, and the minimum brightness of the display; A backlight intensity of each pixel is reduced from a preset backlight value corresponding to the preset brightness to the corresponding reference backlight value. The method of claim 8, wherein the pixels include a first pixel, and the coordinates of the gaze point on the display are represented by ( , ), the coordinates of the first pixel on the display are represented by ( , ), and the backlight adjustment factor of the first pixel is represented by: , where W is the width of the display and H is the height of the display. The method of claim 9, wherein the reference backlight value of the first pixel is characterized by: , where BMin is the minimum brightness of the display, and BMax is the maximum brightness of the display. An electronic device including: a storage circuit that stores a program code; A processor coupled to the storage circuit and accessing the program code to execute: Obtaining a gaze point of a user on a display, wherein the display includes a plurality of pixels, and each pixel has a preset brightness; Reduce the brightness of each pixel based on the distance between the gaze point and each pixel; determining a gaze area on the display that includes the gaze point; Obtain a plurality of specific pixels located within the gaze area from the pixels; and The brightness of each specific pixel is restored to the default brightness.

Images