TW202322607A - Method of performing color calibration and color calibration system - Google Patents

Abstract

A color calibration system includes a mobile device and a display device. The display device is configured to detect the eye location of a user and calculate a recommended location of the mobile device. The mobile device is configured to capture a test image displayed on the screen of the display device, and a first image parameter of the captured image is acquired by analyzing the captured image. The display device is configured to adjust the display setting of its screen when determining that the first image parameter does not conform to a second image parameter of the test image.

Description

Color correction method and color correction system

The present invention relates to a color correction method and a color correction system, in particular to a method of using a portable device to perform color correction on a display device and a related color correction system.

With the advancement of technology, various displays have been widely used by users, such as backlit displays, direct-lit displays, or side-illuminated displays. As the pixel array density of the display becomes higher and higher, the display can also be used to display higher and higher resolution images. When the display is displaying images, due to differences in production processes or component aging after long-term use, the display images may experience color shifts, such as hue shifts, white balance shifts, or color brightness shifts, etc. . These color shifts often result in unpleasing or distorted hair colors, which affect the user's viewing experience.

When the color shift occurs on the display, the easiest solution is for the user to directly turn on the On Screen Display (OSD) function of the display and manually adjust various parameters of the display. The method of displaying the picture is rather time-consuming and imprecise. For display devices with built-in color calibration function, users can also use the color calibration tool to select patterns with different settings according to their own preferences and environment, and then perform manual color calibration. However, this method will have more errors. Another commonly used solution is to use a professional screen color calibrator, most of which connect the monitor and the screen color calibrator equipped with photosensitive elements through a universal serial bus (Universal Serial Bus, USB), and then match it with appropriate software or The program can calibrate the display based on the data measured by the screen color calibrator, but the cost of professional screen color calibrator is too high.

The present invention provides a method for color correction of a display device using a portable device, which includes a display device detecting the position of a user's eyes, and calculating and placing a portable device according to the position of the user's eyes a suggested location of the portable device; instruct the user to place the portable device at the suggested location; the display device displays a test picture on a screen; the portable device shoots the test picture; analyzes the portable a shooting frame captured by the formula device to obtain a first image parameter of the shooting frame; Screen display settings.

The present invention further provides a color calibration system, which includes a portable device and a display device. The portable device is installed with a first color correction application program, and includes a correction photosensitive element and a first processor. The display device is installed with a second color correction application program, and includes a screen, an image capturing component, and a second processor. The calibration photosensitive element is used to capture a test frame to provide a shooting frame, and the first processor is used to control the operation of the portable device. The screen is used to display the test image, and the image capture device is used to detect the position of a user's eyes. The second processor is used to execute the second color correction application to calculate a suggested position according to the position of the user's eyes, instruct the user to place the portable device at the suggested position, and analyze the captured image Obtaining a first image parameter of the shooting frame, judging whether the first image parameter meets a predetermined standard according to a second image parameter of the test frame, and determining whether the first image parameter does not meet a predetermined standard based on the second image parameter Adjust the display setting of the screen when the predetermined standard is met.

FIG. 1 is a schematic diagram of a color correction system 10 in an embodiment of the present invention. The color calibration system 10 includes a portable device 100 and a display device 200 , wherein the portable device 100 can be used as a color calibration tool for the display device 200 . The portable device 100 can capture the test picture displayed on the display device 200, and then send back the information of the relevant captured picture to the display device 200 for analysis, so that the display device 200 can adjust its own display settings according to the analysis result.

In the embodiment of the present invention, the portable device 100 can be a smart phone, a tablet computer, a personal digital assistant, a handheld game console, or any electronic device with communication and image capture functions. The display device 200 can be a notebook computer, a desktop computer, a smart TV, a workstation, or any electronic device with communication and display functions. However, the types of the portable device 100 and the display device 200 do not limit the scope of the present invention.

FIG. 2 is a functional block diagram of a color correction system 100 in an embodiment of the present invention. The portable device 100 includes a processor 110 , a screen 120 , a communication module 130 , a storage element 140 , and a calibration photosensitive element 150 . The display device 200 includes a processor 210 , a screen 220 , a communication module 230 , a storage unit 240 , and an image capture unit 250 .

In the present invention, the processor 110 is responsible for the overall operation of the portable device 100 . In one embodiment, the processor 110 may include a central processing unit (central processing unit, CPU), a programmable general-purpose or special-purpose microprocessor (microprocessor), a digital signal processor (digital signal processor, DSP) , programmable controller, application specific integrated circuits (ASIC), programmable logic device (PLD), other similar devices, or any combination of the above devices. However, the implementation of the processor 110 does not limit the scope of the present invention.

In the present invention, the processor 210 is responsible for the overall operation of the display device 200 . In one embodiment, the processor 210 can be implemented as a single system chip that integrates multiple functions, such as a tuner, a demodulator, an analog-to-digital signal converter (ADC), and a digital-to-analog signal converter. (DAC), phase-locked loop (PLL), video decoding (video decoding), de-interlacing scanning (de-Interlacing), video zooming (scalar) and multiple functions in any combination of OSD, and then control each component in the display device 200 operation. However, the implementation of the processor 210 does not limit the scope of the present invention.

In the present invention, the screens 120 and 220 can be liquid crystal displays (liquid crystal display, LCD), light-emitting diodes (light-emitting diode, LED) or organic light-emitting diodes (organic light-emitting diode, OLED), etc. type of display screen. However, the types of the display screens 120 and 220 do not limit the scope of the present invention.

In the present invention, the portable device 100 can communicate with the communication module 230 of the display device 200 through the communication module 130 . The communication modules 130 and 230 can be modules of any wired or wireless interface compatible with each other. In an embodiment, the communication modules 130 and 230 can use a wired communication interface, such as a cable, a universal serial bus (USB), a thunderbolt (thunderbolt), a controller area network (controller area network, CAN), a proposed standard (RS)232 interface, recommended standard 422 interface, universal asynchronous receiver/transmitter (UART), or serial peripheral interface (serial peripheral interface bus, SPI) and other wired communication interfaces. In another embodiment, the communication modules 130 and 230 can use wireless communication interfaces, such as wireless sensor networks such as EnOcean/Bluetooth/ZigBee, 2G/3G/Long Term Evolution (LTE) )/5G and other cellular networks, wireless local area networks (WLAN)/worldwide interoperability for microwave connectivity (WiMAX) and other wireless local area networks, radio frequency identification (RFID)/near field communication (NFC) and other short-distance point-to-point communications, or wireless Fidelity network (Wireless Fidelity, WiFi) and other wireless communication interfaces. However, the communication interfaces adopted by the communication modules 130 and 230 do not limit the scope of the present invention.

In the present invention, the storage elements 140 and 240 are respectively used to store data and settings required for the operation of the portable device 100 and the display device 200 , and to store data obtained during operation. In one embodiment, the storage element 140 can be fixed or removable random access memory (random access memory, RAM), read-only memory (read-only memory, ROM), flash memory (flash), Any form of hard disk, or any combination of the above. In one embodiment, the storage element 240 may be a read-only memory (ROM), flash memory, any form of hard disk, or any combination of the above devices. However, the types or implementations of the storage elements 140 and 240 do not limit the scope of the present invention.

In the present invention, the calibration photosensitive element 150 of the portable device 100 can capture the test image displayed on the display device 200 during the color calibration process, so as to obtain the optical sensing data of the test image. In one embodiment, the calibration photosensitive element 150 may include an image capture device and an ambient light sensor (ambient light sensor, ALS), wherein the image capture device is used to obtain an RGB image corresponding to the test image, and the ambient light sensor The detector is used to obtain the brightness value corresponding to the test image. However, the implementation of the calibration photosensitive element 150 does not limit the scope of the present invention.

In the present invention, the image capture unit 250 of the display device 200 can be a depth camera based on stereo vision technology, which uses multiple cameras to capture the color image and depth image of the scene, and then uses intensive calculations and calculations The three-dimensional information of the scene space is obtained by the method. However, the implementation of the image capture device 250 does not limit the scope of the present invention.

Fig. 3 is a flow chart of the color correction system 10 in the embodiment of the present invention when performing color correction operation, which includes the following steps:

Step 310: Install a color correction application (APP) on the portable device 100 and the display device 200 respectively.

Step 320: The portable device 100 and the display device 200 open the color calibration application and activate the setting function, and then execute a color calibration setting procedure.

Step 330: The portable device 100 and the display device 200 open the color correction application and activate the color correction function.

Step 340: The user selects a color mode or loads a color setting through the portable device 100 .

Step 350: The display device 200 prompts the user to maintain the viewing posture through the color correction application, and waits for the user to confirm.

Step 360: After the user confirms that the viewing posture has been maintained, the display device 200 activates the image capture unit 250 to detect the position of the user's eyes.

Step 370: The display device 200 calculates a suggested position for placing the portable device 100 according to the position of the user's eyes, and instructs the user to move the portable device 100 to the suggested position.

Step 380: Determine whether the display device 200 and the portable device 100 are connected? If yes, go to step 400; if not, go to step 390.

Step 390: The display device 200 asks the user whether to perform color calibration in offline mode? If yes, go to step 500; if not, go to step 380.

Step 400: Execute real-time color correction procedure in online mode.

Step 500: Execute off-time color correction procedure in offline mode.

In step 310 , the portable device 100 and the display device 200 install color correction applications respectively. Since different types of portable devices 100 have different settings, before starting the color calibration function for the first time, the portable device 100 and the display device 200 will execute the color calibration setting procedure through the color calibration application in step 320 . In the present invention, the above-mentioned color calibration setting procedure includes obtaining the photography parameters of the portable device 100, connecting the portable device 100 and the display device 200, and carrying out the portable device 100 and the display device 200 according to the portable device 100 The photographic parameters are used for pairing. In one embodiment, the portable device 100 executes a color correction application to detect the model of the portable device 100 , and then downloads corresponding photographic parameters from the Internet according to the model of the portable device 100 . In another embodiment, the user can manually input the photography parameters of the portable device 100 . The above photographic parameters include parameters such as white balance (AWB), sensitivity (ISO), focus (AF), exposure compensation (EV) or shutter speed (S), but do not limit the scope of the present invention.

In one embodiment of the color calibration setting program of the present invention, the portable device 100 and the display device 200 can be connected through a wired communication interface, such as through a cable, USB, Thunderbolt, CAN, RS232 interface, RS422 interface, UART , SPI to connect. In another embodiment of the calibration setting program of the present invention, the portable device 100 and the display device 200 can be connected through a wireless communication interface, such as wireless sensor networks such as EnOcean/Bluetooth/ZigBee, 2G/3G/ Cellular networks such as LTE/5G, wireless area networks such as WLAN/WiMAX, short-distance point-to-point communications such as RFID/NFC, or wireless communication interfaces such as WiFi for connection. However, the connection method between the portable device 100 and the display device 200 does not limit the scope of the present invention.

In step 330, the portable device 100 and the display device 200 open the color correction application and activate the color correction function, so as to execute the color correction procedure in steps 340-500.

In step 340 , the user can select a color mode or load a color setting through the portable device 100 . The color mode may be related to screen brightness, color temperature, color gamut, hue and saturation, and different types of portable devices 100 may have different color modes or color settings.

In step 350 , the display device 200 prompts the user to maintain the viewing posture through the color correction application, and waits for the user to confirm. In one embodiment, the display device 200 may display a text prompt message on the screen 220, or send an audio prompt message through a speaker. However, the manner in which the display device 200 provides prompt information does not limit the scope of the present invention.

In step 360 , after the user confirms that the viewing posture has been maintained, the display device 200 activates the image capture unit 250 to detect the position of the user's eyes. Then in step 370 , the display device 200 calculates a suggested position for placing the portable device 100 according to the position of the user's eyes, and instructs the user to move the portable device 100 to the suggested position. Due to the differences in the physical structure and usage habits of different users, the height of the eyes and the distance from the screen 220 will also be different, so the angle at which the light of the display device 200 enters the human eyes will also change to varying degrees accordingly, making the user The perceived display content will vary to varying degrees. In steps 360 and 370, the present invention calculates the most suitable recommended position for placing the portable device 100 according to the characteristics of each user, so that the image captured by the portable device 100 can best reflect the The user's binocular field of view. In one embodiment, the suggested position for placing the portable device 100 may be the position of the eyes of the user in step 350 . In another embodiment, the suggested position for placing the portable device 100 may be a specific position having a specific relationship with the position of the user's eyes, for example, a specific position between the user's eyes and the screen 220 of the display device 200 . The above-mentioned specific relationship will be considered in the subsequent image analysis process, thereby simulating the binocular field of view of the user.

In step 380 , the present invention determines whether the display device 200 and the portable device 100 are connected. When it is determined in step 380 that the display device 200 and the portable device 100 are connected, the present invention will execute step 400 to perform color correction in the connected mode. When it is determined in step 380 that the display device 200 and the portable device 100 are not connected, and it is learned in step 390 that the user wants to perform color correction in the offline mode, the present invention will execute step 500 to perform color correction in the offline mode. Make color corrections.

FIG. 4 is a flow chart of the color correction system 10 in the embodiment of the present invention executing the real-time color correction procedure in the connection mode, which includes the following steps:

Step 410: The portable device 100 guides the user to adjust its placement position.

Step 420: The color correction application program of the display device 200 judges whether the portable device 100 has been placed in the suggested position through the image capture unit 250? If yes, go to step 430 ; if not, go to step 410 .

Step 430: The display device 200 informs that the portable device 100 has been placed at the suggested position, and determines whether the user returns a corresponding confirmation message? If yes, go to step 440 ; if not, go to step 430 .

Step 440: The portable device 100 captures the test frame IMG displayed on the screen 220 by the display device 200, and then sends back one or more captured frames IMG' to the display device 200.

Step 450: The display device 200 analyzes one or more images IMG' and determines whether its image parameters meet a predetermined standard? If yes, go to step 470 ; if not, go to step 460 .

Step 460: The display device 200 adjusts the image parameters of the screen 220 according to the image analysis result; execute step 440.

Step 470: End the in-line color correction procedure.

Fig. 5 is a flow chart of the color correction system 10 in the embodiment of the present invention executing the offline color correction program in the offline mode, which includes the following steps:

Step 510: The display device 200 guides the user to adjust the placement position of the portable device 100 .

Step 520: The color correction application program of the display device 200 judges whether the portable device 100 has been placed in the suggested position through the image capture unit 250? If yes, go to step 530 ; if not, go to step 520 .

Step 530: The display device 200 informs that the portable device 100 has been placed at the suggested position, and determines whether the user returns a corresponding confirmation message? If yes, go to step 540 ; if not, go to step 530 .

Step 540: The portable device 100 captures the test frame IMG displayed on the screen 220 by the display device 200, and then the user inputs the image parameters of one or more captured frames IMG' to the display device 200.

Step 550: The display device 200 determines whether the image parameters of one or more frames IMG' meet a predetermined standard? If yes, go to step 570; if not, go to step 560.

Step 560: The display device 200 adjusts the display settings of the screen 220 according to the result of the screen analysis; execute step 540.

Step 570: End the offline color correction procedure.

In step 410 of the online color calibration procedure, the portable device 100 guides the user to adjust its placement through the color calibration application. In one embodiment, the portable device 100 can display a text guide message or a graphic guide message on the screen 120, through augmented reality (augmented reality, AR) technology, or send an audio guide message through a speaker to inform the user The direction or distance to move. However, the manner in which the portable device 100 guides the user to adjust its placement does not limit the scope of the present invention.

In step 510 of the offline color calibration procedure, the display device 200 guides the user to adjust the placement position of the portable device 100 through the color calibration application program. In one embodiment, the display device 200 may display a text guide message or a graphic guide message on the screen 220 , or send an audio guide message through a speaker to inform the user of the direction or distance in which the portable device 100 needs to be moved. However, the manner in which the display device 200 guides the user to adjust the position of the portable device 100 does not limit the scope of the present invention.

In step 420 of the online color correction procedure and step 520 of the offline color correction procedure, when the color correction application program of the display device 200 judges that the portable device 100 has not been placed in the recommended position through the image captured by the image capture device 250 , steps 410 and 510 will be executed again to guide the user to adjust the placement position of the portable device 100 .

In the step 430 of the online color calibration procedure and the step 530 of the offline color calibration procedure, the display device 200 will notify that the portable device 100 has been placed in the suggested position, and wait for the user to confirm. When receiving the confirmation message sent back by the user, the color calibration system 10 can start to execute the color calibration procedure in the online mode or the offline mode.

In step 440 of the online color calibration procedure, the portable device 100 will capture the test frame IMG displayed on the screen 220 by the display device 200, and then return one or more captured frames IMG' to the Display device 200. In step 450, the display device 200 analyzes one or more shooting frames IMG' through the color correction application program to obtain its image parameters, and then compares them with the image parameters of the test frame IMG to determine whether it meets the predetermined standard. In one embodiment, the display device 200 analyzes one or more captured images IMG' through a color correction application program to obtain one or more image parameters such as brightness, color temperature, color gamut, hue, and saturation. If the difference between one or more image parameters of the shooting frame IMG' and one or more image parameters of the test frame IMG is not greater than a predetermined value, it can be determined that the image parameters of one or more shooting frames IMG' meet the predetermined value. standard. That is to say, at this time, the image characteristics captured by the portable device 100 simulating the user's binocular field of vision conform to the image characteristics that the display device 200 wants to present, so then step 470 is executed to end the in-line color calibration process.

In step 540 of the offline color calibration procedure, the portable device 100 will capture the test frame IMG displayed on the screen 220 by the display device 200, and then the user will capture one or more captured frames IMG' The image parameters are input to the display device 200 . In step 550, the display device 200 judges whether the image parameters of one or more shooting frames IMG' meet predetermined standards. In one embodiment, the portable device 100 analyzes one or more captured images IMG' through a color correction application to obtain one or more image parameters such as brightness, color temperature, color gamut, hue, and saturation, and then The above one or more image parameters are input to the display device 200 by the user. The display device 200 compares one or more image parameters input by the user with the image parameters of the test image IMG through the color calibration application program to determine whether it meets the predetermined standard. If the difference between one or more image parameters of the shooting frame IMG' and one or more image parameters of the test frame IMG is not greater than a predetermined value, the display device 200 can determine one or more image parameters of the shooting frame IMG' Meet predetermined standards. That is to say, at this moment, the image characteristics captured by the portable device 100 simulating the user's binocular field of vision conform to the image characteristics that the display device 200 wants to present, so then step 570 is executed to end the offline color correction process.

If the display device 200 determines in step 450 or 550 that the image parameters of one or more captured frames IMG' do not meet the predetermined standards, it means that the image characteristics captured by the portable device 100 simulating the user's binocular field of view do not meet the requirements. The display device 200 wants to display the image characteristics. At this time, the display device 200 will adjust the display settings of the screen 220 according to the image analysis result in step 460 or 560, and then execute step 440 or 540 again to verify the color calibration effect.

In one embodiment, the display device 200 can set the adjustment target of the display panel 220 through a color correction application program, such as setting RGB three points in a color space, a gamma curve or a color response. For example, when the R value of the test image IMG is 32, the display settings of the display panel 220 must be adjusted (for example, adjust the RGB gain value) until the R value of the captured image IMG' captured by the portable device 100 is also 32. By analogy, the display device 200 can adjust the display settings of the display panel 220 through the calibration application program of the portable device 100 until the G value, B value, Y value (brightness), and U value of the image IMG' and the test image IMG Display parameters such as (chromaticity), V (chromaticity), gamma curve or color response coincide with each other.

To sum up, the present invention provides a method of using a portable device to perform color correction on a display device and a related color correction system. First, according to the characteristics of each user, the most suitable suggestion for the placement of the portable device is calculated. position, and then the portable device shoots the test picture displayed on the display device, so that the image captured by the portable device can best reflect the user's binocular vision. Then, the display device will analyze the image parameters of the shooting picture and adjust the display settings of the screen accordingly until the image parameters of the shooting picture and the test picture match each other. The user can use the portable device to perform accurate color calibration on the display device in the connection mode or the offline mode, without needing to purchase an additional screen color calibrator dedicated to the display device, which improves the convenience. The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the scope of the patent application of the present invention shall fall within the scope of the present invention.

10: Color correction system 100: Portable device 200: display device 110, 210: Processor 120, 220: screen 130, 230: communication module 140, 240: storage element 150:Correct photosensitive element 250: image capture component 310-390, 400-470, 500-570: steps

Fig. 1 is a schematic diagram of a color correction system in an embodiment of the present invention. Fig. 2 is a functional block diagram of the color correction system in the embodiment of the present invention. Fig. 3 is a flow chart of the color correction system in the embodiment of the present invention when it performs color correction operation. FIG. 4 is a flow chart of the color calibration system executing the color calibration program in the connection mode in the embodiment of the present invention. FIG. 5 is a flow chart of the color calibration system executing the color calibration program in offline mode in the embodiment of the present invention.

310-500: Steps

Claims (10)

A method of color calibrating a display device using a portable device, comprising: A display device detects a user's binocular position, and calculates a suggested position for placing a portable device according to the user's binocular position; instruct the user to place the portable device at the proposed location; The display device displays a test pattern on a screen; the portable device captures the test frame; analyzing a shooting frame captured by the portable device to obtain a first image parameter of the shooting frame; and When it is determined according to a second image parameter of the test frame that the first image parameter does not meet a predetermined standard, the display device adjusts the display setting of the screen. The method for performing color correction as described in claim 1, further comprising: When it is determined that the display device and the portable device have been connected, the portable device guides the user to adjust the placement of the portable device until it is confirmed that the portable device has been placed on the suggested Location; the portable device sends back the captured image to the display device; and The display device analyzes the shooting frame to obtain the first image parameter. The method for performing color correction as described in claim 1, further comprising: When it is determined that the display device and the portable device are not connected, the display device guides the user to adjust the placement position of the portable device until it is confirmed that the portable device has been placed at the suggested position ; The portable device analyzes the shot frame to obtain the first image parameter; and The user inputs the first image parameter into the display device. The method for performing color correction as described in any one of claims 2-3, further comprising: The display device determines whether the difference between the first image parameter and the second image parameter is greater than a predetermined value; and When the difference between the first image parameter and the second image parameter is greater than the predetermined value, it is determined that the first image parameter does not meet the predetermined standard. The method for performing color correction as described in Claim 4, wherein the first image parameter is the brightness or saturation of the captured image, and the second image parameter is the brightness or saturation of the test image. The method for performing color correction as described in claim 1, further comprising: When determining that the first image parameter does not meet the predetermined standard, the display device adjusts the brightness or chroma of the screen. A color correction system comprising: A portable device, which installs a first color correction application program, and includes: a calibration photosensitive element, used to capture a test frame to provide a shooting frame; and a first processor for controlling the operation of the portable device; and A display device, which installs a second color correction application program, and includes: a screen for displaying the test pattern; An image capture device for detecting the position of a user's eyes; A second processor for executing the second color correction application to: Calculate a suggested position based on the position of the user's eyes; instruct the user to place the portable device at the proposed location; analyzing the shooting frame to obtain a first image parameter of the shooting frame; judging whether the first image parameter meets a predetermined standard according to a second image parameter of the test frame; and When it is determined according to the second image parameter that the first image parameter does not meet the predetermined standard, the display setting of the screen is adjusted. The color correction system as described in claim 7, wherein the first processor is further used to execute the first color correction application to control the portable device when it is determined that the display device and the portable device are connected. The device guides the user to adjust the placement position of the portable device until it is confirmed that the portable device has been placed at the suggested position, and returns the shooting picture to the display device. The color correction system as claimed in item 7, wherein: The second processor is also used to execute the second color correction application program to control the display device to guide the user to adjust the portable device when it is determined that the display device and the portable device are not connected. placement until it is confirmed that the portable device has been placed at the suggested location; and The first processor is further used to execute the first color correction application program to analyze the captured image, and then obtain the first image parameter. The color correction system as described in any one of claims 8-9, wherein the second processor is further configured to receive the first image parameter input by the user, and execute the second color correction application program to determine the Whether the difference between the first image parameter and the second image parameter is greater than a predetermined value, and when the difference between the first image parameter and the second image parameter is greater than the predetermined value, it is determined that the first image parameter does not meet the the predetermined standard.

Images