WO2022050641A1 - Electronic device that performs color temperature calibration and operating method therefor - Google Patents

Abstract

An electronic device comprises: a first display; a second display; a memory that stores a first white value of the first display and a second white value of the second display, and a processor operatively coupled to the first display, the second display, and the memory, wherein the memory, when executed, may cause the processor to obtain the first white value and the second white value from the memory, generate a first transformation matrix on the basis of the first white value and the second white value, and perform color temperature calibration of the first display on the basis of the first transformation matrix and a 1-dimension look up table (1DLUT). Various other embodiments identified through the specification are possible.

Description

Electronic device for performing color temperature correction and method for operating the same

This document relates to an electronic device and method for performing color temperature correction.

BACKGROUND Electronic devices including two or more displays (eg, liquid crystal displays (LCDs)) are widely used. The displays included in the electronic device may have different color temperature characteristics due to process variations. When a color temperature deviation between two or more displays appears, the user may feel a sense of difference, which may lead to inconvenience of use. An effective color temperature correction method can be devised to reduce the color temperature deviation between displays.

Conventionally, in order to resolve a color temperature deviation between displays of an electronic device including two or more displays, a display having a similar color temperature characteristic is selected in a process step, and then color temperature correction is performed. After color temperature correction, the color temperature deviation was resolved through LCD firmware update.

However, in order to produce an LCD having similar color temperature characteristics in the process step, it is necessary to adjust the production yield, which may cause an increase in cost. In addition, in the case of a general display (eg, LCD), firmware update may not be possible, and even if the firmware update is possible, if the firmware update fails, the display must be discarded, which may cause cost problems.

An electronic device according to an embodiment disclosed herein includes a first display, a second display, and a memory in which a first white value of the first display and a second white value of the second display are stored. and a processor operatively coupled with the first display, the second display, and the memory, wherein the memory, when executed, causes the processor to: receive the first white value and the second white value from the memory; obtain, generate a first transformation matrix based on the first white value and the second white value, and a color for the first display based on the first transformation matrix and a 1-dimension look up table (1DLUT) Temperature calibration may be performed.

In addition, the method of operating an electronic device according to an embodiment disclosed herein includes an operation of acquiring a first white value and a second white value from a memory, and a second white value based on the first white value and the second white value. It may include generating one transformation matrix and performing color temperature calibration on the first display based on the first transformation matrix and a 1-dimension look up table (1DLUT).

According to the embodiments disclosed in this document, the electronic device may correct the color temperature deviation without damaging the display by performing color temperature correction that can be supported by most displays.

According to the embodiments disclosed in this document, the electronic device may provide display settings optimized for the user's use environment by changing the display to be subjected to color temperature correction in real time.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;

2 is a block diagram illustrating a structure of an electronic device.

3 shows color temperature calibration of the display.

4 is a flowchart illustrating color temperature correction.

5 is a flowchart illustrating the determination of the main display.

6 is a flowchart illustrating color temperature correction for each grayscale.

7 is a flowchart illustrating color temperature correction for a similar grayscale section.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram illustrating a structure of an electronic device.

According to an embodiment, the electronic device 200 (eg, 101 in FIG. 1 ) includes a processor 210 (eg, 120 in FIG. 1 ), a memory 220 (eg, 130 in FIG. 1 ), and a first display ( 230) (eg, the display module 160 of FIG. 1 ), and/or the second display 240 (eg, the display module 160 of FIG. 1 ). The configuration of the electronic device 200 illustrated in FIG. 2 is exemplary and embodiments of the present document are not limited thereto. For example, the electronic device 200 may further include a third display (eg, the display module 160 of FIG. 1 ).

The processor 210 may be operatively coupled to the memory 220 , the first display 230 , and/or the second display 240 . The processor 210 may control configurations of the electronic device 200 . For example, the processor 210 may control the configurations of the electronic device 200 according to one or more instructions stored in the memory 220 . The processor 210 may include an application processor and/or a communication processor. The processor 210 may be configured with one chip or a plurality of chips.

The memory 230 may store various data used by at least one component (eg, the processor 210 ) of the electronic device 200 . The data may include, for example, input data or output data for software (eg, the program 140 of FIG. 1 ) and commands related thereto.

The first display 230 and/or the second display 240 may visually provide information to the outside (eg, a user) of the electronic device 200 . The first display 230 and/or the second display 240 may include, for example, a control circuit for controlling the electronic device 200 . According to an embodiment, the first display 230 and/or the second display 240 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch. there is. The first display 230 and the second display 240 may be structurally connected by a housing included in the electronic device 200 . According to an example, the first display 230 and the second display 240 may be connected by one axis. The first display 230 and/or the second display 240 may rotate about one axis. As the first display 230 and/or the second display 240 rotates, the relative positions of the first display 230 and the second display 240 may change.

According to an embodiment, the processor 210 may obtain the first white value of the first display 230 and the second white value of the second display 240 from the memory 220 . The first white value and the second white value may be measured in a production process of the display. The measured first and second white values may be stored in the memory 220 of the electronic device 200 . The processor 210 performs color temperature correction to match the color temperature of the first display 230 to the color temperature of the second display 240 or vice versa based on the first white value and the second white value. can do. According to an embodiment, color temperature correction may be performed in real time according to the usage state of the electronic device 200 . For example, when the first display 230 is used as the main display, the processor 210 performs color temperature correction to match the color temperature of the second display 240 to the color temperature of the first display 230 . can be done

According to an embodiment, the electronic device 200 includes a first display 230 , a second display 240 , a first white value of the first display 230 , and a second value of the second display 240 . a memory 220 having a white value stored therein, and/or a first display 230 , a second display 240 , and a processor 210 operatively coupled with the memory 220 , the memory comprising: When executed, the processor obtains a first white value and a second white value from the memory, generates a first transformation matrix based on the first white value and the second white value, and generates the first transformation matrix and the 1DLUT(1- A color temperature calibration of the first display may be performed based on a dimension look up table. For example, components other than the diagonal component of the first transformation matrix may be set to 0, and the diagonal component may be normalized.

According to an embodiment, the memory 220 further stores information on the gray scale of the first display 230 and the information on the gray scale of the second display 240, and the instructions are provided by the processor 210, Information on the gray scale of the first display 230 and information on the gray scale of the second display 240 are acquired from the memory 220 , and information on the gray scale of the first display 230 and the second display Second transformation matrices for each gray scale are generated based on the gray scale information of 240 , and color temperature calibration for each gray scale of the first display 230 is performed based on the second transformation matrices and 1DLUT. ) can be done.

According to an embodiment, the memory 220 further stores representative values of the similar gray scale sections and the similar gray scale sections of the first display 230 and the second display 240, and the instructions are: Obtaining representative values of similar grayscale sections from the memory 220 , generating third transformation matrices for each of the similar grayscale sections based on the representative values of the similar grayscale sections, and generating third transformation matrices based on the third transformation matrices and 1DLUT 1 It is possible to perform color temperature calibration on each of the similar grayscale sections of the display 230. The instructions, by the processor 210, are interpolated with respect to a boundary value of the color temperature-corrected similar grayscale sections. (interpolation) can be performed.

According to an embodiment, the instructions, when the processor 210 determines one of the first display and the second display as the main display and the other as the sub-display, and determines that the first display is the main display, the second display It is possible to perform color temperature correction on the display. The memory 220 further stores the standard color temperature characteristic, and the instructions provide that the processor 210 is closer to the standard color temperature characteristic of the first display and the second display based on the first white value and the second white value. The display may be determined as the main display. The electronic device 200 further includes at least one sensor (eg, the sensor module 176 of FIG. 1 ), and the instructions include the processor 210 using the at least one sensor 176 to the first display ( 230) and the second display 240, a display having a contact surface with an external object (eg, a desk) of a predetermined size or greater may be checked, and a display having a contact surface with an external object greater than or equal to a predetermined size may be determined as a sub-display. The instructions may cause the processor 210 to determine a main display and a sub display in real time.

3 shows color temperature calibration of the display.

Reference numeral 300a denotes an electronic device (eg, 200 in FIG. 2 ) before color temperature correction. Referring to reference numeral 300a , the electronic device 200 may include a first display (eg, 230 in FIG. 2 ) and a second display (eg, 240 in FIG. 2 ). The first display 230 and the second display 240 may have different color temperature characteristics due to a yield deviation in the production process. For example, the color temperature of the first display 230 may be generally yellowish than the color temperature of the second display 240 . In this case, the content displayed through the first display 230 may be more yellowish than the content displayed through the second display 240 . The processor (eg, 210 of FIG. 2 ) may correct the color temperature of the first display 230 and the second display 240 in order to resolve the color temperature deviation between the displays. For example, the processor 210 may perform color temperature correction on the first display 230 to match the color temperature of the first display 230 with the color temperature of the second display 240 .

Reference numeral 300b denotes the electronic device 200 after color temperature correction is performed. The processor 210 may perform color temperature correction on the first display 230 to match the color temperature of the first display 230 with the color temperature of the second display 240 . The description of color temperature correction may be referred to with reference to FIGS. 4 to 7 . Referring to reference numeral 300b, the color temperature of the first display 230 may be understood to be the same as or similar to the color temperature of the second display 240 .

4 is a flowchart illustrating color temperature correction.

Referring to operation 400 , the processor (eg, 210 of FIG. 2 ) may obtain a first white value and a second white value from a memory (eg, 220 of FIG. 2 ). The first white value may be referred to as corresponding to the color temperature characteristic of the first display (eg, 230 in FIG. 2 ). The second white value may be referred to as corresponding to the color temperature characteristic of the second display (eg, 240 of FIG. 2 ). The white value for each display can be measured in the production process of the display. The measured white value may be stored in a memory (eg, 220 of FIG. 2 ). According to an embodiment, the first white value and the second white value may be referred to as being stored in a system basic input output system (BIOS) of the memory 220 . System BIOS can be understood as memory with low probability of data loss due to impact. For example, when the electronic device 200 is booted, the processor 210 may operate the system BIOS and obtain a first white value and a second white value from the system BIOS. Since data stored in the system BIOS cannot be deleted by a user, the system BIOS can stably store the first white value and the second white value. According to another embodiment, the first white value and the second white value are stored in an internal memory (eg, internal ROM) of the processor 210 or may be accessed only by a kernel (eg, middleware 144 of FIG. 1 ). Security of an external memory It can be stored in the (secure) area.

In operation 410 , the processor 210 may generate a first transformation matrix based on the first white value and the second white value. The processor 210 may use the following transformation matrix to generate the first transformation matrix.

0.7151	0.2849	0.0000
0.0000	1.0000	0.0000
0.0000	0.0412	0.9588

The matrix of Table 1 may be referred to as a color space calculation (CSC) matrix. The CSC matrix may be generally referred to as a transformation matrix used for changing to a different color space (eg, sRGB, DCI-P3, AdobeRGB). Each component of the CSC matrix may be determined based on the first white value and the second white value. According to an embodiment, a display or system supporting color space conversion according to the CSC matrix may be limited. For example, most displays do not support CSC matrices, and only some modern systems can support CSC matrices. Accordingly, in order to perform color temperature correction for all displays according to an embodiment, the processor 210 may generate the following CSC matrix.

0.6135	0.0000	0.0000
0.0000	0.7398	0.0000
0.0000	0.0000	1.0000

Table 2 may be referred to as a first transformation matrix for color temperature correction. The first transformation matrix (eg, Table 2) may be understood as determining that the remaining components except for the diagonal components of the CSC matrix are 0, and normalizing the diagonal components. According to an embodiment, a system supporting a CSC matrix may perform color temperature correction by mainly calculating a CSC matrix and a three-dimensional lookup table (3DLUT). However, similar to the CSC matrix, systems capable of supporting 3DLUT operation are limited, whereas 1DLUT operation can be supported by most systems. Accordingly, in an embodiment, the processor 210 may generate the first transformation matrix instead of the CSC transformation matrix for color temperature correction using 1DLUT. In operation 420 , the processor 210 sets the second display 240 to the main display. It can be determined by the display. For a description of the determination of the main display, reference may be made to the description of FIG. 5 . Operation 420 may be omitted as an optional operation.

In operation 430 , the processor 210 may perform color temperature correction on the first display 230 based on the first transformation matrix and the 1DLUT. Since operation using 1 DLUT is supported by most systems, the processor 210 may perform color temperature correction according to an embodiment in most displays.

For reference, 1DLUT and 3DLUT can be understood as a reference table that can obtain an output value after re-mapping when a specific value (eg, a white value) is input as an input value. 3DLUT can be understood as a reference table that can express more complex color changes compared to 1DLUT. Specifically, the 3DLUT can arrange colors and brightness in a three-dimensional space. Therefore, 3DLUT can represent color change and color combination in reality in more detail than 1DLUT. Using these characteristics, 3DLUT can express more complex color grades compared to 1DLUT. However, 3DLUT is provided only in some of the latest systems and has a drawback in that the amount of computation is high, whereas 1DLUT is provided in most systems and the amount of computation may be small.

The processor 210 may perform operation 430 to match the color temperature of the first display 230 to the color temperature of the second display 240 . According to an embodiment, the processor 210 may perform color temperature correction for each grayscale of the first display 230 based on one first transformation matrix and 1DLUT. For example, the gray level of the first display 230 may be referred to as a gray level of 0 to 255 (eg, 256 gray level).

5 is a flowchart illustrating the determination of the main display.

The operations of FIG. 5 may be understood as operations corresponding to operation 420 of FIG. 4 . According to an embodiment, the processor (eg, 210 of FIG. 2 ) may proceed to operation 430 of FIG. 4 after completing the operations of FIG. 5 .

Referring to operation 500 , the processor 210 may check quality information and/or usage status of the first display (eg, 230 of FIG. 2 ) and the second display (eg, 240 of FIG. 2 ). According to an embodiment, the processor 210 may compare the first white value and the second white value with a standard color temperature characteristic. The standard color temperature characteristic may be stored in a memory (eg, 220 of FIG. 2 ) of the electronic device 200 in a generation process. According to another embodiment, the processor 210 may check the use state of the electronic device 200 . For example, the processor 210 may determine which display the user uses to perform a task (eg, Photoshop). As another example, the processor 210 may determine on which display the keyboard layout is output.

In operation 510 , the processor 210 may determine whether the first display 230 is the main display. According to an embodiment, when the first white value is more similar to the standard color temperature characteristic than the second white value, the processor 210 may determine the first display 230 as the main display. According to another embodiment, when the keyboard layout is output from the second display 240 , the processor 210 may determine the first display 230 as the main display. According to another embodiment, the electronic device 200 may further include at least one sensor (eg, the sensor module 176 of FIG. 1 ). The processor 210 may check the angles formed by the first display 230 and the second display 240 using at least one sensor 176 . Also, the processor 210 may identify an area in which the display is in contact with an external object using at least one sensor 176 . For example, the first display 230 and the second display 240 form a constant angle (eg, an acute angle) about one axis, and one of the first display 230 and the second display 240 is When one surface of an external object (eg, desk) is in complete contact or the contact surface is larger than a certain size, the processor 210 determines a display having a large contact area with the external object (eg, desk) as a sub-display, and selects another display. It can be determined by the main display. According to another embodiment, when a task requiring high performance (eg, a graphic task) is performed on the first display 230 , the processor 210 may determine the first display 230 as the main display.

When the second display 240 is determined as the main display (510-NO), the processor 210 ends the operation and proceeds to operation 430 of FIG. 4 to perform color temperature correction on the first display 230 . can do.

When it is determined that the first display 230 is the main display (510 - YES), the processor 210 may proceed to operation 520 . In operation 520 , the processor 210 may perform color temperature correction on the second display 240 unlike operation 430 of FIG. 4 . The processor 210 may perform color temperature correction so that the color temperature of the second display 240 matches the color temperature of the first display 230 . In this case, the processor 210 may not proceed to operation 430 of FIG. 4 .

A display (eg, a sub-display) on which color temperature correction is performed may have grayscale loss due to color temperature correction. Accordingly, in order to preserve the image quality of the main display, the processor 210 according to an embodiment may be set to perform color temperature correction on the sub-display.

6 is a flowchart illustrating color temperature correction for each grayscale.

According to an embodiment, the operations of FIG. 6 may be understood to correspond to the operations of FIG. 4 . For example, it may be understood that operation 600 of FIG. 6 corresponds to operation 400 of FIG. 4 , operation 610 of FIG. 6 corresponds to operation 410 of FIG. 4 , and operation 620 of FIG. 6 corresponds to operation 430 of FIG. 4 .

Referring to operation 600 , the processor (eg, 210 of FIG. 2 ) receives information on the gray scale of the first display (eg, 230 of FIG. 2 ) from the memory (eg, 220 of FIG. 2 ) and the second display (eg, 230 of FIG. 2 ). Information on the gray level of 240 of FIG. 2 may be obtained. It may be understood that the information on the gray level includes a white value for each gray level (eg, 0 to 255 gray level) of each display. Information on the gray level of each display may be measured in a production process of the display. Information on the measured gray level may be stored in a memory (eg, 220 of FIG. 2 ). For example, white values for 256 gray levels of the first display 230 may be stored in the memory 220 . According to an embodiment, information on the gray level of each display may be stored in a system basic input output system (BIOS) of a memory (eg, 220 of FIG. 2 ).

In operation 610 , the processor 210 may generate second transformation matrices for each grayscale based on the grayscale information of the first display 230 and the grayscale information of the second display 240 . . The second transformation matrices may be generated, for example, for each gray level (eg, 0 to 255 gray levels). A method of generating the second transformation matrices for each grayscale may be referred to as a method of generating the first transformation matrix of FIG. 4 .

In operation 620 , the processor 210 may perform color temperature correction for each grayscale of the first display 230 based on the second transformation matrices and 1DLUT (eg, 1DLUT of FIG. 4 ). The processor 210 may perform operation 620 to match the color temperature of each gray level of the first display 230 to the color temperature of each gray level of the second display 240 .

According to an embodiment, the display may have different color temperature characteristics for each gray level. Accordingly, as shown in FIG. 6 , the processor 210 may increase the accuracy of color temperature correction by performing color temperature correction for each gray level.

7 is a flowchart illustrating color temperature correction for a similar grayscale section.

According to an embodiment, the operations of FIG. 7 may be understood to correspond to the operations of FIG. 4 . For example, it can be understood that operation 700 of FIG. 7 corresponds to operation 400 of FIG. 4 , operation 710 of FIG. 7 corresponds to operation 410 of FIG. 4 , and operation 720 of FIG. 7 corresponds to operation 430 of FIG. 4 .

Referring to operation 700 , the processor (eg, 210 of FIG. 2 ) performs a first display (eg, 230 of FIG. 2 ) and a second display (eg, 240 of FIG. 2 ) from a memory (eg, 220 of FIG. 2 ). Representative values of similar grayscale sections may be obtained. Information and representative values of similar grayscale sections may be understood as predefined values measured in a development process or a production process. Information and representative values of the measured similar grayscale sections may be stored in the memory 220 of the electronic device 200 . For example, the first display 230 and the second display 240 may exhibit similar color temperature characteristics in five sections. In this case, the display 230 and the second display 240 may have five similar grayscale sections. Accordingly, information on similar grayscale sections and five representative values may be stored in the memory 220 .

In operation 710, the processor 210 may generate third transformation matrices for each of the plurality of similar grayscale sections based on the representative value of the similar grayscale sections. A method of generating the third transformed matrices for the representative values of the respective pseudo grayscale sections may be referred to by the description of the method of generating the first transform matrix of FIG. 4 .

In operation 720 , the processor 210 may perform color temperature correction for each of the similar grayscale sections of the first display 230 based on the third transformation matrices and the 1DLUT (eg, 1DLUT of FIG. 4 ). The processor 210 may perform operation 720 to match the color temperature of the similar grayscale sections of the first display 230 to the color temperature of the similar grayscale sections of the second display 240 .

In operation 730, the processor 210 may perform interpolation on a boundary value between similar grayscale sections. Since the color temperature correction in operation 720 is performed on a representative value of the similar grayscale sections, the grayscale change may not be continuous at the boundary between the similar grayscale sections. The processor 210 may perform interpolation before and after the boundary point of the similar gray level sections to make the gray level change at the boundary appear smooth. Operation 730 is optional and may be omitted.

The color temperature correction according to FIG. 7 may be less accurate than the color temperature correction according to FIG. 6 . However, according to the embodiment of FIG. 7 , since only representative values of similar grayscale sections need to be measured in the generation process, the display mass production time can be shortened.

Claims (15)

1. An electronic device comprising:

   a first display;

   a second display;

   a memory storing a first white value of the first display and a second white value of the second display; and

   a processor operatively coupled to the first display, the second display, and the memory;

   The memory, when executed, the processor

   obtain the first white value and the second white value from the memory;

   generating a first transformation matrix based on the first white value and the second white value;

   to perform color temperature calibration on the first display based on the first transformation matrix and 1-dimension look up table (1DLUT);

   electronic device.
2. The method of claim 1 .

   Components other than the diagonal component of the first transformation matrix are set to 0 and the diagonal component is normalized,

   electronic device.
3. According to claim 1,

   the memory further stores information on the gray scale of the first display and information on the gray scale of the second display;

   The instructions, the processor,

   acquiring information on the gray scale of the first display and information on the gray scale of the second display from the memory;

   generating second transformation matrices for each gray level based on the information on the gray level of the first display and the information on the gray level of the second display;

   to perform color temperature calibration for each gray level of the first display based on the second transformation matrices and the 1DLUT;

   electronic device.
4. According to claim 1,

   The memory further stores similar grayscale sections of the first display and the second display and representative values of the similar grayscale sections;

   The instructions, the processor,

   obtaining representative values of the similar grayscale sections from the memory;

   generating third transformation matrices for each of the similar grayscale sections based on the representative value of the similar grayscale sections;

   performing color temperature calibration for each of the pseudo grayscale sections of the first display based on the third transformation matrices and the 1DLUT;

   electronic device.
5. 5. The method of claim 4,

   The instructions, the processor,

   to perform interpolation on boundary values of similar grayscale sections for which the color temperature is corrected;

   electronic device.
6. According to claim 1,

   The instructions, the processor,

   determining one of the first display and the second display as a main display and the other as a sub-display;

   to perform color temperature correction on the first display when the second display is determined as the main display;

   electronic device.
7. 7. The method of claim 6,

   the memory further stores standard color temperature characteristics;

   The instructions, the processor,

   determine a display closer to the standard color temperature characteristic among the first display and the second display as the main display based on the first white value and the second white value;

   electronic device.
8. 7. The method of claim 6,

   It further comprises at least one sensor,

   The instructions, the processor,

   Checking a display having a contact surface with an external object of a predetermined size or more among the first display and the second display using the at least one sensor,

   determining a display having a contact surface with the external object greater than or equal to a certain size as the sub-display,

   electronic device.
9. 7. The method of claim 6,

   The instructions, the processor,

   to determine the main display and the sub-display in real time,

   electronic device.
10. A method of operating an electronic device, comprising:

    obtaining a first white value and a second white value from a memory;

    generating a first transformation matrix based on the first white value and the second white value; and

    performing color temperature calibration on the first display based on the first transformation matrix and 1-dimension look up table (1DLUT);

    method.
11. 11. The method of claim 10.

    Components other than the diagonal component of the first transformation matrix are set to 0 and the diagonal component is normalized,

    method.
12. 11. The method of claim 10,

    obtaining information on the gray scale of the first display and information on the gray scale of the second display from the memory;

    generating second transformation matrices for each gray scale based on the gray scale information of the first display and the gray scale information of the second display; and

    performing color temperature calibration for each gray level of the first display based on the second transformation matrices and the 1DLUT;

    method.
13. 11. The method of claim 10,

    obtaining representative values of similar grayscale sections from the memory;

    generating third transformation matrices for each of the similar grayscale sections based on the representative value of the similar grayscale sections; and

    performing color temperature calibration on each of the similar grayscale sections of the first display based on the third transformation matrices and the 1DLUT;

    method.
14. 14. The method of claim 13,

    The method further comprising: performing interpolation on the boundary value of the similar grayscale sections for which the color temperature is corrected;

    method.
15. 11. The method of claim 10,

    determining one of the first display and the second display as a main display and the other as a sub-display; and

    When the second display is determined as the main display, performing color temperature correction on the first display; further comprising

    method.

Images