KR20210014559A - Display, electronic device having the display, and method for estimating bio-information using the electronic device - Google Patents

Abstract

Disclosed is a display device having a light sensing function. According to one embodiment of the present invention, the display device comprises: a display unit formed of an array of unit pixels including a light source pixel and a detector pixel; a control driver including a light source driver and a data driver connected to each light source pixel, and a detector driver connected to each detector pixel; and a control unit operating the display unit in a first mode, a second mode, or a third mode through the control driver.

Description

Display device, electronic device equipped with display device, and biometric information estimation method {DISPLAY, ELECTRONIC DEVICE HAVING THE DISPLAY, AND METHOD FOR ESTIMATING BIO-INFORMATION USING THE ELECTRONIC DEVICE}

It relates to a display device having a light sensing function. Further, the present invention relates to an electronic device including the display device and a technology for estimating biometric information in the electronic device.

In general, devices such as wearable devices and smart devices include a display device that displays an image, and the display device recognizes the touch when a user's hand or a touch pen touches a specific location on the screen in addition to the function of displaying a recent image. Includes a touch screen. Recently, as interest in health increases, a technology for non-invasively measuring biometric information such as blood pressure by mounting a separate optical sensor in such a device such as a wearable device or a smart device is being studied. However, it is difficult to reduce the size of general devices by separately including a display device displaying an image and an optical sensor having a light sensing function.

A display device having a light sensing function is provided. In addition, an electronic device including the display device and a method of estimating biometric information through the electronic device are provided.

According to an aspect, the display device includes a display unit formed of an array of unit pixels including a light source pixel and a detector pixel, a light source driver and a data driver connected to each light source pixel, and a control driver including a detector driver connected to each detector pixel, and And a control unit that operates the display unit in a first mode, a second mode, or a third mode through the control driver.

In this case, the light source pixel includes one or more light emitting diode (LED) pixels that irradiate light of one or more wavelengths, and the detector pixel includes a photodiode (PD) pixel that receives light scattered or reflected from the object and converts it into an electrical signal. Can include.

In this case, each LED pixel may have a 2 transistor 1 capacitor structure, and the PD pixel may have a 4 transistor or 3 transistor structure.

When driving data corresponding to the first mode is input, the controller may deactivate the detector driver and display an image by driving each light source of the display unit through a light source driver and a data driver based on the driving data.

The driving data may include at least one of a driving sequence, a wavelength, and a duration time of the light source of the unit pixel array.

When driving data corresponding to the second mode is input, the controller activates the detector driver, and drives the light source and the detector of the display unit through the light source driver, data driver, and detector driver based on the driving data to obtain an optical signal from the object. I can.

In this case, the driving data may include the position of the light source to be driven, the wavelength, the duration, and the position of the detector to be driven.

When the driving data corresponding to the third mode is input, the controller activates the detector driver, and drives the light source and the detector of the display unit through the light source driver, data driver, and detector driver based on the driving data, thereby Is output and an optical signal can be obtained in the second region.

In this case, the driving data includes the driving order, wavelength and duration of each light source of the unit pixel array included in the first region, and the position, wavelength, duration, and position of the detector to be driven in the second region. Can include.

Further, the display device may further include a conversion unit that is activated by the control unit when the display unit operates in the second mode or the third mode, and converts the optical signal into a digital signal by receiving an optical signal from the detector of the display unit.

The conversion unit includes a Mux (multiplexer) in which the outputs of detectors are integrated and connected for each column of the unit pixel array, and an analog-digital converter (ADC) connected to the Mux, and inputs of the detectors of the unit pixel array are each It can be integrated by row and connected to the detector driver.

The conversion unit includes an analog-digital converter (ADC) connected to an output of each detector of the unit pixel array, and inputs of the detectors of the unit pixel array may be independently connected to the detector driver.

The conversion unit includes a plurality of analog-digital converters (ADCs) in which the outputs of the detectors are integrated and connected for each column of the unit pixel array, and the inputs of the detectors of the unit pixel array are integrated for each row. Can be connected to the detector driver.

The conversion unit includes a plurality of analog-digital converters (ADCs) respectively connected to outputs of each detector of the unit pixel array, and inputs of the detectors of the unit pixel array may be integrated and connected to the detector driver.

According to an aspect, the electronic device includes an array of unit pixels including a light source pixel and a detector pixel, and includes a first mode for displaying an image, a second mode for obtaining an optical signal, or for displaying an image and obtaining an optical signal. A display device operating in a third mode, and a processor that determines a mode of the display device and controls an operation of the display device according to the determined mode may be included.

The processor may set the first mode as a basic mode, and may switch to the second mode or the third mode when an analysis request from the object is received.

When a request for analysis of an object is received, the processor may select one of the second mode and the third mode based on at least one of the user's request and the size and performance of the display device.

When the second mode is determined, the processor controls the display device to operate in the first mode to display guide information for acquiring an optical signal, and after a predetermined time, the display device operates in the second mode to acquire an optical signal from the object. Can be controlled.

When the third mode is determined, the processor may display guide information for acquiring an optical signal or an analysis result of an object in the first area of the display device and control to acquire an optical signal in the second area.

When it is determined as the second mode or the third mode, the processor controls the display device to obtain a first optical signal from the object, and analyzes the contact position of the object based on the acquired first optical signal, 2 The display device can be controlled to acquire an optical signal.

In addition, the electronic device may further include a fingerprint sensor that acquires fingerprint data of the object when the object contacts the display device.

The processor may analyze the contact position of the object based on the fingerprint data, and control the display device to acquire an optical signal or display guide information based on the analysis result.

The processor may acquire a fingerprint feature point based on the fingerprint data, and determine a light source and a detector to be driven to acquire the optical signal based on the acquired fingerprint feature point.

When an optical signal is obtained from the object according to the second mode or the third mode, the processor may perform at least one of biometric information estimation, fingerprint authentication, document scanning, and image scanning by analyzing the object based on the obtained optical signal.

According to an aspect, the electronic device includes an array of unit pixels including a light source pixel and a detector pixel, and includes a first mode for displaying an image, a second mode for acquiring an optical signal, or a second mode for displaying an image and acquiring an optical signal. When a request for estimating biometric information and a display device operating in a three mode is received, the display device operates in a second mode or a third mode to control to obtain a first optical signal from an object, and based on the acquired first optical signal. Biometric information can be estimated.

The display device may obtain a first optical signal by driving one or more pairs of light sources and detectors within a first area in contact with the object.

The processor may determine a light source and a detector pair in the first area based on a predetermined reference point in the first area.

The predetermined reference point may include at least one of a center point of the first area and a fingerprint feature point acquired based on fingerprint data according to a contact of the object.

The display device may obtain the first optical signal while acquiring a plurality of second optical signals by driving a plurality of light source and detector pairs in a second region including the first region.

The processor may correct the first optical signal based on the second optical signal, and estimate the biometric information based on the corrected first optical signal.

In addition, the electronic device may further include a force sensor that measures a contact force when an object contacts the display device and presses it.

The processor acquires a contact area based on the amount of light received by the detector pixel when the object contacts the display device, acquires a contact pressure based on the contact force and the contact area, and based on the contact pressure and the optical signal. Biometric information can be estimated with.

The biometric information may include one or more of blood pressure, blood vessel age, arteriosclerosis, aortic pressure waveform, blood vessel elasticity, stress index, fatigue, skin elasticity, skin age, triglycerides, cholesterol, blood sugar and antioxidant index.

By presenting a display device having a light detection function, it is not necessary to have a separate optical sensor for acquiring an optical signal, so the electronic device can be miniaturized, and various functions such as biometric information estimation can be performed using the acquired optical signal. Can be done.

1 is a block diagram of a display device according to an exemplary embodiment.
2 illustrates a structure of a display unit according to an exemplary embodiment.
3A to 3C are diagrams for explaining various operation modes of the display device.
4A to 4D are diagrams for explaining various driving methods of the detector.
5A and 5B illustrate examples of driving data configured to operate in a mode in which the display device acquires an optical signal.
6 is a block diagram of an electronic device according to an exemplary embodiment.
7A and 7B are diagrams for explaining a method of operating a display device.
8A to 8G are diagrams for explaining acquisition of an optical signal in a display device.
9 is a block diagram of an electronic device according to another embodiment.
10A to 10C are diagrams for explaining oscillometric-based blood pressure estimation.
11 is a block diagram of an electronic device according to another embodiment.
12 is a diagram for describing determination of a contact state of an object.
13 is a block diagram of an electronic device according to another embodiment.
14 is a flowchart of a method of estimating biometric information according to an exemplary embodiment.

Details of other embodiments are included in the detailed description and drawings. Advantages and features of the described technology, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the drawings. The same reference numerals refer to the same components throughout the specification.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. The terms are only used for the purpose of distinguishing one component from another component. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software.

Hereinafter, embodiments of the display device will be described in detail with reference to the drawings. The display device of the present exemplary embodiments has a light sensing function and may be mounted on various electronic devices. Electronic devices include various types of wearable devices such as a smart watch worn on the wrist, a smart band type, a headphone type, and a headband type, a mobile device such as a smartphone or tablet PC, a desktop PC, a notebook PC, a navigation device, and a television. It includes various information processing devices and is not particularly limited to these examples.

1 is a block diagram of a display device according to an exemplary embodiment.

Referring to FIG. 1, the display device 100 includes a display unit 110, a control unit 120, control drivers 130, 140 and 150, and a conversion unit 160.

The display unit 110 includes a display panel that displays an image. The display panel may include a touch screen that recognizes a touch when a user's hand or a touch pen comes into contact.

2 illustrates a structure of a display unit according to an exemplary embodiment.

Referring to FIG. 2, in the display unit 110 according to an exemplary embodiment, unit pixels 111 may be formed in an array. Each unit pixel 111 may include a light source pixel and a detector pixel.

The light source pixel of each unit pixel 111 may include a light emitting diode (LED), a laser diode (LD), or a phosphor, but is not limited thereto. As illustrated, the light source pixel may include a plurality of LED pixels (IR, Red, Green, Blue) that irradiate light of different wavelengths. However, since it is not limited to this structure, some LED pixels, such as IR LED pixels, in the illustrated example may be excluded. In addition, it is possible to configure the LED pixel so that it can represent white instead of RGB. Each LED pixel (IR, Red, Green, Blue) can be configured to have a general active matrix driving method, for example, a 2Tr 1C structure, that is, 2 transistors and 1 capacitor. I can.

The detector pixel of each unit pixel 111 may include a photodiode (PD) that detects light and converts the detected light into an electrical signal (hereinafter, referred to as an “optical signal”). However, it is not limited thereto. As illustrated, the detector pixel of each unit pixel 111 may include one PD pixel PD. The PD pixel PD may have a general CIS (CMOS Image Sensor) configuration, but is not limited thereto and may be configured to have various structures such as a 4 transistor 4Tr or 3 transistor 3Tr structure.

Referring to FIG. 1 again, the controller 120 controls the control drivers 130, 140, 150 based on driving data to display an image on the display unit 110, a second mode for acquiring an optical signal from an object, and It is possible to operate in any of the third modes for simultaneously displaying an image and acquiring an optical signal.

The control driver includes a light source driver 130 and a data driver 140 electrically connected to a light source pixel of each unit pixel of the display unit 110, and a detector driver 150 electrically connected to a detector pixel of each unit pixel. can do. In this case, the light source driver 130, the data driver 140, and the detector driver 150 may be configured as a multiplexer (Mux).

The driving data may be input from a processor of an electronic device in which the display device 100 is mounted or connected to the display device 100 through wired or wireless communication, and may include data related to driving of a light source of each unit pixel and a detector.

For example, the driving data for operating the display unit 110 in the first mode includes image data to be displayed, and includes light source data such as driving order, driving wavelength, and driving duration of each light source of the unit pixel array. can do. However, it is not limited thereto.

As another example, driving data for operating the display unit 110 in the second mode may include data on one or more light source-detector pairs or a single detector to be driven to obtain an optical signal from an object. For example, it may include light source data such as a position of a light source to be driven, a driving wavelength, and a driving duration time, and detector data such as a position of a detector to be driven. However, it is not limited thereto.

As another example, the driving data for operating the display unit 110 in the third mode may include the driving order of each light source of the unit pixel array included in the first area to display image data in the first area of the display unit 110, Light source data such as driving wavelength and duration may be included. Here, the first region does not mean only one physically continuous region, but may mean two or more regions separated from each other. In addition, the second area of the display unit 110 may include data on one or more light source-detector pairs to be driven to obtain an optical signal from an object. For example, it may include light source data such as a position of a light source to be driven, a driving wavelength, and a driving duration time, and detector data such as a position of a detector to be driven. However, it is not limited thereto.

The conversion unit 160 may be electrically connected to the controller 120 and the detector pixel PD of the display unit 160. The converter 160 may be activated/deactivated under the control of the controller 120 and may convert an optical signal output from the detector pixel PD into a digital signal and transmit it to the processor of the electronic device.

3A to 3C are diagrams for explaining various operation modes of the display device.

3A is a diagram for explaining an example of operating in a first mode. Referring to FIG. 3A, the controller 120 determines the operation mode of the display unit 110 when driving data is input, and when the first mode is determined, the detector driver 150 driving the detector and receiving an optical signal from the detector. The conversion unit 160 may be deactivated. In addition, driving data may be transmitted to the light source driver 130 and the data driver 140 to drive the light source of the unit pixel array to display an image. At this time, the light source driver 130 outputs a signal for driving each light source as a light source pixel based on the driving data received from the control unit 120, and the data driver 140 outputs the image data to each light source pixel based on the driving data. It can be output as an image (ID) to be displayed.

3B is a diagram for explaining an example of operating in a second mode. Referring to FIG. 3B, the controller 120 determines an operation mode of the display unit 110 when driving data is input, and when the second mode is determined, the detector driver 150 driving the detector and receiving an optical signal from the detector. The conversion unit 160 may be activated. In addition, LED data among driving data may be transmitted to the light source driver 130 and the data driver 140, and PD data among the driving data may be transmitted to the detector driver 150. The light source driver 130, the data driver 140, and the detector driver 150 drive the light source LED _i and the detector PD _i at the corresponding position based on the received driving data to receive an optical signal from the object OBJ. Can be detected. The converter 160 may receive an optical signal detected from the object OBJ by the detector PD _i , convert the received optical signal into a digital signal, and output the converted optical signal to a processor of the electronic device.

3C is a diagram for explaining an example of operating in a third mode. Referring to FIG. 3C, the controller 120 determines the operation mode of the display unit 110 when driving data is input, and when the third mode is determined, the detector driver 150 driving the detector and receiving an optical signal from the detector. The conversion unit 160 may be activated. In addition, LED data among driving data may be transmitted to the light source driver 130 and the data driver 140, and PD data among the driving data may be transmitted to the detector driver 150. The light source driver 130 and the data driver 140 drive a light source in the first area of the display unit 110 to display an image ID, and the light source driver 130, the data driver 150, and the detector driver 160 ) May drive the light source LED _i and the detector PD _i at predetermined positions in the second area of the display unit 110 to detect an optical signal from the object OBJ. The converter 160 may receive an optical signal detected from the object OBJ by the detector PD _i , convert the received optical signal into a digital signal, and output the converted optical signal to a processor of the electronic device.

4A to 4D are diagrams for explaining various driving methods of the detector. 4A to 4D illustrate a unit pixel array including four detectors PD1, PD2, PD3, and PD4 for convenience, but the number is not particularly limited.

Referring to FIG. 4A, in the first driving method, the converter 160 includes one analog-digtal converter (ADC) 161, and the ADC 161 includes detectors PD1 and PD2 of a unit pixel array. ,PD3,PD4) can be connected to each output. Also, inputs of each of the detectors PD1, PD2, PD3, and PD4 of the unit pixel array may be independently connected to the detector driver 150. In this way, the first driving method may be configured to output an optical signal of one detector selected by the detector driver 150 to the ADC 161.

Referring to FIG. 4B, in the second driving scheme, the conversion unit 160 may include one ADC 161 and one Mux 162. The mux 162 may be connected to each line in which detectors are integrated for each column. For example, the Mux 162 is connected to a line incorporating the detectors PD1 and PD3 in the first column and a line incorporating the detectors PD2 and PD4 in the second column, and selectively selects an optical signal input from each line. It can be output to the ADC 161. In addition, inputs of the detectors may be integrated for each row and connected to the detector driver 150. For example, a line incorporating inputs of the detectors PD1 and PD2 in the first row and a line incorporating inputs of the detectors PD3 and PD4 in the second row may be connected to the detector driver 150, respectively. As described above, in the second driving method, the output of the detectors in one row selected by the detector driver 150 is simultaneously input to the Mux 162, and the optical signal selected by the Mux 162 is output to the ADC 161. I can.

Referring to FIG. 4C, in the third driving method, the conversion unit 160 may include a plurality of ADCs 161a and 161b. The plurality of ADCs 161a and 161b may be connected to each other by integrating the outputs of the detectors for each column. For example, the ADC 161a in the first column is connected to a line that integrates the outputs of the detectors PD1 and PD3 in the first column, and the ADC 161b in the second column integrates the outputs of the detectors PD2 and PD4 in the second column. Can be connected to one line. In addition, the inputs of the detectors may be integrated for each row and connected to the detector driver 150. For example, a line incorporating inputs of the detectors PD1 and PD2 in the first row and a line incorporating inputs of the detectors PD3 and PD4 in the second row may be connected to the detector driver 150. As described above, the third driving method may be configured such that the outputs of the detectors of one row selected by the detector driver 150 are simultaneously input to the ADCs 161a and 161b.

Referring to FIG. 4D, in the fourth driving method, the conversion unit 160 includes a plurality of ADCs 161a, 161b, 161c, and 161d, and each of the ADCs 161a, 161b, 161c, and 161d corresponds to each detector. It can be connected to the outputs of (PD1, PD2, PD3, PD4) respectively. In addition, inputs of each of the detectors PD1, PD2, PD3, and PD4 may be integrated into one and connected to the detector driver 150. As described above, the fourth driving method may be configured to output optical signals of all detectors PD1, PD2, PD3, and PD4 to the corresponding ADCs 161a, 161b, 161c, and 161d, respectively. In this case, the detector driver 150 may be omitted.

However, it is not limited to the driving methods described with reference to FIGS. 4A to 4D, and may be configured to have a modification of each driving method, a combination of two or more driving methods, or other various driving methods not illustrated herein. For example, by modifying the third driving method, the conversion unit 160 bundles each line including only one ADC and integrates the detectors of each column into one and connects it to the ADC, and the inputs of the detectors in each column are respectively the detector driver 150 You can have a configuration that connects independently to. That is, the driving method of the detector can optimize the design by adjusting the number of ADCs and the complexity of lines in consideration of the purpose of use of the display device, the size of the display device, and computing performance of the electronic device.

5A and 5B illustrate examples of driving data configured to operate in a mode in which the display device acquires an optical signal. However, the following examples are for illustrative purposes only and should not be construed as being limited thereto.

Referring to FIG. 5A, a display unit having a unit pixel array of 18 rows and 12 columns is illustrated. 5B shows an example of various driving data in a second mode or a third mode for acquiring an optical signal. Driving data 1 is an example of driving data that acquires one optical signal using a pair of a light source (LED) of the unit pixel of 30 and a detector (PD) of the pixel of unit 114, and an optical signal having a single optical path is obtained. I can.

Driving data 2 is an example of driving data for acquiring a plurality of optical signals by a light source at a position 30 and a pair of detectors at a plurality of positions (113, 114, 115). Can be obtained.

Driving data 3 is an example of driving data for acquiring a plurality of optical signals by a light source at a plurality of positions (30, 31, 32) and a pair of detectors at a position 114. An optical signal can be obtained.

Drive data 4 is a drive that acquires a plurality of optical signals by a light source at a plurality of positions (1,2,3,4,5,6) and a detector pair at a plurality of positions (1,2,3,4,5,6) As an example of data, it is possible to acquire optical signals of various optical paths at various locations.

The driving data 5 is an example of driving data obtained by combining two or more driving data, such as driving data 1 and driving data 4, by alternately driving driving data 1 and driving data 4 in a time-division method for each sampling to obtain a plurality of optical signals. It can be used for more various analysis purposes.

6 is a block diagram of an electronic device according to an exemplary embodiment. 7A and 7B are diagrams for explaining a method of operating a display device. 8A to 8G are diagrams for explaining acquisition of an optical signal in a display device.

Referring to FIG. 6, the electronic device 600 includes a display device 610 and a processor 620.

The display device 610 includes a display unit operating in a first mode displaying an image, a second mode acquiring an optical signal, and a third mode acquiring an image display and an optical signal, and the display unit first based on driving data. And a control unit to operate in a mode, a second mode, or a third mode.

The display unit is formed as an array of unit pixels, and each unit pixel may include a light source pixel and a detector pixel. The light source pixels of each unit pixel may include, for example, a plurality of LED pixels for irradiating light of different wavelengths. Also, the detector pixel of each unit pixel may include a PD pixel that detects an optical signal from an object.

In addition, the display device 610 may include a control driver that is electrically connected to the display unit and the control unit and drives the display unit according to a corresponding mode under the control of the control unit. The control driver may include a light source driver and a data driver connected to the light source pixel, and a detector driver connected to the detector pixel.

When driving data corresponding to the first mode is input from the processor 620, the controller may deactivate the detector driver and control the light source driver and the data driver. In addition, when driving data corresponding to the second mode or the third mode is input, the detector driver may be activated and the light source driver, the data driver, and the detector driver may be controlled.

In addition, the display device 610 may further include a converter configured to convert the optical signal obtained according to the second mode or the third mode into a digital signal and output it to the processor 620. As described above, the conversion unit may include one or more ADCs or one or more Muxes and one or more ADCs.

Since exemplary embodiments of the display device 610 have been described in detail with reference to FIGS. 1 to 5B, they will be omitted below.

The processor 620 processes various functions of the electronic device 600. For example, the processor 620 may determine the mode of the display device 610 according to a request related to the display device 610. In addition, driving data may be generated according to the determined mode and transmitted to the controller of the display device 610 to control the operation of the display device 610. Examples of driving data according to each mode have been described above.

The processor 620 may set the first mode to a default mode, and may switch the display device 610 to a second mode or a third mode when an analysis request from an object is received. In addition, the processor 620 may automatically switch the display device 610 to the first mode when the optical signal acquisition is completed according to the second mode or the third mode.

When various image data are processed in the electronic device 600 while maintaining the display device 610 in the first mode, the processor 620 may generate driving data including various image data and transmit it to the control unit of the display device 610. . At this time, the image data processed by the electronic device 600 is TV (television) content, a video/still image generated and/or played by various applications installed in the electronic device 600, and connected to the electronic device 600 through wired or wireless communication. As a result, various image data received from an external device may be included.

When a request for analysis of an object using an optical signal is received, the processor 620 may generate appropriate driving data to change the mode of the display device 610 to the second mode or the third mode. In this case, the request for analysis of the object may include a request for various operations that can be processed using optical signals such as biometric information estimation, fingerprint authentication, document scanning, and image scanning.

For example, the processor 620 may determine the optical signal acquisition mode in consideration of the user's request, the type of the electronic device 600, the type of the object analysis request, and the size and/or performance of the display device 610. . As an example, the user may designate the second mode to acquire an optical signal using the entire area of the display device 610 for more accurate biometric information estimation. Alternatively, the user may designate the third mode to obtain an optical signal from the remaining regions while continuing to enjoy the image currently being viewed in a partial region.

As another example, the optical signal acquisition mode of the display device 610 may be predefined according to the type of the object analysis request, the size and/or performance of the display device 610, and the processor 620 receives the object analysis request. The optical signal acquisition mode of the display device 610 may be determined as a predefined mode. For example, if an object analysis request is requested, the third mode may be defined, and if the display device 610 has a relatively low performance or a small size, the second mode may be defined. However, it is not limited thereto.

When the display device 610 operates in the second mode or the third mode to obtain an optical signal from the object, the processor 620 may analyze the object based on the optical signal to process a user's request. When the analysis of the object is completed, the processor 620 generates the analysis result of the object as image data, and generates appropriate driving data to display the analysis result image data in the first mode or the third mode, and the controller of the display device 610 I can deliver.

For example, referring to FIG. 7A, when the processor 620 determines the mode of the display device 610 as the second mode according to an optical signal acquisition request, as shown in (1), a predetermined light source (LED) and a detector Driving data driving the PD may be generated and transmitted to the control unit of the display device 600. In addition, when an object contacts the display unit 611 to obtain an optical signal, a blood pressure may be estimated using the optical signal.

Meanwhile, the processor 620 operates in a first mode before generating driving data for acquiring an optical signal, and guide information for acquiring an optical signal, for example, information such as a contact position, a contact state, and a contact pressure. Driving data may be generated to display and transmitted to the controller of the display device 600, and when a predetermined time elapses, driving data may be generated and transmitted to the controller to acquire an optical signal in the second mode.

Further, as shown in (2), when the optical signal acquisition or blood pressure estimation is completed, the processor 620 switches the mode of the display device 610 to the first mode and drives to output the blood pressure estimation result to the display unit 611. Data can be created.

Referring to FIG. 7B, when the processor 620 determines the mode of the display device 610 as the third mode, guide information for acquiring an optical signal in the first areas D1 and D3 of the display unit 611 and/or In order to output the processing result and obtain an optical signal in the second region D2, driving data including information on the light source LED and the detector PD to be driven may be generated. As shown, the first areas D1 and D3 are divided into two or more areas, so that information for visually guiding the contact pressure is displayed in one area D1, and the second area D2 is in the other area D3. During the acquisition of the optical signal or after the acquisition of the optical signal is completed, the processing result may be output. For example, the processor 620 may display text such as "press harder" so that the user increases the contact pressure while acquiring the optical signal, and when blood pressure estimation is completed, the blood pressure estimation value is displayed. can do.

8A to 8G are examples of driving a pair of light sources and detectors when the display device 610 operates in a second mode or a third mode to obtain an optical signal. An example of a display area of the display device 610 is composed of 10 rows and 10 columns. In this case, the display area represents the entire area in the second mode or an optical signal acquisition area in the third mode.

The display device 610 may drive a pair of a light source and a detector based on the driving data generated by the processor 620 and obtain, for example, a first optical signal for estimating blood pressure.

As an example, referring to FIG. 8A, the display device 610 may obtain a first optical signal from the object OBJ by driving a single light source 41 and a pair of the detector 77. In this case, the pair of the light source 41 and the detector 77 to be driven may be predefined.

As another example, referring to FIG. 8B, the display device 610 drives one light source 41 and a pair of detectors 77 in the first area DA1 contacted by the object OBJ to obtain a first optical signal. A plurality of second optical signals may be obtained by driving a plurality of light source and detector pairs in the second area DA2 including the first area DA1. In this case, the first area DA1 and the second area DA2 may be set in advance. The display device 610 continuously simultaneously drives or time-divisions the pair of light sources 41 and detectors 77 in the first area DA1 for a predetermined time while the plurality of light source and detector pairs in the second area DA2 are being driven. It can be driven sequentially in a way.

The plurality of light source and detector pairs in the second area DA2 may be predefined as a combination of light sources and detectors of all unit pixels in the second area DA2. For example, the light source and the detector of the same unit pixel may be combined as a pair, or the light source of the first unit pixel and the detector of the second unit pixel separated by a predetermined distance may be combined as a pair. However, the present invention is not limited thereto, and various unit pixels may be combined.

Alternatively, the plurality of light source and detector pairs in the second area DA2 may be predefined as a combination of light sources and detectors of a selected portion of the unit pixels in the second area DA2. For example, a unit pixel to be selected may be predetermined in consideration of the performance of the electronic device 600, the performance of the display device 610, the purpose of analyzing the optical signal, and the speed required for analyzing the optical signal. For example, it may be selected with a predefined row spacing such as a first row, a third row, a fifth row, and/or a predefined column spacing such as a first column, a third column, and a fifth column. It is also possible to select a direction, a cross direction, etc. However, it is not limited thereto. As described above, the pair of light sources and detectors to be driven simultaneously may be combined into a light source and detector of each unit pixel or a pair of light sources and detectors of two unit pixels spaced apart from each other.

The display device 610 may drive all or selected pairs of light sources and detectors in the second area DA2 in a predefined pattern. At this time, the predefined pattern is a method of sequentially driving in a row direction or a column direction, a method of driving one or more times at the same time, a method of driving in the form of a circle/square, etc. Conversely, they can be driven sequentially and/or simultaneously. However, it is not limited thereto.

Referring to FIG. 8C, the display device 610 drives a plurality of light sources and detector pairs in the second area DA2 in various ways, while driving one light source 41 and a plurality of detectors in the first area DA1. The plurality of first optical signals may be obtained from the object OBJ by simultaneously or sequentially driving 76, 77, and 78.

Referring to FIG. 8D, the display device 610 drives a plurality of light sources and detector pairs in the second area DA2 in various manners as described above, while driving the plurality of light sources 40 and 41 in the first area DA1. , 42 and one detector 77 may be simultaneously or sequentially driven to obtain one or more first optical signals from the object OBJ.

Referring to FIG. 8E, the display device 610 drives the plurality of light sources and detector pairs in the second area DA2 in various ways as described above, and the plurality of light sources 40 and 41 in the first area DA1 , 42 and the plurality of detectors 76, 77, and 78 may be simultaneously or sequentially driven to obtain a plurality of first optical signals from the object OBJ.

8F and 8G, when an optical signal acquisition request is received, the processor 620 may determine one or more light sources and detectors to be driven based on a predetermined reference point in the first area.

For example, as shown in FIG. 8F, the predetermined reference point of the first area DA1 may be the center point AC of the first area DA1. The light source 41 and the detector 77 at a predetermined distance from the center point of the first area DA1 may be determined as a light source and a detector for acquiring the first optical signal. In this case, one or more light sources and detectors may be determined as shown in FIGS. 8C to 8E. The processor 620 performs calibration to guide the object OBJ to contact the display device 610 multiple times, analyzes the contact pattern of the object, and analyzes the optimal size of the first area DA1 and the first An optimum distance from the center point AC of the area DA1 to the light source and the detector may be determined.

As another example, as shown in FIG. 8G, the processor 620 acquires the fingerprint feature point FP as a predetermined reference point based on the fingerprint data according to the contact of the object OBJ, and obtains the first light based on the acquired fingerprint feature point FP. It is possible to determine a light source and a detector for obtaining a signal. In this case, the processor 620 may obtain the fingerprint direction FD and determine a light source and a detector at a predetermined distance in the fingerprint direction FD from the fingerprint feature point FP. In this case, the fingerprint data may be obtained using a distribution of the amount of light received by the display device 610 according to the contact of the object or using a fingerprint sensor as described later.

As described above, the processor 620 may process requests for biometric information estimation, fingerprint authentication, document scanning, and image scanning, based on the first optical signal. In this case, when a plurality of first optical signals are obtained, the processor 620 may process various requests by selecting one of the plurality of first optical signals or combining two or more first optical signals.

Also, as described above, when a plurality of second optical signals are acquired in the second region together with the first optical signal, the processor 620 may correct the first optical signal based on the second optical signal. For example, referring to FIG. 8B, when an object is more in contact with the unit pixel 76 on the left side of the object compared to the unit pixel 77 acquiring the first optical signal, based on the second optical signal detected at the unit pixel 76 The first optical signal of No. 77 can be corrected. For example, the first optical signal 77 may be corrected using various predefined correction equations, such as a method of averaging the amplitudes of each view point of the optical signals 76 and 77. Here, only one of number 76 is exemplified, but the present invention is not limited thereto, and a plurality of second optical signals having a relatively good contact state may be selected and the first optical signal may be corrected based on the selected plurality of second optical signals.

Alternatively, the processor 620 may evaluate the reliability of the first optical signal based on the plurality of second optical signals. For example, if the feature point extracted from each optical signal, for example, the maximum amplitude gradually increases as the maximum amplitude increases from 77, it is determined that the reliability of the first optical signal is not high, and the mode of the display device 610 is set to the first mode or the third mode. The mode can be switched to guide re-contact of the object. At this time, the criterion for determining the reliability is not limited to what is illustrated.

9 is a block diagram of an electronic device according to another embodiment. 10A to 10C are diagrams for explaining oscillometric-based blood pressure estimation.

A function of estimating biometric information among various functions of the electronic device 900 analyzing an object through an optical signal will be described with reference to FIGS. 9 to 10C. At this time, the biometric information may include one or more of blood pressure, blood vessel age, arterial stiffness, aortic pressure waveform, blood vessel elasticity, stress index, fatigue, skin elasticity, skin age, triglyceride, cholesterol, blood sugar, and antioxidant index. It is not limited thereto.

As shown in FIG. 9, according to an embodiment, the electronic device 900 may include a display device 910, a processor 920, and a force sensor 930. The display device 910 and the processor 920 have been described in detail through the above-described embodiments.

When a request for estimating biometric information is received, the processor 920 generates driving data for converting the display device 910 to the second mode or the third mode and transmits it to the display device 910.

For example, if the second mode is determined, the processor 920 may first operate in the first mode to generate first driving data and transmit the first driving data to the display device 910 to display information guiding the user to acquire an optical signal. In this case, the guide information may be image data visually displaying a contact position and/or a contact pressure of an object (eg, a finger). Then, when a predetermined time elapses after the guide information is displayed on the display device 910, the display device 910 generates second driving data to obtain an optical signal from the object by operating in the second mode. ).

As another example, if the processor 920 is determined as the third mode, the display device 910 operates in the third mode to display guide information and/or biometric information estimation results for acquiring an optical signal in the first area, and Driving data may be generated and transmitted to the display device 910 so as to acquire an optical signal in the display device 910.

Meanwhile, when the second mode or the third mode is determined, the processor 920 first generates first driving data to obtain a first optical signal for determining the contact position of the object, and transmits the first driving data to the display device 910. When the optical signal is acquired, the contact position of the object may be analyzed based on the first optical signal. In addition, the processor 920 determines a light source and a detector to be driven to obtain a second optical signal for estimating biometric information based on the analyzed contact position, and generates and displays second driving data including information on the determined light source and detector. To the device 910.

For example, by generating the driving data 4 of FIG. 5B as the first driving data, the amount of light according to the contact of the object is detected in the entire area of the display, and the area of the unit pixels in which the amount of light is higher than a predetermined threshold is the contact position of the subject. Can be traced with In addition, when a rectangular area having the unit pixels 17, 19, 137, and 139 of FIG. 5A as the vertices is determined as the contact position of the object as a result of tracking, driving data 1 of FIG. 5B may be generated as second driving data.

The force sensor 930 may be disposed at the bottom of the display device 910, and when a user applies a force to the object by contacting the display device 910, the contact force may be measured. In order to change the intensity of the optical signal for a predetermined period of time, the user may gradually increase the pressing force while the finger is in contact with the display device 910 or gradually decrease the pressing force while applying a force above a predetermined threshold.

When the contact force measured from the force sensor 930 and the optical signal are received from the display device 910, the processor 920 may estimate biometric information based on the contact force and the optical signal.

For example, FIG. 10A illustrates a part of the amount of light received by the detector pixel of the display device 910 when an object contacts the display device 910 and gradually presses it. In this case, the amount of light of the detector pixel may be the size of the capacitance. The processor 920 may obtain a contact area in which the object contacts the display unit based on the amount of light of the detector pixel.

As an example, a continuous area having a light amount equal to or greater than a predetermined threshold (8 in FIG. 10A) is set as the region of interest (AI), and the number of unit pixels in the set region of interest (AI) is multiplied by the size of each unit pixel. Can be obtained by area. As another example, the contact area may be obtained based on a correlation between a statistical value (a total, an average value, a median value, a maximum value, a minimum value, etc.) of the amount of light of the pixels in the ROI and the contact area. In general, when the user gradually increases the pressing force while the finger is in contact with the display, the contact area increases in a certain section, and the amount of light of the pixel in the area where the finger touches at this time increases or increases. Accordingly, a constant correlation between the statistic value of the amount of light and the contact area can be predefined as a linear/nonlinear function.

The processor 920 determines the contact area of the subject by generating optimal first driving data for measuring the contact area, such as driving data 5 of FIG. 5B, and when the contact area is determined, obtains an optical signal for estimating biometric information. The second driving data for driving may be generated and transmitted to the display device 910.

However, the present invention is not limited thereto, and the electronic device 900 may further include a contact area sensor mounted on or below the display device 910, and may obtain a contact area through the contact area sensor.

When the contact area is obtained as described above, the processor 920 may obtain the contact pressure based on the obtained contact area and the contact force measured by the force sensor 930. For example, the contact pressure can be obtained by dividing the contact force by the contact area. When the contact pressure is obtained as described above, the processor 920 may estimate biometric information based on an oscillometric based on the contact pressure and the amplitude of the optical signal.

For example, FIG. 10B shows an optical signal, such as a pulse wave signal, measured by the display device 910 when a user contacts the display device 910 with a finger and gradually increases the contact pressure. As shown in the figure, when the user's pressing force is gradually increased while touching the display device 910 with a finger, the amplitude of the optical signal also tends to gradually increase for a certain period of time. The processor 920 extracts a peak-to-peak point by subtracting the amplitude value (in3) of the minus (-) point from the amplitude value (in2) of the positive (+) point of the waveform envelope (in1) at each measurement time point, As illustrated in FIG. 10C, an oscillometric envelope OW may be obtained by plotting the amplitude of the extracted peak-to-peak point at each measurement point based on the contact pressure at the same measurement point.

Referring to FIG. 10C, the processor 920 may obtain biometric information, for example, a characteristic for estimating blood pressure, from the obtained oscillometric envelope OW. The processor 720 is the amplitude value of the maximum peak point (MA), the contact pressure value (MP) of the maximum peak point, and the amplitude value (MA) of the maximum peak point in the oscillometric envelope (OW). Contact pressure values (SP, DP) corresponding to the left and right time points corresponding to ~0.7) can be obtained as features. However, the present invention is not limited thereto, and the maximum amplitude value, the time corresponding to the maximum amplitude value, the time and amplitude of the points related to the forward wave and the reflected wave, and a combination of acquired values can be obtained as additional features through the waveform analysis of the optical signal. have.

When the feature is extracted, the processor 920 may estimate the biometric information by applying a predefined biometric information estimation model. The biometric information estimation model may be defined in a variety of linear or nonlinear combined function types without any particular limitation, such as addition, subtraction, division, multiplication, logarithmic value, and regression equations. For example, Equation 1 below illustrates a simple linear function equation.

Here, y denotes an estimated biometric information to be obtained, and x denotes an extracted feature value. A and b are values obtained in advance through a pre-processing process, and may be differently defined according to the type of biometric information and user characteristics. For example, the processor 920 may independently estimate each blood pressure through Equation 1 defined for each average blood pressure, diastolic blood pressure, and systolic blood pressure. For example, an average blood pressure, a diastolic blood pressure, and a systolic blood pressure may be obtained by inputting the extracted feature value MP, the feature value DP, and the feature value SP into each defined function equation.

11 is a block diagram of an electronic device according to another embodiment. 12 is a diagram for explaining determination of a contact state of an object through fingerprint detection.

Referring to FIG. 11, an electronic device 1100 according to an exemplary embodiment may include a display device 1110, a processor 1120, and a fingerprint sensor 1130. Various functions of the electronic devices 600 and 900 described above may be performed in the electronic device 1100 of the present embodiment. The electronic device 1100 may further include the force sensor described in FIG. 9. Since the embodiments of the display device 1110 and the processor 1120 have been described above, non-redundant functions will be mainly described.

The fingerprint sensor 1130 may be disposed above or below the display device 1110. The fingerprint sensor 1130 may be an optical or capacitive-based fingerprint sensor. The fingerprint sensor 1130 may acquire fingerprint data when a user contacts an object to acquire an optical signal. Here, the fingerprint data does not mean only the fingerprint image of the finger, but may include a contact image of an object other than the finger.

12 shows a fingerprint image of a finger, where (1) shows a state in which the fingerprint is in good contact with the center of the display unit, and (2) shows a state in which the fingerprint is biased to one side. For example, when the fingerprint image FI is acquired, the processor 1120 may obtain the fingerprint feature point FP, and generate driving data for driving a light source and a detector within a predetermined range around the acquired fingerprint feature point FP. have. As another example, if the fingerprint feature point FP is too skewed toward one side as shown in (2) of FIG. 12, the processor 1120 allows the user to contact the object again instead of driving a light source and a detector near the fingerprint feature point FP. Guide information may be displayed through the display device 1110.

Meanwhile, the fingerprint sensor 1130 may be an ultrasonic sensor based on ultrasonic waves. The ultrasonic sensor may detect additional information, such as a contact load distribution, an ultrasonic pulse wave signal, and/or a blood flow signal, in addition to detecting a fingerprint when a user's subject is in contact. The processor 1120 may estimate the biometric information by using the optical signal acquired through the display device 1110 and the additional information acquired through the ultrasonic sensor.

13 is a block diagram of an electronic device according to another embodiment.

Referring to FIG. 13, the electronic device 1300 may include a display device 1310, a processor 1320, a storage unit 1330, and a communication unit 1340. Various functions of the electronic devices 600, 900, and 1100 described above may be performed in the electronic device 1300 of the present embodiment. Accordingly, the electronic device 1300 may further include the force sensor of FIG. 9 and the fingerprint sensor of FIG. 11.

The display device 1310 may operate in a first mode or a third mode under control of the processor 1320 to output various processing results of the processor 1300. For example, the display device 1310 may visually output the estimated biometric information and/or guide information. In addition, when the biometric information estimated value is out of the normal range, the warning information may be output in various ways such as highlighting, displaying the normal range together, outputting a voice warning message, adjusting the vibration intensity, etc. using a red color or the like.

Meanwhile, the electronic device 1300 may include a non-visual output means such as a speaker module or a haptic module in addition to the display device 1310, and can be output in a non-visual manner such as voice, vibration, or tactile sensation through the non-visual output means. I can.

The storage unit 1330 may store a result of processing by the processor 1320. In addition, the storage unit 1330 may store various reference information necessary for analysis of an object including biometric information estimation. For example, the reference information may include user characteristic information such as the user's age, gender, and health status. In addition, the reference information may include various information such as a biometric information estimation model, a biometric information estimation standard, and a mode switching standard of the display device. However, it is not limited thereto.

At this time, the storage unit 1330 is a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). Etc.), RAM (Random Access Memory: RAM) SRAM (Static Random Access Memory), ROM (Read-Only Memory: ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), Magnetic It includes, but is not limited to, storage media such as memory, magnetic disk, and optical disk.

The communication unit 1340 may communicate with an external device and transmit/receive various data using wired/wireless communication technology under the control of the processor 1320. For example, the communication unit 1340 may transmit a result of estimating biometric information to an external device, and may receive various reference information necessary for estimating biometric information from the external device. In this case, the external device may include an information processing device such as a cuff-type blood pressure measuring device, a smart phone, a tablet PC, a desktop PC, and a notebook PC.

At this time, the communication technology is Bluetooth communication, Bluetooth Low Energy (BLE) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, WFD (Wi-Fi Direct) communication, ultra-wideband (UWB) communication, Ant+ communication, WIFI communication, Radio Frequency Identification (RFID) communication, 3G communication, 4G communication, and 5G communication. However, it is not limited thereto.

14 is a flowchart of a method for estimating biometric information by an electronic device according to an exemplary embodiment. 14 illustrates an embodiment of a method for estimating biometric information by the electronic device of FIGS. 6, 9, 11, and 13; Since it has been described in detail above, it is briefly described below.

First, the electronic device may receive a request related to a display device (1410). A request for a display device may be received from a user or an external device. Hereinafter, for convenience of explanation, a request related to a display device is divided into a request for estimating biometric information to obtain an optical signal and a request for displaying other images.

Then, the mode of the display device may be determined based on the received display device related request (1420). For example, when an image display request is received in operation 1410, the display device may be determined as a first mode, which is a basic mode. Alternatively, when a request for estimating biometric information is received in step 1410, a mode of the display device may be determined as either a second mode or a third mode according to a user's request or a preset reference. At this time, the preset criterion is set based on the performance and type of the electronic device, the performance and/or type of the display device, etc. For example, when the size of the display device is small, the second mode is set to acquire only an optical signal, and the display device When the size of is relatively large, the third mode may be set to simultaneously display an image and acquire an optical signal.

Thereafter, when the first mode is determined in step 1420, the display device is switched to the first mode (1431), and image data may be displayed on the display device (1432).

If the second mode is determined in step 1420, the display device is switched to the second mode (1441), and the display device may measure an optical signal from the object (1442). In this case, the display device may display guide information for measuring a pulse wave signal while maintaining the first mode before switching to the second mode, and switch to the second mode after a predetermined time to measure the optical signal. If the third mode is determined in step 1420, the display device is switched to the third mode (1451), image data including guide information is displayed in a partial area of the display device, and an optical signal Can be measured (1452).

Meanwhile, in the steps of acquiring an optical signal in the second mode and the third mode (1442, 1542), a first optical signal for estimating biometric information is generated by driving a pair of one or more light sources and a detector in a first area that the object contacts. Can be obtained. In this case, a first optical signal may be obtained while acquiring a second optical signal by driving a pair of a plurality of light sources and a detector in a second area including the first area.

Then, the biometric information may be estimated based on the first optical signal measured in steps 1442 and 1452 (1460). When a plurality of second optical signals are obtained together with the first optical signal in steps 1442 and 1452, the first optical signal is corrected based on the second optical signal, and biometric information is estimated based on the corrected first optical signal. can do.

Meanwhile, the embodiments may be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices storing data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, and the like, and are implemented in the form of carrier waves (for example, transmission over the Internet). Include. Further, the computer-readable recording medium is distributed over a computer system connected by a network, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the embodiments can be easily inferred by programmers in the technical field to which the present invention belongs.

Those of ordinary skill in the art to which the present disclosure pertains will be able to understand that it may be implemented in other specific forms without changing the disclosed technical idea or essential features. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting.

100: display device 110: display unit
120: control unit 130: light source driver
140: data driver 150: detector driver
160: conversion unit
600,900,1100,1300: electronic devices
610,910,1110,1310: display device
620,920,1120,1320: Processor
930: force sensor 1130: fingerprint sensor
1330: storage unit 1340: communication unit

Claims (33)

A display unit formed of an array of unit pixels including a light source pixel and a detector pixel;
A control driver including a light source driver and a data driver connected to each light source pixel, and a detector driver connected to each detector pixel; And
And a controller configured to operate the display unit in a first mode, a second mode, or a third mode through the control driver. The method of claim 1,
The light source pixel includes one or more light emitting diode (LED) pixels that irradiate light of one or more wavelengths,
The detector pixel includes a photodiode (PD) pixel that receives light scattered or reflected from an object and converts it into an electrical signal. The method of claim 2,
Each of the LED pixels has a 2 transistor 1 capacitor structure,
The PD pixel has a 4 transistor or 3 transistor structure. The method of claim 1,
The control unit
When driving data corresponding to the first mode is input, the detector driver is deactivated, and each light source of the display is driven through a light source driver and a data driver based on the driving data to display an image. The method of claim 4,
The driving data is
A display device including at least one of a driving sequence, a wavelength, and a duration time of a light source of a unit pixel array. The method of claim 1,
The control unit
A display device that activates a detector driver when driving data corresponding to the second mode is input, and obtains an optical signal from an object by driving a light source and a detector of the display unit through a light source driver, data driver, and detector driver based on the driving data . The method of claim 6,
The driving data is
A display device including a position, a wavelength, a duration of a light source to be driven, and a position of a detector to be driven. The method of claim 1,
The control unit
When driving data corresponding to the third mode is input, the detector driver is activated, and the light source and detector of the display unit are driven through the light source driver, data driver, and detector driver based on the driving data to output an image in the first area of the display unit. And obtains an optical signal in the second area. The method of claim 8,
The driving data is
A display including the driving order, wavelength, and duration of each light source of the unit pixel array included in the first region, and including the position, wavelength, duration, and position of a detector to be driven in the second region Device. The method of claim 1,
When the display unit operates in a second mode or a third mode, the display device further comprises a conversion unit that is activated by the control unit and receives an optical signal from a detector of the display unit and converts it into a digital signal. The method of claim 10,
The conversion unit
Including a Mux (multiplexer) in which outputs of detectors are integrated and connected for each column of a unit pixel array and an analog-digital converter (ADC) connected to the Mux,
The input of the detectors of the unit pixel array is integrated for each row and connected to the detector driver. The method of claim 10,
The conversion unit
Including an ADC (analog-digital converter) connected to the output of each detector of the unit pixel array,
Inputs of detectors of a unit pixel array are independently connected to the detector driver. The method of claim 10,
The conversion unit
Including a plurality of ADCs (analog-digital converters) to which outputs of the detectors are integrated and connected to each column of the unit pixel array,
The input of the detectors of the unit pixel array is integrated for each row and connected to the detector driver. The method of claim 10,
The conversion unit
Including a plurality of ADCs (analog-digital converter) each connected to the output of each detector of the unit pixel array,
A display device in which inputs of detectors of a unit pixel array are integrated and connected to the detector driver. A display device comprising an array of unit pixels including a light source pixel and a detector pixel and operating in a first mode for displaying an image, a second mode for acquiring an optical signal, or a third mode for displaying an image and acquiring an optical signal ; And
And a processor that determines a mode of the display device and controls an operation of the display device according to the determined mode. The method of claim 15,
The processor is
An electronic device that sets the first mode as a basic mode and switches to a second mode or a third mode when an analysis request from an object is received. The method of claim 16,
The processor is
When an analysis request from an object is received, an electronic device that selects one of a second mode and a third mode based on at least one of a user request and a size and performance of the display device. The method of claim 15,
The processor is
When the second mode is determined, the display device operates in a first mode to display guide information for obtaining an optical signal, and after a predetermined time, the display device operates in a second mode to obtain an optical signal from an object. Control electronics. The method of claim 15,
The processor is
When the third mode is determined, the electronic device displays guide information for acquiring an optical signal or an analysis result of an object in a first area of the display device and controls to acquire an optical signal in the second area. The method of claim 15,
The processor is
When it is determined as the second mode or the third mode, the display device is controlled to obtain a first optical signal from the object, and the contact position of the object is analyzed based on the obtained first optical signal to provide a second An electronic device that controls a display device to acquire an optical signal. The method of claim 15,
The electronic device further comprises a fingerprint sensor that acquires fingerprint data of the object when the object contacts the display device. The method of claim 21,
The processor is
An electronic device that analyzes a contact position of an object based on the fingerprint data and controls the display device to acquire an optical signal or display guide information based on the analysis result. The method of claim 22,
The processor is
An electronic device that acquires a fingerprint feature point based on the fingerprint data, and determines a light source and a detector to be driven to acquire the optical signal based on the acquired fingerprint feature point. The method of claim 15,
The processor is
When an optical signal is obtained from an object according to the second mode or the third mode, an electronic device that analyzes the object based on the obtained optical signal to perform at least one of biometric information estimation, fingerprint authentication, document scanning, and image scanning. A display device including an array of unit pixels including a light source pixel and a detector pixel and operating in a first mode for displaying an image, a second mode for obtaining an optical signal, or a third mode for displaying an image and obtaining an optical signal; And
When a request for estimating biometric information is received, the display device operates in a second mode or a third mode to obtain a first optical signal from an object, and includes a processor for estimating biometric information based on the obtained first optical signal. Electronic devices. The method of claim 25,
The display device
An electronic device that obtains a first optical signal by driving one or more pairs of light sources and detectors in a first area in contact with an object. The method of claim 26,
The processor is
An electronic device that determines a pair of light sources and detectors in the first area based on a predetermined reference point in the first area. The method of claim 27,
The predetermined reference point is
An electronic device comprising at least one of a center point of a first area and a fingerprint feature point acquired based on fingerprint data according to a contact of the object. The method of claim 26,
The display device
An electronic device for acquiring the first optical signal while acquiring a plurality of second optical signals by driving a plurality of light sources and detector pairs in a second area including the first area. The method of claim 29,
The processor is
An electronic device for correcting the first optical signal based on the second optical signal and estimating biometric information based on the corrected first optical signal. The method of claim 25,
An electronic device further comprising a force sensor that measures a contact force when an object contacts the display device and presses it. The method of claim 31,
The processor is
When the object contacts the display device, a contact area is obtained based on the amount of light received by the detector pixel, and a contact pressure is obtained based on the contact force and the contact area, and based on the contact pressure and the optical signal. An electronic device that estimates biometric information. The method of claim 25,
The biometric information is
An electronic device comprising at least one of blood pressure, blood vessel age, arteriosclerosis, aortic pressure waveform, blood vessel elasticity, stress index, fatigue, skin elasticity, skin age, triglycerides, cholesterol, blood sugar, and antioxidant index.

Images