KR20210078148A - Method for reducing response time based on non-contact event and electronic device supporting the same - Google Patents

Abstract

An electronic device according to an embodiment of the present disclosure includes: a display; a display driving circuit connected to the display; and a processor connected to the display and the display driving circuit. The processor detects a non-touch event with respect to the display, transmits a set value for controlling the display to the display driving circuit on the basis of the non-touch event, and detects a touch event with respect to the display. The display driving circuit can use the set value to control the display. Various other embodiments that can be understood through the specification are also possible. Accordingly, compared to a method of performing a specific function by analyzing input data after the occurrence of the contact event, a user experience can be improved by reducing time for performing the specific function.

Description

Method for reducing reaction time based on non-contact event and electronic device supporting the same {METHOD FOR REDUCING RESPONSE TIME BASED ON NON-CONTACT EVENT AND ELECTRONIC DEVICE SUPPORTING THE SAME}

Various embodiments of the present document relate to a method for reducing a reaction time based on a non-contact event and an electronic device supporting the same.

When the electronic device performs a specified function according to a user input, data (eg, continuity of input coordinates or continuity of pen input, etc.) Based on the , the purpose of the user input such as screen scroll adjustment, application execution, or drawing operation may be identified.

The electronic device may transmit data obtained based on a user input to hardware electrically connected to the electronic device, and may perform an operation desired by the user. The electronic device may determine and perform the purpose of various operations based on the user input by using software (eg, a program), but since the operations may accompany a change in the function of the hardware, the electronic device provides Difficulties may arise in efficiently using the function. When performing a specific function using software, the electronic device may request to transmit an instruction set to hardware related to the specific function to change the operation and/or function of the hardware. For example, when performing a screen scrolling function by analyzing user input or pen input data, the electronic device recognizes that the user has performed an input to scroll the screen and performs the screen scrolling operation using software, A picture corresponding to the screen scrolling operation may be drawn and outputted to the display through a graphic pipeline. When changing the refresh rate of the display to a high speed (e.g. 120Hz) for a different user experience, after analyzing the user input or pen input data, the processor sends the display to the display driving circuit (e.g. the display driver IC) A set of commands related to changing the refresh rate of the screen can be delivered, and a scroll operation (eg, drawing a picture corresponding to scrolling and outputting it to the screen) can be performed. In order to perform the operation of transmitting the command set for changing the screen refresh rate of the display, the electronic device may proceed in a queue buffer method, and may be processed simultaneously or sequentially with other command sets. Therefore, if other tasks are piled up in the queue buffer, the command set for changing the refresh rate of the display may not be reflected immediately. Also, as the number of instruction sets accumulated in the queue buffer increases, it may be delayed until the instruction set for changing the screen refresh rate of the display is reflected. Due to the delay time for the reflection of the instruction set, a change in the screen refresh rate of the display may be reflected after the scroll operation, and the delay may impair the user experience.

According to various embodiments disclosed in this document, it is possible to provide a method for reducing a reaction time according to the occurrence of a contact event by transmitting a command set based on the occurrence of a non-contact event, and an electronic device supporting the same.

An electronic device according to an embodiment of the present disclosure includes a display, a display driving circuit connected to the display, and a processor connected to the display and the display driving circuit, wherein the processor detects a non-contact event with respect to the display and , based on the detection of the non-contact event, transmits a set value for controlling the display to the display driving circuit, detects a touch event for the display, and based on the detection of the touch event, the display driving circuit The display may be controlled by using the set value.

An electronic device according to an embodiment of the present disclosure includes a display, a display driving circuit connected to the display, an antenna module, a memory for storing an application, and functionally connected to the display, the display driving circuit, the antenna module, and the memory a processor, wherein the processor identifies whether a location at which a non-contact event is sensed on the display corresponds to a designated area of the display, and as it identifies that the location at which the non-contact event is detected corresponds to the designated area, transmits a wake-up command to the display driving circuit and transmits a wake-up command to the antenna module of the electronic device for the application, according to detection of a contact event for at least a part of the designated area, the and send an on command of the display to the display driving circuit.

An electronic device according to an embodiment of the present disclosure includes a display including a fingerprint sensor, a display driving circuit connected to the display, and a processor connected to the display and the display driving circuit, wherein the processor includes: Identifies whether the position at which the non-contact event is detected corresponds to the position of the fingerprint sensor, and when it is identified that the position at which the non-contact event is detected corresponds to the position of the fingerprint sensor, a wake is sent to the fingerprint sensor driving circuit connected to the fingerprint sensor transmits an up command, determines a scan area of the fingerprint sensor based on the position at which the non-contact event is sensed, and controls the fingerprint sensor driving circuit to scan the scan area according to detection of a touch event on the display can do.

In the storage medium storing instructions according to an embodiment of the present disclosure, the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor, The operation is an operation of detecting a non-contact event for a display functionally connected to the processor, and a setting value of changing an interface mode of the display to a display driving circuit functionally connected to the processor according to the detection of the non-contact event , an operation of detecting a touch event with respect to the display, and an operation of the display driving circuit controlling the display by using the setting value based on the detection of the touch event.

An electronic device and method according to various embodiments disclosed in this document transmit at least a portion of a command set for a specific function to a display device based on, for example, occurrence of a non-contact event that satisfies a specified condition. , compared to a method of performing a specific function by analyzing input data after a contact event occurs, the user experience can be improved by reducing the time for performing the specific function, and resources such as a battery can be saved.

1 is a block diagram of an electronic device in a network environment according to an embodiment.
2 is a block diagram of a display device included in an electronic device, according to an exemplary embodiment.
3 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
4 is a diagram schematically illustrating a structure of a capacitive sensor of an electronic device according to an exemplary embodiment;
5 is a graph illustrating a correlation between the brightness of a signal input to a display of an electronic device and a gamma value of the output luminance, according to an exemplary embodiment.
6 is a flowchart illustrating operations of an electronic device according to time sequence according to an exemplary embodiment.
7 is a flowchart illustrating operations of an electronic device according to a time sequence according to an exemplary embodiment.
8 is a flowchart illustrating operations of an electronic device according to time sequence according to an exemplary embodiment.
9 is a flowchart illustrating operations of an electronic device according to time sequence according to an exemplary embodiment.
10 is a diagram schematically illustrating a fingerprint sensor of an electronic device according to an exemplary embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included.

Hereinafter, a configuration and operation of an electronic device according to an exemplary embodiment will be described with reference to FIGS. 1 to 5 .

1 is a block diagram 100 of an electronic device in a network environment according to an embodiment. 2 is a block diagram 200 of a display device 160 according to an exemplary embodiment. 3 is a flowchart 300 illustrating an operation of an electronic device according to an exemplary embodiment. 4 is a diagram schematically illustrating a structure 400 of a capacitive sensor of an electronic device according to an exemplary embodiment. 5 is a graph 500 illustrating a correlation between the brightness of a signal input to a display of an electronic device and a gamma value of the output brightness, according to an exemplary embodiment.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the nonvolatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with the external electronic device 104 through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal (eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 and 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more of the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^™ ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram 200 of a display device 160 according to various embodiments of the present disclosure. Referring to FIG. 2 , the display device 160 may include a display 210 and a display driver integrated circuit (DDI) 230 for controlling the display 210 . The DDI 230 may include an interface module 231 , a memory 233 (eg, a buffer memory), an image processing module 235 , or a mapping module 237 . The DDI 230 receives, for example, image data or image information including an image control signal corresponding to a command for controlling the image data from other components of the electronic device 101 through the interface module 231 . can do. For example, according to one embodiment, the image information is the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 (eg, an application processor) operated independently of the function of the main processor 121 ( For example, a graphic processing device) The DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231. In addition, the DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231. At least a portion of the received image information may be stored in the memory 233, for example, in units of frames. The memory 233 may include a register 234, and the register 234 may include: A setting value for performing a function of the electronic device 101 may be stored. The image processing module 235 may, for example, apply at least a portion of the image data to the characteristics of the image data or the characteristics of the display 210 . Pre-processing or post-processing (eg, resolution, brightness, or size adjustment) may be performed based on at least a voltage corresponding to the image data pre-processed or post-processed by the image processing module 135 . A value or a current value may be generated.According to one embodiment, the generation of a voltage value or a current value may include, for example, a property of the pixels of the display 210 (eg, an arrangement of pixels (RGB stripe or pentile structure); or the size of each of the sub-pixels.) At least some pixels of the display 210 are driven based at least in part on the voltage value or the current value to correspond to the image data. Visual information (eg, text, image, or icon) may be displayed through the display 210 .

According to an embodiment, the display device 160 may further include a touch circuit 250 . The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251 . The touch sensor IC 253 may control the touch sensor 251 to sense a touch input or a hovering input for a specific position of the display 210 , for example. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 210 . The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 250 (eg, the touch sensor IC 253 ) is a part of the DDI 230 , the display 210 , or another device disposed outside the display device 160 . It may be included as part of a component (eg, the coprocessor 123 ).

According to an embodiment, the display device 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display device 160 (eg, the display 210 or the DDI 230 ) or a part of the touch circuit 250 . For example, when the sensor module 176 embedded in the display device 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 210 . (eg, fingerprint image) can be acquired. As another example, when the sensor module 176 embedded in the display device 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 210 . can According to an embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of the pixel layer of the display 210 , or above or below the pixel layer.

3 is a flowchart 300 illustrating an operation of the electronic device 101 according to an exemplary embodiment. Hereinafter, an operation of the electronic device 101 according to an embodiment of the present disclosure may be performed by the processor 120 of the electronic device 101 .

1 to 3 , in operation 301 , the electronic device 101 may detect a non-contact event with respect to the display 210 of the electronic device 101 .

According to an embodiment, the non-contact event is the hovering or air of a user's hand or a pen (eg, a digital pen or a stylus pen, etc.) with respect to the display 210 of the display device 160 of the electronic device 101 . It may include at least one of an air gesture. According to an embodiment, the air gesture is an operation performed without contacting the screen of the display 210 using the user's hand or pen (eg, moving the user's finger or palm from one side of the display 210 to the other side). movement, a user's hand clenching a fist, or using a digital pen) may be performed. According to an embodiment, the electronic device 101 uses the touch sensor IC 253 of the display device 160 to generate a signal (eg, voltage, resistance, or amount of charge) due to an external object approaching the display 210 . Hovering or air gestures can be detected by measuring changes in The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the detected hovering or air gesture to the processor 120 .

According to an embodiment, the electronic device 101 may measure information on hovering or air gesture in various ways. For example, the electronic device 101 may use a capacitive method, a resistive method, a capacitive method, an infrared method, or an ultrasonic method to sense a touch input, and a method for the electronic device 101 to recognize hovering is not limited to the present disclosure.

According to an embodiment, the electronic device 101 may electrostatically detect a non-contact event or a contact event. 4 is a diagram schematically illustrating a structure 400 of a capacitive sensor for detecting a non-contact event or a contact event by the electronic device 101 according to an embodiment.

Referring to FIG. 4 , the electronic device (eg, the display device included in the electronic device 101 of FIG. 1 (eg, the display device 160 of FIG. 1 ) includes a first electrode 401 and a second electrode 402 ). and a capacitance 403, and a cover glass 404 to cover the first electrode 401, the second electrode 402, and the capacitance 403. The capacitance 403 includes: For example, it may be positioned between the first electrode 401 and the second electrode 402. According to an embodiment, the electronic device 101 includes a first electrode 401 and a second electrode 402. ), an approach of the external object 4 to the display device 160 may be detected based on the measurement of the value of the capacitance 403 connecting the . For example: when a finger) approaches the cover glass 404 of the electronic device, the electrostatic capacity of the capacitance 403 may be measured differently depending on the degree to which the external object 4 approaches the electronic device, and the electronic device The external object 4 may be sensed according to a change in electrostatic capacity measured by the capacitance 403 between the first electrode 401 and the second electrode 402 .

Referring back to FIGS. 1 to 3 , in operation 302 , the electronic device 101 determines the level of change in a numerical value (eg, electrostatic capacity) determined based on a non-contact event (eg, a hovering input) to a threshold value ( threshold) or not. According to an embodiment, when the electronic device 101 uses a capacitive sensor to detect a non-contact event or a contact event, the amount of change in capacitance of the capacitive sensor is measured and the degree of hovering input ( level) can be checked. For example, when the level of the hovering input is less than or equal to the threshold value, it is determined that there will be no user's subsequent action (eg, a contact event), and the process may be terminated without an action for the non-contact event. In operation 302 , when the degree of the hovering input is greater than a threshold value as a result of comparison or determination, the electronic device 101 may, for example, perform operation 303 . According to an embodiment, the level of the hovering input may be determined according to a distance between an external object and the display 210 of the electronic device 101 . For example, when the distance between the external object and the display 210 of the electronic device 101 is greater than a predetermined distance, the capacitance change amount may be measured to be low.

According to an embodiment, in operation 303, when the degree of the hovering input is greater than a threshold value, the electronic device 101 performs an operation according to a non-contact event (hereinafter, 'operation according to a non-contact event' is mixed with a 'pre-operation') can be used.) can be performed. According to an embodiment, the operation according to the non-contact event may be that the processor 120 transmits at least a part of the instruction set for performing a specific function (eg, change of the screen refresh rate) of the display device 160 to the DDI 230 . have.

According to an embodiment, the specific function may be to adjust a screen refresh rate. According to an embodiment, the specific function may be to increase the screen refresh rate. For example, the specific function may be to increase the screen refresh rate from 60 Hz to 120 Hz.

According to an embodiment, the screen refresh rate may mean how many times a display screen can be output in 1 second. For example, the screen refresh rate may be used synonymously with a screen refresh rate or a screen refresh rate. Since the screen refresh rate increases as the number of Hertz (Hz), which is a unit of the screen refresh rate, increases, the electronic device 101 may provide a smoother and more continuous moving screen to the user by increasing the screen refresh rate. According to an embodiment, the electronic device 101 variably adjusts the screen refresh rate according to the power state of the electronic device 101 , the use state of the electronic device, and the display state (eg, on/off/sleep mode, etc.). Can be adjusted.

According to an embodiment, the instruction set for performing a specific function (eg, change of the screen refresh rate) simultaneously reflects the values of the register 234 defining the setting values of detailed functions of the electronic device 101 and each value (eg, : May include a masking key to enable or update). In order to perform a specific function (eg, change of the screen refresh rate), it is necessary to change the settings of a plurality of logic and/or components, and the changed setting values must be applied in units of function blocks and/or roles. It is possible to prevent abnormal operations (eg, screen irregularity, etc.) in the process of switching to a specific function (eg, changing the screen refresh rate). Accordingly, based on the occurrence of a non-contact event that satisfies a specific condition, the electronic device 101 applies, for example, various pre-tasks for performing a specific function (eg, a finally changed setting among a set of commands for performing a specific function). The processor 120 transmits the instruction set excluding the instruction set related to the operation to the DDI 230). In this case, since the electronic device 101 performs a pre-operation, a specific function (eg, change of the screen refresh rate) may not be actually performed.

For example, when detecting a hovering motion in which a finger approaches before a touch input, the electronic device 101 increases the screen refresh rate of the display device 160 in preparation for an action corresponding to the touch input (eg, screen scrolling). A part of the instruction set for changing may be transmitted to the DDI 230 first. For example, when the electronic device 101 receives a touch input (eg, when receiving a touch input for adjusting screen scrolling), the screen refresh rate that the processor 120 transmits to the DDI 230 is changed (eg, upward). When a command to apply a command set for , to the display device 160 is transmitted, the screen refresh rate may be changed without delay. The description of the instruction set will be described in detail with reference to [Table 1] below.

For another example, in the case of an input using a digital pen or the like, the processor 120 detects an approach of the pen to the display 210 (eg, a hovering input by the pen) and the pen touches the display 210 . A command set for changing the screen refresh rate (eg, upward) may be transmitted to the DDI 230 before, and when a contact of the pen with the display 230 is detected, the screen refresh rate may be increased to perform smooth drawing without delay.

According to an embodiment, when the contact of the pen with the display 210 is not detected, the hovering level is lowered, or the hovering is not detected for a specified period of time, the electronic device 101 sets the screen refresh rate. You can keep the previous screen refresh rate without executing a set of commands to make changes (eg upwards).

According to an embodiment, the electronic device 101 checks the time it takes for the transmitted command to be actually reflected, and selects a command to be transmitted to the DDI 230 as a pre-operation according to the detection of a non-contact event based on the checked time. can

For example, the electronic device 101 may select a command for which the time required for the command transmitted to the DDI 230 to be actually executed is two or more frames as a command to be transmitted as a pre-action, and when the non-contact event occurs, a command selected as a pre-action may be transmitted to the DDI 230 .

In this way, the electronic device 101 transmits a command that takes a relatively long time to be actually executed to the DDI 230 even when only a non-contact event occurs before the contact event occurs, so that a specific function (eg, change of the screen refresh rate) is performed. You can see the effect of reducing the execution time. According to an embodiment, an operation according to a non-contact event (pre-operation) and an operation according to a contact event (this operation) may be as shown in [Table 1].

When the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 302 , the processor 120 may check the state of the electronic device 101 whether the screen refresh rate can be changed. According to an embodiment, the processor 120 may change the screen refresh rate when the remaining power of the battery 189 of the electronic device 101 is less than or equal to a specified value or when the screen refresh rate is set so that the user cannot change the screen refresh rate. It can be considered an impossible situation. If the screen refresh rate is increased, since high battery consumption may occur, the electronic device 101 may, for example, check the remaining amount of power of the battery 189 and check a condition for change. According to an embodiment, when the processor 120 determines that it is impossible to change the screen refresh rate, the processor 120 may not transmit a command set for changing the screen refresh rate (eg, upward) to the display driving circuit 230 . .

According to an embodiment, the processor 120 is a set of instructions for increasing the screen refresh rate of the display 210 as a pre-operation according to the detection of a non-contact event, based on the application 146 executed in the electronic device 101 . Alternatively, it may be determined whether to transmit a downlink instruction set to the DDI 230 . For example, in the electronic device 101, when the application 146 is an image playback application, the screen refresh rate (eg, 60 Hz) of the display 210 at the time of detection of the non-contact event is lower than that of a frame (eg, 24 fps). When an image file is to be reproduced, commands related to a downgrade of the screen refresh rate may be transmitted to the DDI 230 as a pre-operation according to the detection of a non-contact event. According to an embodiment, when the application 146 is an image playback application, the processor 120 plays the video playback application while detecting a non-contact event for an icon for executing the image playback application or while the image playback application is running. When a non-contact event for the icon is detected, commands related to a screen refresh rate downgrade may be transmitted to the DDI 230 as a pre-action. According to an embodiment, a prior operation is not performed when a non-contact event is detected with respect to an icon for the execution of an image playback application, but when a non-contact event with respect to a playback icon is detected while the image playback application is running, a preliminary operation may be performed. This may be because, in the case of video playback, it is not necessary to change the screen refresh rate until the play button is pressed.

According to an embodiment, the electronic device 101 detects the non-contact event when the application 146 is a game application and the game content has a higher frame rate than the screen refresh rate of the display 210 when the non-contact event is detected. As a pre-operation according to , commands related to raising the screen refresh rate may be transmitted to the DDI 230 to the DDI 230 . In addition, the electronic device 101, for example, is an application in which the application 146 performs a handwriting input according to a pen input from the outside, and does not require a frame rate higher or lower than the screen refresh rate of the display 210 when a non-contact event is detected. Otherwise, commands for raising or lowering the screen refresh rate may not be transmitted to the DDI 230 .

According to an embodiment, when the processor 120 determines that it is possible to change the screen refresh rate, the processor 120 sends to the display device 160 one of the commands included in the instruction set for changing the screen refresh rate (eg, upward). At least part of it can be transmitted.

According to an embodiment, the command set for changing the screen refresh rate (eg, upward) may include a command for changing the clock setting of the DDI 230 . According to an embodiment, when the screen refresh rate is increased from 60 Hz to 120 Hz, the command set for changing the screen refresh rate (eg, upward) may include a command for changing the clock of the DDI 230 from 45 MHz to 90 MHz.

Also, according to an embodiment, the command set for changing the screen refresh rate (eg, upward) may include a command for changing the setting of a gamma value or a gamma correction value for a target screen refresh rate. can According to an embodiment, as the screen refresh rate is changed, the image quality characteristics of the panel set as the target gamma value may be changed, and the command set for changing the screen refresh rate (eg, upward) is a gamma for correcting the target gamma value. It may include a command for setting a correction value.

5 is a graph 500 illustrating a correlation between the brightness of a signal input to a display of an electronic device and a gamma value of the output brightness, according to an exemplary embodiment. Referring to FIG. 5 , the x-axis of the graph 500 may represent the gray scale of a signal input to the display, and the y-axis may represent the luminance output to the screen of the display.

The gamma value may mean, for example, a numerical value capable of determining a correlation between the gray level of a signal input to the display and the luminance of an image displayed on the display screen. For example, even on the same display screen, differences in brightness tones that can be expressed according to gamma values may occur. For example, when the gamma value is 1 (501), the brightness of the input and output of the display screen is the same, but when the gamma value is greater than 1 (502), the display screen is relatively relative to the input value in the middle or low gray scale region. may be displayed as dark. When the gamma value is less than 1, the display screen may be expressed relatively brightly compared to the input value. According to an embodiment, the display device 160 may set the gray scale of the input signal and the output luminance differently according to the gamma value as shown in FIG. 5 . According to an embodiment, the electronic device may set the gamma values differently based on the screen refresh rate.

According to an embodiment, when the screen refresh rate is raised from 60 Hz to 120 Hz, the command set for changing the screen refresh rate (eg, upward) may include a command for changing from a gamma value correction set for 60 Hz to a gamma value correction set for 120 Hz. have.

Also, according to an embodiment, the command set for changing the screen refresh rate (eg, upward) changes the timing related setting value of the driver included in the backplane of the display 210 to correspond to the target screen refresh rate. command may be included. According to an embodiment, the timing-related setting value of the back plane of the display 210 is a 　 vertical back porch (VBP), a vertical 　 signal output waiting time (VFP, vertical 　 front porch), and a vertical signal High Level Holding time (VSPW,　vertical sync pulse width), Horizontal signal 　output latency (HBP, horizontal back porch), Latency after horizontal signal output (HFP, horizontal front porch), Horizontal signal High Level holding time (HSPW, horizontal sync pulse) width), pixel charging time, and the like.

According to an embodiment, the processor 120 of the electronic device 101 provides a command for changing a setting of a clock of the DDI 230, a command for changing a setting of a gamma value, and/or a display ( 210 transmits at least a part of a command set related to a specific function (eg, screen refresh rate increase) including at least one of commands for changing a timing related setting value of a backplane of 210 to the display device 160 (pre-operation )can do. Then, in operation 304, it is possible to detect the occurrence of a contact event.

In the embodiment described with reference to FIGS. 3 and 4 , it is a command transmitted to the display device 160 as a pre-operation according to the detection of a non-contact event that satisfies a condition, and changes the clock setting of the DDI 230 . A command, a command for changing a setting of a gamma value, and a command for changing a setting value related to timing of a backplane of the display 210 are exemplified, but this is only an example and may vary according to an embodiment. Some of these commands may be omitted, and some settings may be merged and changed into one command.

In operation 304 , the electronic device 101 may detect a contact event with respect to the display 210 . For example, the touch circuit 250 of the electronic device 101 determines whether an external object in contact with the display 210 is in contact, and when the external object touches a portion of the display 210 , the touch sensor Through (251), it is possible to recognize and detect a contact event. According to an exemplary embodiment, the contact event may mean occurrence of a touch of a user's finger or a digital pen with respect to the display 210 .

In operation 305, when the touch event is detected in operation 304, the electronic device 101 performs an operation according to the touch event (in this specification, 'operation according to a contact event' may be used interchangeably with 'this operation'). can be done According to an embodiment, in operation 305 , when the touch event is detected, the electronic device 101 may increase the screen refresh rate according to the touch event.

According to an embodiment, referring to [Table 1], the processor 120 may increase the CPU and/or GPU clock according to a screen refresh rate targeted by this operation. In [Table 1], the processor (eg, CPU and/or GPU) clock increase is included in this operation, but according to an embodiment, the processor (eg, CPU and/or GPU) clock increase is preset according to the situation of the processor 120 . It can also be included in the action.

In addition, according to an embodiment, referring to [Table 1], the display device 160 displays a command set for changing the screen refresh rate (eg, upward) received in the pre-operation according to the detection of the touch event. 160) can be applied to perform the driving operation. For example, the electronic device 101 may perform a setting value and/or a command and control the DDI 230 to control the display 210 based on the set value. According to an embodiment, the electronic device 101 may perform an operation of updating the register 234 . According to an embodiment, the display device 160 uses the DDI clock setting value, the gamma setting value, and/or the timing related setting value of the backplane included in the received command according to the detection of the touch event. 230 may be controlled and the display 230 may be controlled based thereon. According to an embodiment, the instruction set for changing the screen refresh rate (eg, upward) received in the pre-operation does not affect the operation of the display device 160 until the register 234 is updated. ) is stored in the memory 233 (eg, buffer memory) included in the DDI 230 of the DDI 230 , and after the display device 160 updates the register 234 with this operation according to the detection of a touch event, the display ( 210), the frame may be displayed using the changed setting value from the next frame. Accordingly, the screen refresh rate can be directly increased by updating the register 234 of the display device 160 , and the electronic device 101 performs an operation corresponding to the user's contact event (eg, the screen when the screen refresh rate is increased). scrolling) can be performed without delay.

Also, according to an embodiment, as the touch event is detected, the electronic device 101 may control the interlocking component related to the reception of the contact event through this operation. According to an embodiment, the interlocking component related to the reception of a contact event may include a touch sensor IC 253 , a digitizer for detecting a digital pen, and the like. According to an embodiment, the control of the interlocking component related to the reception of the touch event may change the timing of transmitting the coordinates at which the user's touch event is received to the processor 120 according to the change of the screen refresh rate, or according to the change of the screen refresh rate. Since the noise of the display 210 may be changed, the frequency for detecting the user's touch event may be changed to avoid the changed noise.

When the touch event is not detected in operation 304 , the electronic device 101 may not perform an operation according to the contact event. According to an embodiment, the electronic device 101 may determine that the touch event is not detected, and may not change the screen refresh rate, which is an operation according to the touch event.

According to the above-described embodiments, when the electronic device 101 analyzes input data and increases the screen refresh rate after the occurrence of a contact event, it takes several frames to several tens of frames or several hundred ms (milliseconds) or more. However, the electronic device 101 transmits in advance at least a part of a command set for changing the screen refresh rate (eg, upward) to the display device 160 according to the occurrence of a non-contact event that satisfies the condition, so that the screen refresh rate at the point of occurrence of the contact event It is possible to reduce the time it takes for this to increase. Therefore, an increase in the screen refresh rate is required in an operation according to the user's touch event (eg, screen scroll adjustment), but it takes time to change the screen refresh rate, so the operation (eg, screen scroll adjustment) according to the user's touch event is started. It is possible to solve the problem that the screen refresh rate is increased after or when it is finished, and the improvement in the screen refresh rate is reflected at an appropriate time to provide a response of the display 210 to an operation (eg, screen scroll adjustment) according to a contact event. This can improve the user experience.

Hereinafter, an operation of the electronic device according to an exemplary embodiment will be described with reference to FIGS. 1, 2 and 6 . Configurations and operations identical to those of the above-described embodiment may be referred to by the same reference numerals, and descriptions thereof may be omitted.

6 is a flowchart 600 illustrating an operation of an electronic device according to a time sequence according to an exemplary embodiment.

1, 2, and 6 , in operation 601 , the electronic device 101 may detect a non-contact event with respect to the display 210 of the electronic device 101 . The description of the non-contact event may be the same as in the above-described embodiment. In the embodiment described with reference to FIG. 6 , it is assumed that the non-contact event is a hovering input. According to an embodiment, the operation of the electronic device 101 detecting the non-contact event with respect to the display 210 is that an object external to the display 210 approaches a part of the electronic device (eg, the display 210 ). It may be to detect that a non-contact event has occurred based on an amount of change in capacitance of an external object using the touch circuit 250 in an approaching situation.

According to an embodiment, the electronic device 101 may determine whether the degree of the non-contact event (eg, a hovering input) is greater than a threshold value in operation 602 , and in operation 603 , the electronic device 101 determines whether the degree of the non-contact event is If it is greater than the threshold value, an operation (pre-operation) according to the non-contact event may be performed. Descriptions of operations 602 and 603 may be the same as those of operations 302 and 303 of FIG. 3 described above, and detailed descriptions thereof will be omitted.

According to an embodiment, the operation (pre-operation) according to the non-contact event may be that the processor 120 transmits at least a portion of an instruction set for performing a specific function of the display device 160 to the DDI 230 . For example, in the embodiment described with reference to FIG. 6 , a specific function is to change an interface mode of the display 210 from a command mode to a video mode or vice versa. it could be According to an embodiment, the video mode may mean a mode in which a single image is transmitted from the processor 120 to the DDI 230 even when there is no change in the image, and the command mode is only when there is a change in the image. It may refer to a mode in which only information necessary for a corresponding change is transmitted from the processor 120 to the DDI 230 . According to an embodiment, the video mode may increase power consumption of the electronic device 101 , and the electronic device 101 selects one of the video mode and the command mode according to screen switching speed and priority determination of power consumption. can

For example, when the electronic device 101 detects a hovering motion approaching by a finger or a digital pen that satisfies a predetermined condition, one of the command sets for changing the interface mode of the display 210 in preparation for an action corresponding to a touch input A portion may be transmitted to the DDI 230 first.

According to an embodiment, when the pen touches the display 230 for a specified period of time, when the hovering level is lowered, or when the hovering is not detected, the electronic device changes the interface mode of the display 210 You can keep the previous interface mode without executing the command set for .

According to an embodiment, the electronic device 101 checks the time it takes for the transmitted command to be actually reflected, and selects a command to be transmitted to the DDI 230 as a pre-operation according to the detection of a non-contact event based on the checked time. can

For example, the electronic device 101 selects a command for which the time required for the command transmitted to the DDI 230 to be actually executed is 2 frames or more as a command to be transmitted as a pre-action, and when a non-contact event occurs, the command selected as a pre-action is selected as the DDI It can be transmitted to (230).

In this way, the electronic device 101 transmits a command that takes a relatively long time to actually be executed to the DDI 230 even when only a non-contact event occurs before the contact event occurs, so that a specific function (eg, change of the display interface) is performed. You can see the effect of reducing the execution time. According to an embodiment, an operation according to a non-contact event (pre-operation) and an operation according to a contact event (this operation) may be as shown in [Table 2]. According to an embodiment, it may take two or more frames to change the interface mode of the display 210 .

According to an embodiment, in order to perform a specific function (eg, change of display interface mode), it is necessary to change the settings of a plurality of logic and components, and to apply the changed setting values in units of function blocks and/or roles. It is possible to prevent an abnormal operation displayed in the process of the display device 160 being switched to a specific function. Accordingly, based on the occurrence of a non-contact event that satisfies a specific condition, the electronic device 101 excludes a part of a command set related to applying a finally changed setting among various pre-operations (eg, among command sets) for performing a specific function. and the processor 120 transmits the excluded instruction set to the DDI 230) first. In this case, since the electronic device 101 performs only a preliminary operation, a specific function (eg, change of the interface mode of the display) may not be performed.

According to an embodiment, the operation according to the non-contact event (pre-operation) and the operation according to the contact event (this operation) for changing the interface mode of the display 210 from the command mode to the video mode are as shown in [Table 2]. can

As the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 602 , in operation 603 , the processor 120 determines the interface mode of the display 210 as the video mode and enters the video mode. The corresponding setting value may be transmitted to the DDI 230 of the display device 160 . According to an embodiment, the DDI 230 that has received the setting value for the video mode may store the received setting value.

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 604 , the electronic device 101 may perform an operation (this operation) according to the touch event in operation 605 . have.

According to an embodiment, when the electronic device 101 does not detect a contact event with respect to the display 210 in operation 604 , a specific function (eg, change of an interface mode of the display) may not be performed. The electronic device 101 may, for example, undo operations performed in the previous operation.

According to an embodiment, referring to [Table 2], the processor 120 may update the register 234 for applying the set value for the video mode to the processor 120 through this operation. Also, through this operation, the DDI 230 may update the register 234 for applying the set value for the video mode received from the processor 120 to the DDI 230 . According to an embodiment, the instruction set for changing to the video mode received from the pre-operation does not affect the actual operation of the electronic device 101 until the register 234 is updated, and the processor 120 and the DDI ( After being stored in the 230 , the register 234 is updated in this operation according to the detection of the touch event, the setting value may be applied from the next frame of the display 210 . Accordingly, the video mode may be switched by updating the register 234 of the processor 120 and the display device 160 .

Also, according to an embodiment, as the touch event is detected, the electronic device 101 may control the interlocking component related to the reception of the contact event through this operation. According to an embodiment, the interlocking component related to the reception of a contact event may include a touch sensor IC 253 , a digitizer for detecting a digital pen, and the like. According to an embodiment, in the control of the interlocking component related to the reception of the contact event, the touch sensor IC 253 and/or the digitizer interlock the display for interlocking the screen output of the display 210 and the user input to the display 210 . It may be a control to change the synchronization signal received from the DDI 230 in the command mode to that received from the processor 120 in the video mode.

Conversely, according to an embodiment, the operation according to the non-contact event (pre-operation) and the operation according to the contact event (this operation) for changing the interface mode of the display 210 from the video mode to the command mode are [Table 3] can be the same as

According to an embodiment, as the processor 120 of the electronic device 101 detects a non-contact event satisfying a condition in operation 602 , in operation 603 , the processor 120 sets the interface mode of the display 210 to the command mode. , and transmits a setting value according to the command mode to the DDI 230 of the display device 160 . According to an embodiment, the DDI 230 that has received the setting value for the command mode may store the received setting value.

According to an embodiment, as the processor 120 of the electronic device 101 detects a non-contact event that satisfies a condition in operation 602 , in operation 603 , the processor 120 sets a set value for the command mode to the processor ( The update of the register 234 applied to 120 may be performed. Also, the DDI 230 may update the register 234 by applying a set value for the command mode received from the processor 120 to the DDI 230 .

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 604 , the electronic device 101 may perform an operation (this operation) according to the touch event in operation 605 . have.

According to an embodiment, referring to [Table 3], in this operation, the processor 120 may transmit image data to the DDI 230 of the display device 160 .

Also, according to an embodiment, as the touch event is detected, the electronic device 101 may control the interlocking component related to the reception of the contact event through this operation. According to an embodiment, the interlocking component related to the reception of a contact event may include a touch sensor IC 253 , a digitizer for detecting a digital pen, and the like. According to an embodiment, the touch sensor IC 253 and the digitizer transmit a display interlocking synchronization signal for interworking the screen output of the display 210 and the user input to the display 210 from the processor 120 in the video mode. and may receive from the DDI 230 in the command mode. For example, assuming that the electronic device 101 receives an input through a user's finger or a digital pen after changing the interface mode of the display 210 from the video mode to the command mode, the touch sensor IC ( 253 ) and/or the digitizer may have to change the master device to receive the synchronization signal from the processor 210 to the DDI 230 . Therefore, according to an embodiment, the control of the interlocking component related to the reception of the touch event may be to control the touch sensor IC 253 and/or the digitizer to change the master device to receive the synchronization signal.

According to the above-described embodiments, when the electronic device 101 analyzes input data after the occurrence of the touch event and performs the operation of switching the display interface mode, it takes 2 to 3 frames after the occurrence of the contact event. 101) transmits at least a part of a command set for switching the display interface mode to the display device 160 according to the occurrence of a non-contact event that satisfies the condition, so that the time taken from the occurrence of the contact event until the display interface mode is changed can be reduced Accordingly, the change of the display interface mode may be reflected at an appropriate time to improve the user's experience.

Hereinafter, an operation of the electronic device according to an exemplary embodiment will be described with reference to FIGS. 1, 2 and 7 . Configurations and operations that are the same as those of the above-described embodiment may be referred to by the same reference numerals, and a description thereof may be omitted.

FIG. 7 is a diagram 700 illustrating an operation of an electronic device according to a chronological order according to an exemplary embodiment.

1, 2, and 7 , in operation 701 , the electronic device 101 may detect a non-contact event with respect to the display 210 of the electronic device 101 . The description of the non-contact event may be the same as the embodiment described with reference to FIG. 3 above. In the embodiment described with reference to FIG. 7 , it is assumed that the non-contact event is a hovering input.

According to an embodiment, in operation 702 , the electronic device 101 determines whether the degree of the non-contact event (eg, a hovering input) is greater than a threshold value, and in operation 703 , the electronic device 101 determines that the degree of the non-contact event is If it is greater than the threshold value, an operation (pre-operation) according to the non-contact event may be performed. Descriptions of operations 702 and 703 may be the same as those of operations 302 and 303 of FIG. 3 described above, and detailed descriptions thereof will be omitted.

According to an embodiment, in operation 703 , when the degree of the non-contact event is greater than a threshold value, the electronic device 101 may perform an operation (pre-operation) according to the non-contact event. According to an embodiment, the operation (pre-operation) according to the non-contact event may be that the processor 120 transmits at least a portion of an instruction set for performing a specific function of the display device 160 to the DDI 230 .

For example, in the embodiment described with reference to FIG. 7 , the specific function wakes up the display while the state of the display is in a sleep mode and prepares for an operation corresponding to a contact event. By performing an operation, an operation corresponding to the touch event occurring together with the display on may be quickly performed when a later contact event occurs. According to an embodiment, the operation corresponding to the generated contact event may include performing a function corresponding to the user's touch input position (eg, executing an application corresponding to the user's touch input position, etc.) in the future.

According to an embodiment, in the case of a sleep mode, in order for the electronic device 101 to reduce power consumption, the processor 120 , the display 210 , the touch panel, or an electric device (eg: It may include a state of maintaining the antenna module 197, the NFC module) in a low power state. For example, in the sleep mode, the electronic device 101 may keep the power of the display 210 turned off. For example, in the sleep mode, the electronic device 210 may perform an operation of displaying on at least a partial area while turning off or maintaining the minimum power of the display.

For example, in the embodiment described with reference to FIG. 7 , the specific function may be turning on the display 210 . In an embodiment, the specific function is a function corresponding to the user's input position at the same time as the display 210 is turned on (eg, an application (mobile payment application, music application, etc.) corresponding to the position at the user's contact input position. execution) may be performed.

Hereinafter, it is assumed that a specific function is the execution of a mobile payment service application according to an embodiment. For example, when the electronic device 101 detects a hovering motion approaching by a finger or a digital pen that satisfies a predetermined condition, the electronic device 101 provides a set of commands necessary for executing an application in preparation for an action corresponding to a touch input; At least one setting related to a function or the electronic device 101 may be performed in advance. For example, in the case of an application providing a mobile payment service, a part of a command set for executing the mobile payment service application may be transmitted to the DDI 230 first.

According to an embodiment, the electronic device 101 checks the time it takes for the transmitted command to be actually reflected, and selects a command to be transmitted to the DDI 230 as a pre-operation according to the detection of a non-contact event based on the checked time. can

For example, the electronic device 101 selects a command for which the time required for the command transmitted to the DDI 230 to be actually executed is 2 frames or more as a command to be transmitted as a pre-action, and when a non-contact event occurs, the command selected as a pre-action is selected as the DDI It can be transmitted to (230).

In this way, the electronic device 101 transmits a command that takes a relatively long time to be actually executed to the DDI 230 in advance even when only a non-contact event occurs before the contact event occurs, thereby executing a specific function (eg, a mobile payment system application). ) can be effective in reducing the time it takes to execute.

According to an embodiment, it may take two or more frames to execute the mobile payment service application of the mobile electronic device 101 . According to an embodiment, an operation according to a non-contact event (pre-operation) and an operation according to a contact event (this operation) for executing the mobile payment system application of the electronic device 101 may be as shown in [Table 4].

As the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 702 , in operation 703 , the processor 120 may determine the location of the non-contact event. According to an embodiment, the electronic device 101 may identify whether the detected non-contact event location corresponds to a designated area. For example, as a pre-operation, the processor 120 displays an interface for executing the mobile payment service application of the electronic device 101 on the display 210 when the display 210 is turned on at the location where the non-contact event occurs. You can check whether the location is adjacent to the location. A position where an interface for executing the mobile payment service application of the electronic device 101 is displayed may be variously changed according to a user interface (UI) design of the electronic device 101 . For example, in the case of an electronic device designed to execute a mobile payment service application when a user performs a specific action (eg, swiping) in some area (eg, the side of the electronic device) of the electronic device, the side of the electronic device is mobile An interface for executing a payment service application may be included in a displayed position. Alternatively, according to an embodiment, the location at which the interface for executing the mobile payment service application is displayed is an area adjacent to the area where the user's fingerprint is authenticated when the mobile payment service application is executed or when fingerprint recognition is performed during execution, or the corresponding fingerprint It may include a recognition area.

For example, when the display 210 is turned on, a position where an interface for executing a mobile payment service application of the electronic device 101 is displayed on the display 210 is a position adjacent to a position where a home key is displayed. can be

According to an embodiment, when the location where the non-contact event occurs corresponds to the location of the interface for executing the mobile payment service application, the processor 120 wakes up the component linked to the mobile payment service application as a pre-operation. up) can be done. For example, the associated component of the mobile payment service application may include at least one of a magnetic secure transmission (MST) antenna module and/or a near field communication (NFC) antenna module. Also, according to an embodiment, the operation for waking up the associated component may include at least one of supplying power to the associated IC and/or operating a booting sequence.

According to an embodiment, when the location where the non-contact event occurs corresponds to the location of the interface for executing the mobile payment service application, the processor 120 tells the DDI 230 to wake up ( wake-up) settings can be transmitted. According to an embodiment, the wake-up setting for the display 210 includes supplying power to the DDI 230 , the type of interface connecting the processor 120 and the DDI 230 (eg, a command mode or a video mode, etc.) and It may include at least one of a setting for speed, etc. and a luminance (nit) setting for displaying the display 210 .

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 704 , the electronic device 101 may perform an operation (this operation) according to the touch event in operation 705 . have. According to an embodiment, referring to [Table 4], in this operation, the processor 120 may transmit the execution screen image data corresponding to the user's contact event to the DDI 230 . For example, the image data may be an execution screen of a mobile payment service application.

According to an embodiment, when the electronic device 101 does not detect a touch event with respect to the display 210 in operation 704 , an operation (this operation) according to the touch event may not be performed. The electronic device 101 may, for example, undo operations performed in the previous operation.

Also, referring to [Table 4], according to an embodiment, in this operation, the DDI 230 may transmit a display on setting to the display panel. For example, when the DDI 230 transmits a display on setting to the display panel, a command for turning on the screen of the display 210 may be transmitted to the display panel.

Also, referring to [Table 4], according to an embodiment, in this operation, the processor 120 may perform an operation of the associated component. For example, the processor 120 may change the electronic device 101 from a low power mode to a normal mode, and may wake-up the touch sensor IC 253 and/or the digitizer. . According to an embodiment, in the low power mode, the power consumed for the operation of the linked part may be set to be lower than a specified value, and in the normal mode, the power consumed for the operation of the linked part is equal to or similar to the specified value. can be set.

According to the above-described embodiments, when the electronic device 101 transmits at least a part of a command set for executing the mobile payment service application to the display device 160 according to the occurrence of a non-contact event that satisfies a condition, the contact event occurs It is possible to reduce the time it takes to run the mobile payment service application because it transmits a command to turn on the display. Accordingly, the mobile payment service application may be executed at an appropriate time to improve the user's experience.

According to another embodiment, an operation according to a non-contact event (pre-operation) and an operation according to a contact event (this operation) for executing the mobile payment system application of the electronic device 101 may be as shown in [Table 5]. .

As the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 702 , in operation 703 , the processor 120 may determine the location of the non-contact event. For example, in the pre-operation I, the processor 120 displays an interface for executing the mobile payment service application of the electronic device 101 on the display 210 when the display 210 is turned on at the location where the non-contact event occurs. You can check whether the location is adjacent to the location being Also, for example, the processor 120 may identify a distance between the location where the non-contact event occurred and the display 210 .

According to an embodiment, the location where the non-contact event occurs corresponds to the location of the interface for executing the mobile payment service application, and the distance between the location where the non-contact event occurs and the display 210 is between the first value and the second value. In this case (here, the first value is smaller than the second value), the processor 120 may transmit a wake-up setting for the display 210 to the DDI 230 as a pre-action I. A description of the wake-up setting for the display 210 may be the same as the description described above with reference to [Table 4]. The first value may be, for example, a numerical value for determining whether the pre-action II is performed, and the second value may be, for example, a numerical value for determining whether the pre-action I is performed.

According to an embodiment, the location where the non-contact event occurs corresponds to the location of the interface for executing the mobile payment service application, and the user's finger or pen approaches the display and the distance between the location where the non-contact event occurs and the display 210 . When is decreased to less than or equal to the first value, the processor 120 may wake-up the biometric sensor, which is a component linked to the mobile payment service application, as a pre-operation II. That is, the pre-action II may be a case where the non-contact event occurrence location is closer to the display 210 than the pre-action I. According to an embodiment, the operation for waking up the associated component may include at least one of supplying power to the associated IC and a booting sequence operation.

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 704 , the electronic device 101 may perform an operation (this operation) according to the touch event in operation 705 . have. According to an embodiment, referring to [Table 5], the processor 120 may transmit, through this operation, execution screen image data corresponding to the user's contact event to the DDI 230, and the DDI 230 may display A display on setting may be transmitted to the display panel, and the processor 120 may perform an operation of the associated component. The description of this operation in [Table 5] may be the same as the description described above with reference to [Table 4].

According to the above-described embodiments, the electronic device 101 may perform a pre-operation of a non-contact event occurrence location for each distance from the display 210, and accordingly, when a non-contact event is highly likely to be connected to a contact event It is possible to prevent power consumption of the electronic device 101 by performing a pre-operation related only to .

According to another embodiment, when the non-contact event of the user is detected in operation 702 , the electronic device 101 may check the type of the application corresponding to the user's hovering position and set pre-operations for executing the application. For example, when the application corresponding to the user's hovering position is a music application, the electronic device 101 performs an operation or at least a part of a command for setting a connection for connecting a Bluetooth speaker previously connected to the music application as a pre-operation can do. According to an embodiment, when the electronic device 101 detects a user's contact event in operation 704, the display 210 is turned on and simultaneously controls the music application to use the Bluetooth speaker directly through the Bluetooth connection. can

Hereinafter, an operation of the electronic device according to an exemplary embodiment will be described with reference to FIGS. 1, 2 and 8 . Configurations and operations that are the same as those of the above-described embodiment may be referred to by the same reference numerals, and a description thereof may be omitted.

FIG. 8 is a diagram 800 illustrating an operation of an electronic device according to a chronological order according to an exemplary embodiment.

1, 2, and 8 , in operation 801 , the electronic device 101 may detect a non-contact event with respect to the display 210 of the electronic device 101 . The description of the non-contact event may be the same as in the above-described embodiment. In the embodiment described with reference to FIG. 8 , it is assumed that the non-contact event is a hovering input.

According to an embodiment, in operation 802 , the electronic device 101 determines whether the degree of the non-contact event (eg, a hovering input) is greater than a threshold value, and in operation 803 , the electronic device 101 determines whether the degree of the non-contact event is If it is greater than the threshold value, an operation (pre-operation) according to the non-contact event may be performed. Descriptions of operations 802 and 803 may be the same as those of operations 302 and 303 of FIG. 3 described above, and detailed descriptions thereof will be omitted.

According to an embodiment, the operation (pre-operation) according to the non-contact event may be that the processor 120 transmits at least a portion of an instruction set for performing a specific function of the display device 160 to the DDI 230 . For example, in the embodiment described with reference to FIG. 8 , a specific function may be to activate an optical fingerprint sensor included in the display 210 . For example, if the electronic device 101 detects a hovering motion approaching a finger or a digital pen satisfying a predetermined condition in operation 802 , the electronic device 101 prepares for an operation corresponding to the touch input, in operation 803 , the optical type included in the display 210 . A part of a set of commands for activating the fingerprint sensor may first be transmitted to the DDI 230 .

According to an embodiment, the electronic device 101 checks the time it takes for the transmitted command to be actually reflected, and selects a command to be transmitted to the DDI 230 as a pre-operation according to the detection of a non-contact event based on the checked time. can

For example, the electronic device 101 selects a command for which the time required for the command transmitted to the DDI 230 to be actually executed is 2 frames or more as a command to be transmitted as a pre-action, and when a non-contact event occurs, the command selected as a pre-action is selected as the DDI It can be transmitted to (230).

In this way, the electronic device 101 transmits a command that takes a relatively long time to actually be executed to the DDI 230 in advance even when only a non-contact event occurs before the contact event occurs, thereby providing a specific function (eg, activation of the optical fingerprint sensor). It can have an effect of reducing the time required to execute the . According to an embodiment, it may take two or more frames to activate the optical fingerprint sensor included in the display 210 .

According to an embodiment, an operation according to a non-contact event (pre-operation) and an operation according to a contact event (this operation) for activating the optical fingerprint sensor included in the display 210 may be as shown in [Table 6].

As the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 802 , in operation 803 , the processor 120 may identify the location of the non-contact event. For example, as a pre-operation I, the processor 120 may determine whether the location where the non-contact event occurs is adjacent to the location of the optical fingerprint sensor built into the display 210 . Also, for example, the processor 120 may identify a distance between the location where the non-contact event occurred and the display 210 .

According to an embodiment, when the location where the non-contact event occurs is adjacent to the location of the optical fingerprint sensor, and the distance between the location where the non-contact event occurs and the display 210 is between a first value and a second value (here, the first value) is less than the second value), the processor 120, as a pre-operation I, provides a command to display an interface guiding the position of the optical fingerprint sensor on the display 210 in an always on display (AoD) mode to the DDI 230 . can be sent to The first value may be, for example, a numerical value for determining whether the pre-action II is performed, and the second value may be, for example, a numerical value for determining whether the pre-action I is performed. According to an embodiment, the AoD mode may be a mode for displaying the date, time, remaining battery level, or a notification on the display 210 with low power consumption. According to an embodiment, a pre-operation of transmitting a command to the DDI 230 to display an interface guiding the position of the optical fingerprint sensor on the display 210 may be omitted. According to an embodiment, in order to use the optical fingerprint sensor as a light source, the electronic device 101 may activate (on) a partial area of the display 210 corresponding to the user's finger position determined by hovering.

According to an embodiment, the location where the non-contact event occurs is adjacent to the location of the optical fingerprint sensor, and the distance between the location where the non-contact event occurs and the display 210 is less than or equal to the first value when the user's finger or pen approaches the display. If it is decreased, the processor 120 may wake-up the optical fingerprint sensor in the sleep mode as a pre-operation II. That is, the pre-action II may be a case where the non-contact event occurrence location is closer to the display 210 than the pre-action I. According to an embodiment, the operation for waking up the optical fingerprint sensor may include at least one of supplying power to a related IC and/or operating a booting sequence.

According to an embodiment, the processor 120 may transmit a normal display mode setting to the DDI 230 as a pre-operation II. According to an embodiment, the normal display mode may be a mode for controlling the display while the electronic device 101 is in the normal mode, unlike the AoD mode for controlling the display while the electronic device 101 is in the low power mode. According to an embodiment, the normal display mode setting may include supplying power in a normal mode to the DDI 230 , a type of an interface connecting the processor 120 and the DDI 230 (eg, a command mode or a video mode, etc.) and/or It may include at least one of a setting for speed, etc. and a luminance (nit) setting for displaying the display 210 .

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 804, in operation 805, the electronic device 101 may perform an operation (this operation) according to the touch event. have. According to an embodiment, referring to [Table 6], with this operation, the DDI 230 may transmit a display on setting to the display panel, and the DDI 230 is positioned at a position corresponding to the optical fingerprint sensor. may be turned on so that at least a portion of the display area of the display can be used as a light source, and the DDI 230 is turned on for a portion area of the display corresponding to the contacted area or changes the property to be used as a light source You can control it to be displayed. The processor 120 may, for example, activate the optical fingerprint sensor and authenticate the received user's fingerprint data according to a contact event.

According to an embodiment, when the electronic device 101 does not detect a touch event with respect to the display 210 in operation 804 , an operation (this operation) according to the touch event may not be performed. The electronic device 101 may, for example, undo operations performed in the previous operation.

According to the above-described embodiments, the electronic device 101 transmits at least a part of a command set for activating the optical fingerprint sensor to the display device 160 according to the occurrence of a non-contact event that satisfies a condition, so that at the time of occurrence of the contact event The time required to activate the optical fingerprint sensor can be reduced. Accordingly, it is possible to solve the problem that the optical fingerprint sensor is activated after the occurrence of a contact event and the reaction speed is delayed, and the optical fingerprint sensor is activated at an appropriate time to improve the user's experience.

Hereinafter, an operation of the electronic device according to an exemplary embodiment will be described with reference to FIGS. 1, 2, 9 and 10 . Configurations and operations that are the same as those of the above-described embodiment may be referred to by the same reference numerals, and a description thereof may be omitted.

9 is a flowchart 900 illustrating operations of an electronic device according to time sequence according to an exemplary embodiment. 10 is a diagram 1000 schematically illustrating a fingerprint sensor of an electronic device according to an exemplary embodiment.

1, 2, 9 and 10 , in operation 901 , the electronic device 101 may detect a non-contact event with respect to the display 210 of the electronic device 101 . The description of the non-contact event may be the same as in the above-described embodiment, and a detailed description thereof will be omitted. In the embodiment described with reference to FIGS. 9 and 10 , it is assumed that the non-contact event is a hovering input.

According to an embodiment, in operation 902 , the electronic device 101 may determine whether the degree of the non-contact event (eg, a hovering input) is greater than a threshold value, and in operation 903 , the electronic device 101 determines that the degree of the non-contact event is If it is greater than the threshold value, an operation (pre-operation) according to the non-contact event may be performed. Descriptions of operations 902 and 903 may be the same as those of operations 302 and 303 of FIG. 3 described above, and detailed descriptions thereof will be omitted.

According to an embodiment, in operation 903 , when the degree of the non-contact event is greater than a threshold value, the electronic device 101 may perform an operation (pre-operation) according to the non-contact event. According to an embodiment, the operation (pre-operation) according to the non-contact event may be that the processor 120 transmits at least a portion of an instruction set for performing a specific function of the display device 160 to the DDI 230 . For example, in the embodiment described with reference to FIG. 9 , the specific function may be activation of a specific area 1002 of the large-area fingerprint sensor 1001 of FIG. 10 included in the display 210 . For example, when the electronic device 101 detects a hovering motion approaching by the finger 10 or the digital pen that satisfies a predetermined condition, the large-area fingerprint sensor included in the display 210 prepares for an action corresponding to a touch input. A part of the instruction set for activating the specific region 1002 of 1001 may be transmitted to the DDI 230 first. In this case, the specific area 1002 may mean an area corresponding to the area 1004 in which the finger 10 or the digital pen approaches the display 210 among the large-area fingerprint sensors 1001 . Accordingly, the electronic device 101 may check a time taken for the transmitted command to be actually reflected, and based on the checked time, select a command to be transmitted to the DDI 230 as a pre-operation according to the detection of the non-contact event.

For example, the electronic device 101 selects a command for which the time required for the command transmitted to the DDI 230 to be actually executed is 2 frames or more as a command to be transmitted as a pre-action, and when a non-contact event occurs, the command selected as a pre-action is selected as the DDI It can be transmitted to (230).

In this way, the electronic device 101 transmits a command that takes a relatively long time to be actually executed to the DDI 230 in advance even if only a non-contact event occurs before the contact event occurs, thereby providing a specific function (eg, the large-area fingerprint sensor 1001 ). ), the effect of reducing the time taken for the activation of the specific region 1002) can be seen.

According to an embodiment, it may take two or more frames to activate the specific region 1002 of the large-area fingerprint sensor 1001 included in the display 210 . An operation according to a non-contact event (pre-operation) and an operation according to a contact event (main operation) for activation of a specific region 1002 of the large-area fingerprint sensor 1001 included in the display 210 according to an embodiment may be as shown in [Table 7].

As the processor 120 of the electronic device 101 detects a non-contact event that satisfies the condition in operation 902 , in operation 903 , the processor 120 may identify a location 1004 of the non-contact event. For example, as a pre-operation of the processor 120 or the display device 160 , the location 1004 where the non-contact event occurred is at least one fingerprint sensor included in the large-area fingerprint sensor 1001 built into the display 210 . You can check whether the location corresponds to .

According to an embodiment, when the location 1004 at which the non-contact event occurs corresponds to the location of at least one fingerprint sensor included in the large-area fingerprint sensor 1001 , the processor 120 or the display device 160 performs a pre-operation For example, the display 210 may be controlled to display an interface guiding the location of at least one fingerprint sensor included in the large-area fingerprint sensor 1001 on the display 210 in the AoD mode. According to an embodiment, in the large-area fingerprint sensor 1001 included in the display device 160 , a plurality of fingerprint sensors capable of detecting a fingerprint may be partitioned in a check pattern, and the A guide interface for inducing a finger to come into contact may be displayed in at least one area adjacent to the non-contact event 1004 that has occurred among the partitioned plurality of fingerprint detection sensors. According to an embodiment, the region to display the guide interface for inducing contact of a finger is one of at least one region adjacent to the region 1004 in which the non-contact event occurred, the movement speed of the finger, the direction and/or the distance from the surface of the display, etc. An area in which a contact event is expected to occur may be determined based on at least one.

According to an embodiment, in operation 903 , the processor 120 may wake-up the large-area fingerprint sensor 1001 in the sleep mode as a pre-operation. According to an embodiment, the operation for waking up the large-area fingerprint sensor 1001 may include at least one of supplying power to the fingerprint sensor IC and/or operating a booting sequence.

According to an embodiment, in operation 903 , the processor 120 determines as an area to activate at least one sensor among a plurality of fingerprint detection sensors partitioned in a check pattern in the large-area fingerprint sensor 1001 as a pre-operation. can According to an embodiment, the region to be activated of the large-area fingerprint sensor 1001 based on at least one of at least one region adjacent to the region where the non-contact event occurred, the movement speed of the finger, the direction, and/or the distance from the surface of the display. (1002) can be determined.

According to an embodiment, when the electronic device 101 detects a touch event with respect to the display 210 in operation 904 , the electronic device 101 may perform an operation (this operation) according to the touch event in operation 905 . have. According to an embodiment, referring to [Table 7], in this operation, the fingerprint sensor IC activates a specific area 1002 of the large-area fingerprint sensor 1001 determined in the pre-operation, and for the specific area 1002 Only by performing a scan operation, a fingerprint image according to a user's contact event may be acquired.

According to an embodiment, when the electronic device 101 does not detect a touch event with respect to the display 210 in operation 904 , an operation (this operation) according to the touch event may not be performed. The electronic device 101 may, for example, undo operations performed in the previous operation.

According to the above-described embodiments, in the case of the large-area fingerprint sensor 1001 including a plurality of fingerprint sensors, since the number of fingerprint sensors to be scanned is large, the entire area of the large-area fingerprint sensor 1001 is scanned. While the response may be delayed, the number of fingerprint sensor channels for the electronic device 101 to perform a scan operation by specifying the scan area 1002 of the large-area fingerprint sensor 1001 based on the occurrence of a non-contact event that satisfies the condition. By reducing , the response of the display 210 may be improved.

The electronic device and method according to various embodiments of the present disclosure transmit, for example, at least a part of a command set for a specific function to a display device based on the occurrence of a non-contact event that satisfies a specific condition, so that the input after the contact event occurs Compared to a method of performing a specific function by analyzing data, the user experience may be improved by reducing the time for performing the specific function, and resources such as a battery may be saved.

An electronic device according to an embodiment of the present disclosure includes a display, a display driving circuit connected to the display, and a processor connected to the display and the display driving circuit, wherein the processor detects a non-contact event with respect to the display and , based on the detection of the non-contact event, transmits a set value for controlling the display to the display driving circuit, detects a touch event for the display, and based on the detection of the touch event, the display driving circuit The display may be controlled by using the set value.

According to an embodiment of the present disclosure, in response to detecting the non-contact event, the processor changes the screen refresh rate of the display based on at least one of a battery state of the electronic device and a setting for a screen refresh rate change of the electronic device It can be configured to check whether this is possible.

According to an embodiment of the present disclosure, the setting value for controlling the display may include a clock setting value corresponding to a specific screen refresh rate, a gamma value corresponding to the specific screen refresh rate, or The display may include at least one of setting values related to the timing of the driving unit of the backplane included in the display.

According to an embodiment of the present disclosure, the processor may control the display by using the gamma value setting by the display driving circuit in response to the detection of the touch event.

According to an embodiment of the present disclosure, in response to detecting the non-contact event, the processor is configured to output a vertical signal output latency (vertical back porch), a horizontal signal output latency (horizontal back porch) and a pixel corresponding to the specific screen refresh rate. and transmit a setting of at least one of a pixel charging time to the display driving circuit.

According to an embodiment of the present disclosure, in response to the detection of the touch event, the processor sets the display driving circuit to set at least one of the stored vertical signal output standby time, horizontal signal output standby time, and pixel charging time to the display. It can be configured to be applied to

According to an embodiment of the present disclosure, the processor includes a first processor and a second processor, and in response to the detection of the touch event, the processor corresponds to the set value among the first processor and the second processor. It may be configured to change the clock set to at least one.

According to an embodiment of the present disclosure, the set value includes a screen refresh rate, and the processor determines a time point at which information on a location where the touch event occurs is transmitted to the processor in response to the detection of the touch event; It can be set to change based on the screen refresh rate.

According to an embodiment of the present disclosure, a sensor for detecting the contact event may be included, and the changed time point may be set to be transmitted to the sensor.

According to an embodiment of the present disclosure, the processor may be configured to change a frequency for detecting the touch event to a frequency different from a frequency corresponding to noise of the display in response to detecting the touch event. have.

An electronic device according to an embodiment of the present disclosure includes a display, a display driving circuit connected to the display, an antenna module, a memory for storing an application, and functionally connected to the display, the display driving circuit, the antenna module, and the memory a processor, wherein the processor identifies whether a location at which a non-contact event is sensed on the display corresponds to a designated area of the display, and as it identifies that the location at which the non-contact event is detected corresponds to the designated area, transmits a wake-up command to the display driving circuit and transmits a wake-up command to the antenna module of the electronic device for the application, according to detection of a contact event for at least a part of the designated area, the and send an on command of the display to the display driving circuit.

According to an embodiment of the present disclosure, the wake-up command for the display driving circuit includes supplying power to the display driving circuit, setting a type and speed of an interface connecting the processor and the display driving circuit, and the It may include at least one of settings for luminance to display the display.

According to an embodiment of the present disclosure, the antenna module may include at least one of a magnetic secure transmission (MST) antenna module and a near field communication (NFC) antenna module.

According to an embodiment of the present disclosure, the wake-up command for the antenna module may include at least one of supplying power to the antenna module and initializing the antenna module.

According to an embodiment of the present disclosure, the designated area is an area corresponding to the application, and the processor generates image data corresponding to the execution screen of the application in response to the detection of the touch event for the designated area. and may be configured to transmit to the display driving circuit.

According to an embodiment of the present disclosure, the processor identifies that the location where the non-contact event is sensed corresponds to the designated area, and further identifies that the distance between the surface of the display and the user's finger is within a specific value Accordingly, it may be configured to transmit a wake-up command to a driving circuit of the biometric authentication sensor of the electronic device.

An electronic device according to an embodiment of the present disclosure includes a display including a fingerprint sensor, a display driving circuit connected to the display, and a processor connected to the display and the display driving circuit, wherein the processor includes: Identifies whether the position at which the non-contact event is detected corresponds to the position of the fingerprint sensor, and when it is identified that the position at which the non-contact event is detected corresponds to the position of the fingerprint sensor, a wake is sent to the fingerprint sensor driving circuit connected to the fingerprint sensor transmits an up command, determines a scan area of the fingerprint sensor based on the position at which the non-contact event is sensed, and controls the fingerprint sensor driving circuit to scan the scan area according to detection of a touch event on the display can do.

According to an embodiment of the present disclosure, the processor determines the scan area based on at least one of a position where the non-contact event is sensed, a movement speed of a finger, a movement direction of the finger, and a distance between the finger and the surface of the display. can be configured to determine.

According to an embodiment of the present disclosure, the processor may be configured to display a user interface for inducing a touch of the finger in the determined scan area on the display in response to detecting the non-contact event.

According to an embodiment of the present disclosure, the wake-up command for the fingerprint sensor driving circuit may include at least one of supplying power to the fingerprint sensor driving circuit and initializing the fingerprint sensor driving circuit.

According to an embodiment of the present disclosure, the processor may be configured to transmit the wake-up command to the fingerprint sensor driving circuit as it is further identified that the distance between the display surface and the user's finger is within a specific value. can

In the storage medium storing instructions according to an embodiment of the present disclosure, the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor, The operation is an operation of detecting a non-contact event for a display functionally connected to the processor, and a setting value of changing an interface mode of the display to a display driving circuit functionally connected to the processor according to the detection of the non-contact event , an operation of detecting a touch event with respect to the display, and an operation of the display driving circuit controlling the display by using the setting value based on the detection of the touch event.

According to an embodiment of the present disclosure, the interface mode may include at least one of a video mode and a command mode.

According to an embodiment of the present disclosure, the at least one operation determines the interface mode of the display in response to detecting the non-contact event, and displays the set value for the determined interface mode. It may include an operation of transmitting to the driving circuit.

According to an embodiment of the present disclosure, the at least one operation includes a master device for receiving a synchronization signal for interworking between a user input and the display according to the changed interface mode in response to the detection of the touch event. and controlling a driving circuit for the sensor detecting the contact event to change.

Claims (25)

In an electronic device,
display;
a display driving circuit coupled to the display; and
a processor coupled to the display and the display driving circuit; includes,
The processor is
detecting a non-contact event for the display;
Transmitting a setting value for controlling the display to the display driving circuit based on the detection of the non-contact event,
detecting a contact event to the display, and
based on the detection of the touch event, the display driving circuit controls the display by using the set value. The method according to claim 1,
the processor is configured to check whether a change in the screen refresh rate of the display is possible based on at least one of a battery state of the electronic device and a setting for a screen refresh rate change of the electronic device in response to detecting the non-contact event Device. The method according to claim 1,
The setting value for controlling the display may include a clock setting value corresponding to a specific screen refresh rate, a gamma value corresponding to the specific screen refresh rate, or a driving unit of a backplane included in the display. An electronic device comprising at least one of a set value related to timing. 4. The method according to claim 3,
The processor is configured to control the display by using the setting of the gamma value by the display driving circuit in response to the detection of the touch event. 4. The method according to claim 3,
In response to detecting the non-contact event, the processor is configured to perform at least one of a vertical back porch, a horizontal back porch, and a pixel charging time corresponding to the specific screen refresh rate. and transmit one setting to the display driving circuit. 6. The method of claim 5,
and the processor is configured to apply, to the display, a setting of at least one of the stored vertical signal output waiting time, horizontal signal output waiting time, and pixel charging time, by the display driving circuit, in response to detecting the touch event. The method according to claim 1, wherein the processor comprises a first processor and a second processor,
The processor is configured to change a clock set in at least one of the first processor and the second processor to correspond to the set value in response to the detection of the touch event. The method according to claim 1, wherein the set value includes a screen refresh rate,
The processor is configured to change, based on the screen refresh rate, a timing at which the information on the location where the touch event occurs is transmitted to the processor in response to the detection of the touch event. 9. The method of claim 8, comprising a sensor for detecting the contact event;
An electronic device configured to transmit the changed time point to the sensor. The method according to claim 1,
The processor is configured to change a frequency for detecting the touch event to a frequency different from a frequency corresponding to noise of the display in response to detecting the touch event. In an electronic device,
display;
a display driving circuit coupled to the display;
antenna module;
memory for storing applications; and
a processor operatively coupled to the display, the display driving circuit, the antenna module, and the memory; includes,
The processor is
Identifies whether a location where a non-contact event for the display is detected corresponds to a designated area of the display,
As it is identified that the location at which the non-contact event is sensed corresponds to the designated area, a wake-up command is transmitted to the display driving circuit and a wake-up command is sent to the antenna module of the electronic device for the application. transmits, and
and transmit an on command of the display to the display driving circuit according to detection of a touch event for at least a portion of the designated area. 12. The method of claim 11,
The wake-up command for the display driving circuit may include supplying power to the display driving circuit, setting a type and speed of an interface connecting the processor and the display driving circuit, and setting a luminance to display the display. An electronic device comprising at least one. 12. The method of claim 11,
The antenna module includes at least one of a magnetic secure transmission (MST) antenna module and a near field communication (NFC) antenna module. 14. The method of claim 13,
The wake-up command for the antenna module includes at least one of supplying power to the antenna module and initializing the antenna module. 12. The method of claim 11,
The designated area is an area corresponding to the application,
The processor is configured to transmit image data corresponding to the execution screen of the application to the display driving circuit in response to detecting the touch event for the designated area. 12. The method of claim 11,
The processor identifies that the location where the non-contact event is sensed corresponds to the designated area, and when it is further identified that the distance between the surface of the display and the user's finger is within a specific value, biometric authentication of the electronic device An electronic device configured to send a wake-up command to a drive circuit of the sensor. In an electronic device,
a display including a fingerprint sensor;
a display driving circuit coupled to the display; and
a processor coupled to the display and the display driving circuit; includes,
The processor is
Identifies whether the position where the non-contact event on the display is detected corresponds to the position of the fingerprint sensor,
Upon identifying that the position at which the non-contact event is sensed corresponds to the position of the fingerprint sensor, a wake-up command is transmitted to a fingerprint sensor driving circuit connected to the fingerprint sensor, and based on the position at which the non-contact event is detected, the determine a scan area of the fingerprint sensor, and
and controlling the fingerprint sensor driving circuit to scan the scan area according to detection of a contact event on the display. 18. The method of claim 17,
and the processor is configured to determine the scan area based on at least one of a position where the non-contact event is sensed, a movement speed of a finger, a movement direction of the finger, and a distance between the finger and a surface of the display. 19. The method of claim 18,
and the processor is configured to display a user interface for inducing a touch of the finger in the determined scan area on the display in response to detecting the non-contact event. 18. The method of claim 17,
The wake-up command for the fingerprint sensor driving circuit includes at least one of supplying power to the fingerprint sensor driving circuit and initializing the fingerprint sensor driving circuit. 21. The method of claim 20,
and the processor is configured to send the wake-up command to the fingerprint sensor driving circuit as it is further identified that the distance between the display surface and the user's finger is within a specific value. A storage medium storing instructions, wherein the instructions are configured to cause the at least one processor to perform at least one operation when executed by the at least one processor, the at least one operation comprising:
detecting a non-contact event for a display functionally connected to the processor;
storing a setting value for changing an interface mode of the display in a display driving circuit functionally connected to the processor according to the detection of the non-contact event;
detecting a contact event with respect to the display; and
and controlling the display by using the set value by the display driving circuit based on the detection of the touch event. The storage medium of claim 22 , wherein the interface mode comprises at least one of a video mode and a command mode. 23. The method of claim 22,
The at least one operation is
and determining the interface mode of the display in response to detecting the non-contact event, and transmitting the set value for the determined interface mode to the display driving circuit. 24. The method of claim 23,
The at least one operation is a sensor detecting the touch event so as to change a master device for receiving a synchronization signal for interworking between a user input and the display according to the changed interface mode in response to the detection of the touch event A storage medium comprising the operation of controlling a driving circuit for

Images