CN212675896U

CN212675896U - Electronic device supporting screen movement of compensated display

Info

Publication number: CN212675896U
Application number: CN202021037805.0U
Authority: CN
Inventors: 李在晟; 金池龙; 金晋贤; 金泰亨; 裵正培; 裵钟坤; 梁丙德; 李约翰; 韩东均; 洪润杓
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2019-06-07
Filing date: 2020-06-08
Publication date: 2021-03-09
Anticipated expiration: 2030-06-08
Also published as: KR20200140709A

Abstract

An electronic device supporting compensating screen movement of a display is provided. The electronic device includes: a display for outputting a screen; and a processor operatively connected to the display. The processor is configured to: the method includes receiving a user input associated with movement of a screen output on a display, detecting a screen movement speed corresponding to the user input associated with the screen movement, determining a screen tilt compensation amount corresponding to the screen movement based on the screen movement speed when the screen movement speed is included in a first interval, and keeping the screen tilt compensation amount constant based on the screen movement speed when the screen movement speed is included in a second interval faster than the first interval.

Description

Electronic device supporting screen movement of compensated display

Cross reference to related applications

The present application is based on and claimed from korean patent application No. 10-2019-0067604, filed on.07.2019 to the korean intellectual property office, and korean patent application No. 10-2020-0062430, filed on.25.05.2020, the disclosures of which are incorporated herein by reference in their entirety.

Technical Field

The present disclosure relates to a method for compensating for a jelly roll (jelly scroll) phenomenon during screen movement of a display. More particularly, the present disclosure relates to an electronic device and method for compensating screen movement of a display to naturally display the screen movement.

Background

The related art electronic device may include a display, and various screens may be visually provided for a user on the display. An electronic device may include a display and a display driver integrated circuit (DDI) to drive the display. A DDI loaded into an electronic device may receive display data from a processor to drive a display.

The above information is presented merely as background information to aid in understanding the present disclosure. Neither determination nor assertion as to whether any of the above may apply as prior art to the present disclosure

SUMMERY OF THE UTILITY MODEL

The movement of the displayed contents or screen movement may occur on the display of each of various electronic devices of the related art under the control of the processor. Meanwhile, since the display implements a screen by sequentially supplying gate signals to a plurality of gate lines, a data update time for each gate line may vary. Therefore, when the screen moves on the display of the related art and when the direction of the screen movement does not coincide with the gate scan direction, there is a visual problem (e.g., smooth tracing) in which the arranged images or texts are not considered to move horizontally but are considered to move in a tilted state.

Aspects of the present disclosure are to address at least the above problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide a method for compensating screen movement of a display to naturally display the screen movement by: by compensating the image or text output state according to the moving speed at which the screen movement occurs on the display.

Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

According to an aspect of the present disclosure, an electronic device is provided. The electronic device includes: a display configured to output a screen; and a processor operatively connected to the display. The processor is configured to receive a user input associated with movement of a screen output on the display, detect a screen movement speed corresponding to the input associated with the screen movement, and differently determine an amount of tilt compensation for at least some screen regions according to the screen movement speed.

According to another aspect of the present disclosure, a method for compensating for screen movement of a display is provided. The method comprises the following steps: outputting a screen on a display; receiving a user input; determining whether a screen movement direction corresponding to the user input coincides with a gate scanning direction when the user input is an input associated with screen movement; detecting a screen movement speed corresponding to an input associated with the screen movement when the screen movement direction is not identical to the gate scanning direction; and differently determining a compensation value associated with a degree to which the current screen frame (frame) is tilted according to the screen moving speed.

Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure.

Drawings

The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings in which:

FIG. 1 is a diagram illustrating some components of an electronic device for supporting compensation of screen movement in accordance with an embodiment of the present disclosure;

FIG. 2 is a flow chart illustrating an example of a method for compensating for screen movement of a display in accordance with an embodiment of the present disclosure;

FIG. 3 is a flow chart illustrating another example of a method for compensating for screen movement of a display in accordance with an embodiment of the present disclosure;

FIG. 4 is an illustration of display settings associated with detecting screen movement speed in accordance with an embodiment of the present disclosure;

fig. 5 is a diagram of an example of a method for detecting a screen moving speed according to an embodiment of the present disclosure;

fig. 6 is an illustration of another example of a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Fig. 7 is a diagram of an example of modifying a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Fig. 8 is a diagram of another example of modifying a method for detecting screen movement speed according to an embodiment of the present disclosure;

FIG. 9 is an illustration of an example of a hardware operational method associated with detecting screen movement speed in accordance with an embodiment of the disclosure;

FIG. 10 is an illustration of an example associated with setting a region of interest (ROI) in accordance with an embodiment of the present disclosure;

FIG. 11 is an illustration of another example associated with setting up a ROI according to an embodiment of the disclosure;

fig. 12 is an illustration of changes in visibility associated with eye tracking according to an embodiment of the disclosure;

fig. 13 is a diagram of an example of a change in compensation amount according to eye tracking according to an embodiment of the present disclosure;

FIG. 14 is a graphical illustration of weight adjustments associated with representing the same screen in accordance with an embodiment of the present disclosure;

FIG. 15 is a graphical illustration of an example of applying compensation values in accordance with an embodiment of the disclosure;

FIG. 16 is a diagram of another example of applying compensation values, according to an embodiment of the present disclosure;

fig. 17 is an illustration of an example of a concept of compensating for screen movement according to an embodiment of the present disclosure; and

fig. 18 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure.

Throughout the drawings, it should be noted that the same reference numerals are used to depict the same or similar elements, features and structures.

Detailed Description

The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are not limited to the written meaning, but are used only by the inventor to enable a clear and consistent understanding of the disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of the various embodiments of the present disclosure is provided for illustration only and not for the purpose of limiting the disclosure as defined by the appended claims and their equivalents.

It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more such surfaces.

Fig. 1 is a diagram illustrating some components of an electronic device for supporting compensation of screen movement in accordance with an embodiment of the present disclosure.

Referring to fig. 1, an electronic device 100 according to an embodiment may include a processor 110, a display driver Integrated Circuit (IC) (DDI)120, and a display 140.

The processor 110 (e.g., an application processor, a communication processor, a sensor hub, a Touch Screen Panel (TSP) IC, etc.) may generate display data according to various embodiments, and may provide the generated display data (e.g., data configuring a screen including at least one of an image or text) to the DDI 120. For example, the processor 110 may encode or compress display data in a specified manner and may provide the encoded or compressed display data to the DDI 120. For example, while performing screen movement, the processor 110 may process compensation associated with the screen movement (e.g., data transformation for jelly scroll (transform) phenomenon). In this regard, the processor 110 may include a display controller 111, a compression encoder 112, an internal transfer interface 113 (e.g., Mobile Industry Processor Interface (MIPI) Tx), and a first serial interface 115.

The display controller 111 may generate display data to be passed to the DDI 120 based on data passed by a central processing unit/graphics processing unit (CPU/GPU).

The compression encoder 112 may encode the display data generated by the display controller 111 in a specified manner, for example, a Display Stream Compression (DSC) scheme determined by the Video Electronics Standards Association (VESA). As a result, the display data generated by the display controller 111 may be compressed to reduce the data size. For example, the size of the display data generated by the display controller 111 can be reduced to 1/n by the encoding of the compression encoder 112. According to various embodiments, the compression encoder 112 may be omitted. In other words, the display data may be passed to the DDI 120 without compression processing.

The internal transmission interface 113 may transfer the display data encoded by the compression encoder 112 to the DDI 120. The internal transport interface 113 may include a Mobile Industry Processor Interface (MIPI).

The processor 110 may perform data processing associated with compensating for screen movement. According to an embodiment, when outputting display data, the processor 110 may determine whether a gate scanning direction (a direction formed when scanning signals are sequentially output from a gate driver) coincides with a screen moving direction (a direction in which a screen moves by a scroll operation). In this regard, the processor 110 may obtain at least one of configuration information regarding a display direction of the content (e.g., information configured to be output in a horizontal or vertical direction of the electronic apparatus 100 when outputting the content depending on user settings; or information configured to change the display direction of the content depending on rotation of the electronic apparatus 100) and information regarding a direction in which the electronic apparatus 100 is located (e.g., sensor information of an acceleration sensor). The processor 110 may compare the gate scanning direction with the screen moving direction based on the obtained information.

When the gate scan direction is different from the screen movement direction, the processor 110 may calculate a compensation value associated with compensating for the screen movement, may apply the compensation value, and may deliver (e.g., to the DDI 120) the image to which the compensation value is applied. In this operation, the processor 110 may receive a touch input signal from a touch circuit (not shown), may identify an occurrence of an input (e.g., a scroll input) associated with a screen movement, and may detect a movement speed (or a scroll speed) associated with: the input is associated with a screen movement.

According to an embodiment, the processor 110 may pass content display orientation configuration information to the DDI 120 when the following operations are designed to be performed by the DDI 120: an operation of determining whether the gate scanning direction and the screen moving direction are identical to each other; and an operation of detecting a screen moving speed, calculating a compensation value, and applying the compensation value when the directions are different from each other. According to an embodiment, the processor 110 may communicate sensor information obtained by an acceleration sensor (not shown) associated with a state in which the electronic device 100 is located to the DDI 120. According to various embodiments, at least some of the operations of detecting screen movement speed, calculating compensation values, and applying compensation values may be designed to be performed by the processor 110 (e.g., an application processor), and at least other of the operations may be designed to be performed by the DDI 120.

According to various embodiments, a sensor hub (or sensor control processor) associated with a sensor operating the electronic device 100 is located in the electronic device 100, and the electronic device 100 may include signal lines directly connected between the sensor hub and the DDI 120. In this case, the function of transferring the sensor information of the processor 110 may be omitted, and the sensor information may be transferred through the sensor hub. The information communicated by the sensor hub may include at least one of: a touch input signal of the touch circuitry and sensor information associated with a state in which the electronic device 100 is located.

The processor 110 may pass control signals to the DDI 120 via the first serial interface 115. For example, the processor 110 may receive a touch input signal from a touch circuit and may pass the received touch input signal to the DDI 120 via the first serial interface 115. According to various embodiments, the processor 110 may collect sensor signals of at least one sensor included in the electronic device 100 (e.g., an acceleration sensor for sensing a state in which the electronic device 100 is located) and may pass the collected sensor signals to the DDI 120 via the first serial interface 115. Alternatively, the processor 110 may pass information to the DDI 120 via the first serial interface 115 regarding: the screen movement speed received from the touch circuit, the state in which the electronic device 100 is determined based on the sensor signal, or the gate scanning direction.

The DDI 120 may calculate and apply a color transform value of the display data depending on the setting, and may output the display data to the display panel 143. When the processor 110 is designed to perform compensation processing associated with operating screen movement and calculate and apply compensation values, the DDI 120 may play the following roles: receives display data to which the compensation value is applied according to the screen movement from the processor 110, and outputs the display data to the display panel 143. According to various embodiments, when the DDI 120 is designed to perform compensation processing associated with operating screen movement, it may detect a screen movement speed when receiving display data from the processor 110, may generate compensated data in response to the detected screen movement speed, and may output the generated compensated data on the display 140.

According to various embodiments, the DDI 120 may set a region of interest (ROI) before detecting the screen movement speed. Alternatively, the DDI 120 may compare the screen movement speed with a predefined compensation application range value to determine whether to generate compensation data. According to various embodiments, when the processor 110 also detects a screen movement speed and passes the screen movement speed value to the DDI 120 together with compensation for the screen movement, the DDI 120 may calculate a compensation value depending on the received screen movement speed value, and may output display data to which the compensation value is applied.

The DDI 120 may include an internal reception interface 121 (e.g., MIPI Rx), a MIPI Display Serial Interface (DSI)122, an interface controller 123, a second serial interface 124, a command controller 125, a first memory 126 (e.g., Graphics Ram (GRAM)), a memory controller 127 (e.g., GRAM controller), a compression decoder 128, a second memory 129 (e.g., single-port static ram (spsram)), a first internal processing module (IP1)131, a second internal processing module (IP2)132, a shift register 133, a display timing controller 134, and an internal oscillator 135.

Internal receive interface 121 may communicate with processor 110 to receive control information and display data from processor 110. The internal receive interface 121 may comprise, for example, MIPI receiver circuitry. When receiving control information and display data via an internal transmit interface (MIPI transmitter circuit) of processor 110, internal receive interface 121 may pass the control information and display data to interface controller 123 via MIPI DSI 122. When the internal receive interface 121 is designed to process MIPI mode data, the MIPI DSI 122 may be a component that can be added; when internal transmit interface 113 and internal receiver interface 121 change, MIPI DSI 122 may be omitted or may be replaced by another component.

Interface controller 123 may receive display data and/or control information from processor 110. The interface controller 123 may transfer the received display data to the memory controller 127. The interface controller 123 may transfer the received control information to the command controller 125. According to an embodiment, the interface controller 123 may receive the sensor information via the second serial interface 124. For example, the interface controller 123 may receive screen movement information collected by the touch circuit or sensor information associated with a state in which the electronic device 100 is located via the second serial interface 124, and may transfer the screen movement information and the sensor information to the command controller 125.

The memory controller 127 may write the display data received from the interface controller 123 to the first memory 126. For example, the memory controller 127 may write the display data to the first memory 126 depending on the frame rate of the display data delivered by the processor 110.

The first memory 126 may include a GRAM. The first memory 126 may store display data transferred by the memory controller 127. The stored display data may include display data in the following states: in this state, it is compressed by the processor 110 or uncompressed by the processor 110. The first memory 126 may include a storage space corresponding to the resolution of the display panel 143 and/or the number of color levels of the display panel 143. The first memory 126 may include a frame buffer, a line buffer, and the like. The first memory 126 may vary the update amount or speed according to the type of image output to the display panel 143. For example, when a moving image is played, display data corresponding to a frame of the moving image may be written to the first memory 126 at a designated speed. For images (e.g., still images), the first memory 126 may store previous images until the images are updated. The display data stored in the first memory 126 may include coordinate values to be displayed on each display region of the display 140, or the order of the display data may correspond to the coordinates to be displayed on the display 140.

The command controller 125 may apply a color conversion value corresponding to the display data stored in the first memory 126 to control the display timing controller 134 to output the display data on a designated area of the display panel 143. Command controller 125 may be referred to as control logic.

When encoding at least a portion of the display data read from the first memory 126, the compression decoder 128 may decode at least a portion of the display data in a specified manner and may pass the decoded data to the display timing controller 134. For example, when the size of the display data is compressed to 1/n by the compression encoder 112 of the processor 110, the compression decoder 128 may decompress at least a portion of the display data to restore the display data to the display data before compression. The first and second internal processing modules 131 and 132 (e.g., up-scaler and/or image pre-processing unit) may be located between the compression decoder 128 and the display timing controller 134. According to various embodiments, the compression decoder 128 may be omitted or bypassed when at least a portion of the display data selected by the command controller 125 is not encoded.

The first internal processing module 131 can perform data calculation and display data processing associated with processing screen movement. For example, the first internal processing module 131 may obtain and store (e.g., in the second memory 129) at least a portion of the display data (e.g., diagonal pixel information intersecting certain regions of the screen) read from the first memory 126, and may detect the screen movement speed based on a change in the at least a portion of the display data. When the screen moving speed is detected, the first internal processing module 131 may calculate a compensation value to be applied to the display data along with the screen moving speed, and may generate the compensation data by applying the calculated compensation value to each of the display data. The first internal processing module 131 may store compensation data to which the compensation value is applied in the second memory 129, and then may transfer the compensation data to the second internal processing module 132. According to various embodiments, the first internal processing module 131 may calculate the ROI based on the display data. For example, the first internal processing module 131 may detect a change in display data using the second memory 129, and may detect the ROI based on the change in display data. The first internal processing module 131 may detect a screen moving speed in the detected ROI, and may calculate and apply a compensation value to be applied to the ROI. The first internal processing module 131 may be implemented as a software module to be loaded capable of processing the above-described compensation associated with screen movement, or may be provided as a separate hardware processor capable of processing the compensation associated with screen movement to be disposed in at least one of the inside and the outside of the DDI 120.

The second internal processing module 132 may be implemented as a hardware processor capable of processing the functions of a scaler or an image pre-processing unit, or may be provided in the form of a software block to be loaded into the DDI 120. The second internal processing module 132 may perform an up-scaler function of enlarging the decompressed image at a designated magnification. According to an embodiment, the second internal processing module 132 may enlarge the display data when the display data needs to be enlarged depending on the size of the display data to be output on the display panel 143 or depending on user settings. The enlarged display data may be transferred to the display timing controller 134. The up-scaler function of the second internal processing module 132 may be omitted or bypassed when it is not necessary to magnify at least a portion of the display data. The second internal processing module 132 may perform the function of a pre-processing unit for enhancing the image quality of the display data. The second internal processing block 132 may include, for example, a pixel data processing circuit, a preprocessing circuit, a gating (gating) circuit, and the like.

The display timing controller 134 may control the timing of the components included in the DDI 120. For example, the display timing controller 134 may adjust a timing of storing display data received from the processor 110 in the first memory 126 and a timing for reading the display data stored in the first memory 126, which do not overlap with each other. The display timing controller 134 may control the timings for: timing for reading the display data stored in the first memory 126 at a designated frame rate and transferring the display data to the compression decoder 128, the first internal processing module 131, and the second internal processing module 132 in response to control of the command controller 125.

The display timing controller 134 may transfer the display data received from the second internal processing module 132 to the source driver 142 in response to the control of the command controller 125, and may control the gate signal of the output gate driver 141. According to an embodiment, the display timing controller 134 may be implemented to be included in the command controller 125. The display timing controller 134 may convert display data received from the first memory 126 or the second memory 129 via the second internal processing module 132 into an image signal, and may provide the image signal to the source driver 142 and the gate driver 141 of the display panel 143.

Under the control of the display timing controller 134, the shift register 133 may receive data processed by the second internal processing module 132 and may transfer the received data to the source driver 142. The internal oscillator 135 may generate a timing signal necessary to operate the display timing controller 134 and may transfer the generated timing signal to the display timing controller 134.

The display 140 may include a source driver 142, a gate driver 141, and a display panel 143. In addition, the display 140 may further include a touch panel and a touch IC, a pressure sensor and a pressure sensor IC, a digitizer (digitzer), and the like, associated with the user input.

The display panel 143 may display various information (e.g., information including at least one of multimedia data or text data) to a user. The display panel 143 may include, for example, a Liquid Crystal Display (LCD) panel, an active matrix organic light emitting diode (AM-OLED) panel, and the like. The display panel 143 may be implemented, for example, as flexible, transparent, or wearable. In addition, the display panel 143 may be included in, for example, a cover of a housing that is electrically coupled with the electronic apparatus 100.

The display panel 143 may receive an image signal corresponding to display data from the DDI 120 and may display a screen according to the display data. The plurality of data lines and the plurality of gate lines may cross each other on the display panel 143, and the plurality of pixels may be arranged in the crossing regions. When the display panel 143 corresponds to an OLED panel, each of the plurality of pixels may include at least one or more switching elements (e.g., FETs) and one OLED. Each pixel may receive an image signal or the like from the DDI 120 at a certain timing to generate light. The display panel 143 may have, for example, a specific resolution (e.g., a resolution of 1536 (horizontal) × 2152 (vertical)).

Each of the source driver 142 and the gate driver 141 may generate signals supplied to scan lines and data lines of the display panel 142, not shown, based on source control signals and gate control signals received from the display timing controller 134.

Fig. 2 is a flowchart illustrating an example of a method for compensating for screen movement of a display according to an embodiment of the present disclosure.

Referring to fig. 2, in a method for compensating for screen movement according to an embodiment, a processor 110 (or at least one of an AP and a DDI 120) of an electronic device 100 of fig. 1 may turn on a display 140 of fig. 1 depending on user input or predetermined system settings at operation 201. After the display 140 is turned on, the processor 110 may control processing of various predetermined functions. For example, the display 140 may output an idle screen, may output a specific web page depending on user input, or may output a picture search screen including a plurality of thumbnails depending on execution of a gallery function. Alternatively, the display 140 may output a screen, at least a portion of which is composed of text. According to various embodiments, the display 140 may output a screen including a plurality of divided screens, each of which includes different information; or may overlay and display a window (e.g., a video pop-up or notification pop-up) that displays the second information on a screen displaying the first information with a screen (e.g., a screen containing at least some text) in which the first information is displayed in a background.

When an input associated with a screen movement is received, the processor 110 (or at least one of the AP and the DDI 120) may determine whether the gate scan direction and the scroll direction of the display 140 are the same as each other in operation 203. In conjunction with an input associated with a screen movement, the electronic device 100 may include a touch circuit composed of a touch screen (or a touch panel) and a touch IC for driving the touch screen (or the touch panel). When an input associated with a screen movement is received through the touch screen, the processor 110 may identify a direction of the screen movement and may compare the screen movement direction to the gate scan direction. In this regard, the processor 110 may identify at least one of configuration information regarding a display direction of the content (e.g., configuration information displayed in a horizontal or vertical direction when the content is displayed; or configuration information changing the display direction of the content to a horizontal or vertical direction depending on a direction in which the electronic device 100 is located) and a state in which the electronic device 100 is located.

In conjunction with identifying the state in which electronic device 100 is located, processor 110 may identify whether there is: a setting for displaying only in the horizontal direction when displaying the content, or a setting for displaying only in the vertical direction when displaying the content. And displaying the content. Alternatively, the processor 110 of the electronic device 100 may determine whether a change in horizontal or vertical display according to the direction in which the electronic device 100 is located is set. When the content display direction is set to be changed according to the arrangement direction, the processor 110 of the electronic apparatus 100 may obtain the sensor information and may identify a state in which the electronic apparatus 100 is located. In this regard, the electronic device 100 may include a gyro sensor or an acceleration sensor, and may identify the gate scanning direction based on the collected sensor information.

The gate scanning direction may be a direction in which gate signals are sequentially input to a plurality of gate signal lines constituting the display 140. Since the state of the gate signal lines in which the display 140 is arranged is fixed, when the content display is set to change in the horizontal or vertical direction in accordance with a change in the arrangement of the electronic apparatus 100, the gate scanning direction can be determined in accordance with the state in which the electronic apparatus 100 is located. For example, the gate scan direction is determined according to the direction in which the electronic device 100 is placed as: from left to right, right to left, top to bottom, or bottom to top.

When the gate scan direction does not coincide with the scroll direction, the processor 110 (e.g., at least one of the AP or the DDI 120 of the electronic device 100) may collect the screen movement speed in operation 205. In this regard, the processor 110 may detect pixel changes from movement of the screen output on the display 140 and may calculate a screen movement speed in dependence on the pixel changes. According to various embodiments, the processor 110 may calculate the scroll speed using the touch coordinates transmitted from the touch circuit. Alternatively, the processor 110 may detect a change in a partial region of the screen output on the display 140, and may calculate the screen moving speed according to the detected change. According to various embodiments, the processor 110 may collect screen movement speed from a touch circuit that provides input associated with screen movement. The screen movement speed may include, for example, a rate of pixel change per frame. When the gate scan direction is the same as the scroll direction, the processor 110 may output the data stored in the frame buffer on the display 140 without separate compensation associated with screen movement at operation 211.

In operation 207, the processor 110 (e.g., at least one of the AP or the DDI 120 of the electronic device 100) may calculate a compensation value (or screen tilt compensation amount) to be applied to display data to be output according to the screen movement speed. In this operation, the processor 110 may vary the level of the compensation value (or the compensation amount) depending on the screen moving speed. According to an embodiment, the processor 110 may calculate a compensation value in which the number of equal portions dividing the display 140 increases as the screen movement speed increases. According to an embodiment, the processor 110 may calculate a compensation value in which the number of equal portions dividing the display 140 decreases as the screen moving speed decreases. According to various embodiments, the processor 110 may vary the size of the area for changing data on each of the screen areas equally divided according to the screen moving speed. For example, the processor 110 may equally divide the screen into several columns in a first direction (e.g., a horizontal direction) depending on the screen movement speed. The processor 110 may divide the screen area equally divided into each column into a plurality of areas in a second direction (e.g., a horizontal direction), and may determine an area for changing data. According to various embodiments, when the screen moving speed is included in the designated first interval (or first time range), the processor 110 (or the DDI 120) may determine a screen tilt compensation amount (an amount of compensation for a state in which at least a portion of the screen is tilted to be horizontally visible) according to the screen movement based on the screen moving speed. Alternatively, when the screen moving speed is included in a second interval (or a second time range) that is faster than the first interval, the processor 110 (or the DDI 120) may set the screen tilt compensation amount based on the screen moving speed to be kept constant.

At operation 209, the processor 110 (e.g., at least one of the AP or DDI 120 of the electronic device 100) may apply compensation for each equally divided region to the display data to be output. According to an embodiment, the processor 110 may vertically divide each of the areas into three areas with respect to the respective areas equally divided into the screen including the plurality of columns, may add data to a first area (e.g., a data copy area), may hold original data in a second area (e.g., a data shift area) to move a position of the original data, and may remove data from a third area (e.g., a data truncation area) to generate compensation data for screen movement. In this operation, the processor 110 may assign a size larger (or smaller) than the following area to a first area or a third area adjacent to an area to which a gate signal is first input, among equally divided areas, among the sub areas of the display 140: in the sub-region, the gate signal is relatively late input to the first region or the third region thereof. According to various embodiments, the processor 110 may generate the compensation data when traveling from a sub-region adjacent to a region to which a gate signal is first input relatively among equally divided regions to a sub-region distant from the region, wherein the first region (or the third region) of the respective sub-regions is allocated to be gradually larger (or smaller) in size. According to various embodiments, when traveling from a sub-region adjacent to a region to which a gate signal is first input relatively among equally divided regions to a sub-region far from the region, the processor 110 may gradually increase the amount of additional data to be added to the data copy region of the respective sub-regions (or remove data by the same amount as the added data is increased). According to various embodiments, the processor 110 may gradually increase the amount of candidate data to be removed from the data truncation region of each sub-region when traveling from a sub-region adjacent to a region to which a gate signal is first input relatively among equally divided regions to a sub-region distant from the region. According to various embodiments, when the screen tilt compensation amount based on the screen moving speed is kept constant, the processor 110 (or the DDI 120) may set the compensation amount (or the screen tilt compensation amount) to 0 or a specific value (e.g., a pixel/frame of a specific speed). According to various embodiments, when the screen moving speed is included in a third interval (or a third time range) that is faster than the second interval, the processor 110 (or the DDI 120) may set the screen tilt compensation amount according to the screen movement to 0 based on the screen moving speed. Alternatively, when the screen moving speed is included in an interval relatively slower than the first interval, the processor 110 (or the DDI 120) may set the screen tilt compensation amount according to the screen movement to 0 based on the screen moving speed.

According to various embodiments, when determining the screen tilt compensation amount according to the screen movement based on the screen movement speed, the processor 110 (or the DDI 120) may change the compensation amount in a linear or non-linear manner according to the screen movement speed. The non-linear change may include, for example, a step-wise (stepwise) change, a change with an exponential or logarithmic function, or the like.

At operation 211, the processor 110 (e.g., at least one of the AP or DDI 120 of the electronic device 100) may output display data to which compensation for each equally divided region is applied on the display 140. When the screen is moved in the screen moving direction, at least a portion of the screen may be output such that it is considered to move horizontally without tilting as the display data to which the compensation is applied is output.

At operation 213, the processor 110 (at least one of the AP or the DDI 120) may determine whether an input signal associated with an end screen output is received. When there is no input signal associated with the end screen output, the processor 110 may branch to (branch to) operation 203 to perform the operations from operation 203 again.

In the above description, at least one of the following operations may be performed by the processor 110 or the DDI 120: an operation of determining whether the gate scanning direction and the screen moving direction are the same, an operation of detecting a screen moving speed when the directions are different from each other, an operation of calculating a compensation value, or an operation of generating data (e.g., display data) to which the compensation value is applied. For example, the processor 110 may perform all of the following operations: an operation of determining whether the gate scanning direction and the screen moving direction are the same, an operation of detecting a screen moving speed when the directions are different from each other, an operation of calculating a compensation value, or an operation of generating data (e.g., display data) to which the compensation value is applied. In this case, the DDI 120 may receive the display data to which the compensation value is applied, and may output the display data on the display panel 143.

According to various embodiments, the processor 110 may perform only an operation of determining whether the gate scanning direction and the screen moving direction are the same and an operation of detecting the screen moving speed when the directions are different from each other. In this case, the DDI 120 may calculate a compensation value according to the screen moving speed, may generate display data to which the compensation value is applied, and may output the display data.

According to various embodiments, the processor 110 may perform only an operation of determining whether the gate scanning direction and the screen moving direction are the same, an operation of detecting the screen moving speed when the directions are different from each other, and an operation of calculating the compensation value. In this case, the DDI 120 may receive the calculated compensation value, and may generate and output compensation data according to the compensation value.

Fig. 3 is a flowchart illustrating another example of a method for compensating for screen movement of a display according to an embodiment of the present disclosure.

Referring to fig. 3, in a method for compensating for screen movement according to an embodiment, a processor 110 (or at least one of an AP and a DDI 120) of an electronic device 100 of fig. 1 may turn on a display 140 of fig. 1 depending on user input or predetermined information at operation 301. Performing a function according to the turning on of the display 140 may be the same as or similar to the operation 201 described above.

When an input related to a screen movement is received, the processor 110 (or at least one of the AP and the DDI 120) may determine whether the gate scan direction and the scroll direction of the display 140 are identical to each other in operation 303. In conjunction with the input associated with the screen movement, as described above, the processor 110 may receive the input associated with the screen movement from the touch circuit included in the electronic device 100. The processor 110 may compare a scanning direction in which signals are supplied to the gate lines with a screen moving direction.

When the gate scan direction and the scroll direction are not identical to each other, the processor 110 (or the DDI 120) may set an ROI in operation 305. In connection with setting up the ROI, the processor 110 may identify the ROI based on user input. According to various embodiments, the processor 110 may detect a screen change from a screen currently being output on the display 140, and may set a region in which the detected screen change rate is greater than or equal to a specified value as the ROI. Alternatively, the processor 110 may identify configuration information of a screen currently being output (e.g., configuration information defining whether each region of a web page is any region), and may set a designated partial region of the screen as an ROI based on the screen configuration information. According to various embodiments, the operation of setting the ROI may be omitted.

At operation 307, the processor 110 (e.g., at least one of the AP or DDI 120 of the electronic device 100) may collect the screen movement speed. When the ROI is set in operation 305, the processor 110 (e.g., at least one of the AP or the DDI 120) may collect screen movement speeds in the ROI in operation 307. For example, the processor 110 may detect a change in position of at least some pixels of the ROI, and may collect the screen movement speed based on the detected change. According to various embodiments, the processor 110 may perform the calculation of the screen change rate and the calculation of the screen movement speed in the same manner or in a similar manner. Alternatively, the processor 110 may use the result of calculating the screen change rate as the screen movement speed. According to various embodiments, the processor 110 may perform the operation of calculating the screen change rate and the operation of calculating the screen moving speed in any order. For example, after calculating the screen movement speed, the processor 110 may apply the screen change rate to detect (or set) the ROI (e.g., set a region in which the screen change rate is greater than or equal to a certain rate as the ROI). In this operation, the processor 110 may set the ROI using the result of calculating the screen moving speed. Alternatively, after setting the ROI by detecting a region in which the screen change rate is greater than or equal to a certain rate, the processor 110 may calculate a screen moving speed for the set ROI. When operation 305 is omitted, the processor 110 may detect changes in pixels of at least some regions of the screen and may calculate the screen movement speed, as in operation 205 of fig. 2. According to various embodiments, in conjunction with calculating the screen movement speed, the processor 110 may calculate the screen movement speed based on at least one of a drag speed, a flick speed, or a scroll speed input by the user. Alternatively, the processor 110 may calculate the screen movement speed based on a change in the user touch input.

At operation 309, the processor 110 (e.g., at least one of the AP or the DDI 120 of the electronic device 100) may determine whether the calculated screen movement speed is within the compensation application range. The limit value for determining whether the screen moving speed is within the compensation application range may be determined through various statistics or experiments. For example, a limit value for compensating the application range may be set as a limit value at which the user's eyes can feel the change while tracking the screen change. The electronic device 100 may store and operate the limit value of the compensation application range in a separate memory or in the first memory 126 or the second memory 129 of the DDI 120. When the screen moving speed deviates from the compensation application range, for example, when the degree of change according to the screen movement on the screen is fast enough not to be recognized by the user's eyes, or when the screen change by the scroll operation is slower than the gate scanning speed, the processor 110 may omit the following operation and may branch to operation 315 to output the display data stored in the frame buffer (or the first memory 126).

When the screen moving speed is within the compensation application range, the processor 110 (e.g., at least one of the AP or the DDI 120 of the electronic device 100) may calculate a compensation value of the display data to be output according to the screen moving speed in operation 311. According to an embodiment, when the detected screen movement speed is faster than a specified first screen movement speed and slower than a specified second screen movement speed (e.g., when the detected screen movement speed is greater than or equal to the first screen movement speed and less than the second screen movement speed), the processor 110 may increase the compensation value in a linear manner depending on the screen movement speed. For example, as in operation 207 described above, the processor 110 may adjust the number of equal portions of the display 140 differently depending on the screen moving speed, may calculate a compensation value to differently have an increasing rate of the number of specific data amounts to be applied to the data copy area or an increasing rate of the number of candidate data (or removal data) to be deleted from the data truncation area on equally divided areas, or may calculate a compensation value to differently adjust the size (e.g., the number of pixel rows) of the data copy area or the data truncation area.

According to various embodiments, when the ROI is set, the processor 110 (e.g., at least one of the AP or DDI 120) may calculate a compensation value of the display data according to a screen movement speed with respect to the ROI. The processor 110 may calculate the fixed compensation value when the detected screen moving speed is greater than or equal to the second screen moving speed.

At operation 313, the processor 110 (e.g., at least one of the AP or DDI 120 of the electronic device 100) may apply the compensation value for each region to the display data to be output. For example, as in operation 209 above of fig. 2, the processor 110 may equally divide the screen into a certain number of columns according to the compensation values in a first direction, and may add or delete data to or from some areas in a second direction (e.g., a direction perpendicular to the first direction) with respect to the equally divided columns to generate compensation data. In this operation, when the ROI is set, the processor 110 may fix a region around the ROI and may process a screen update in which a compensation value is applied only to the ROI.

At operation 315, the processor 110 (e.g., at least one of the AP or DDI 120 of the electronic device 100) may output display data on the display 140 to which the compensation value for each region is applied. Thereafter, in operation 317, the processor 110 may determine whether an input signal associated with an end screen output is received. When there is no input signal associated with the end screen output, the processor 110 may branch to operation 303 to perform operations from operation 303 again.

Fig. 4 is a diagram illustrating display settings associated with detecting screen movement speed according to an embodiment of the present disclosure. Fig. 5 is a diagram illustrating an example of a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Referring to fig. 4 and 5, the display 140 may include a display panel 143, a gate driver 141, and a source driver 142. As described above, the display panel 143 may include a gate signal line (e.g., H: 1536) connected to the gate driver 141 and a source signal line (e.g., V: 2152) connected to the source driver 142. The DDI 120 (or processor 110) of the electronic device 100 may detect a change in at least a portion of the data (or display data, screen, or image) output on the display panel 143 to detect screen movement speed. For example, as shown, the DDI 120 may detect a change in information of pixels located on a diagonal of at least a portion of the display panel 143 to detect a screen movement speed.

Because the probability that a diagonal pixel will be changed is higher than the probability that a particular horizontal line of pixels will be changed or a particular vertical line of pixels will be changed when changing the screen according to the screen movement, the DDI 120 may set a diagonal for at least a portion of the display panel 143. The DDI 120 may store and compare pixel information for each diagonal line on a frame-by-frame basis. Alternatively, the DDI 120 may obtain diagonal pixel information from a frame at the time the input associated with the screen movement occurred. When the screen is moved according to the input associated with the screen movement, the DDI 120 may detect the movement of the diagonal pixels and may calculate the movement distance according to the input associated with the screen movement to determine the screen movement speed.

In conjunction with the diagonal lines, the DDI 120 may set the central regions (e.g., the source lines 309 to 1844 and the gate lines 1 to 1536) except for some upper regions (e.g., the source lines 1 to 308) and some lower regions (e.g., the lines 1845 to 2152) of the display panel 143, and may set diagonal lines connecting the vertices of the central regions.

In conjunction with setting the center region, for a web page, statistically, some regions above and some regions below may be fixed (may often be fixed) in the information, and may be (or may often consist of): the region is set to not scroll despite the presence of input associated with screen movement. Therefore, when the corresponding region is excluded from the diagonal-line setting region associated with the detection screen moving speed, the length of the diagonal line can be reduced. As a result, the operation of detecting the screen moving speed can be enhanced by reducing the amount of data to be compared and searched.

According to an embodiment, in state 501, the DDI 120 may set a diagonal line connecting the upper left point coordinates (309, 1) of the display panel 143 with the lower right point coordinates (1844, 1536) of the display panel 143. The DDI 120 may compare pixel information items while alternating upper and lower sides based on the set diagonal line. For example, the DDI 120 may compare information of a pixel of a diagonal connecting the dot coordinates (310, 1) and the coordinates (1845, 1536), which is one pixel higher to the upper side than a diagonal connecting the upper left dot coordinates (309, 1) and the lower right dot coordinates (1844, 1536), with information of a pixel of the diagonal which is initially set; and information of pixels of the diagonal line connecting the coordinates (308, 1) and the coordinates (1843, 1536) may be compared with information of pixels of the diagonal line initially set (e.g., initial configuration information of pixels of the diagonal line connecting the first coordinates (309, 1) and the second coordinates (1844, 1536)). As described above, the DDI 120 may compare pixel information items of diagonals at a certain pixel distance above the initially set diagonal line. When the pixel information items do not coincide with each other, the DDI 120 may compare pixel information items of a diagonal line at a certain pixel distance to the lower side than the initially set diagonal line, and may gradually compare pixel information items of a diagonal line distant from the initially set diagonal line to detect a diagonal line having the same pixel information as that of the pixels of the initially set diagonal line.

According to various embodiments, the DDI 120 may compare pixel information items from locations spaced apart by a specified distance when setting the minimum movement range. For example, when the screen moving speed is set to a minimum of 5 pixels/frame, the DDI 120 may compare pixel information of a diagonal line located across 5 lines (or 5 pixels) from the initial diagonal position to the upper side and a diagonal line located across 5 lines from the initial diagonal position to the lower side with the pixel information of the initial diagonal line. According to various embodiments, when setting the maximum movement range, the DDI 120 may compare the pixel information items up to a specified distance. For example, when the screen moving speed is set to 60 pixels/frame at maximum, the DDI 120 may compare pixel information items from a diagonal line located within 60 lines (or 60 pixels) from the initial diagonal position to the upper side to a diagonal line located within 60 lines from the initial diagonal position to the lower side.

According to the embodiment, in the state 503, when the screen is moved to the upper side by 50 lines (or 50 pixels on the same line) by the scroll operation, since the pixel information item of the diagonal line set in the state 501 coincides with the pixel information item of the diagonal line connecting the upper left point coordinates (259, 1) and the lower right point coordinates (1794, 1536), the DDI 120 may detect the movement of the diagonal line by comparing the pixel information items and may detect the screen movement speed based on the detected result. For the above example, the screen movement speed may be 50 pixels/frame. For another example, when the screen is moved downward by 60 lines depending on an input associated with screen movement, during the process of comparing the pixel information items of the diagonal line set in the state 501 with the pixel information items of the diagonal lines around the diagonal line, the DDI 120 may identify that the pixel information of the diagonal lines connecting the upper left point coordinates (369, 1) and the lower right point coordinates (1904, 1536) coincide with each other in the state 505, and may calculate the amount of movement (or scroll speed) of the screen. For example, in state 505, a screen movement speed of 60 pixels/frame may be detected.

Fig. 6 is a diagram illustrating another example of a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Referring to fig. 6, in state 601, the DDI 120 of fig. 1 may set an initial diagonal line connecting first point coordinates (1844, 1) and second point coordinates (309, 1536), and may compare pixel information items of a diagonal line located within a certain distance to an upper side and a diagonal line located within a certain distance to a lower side with pixel information of the initial diagonal line to detect a diagonal line having the same pixel information. In this operation, the DDI 120 may compare some of the detected pixel information of the particular diagonal line with some of the pixel information of the initial diagonal line to determine whether the pixel information coincides with each other. When pixel information items on the same line (e.g., at the same position in the vertical direction) coincide with each other, the DDI 120 may determine whether pixel information items of other portions coincide with each other. When the pixel information items on the same line are different from each other, the DDI 120 may not compare the pixel information items of other portions of the diagonal line to skip the diagonal line. The DDI 120 may enhance diagonal detection speed by comparing some of the diagonal pixel information items and skipping other portions. For example, when the screen is moved to the upper side by 50 lines according to the input associated with the screen movement, the DDI 120 may detect the diagonal line while skipping the diagonal line having the pixel information different from the initial diagonal line in state 603 until the diagonal line connecting the point (1794, 1) and the point (259, 1536) is detected.

According to various embodiments, as a result of comparing the pixel information items of the initial diagonal line and the pixel information items of the other diagonal lines adjacent to the initial diagonal line, the DDI 120 may detect a diagonal line including the most pixel information items identical to the pixel information items of the initial diagonal line among the diagonal lines within the specified range. According to various embodiments, the DDI 120 may detect diagonals by pattern (pattern) comparison. For example, the DDI 120 may detect a diagonal line having the same pattern as the pattern of the pixel information items of the initial diagonal line. According to various embodiments, the DDI 120 may detect a diagonal line having a pattern most similar to the pattern of the initial diagonal line's pixel information items. In conjunction with performing the above-described operation, when there is the same pixel information as that of the initial diagonal line in the process of comparing pixels, the DDI 120 may increase the count as a result of having the same pixel information, and as a result, detect the screen moving speed based on the diagonal line in which the increased count value is the highest. According to various embodiments, the DDI 120 may detect the diagonal based on input speed (e.g., flick rate, scroll speed, or touch input change speed) information while skipping designated pixels. Alternatively, the DDI 120 may select only some pixels among the diagonal pixel information items, and may detect the diagonal and the screen moving speed using only the selected some pixels. According to an embodiment, the DDI 120 may increase the number of skipped pixels when the input speed is a specified first speed (or greater than or equal to the specified first speed). According to an embodiment, the DDI 120 may detect the diagonal on a pixel-by-pixel basis after skipping the designated pixels.

Fig. 7 is a diagram illustrating an example of modifying a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Referring to fig. 7, the DDI 120 of fig. 1 may set a plurality of diagonal lines in conjunction with detecting the screen moving speed, and may detect the screen moving speed based on the plurality of diagonal lines. For example, in state 701, the DDI 120 may set a first diagonal connecting the point (309, 1) and the point (1844, 1536) and a second diagonal connecting the point (1844, 1) and the point (309, 1536) as the initial diagonal in frame N-1. When within a certain distance to the upper side and the lower side on the basis of the first diagonal line, the DDI 120 may compare pixel information items of other diagonal lines parallel to the first diagonal line with the pixel information items of the first diagonal line, and may detect a diagonal line having pixel information items coinciding with the pixel information items of the first diagonal line or a diagonal line having the largest number of pixel information items coinciding with the pixel information items of the first diagonal line. In addition, in a subsequent frame N of state 703, DDI 120 may detect diagonals having the same pixel information in the same manner as the first diagonal with respect to the second diagonal. The DDI 120 may detect the screen moving speed using a diagonal line detected based on the first diagonal line and a diagonal line detected based on the second diagonal line. According to various embodiments, the DDI 120 may set three or more initial diagonals. According to various embodiments, as described above, the pixels for detecting the screen moving speed may be pixels corresponding to diagonal lines, and may be pixels existing on any line horizontally passing through the screen. At least a portion of any line passing horizontally through the screen may include at least a portion of a straight line and a curved line. Alternatively, any line passing horizontally through the screen may include a line in a partial area of the screen (e.g., a partial area smaller than the entire screen in terms of size).

Fig. 8 is a diagram illustrating another example of modifying a method for detecting a screen moving speed according to an embodiment of the present disclosure.

Referring to fig. 8, in frame N-1 of state 801, the DDI 120 of fig. 1 may set a plurality of initial diagonals in conjunction with detecting screen movement speed, which may set initial diagonals covering regions that do not overlap each other and may detect screen movement speed based on the initial diagonals. For example, the DDI 120 may set a first diagonal connecting the point (309, 1536) and the point (1076, 1) and a second diagonal connecting the point (1077, 1536) and the point (1844, 1) as initial diagonals. When within a certain distance to the upper side and the lower side on the basis of the first diagonal line, in the subsequent frame N of the state 803, the DDI 120 may compare the pixel information items of other diagonal lines parallel to the first diagonal line with the pixel information of the first diagonal line, and may detect a diagonal line having the same pixel information as the plurality of pixels corresponding to the first diagonal line or a diagonal line having the most of the same pixels. In addition, the DDI 120 may detect a diagonal line having the same pixel information or a diagonal line having the most of the same pixel information items in the same manner as the first diagonal line with respect to the second diagonal line.

Fig. 9 is a diagram illustrating an example of a hardware operation method associated with detecting a screen moving speed according to an embodiment of the present disclosure.

Referring to fig. 9, the electronic device 100 may operate the touch circuit 150, the touch driver 151, the input frame 152, the DDI 120, a display processor 901 (e.g., the processor 110 of fig. 1), a frame buffer 903, a composer 905, or an application (app) layer 907.

In the electronic apparatus 100 having the above-described configuration, when an input associated with a screen movement is received via the touch circuit 150, the touch driver 151 may process the input associated with the screen movement, which is received by the touch circuit 150, and may detect a screen movement speed from the input associated with the screen movement. For example, the touch driver 151 may detect a screen moving speed based on a touch moving distance transferred from the touch circuit 150. The screen movement speed may be communicated to the DDI 120 via the input frame 152. The DDI 120 may calculate a compensation value based on the communicated screen movement speed to apply the compensation.

According to various embodiments, the input framework 152 may communicate the screen movement velocity value to the composer 905, and the composer 905 may determine the degree to which the display data is compensated depending on the screen movement velocity. When determining the extent to which the display data is compensated, the composer 905 may transform the display data stored in the frame buffer 903 to fit the determined compensation value, and may output the compensation data on the display 140 via the display processor 901 and the DDI 120.

As described above, the electronic apparatus 100 according to the embodiment may directly calculate the screen moving speed based on the touch information obtained by the touch circuit 150 so that the DDI 120 does not calculate the screen moving speed, and may provide the screen moving speed to the DDI 120, or may be used to generate compensation data to compensate for the screen movement of the display data to be output.

As described above, according to an embodiment, in conjunction with detecting the screen movement speed, the processor 110 (or AP) may detect the screen movement speed and may communicate the screen movement speed to the DDI 120. According to various embodiments, in the methods described above with reference to fig. 4 through 8, the DDI 120 may detect the screen moving speed based on the screen change. According to various embodiments, the touch circuitry 150 of the electronic device 100 may directly communicate the screen movement speed to the DDI 120. In this regard, signal lines may be placed between the touch circuitry 150 and the DDI 120. According to various embodiments, the input framework 152 may pass information associated with screen movement (e.g., screen movement speed information, flick input speed, or touch input speed) directly to the DDI 120. Alternatively, the input framework 152 may pass information associated with screen movement (e.g., screen movement speed information) to the composer 905 associated with the processor 110 and the DDI 120, either together or simultaneously.

Fig. 10 is a diagram illustrating an example associated with setting up an ROI according to an embodiment of the present disclosure.

Referring to fig. 10, in connection with setting an ROI, the DDI 120 (or processor 110) of fig. 1 may identify a feature value for each region of data (or display data, screen or image) to be output on the display 140 of fig. 1. The feature value may be provided by a server or a manufacturer that provides the screen (or image or page). The feature values may include, for example, the following values (e.g., values defining features for each region of the screen): any area of the screen in this value indicates: an area 1001 in which a notification bar is displayed, an area 1002 in which an address is input, a menu area 1003 associated with a web page, an area 1004 in which data is updated, a control key area 1005, and an area 1006 in which a navigation key capable of searching for another page is located. According to various embodiments, the feature values may include values defining scrollable areas (e.g., area 1004) and non-scrollable areas (e.g.,

areas

1001, 1002, 1003, 1005, and 1006). Accordingly, the DDI 120 (or the processor 110) may set the ROI based on the feature information defining each region of the screen. For example, the DDI 120 may set as the ROI a region 1004 or a scrollable region 1004 in which data is updated within a specified time.

Fig. 11 is a diagram illustrating another example associated with setting up an ROI according to an embodiment of the present disclosure.

Referring to fig. 11, in connection with setting the ROI, the DDI 120 (or the processor 110) of fig. 1 may extract a representative value for each row (e.g., for each horizontal line in a state where the content is vertically displayed based on the illustrated drawing) of the screen output on the display 140 of fig. 1, and may store the extracted representative value for each row (e.g., a value of any position, a representative value (e.g., a maximum value, a minimum value, or a value obtained by adding all of the pixel values of the corresponding row) among the R/G/B values of the respective pixels, or an average value for each row) in a memory (e.g., the second memory 129 of fig. 1). For example, in state 1101, the DDI 120 may extract representative values from the first line 1110_1 to the last line 1110_ N of the screen output on the display 140, and may store the representative value of each extracted line in the memory. When the position of the screen is changed depending on an input associated with the screen movement at the state 1103, the DDI 120 may calculate a representative value of each line of the changed screen and may compare the calculated representative value of each line with a representative value for each line of a previous frame stored in the memory.

According to various embodiments, the DDI 120 may extract a region 1120 in which there is a change in the representative value from the first row to the last row, and may set the region 1120 as an ROI. The representative value of each row may include a maximum pixel value or a minimum pixel value (a value of a pixel in which a value calculated by digitizing the pixel is the maximum or minimum) on the corresponding row. According to various embodiments, the DDI 120 may store the average of the pixels of each row in the memory and may compare the average stored in the memory to the average of the pixels of each row of the next frame to identify the change. According to various embodiments, the DDI 120 may store the variance values of the pixels of each row in a memory, and may compare the variance values stored in the memory to the variance values of the pixels of each row of the next frame to identify the change. According to various embodiments, the DDI 120 may store the checksum value (e.g., CRC code value) assigned to each line in memory, and may compare the checksum value stored in memory with the checksum value of each line of the next frame to identify the change. The DDI 120 may set a region in which there is a change or the degree of change is greater than or equal to a specified value as the ROI.

According to various embodiments, when displaying image frames corresponding to multiple windows on the display panel 143 of fig. 1, the DDI 120 may determine the ROI in dependence on: whether a touch input is received on any of a plurality of application execution areas included in the multi-window, or whether an area currently in focus (focus) is any area. For example, the DDI 120 may determine the ROI based on a frame region to which a screen movement is currently applicable among a plurality of application execution regions included in a multi-window. For example, the DDI 120 may determine at least a portion of a frame region of a region on which a touch input occurs or a currently focused frame region as the ROI.

According to various embodiments, the DDI 120 may determine a central region (or a region where pixels of a screen change more than a designated value) with respect to a point where a touch input occurs in a frame region (or an application execution region) where the touch input occurs, as the ROI, in addition to some regions from above and below (or left and right sides) of a region of a certain size and a currently focused frame region.

In the above description, in a state where the screen of the display 140 of fig. 1 is equally divided or unequally divided, the multi-window may include a state where each application execution screen is displayed for each divided region. Alternatively, the multi-window may include the following states: a state in which an execution screen according to the execution of a first application is provided as a background of the display 140 depending on a picture-in-picture (PIP) function, and a state in which an execution screen according to the execution of a second application different from the first application is displayed as a screen smaller than the background screen.

Fig. 12 is a diagram illustrating changes in visibility associated with eye tracking according to an embodiment of the present disclosure.

Referring to fig. 12, in a state in which a screen is output on the display 140 of fig. 1, when the screen is moved according to an input associated with screen movement, a user's line of sight may be along a certain point of the moved screen in a state 1201. In this case, when the gate signal is supplied from left to right, the update time of the gate signal line adjacent to the region where the gate signal is relatively first input may be faster than the update time of another gate line. At this time, when the user's sight line performs smooth tracking (pursuit) along a specific point of the screen, a jelly roll phenomenon in which the screen moves in a tilted state may occur on the user's eyes.

Further, when the moving speed of the screen is greater than or equal to the designated speed, a saccade (saccade) phenomenon may occur in state 1203. When the moving speed of the screen is greater than or equal to a designated speed, the saccade may allow the user's eyes to recognize that the movement of the screen cannot perform smooth tracking and that a certain point of the screen instantaneously moves to another point. In this case, the instantaneous image of the screen is visible to the eyes of the user (e.g., the discontinuous instantaneous image (to the eyes) is visible; or the probability that an inverse image will be visible may increase due to compensation when compensating for screen movement).

As described above, when the user's eyes track the movement of the screen, smooth tracking and saccade may alternately occur depending on the moving speed of the screen. Accordingly, as shown in fig. 13, the electronic apparatus 100 may perform different screen movement compensation for each section depending on the screen movement speed.

Fig. 13 is a diagram illustrating an example of a change in the compensation amount according to eye tracking according to an embodiment of the present disclosure.

Referring to fig. 13, in the illustrated graph, the DDI 120 (or processor 110) of fig. 1 may apply different compensation values for each interval of screen movement speed. In a first interval (smooth tracking interval) in which the screen moving speed is greater than or equal to 0 and less than 30 pixels/frame, the DDI 120 may increase the compensation value in a linear manner depending on an increase in the screen moving speed. According to an embodiment, the DDI 120 (or the processor 110) may increase the compensation value in a non-linear manner while changing the slope. According to an embodiment, in an interval in which the screen moving speed is less than 10 pixels/frame, the DDI 120 (or the processor 110) may not be able to apply the compensation value depending on the change of the screen moving speed. In other words, the compensation value (or screen tilt compensation amount) may be 0.

As the compensation value increases, the DDI 120 may increase the number of equal portions of the divided screen. In this regard, the DDI 120 may adaptively compensate for tilt of data (e.g., at least one of an image or text) displayed on the screen by increasing a compensation value as the screen movement speed increases.

According to various embodiments, in a second interval (smooth tracking interval + panning interval) where the screen movement speed is greater than or equal to 30 pixels/frame and less than 100 pixels/frame, the DDI 120 may apply an increased compensation value that is less than the screen movement speed. In this regard, since there is a risk that an inverse image (compensation image) will be visible depending on the occurrence of a saccade for a certain level or higher of screen movement speed, the DDI 120 may apply a compensation value smaller than the screen movement speed or may apply only a designated compensation value. According to various embodiments, in the second interval, the DDI 120 may apply a certain compensation value regardless of an increase in screen movement speed.

According to various embodiments, in the third section (section where eye tracking is not possible) where the screen moving speed is greater than or equal to 100 pixels/frame, the DDI 120 may not be able to apply the compensation value regardless of the occurrence of the scroll operation. Alternatively, the DDI 120 may set the compensation value to 0 to apply the compensation value. According to various embodiments, the DDI 120 may maintain the maximum compensation value of the previous interval, or may gradually decrease the compensation value based on the maximum compensation value of the previous interval.

When the screen moving speed is greater than or equal to the designated value, the DDI 120 may not be able to apply a separate compensation value because the user's eyes cannot recognize the jelly rolling phenomenon depending on the screen moving or because the user's eyes have difficulty in perceiving an incompatible feeling according thereto although the user's eyes recognize the jelly rolling phenomenon. According to various embodiments, in order to naturally process the screen movement, the start compensation value of each interval may be the same as the last compensation value of the previous interval.

In the graph of fig. 13 described above, the reference screen moving speed (e.g., 30 pixels/frame or 100 pixels/frame) at which the compensation scheme is differently applied may be differently defined according to the entire size of the display 140 of fig. 1 or the entire size of the scrolled region. Alternatively, the reference screen moving speed may be defined differently according to the number of gate lines of the display 140, the gate scanning speed, and the like. According to various embodiments, the intervals may be divided based on two reference screen moving speeds (e.g., 30 pixels/frame and 100 pixels/frame) in the graph of fig. 13, but the intervals may be divided into more intervals based on a plurality of reference screen moving speeds (e.g., 10 pixels/frame, 20 pixels/frame, 30 pixels/frame, 50 pixels/frame, 70 pixels/frame, 90 pixels/frame, etc.) of three or more, and the compensation value may be defined differently for each interval. Alternatively, the section may be divided into the linear increase section 1301, the sustain section 1303, and the impossible section 1305 based on each reference value (30 pixels/frame or 100 pixels/frame) in the graph of fig. 13, but the compensation value may be applied according to a graph in a curved form such as a logarithmic graph without section division. For example, in the

section

1301 or 1303, the compensation value for each scroll speed may be increased or decreased according to an exponential function or a logarithmic function.

Fig. 14 is a diagram illustrating weight adjustments associated with representing the same screen according to an embodiment of the present disclosure.

Referring to fig. 14, the electronic device 100 of fig. 1 may differently operate the same image holding time during a designated period (e.g., 1 Vsync or driving period). A section in which an image is not displayed may be included in the same image holding time. The DDI 120 of fig. 1 (or the processor 110) may change the weight of the compensation value depending on a duty ratio of a section where an image is displayed on the display 140 of fig. 1 and a section where an image is not displayed on the display 140. For example, the DDI 120 (or the processor 110) may rely on

equation

1 or 2 to change the weight of the compensation value.

Weight (%) - (same image holding time)/(display driving period) × 100% equation 1 weight (%) - (100-AOR/No _ of _ duty _ cycles _ per _ Vperiod equation 2

The No _ of _ duty _ cycles _ per _ Vperiod may refer to a period of a signal supplied to represent an image every 1 driving period (e.g., 1 frame or 1 Vsync). The weight calculated using the above equation 1 may be multiplied by the compensation value calculated based on the screen moving speed, and thus, the compensation value to which the weight is applied may be applied to the real screen. For example, when the number of duty cycles is 1 (e.g., four duty cycles for 1 Vsync) and the display off rate (AOR) is 30% (when the rate of display off is 30%), the weight may be 92.5%.

Fig. 15 is a diagram illustrating an example of applying a compensation value according to an embodiment of the present disclosure.

Referring to fig. 15, the DDI 120 (or the processor 110, hereinafter, a description of the DDI 120 will be given) may generate compensation data based on one frame. For example, when detecting the screen moving speed, the DDI 120 may determine a compensation value (or amount of compensation) according to the detected screen moving speed. When determining the compensation value, the DDI 120 may divide the screen equally depending on the determined compensation value. For example, when the screen moving speed is a first speed value (or a first speed section), the DDI 120 may equally divide at least a portion of the screen into a plurality of sub-areas in a direction (or a gate scanning direction) perpendicular to the screen moving direction, as shown. According to an embodiment, the DDI 120 may equally divide the screen area into N sub-areas 51_1 to 51_ N. The number of N may vary depending on the screen moving speed. For example, as the screen movement speed increases, the DDI 120 may increase the number of N; and the DDI 120 may decrease the number of N as the screen movement speed decreases. As described above with reference to fig. 14, by applying a weight depending on the duty ratio (on/off ratio of operation or on/off arrangement ratio in one period) and the number of duty cycles of output data on the display 140 of fig. 1, the DDI 120 may additionally adjust the number of N (e.g., a compensation value). According to the embodiment, when one equal division is one pixel, it may be one pixel unit.

According to an embodiment, the DDI 120 may divide each sub-region 51_1, 51_2, 51_3 … …, or 51_ N into three regions (e.g., a data copy region 1510, a data shift region 1520, and a data truncation region 1530), and may add or delete data on at least some of the divided regions to generate compensation data. For example, the DDI 120 may add or remove data with respect to at least some of all of the sub-regions 51_1 to 51_ N.

According to an embodiment, the DD 1120 may insert the first additional data 51a into the first data copy region 1511 in at least a portion of the equally divided sub-regions, for example, in the third sub-region 51_ 3. In this operation, the DDI 120 may set a certain number of pixel rows in the vertical direction (including a plurality of pixels) as a group, and may copy or use at least some of the data of the pixel rows belonging to this group (e.g., apply at least one of various interpolation methods) to generate the first additional data 51 a. For example, in the illustrated diagram, the DDI 120 may set 8 pixel rows as a group, and may generate the first additional data 51a from the data of the 8 pixel rows to add the first additional data 51a to the first data copy area 1511. The DDI 120 may vary the number of groups included in the first data copy area 1511 depending on the screen moving speed. For example, the faster the screen moves, the greater the number of groups may be. According to various embodiments, when the number of groups is fixed, the faster the screen moving speed is, the more the number of pixel rows belonging to the group can be increased. According to various embodiments, the faster the screen moves, the more the number of groups may increase. The number of pixel rows assigned to the group can be reduced. The slower the screen movement speed, the more the number of pixel rows belonging to the group can be reduced. According to various embodiments, the slower the screen movement speed, the more the number of groups can be reduced. The number of pixel rows assigned to the group can be increased.

In the illustrated diagram, the DDI 120 may set 2 groups including 8 pixel rows as the first data copy region 1511 with respect to at least some of the sub-regions 51_2 to 51_ N, and may generate the first additional data 51a to add the first additional data 51a to the corresponding group. According to various embodiments, the first additional data 51a may be generated by interpolating data values of 8 pixel lines (for example, one additional data may be generated by collecting 1/8 of data of respective pixel lines). According to various embodiments, the DDI 120 may select specific data among the data in the first data copy region 1511, and may copy the selected data to generate additional data.

According to an embodiment, in at least some of the sub-areas 51_2 to 51_ N among the equally divided sub-areas, the DD 1120 may perform a position movement according to a screen movement speed with respect to the first data shift area 1521. The moving distance of the first data shift region 1521 may be determined according to the number of additional data of the first data copy region 1511 and the number of removed data of the first data truncation region 1531.

According to an embodiment, the DDI 120 may remove the first candidate data 51b from the first data truncation region 1531 in at least some of the sub regions 51_2 to 51_ N among the equally divided sub regions. In this regard, the DDI 120 may select a plurality of groups, each of which includes a plurality of pixel rows, in conjunction with the configuration of the first data truncation region 1531. The DDI 120 may select the first candidate 51b to be removed from each group. The DDI 120 may remove the selected first candidate data 51b from the corresponding group. The number of groups from which the first candidate data 51b are removed may be varied according to the screen moving speed. For example, as the screen moving speed increases, the DDI 120 may increase the number of groups from which the first candidate data 51b is removed. According to various embodiments, the DDI 120 may select some data from each of a plurality of pixel rows, and may constitute the first candidate data 51b to be removed. For example, when 8 pixel rows constitute a group, the DDI 120 may select data in an interval of 1/8 data from each pixel row, and may constitute the first candidate data 51 b.

According to various embodiments, the DDI 120 may add data to be added to sub-regions away from the gate driver 141 of fig. 1 and may add candidate data to be removed from the sub-regions. For example, the DDI 120 may constitute the second additional data 51c more than the first additional data 51a in the second data copy area 1512 in the fourth sub-area 51_ 4. For example, when the first additional data 51a corresponds to two pixel rows, the DDI 120 may constitute the second additional data 51c to correspond to four pixel rows. Similarly, the DDI 120 may constitute the second candidate 51d more than the first candidate 51 b. Accordingly, the second data shift region 1522 may be moved to a different position from the first data shift region 1521. The moving distance of the second data shift region 1522 may be determined according to the number of additional data of the second data copy region 1512 and the number of removed data of the second data truncation region 1532.

According to an embodiment, when the screen moving direction is a first direction (e.g., a direction perpendicular to the gate scanning direction and moving from the upper side to the lower side), the DDI 120 may gradually increase data to be added to the data copy region 1510 as going from a sub region adjacent to a region to which a gate signal is first input opposite to the region to a sub region distant from the region. Alternatively, the DDI 120 may gradually increase the candidate data to be removed from the data truncation region 1530 as going from a sub region adjacent to a region to which the gate signal is first input relatively to the region to a sub region far away from the region.

According to various embodiments, when the screen moving direction is a second direction (e.g., a direction opposite to the first direction), the DDI 120 may gradually decrease data to be added to the data copy region 1510 as going from a sub region adjacent to a region to which a gate signal is first input opposite to the region to a sub region far away from the region. Alternatively, the DDI 120 may gradually reduce the candidate data to be removed from the data truncation region 1530 as going from a sub-region adjacent to a region to which the gate signal is first input relatively to the region to a sub-region far from the region.

As described above, since the position of the data shift region 1520 is gradually inclined in the gate scan direction by the data copy region 1510 and the data truncation region 1530, as a result, the screen is visible while moving based on the imbalance of the horizontal line together with the data update speed generated according to the scroll movement.

According to various embodiments, when detecting the screen moving speed, the DDI 120 may determine a compensation value (or amount of compensation) according to the detected screen moving speed. When determining the compensation value, the DDI 120 may expand the image of the screen region whose screen tilt should be compensated according to the determined compensation value in the scroll direction (e.g., upward and downward directions or left and right directions). The DDI 120 may transform the extended image into a tilted image (e.g., compensation data) based on the compensation value, and may display only a portion of a central portion of the tilted image on the screen.

As described above, since the compensation data can be generated using one frame (image) data in the DDI 120 when generating the compensation data, two frame data may not be required when generating the compensation data. Due to this, memory space in the DDI 120 may be saved.

Fig. 16 is a diagram illustrating another example of applying a compensation value according to an embodiment of the present disclosure.

Referring to fig. 16, the electronic device 100 may operate a touch circuit 150, a touch driver 151, an input frame 152, a DDI 120, a display processor 901 (e.g., an AP), a frame buffer 903, a composer 905, an application layer 907, a sensor (e.g., a 6-axis sensor) 1601, or a sensor hub 1603.

In the electronic apparatus 100 having the above-described configuration, when an input associated with a screen movement is received via the touch circuit 150, the touch driver 151 may process the input associated with the screen movement, which is received by the touch circuit 150, and may transfer screen movement information to the input frame 152. The input framework 152 may pass the screen movement information to the update module 1605 of the composer 905. The update module 1605 may obtain the screen moving speed from the screen moving information and may calculate a compensation value for compensation depending on the screen moving speed, thus transferring the compensation value to the display processor 901. The display processor 901 may generate compensation data 1620 to be output on the display 140 of fig. 1 in dependence on the compensation values, and may pass the generated compensation data 1620 to the DDI 120 for output on the display 140. According to various embodiments, the compensation data 1620 may be generated by at least one of the DDI 120 and an Application Processor (AP) (e.g., an update module).

In the above operation, constructor 905 may receive sensor information associated with the arrangement of electronic device 100 from sensor hub 1603 and may identify the gate scanning direction in dependence on the sensor information. According to various embodiments, the composer 905 may identify a direction in which to output the content according to a user input, and may identify a gate scanning direction based on the sensor information and the content output setting direction. When determining the gate scanning direction, the constructor 905 may determine whether the gate scanning direction is different from the screen moving direction. When the gate scanning direction is different from the screen moving direction, the constructor 905 may generate the compensation data 1620 to the display processor 901 based on the update module 1605.

The compensation data 1620 may be the following screens: wherein the screen output on the display 140 is tilted in response to the screen moving speed. The display processor 901 may determine the degree of tilting the screen differently depending on the screen moving speed based on the uncompensated data 1610 to which the scroll compensation is not applied. The display processor 901 may obtain data of a specific region to be output on the display panel 143 from the compensation data 1620 tilted at a specific slope, and may output the obtained data on the display 140 via the DDI 120.

Fig. 17 is a diagram illustrating an example of a concept of compensating for screen movement according to an embodiment of the present disclosure.

Referring to fig. 17, after the display 140 of fig. 1 is turned on, when an input associated with a screen movement occurs, a jelly roll phenomenon may occur when a sub-region of the display panel 142 adjacent to a region to which a gate signal is first input relatively is faster than a sub-region of the display panel 143 separated from the gate driver 141 in terms of a data update speed in state 1701.

Referring to fig. 17, therefore, in state 1703, the DDI 120 or processor 110 of the electronic device 100 of fig. 1 may generate compensation data in which data addition and data removal are differently set according to a separation distance from the gate driver 141. By applying the compensation data generated in state 1703 to a case in which the jelly scroll phenomenon occurs depending on an input associated with screen movement, the electronic device 100 may output a normal screen from which the jelly scroll phenomenon is removed on the display 140 in state 1705.

The above description has been given for an embodiment of equally dividing a screen (or display data or an image output on a screen) according to various embodiments, but it is not limited thereto. For example, the electronic apparatus 100 may perform non-uniform division when dividing a screen depending on a screen moving speed. For example, in the electronic apparatus 100, a sub-region adjacent to a region to which a gate signal is first supplied relatively may be formed larger in size on the display 140 than a sub-region adjacent to a region to which a gate signal is supplied relatively later. The number of non-uniformly divided regions may vary according to the screen moving speed. According to various embodiments, as the screen moving speed increases, a sub-area adjacent to an area to which a gate signal is first supplied may be smaller as compared to the gate signal.

As described above, an electronic device (e.g., electronic device 100 of fig. 1) according to an embodiment may include a display (e.g., display 140 of fig. 1) configured to output a screen and at least one processor (e.g., processor 110 or DDI 120 of fig. 1) operatively connected to the display. The at least one processor (e.g., at least one of an application processor or a display driver IC) may be configured to receive user input associated with movement of a screen output on the display; detecting a screen movement speed from a user input associated with the screen movement; determining a screen tilt compensation amount according to the screen movement based on the screen movement speed when the screen movement speed is included in the first section; and when the screen moving speed is included in a second interval that is faster than the first interval, maintaining the screen tilt compensation amount based on the screen moving speed to be constant.

According to various embodiments, the at least one processor may set the screen tilt compensation amount to 0 when the screen tilt compensation amount based on the screen moving speed is kept constant.

According to various embodiments, when the screen tilt compensation amount based on the screen moving speed is kept constant, the at least one processor may set the screen tilt compensation amount to a specific value instead of 0.

According to various embodiments, when the screen moving speed is included in a third interval that is faster than the second interval, the at least one processor may set the screen tilt compensation amount according to the screen movement to 0 based on the screen moving speed.

According to various embodiments, when the screen moving speed is included in an interval slower than the first interval, the at least one processor may set the screen tilt compensation amount according to the screen movement to 0 based on the screen moving speed.

According to various embodiments, when determining the screen tilt compensation amount according to the screen movement based on the screen movement speed, the at least one processor may set the change of the screen tilt compensation amount according to the screen movement speed in a linear manner.

According to various embodiments, when determining the screen tilt compensation amount according to the screen movement based on the screen movement speed, the at least one processor may set the change of the compensation amount according to the screen movement speed in a non-linear manner.

An electronic device (e.g., electronic device 100 of fig. 1) according to various embodiments may include a display (e.g., display 140 of fig. 1) configured to output a screen and at least one processor (e.g., processor 110 or DDI 120 of fig. 1) operatively connected to the display. The at least one processor (e.g., at least one of an application processor or a display driver IC) may be configured to receive user input associated with movement of a screen output on the display; the screen movement speed is detected from a user input associated with the screen movement, and the screen tilt compensation amount according to at least a part of the screen area of the screen movement is differently determined depending on the screen movement speed.

According to various embodiments, the at least one processor may be configured to determine the number of equally dividing the current screen frame depending on the screen moving speed (or compensation amount); dividing each of the equally divided screen regions (e.g., 51_1 to 51_ N of fig. 15) into a center region (e.g., data shift region 1520 of fig. 15), a data copy region (e.g., data copy region 1510 of fig. 15), and a data truncation region (e.g., data truncation region 1530 of fig. 15) in the current screen frame; and performing the following compensation operations: adding an amount of data to the data copy area, and removing and displaying the same amount of data as the added data from the data truncation area while moving the center area in a direction opposite to the screen movement.

According to various embodiments, the at least one processor may allocate the sizes of the data copy area and the data truncation area differently depending on the magnitude of the screen moving speed (or compensation amount).

According to various embodiments, when the screen moving direction is from a first direction (e.g., an up direction or a down direction) to a second direction (e.g., a down direction or an up direction), the data copy region may include regions arranged in the first direction of the display (e.g., at least some screen regions at edges of the up direction or the down direction of the display); and when the screen moving direction is from the first direction to the second direction, the data truncation area may include an area arranged in the second direction of the display (e.g., at least some screen areas at edges of a lower direction or an upper direction of the display).

According to various embodiments, when the screen moving direction is from the second direction to the first direction, the data copy area may include an area arranged in the second direction of the display; and when the screen moving direction is from the second direction to the first direction, the data truncation area may include an area arranged in the first direction of the display.

According to various embodiments, the at least one processor may be configured to divide the plurality of pixel lines included in the data duplication area into a plurality of groups, and generate the data to be added by interpolation of the pixel lines in each of the plurality of divided groups.

According to various embodiments, the amount of data to be added may be determined differently according to the positions of equally divided screen regions.

According to various embodiments, the at least one processor may be configured to divide the plurality of pixel lines included in the data truncation region into a plurality of groups and configure (or determine) data (candidate data) to be removed using some of the data on the respective pixel lines included in the plurality of groups.

According to various embodiments, the amount of data to be removed may be determined differently according to the positions of equally divided screen regions.

According to various embodiments, the regions arranged in the first direction and the regions arranged in the second direction may be differently allocated in size according to the positions of the equally divided screens.

According to various embodiments, the at least one processor may be configured to: the data copy area of the screen area relatively first updated by the gate driver (e.g., the gate driver 141 of fig. 1) is allocated to be larger or smaller than the data copy area of the screen area relatively later updated by the gate driver.

According to various embodiments, the at least one processor may be configured to: the data truncation area of the screen area relatively first updated by the gate driver is allocated to be smaller or larger than the data truncation area of the screen area relatively later updated by the gate driver.

According to various embodiments, the at least one processor may be configured to allocate a large number for equally dividing the current screen frame as the screen moving speed (or compensation amount) increases.

According to various embodiments, the at least one processor may be configured to extract a region of interest (ROI) (e.g., the scrollable area 1004 of fig. 10 or the area 1120 of fig. 11 in which at least some of the pixel values are changed) from a screen displayed on the display, and to add and remove data within the ROI.

According to various embodiments, the at least one processor may be configured to detect the screen movement speed based on a change in pixel information on a line segment connecting a first point of the display and a second point of the display.

According to various embodiments, the line segment may include a diagonal line connecting the right side of the display and the left side of the display (e.g., a diagonal line connecting one point of the display panel 143 of fig. 4-8 with another point).

According to various embodiments, the at least one processor may be configured to determine whether a screen moving direction according to a user input coincides with the gate scanning direction, and detect a screen moving speed according to an input associated with the screen movement as the user input is received when the screen moving direction does not coincide with the gate scanning direction.

According to various embodiments, a method for compensating for screen movement of a display may include: outputting a screen on a display; receiving a user input; determining whether a screen movement direction according to the user input is identical to a gate scanning direction when the user input is an input associated with a screen movement; detecting a screen moving speed according to an input associated with the screen moving when the screen moving direction is not identical to the gate scanning direction; and determining a compensation value associated with a degree to which the current screen frame is tilted differently depending on the screen moving speed.

According to various embodiments, determining the compensation value differently may include: determining a number for equally dividing a current screen frame; dividing each of the equally divided screen regions into a center region, a data copy region, and a data truncation region in a current screen frame; and performing the following compensation operations: the additional data is added to the data copy area and the candidate data is removed from the data truncation area and displayed while moving the center area in a direction opposite to the screen moving direction. The method may further comprise: allocating sizes of the data copy area and the data truncation area differently depending on a magnitude of the screen moving speed; or the number of additional data and the number of candidate data are determined differently depending on the positions of equally divided screen regions.

According to various embodiments, detecting the screen movement speed may include: the screen moving speed is detected based on a change in pixel information on a diagonal segment connecting a first point of the display and a second point of the display. The compensating operation may include: extracting an ROI from a screen displayed on a display; detecting a screen movement speed within the ROI; and adding additional data or removing candidate data depending on the screen moving speed on the ROI.

Meanwhile, an electronic device for determining a compensation amount according to a screen moving speed and performing screen compensation based on the screen moving speed by applying the compensation amount according to an embodiment of the present disclosure is also applicable to a foldable display device. A foldable display device (or a foldable device, or a foldable electronic device) may include a first housing, a second housing, and at least one hinge structure disposed between the first housing and the second housing. The foldable display device may further include a hinge housing surrounding the hinge structure. A display whose central portion is foldable may be disposed at an upper portion of the first housing, the second housing, and the hinge structure. The at least one processor may be located in at least one of the first housing and the second housing. The at least one hinge structure may include: the central part of the hinge structure adopts a gear structure; at least one brake hinge structure capable of providing a brake feel; and at least one hinge structure, wherein the gear structure is excluded from both sides to prevent the housing from twisting. At least one plate covering the hinge structure may be arranged between the display and the hinge structure. According to various embodiments, a board (e.g., a board or sheet in a lattice structure) for protecting the display may be further disposed between one surface composed of the first case, the second case, and the hinge structure and the rear surface of the display. The foldable electronic device may have an unfolded state, a held state of a designated angle (a folded angle of 90 degrees, 120 degrees, 140 degrees, 160 degrees, etc. of the display), or a folded state.

Fig. 18 is a block diagram illustrating an electronic device 1801 in a network environment 1800 in accordance with an embodiment of the present disclosure.

Referring to fig. 18, an electronic device 1801 in a network environment 1800 may communicate with an electronic device 1802 via a first network 1898 (e.g., a short-range wireless communication network), or with the electronic device 1804 or a server 1808 via a second network 1899 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 1801 may communicate with the electronic device 1804 via the server 1808. According to an embodiment, the electronic device 1801 may include a processor 1820, a memory 1830, an input device 1850, a sound output device 1855, a display device 1860, an audio module 1870, a sensor module 1876, an interface 1877, a haptic module 1879, a camera module 1880, a power management module 1888, a battery 1889, a communication module 1890, a Subscriber Identification Module (SIM)1896, or an antenna module 1897. In some embodiments, at least one of the components (e.g., display device 1860 or camera module 1880) may be omitted from electronic device 1801, or one or more other components may be added to electronic device 1801. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 1876 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device 1860 (e.g., a display).

The processor 1820 may run, for example, software (e.g., the programs 1840) to control at least one other component (e.g., a hardware component or a software component) of the electronic device 1801 connected to the processor 1820, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or computation, the processor 1820 may load commands or data received from another component (e.g., the sensor module 1876 or the communication module 1890) into the volatile memory 1832, process the commands or data stored in the volatile memory 1832, and store the resulting data in the non-volatile memory 1834. According to an embodiment, processor 1820 may include a main processor 1821 (e.g., a Central Processing Unit (CPU) or an Application Processor (AP)) and an auxiliary processor 1823 (e.g., a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a sensor hub processor, or a Communication Processor (CP)) that is operatively independent of or in conjunction with main processor 1821. Additionally or alternatively, the secondary processor 1823 may be adapted to consume less power than the primary processor 1821, or be adapted to be specific to a specified function. Secondary processor 1823 may be implemented separately from primary processor 1821 or as part of primary processor 1821.

Secondary processor 1823 may control at least some of the functions or states associated with at least one of the components of electronic device 1801 (e.g., display device 1860, sensor module 1876, or communication module 1890) when primary processor 1821 is in an inactive (e.g., sleep) state, or secondary processor 1823 may control at least some of the functions or states associated with at least one of the components of electronic device 1801 (e.g., display device 1860, sensor module 1876, or communication module 1890) with primary processor 1821 when primary processor 1821 is in an active state (e.g., running an application). According to an embodiment, the auxiliary processor 1823 (e.g., an image signal processor or a communications processor) may be implemented as part of another component (e.g., the camera module 1880 or the communications module 1890) that is functionally related to the auxiliary processor 1823.

The memory 1830 may store various data used by at least one component of the electronic device 1801 (e.g., the processor 1820 or the sensor module 1876). The various data may include, for example, software (e.g., programs 1840) and input data or output data for commands associated therewith. The memory 1830 may include volatile memory 1832 or nonvolatile memory 1834.

The programs 1840 may be stored as software in the memory 1830, and the programs 1840 may include, for example, an Operating System (OS)1842, middleware 1844, or applications 1846.

The input device 1850 may receive commands or data from outside of the electronic device 1801 (e.g., a user) to be used by other components of the electronic device 1801 (e.g., the processor 1820). Input device 1850 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

The sound output device 1855 may output the sound signal to the outside of the electronic device 1801. The sound output device 1855 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as playing multimedia or playing a record and the receiver may be used for incoming calls. Depending on the embodiment, the receiver may be implemented separate from the speaker, or as part of the speaker.

The display device 1860 may visually provide information to the outside (e.g., user) of the electronic device 1801. The display device 1860 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, the display device 1860 may include touch circuitry adapted to detect touches or sensor circuitry (e.g., pressure sensors) adapted to measure the intensity of forces caused by touches.

The audio module 1870 may convert sound into electrical signals and vice versa. According to an embodiment, the audio module 1870 may obtain sound via an input device 1850 or output sound via a sound output device 1855 or headphones of an external electronic device (e.g., electronic device 1802) connected directly (e.g., wired) or wirelessly with the electronic device 1801.

The sensor module 1876 may detect an operating state (e.g., power or temperature) of the electronic device 1801 or an environmental state (e.g., state of a user) external to the electronic device 1801, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1876 may include, for example, a gesture sensor, a gyroscope sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an Infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1877 may support one or more specific protocols that will be used to connect the electronic device 1801 with an external electronic device (e.g., electronic device 1802) either directly (e.g., wired) or wirelessly. According to an embodiment, the interface 1877 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

Connection end 1878 may include a connector via which electronic device 1801 may be physically connected with an external electronic device (e.g., electronic device 1802). According to an embodiment, the connection end 1878 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module 1879 may convert the electrical signal into a mechanical stimulus (e.g., vibration or motion) or an electrical stimulus that can be recognized by the user via his sense of touch or movement. According to embodiments, the haptic module 1879 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

The camera module 1880 may capture still images or moving images. According to an embodiment, camera module 1880 may include one or more lenses, image sensors, image signal processors, or flash lights.

Power management module 1888 may manage power to electronic device 1801. According to an embodiment, the power management module 1888 may be implemented as at least part of a Power Management Integrated Circuit (PMIC), for example.

The battery 1889 may power at least one component of the electronic device 1801. According to an embodiment, battery 1889 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module 1890 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1801 and an external electronic device (e.g., the electronic device 1802, the electronic device 1804, or the server 1808), and performing communication via the established communication channel. The communication module 1890 may include one or more communication processors capable of operating independently of the processor 1820 (e.g., an Application Processor (AP)) and supporting direct (e.g., wired) or wireless communication. According to an embodiment, communication module 1890 may include a wireless communication module 1892 (e.g., a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module) or a wired communication module 1894 (e.g., a Local Area Network (LAN) communication module or a Power Line Communication (PLC) module). A respective one of these communication modules may communicate with external electronic devices via a first network 1898 (e.g., a short-range communication network such as bluetooth, wireless fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or a second network 1899 (e.g., a long-range communication network such as a cellular network, the internet, or a computer network (e.g., a LAN or Wide Area Network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) that are separate from one another. The wireless communication module 1892 may identify and authenticate the electronic device 1801 in a communication network, such as the first network 1898 or the second network 1899, using subscriber information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the subscriber identity module 1896.

The antenna module 1897 may transmit or receive signals or power to/from outside of the electronic device 1801 (e.g., an external electronic device). According to embodiments, the antenna module 1897 may include an antenna that includes a radiating element composed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 1897 may include multiple antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network such as the first network 1898 or the second network 1899 may be selected from the plurality of antennas by, for example, the communication module 1890 (e.g., the wireless communication module 1892). Signals or power may then be transmitted or received between the communication module 1890 and external electronic devices via the selected at least one antenna. According to an embodiment, additional components other than the radiating elements, such as a Radio Frequency Integrated Circuit (RFIC), may be additionally formed as part of antenna module 1897.

At least some of the above components may be interconnected and communicate signals (e.g., commands or data) communicatively between them via an inter-peripheral communication scheme (e.g., bus, General Purpose Input Output (GPIO), Serial Peripheral Interface (SPI), or Mobile Industry Processor Interface (MIPI)).

According to an embodiment, commands or data may be transmitted or received between the electronic device 1801 and the external electronic device 1804 via the server 1808 connected to the second network 1899. Each of the electronic device 1802 and the electronic device 1804 may be the same type of device as the electronic device 1801, or a different type of device from the electronic device 1801. According to an embodiment, all or some of the operations to be performed at the electronic device 1801 may be performed at one or more of the external electronic device 1802, the external electronic device 1804, or the server 1808. For example, if the electronic device 1801 should automatically perform a function or service or should perform a function or service in response to a request from a user or another device, the electronic device 1801 may request the one or more external electronic devices to perform at least part of the function or service instead of executing the function or service, or the electronic device 1801 may request the one or more external electronic devices to perform at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may perform the requested at least part of the functions or services or perform another function or another service related to the request and transmit the result of the execution to the electronic device 1801. The electronic device 1801 may provide the result as at least a partial reply to the request with or without further processing of the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may comprise, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to the embodiments of the present disclosure, the electronic devices are not limited to those described above.

It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents, or alternatives to the respective embodiments. For the description of the figures, like reference numerals may be used to refer to like or related elements. It will be understood that a noun in the singular corresponding to a term may include one or more things unless the relevant context clearly dictates otherwise. As used herein, each of the phrases such as "a or B," "at least one of a and B," "at least one of a or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B or C" may include any or all possible combinations of the items listed together with the respective one of the plurality of phrases. As used herein, terms such as "1 st" and "2 nd" or "first" and "second" may be used to distinguish one element from another element simply and not to limit the elements in other respects (e.g., importance or order). It will be understood that, if an element (e.g., a first element) is referred to as being "coupled to", "connected to" or "connected to" another element (e.g., a second element), it can be directly (e.g., wiredly) connected to, wirelessly connected to, or connected to the other element via a third element, when the term "operatively" or "communicatively" is used or not.

As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuitry"). A module may be a single integrated component adapted to perform one or more functions or a minimal unit or portion of the single integrated component. For example, according to an embodiment, the modules may be implemented in the form of Application Specific Integrated Circuits (ASICs).

The various embodiments set forth herein may be implemented as software (e.g., program 1840) including one or more instructions stored in a storage medium (e.g., internal memory 1836 or external memory 1838) readable by a machine (e.g., electronic device 1801). For example, under control of a processor, the processor (e.g., processor 1820) of the machine (e.g., electronic device 1801) may invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to be operable to perform at least one function in accordance with the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code capable of being executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Where the term "non-transitory storage medium" is a tangible device and does not include a signal (e.g., an electromagnetic wave), the term does not distinguish between data being stored semi-permanently in the storage medium and data being stored temporarily in the storage medium. For example, a "non-transitory storage medium" may include a buffer that temporarily stores data.

According to embodiments, methods according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be used as a product for conducting a transaction between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium, such as a compact disc read only memory (CD-ROM), or may be distributed (e.g., downloaded or uploaded) online via an application store (e.g., a Play store), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product (e.g., the downloadable application) may be temporarily generated or at least part of the computer program product may be temporarily stored in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a forwarding server.

According to various embodiments, each of the above components (e.g., modules or programs) may comprise a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as the corresponding one of the plurality of components performed the one or more functions prior to integration. Operations performed by a module, program, or another component may be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or one or more of the operations may be performed in a different order or omitted, or one or more other operations may be added, in accordance with various embodiments.

According to various embodiments of the present disclosure, an electronic device may support more natural screen movement.

While the disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising:

a display; and

at least one processor operatively connected to the display,

wherein the at least one processor is configured to:

receiving a user input associated with movement of a screen output on a display,

detecting a screen movement speed corresponding to a user input associated with the screen movement,

wherein the screen moving speed includes a first section for changing the screen tilt compensation amount according to the level of the screen moving speed, a second section for maintaining the screen tilt compensation amount, and a third section for not applying the screen tilt compensation,

the grade of the second interval is faster than that of the first interval, and the grade of the third interval is faster than that of the second interval or slower than that of the first interval.

2. The electronic device of claim 1, wherein the screen tilt compensation amount comprises 0 when the screen tilt compensation amount remains constant.

3. The electronic device according to claim 1, wherein when the screen tilt compensation amount is kept constant, the screen tilt compensation amount includes a specific value other than 0.

4. The electronic device according to claim 3, wherein when the screen moving speed is included in a third interval that is faster than the second interval, the screen tilt compensation amount corresponding to the screen movement based on the screen moving speed includes 0.

5. The electronic device according to claim 1, wherein the change in the screen tilt compensation amount corresponding to the screen movement speed is a linear change when the screen tilt compensation amount corresponding to the screen movement is determined based on the screen movement speed, or wherein the change in the screen tilt compensation amount corresponding to the screen movement speed is a non-linear change when the screen tilt compensation amount corresponding to the screen movement is determined based on the screen movement speed.

6. The electronic device of claim 1, wherein the at least one processor is further configured to:

determining the number for equally dividing the current screen frame into screen regions according to the screen tilt compensation amount,

dividing each of the equally divided screen regions into a center region, a data copy region, and a data truncation region in the current screen frame, an

The following compensation operations are performed: an amount of data is added to the data copy area and removed from the data truncation area and displayed while moving the center area in a direction opposite to the screen movement.

7. The electronic device of claim 6, wherein the at least one processor allocates the sizes of the data copy area and the data truncation area differently according to an amount of screen tilt compensation.

8. The electronic device of claim 6,

wherein when the screen moving direction is from a first direction to a second direction, the data copy area is an area arranged in the first direction of the display,

wherein when the screen moving direction is from the first direction to the second direction, the data truncation area is an area arranged in the second direction of the display,

wherein when the screen moving direction is from the second direction to the first direction, the data copy area is an area arranged in the second direction of the display,

wherein the data truncation area is an area arranged in the first direction of the display when the screen moving direction is from the second direction to the first direction.

9. The electronic device of claim 6,

wherein the at least one processor divides a plurality of pixel lines included in the data duplication area into a plurality of groups and generates data to be added by interpolation of the pixel lines in each of the plurality of groups, an

Wherein the amount of data to be added is determined differently with respect to the positions of the equally divided screen regions.

10. The electronic device of claim 6,

wherein the at least one processor divides the plurality of pixel lines included in the data truncation region into a plurality of groups and determines data to be removed, using data on the respective pixel lines included in the plurality of groups, and

wherein the amount of data to be removed is determined differently with respect to the positions of the equally divided screen regions.

11. The electronic device according to claim 6, wherein a region in which the screen movement direction is arranged in the first direction and a region in which the screen movement direction is arranged in the second direction are changed in size with respect to positions of the equally divided screens, and

wherein the at least one processor is further configured to:

allocating a data copy area of the screen area updated earlier by the gate driver to be larger or smaller than a data copy area of the screen area updated later by the gate driver; or the data truncation area of the screen area updated earlier by the gate driver is allocated to be smaller or larger than the data truncation area of the screen area updated later by the gate driver.

12. The electronic device of claim 6, wherein the at least one processor is further configured to:

allocating a larger number for equally dividing the current screen frame as the screen tilt compensation amount increases; or a region of interest (ROI) is extracted from a screen displayed on a display and data is added and removed within the ROI.

13. The electronic device of claim 6, wherein at least one processor is configured to detect the screen movement speed based on a change in pixel information on a line segment connecting a first point of the display and a second point of the display, and

wherein the line segment comprises a diagonal connecting a right portion of the display and a left portion of the display.

14. The electronic device of claim 1, wherein the at least one processor is further configured to:

determining whether a screen moving direction corresponding to a user input is consistent with a gate scanning direction; and

when the screen moving direction does not coincide with the gate scanning direction, a screen moving speed corresponding to an input associated with the screen movement is detected when the user input is received.