WO2024112005A1

WO2024112005A1 - Electronic device comprising display and operation method therefor

Info

Publication number: WO2024112005A1
Application number: PCT/KR2023/018492
Authority: WO
Inventors: 박준영; 김승진; 마경희; 이성준; 장창재; 정지순; 조광래
Original assignee: 삼성전자 주식회사
Priority date: 2022-11-23
Filing date: 2023-11-16
Publication date: 2024-05-30
Also published as: EP4398233A1

Abstract

According to one embodiment, an electronic device comprises a memory, a processor, a display controller, and a display, wherein the memory stores at least one instruction for causing, when executed by the processor, the electronic device to: transmit a first frame to the display controller; acquire a second frame for updating some layers of a plurality of layers related to the first frame; and confirm, on the basis that the some layers of the plurality of layers are confirmed to be layers corresponding to a region of interest (ROI) of the first frame, that a screen break occurs if the second frame is transmitted to the display. On the basis that the screen break is confirmed to occur, the second frame may not be written in the memory included in the display, while the first frame is being scanned to the display.

Description

Electronic device including display and method of operating same

Embodiments of the present disclosure relate to an electronic device including a display and a method of operating the same.

As electronic, information, and communication technologies develop, various functions are being integrated into a single portable communication device or electronic device. For example, electronic devices (e.g., smartphones, wearable electronic devices, or other portable electronic devices) can perform communication functions as well as more diverse functions through the installation and execution of various applications.

Additionally, the electronic device may include a display capable of displaying information related to the execution of various functions. For example, the display may include various display devices such as a liquid crystal display (LCD), an organic light emitting diode display (OLED display), or an electrophoretic display.

An electronic device according to an embodiment may include a memory, a processor, a display controller, and a display.

The memory according to an embodiment, when executed by the processor, causes the electronic device to send a first frame to the display controller based on the first tearing signal output from the display at the first output time. At least one instruction causing transmission may be stored.

The memory according to one embodiment, when executed by the processor, causes the electronic device to obtain a second frame for updating some of the plurality of layers related to the first frame. One instruction can be saved.

The memory according to one embodiment, when executed by the processor, causes the electronic device to determine that some of the layers among the plurality of layers correspond to a region of interest (ROI) of the first frame. If it is confirmed that it is a layer, at least one instruction that causes it to be confirmed that screen tearing occurs when the second frame is transmitted to the display through the display controller can be stored.

In the electronic device according to one embodiment, based on determining that the screen is broken, the second frame is not written to the memory included in the display while the first frame is being scanned on the display. It may not be possible.

In a method of operating an electronic device according to an embodiment, based on a first tearing signal output from a display included in the electronic device at a first output time, a first frame is transmitted to a display controller included in the electronic device. It may include a transmitting operation.

A method of operating an electronic device according to an embodiment may include obtaining a second frame for updating some layers related to the first frame.

In a method of operating an electronic device according to an embodiment, when it is confirmed that the second frame is a layer corresponding to a region of interest (ROI) of the first frame, the second frame is transmitted to the display. In this case, it may include an operation to check that a screen is broken.

In a method of operating an electronic device according to an embodiment, based on confirming that the screen is broken, the second frame is written to the memory included in the display while the first frame is being scanned on the display. It may not be written.

In a storage medium storing at least one computer-readable instruction according to an embodiment, the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to display a display included in the electronic device. Based on the first tearing signal output at the first output time, an operation of transmitting the first frame to the display controller included in the electronic device may be caused to be performed.

In a storage medium storing at least one computer-readable instruction according to an embodiment, the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to display a plurality of instructions related to the first frame. It may cause an operation to obtain a second frame to update some of the layers of .

In a storage medium storing at least one computer-readable instruction according to an embodiment, the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to display the second frame as the first Based on confirmation that it is a layer corresponding to the region of interest (ROI) of 1 frame, it may be caused to perform an operation to determine that screen tearing occurs when transmitting the second frame to the display. .

In a storage medium storing at least one computer-readable instruction according to an embodiment, based on confirmation that the screen is broken, the second frame is displayed while the first frame is being scanned on the display. The memory included in the display may not be written.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.

2 is a block diagram of a display module, according to various embodiments.

FIG. 3A is a schematic block diagram of the configuration of an electronic device according to an embodiment.

FIG. 3B is a schematic block diagram of the configuration of an electronic device according to an embodiment.

FIG. 4A is a flowchart showing a method of operating an electronic device according to an embodiment.

FIG. 4B is a flowchart showing a method of operating an electronic device according to an embodiment.

Figure 5 is a timing diagram showing the frame transmission, writing, and scanning processes after adjusting the output timing of the tearing signal according to a comparative example.

FIG. 6A is a flowchart illustrating a method of operating an electronic device to prevent screen cracking according to an embodiment.

FIG. 6B is a timing diagram illustrating frame transmission, writing, and scanning processes according to an embodiment.

FIG. 7A is a flowchart illustrating a method of operating an electronic device to prevent screen cracking, according to an embodiment.

FIG. 7B is a timing diagram illustrating frame transmission, writing, and scanning processes according to an embodiment.

FIG. 8A is a flowchart illustrating a method of operating an electronic device to prevent screen cracking according to an embodiment.

FIG. 8B is a timing diagram illustrating frame transmission, writing, and scanning processes according to an embodiment.

The various embodiments of the invention mentioned herein can be advantageously combined with each other, unless otherwise specified in individual cases.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access to multiple terminals (massive machine type communications (mMTC)), or ultra-reliable and low-latency (URLLC). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern created on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally produced as part of the antenna module 197.

According to one embodiment, the antenna module 197 may generate a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external

electronic devices

102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external

electronic devices

102, 104, or 108. For example, when the electronic device 101 must perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a block diagram 200 of a display device 260 according to various embodiments. Referring to FIG. 2 , the display device 260 may include a display 210 and a display driver IC (DDI) 230 for controlling the display 210 . The DDI 230 may include an interface module 231, a memory 233 (eg, buffer memory), an image processing module 235, or a mapping module 237. For example, the DDI 230 receives image information including image data or an image control signal corresponding to a command for controlling the image data from other components of the electronic device 101 through the interface module 231. can do. For example, according to one embodiment, the image information is stored in the processor 120 (e.g., the main processor 121 (e.g., an application processor) or the auxiliary processor 123 ( For example, the DDI 230 may communicate with the touch circuit 250 or the sensor module 276 through the interface module 231. The image processing module 235 may store at least a portion of the received image information in the memory 233, for example, in units of frames. The mapping module 237 may perform pre-processing or post-processing (eg, resolution, brightness, or size adjustment) based at least on the characteristics of the display 210. According to one embodiment, a voltage value or a current value corresponding to the image data may be generated, for example, through properties of pixels of the display 210 (e.g., an arrangement of pixels). At least some pixels of the display 210 may be based at least in part on the RGB stripe or pentile structure (or the size of each subpixel), for example, at least in part based on the voltage value or the current value. By driving, visual information (eg, text, image, or icon) corresponding to the image data may be displayed through the display 210.

According to one embodiment, the display device 260 may further include a touch circuit 250. The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251. For example, the touch sensor IC 253 may control the touch sensor 251 to detect a touch input or a hovering input for a specific position of the display 210. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or charge amount) for a specific position of the display 210. The touch sensor IC 253 may provide information (e.g., location, area, pressure, or time) about the detected touch input or hovering input to the processor 120. According to one embodiment, at least a portion of the touch circuit 250 (e.g., touch sensor IC 253) is disposed outside the display driver IC 230, a part of the display 210, or the display device 260. It may be included as part of other components (e.g., auxiliary processor 123).

According to one embodiment, the display device 260 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illumination sensor) of the sensor module 276, or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display device 260 (eg, the display 210 or the DDI 230) or a part of the touch circuit 250. For example, when the sensor module 276 embedded in the display device 260 includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor transmits biometric information associated with a touch input through a portion of the display 210. (e.g. fingerprint image) can be acquired. For another example, when the sensor module 276 embedded in the display device 260 includes a pressure sensor, the pressure sensor may acquire pressure information associated with a touch input through part or the entire area of the display 210. You can. According to one embodiment, the touch sensor 251 or the sensor module 276 may be disposed between pixels of a pixel layer of the display 210, or above or below the pixel layer.

According to one embodiment, the electronic device 301 (eg, the electronic device 101 of FIG. 1) may include a first processor 320, a memory 330, and a display 360.

According to one embodiment, the electronic device 301 may be implemented identically or similarly to the electronic device 101 of FIG. 1 .

According to one embodiment, the display 360 may be implemented the same or similar to the display module 160 of FIG. 1 or the display device 260 of FIG. 2. According to one embodiment, the display 360 may include a display driver integrated circuit (IC) (DDI) 370 and a display panel 380. According to one embodiment, a display driver integrated circuit (IC) (DDI) 370 may control the display panel 380. According to one embodiment, the display driver IC 370 may be implemented the same or similar to the display driver IC (DDI) 230 of FIG. 2.

According to one embodiment, the first processor 320 may control the overall operation of the electronic device 301. For example, the first processor 320 may be implemented identically or similarly to the processor 120 of FIG. 1 . According to one embodiment, the first processor 320 may be implemented as an application processor (AP). According to one embodiment, the first processor 320 may include a second processor 321, a third processor 322, and a display controller 350. The display controller 350 may be implemented as a display processing unit (DPU) or data processing unit (DPU). According to one embodiment, the second processor 321 may be implemented as a graphics processing unit (GPU). According to one embodiment, the third processor 322 may be implemented as a central processing unit (CPU). According to one embodiment, the third processor 322 may execute a display driver.

According to one embodiment, the display controller 350 may receive a tearing signal for a frame (or image) from the display 360. For example, a tearing signal may mean a tearing effect (TE) signal.

The tearing effect (TE) may refer to a visual artifact that appears when a plurality of frames are displayed as one screen on the display 360. For example, if the screen refresh rate of the display 360 and the frame rate of the GPU are not synchronized, a tearing effect (TE) may occur.

According to one embodiment, the tearing signal is used to prevent the tearing effect of the frame being scanned (or displayed) on the display panel 380 by dividing the time period in which the frame is written and the frame being scanned (or displayed). It may include a control signal for determining the time interval. When the tearing signal is confirmed, the display controller 350 may transmit a frame to the display driver IC 370. According to one embodiment, the operation of the display controller 350 transmitting the frame to the display driver IC 370 is performed when the display driver IC 370 operates as a memory for the display 360 (e.g., memory 233 in FIG. 2). ) (e.g., graphic ram (GRAM)), the display driver IC 370 reads the frame written to the memory 233. For example, the cycle of the tearing signal may match the cycle of the synchronization signal (eg, the Vsync signal). According to one embodiment, the output time of may be adjusted based on the output time of the synchronization signal, the tearing signal rises at the rising edge time of the synchronization signal, and the tearing signal rises at the falling point of the synchronization signal (e.g. According to one embodiment, the point at which the tearing signal rises may be the point at which the tearing signal is output. According to one embodiment, the frame is transmitted to the display driver IC 370 when the signal rises, and the display driver IC 370 writes the frame to the memory 233. ) can read a frame from the memory 233 at the falling point of the tearing signal and scan (or display) the frame on the display panel 380.

According to one embodiment, the second processor 321 may render a frame (or image). According to one embodiment, the second processor 321 may transmit the rendered frame (or image) to the third processor 322. According to one embodiment, the third processor 322 may transmit a frame to the display controller 350. According to one embodiment, the display controller 350 may transmit a frame (or image) to a display driver integrated circuit (IC) 370. According to one embodiment, the display controller 350 converts the first frame received from the third processor 322 to a display driver IC (integrated circuit) 370 based on a tearing signal output at regular intervals from the display 360. ) can be transmitted to. According to one embodiment, the tearing signal may be output at a point in time advanced by a specified time based on the output point of the reference tearing signal. For example, the reference tearing signal may refer to a tearing signal output from the display 360 at the output time before adjustment. For example, the designated time may be determined based on at least one of the number of layers constituting the frame, the resolution of the display 360, or the frequency (frame rate). For example, the resolution of the display 360 may be implemented as 3,088 (number of horizontal pixels) Х number of vertical pixels). For example, the frequency of the display 360 may be implemented at 120Hz. For example, for setting values based on the resolution, the frequency, and the number of four layers, the specified time may be 2 ms. However, this is an example, and embodiments of the present invention may set the designated time based on various methods.

According to one embodiment, the display controller 350 may transmit the first frame to the display driver IC 370 at the time of output of the tearing signal. According to one embodiment, the first frame may be written to the memory 233 (eg, the memory 233 in FIG. 2) at the time of output of the tearing signal. According to one embodiment, the memory 233 may be implemented as graphic RAM (GRAM). According to one embodiment, the display driver IC 370 may read the first frame from the memory 233 and scan (or display) the first frame on the display panel 380.

According to one embodiment, the third processor 322 may receive a second frame for updating some layers related to the first frame from the second processor 321. For example, the second frame may be a frame rendered by the second processor 321 after the first frame. According to one embodiment, the third processor 322 may check whether the second frame is a frame for updating part of the first frame. For example, the third processor 322 may check whether the second frame is a frame for updating some of the plurality of layers constituting the first frame. At this time, the second frame may include only some layers rather than all layers. If the third processor 322 determines that the second frame is a frame for updating a portion of a layer of the first frame, the third processor 322 determines that the second frame is a region of interest of the first frame. You can check whether it is to update the layer corresponding to ROI). For example, the area of interest may include the bottom area of the first frame displayed (or scanned) on the display panel 380. For example, the area of interest may be set based on user input. For example, the area of interest is not limited to the bottom area of the first frame and may include at least a portion of the first frame displayed on the display panel 380.

According to one embodiment, when the third processor 322 determines that the second frame is for updating a layer corresponding to the region of interest of the first frame, the third processor 322 updates the second frame based on the tearing signal to a display driver IC (integrated circuit) (370), it can be confirmed that screen cracking occurs (or is expected). For example, when transmitting the second frame to the display driver IC (integrated circuit) 370 based on the tearing signal, the display driver IC (integrated circuit) 370 transmits the first frame written to the memory 233 to the display panel. The time of scanning (or displaying) at 380 and the time of writing the second frame to the memory 233 by the display driver integrated circuit (IC) 370 may overlap. As a result, the image or frame displayed (or scanned) through the display 360 may be broken.

According to one embodiment, the third processor 322 and the display controller 350 may perform an operation to prevent screen tearing based on an operation that confirms that screen tearing has occurred.

According to one embodiment, the display controller 350 may transmit the second frame to the display driver IC 370 after the first frame is scanned (or displayed) on the display panel 380. According to one embodiment, the display controller 350 may transmit the second frame to the display driver IC 370 after a specified first time from the point of output of the tearing signal. According to one embodiment, the designated first time (e.g., 2ms) is the time between the output of the tearing signal and the time when the first frame is scanned (or displayed) on the display panel 380. It can mean. Alternatively, according to one embodiment, the third processor 322 may transmit the second frame to the display controller 350 after a designated second time from the point of output of the tearing signal. According to one embodiment, the designated second time (e.g., 2ms) is the time between the output of the tearing signal and the time when the first frame is scanned (or displayed) on the display panel 380. It can mean. According to one embodiment, the designated first time and the designated second time may be the same time or may be different times. According to one embodiment, the designated first time and the designated second time are the time interval in which the region of interest of a portion of the first frame is scanned (or displayed) on the display panel 380 and the layer corresponding to the region of interest is updated. This may refer to a time set so that the time intervals in which the second frame is transmitted to the display driver IC 370 do not match. For example, the operation of transmitting the second frame to the display driver IC 370 may include the display driver IC 370 writing the second frame to the memory 233. For example, when partially updating the first frame, the third processor 322 may adjust the timing of transmitting the second frame to the display driver IC 370. Through this, screen tearing may not occur even when only a portion of the frame is updated.

According to one embodiment, the third processor 322 may transmit a third frame to update the entire first frame to the display controller 350 based on an operation that confirms that the screen is broken. According to one embodiment, the display controller 350 may receive the third frame from the third processor 322 based on the tearing signal. According to one embodiment, the display controller 350 may transmit the third frame to the display driver IC 370 at the time of output of the tearing signal. According to one embodiment, the display controller 350 may transmit the third frame to the display driver IC 370 while the first frame is being scanned (or displayed) on the display panel 380. For example, the operation of transmitting the third frame to the display driver IC 370 may include the display driver IC 370 writing the third frame to the memory 233. For example, if the first frame is updated entirely rather than partially updated, screen tearing may not occur. Accordingly, when the screen is expected to be broken, the third processor 322 requests the second processor 321 for a third frame to update the first frame as a whole, and receives the third frame from the second processor 321. 3 frames can be transmitted to the display controller 350.

According to one embodiment, the third processor 322 may receive the first frame in response to the output of the first tearing signal. However, if the first frame is not received from the output time of the first tearing signal to the output time of the subsequent second tearing signal (e.g., a tearing signal output after the first tearing signal), frame delay occurs. It can be. For example, when a frame delay occurs, the third processor 322 may transmit the first frame to the display controller 350 in a time section following the originally allocated time section. To solve this problem, the third processor 322 may advance the output timing of the tearing signal by a designated time (eg, 2 ms). Through this, the third processor 322 can wait for a frame rendered from the second processor 321 for a specified amount of time. Additionally, the third processor 322 can reduce the occurrence of frame delay.

According to one embodiment, the first processor 320 (e.g., the first processor 320 in FIG. 3A) includes a second processor 321 (e.g., the second processor 321 in FIG. 3A), and a third processor ( 322) (eg, the third processor 322 in FIG. 3A) and a display controller 350 (eg, the display controller 350 in FIG. 3A).

According to one embodiment, the third processor 322 may execute Surface flinger 381, HW composer 382, and display driver 383. According to one embodiment, the second processor 321 may render a frame (or image). According to one embodiment, the rendered frame (or image) may be stored in a graphics buffer (eg, a frame storage area of the memory 330).

According to one embodiment, the Surface flinger 381 may transmit graphics buffer information (e.g., address of the frame storage area, resolution information, etc.) to the HW composer 382. According to one embodiment, the HW composer 382 may transmit information about the graphics buffer to the display driver 383.

According to one embodiment, the display driver 383 may transmit the rendered frame to the display controller 350. For example, the display driver 383 may determine when the display controller 350 will transmit a frame to the display 360 (eg, the display 360 of FIG. 3A). For example, the time to transmit the frame may be the time when the tearing signal is output (or the time when the display controller 350 checks the tearing signal). According to one embodiment, the display driver 383 may advance the output timing of the reference tearing signal by adjusting it by a specified time (eg, 2 ms).

According to one embodiment, the display controller 350 may transmit a frame to the display 360 at the time of output of the adjusted tearing signal. For example, the operation of the display controller 350 to transmit a frame may include an operation of the display 360 to write the frame to the memory 233 (eg, memory 233 in FIG. 2).

According to one embodiment, the display 360 may read a frame from the memory 233 and scan (or display) the frame on the display 360.

FIG. 4A is a flowchart showing a method of operating an electronic device according to an embodiment. Although the flow diagram of FIG. 4A includes a conditional branch statement such as operation 405, each of the branching operations may form a separate additional embodiment, and each of the branching operations may be optional, as described below. can be regarded as

According to one embodiment, in operation 401, the display controller 350 (e.g., the display controller 350 in FIG. 3A) performs tearing output at a certain period from the display 360 (e.g., the display 360 in FIG. 3A). Based on the signal, the first frame may be transmitted to the display 360. According to one embodiment, the first frame may refer to a frame rendered by the second processor 321 (eg, the second processor 321 in FIG. 3A). According to one embodiment, the output timing of the tearing signal may be adjusted to advance by a specified time (eg, 2 ms) from the output timing of the reference tearing signal. For example, the reference tearing signal may refer to a tearing signal output from the display 360 at the output time before adjustment. For example, the designated time may be determined based on at least one of the number of layers constituting the frame, the resolution of the display 360, or the frequency. However, this is an example, and embodiments of the present invention may set the designated time based on various methods.

According to one embodiment, the first frame may be written to the memory 233 (eg, the memory 233 in FIG. 2) at the time the tearing signal is output. According to one embodiment, the display controller 350 may transmit the first frame to the display 360 within a preset time (eg, 2 ms) from the time the tearing signal is output. According to one embodiment, the display 360 may read the first frame from the memory 233 and scan (or display) the first frame. According to one embodiment, the preset time may be set by the user or may be set by the first processor 320.

According to one embodiment, at operation 403, a third processor 322 (e.g., third processor 322 in Figure 3A) (e.g., display driver 383) (e.g., display driver 383 in Figure 3b) may receive a second frame from the second processor 321 to update some layers related to the first frame. According to one embodiment, the second frame may include a frame rendered by the second processor 321 after the first frame. According to one embodiment, the second frame may include only some layers rather than all layers.

According to one embodiment, in operation 405, the third processor 322 (e.g., display driver 383) determines that the second frame is a layer corresponding to the region of interest of the first frame (e.g., the bottom region of the first frame). You can check whether it is a frame for updating. If

operations

411 and 413 are not part of the above-described embodiment, operation 405 may cause the third processor 322 (e.g., display driver 383) to convert the second frame to the ROI of the first frame (e.g., It can be expressed as a step of determining that the frame is for updating the layer corresponding to the lower area of the first frame. If

operations

407 and 409 are not part of the above-described embodiment, operation 405 may cause the third processor 322 (e.g., display driver 383) to display the ROI of the first frame (e.g., It can be expressed as a step of determining that the frame is not for updating the layer corresponding to the lower area of the first frame.

According to one embodiment, the third processor 322 (e.g., display driver 383) is configured to update the layer that the second frame corresponds to the region of interest of the first frame (e.g., the bottom region of the first frame). If it is confirmed to be a frame (operation 405 - Yes), in operation 407, it can be confirmed that when the second frame is transmitted to the display 360 through the display controller 350, screen tearing occurs (or is expected). For example, when transmitting the second frame to the display 360 based on a tearing signal, the time when the display 360 scans (or displays) the first frame written in the memory 233 and the display 360 The timing of writing the second frame to the memory 233 may overlap. As a result, the image or frame displayed (or scanned) through the display 360 may be broken. According to one embodiment, the third processor 322 (eg, display driver 383) may transmit the second frame to the display controller 350. For example, the third processor 322 sends information related to the time when the display controller 350 transmits the second frame to the display 360 (e.g., the first time specified from the time of output of the tearing signal) to the display controller 350. ) can be transmitted to. Alternatively, for example, the third processor 322 may transmit the second frame to the display controller 350 after a specified second time (eg, 2 ms) from the point of output of the tearing signal.

According to one embodiment, in operation 409, the display controller 350 may transmit a second frame to the display 360 after the first frame is scanned (or displayed) on the display. According to one embodiment, the display controller 350 may transmit the second frame to the display 360 after a designated first time (eg, 2 ms) from the point of output of the tearing signal. Or, according to one embodiment, the display controller 350 receives a second frame from the third processor 322 (e.g., the display driver 383) after a specified second time (e.g., 2 ms) from the point of output of the tearing signal. can receive. According to one embodiment, the designated first time and the designated second time may be the same time or may be different times. According to one embodiment, the designated first time and the designated second time are a time interval in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and a layer corresponding to the region of interest is updated. This may mean a time set so that the time intervals for which the second frame is transmitted to the display 360 do not match.

As a result, the electronic device 301 (e.g., the electronic device 301 in FIG. 3A) determines that the time interval at which the ROI of the first frame is scanned (or displayed) on the display 360 is used to update the layer corresponding to the ROI. It can be ensured that the time interval at which the second frame is transmitted to the display 360 (or the time interval at which the second frame is read) does not match, thus avoiding screen tearing when updating only part of the screen.

According to one embodiment, the operation of the display controller 350 transmitting the second frame to the display 360 after a designated first time (e.g., 2 ms) from the point of output of the tearing signal will be described in detail in FIG. 6A. will be. According to one embodiment, the operation of the third processor 322 transmitting a second frame to the display controller 350 after a specified second time (e.g., 2 ms) from the point of output of the tearing signal is described in detail in FIG. 7A. I will explain.

According to one embodiment, the third processor 322 (e.g., display driver 383) determines that the second frame corresponds to the area of interest of the first frame (e.g., the bottom area of the first frame). If it is not confirmed as a frame for updating the layer (operation 405 - No), in operation 411, it can be confirmed that the screen is not broken when the second frame is transmitted to the display 360 through the display controller 350. there is.

According to one embodiment, in operation 413, the display controller 350 may transmit the second frame to the display 360 at the time of output of the tearing signal. According to one embodiment, the display controller 350 may transmit the second frame to the display 360 while the first frame is scanned (or displayed) on the display 360. According to one embodiment, the second frame may be written to the memory 233 at the time the tearing signal is output. According to one embodiment, the display controller 350 may transmit the second frame to the display 360 after a preset time from when the tearing signal is output. For example, the display 360 may read the second frame from the memory 233 at the falling point of the tearing signal and scan (or display) the second frame.

According to one embodiment, the electronic device 301 (e.g., the electronic device 301 in FIG. 3A) displays a frame that updates only part of the screen on the display, thereby reducing the value of current consumption consumed to update the entire screen. there is. Additionally, the electronic device 301 may not cause screen tearing when updating only part of the screen.

FIG. 4B is a flowchart showing a method of operating an electronic device according to an embodiment. Although the flow diagram of FIG. 4B includes a conditional branch statement such as operation 425, each of the branching operations may form a separate additional embodiment, and each of the branching operations may be optional, as described below. can be regarded as

According to one embodiment, in operation 421, the display controller 350 (e.g., the display controller 350 in FIG. 3A) performs a tearing signal output at regular intervals from the display 360 (e.g., the display 360 in FIG. 3a). Based on the signal, the first frame may be transmitted to the display 360. According to one embodiment, the output timing of the tearing signal may be adjusted to advance by a specified time (eg, 2 ms) from the output timing of the reference tearing signal.

According to one embodiment, at operation 423, a third processor 322 (e.g., third processor 322 in Figure 3A) (e.g., display driver 383) (e.g., display driver 383 in Figure 3B) may receive a second frame from the second processor 321 to update some layers related to the first frame.

According to one embodiment, in operation 425, the third processor 322 (e.g., display driver 383) determines that the second frame is a layer corresponding to the region of interest of the first frame (e.g., the bottom region of the first frame). You can check whether it is a frame for updating.

If operations 431 and 433 are not part of the above-described embodiment, operation 425 may cause the third processor 322 (e.g., display driver 383) to display the ROI (e.g., ROI) of the first frame by the second frame. It can be expressed as a step of determining that the frame is for updating the layer corresponding to the lower area of the first frame. If operations 427 and 429 are not part of the above-described embodiment, operation 425 may cause the third processor 322 (e.g., display driver 383) to display the ROI of the first frame (e.g., It can be expressed as a step of determining that the frame is not for updating the layer corresponding to the lower area of the first frame.

According to one embodiment, the third processor 322 (e.g., display driver 383) determines that the second frame is a frame for updating the layer corresponding to the region of interest in the first frame (operation 425 - yes). , In operation 427, when the second frame is transmitted to the display 360 through the display controller 350, it can be confirmed that screen tearing occurs (or is expected).

According to one embodiment, in operation 429, the display controller 350 may transmit a third frame to update the entire first frame to the display 360 at the time of output of the tearing signal. For example, if the first frame is updated entirely rather than partially updated, screen tearing may not occur. Accordingly, the third processor 322 (e.g., display driver 383) may request a third frame from the second processor 321 to update the first frame as a whole when screen corruption is expected. The third processor 322 (eg, display driver 383) may transmit the third frame to the display controller 350, and the display controller 350 may transmit the third frame to the display 360. According to one embodiment, the third frame may include a frame rendered by the second processor 321 (eg, the second processor 321 in FIG. 3A). According to one embodiment, the display controller 350 may transmit the third frame to the display 360 while the first frame is being scanned (or displayed) on the display 360. According to one embodiment, the operation of the display controller 350 transmitting the third frame to the display 360 at the time of output of the tearing signal will be described in detail with reference to FIG. 8A.

According to one embodiment, the third processor 322 (e.g., display driver 383) determines that if the second frame is not identified as a frame for updating the layer corresponding to the region of interest in the first frame (operation 425 - No ), in operation 431, it can be confirmed that the screen is not broken when the second frame is transmitted to the display 360 through the display controller 350.

According to one embodiment, in operation 433, the display controller 350 may transmit the second frame to the display 360 at the time of output of the tearing signal. According to one embodiment, the display controller 350 may transmit the second frame to the display 360 while the first frame is scanned (or displayed) on the display 360. According to one embodiment, the second frame may be written to the memory 233 at the time the tearing signal is output.

As a result, screen tearing is prevented when only part of the screen is updated.

According to a comparative example, when the delay of the first frame is confirmed, the display driver displays the first frame at the time of output of the second tearing signal (not shown) (e.g., a tearing signal after the first tearing signal). It may not be transmitted to the controller. For example, the display driver receives the first frame from the output time of the first tearing signal (not shown) to the output time of the second tearing signal (not shown) (e.g., a tearing signal after the first tearing signal). If not, it can be confirmed that there is a delay in the first frame. According to a comparative example, when frame delay occurs, the display driver sends the first frame to the display controller at the time of output of the third tearing signal (not shown) (e.g., a tearing signal output after the second tearing signal). can be transmitted to.

To solve this problem, according to the comparative example, the display driver may adjust the output timing of the tearing signal so that the tearing signal is output at a time adjusted by a specified time (T1) based on the output timing of the vertical synchronization signal. Through this, according to the comparative example, the electronic device can relatively reduce the occurrence of frame delay. Referring to FIG. 5 , the output time 561 of the tearing signal before display adjustment and the output time 511, 512, and 513 of the tearing signal adjusted for a designated time (T1) are shown.

Referring to FIG. 5, the display driver may wait to receive the first frame from the first time point 511 of the tearing signal 560 output from the display until the second time point 512. According to one embodiment, the display driver may receive the first frame rendered by the GPU based on the synchronization signal 540 between the first viewpoint 511 and the second viewpoint 512. For example, the first time point 511, the second time point 512, and the third time point 513 may mean the time point at which the tearing signal is output from the display and rises. The display driver may transmit the first frame to the display controller between the first viewpoint 511 and the second viewpoint 512.

According to a comparative example, the display controller may transmit the first frame to the display at a second time point 512. When the first frame is written to memory, the display can scan (or display) the first frame by reading it from the memory.

According to a comparative example, the display driver may wait to receive the second frame from the second time point 512 until the third time point 513. According to a comparative example, the display driver may receive the second frame rendered by the GPU based on the synchronization signal 540. For example, the second frame may be a frame for updating some layers of the first frame.

According to a comparative example, in a time section 510 in which the time section in which the second frame is written and the time section in which the first frame is scanned (or displayed) at least partially coincide, a screen tearing phenomenon occurs in the electronic device. It can be.

According to one embodiment, at operation 605, a third processor 322 (e.g., third processor 322 in Figure 3A) (e.g., display driver 383) (e.g., display driver 383 in Figure 3B) When it is confirmed that the second frame is for updating a layer corresponding to a portion of the interest area of the first frame (e.g., the bottom area of the first frame), the display controller 350 displays the second frame based on the tearing signal. ) (e.g., the display controller 350 of FIG. 3A), it can be confirmed that screen cracking occurs (or is expected) when transmitting to the display 360 (e.g., the display 360 of FIG. 3A). According to one embodiment, the second frame may refer to a frame rendered by the second processor 321 (eg, the second processor 321 in FIG. 3A) after the first frame. According to one embodiment, the second frame may include only some layers rather than all layers. According to one embodiment, screen tearing occurs between a time period in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and a time period in which the second frame is transmitted to the display 360 (or memory (or memory) 233) (e.g., the time interval for writing the second frame to the memory 233 in FIG. 2) may mean that at least part of the time interval matches.

According to one embodiment, in operation 607, the display controller 350 may transmit the second frame to the display 360 after a specified time (eg, 2 ms) from the point of output of the tearing signal. For example, the operation of the display controller 350 transmitting the second frame to the display 360 may include the operation of the display 360 writing the second frame to the memory 233. According to one embodiment, the designated time may mean the time between the output of the tearing signal and the start of scanning (or display) of the first frame on the display 360. According to one embodiment, the designated time is a time period in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and a second frame for updating the layer corresponding to the region of interest is displayed. The time intervals transmitted to (360) may be set to not match. However, this is an example, and embodiments of the present invention may set the designated time based on various methods.

According to one embodiment, the electronic device 301 (e.g., the electronic device 301 in FIG. 3A) determines the time period in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and the region of interest. When only part of the screen is updated because the time section in which the second frame for updating the layer corresponding to the area is transmitted to the display 360 (or the time section in which the second frame is written) does not match, the phenomenon of screen tearing occurs. may not occur.

According to one embodiment, the display driver 383 (e.g., the display driver 383 in FIG. 3B) controls the tearing signal 660 output from the display 360 (e.g., the display 360 in FIG. 3A). After the first time point (611), reception of the first frame may be waited until the second time point (612). According to one embodiment, the display driver 383 converts the first frame rendered by the second processor 321 (e.g., the second processor 321 in FIG. 3A) to the second frame based on the synchronization signal 640. It can be received at time 612. For example, the synchronization signal 640 (eg, Vsync signal) may be a clock signal including a rising point (eg, rising edge point) and a falling point (eg, falling edge point). The tearing signal 660 may coincide with the period of the synchronization signal 640 (eg, Vsync signal). According to one embodiment, the tearing signal may be a clock signal that rises at the rising point of the synchronization signal (eg, rising edge time) and falls at the falling point of the synchronization signal (eg, falling edge time). According to one embodiment, the time when the tearing signal rises may be the time when the tearing signal is output. For example, the first time point 611, the second time point 612, and the third time point 613 mean the time point when the tearing signal 660 is output from the display 360 and rises (e.g., the rising edge time point). You can. The display driver 383 may transmit the first frame to the display controller 350 between the first viewpoint 611 and the second viewpoint 612.

According to one embodiment, the display controller 350 (e.g., the display controller 350 in FIG. 3A) may transmit the first frame to the display 360 at a second time point 612. For example, the display 360 may write the first frame to the memory 233 (eg, the memory 233 in FIG. 2) at the second viewpoint 612.

According to one embodiment, the display 360 may scan (or display) the first frame by reading it from the memory 233 at the falling point (e.g., falling edge point) of the tearing signal 660. there is.

According to one embodiment, the display driver 383 may wait to receive the second frame from the second time point 612 until the third time point 613. According to one embodiment, the display driver 383 may receive the second frame rendered by the second processor 321 based on the synchronization signal 640. For example, the second frame may be a frame for updating some layers of the first frame.

According to one embodiment, the display driver 383 may check whether the second frame is for updating a layer corresponding to the region of interest (eg, bottom region) of the first frame. According to one embodiment, if it is confirmed that the second frame is to update the layer corresponding to the region of interest (e.g., bottom region) of the first frame, the display controller 350 selects a specified time from the third viewpoint 613 ( After T2) has elapsed, the second frame may be transmitted to the display 360. For example, the designated time T2 is a time interval in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and a second frame for updating the layer corresponding to the region of interest is displayed (360). ) can be set so that the time intervals transmitted do not match. For example, the designated time (T2) may be set to 2ms.

According to one embodiment, the display controller 350 may transmit the second frame to the display 360. For example, the display controller 350 may write the second frame to the memory 233 on the display 360 as at least part of a transmission operation of the second frame. According to one embodiment, the display 360 may scan (or display) the second frame by reading it from the memory 233 at the falling point (e.g., falling edge point) of the tearing signal 660. there is.

According to the above-described method, the display controller 350 can adjust the transmission timing of the second frame when screen tearing of the display 360 is expected. Through this, the display controller 350 can prevent the screen of the display 360 from being broken.

According to one embodiment, at operation 705, the third processor 322 (e.g., display driver 383) (e.g., third processor 322 of Figure 3A) determines that the second frame is of interest to a portion of the first frame. If it is confirmed that the layer corresponding to the area (e.g., the bottom area of the first frame) is to be updated, the second frame is sent to the display controller 350 (e.g., the display controller 350 in FIG. 3A) based on the tearing signal. It can be confirmed that screen cracking occurs (or is expected) when transmitting to the display 360 through .

According to one embodiment, in operation 707, the third processor 322 (e.g., display driver 383) sends a second frame to the display controller 350 after a specified time (e.g., 2 ms) from the point of output of the tearing signal. can be transmitted. According to one embodiment, the designated time is the time when the first frame begins to be scanned (or displayed) on the display 360 (e.g., the display 360 of FIG. 3A) from the time of output of the tearing signal. It can mean the time between. According to one embodiment, the designated time is a time period in which a portion of the region of interest of the first frame is scanned on the display 360 and a second frame for updating the layer corresponding to the region of interest is transmitted to the display 360. The time intervals may be set to not match.

According to one embodiment, in operation 709, the display controller 350 may transmit the second frame to the display 360.

According to one embodiment, the display driver 383 (e.g., the display driver 383 in FIG. 3B) controls the tearing signal 760 output from the display 360 (e.g., the display 360 in FIG. 3A). It may wait to receive the first frame from the first time point 711 to the second time point 712. According to one embodiment, the display driver 383 converts the first frame rendered by the second processor 321 (e.g., the second processor 321 in FIG. 3A) to the second frame based on the synchronization signal 740. It can be received at time 712. For example, the synchronization signal 740 may be a vertical synchronization signal. For example, the first time point 711, the second time point 712, and the third time point 713 may mean the time point at which the tearing signal 760 is output from the display 360 and rises. The display driver 383 may transmit the first frame to the display controller 350 between the first viewpoint 711 and the second viewpoint 712.

According to one embodiment, the display controller 350 (e.g., the display controller 350 in FIG. 3A) may transmit the first frame to the display 360 at the second time point 712. The display 360 may write the first frame to the memory 233 (eg, the memory 233 in FIG. 2) at the second viewpoint 712.

According to one embodiment, the display 360 may read the first frame from the memory 233 and scan (or display) the first frame at the falling point of the tearing signal 760.

According to one embodiment, the display driver 383 may wait to receive the second frame from the second time point 712 until the third time point 713. According to one embodiment, the display driver 383 may receive the second frame rendered by the second processor 321 based on the synchronization signal 740. For example, the second frame may be a frame for updating some layers of the first frame.

According to one embodiment, when the display driver 383 determines that the second frame is for updating the layer corresponding to the region of interest (e.g., the bottom region) of the first frame, the display driver 383 selects a specified time from the third viewpoint 713. After (T2) has elapsed, the second frame may be transmitted to the display controller 350. For example, the designated time T2 is a time interval in which a portion of the region of interest of the first frame is scanned (or displayed) on the display 360 and a second frame for updating the layer corresponding to the region of interest is displayed (360). ) can be set so that the time intervals transmitted do not match. For example, the designated time (T2) may be set to 2ms.

According to one embodiment, the display controller 350 may transmit the second frame to the display 360. For example, as at least part of the transmission operation of the second frame, the display 360 may write the second frame to the memory 233.

According to one embodiment, the display 360 may read the second frame from the memory 233 at the falling point of the tearing signal 760 and scan (or display) the second frame.

According to the above-described method, the display driver 383 can adjust the timing of transmitting the second frame to the display controller 350 when the screen of the display 360 is expected to be broken. Through this, the electronic device 301 (eg, the electronic device 301 in FIG. 3A) can prevent the screen of the display 360 from being broken.

FIG. 8A is a flowchart showing a method of operating a display controller to prevent screen tearing according to an embodiment.

According to one embodiment, at operation 805, third processor 322 (e.g., third processor 322 of FIG. 3A (e.g., display driver 383)) determines that the second frame is a portion of the region of interest of the first frame. If it is confirmed that the layer corresponding to It can be confirmed as occurring (or expected).

According to one embodiment, in operation 807, the third processor 322 (e.g., display driver 383) sends a third frame to update the entire first frame to the second processor 321 (e.g., FIG. 3A). According to one embodiment, if the first frame is updated entirely rather than partially updated, the screen tearing phenomenon may not occur. ) (e.g., the display driver 383) may request the second processor 321 for a third frame to entirely update the first frame when screen disruption is expected. The processor 321 may transmit the rendered third frame to the third processor 322 (eg, display driver 383).

According to one embodiment, in operation 809, the third processor 322 (eg, display driver 383) may receive the third frame from the second processor 321. According to one embodiment, the third processor 322 may transmit the third frame to the display controller 350.

According to one embodiment, in operation 811, the display controller 350 may transmit the third frame to the display 360 at the time of output of the tearing signal. According to one embodiment, the display 360 may write the third frame to the memory 233 (eg, the memory 233 in FIG. 2) at the time of output of the tearing signal. According to one embodiment, the display 360 may scan (or display) the third frame. According to one embodiment, the display controller 350 may transmit the third frame to the display 360 while the first frame is scanned (or displayed) on the display 360.

According to one embodiment, the electronic device 301 (e.g., the electronic device 301 in FIG. 3A) displays the upper part of the third frame while the lower area of the first frame is being scanned (or displayed) on the display 360. The area (or middle area) is written to the memory 233 to prevent screen tearing of the image displayed by the display 360.

According to one embodiment, the display driver 383 (e.g., the display driver 383 in FIG. 3B) controls the tearing signal 860 output from the display 360 (e.g., the display 360 in FIG. 3A). It may wait to receive the first frame from the first time point 821 to the second time point 822. According to one embodiment, the display driver 383 converts the first frame rendered by the second processor 321 (e.g., the second processor 321 in FIG. 3A) to the second frame based on the synchronization signal 840. It can be received at time 822. For example, the synchronization signal 840 may be a vertical synchronization signal. For example, the first time point 821, the second time point 822, and the third time point 823 may mean the time point at which the tearing signal 860 is output from the display 360 and rises. The display driver 383 may transmit the first frame to the display controller 350 between the first viewpoint 821 and the second viewpoint 822.

According to one embodiment, the display controller 350 (e.g., the display controller 350 of FIG. 3A) may transmit the first frame to the display 360 at a second time point 822.

According to one embodiment, the display 360 may read the first frame from the memory 233 and scan (or display) the first frame at the falling point of the tearing signal 860.

According to one embodiment, the display driver 383 waits to receive the next frame (e.g., the second frame or the third frame) to update the first frame until the third time point 823 after the second time point 822. You can.

According to one embodiment, the display driver 383 may receive the second frame rendered by the second processor 321 based on the synchronization signal 840. For example, the second frame may be a frame for updating some layers of the first frame.

According to one embodiment, when the display driver 383 determines that the second frame is a frame for updating a partial layer of the first frame, the display driver 383 sends a third frame for updating the entire first frame to the second processor 321. You can request it.

According to one embodiment, the display controller 350 may transmit a third frame to the display 360 at a third time point 823. For example, the display 360 may write the third frame to the memory 233 at the third time point 823. According to one embodiment, the display 360 may read the third frame from the memory 233 at the falling point of the tearing signal 860 and scan (or display) the third frame.

According to one embodiment, the display controller 350 displays the upper area (or middle area) of the third frame on the display 360 while the lower area of the first frame is scanned (or displayed) on the display 360. By transmitting, the upper area (or middle area) of the third frame can be written to the memory 233 by the display 360.

According to the above-described method, when the screen of the display 360 is expected to be broken, the display driver 383 sends a third frame capable of updating the entire first frame to the display 360 through the display controller 350. ) can be transmitted to. Through this, the display driver 383 can prevent the screen of the display 360 from being broken.

An electronic device according to one embodiment may include a memory, a processor, a display controller, and a display.

The memory according to an embodiment, when executed by the processor, causes the electronic device to determine that some of the layers among the plurality of layers correspond to a region of interest (ROI) of the first frame. Based on confirmation that the second frame is transmitted to the display through the display controller, at least one instruction that causes it to be confirmed that screen tearing occurs may be stored.

The electronic device according to one embodiment, based on determining that the screen is broken, the second frame is stored in the memory included in the display while the first frame is being scanned on the display. It may not be written.

The memory according to one embodiment, when executed by the processor, causes the electronic device to display the first frame after the first frame is scanned on the display based on an operation that confirms that the screen is broken. At least one instruction that causes two frames to be transmitted to the display controller may be stored.

The memory according to one embodiment, when executed by the display controller, causes the electronic device to detect the screen after the first frame is scanned on the display based on an operation that confirms that the screen is broken. At least one instruction that causes a second frame to be transmitted to the display may be stored.

The memory according to one embodiment, when executed by the display controller, causes the electronic device to detect a second tearing signal after the first tearing signal based on an operation that determines that the screen is broken. At least one instruction causing the second frame to be transmitted to the display after a first specified time from the second output point of the signal may be stored.

The memory according to one embodiment, when executed by the display controller, causes the electronic device to display the second frame after a second designated time from the point of output of the second touring signal after the first touring signal. At least one instruction that causes to be written to the memory of the display may be stored.

In the electronic device according to one embodiment, the region of interest (ROI) may include a lower area of the first frame displayed on the display.

The memory according to one embodiment, when executed by the processor, causes the electronic device to detect a second tearing signal after the first tearing signal based on an operation that determines that the screen is broken. At least one instruction causing the second frame to be transmitted to the display controller after a third designated time from the second output point of the signal may be stored.

The memory according to one embodiment, when executed by the processor, causes the electronic device to update the plurality of layers related to the first frame based on an operation that confirms that the screen is broken. At least one instruction that causes the third frame to be obtained may be stored.

The memory according to one embodiment, when executed by the processor, causes the electronic device to display the third frame at the second output time of the second tearing signal output after the first tearing signal. At least one instruction that causes transmission to the display controller may be stored.

The memory according to one embodiment, when executed by the display controller, causes the electronic device to transmit the third frame to the display while the first frame is scanned to the display. Instructions can be saved.

A method of operating an electronic device according to an embodiment may include obtaining a second frame for updating some of a plurality of layers related to the first frame.

In a method of operating an electronic device according to an embodiment, based on confirming that the second frame corresponds to a region of interest (ROI) of the first frame, the display controller sends the second frame to the display controller. It may include an operation to confirm that screen cracking occurs when transmitting to the display through .

In a method of operating an electronic device according to an embodiment, based on the operation of confirming that the screen is broken, the second frame is transmitted to the controller of the display after the first frame is scanned on the display. Can include actions.

In a method of operating an electronic device according to an embodiment, based on the operation of confirming that the screen is broken, the display controller sends the second frame to the display after the first frame is scanned on the display. It may include the operation of transmitting to .

In a method of operating an electronic device according to an embodiment, the display controller is configured to operate from a second output point of the second tearing signal after the first tearing signal based on the operation of confirming that the screen is broken. It may include transmitting the second frame to the display after a first designated time.

In a method of operating an electronic device according to an embodiment, the display controller writes the second frame to the memory of the display after a second designated time from the time of output of the second touring signal after the first touring signal. It may include the action of (write).

In a method of operating an electronic device according to an embodiment, the region of interest (ROI) may include a lower area of the first frame displayed on the display.

In the method of operating an electronic device according to an embodiment, based on the operation of confirming that the screen is broken, a third designated time is elapsed from the second output time of the second tearing signal after the first tearing signal. It may later include transmitting the second frame to the display controller.

A method of operating an electronic device according to an embodiment may include an operation of obtaining a third frame for updating the entire first frame based on the operation of confirming that the screen is broken.

A method of operating an electronic device according to an embodiment may include transmitting the third frame to the display controller at a second output time of a second touring signal output after the first touring signal. there is.

In a method of operating an electronic device according to an embodiment, the display controller may include transmitting the third frame to the display while the first frame is being scanned to the display.

In a storage medium storing at least one computer-readable instruction according to an embodiment, the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to display a display included in the electronic device. An operation of transmitting a first frame to a display controller included in the electronic device may be caused to be performed based on the first tearing signal output at the first output time.

In a storage medium storing at least one computer-readable instruction according to an embodiment, the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to display the second frame as the first Based on confirmation that it is a layer corresponding to the region of interest (ROI) of 1 frame, to perform an operation to determine that screen tearing occurs when the second frame is transmitted to the display through the display controller. can cause

In a storage medium storing at least one computer-readable instruction according to an embodiment, based on confirmation that the screen is broken, the second frame is displayed while the first frame is being scanned on the display. It may not be written to the memory included in the display.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “ Each of phrases such as "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document are stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101, 201, 301). It may be implemented as software (e.g., program 140) including one or more instructions, for example, in a processor (e.g., processor 120, 320) of a device (e.g., electronic device 101, 201, 301). ) may call at least one command among one or more commands stored from a storage medium, and execute it, enabling the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term means that data is stored semi-permanently in the storage medium. There is no distinction between temporary storage and temporary storage.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims

In the electronic device (101 in FIG. 1; 301 in FIG. 3A),

Memory (130 in Figure 1; 330 in Figure 3A);

Processor (120 in Figure 1; 322 in Figure 3A);

display controller (350 in Figure 3A); and

A display (160 in FIG. 1; 260 in FIG. 2A; 360 in FIG. 3A);

The memory, when executed by the processor, causes the electronic device to:

Based on the first tearing signal output from the display at the first output time, transmitting the first frame to the display controller (401, 421),

Obtaining a second frame for updating some of the layers among the plurality of layers related to the first frame (403, 423),

Based on confirming that some of the layers among the plurality of layers are layers corresponding to a region of interest (ROI) of the first frame (405, 425), the display controller transmits the second frame to the second frame. Store at least one instruction that causes confirmation (407, 427) that screen cracking occurs when transmitted to the display,

Based on confirmation that the screen is broken, the second frame is not written (409) to the memory (233 in FIG. 2) included in the display while the first frame is being scanned on the display. , 429) Electronic devices.
According to paragraph 1,

The memory, when executed by the processor, causes the electronic device to:

An electronic device that stores at least one instruction that causes the second frame to be transmitted to the display controller after the first frame has been scanned on the display, based on the operation of determining that the screen tearing has occurred.
According to claim 1 or 2,

The memory, when executed by the display controller, causes the electronic device to:

An electronic device that stores at least one instruction that causes the second frame to be transmitted to the display after the first frame has been scanned to the display, based on the operation of determining that the screen tearing has occurred.
According to any one of claims 1 to 3,

The memory, when executed by the display controller, causes the electronic device to:

Based on the operation of confirming that the screen tearing occurs, causing the second frame to be transmitted to the display after a first specified time from the second output time of the second tearing signal after the first tearing signal. An electronic device that stores at least one instruction.
According to any one of claims 1 to 4,

The memory, when executed by the display controller, causes the electronic device to:

At least one device that causes the second frame to be written to the memory of the display (233 in FIG. 2) after a second designated time from the second output time of the second touring signal after the first touring signal. An electronic device that stores instructions.
According to any one of claims 1 to 5,

The region of interest (ROI) is an electronic device comprising a lower area of the first frame displayed on the display.
According to any one of claims 1 to 6,

The memory, when executed by the processor, causes the electronic device to:

Based on the operation of confirming that the screen is broken, the second frame is caused to be transmitted to the display controller after a third designated time from the second output time of the second touring signal after the first touring signal. An electronic device that stores at least one instruction to:
According to any one of claims 1 to 7,

When executed by the processor, the at least one instruction causes the electronic device to:

A configured electronic device that stores at least one instruction causing to obtain a third frame for updating the plurality of layers related to the first frame, based on the operation of confirming that the screen tearing occurs.
According to any one of claims 1 to 8,

When executed by the processor, the at least one instruction causes the electronic device to:

An electronic device that stores at least one instruction that causes the third frame to be transmitted to the display controller at a second output time of the second tearing signal output after the first tearing signal.
According to any one of claims 1 to 9,

The memory, when executed by the display controller, causes the electronic device to:

An electronic device that stores at least one instruction that causes the third frame to be transmitted to the display while the first frame is being scanned to the display.
In a method of operating an electronic device (101 in FIG. 1; 301 in FIG. 3A),

Based on the first tearing signal output at the first output time from the display (160 in FIG. 1; 260 in FIG. 2A; 360 in FIG. 3A) included in the electronic device, the first frame is displayed in the electronic device. An operation to transmit to a display controller (401, 421);

Operations 403 and 423 of obtaining a second frame to update some of the layers among the plurality of layers related to the first frame; and

Based on determining (405, 425) that the second frame is a layer corresponding to a region of interest (ROI) of the first frame, the second frame is transmitted to the display through the display controller. Including operations 407 and 427 to determine that a screen is broken in this case,

Based on confirmation that the screen is broken, the second frame is not written (409) to the memory (233 in FIG. 2) included in the display while the first frame is being scanned on the display. , 429) Methods of operation of electronic devices.
According to clause 11,

A method of operating an electronic device further comprising transmitting the second frame to a controller of the display after the first frame is scanned on the display, based on the operation of confirming that the screen is broken.
According to any one of claims 11 to 12,

A method of operating an electronic device further comprising transmitting the second frame to the display after the first frame is scanned to the display by the display controller based on the operation of confirming that the screen is broken. .
According to any one of claims 11 to 13,

Based on the operation of confirming that the screen is broken, the display controller displays the second frame after a first designated time from the second output time of the second touring signal after the first touring signal. A method of operating an electronic device further comprising transmitting to.
A storage medium storing at least one computer-readable instruction, wherein the at least one instruction, when executed by a processor of an electronic device, causes the electronic device to:

Based on the first tearing signal output at the first output time from the display (160 in FIG. 1; 260 in FIG. 2A; 360 in FIG. 3A) included in the electronic device (101 in FIG. 1; 301 in FIG. 3A) , an operation (401, 421) of transmitting the first frame to a display controller included in the electronic device;

An operation (403, 423) of obtaining a second frame for updating some of a plurality of layers related to the first frame; and

Based on confirming that the second frame is a layer corresponding to a region of interest (ROI) of the first frame (405, 425), transmit the second frame to the display through the display controller. In this case, it causes the operation (407, 427) to be performed to confirm that the screen is broken,

Based on confirmation that the screen is broken, the second frame is not written (409) to the memory (233 in FIG. 2) included in the display while the first frame is being scanned on the display. , 429) storage media.