WO2018120546A1 - Image display method and terminal device - Google Patents

Image display method and terminal device Download PDF

Info

Publication number
WO2018120546A1
WO2018120546A1 PCT/CN2017/082240 CN2017082240W WO2018120546A1 WO 2018120546 A1 WO2018120546 A1 WO 2018120546A1 CN 2017082240 W CN2017082240 W CN 2017082240W WO 2018120546 A1 WO2018120546 A1 WO 2018120546A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
frame image
display
buffer register
terminal device
Prior art date
Application number
PCT/CN2017/082240
Other languages
French (fr)
Chinese (zh)
Inventor
陈磊
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780004907.7A priority Critical patent/CN108476306B/en
Priority to CN202110320798.8A priority patent/CN113225427B/en
Publication of WO2018120546A1 publication Critical patent/WO2018120546A1/en

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3433Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using light modulating elements actuated by an electric field and being other than liquid crystal devices and electrochromic devices
    • G09G3/344Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using light modulating elements actuated by an electric field and being other than liquid crystal devices and electrochromic devices based on particles moving in a fluid or in a gas, e.g. electrophoretic devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present application relates to the field of terminal technologies, and in particular, to a method for displaying an image and a terminal device.
  • smartphones have evolved from a front-facing single screen that supports display and touch control to both front and back dual screens, and the back screen of the smartphone can also be displayed and touch controlled.
  • the front of the smartphone uses an LCD screen.
  • the back of the smartphone uses an E Ink screen with low power consumption and high visibility compared to the LCD screen.
  • This E Ink screen uses the latest Carta panel. Technology, easy to read under the sun, and no flicker, no radiation, large viewing angle, greatly reducing the fatigue of the eyes, more and more people are favored.
  • the latest E Ink screen fully supports touch operation, supports multi-finger touch, and supports various gestures. The increase in touch characteristics makes the E Ink screen have a wider application.
  • the latest E Ink screen can fully display the interface of the entire Android system, but since the refresh rate of the electronic ink screen is 2 to 8 Hz, and the refresh rate of the front LCD screen is 60 Hz or higher, the animation normally displayed on the front LCD screen The effect is that the animation frame with several frames split on the back E Ink screen has a great delay and the user experience is poor.
  • the third-party application used on the front LCD screen must use a specific The software development kit (SDK) provided by the manufacturer can be used normally on the back E Ink screen, which is really beneficial for uniformity and usability, but it also makes this E Ink The scope of application of the screen is greatly reduced.
  • SDK software development kit
  • the embodiment of the present invention provides a method for displaying an image and a terminal device for solving the problem that the electronic ink screen existing in the prior art has a poor display effect when displaying an image of a third-party application that does not use the SDK.
  • the present application provides a method for displaying an image, the method comprising: determining a sending time of a received second frame image, where the sending time is after the application layer draws the second frame image, Determining a time when the second frame image is sent to the next processing module, and then determining a difference between a transmission time of the second frame image and a transmission time of the previously received first frame image; if it is determined that the difference is greater than or Equal to the set threshold value, the second frame image is sent to the display buffer register, and the image stored in the display buffer register is acquired according to the actual vertical synchronization clock signal, and sent to the electronic ink screen for display in the storage order.
  • a method for displaying an image is provided.
  • the second The frame image is sent to the display buffer register for display on the electronic ink screen, and the difference can be made smaller than the set threshold by the above image display method.
  • the image of the multi-frame animation effect continuously sent is filtered out, and only the image whose difference is greater than or equal to the set threshold value is displayed, so as to ensure that the electronic ink screen is like a stable static picture, thereby improving the user's use.
  • the method further includes:
  • the second frame image is discarded.
  • the method further includes:
  • Receiving a touch instruction drawing a setting image triggered by the touch instruction; performing layer superposition processing on the set image triggered by the touch instruction and the second frame image in the display buffer register.
  • the electronic ink screen when the electronic ink screen receives the touch instruction, the user needs to display the positive feedback information, but the time of the real-time feedback may be lower than the time displayed by the ink screen in one frame, so the setting triggered by the drawing of the touch instruction is adopted. And setting an image, superimposing the set image triggered by the touch instruction with the second frame image in the display buffer register, so that the user obtains positive feedback information, determining that the touch command issued by the user has taken effect, and improving the user The experience of using.
  • the step of superimposing the set image triggered by the touch instruction with the second frame image in the display buffer register includes:
  • the set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  • the method further includes:
  • refreshing the designated area on the electronic ink screen instead of full-screen refreshing can speed up display efficiency and improve display speed.
  • the present application provides an image display terminal device, where the terminal device includes: a first determining module, configured to determine a sending time of the received second frame image, where the sending time is completed by the application layer After the second frame image is sent, the second frame image is sent to the time of the next processing module; the second determining module is configured to determine the sending time of the second frame image and the previously received first frame image. And a processing module, configured to send the second frame image to the display buffer register if it is determined that the difference is greater than or equal to the set threshold.
  • the terminal device further includes:
  • a display module configured to acquire an image stored in the display buffer register according to an actual vertical synchronous clock signal, and send the image to the electronic ink screen for display in a storage order.
  • the terminal device further includes:
  • a receiving module configured to receive a touch instruction
  • a generating module configured to draw a setting image triggered by the touch instruction
  • the processing module is further configured to perform a layer superposition process on the set image triggered by the touch instruction and the second frame image in the display buffer register.
  • the processing module is specifically configured to:
  • the set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  • the display module is further configured to:
  • the embodiment of the present application further provides an image display terminal device, where the terminal includes a processor and a memory, the memory is used to store a software program, and the processor is configured to read software stored in the memory.
  • the program and the method of any one of the possible aspects of the first aspect or the first aspect described above are implemented.
  • the electronic device can be a mobile terminal, a computer, or the like.
  • the processor is further configured to:
  • the images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
  • the processor is further configured to:
  • the processing module is further configured to: perform setting image triggered by the touch instruction with the second frame image in the display buffer register Layer overlay processing.
  • the processor is specifically configured to:
  • the set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  • the processor is further configured to:
  • the embodiment of the present application further provides a computer storage medium, where the software program stores a software program, where the software program can implement the first aspect or the first one when being read and executed by one or more processors Any of the possible ways of designing aspects provided.
  • FIG. 1 is a flowchart of a method for displaying an image on an LCD screen according to an embodiment of the present application
  • FIG. 2 is a flowchart of combining different screen layer superposition processing according to an embodiment of the present application
  • FIG. 3 is a flowchart of a method for displaying an image on an electronic ink screen according to an embodiment of the present application
  • FIG. 4 is a flowchart of a method for displaying an image according to an embodiment of the present application.
  • FIG. 5 is a flowchart of another method for displaying an image according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of an instruction area according to an embodiment of the present application.
  • FIG. 7 is a flowchart of still another method for displaying an image according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of an apparatus for a terminal device according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of hardware of a terminal device according to an embodiment of the present disclosure.
  • the embodiment of the present invention provides a method for displaying an image and a terminal device for solving the problem that the electronic ink screen existing in the prior art has a poor display effect when displaying an image of a third-party application that does not use the SDK.
  • the method and the terminal device are based on the same inventive concept, and the method is similar to the method for solving the problem by the terminal device, so the terminal.
  • the implementation of the devices and methods can be referred to each other, and the repeated description will not be repeated.
  • a plurality of words refer to two or more words such as “first” and “second”, which are only used to distinguish the purpose of description, and are not to be understood as indicating or suggesting that they are relatively important. Sex, can not be understood as an indication or suggestion order.
  • the "terminal device” involved in the present invention is a device that has a built-in display system and can realize a human-computer interaction function, and the terminal device can be a computer, a mobile phone, a tablet computer, a point of sales (POS), or a vehicle-mounted computer.
  • POS point of sales
  • a mobile phone is taken as an example.
  • a layer composed of many pixels, is the basic unit that makes up an image.
  • a frame of image can be a layer, and it is also composed of multiple layers stacked up and down.
  • a layer is like a film containing elements such as text or graphics. The sheets are stacked one on another and combined to form the final result of the image.
  • the front-side liquid crystal display (LCD) screen or the organic light-emitting diode (OLED) OLED screen of the existing double-sided smart phone the front liquid crystal screen or the OLED screen has a refresh rate of 60 Hz or even higher. , higher than the 2Hz ⁇ 8Hz refresh rate of the back ELINK screen, the third-party application based on the front LCD refresh rate design animation effect, if displayed on the back ELINK screen, will lead to great delay, third-party application animation The effect of the display on the back ELINK screen is poor, and the embodiment of the present invention solves the above problems.
  • the flow of displaying the image according to the vsync clock signal on the front liquid crystal screen is first introduced. As shown in FIG.
  • the S101 application layer is firstly drawn, and then the S102 combination (Compose) different screen layer superposition is performed. Processing, and finally executing S103 on the front LCD screen display, wherein the process of composing different screen layer superposition processing is as shown in FIG. 2, and the processing of each frame image strictly depends on the vsync pulse clock signal as a synchronization signal source, keeping The different modules perform synchronization processing on the image.
  • the vsync pulse clock is X
  • the application layer is used to draw the first frame image.
  • the step S202Compse layer is superimposed on the first frame.
  • Step S203 is performed to apply the second frame image; when the vsync pulse clock is X+2, step S204 is performed to display the first frame on the LCD screen, and step S205Compse layer is performed to superimpose the second frame, and step S206 is performed.
  • the layer draws the third frame image; when the vsync pulse clock is X+3, step S207 is executed to display the second frame on the LCD screen, and the step is executed at the same time.
  • the frequency of the LCD screen is 60 Hz
  • the frequency of the electronic ink screen is 4 Hz. If the 4 Hz vsync clock signal of the electronic ink screen is used as the synchronous signal source for display, the third-party application will follow the 4 Hz vsync clock signal.
  • the frequency to draw the image To draw an animation of 1S according to the frequency of the 60Hz vsync clock signal, it is necessary to draw 60 frames of images, and to draw the 60 frames of images according to the frequency of the 4Hz vsync clock signal, 15S is required, and the animation displayed on the LCD screen is displayed in 1S.
  • an embodiment of the present invention provides a method for displaying an image.
  • a third-party application displays an image on an electronic ink screen, but sets a virtual vsync when the application layer draws an image in step S301.
  • step S304 selects the frame to be displayed according to the actual vsync clock signal of the electronic ink screen in the plurality of drawn images, and the electronic ink is performed in step S305. Displayed on the screen.
  • This method can improve the user's experience when using the electronic ink screen, but there is a disadvantage in this method, that is, the selected final frame may not be displayed in time, and the effect of the displayed animation is relatively poor.
  • an animation with a duration of 800ms selects a frame according to the set duration.
  • the set duration is 250ms.
  • the electronic ink screen will display the image of the 250ms, 500ms, and 750ms, and then display the final static at 1000ms.
  • the picture, while the duration of the animation is 800ms, so the final static picture display delay is large.
  • the application When using the e-book application, the application displays an animated page flip effect on the LCD screen to the final display page when processing the page flip, but on the e-ink screen, an animation frame with several frames is split, and then the last frame There is also a delay in the static picture display, and the user's experience is poor. The lower the refresh rate of the electronic ink screen, the worse the user experience is. In the above case, the most ideal display effect should be that the intermediate process animation is not displayed, and the last frame of the static picture is displayed directly at the first time.
  • a method for displaying an image includes:
  • S402. Determine a difference between a sending time of the second frame image and a sending time of the previously received first frame image.
  • the method further includes:
  • the second frame image is discarded.
  • the method further includes:
  • the images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
  • a method for displaying an image is provided.
  • the difference between the sending time of the second frame image and the sending time of the first frame image is greater than or equal to the set threshold
  • the second The frame image is sent to the display buffer register for display on the electronic ink screen.
  • step S501 when a layer is drawn by an application layer, a virtual vsync clock signal is set, wherein the virtual vsync clock signal may be generated by the S502 virtual vsync clock signal.
  • step S503 combines different screen layer superposition processing according to the virtual vsync clock signal
  • step S504 acquires the transmission time of the received second frame image
  • step S505 compares the transmission time of the second frame image with Whether the difference of the first frame image transmission time received before is greater than or equal to the set threshold value, for example, 40 ms or more than 2 frames, then step S506 is performed to send the last frame image to the display buffer register, otherwise Step S507 is performed to discard the second frame image, and the image in the display buffer register is acquired according to the actual vsync clock signal, and step 508 is displayed on the electronic ink screen.
  • the set threshold value for example, 40 ms or more than 2 frames
  • the method further includes:
  • the superimposing process of the triggered setting image and the second frame image in the display buffer register specifically includes: overwriting the setting of the touch instruction trigger on the second frame image in the display buffer register image.
  • the method further includes:
  • the image obtained by the superimposition processing is sent to the electronic ink screen by a module of Compose superposition processing of an application layer.
  • different touch commands trigger different setting images, as shown in FIG. 6 , which are setting images corresponding to the click touch command and the sliding touch command, respectively, wherein the set image can be displayed on the electronic ink screen.
  • One frame is then disappeared, which is not limited by the present invention.
  • the setting image triggered by the touch command is superimposed with the second frame image in the display buffer register, the first line determines the original color of the user's click position, although the electronic ink screen has only two colors of black and white. However, the color gradation is read, and the original color information of the designated area centered on the click position is read.
  • the designated area after the click is displayed as a dark color;
  • the original color is dark tone, then the specified area after clicking is displayed as a light color;
  • the specified area is refreshed on the electronic ink screen, and the full screen of the electronic ink screen is not refreshed, the display rate can be accelerated, and the real-time display can be improved.
  • User experience If it is judged that the original color displayed in the designated area is a light color, the designated area after the click is displayed as a dark color; The original color is dark tone, then the specified area after clicking is displayed as a light color; the specified area is refreshed on the electronic ink screen, and the full screen of the electronic ink screen is not refreshed, the display rate can be accelerated, and the real-time display can be improved. User experience.
  • step S701 when the application layer draws an image in step S701, a virtual vsync clock signal is set, wherein the virtual vsync clock signal may be generated by the S702 virtual vsync clock signal generation module, and then step S703 is performed according to the virtual The vsync clock signal Compose different screen layer superimposition processing, step S704 acquires the transmission time of the currently received second frame image, and step S705 compares the transmission time of the second frame image with the previously received first frame image transmission time.
  • step S706 When the electronic ink screen receives the touch instruction, the electronic ink screen draws the setting image triggered by the touch instruction in step S709, and the step S710 performs the Compose picture layer superposition processing on the set image and the image acquired from the display buffer register.
  • Step S711 sending the superimposed processed image to the electronic ink screen for display, where the Reflect on ink screen refresh operation for the designated area.
  • the present application further provides a schematic diagram of a terminal device.
  • the terminal device includes:
  • the first determining module 801 is configured to determine a sending time of the received second frame image, where the sending time is after the application layer draws the second frame image, and sends the second frame image to the next processing module. Moment.
  • the second determining module 802 is configured to determine a difference between a sending time of the second frame image and a sending time of the previously received first frame image.
  • the processing module 803 is configured to send the second frame image to the display buffer register if it is determined that the difference is greater than or equal to the set threshold.
  • the terminal device further includes:
  • a display module configured to acquire an image stored in the display buffer register according to an actual vertical synchronous clock signal, and send the image to the electronic ink screen for display in a storage order.
  • a terminal device where the sending time of the second frame image and the sending of the first frame image
  • the second frame image is sent to the display buffer register for display on the electronic ink screen, and the difference can be set smaller than the above image display method.
  • the image of the multi-frame animation effect continuously sent by the fixed threshold value is filtered out, and only the image whose difference value is greater than or equal to the set threshold value is displayed, so that the electronic ink screen is like a stable static picture. Improve the user experience.
  • the terminal device further includes:
  • a receiving module configured to receive a touch instruction
  • a generating module configured to draw a setting image triggered by the touch instruction
  • the processing module is further configured to perform a layer superposition process on the set image triggered by the touch instruction and the second frame image in the display buffer register.
  • the processing module is specifically configured to:
  • the set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  • the display module is further configured to:
  • each functional module in each embodiment of the present application may be integrated into one processing. In the device, it can also be physically existed alone, or two or more modules can be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the terminal device can include the processor 901.
  • the hardware of the entity corresponding to the above module may be the processor 901.
  • the processor 901 can be a central processing unit (English: central processing unit, CPU for short), or a digital processing module or the like.
  • the terminal device further includes a memory 902 for storing a program executed by the processor 901.
  • the memory 902 can be a non-volatile memory, such as a hard disk drive (HDD) or a solid state drive (SSD), or a volatile memory (English: volatile) Memory), such as random access memory (English: random-access memory, abbreviation: RAM).
  • Memory 902 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.
  • the processor 901 is configured to execute the program code stored in the memory 902, specifically invoke the program instruction stored in the first memory, and determine a transmission time of the received second frame image, where the sending time is the application layer After the two frames of images, the time at which the second frame image is sent to the next processing module determines the difference between the transmission time of the second frame image and the transmission time of the previously received first frame image, if it is determined The difference is greater than or equal to the set threshold value, and the second frame image is sent to the display buffer register.
  • connection medium between the processor 901 and the memory 902 is not limited in the embodiment of the present application.
  • the embodiment of the present application is connected between the processor 901 and the memory 902 in FIG. 9 through a bus 903.
  • the bus is indicated by a thick line in FIG. 9.
  • the connection manner between other components is only for illustrative description, and is not cited. Limited.
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 9, but it does not mean that there is only one bus or one type of bus.
  • embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application may employ an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware aspects.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

An image display method and a terminal device, used for solving the problem in the prior art of poor display effects when displaying images of third party applications not using SDK on existing electronic ink screens. The method comprises: determining the sending time of a received second frame image, the sending time being the time that the second frame image is sent to the next processing module after the application layer finishes rendering the second frame image; determining the difference between the sending time of the second frame image and the sending time of a previously received first frame image; and, if determining that the difference is greater than or equal to a preset threshold, then sending the second frame image to a display buffer register.

Description

一种图像显示的方法及终端设备Image display method and terminal device
本申请要求在2016年12月30日提交中国专利局、申请号为201611265369.0、发明名称为“一种双面屏手机应用显示方法的方法和设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese Patent Application filed on Dec. 30, 2016, the Chinese Patent Application No. 201611265369.0, entitled "A Method and Apparatus for Displaying a Double-Sided Screen Mobile Phone Application", the entire contents of which are hereby incorporated by reference. The citations are incorporated herein by reference.
技术领域Technical field
本申请涉及终端技术领域,尤其涉及一种图像显示的方法及终端设备。The present application relates to the field of terminal technologies, and in particular, to a method for displaying an image and a terminal device.
背景技术Background technique
随着科技的进步,智能手机从支持显示和触摸控制为一体的正面单屏幕,发展为同时支持正面和背面双屏幕,智能手机的背面屏幕也可以进行显示并实现触摸控制。目前,智能手机的正面采用了液晶屏幕,智能手机的背面采用了与液晶屏幕相比耗电量低、视觉辨识性高的电子墨水(E Ink)屏幕,这块E Ink屏幕使用最新的Carta面板技术,在太阳光下可以轻松阅读,而且无闪烁、无辐射、可视角度大,大大减少了眼睛的疲劳度,越来越受到人们的青睐。最新的E Ink屏幕全面支持触控操作,且支持多指触控,也支持各种手势,触控特性的增加让E Ink屏幕有了更广阔的应用。最新的E Ink屏幕能够全面显示整个Android系统的界面,但是由于电子墨水屏的刷新率为2~8Hz,而正面液晶屏幕的刷新率为60HZ甚至更高,因此在正面液晶屏幕上正常显示的动画效果,在背面E Ink屏幕上会显示为几帧割裂的动画帧,并存在极大的延迟,用户体验差,为了能够充分利用E Ink屏幕,在正面液晶屏幕上使用的第三方应用必须使用特定厂商提供的软件开发工具包(Software Development Kit,SDK),所述第三方应用才可以在背面E Ink屏幕正常使用,这对统一性和可用性而言确实有益处,但这也让这块E Ink屏幕的应用范围大大缩减。With the advancement of technology, smartphones have evolved from a front-facing single screen that supports display and touch control to both front and back dual screens, and the back screen of the smartphone can also be displayed and touch controlled. At present, the front of the smartphone uses an LCD screen. The back of the smartphone uses an E Ink screen with low power consumption and high visibility compared to the LCD screen. This E Ink screen uses the latest Carta panel. Technology, easy to read under the sun, and no flicker, no radiation, large viewing angle, greatly reducing the fatigue of the eyes, more and more people are favored. The latest E Ink screen fully supports touch operation, supports multi-finger touch, and supports various gestures. The increase in touch characteristics makes the E Ink screen have a wider application. The latest E Ink screen can fully display the interface of the entire Android system, but since the refresh rate of the electronic ink screen is 2 to 8 Hz, and the refresh rate of the front LCD screen is 60 Hz or higher, the animation normally displayed on the front LCD screen The effect is that the animation frame with several frames split on the back E Ink screen has a great delay and the user experience is poor. In order to make full use of the E Ink screen, the third-party application used on the front LCD screen must use a specific The software development kit (SDK) provided by the manufacturer can be used normally on the back E Ink screen, which is really beneficial for uniformity and usability, but it also makes this E Ink The scope of application of the screen is greatly reduced.
综上所述,如何使背面E Ink屏幕支持没有使用SDK的第三方应用的图像的显示效果具备良好的应用性,提高用户体验,是目前需要解决的问题。In summary, how to make the back E Ink screen support the display effect of the image of the third-party application without the SDK has good applicability and improve the user experience, which is a problem that needs to be solved at present.
发明内容Summary of the invention
本申请实施例提供了一种图像显示的方法及终端设备,用以解决现有技术中存在的电子墨水屏在显示没有使用SDK的第三方应用的图像时,显示效果较差的问题。The embodiment of the present invention provides a method for displaying an image and a terminal device for solving the problem that the electronic ink screen existing in the prior art has a poor display effect when displaying an image of a third-party application that does not use the SDK.
第一方面,本申请提供了一种图像显示的方法,该方法包括:确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻,然后确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值;若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器,按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。In a first aspect, the present application provides a method for displaying an image, the method comprising: determining a sending time of a received second frame image, where the sending time is after the application layer draws the second frame image, Determining a time when the second frame image is sent to the next processing module, and then determining a difference between a transmission time of the second frame image and a transmission time of the previously received first frame image; if it is determined that the difference is greater than or Equal to the set threshold value, the second frame image is sent to the display buffer register, and the image stored in the display buffer register is acquired according to the actual vertical synchronization clock signal, and sent to the electronic ink screen for display in the storage order.
本申请实施例中,提供了一种图像显示的方法,当第二帧图像的发送时间与第一帧图像的发送时间的差值大于或等于设定的门限值时,将所述第二帧图像发送到显示缓冲寄存器,以便在电子墨水屏幕上显示,通过上述图像显示的方法,可以将差值小于设定的门限 值连续发送的多帧动画效果的图像过滤掉,只显示差值大于或等于设定的门限值的图像,保证所述电子墨水屏上像是的是一个稳定的静态画面,提高用户的使用体验。In the embodiment of the present application, a method for displaying an image is provided. When the difference between the sending time of the second frame image and the sending time of the first frame image is greater than or equal to the set threshold, the second The frame image is sent to the display buffer register for display on the electronic ink screen, and the difference can be made smaller than the set threshold by the above image display method. The image of the multi-frame animation effect continuously sent is filtered out, and only the image whose difference is greater than or equal to the set threshold value is displayed, so as to ensure that the electronic ink screen is like a stable static picture, thereby improving the user's use. Experience.
在一种可能的设计中,该方法还包括:In one possible design, the method further includes:
若判断出所述差值小于设定的门限值,将所述第二帧图像丢弃。If it is determined that the difference is less than a set threshold, the second frame image is discarded.
在一种可能的设计中,所述第二帧图像发送到显示缓冲寄存器之后,该方法还包括:In a possible design, after the second frame image is sent to the display buffer register, the method further includes:
接收到触摸指令;绘制所述触摸指令触发的设定图像;将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。Receiving a touch instruction; drawing a setting image triggered by the touch instruction; performing layer superposition processing on the set image triggered by the touch instruction and the second frame image in the display buffer register.
本申请实施例中,当电子墨水屏接收到触摸指令时,需要显示给用户正反馈信息,但实时反馈的时间可能低于墨水屏一帧显示的时间,所以采用绘制所述触摸指令触发的设定图像,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行叠加处理,使用户得到正反馈信息,确定用户自己发出的触摸指令已生效,提高用户的使用体验。In the embodiment of the present application, when the electronic ink screen receives the touch instruction, the user needs to display the positive feedback information, but the time of the real-time feedback may be lower than the time displayed by the ink screen in one frame, so the setting triggered by the drawing of the touch instruction is adopted. And setting an image, superimposing the set image triggered by the touch instruction with the second frame image in the display buffer register, so that the user obtains positive feedback information, determining that the touch command issued by the user has taken effect, and improving the user The experience of using.
在一种可能的设计中,所述将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理,具体包括:In a possible design, the step of superimposing the set image triggered by the touch instruction with the second frame image in the display buffer register includes:
在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
在一种可能的设计中,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行图层叠加处理之后,该方法还包括:In a possible design, after performing the layer superposition processing on the set image triggered by the touch instruction and the second frame image in the display buffer register, the method further includes:
将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
本申请实施例中,在所述电子墨水屏上刷新指定区域,而不是全屏刷新,可以加快显示效率,提高显示的速度。In the embodiment of the present application, refreshing the designated area on the electronic ink screen instead of full-screen refreshing can speed up display efficiency and improve display speed.
第二方面,本申请提供了一种图像显示的终端设备,该终端设备包括:第一确定模块,用于确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻;第二确定模块,用于确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值;处理模块,用于若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。In a second aspect, the present application provides an image display terminal device, where the terminal device includes: a first determining module, configured to determine a sending time of the received second frame image, where the sending time is completed by the application layer After the second frame image is sent, the second frame image is sent to the time of the next processing module; the second determining module is configured to determine the sending time of the second frame image and the previously received first frame image. And a processing module, configured to send the second frame image to the display buffer register if it is determined that the difference is greater than or equal to the set threshold.
在一种可能的设计中,所述终端设备还包括:In a possible design, the terminal device further includes:
显示模块,用于按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。And a display module, configured to acquire an image stored in the display buffer register according to an actual vertical synchronous clock signal, and send the image to the electronic ink screen for display in a storage order.
在一种可能的设计中,所述终端设备还包括:In a possible design, the terminal device further includes:
接收模块,用于接收到触摸指令;a receiving module, configured to receive a touch instruction;
生成模块,用于绘制所述触摸指令触发的设定图像;a generating module, configured to draw a setting image triggered by the touch instruction;
所述处理模块还用于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。The processing module is further configured to perform a layer superposition process on the set image triggered by the touch instruction and the second frame image in the display buffer register.
在一种可能的设计中,所述处理模块具体用于:In one possible design, the processing module is specifically configured to:
在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
在一种可能的设计中,所述显示模块还用于:In a possible design, the display module is further configured to:
将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显 示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic On the ink screen Show area.
第三方面,本申请实施例还提供了一种图像显示的终端设备,该终端包括处理器和存储器,所述存储器用于存储软件程序,所述处理器用于读取所述存储器中存储的软件程序并实现第一方面或上述第一方面的任意一种可能的设计提供的方法。该电子设备可以是移动终端、计算机等等。In a third aspect, the embodiment of the present application further provides an image display terminal device, where the terminal includes a processor and a memory, the memory is used to store a software program, and the processor is configured to read software stored in the memory. The program and the method of any one of the possible aspects of the first aspect or the first aspect described above are implemented. The electronic device can be a mobile terminal, a computer, or the like.
在一种可能的设计中,所述处理器还用于:In one possible design, the processor is further configured to:
按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。The images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
在一种可能的设计中,所述处理器还用于:In one possible design, the processor is further configured to:
接收到触摸指令,绘制所述触摸指令触发的设定图像,所述处理模块还用于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。Receiving a touch command, and drawing a setting image triggered by the touch instruction, the processing module is further configured to: perform setting image triggered by the touch instruction with the second frame image in the display buffer register Layer overlay processing.
在一种可能的设计中,所述处理器具体用于:In one possible design, the processor is specifically configured to:
在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
在一种可能的设计中,所述处理器还用于:In one possible design, the processor is further configured to:
将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
第四方面,本申请实施例中还提供一种计算机存储介质,该存储介质中存储软件程序,该软件程序在被一个或多个处理器读取并执行时可实现第一方面或上述第一方面的任意一种可能的设计提供的方法。In a fourth aspect, the embodiment of the present application further provides a computer storage medium, where the software program stores a software program, where the software program can implement the first aspect or the first one when being read and executed by one or more processors Any of the possible ways of designing aspects provided.
附图说明DRAWINGS
图1为本申请实施例提供的一种LCD屏显示图像的方法流程图;FIG. 1 is a flowchart of a method for displaying an image on an LCD screen according to an embodiment of the present application;
图2为本申请实施例提供的一种组合不同画面图层叠加处理的流程图;2 is a flowchart of combining different screen layer superposition processing according to an embodiment of the present application;
图3为本申请实施例提供的一种电子墨水屏显示图像的方法流程图;3 is a flowchart of a method for displaying an image on an electronic ink screen according to an embodiment of the present application;
图4为本申请实施例提供的一种图像显示的方法流程图;4 is a flowchart of a method for displaying an image according to an embodiment of the present application;
图5为本申请实施例提供的另一种图像显示的方法流程图;FIG. 5 is a flowchart of another method for displaying an image according to an embodiment of the present application;
图6为本申请实施例提供的一种指令区域的示意图;FIG. 6 is a schematic diagram of an instruction area according to an embodiment of the present application;
图7为本申请实施例提供的再一种图像显示的方法流程图;FIG. 7 is a flowchart of still another method for displaying an image according to an embodiment of the present application;
图8为本申请实施例提供的一种终端设备的装置示意图;FIG. 8 is a schematic diagram of an apparatus for a terminal device according to an embodiment of the present disclosure;
图9为本申请实施例提供的一种终端设备的硬件结构示意图。FIG. 9 is a schematic structural diagram of hardware of a terminal device according to an embodiment of the present disclosure.
具体实施方式detailed description
为了使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请作进一步地详细描述。In order to make the objects, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings.
本申请实施例提供一种图像显示的方法及终端设备,用以解决现有技术中存在的电子墨水屏在显示没有使用SDK的第三方应用的图像时,显示效果较差的问题。其中,方法和终端设备是基于同一发明构思的,由于方法及终端设备解决问题的原理相似,因此终端 设备与方法的实施可以相互参见,重复之处不再赘述。The embodiment of the present invention provides a method for displaying an image and a terminal device for solving the problem that the electronic ink screen existing in the prior art has a poor display effect when displaying an image of a third-party application that does not use the SDK. Wherein, the method and the terminal device are based on the same inventive concept, and the method is similar to the method for solving the problem by the terminal device, so the terminal The implementation of the devices and methods can be referred to each other, and the repeated description will not be repeated.
另外,在本申请的描述中,多个,是指两个或两个以上,“第一”、“第二”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。In addition, in the description of the present application, a plurality of words refer to two or more words such as “first” and “second”, which are only used to distinguish the purpose of description, and are not to be understood as indicating or suggesting that they are relatively important. Sex, can not be understood as an indication or suggestion order.
本发明涉及的“终端设备”,为含有内置的显示系统,可以实现人机交互功能的设备,该终端设备可以为计算机、手机、平板电脑、销售终端(Point of Sales,POS)或车载电脑等,在本申请中,仅以手机为例。The "terminal device" involved in the present invention is a device that has a built-in display system and can realize a human-computer interaction function, and the terminal device can be a computer, a mobile phone, a tablet computer, a point of sales (POS), or a vehicle-mounted computer. In this application, only a mobile phone is taken as an example.
图层,由许多像素组成,是构成图像的基本单元。一帧图像可以是一个图层,也为多个图层通过上下叠加的方式组成。图层就象是含有文字或图形等元素的胶片,一张张按顺序叠放在一起,组合起来形成图像的最终效果。A layer, composed of many pixels, is the basic unit that makes up an image. A frame of image can be a layer, and it is also composed of multiple layers stacked up and down. A layer is like a film containing elements such as text or graphics. The sheets are stacked one on another and combined to form the final result of the image.
帧率,通常为1秒内显示图像的帧数,在本发明实施例中,帧率=1秒/垂直同步(Vertical Synchronization,Vsync)周期的时长。The frame rate is usually the number of frames of the displayed image in one second. In the embodiment of the present invention, the frame rate = 1 second/Vertical Synchronization (Vsync) period.
现有的双面智能手机的正面液晶显示(Liquid Crystal Display,LCD)屏或者有机发光二极管(Organic Light-Emitting Diode)OLED屏,所述正面液晶屏或OLED屏的刷新率为60Hz,甚至更高,高于背面ELINK屏的2Hz~8Hz的刷新率,第三方应用程序根据正面液晶屏刷新率设计的动画效果,如果在背面ELINK屏上显示,将导致极大的延迟,第三方应用程序的动画效果在背面ELINK屏上显示的效果差,本发明实施例解决了上述问题。下面,首先对正面液晶屏根据vsync时钟信号显示图像的流程进行一下介绍,如图1所示,根据vsync时钟信号,首先执行S101应用层绘制图像,然后执行S102组合(Compose)不同画面图层叠加处理,最后执行S103在正面LCD屏显示,其中,组合(Compose)不同画面图层叠加处理的过程如图2所示,对每帧图像的处理,严格依赖vsync脉冲时钟信号作为同步信号源,保持不同模块对图像进行同步处理,当vsync脉冲时钟为X时起,执行步骤S201应用层绘制第一帧图像;当vsync脉冲时钟为X+1时起,执行步骤S202Compse图层叠加第一帧,同时执行步骤S203应用层绘制第二帧图像;当vsync脉冲时钟为X+2时起,执行步骤S204在LCD屏上显示第一帧,同时执行步骤S205Compse图层叠加第二帧,同时执行步骤S206应用层绘制第三帧图像;当vsync脉冲时钟为X+3时起,执行步骤S207在LCD屏上显示第二帧,同时执行步骤S208Compse图层叠加第三帧,以此类推。The front-side liquid crystal display (LCD) screen or the organic light-emitting diode (OLED) OLED screen of the existing double-sided smart phone, the front liquid crystal screen or the OLED screen has a refresh rate of 60 Hz or even higher. , higher than the 2Hz ~ 8Hz refresh rate of the back ELINK screen, the third-party application based on the front LCD refresh rate design animation effect, if displayed on the back ELINK screen, will lead to great delay, third-party application animation The effect of the display on the back ELINK screen is poor, and the embodiment of the present invention solves the above problems. Next, firstly, the flow of displaying the image according to the vsync clock signal on the front liquid crystal screen is first introduced. As shown in FIG. 1 , according to the vsync clock signal, the S101 application layer is firstly drawn, and then the S102 combination (Compose) different screen layer superposition is performed. Processing, and finally executing S103 on the front LCD screen display, wherein the process of composing different screen layer superposition processing is as shown in FIG. 2, and the processing of each frame image strictly depends on the vsync pulse clock signal as a synchronization signal source, keeping The different modules perform synchronization processing on the image. When the vsync pulse clock is X, the application layer is used to draw the first frame image. When the vsync pulse clock is X+1, the step S202Compse layer is superimposed on the first frame. Step S203 is performed to apply the second frame image; when the vsync pulse clock is X+2, step S204 is performed to display the first frame on the LCD screen, and step S205Compse layer is performed to superimpose the second frame, and step S206 is performed. The layer draws the third frame image; when the vsync pulse clock is X+3, step S207 is executed to display the second frame on the LCD screen, and the step is executed at the same time. Overlay S208Compse third frame, and so on.
举例说明,LCD屏的频率为60Hz,电子墨水屏的频率为4Hz,若使用电子墨水屏的4Hz的vsync时钟信号来作为显示的同步信号源,则第三方应用程序就会按照4Hz的vsync时钟信号的频率来绘制图像。按照60Hz的vsync时钟信号的频率绘制1S的动画,需要绘制60帧图像,而按照4Hz的vsync时钟信号的频率绘制所述60帧图像,则需要15S,在LCD屏上1S显示的动画,在所述电子墨水屏上需要显示15s,呈现出一帧帧跳动的“慢动作”的动画效果,造成用户极差的使用体验。为解决上述问题,本发明实施例提供了一种图像显示的方法,如图3所示,第三方应用程序在电子墨水屏上显示图像,但在步骤S301应用层绘制图像时,设置一个虚拟vsync时钟信号,其中,所述虚拟vsync时钟信号可以是由S302虚拟vsync时钟信号发生模块产生的,使所述应用层按照虚拟vsync时钟信号绘制图像,该虚拟vsync时钟信号与所述第三方应用在LCD屏幕上绘制图像时的刷新率相同,步骤S303Compose不同画面图层叠加处理,步骤S304在绘制的多个图像中按照电子墨水屏的实际vsync时钟信号挑选需要显示的帧,步骤S305在所述电子墨水屏上显示。 该方法可以使用户在使用电子墨水屏时的体验得到提高,但是该方法还存在一个缺点,即挑选出的最终帧可能无法得到及时的显示,并且显示出的动画的效果比较差。例如,一个时长为800ms的动画,按照设定时长挑选帧,所述设定时长为250ms,则电子墨水屏将显示第250ms,第500ms,第750ms的图像,然后第1000ms的时候显示最终的静态画面,而动画的时长为800ms,因此最终的静态画面显示延迟较大。当使用电子书应用时,在处理翻页时,该应用在LCD屏上显示动画翻页效果到最终的显示页面,但在电子墨水屏上,将呈现几帧割裂的动画帧,然后最后一帧静态画面显示还有延迟,用户的体验效果较差,所述电子墨水屏的刷新率越低,用户的体验效果越差。在上述情况下,最理想的显示效果应该是不显示中间过程动画,直接第一时间显示最后一帧静态画面。For example, the frequency of the LCD screen is 60 Hz, and the frequency of the electronic ink screen is 4 Hz. If the 4 Hz vsync clock signal of the electronic ink screen is used as the synchronous signal source for display, the third-party application will follow the 4 Hz vsync clock signal. The frequency to draw the image. To draw an animation of 1S according to the frequency of the 60Hz vsync clock signal, it is necessary to draw 60 frames of images, and to draw the 60 frames of images according to the frequency of the 4Hz vsync clock signal, 15S is required, and the animation displayed on the LCD screen is displayed in 1S. It takes 15 seconds to display on the electronic ink screen, which presents a "slow motion" animation with a frame of jitter, resulting in a very poor user experience. In order to solve the above problem, an embodiment of the present invention provides a method for displaying an image. As shown in FIG. 3, a third-party application displays an image on an electronic ink screen, but sets a virtual vsync when the application layer draws an image in step S301. a clock signal, wherein the virtual vsync clock signal may be generated by the S302 virtual vsync clock signal generation module, causing the application layer to render an image according to a virtual vsync clock signal, the virtual vsync clock signal and the third party application on the LCD The refresh rate is the same when the image is drawn on the screen, step S303Compose different screen layer superimposition processing, step S304 selects the frame to be displayed according to the actual vsync clock signal of the electronic ink screen in the plurality of drawn images, and the electronic ink is performed in step S305. Displayed on the screen. This method can improve the user's experience when using the electronic ink screen, but there is a disadvantage in this method, that is, the selected final frame may not be displayed in time, and the effect of the displayed animation is relatively poor. For example, an animation with a duration of 800ms selects a frame according to the set duration. The set duration is 250ms. The electronic ink screen will display the image of the 250ms, 500ms, and 750ms, and then display the final static at 1000ms. The picture, while the duration of the animation is 800ms, so the final static picture display delay is large. When using the e-book application, the application displays an animated page flip effect on the LCD screen to the final display page when processing the page flip, but on the e-ink screen, an animation frame with several frames is split, and then the last frame There is also a delay in the static picture display, and the user's experience is poor. The lower the refresh rate of the electronic ink screen, the worse the user experience is. In the above case, the most ideal display effect should be that the intermediate process animation is not displayed, and the last frame of the static picture is displayed directly at the first time.
下面结合附图对本申请提供的一种图像显示的方法进行具体说明,使电子墨水在使用功能第三方应用时,不显示中间过程动画,直接第一时间显示最后一帧静态画面。The method for displaying an image provided by the present application is specifically described below with reference to the accompanying drawings, so that when the electronic ink is used in the third-party application, the intermediate process animation is not displayed, and the last frame of the static image is directly displayed at the first time.
参见图4,为本申请提供的一种图像显示的方法,该方法包括:Referring to FIG. 4, a method for displaying an image provided by the present application includes:
S401,确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻。S401. Determine a transmission time of the received second frame image, where the transmission time is a time when the application layer draws the second frame image and sends the second frame image to the next processing module.
S402,确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值。S402. Determine a difference between a sending time of the second frame image and a sending time of the previously received first frame image.
S403,若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。S403. If it is determined that the difference is greater than or equal to a set threshold, send the second frame image to a display buffer register.
在一种可能的实现方式中,所述S402之后,该方法还包括:In a possible implementation manner, after the S402, the method further includes:
若判断出所述差值小于设定的门限值,将所述第二帧图像丢弃。If it is determined that the difference is less than a set threshold, the second frame image is discarded.
在一种可能的实现方式中,所述S403之后,该方法还包括:In a possible implementation manner, after the S403, the method further includes:
按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。The images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
本申请实施例中,提供了一种图像显示的方法,当第二帧图像的发送时间与第一帧图像的发送时间的差值大于或等于设定的门限值时,将所述第二帧图像发送到显示缓冲寄存器,以便在电子墨水屏幕上显示,通过上述图像显示的方法,可以将差值小于设定的门限值连续发送的多帧动画效果的图像过滤掉,只显示差值大于或等于设定的门限值的图像,保证所述电子墨水屏上像是的是一个稳定的静态画面,提高用户的使用体验。In the embodiment of the present application, a method for displaying an image is provided. When the difference between the sending time of the second frame image and the sending time of the first frame image is greater than or equal to the set threshold, the second The frame image is sent to the display buffer register for display on the electronic ink screen. By the above image display method, the image of the multi-frame animation effect whose difference value is continuously transmitted less than the set threshold value can be filtered out, and only the difference is displayed. An image larger than or equal to the set threshold value ensures that the electronic ink screen is like a stable static picture, thereby improving the user experience.
下面结合图5对本申请提供的一种图像显示的方法进行具体说明,步骤S501应用层绘制图像时,设置一个虚拟vsync时钟信号,其中,所述虚拟vsync时钟信号可以是由S502虚拟vsync时钟信号发生模块产生的,然后步骤S503根据虚拟vsync时钟信号组合(Compose)不同画面图层叠加处理,步骤S504获取接收到的第二帧图像的发送时间,步骤S505比较所述第二帧图像的发送时间与之前接收到的第一帧图像发送时间的差值是否大于或等于设定门限值,例如,40ms即超过2帧,则执行步骤S506将所述最后一帧图像发送到显示缓冲寄存器中,否则,执行步骤S507丢弃第二帧图像,按照实际vsync时钟信号获取所述显示缓冲寄存器中的图像,步骤508显示到电子墨水屏上。A method for displaying an image provided by the present application is specifically described below with reference to FIG. 5. In step S501, when a layer is drawn by an application layer, a virtual vsync clock signal is set, wherein the virtual vsync clock signal may be generated by the S502 virtual vsync clock signal. The module generates, then step S503 combines different screen layer superposition processing according to the virtual vsync clock signal, step S504 acquires the transmission time of the received second frame image, and step S505 compares the transmission time of the second frame image with Whether the difference of the first frame image transmission time received before is greater than or equal to the set threshold value, for example, 40 ms or more than 2 frames, then step S506 is performed to send the last frame image to the display buffer register, otherwise Step S507 is performed to discard the second frame image, and the image in the display buffer register is acquired according to the actual vsync clock signal, and step 508 is displayed on the electronic ink screen.
在一种可能的实现方式中,在所述S403之后,若接收到用户对屏幕的操作,该方法还包括:In a possible implementation, after the S403, if the operation of the user on the screen is received, the method further includes:
接收到触摸指令;绘制所述触摸指令触发的设定图像;将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行叠加处理。其中,所述将所述触摸指令 触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行叠加处理,具体包括:在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。Receiving a touch instruction; drawing a setting image triggered by the touch instruction; and superimposing the setting image triggered by the touch instruction with the second frame image in the display buffer register. Wherein the touch instruction is The superimposing process of the triggered setting image and the second frame image in the display buffer register specifically includes: overwriting the setting of the touch instruction trigger on the second frame image in the display buffer register image.
在一种可能的实现方式中,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行图层叠加处理之后,该方法还包括:In a possible implementation, after performing the layer superposition processing on the set image triggered by the touch instruction and the second frame image in the display buffer register, the method further includes:
将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
具体的,将所述叠加处理后的得到的图像由应用层的Compose叠加处理的模块发送至所述电子墨水屏。Specifically, the image obtained by the superimposition processing is sent to the electronic ink screen by a module of Compose superposition processing of an application layer.
具体的,不同的触摸指令触发不同的设定图像,如图6所示,分别为点击触摸指令和滑动触摸指令所对应的设定图像,其中,所述设定图像在电子墨水屏上可以显示一帧,然后消失,本发明对其不做限定。将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行叠加处理时,首线判断用户点击位置的原有色彩,虽然电子墨水屏只有黑白两种颜色,但是具备色阶,读取点击位置为中心的指定区域的原有颜色信息,若判断指定区域显示的原有颜色为浅色调,则点击后的指定区域显示为深色调;若判断指定区域显示的原有颜色为深色调,则点击后的指定区域显示为浅色调;在所述电子墨水屏上刷新指定区域,不对电子墨水屏全屏进行刷新,可以加快显示速率,做到更实时的显示,提高用户的使用体验。Specifically, different touch commands trigger different setting images, as shown in FIG. 6 , which are setting images corresponding to the click touch command and the sliding touch command, respectively, wherein the set image can be displayed on the electronic ink screen. One frame is then disappeared, which is not limited by the present invention. When the setting image triggered by the touch command is superimposed with the second frame image in the display buffer register, the first line determines the original color of the user's click position, although the electronic ink screen has only two colors of black and white. However, the color gradation is read, and the original color information of the designated area centered on the click position is read. If it is judged that the original color displayed in the designated area is a light color, the designated area after the click is displayed as a dark color; The original color is dark tone, then the specified area after clicking is displayed as a light color; the specified area is refreshed on the electronic ink screen, and the full screen of the electronic ink screen is not refreshed, the display rate can be accelerated, and the real-time display can be improved. User experience.
举例说明,如图7所示,步骤S701应用层绘制图像时,设置一个虚拟vsync时钟信号,其中,所述虚拟vsync时钟信号可以是由S702虚拟vsync时钟信号发生模块产生的,然后步骤S703根据虚拟vsync时钟信号Compose不同画面图层叠加处理,步骤S704获取当前接收到的第二帧图像的发送时间,步骤S705比较所述第二帧图像的发送时间与之前接收到的第一帧图像发送时间的差值是否大于或等于设定门限值,若是,则执行步骤S706将所述第二帧图像发送到显示缓冲寄存器中,若否,则执行步骤707将所述第二帧图像丢弃,步骤S708当电子墨水屏接收到触摸指令时,步骤S709电子墨水屏绘制所述触摸指令触发的设定图像,步骤S710将所述设定图像和从显示缓冲寄存器中获取的图像进行Compose画面图层叠加处理,步骤S711将所述叠加处理后的图像发送到所述电子墨水屏进行显示,在所述电子墨水屏上体现出的操作为刷新了指定区域。For example, as shown in FIG. 7 , when the application layer draws an image in step S701, a virtual vsync clock signal is set, wherein the virtual vsync clock signal may be generated by the S702 virtual vsync clock signal generation module, and then step S703 is performed according to the virtual The vsync clock signal Compose different screen layer superimposition processing, step S704 acquires the transmission time of the currently received second frame image, and step S705 compares the transmission time of the second frame image with the previously received first frame image transmission time. Whether the difference is greater than or equal to the set threshold, if yes, executing step S706 to send the second frame image to the display buffer register, and if not, executing step 707 to discard the second frame image, step S708 When the electronic ink screen receives the touch instruction, the electronic ink screen draws the setting image triggered by the touch instruction in step S709, and the step S710 performs the Compose picture layer superposition processing on the set image and the image acquired from the display buffer register. Step S711, sending the superimposed processed image to the electronic ink screen for display, where the Reflect on ink screen refresh operation for the designated area.
基于与方法实施例同样的发明构思,本申请还提供了一种终端设备示意图,如图8所示,该终端设备包括:Based on the same inventive concept as the method embodiment, the present application further provides a schematic diagram of a terminal device. As shown in FIG. 8, the terminal device includes:
第一确定模块801,用于确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻。The first determining module 801 is configured to determine a sending time of the received second frame image, where the sending time is after the application layer draws the second frame image, and sends the second frame image to the next processing module. Moment.
第二确定模块802,用于确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值。The second determining module 802 is configured to determine a difference between a sending time of the second frame image and a sending time of the previously received first frame image.
处理模块803,用于若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。The processing module 803 is configured to send the second frame image to the display buffer register if it is determined that the difference is greater than or equal to the set threshold.
在一种可能的实现方式中,在所述终端设备还包括:In a possible implementation, the terminal device further includes:
显示模块,用于按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。And a display module, configured to acquire an image stored in the display buffer register according to an actual vertical synchronous clock signal, and send the image to the electronic ink screen for display in a storage order.
本申请实施例中,提供了一种终端设备,当第二帧图像的发送时间与第一帧图像的发 送时间的差值大于或等于设定的门限值时,将所述第二帧图像发送到显示缓冲寄存器,以便在电子墨水屏幕上显示,通过上述图像显示的方法,可以将差值小于设定的门限值连续发送的多帧动画效果的图像过滤掉,只显示差值大于或等于设定的门限值的图像,保证所述电子墨水屏上像是的是一个稳定的静态画面,提高用户的使用体验。In the embodiment of the present application, a terminal device is provided, where the sending time of the second frame image and the sending of the first frame image When the difference of the sending time is greater than or equal to the set threshold value, the second frame image is sent to the display buffer register for display on the electronic ink screen, and the difference can be set smaller than the above image display method. The image of the multi-frame animation effect continuously sent by the fixed threshold value is filtered out, and only the image whose difference value is greater than or equal to the set threshold value is displayed, so that the electronic ink screen is like a stable static picture. Improve the user experience.
在一种可能的实现方式中,所述终端设备还包括:In a possible implementation manner, the terminal device further includes:
接收模块,用于接收到触摸指令;a receiving module, configured to receive a touch instruction;
生成模块,用于绘制所述触摸指令触发的设定图像;a generating module, configured to draw a setting image triggered by the touch instruction;
所述处理模块还用于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。The processing module is further configured to perform a layer superposition process on the set image triggered by the touch instruction and the second frame image in the display buffer register.
在一种可能的实现方式中,所述处理模块具体用于:In a possible implementation manner, the processing module is specifically configured to:
在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
在一种可能的实现方式中,所述显示模块还用于:In a possible implementation manner, the display module is further configured to:
将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,另外,在本申请各个实施例中的各功能模块可以集成在一个处理器中,也可以是单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。The division of the modules in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner. In addition, each functional module in each embodiment of the present application may be integrated into one processing. In the device, it can also be physically existed alone, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
其中,集成的模块既可以采用硬件的形式实现时,如图9所示,终端设备可以包括处理器901。上述模块对应的实体的硬件可以为处理器901。处理器901,可以是一个中央处理模块(英文:central processing unit,简称CPU),或者为数字处理模块等等。该终端设备还包括:存储器902,用于存储处理器901执行的程序。存储器902可以是非易失性存储器,比如硬盘(英文:hard disk drive,缩写:HDD)或固态硬盘(英文:solid-state drive,缩写:SSD)等,还可以是易失性存储器(英文:volatile memory),例如随机存取存储器(英文:random-access memory,缩写:RAM)。存储器902是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。When the integrated module can be implemented in the form of hardware, as shown in FIG. 9, the terminal device can include the processor 901. The hardware of the entity corresponding to the above module may be the processor 901. The processor 901 can be a central processing unit (English: central processing unit, CPU for short), or a digital processing module or the like. The terminal device further includes a memory 902 for storing a program executed by the processor 901. The memory 902 can be a non-volatile memory, such as a hard disk drive (HDD) or a solid state drive (SSD), or a volatile memory (English: volatile) Memory), such as random access memory (English: random-access memory, abbreviation: RAM). Memory 902 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.
处理器901用于执行存储器902存储的程序代码,具体调用所述第一存储器中存储的程序指令,确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻,确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值,若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。The processor 901 is configured to execute the program code stored in the memory 902, specifically invoke the program instruction stored in the first memory, and determine a transmission time of the received second frame image, where the sending time is the application layer After the two frames of images, the time at which the second frame image is sent to the next processing module determines the difference between the transmission time of the second frame image and the transmission time of the previously received first frame image, if it is determined The difference is greater than or equal to the set threshold value, and the second frame image is sent to the display buffer register.
本申请实施例中不限定上述处理器901以及存储器902之间的具体连接介质。本申请实施例在图9中处理器901以及存储器902之间通过总线903连接,总线在图9中以粗线表示,其它部件之间的连接方式,仅是进行示意性说明,并不引以为限。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示,图9中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。The specific connection medium between the processor 901 and the memory 902 is not limited in the embodiment of the present application. The embodiment of the present application is connected between the processor 901 and the memory 902 in FIG. 9 through a bus 903. The bus is indicated by a thick line in FIG. 9. The connection manner between other components is only for illustrative description, and is not cited. Limited. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 9, but it does not mean that there is only one bus or one type of bus.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面 的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application may employ an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware aspects. The form of the embodiment. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
显然,本领域的技术人员可以对本申请实施例进行各种改动和变型而不脱离本申请实施例的精神和范围。这样,倘若本申请实施例的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。 It is apparent that those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, it is intended that the present invention cover the modifications and variations of the embodiments of the present invention.

Claims (15)

  1. 一种图像显示的方法,其特征在于,该方法包括:A method of image display, characterized in that the method comprises:
    确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻;Determining a transmission time of the received second frame image, where the transmission time is a time after the application layer draws the second frame image, and sends the second frame image to the next processing module;
    确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值;Determining a difference between a transmission time of the second frame image and a transmission time of the previously received first frame image;
    若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。If it is determined that the difference is greater than or equal to the set threshold, the second frame image is sent to the display buffer register.
  2. 如权利要求1所述的方法,其特征在于,所述第二帧图像发送到显示缓冲寄存器之后,该方法还包括:The method of claim 1, wherein after the second frame image is sent to the display buffer register, the method further comprises:
    按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。The images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
  3. 如权利要求1所述的方法,其特征在于,所述第二帧图像发送到显示缓冲寄存器之后,该方法还包括:The method of claim 1, wherein after the second frame image is sent to the display buffer register, the method further comprises:
    接收到触摸指令;Receiving a touch command;
    绘制所述触摸指令触发的设定图像;Draw a setting image triggered by the touch instruction;
    将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。And performing layer overlay processing on the set image triggered by the touch instruction and the second frame image in the display buffer register.
  4. 如权利要求3所述的方法,其特征在于,所述将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理,具体包括:The method of claim 3, wherein the performing the layer superimposition processing on the set image triggered by the touch instruction and the second frame image in the display buffer register comprises:
    在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  5. 如权利要求3所述的方法,其特征在于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像进行图层叠加处理之后,该方法还包括:The method of claim 3, after the step of superimposing the set image triggered by the touch command with the second frame image in the display buffer register, the method further comprises:
    将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
  6. 一种图像显示的终端设备,其特征在于,该终端设备包括:An image display terminal device, characterized in that the terminal device comprises:
    第一确定模块,用于确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻;a first determining module, configured to determine a sending time of the received second frame image, where the sending time is after the application layer draws the second frame image, and sends the second frame image to the next processing module time;
    第二确定模块,用于确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值;a second determining module, configured to determine a difference between a sending time of the second frame image and a sending time of the previously received first frame image;
    处理模块,用于若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。The processing module is configured to send the second frame image to the display buffer register if it is determined that the difference is greater than or equal to the set threshold.
  7. 如权利要求6所述的终端设备,其特征在于,所述终端设备还包括:The terminal device according to claim 6, wherein the terminal device further comprises:
    显示模块,用于按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。And a display module, configured to acquire an image stored in the display buffer register according to an actual vertical synchronous clock signal, and send the image to the electronic ink screen for display in a storage order.
  8. 如权利要求6所述的终端设备,其特征在于,所述终端设备还包括:The terminal device according to claim 6, wherein the terminal device further comprises:
    接收模块,用于接收到触摸指令;a receiving module, configured to receive a touch instruction;
    生成模块,用于绘制所述触摸指令触发的设定图像;a generating module, configured to draw a setting image triggered by the touch instruction;
    所述处理模块还用于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所 述第二帧图像上进行图层叠加处理。The processing module is further configured to: set a setting image triggered by the touch instruction and a location in the display buffer register Layer superposition processing is performed on the second frame image.
  9. 如权利要求8所述的终端设备,其特征在于,所述处理模块具体用于:The terminal device according to claim 8, wherein the processing module is specifically configured to:
    在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  10. 如权利要求8所述的终端设备,其特征在于,所述显示模块还用于:The terminal device according to claim 8, wherein the display module is further configured to:
    将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
  11. 一种图像显示的终端设备,其特征在于,该终端设备包括:An image display terminal device, characterized in that the terminal device comprises:
    存储器,用于存储器程序指令;Memory for memory program instructions;
    处理器,用于调用所述存储器中存储的程序指令,确定接收到的第二帧图像的发送时间,所述发送时间为应用层绘制完所述第二帧图像后,将所述第二帧图像发送至下一个处理模块的时刻,确定所述第二帧图像的发送时间与之前接收到的第一帧图像的发送时间的差值,若判断出所述差值大于或等于设定的门限值,将所述第二帧图像发送到显示缓冲寄存器。a processor, configured to invoke a program instruction stored in the memory, to determine a transmission time of the received second frame image, where the sending time is after the application layer draws the second frame image, and the second frame is Determining, by the time when the image is sent to the next processing module, a difference between the sending time of the second frame image and the sending time of the previously received first frame image, and determining that the difference is greater than or equal to the set gate A limit value that sends the second frame image to a display buffer register.
  12. 如权利要求11所述的终端设备,其特征在于,所述处理器还用于:The terminal device according to claim 11, wherein the processor is further configured to:
    按照实际垂直同步时钟信号获取所述显示缓冲寄存器中存储的图像,并按存储顺序发送到电子墨水屏幕上显示。The images stored in the display buffer register are acquired according to the actual vertical synchronous clock signal, and are sent to the electronic ink screen for display in the order of storage.
  13. 如权利要求11所述的终端设备,其特征在于,所述处理器还用于:The terminal device according to claim 11, wherein the processor is further configured to:
    接收到触摸指令,绘制所述触摸指令触发的设定图像,所述处理模块还用于,将所述触摸指令触发的设定图像与所述显示缓冲寄存器中的所述第二帧图像上进行图层叠加处理。Receiving a touch command, and drawing a setting image triggered by the touch instruction, the processing module is further configured to: perform setting image triggered by the touch instruction with the second frame image in the display buffer register Layer overlay processing.
  14. 如权利要求13所述的终端设备,其特征在于,所述处理器具体用于:The terminal device according to claim 13, wherein the processor is specifically configured to:
    在所述显示缓冲寄存器中的所述第二帧图像上覆盖所述触摸指令触发的设定图像。The set image triggered by the touch instruction is overwritten on the second frame image in the display buffer register.
  15. 如权利要求13所述的终端设备,其特征在于,所述处理器还用于:The terminal device according to claim 13, wherein the processor is further configured to:
    将所述叠加处理后的得到的图像发送至所述电子墨水屏,并在所述电子墨水屏上刷新指定区域,其中,所述指定区域为所述触摸指令触发的设定图像在所述电子墨水屏上的显示区域。 Transmitting the obtained image after the superimposition processing to the electronic ink screen, and refreshing a designated area on the electronic ink screen, wherein the designated area is a set image triggered by the touch instruction in the electronic The display area on the ink screen.
PCT/CN2017/082240 2016-12-30 2017-04-27 Image display method and terminal device WO2018120546A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780004907.7A CN108476306B (en) 2016-12-30 2017-04-27 Image display method and terminal equipment
CN202110320798.8A CN113225427B (en) 2016-12-30 2017-04-27 Image display method and terminal equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611265369.0 2016-12-30
CN201611265369 2016-12-30

Publications (1)

Publication Number Publication Date
WO2018120546A1 true WO2018120546A1 (en) 2018-07-05

Family

ID=62706689

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/082240 WO2018120546A1 (en) 2016-12-30 2017-04-27 Image display method and terminal device

Country Status (2)

Country Link
CN (2) CN113225427B (en)
WO (1) WO2018120546A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110865784A (en) * 2019-11-15 2020-03-06 合肥讯飞读写科技有限公司 Screen projection processing method, device, equipment, storage medium and screen projection system
CN113596425A (en) * 2021-06-21 2021-11-02 深圳市沃特沃德信息有限公司 Image processing method and device for ink screen terminal, storage medium and intelligent device
CN113867674A (en) * 2021-09-28 2021-12-31 北京大上科技有限公司 Electronic ink display screen refreshing method and display system
CN114489383A (en) * 2022-01-28 2022-05-13 广州文石信息科技有限公司 Electronic ink screen equipment and display method of electronic ink screen
CN114677974A (en) * 2022-02-25 2022-06-28 珠海读书郎软件科技有限公司 Refreshing control method for electronic ink screen, storage medium and equipment
CN115116403A (en) * 2022-08-29 2022-09-27 惠科股份有限公司 Electronic ink screen, control method and device thereof, and computer-readable storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113052749B (en) * 2021-03-02 2023-04-07 长沙景嘉微电子股份有限公司 Video display method and graphics processor
CN113407029B (en) * 2021-06-25 2024-02-20 腾讯云计算(北京)有限责任公司 Page object state information determining method, device, equipment and readable medium
CN113870799B (en) * 2021-09-09 2022-11-18 瑞芯微电子股份有限公司 System display method and storage device of electronic ink screen device
CN115550709B (en) * 2022-01-07 2023-09-26 荣耀终端有限公司 Data processing method and electronic equipment
CN116723416B (en) * 2022-10-21 2024-04-02 荣耀终端有限公司 Image processing method and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102610198A (en) * 2012-03-05 2012-07-25 福州瑞芯微电子有限公司 Method for improving display effect of electronic ink display screen
CN104036713A (en) * 2013-03-07 2014-09-10 三星电子株式会社 Display Drive Integrated Circuit And Image Display System
CN104951266A (en) * 2015-06-11 2015-09-30 联想(北京)有限公司 Screen adjustment method and electronic device
CN105070253A (en) * 2015-08-28 2015-11-18 广州文石信息科技有限公司 Refreshing method of electronic ink screen
US20160239249A1 (en) * 2015-02-12 2016-08-18 Samsung Electronics Co., Ltd. Multi-display device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2226787B1 (en) * 2009-03-03 2016-12-07 Lg Electronics Inc. Mobile terminal and method for displaying data in mobile terminal
TWI437469B (en) * 2009-03-17 2014-05-11 Inventec Appliances Corp Electronic book apparatus and operating method thereof
JP5382528B2 (en) * 2009-12-28 2014-01-08 Nltテクノロジー株式会社 Image display control device, image display device, image display control method, and image display control program
CN103258505B (en) * 2013-05-13 2015-05-13 福州瑞芯微电子有限公司 Electronic ink screen refreshing method and corresponding electronic device thereof
US20140340282A1 (en) * 2013-05-15 2014-11-20 Samsung Electronics Co., Ltd. Soc for supporting multiple display screens and configuration method thereof
CN103325332B (en) * 2013-06-14 2015-12-02 小米科技有限责任公司 Page furbishing method, device and equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102610198A (en) * 2012-03-05 2012-07-25 福州瑞芯微电子有限公司 Method for improving display effect of electronic ink display screen
CN104036713A (en) * 2013-03-07 2014-09-10 三星电子株式会社 Display Drive Integrated Circuit And Image Display System
US20160239249A1 (en) * 2015-02-12 2016-08-18 Samsung Electronics Co., Ltd. Multi-display device
CN104951266A (en) * 2015-06-11 2015-09-30 联想(北京)有限公司 Screen adjustment method and electronic device
CN105070253A (en) * 2015-08-28 2015-11-18 广州文石信息科技有限公司 Refreshing method of electronic ink screen

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110865784A (en) * 2019-11-15 2020-03-06 合肥讯飞读写科技有限公司 Screen projection processing method, device, equipment, storage medium and screen projection system
CN110865784B (en) * 2019-11-15 2024-03-15 合肥讯飞读写科技有限公司 Screen projection processing method, device, equipment, storage medium and screen projection system
CN113596425A (en) * 2021-06-21 2021-11-02 深圳市沃特沃德信息有限公司 Image processing method and device for ink screen terminal, storage medium and intelligent device
CN113596425B (en) * 2021-06-21 2023-02-07 深圳市沃特沃德信息有限公司 Image processing method and device for ink screen terminal, storage medium and intelligent device
CN113867674A (en) * 2021-09-28 2021-12-31 北京大上科技有限公司 Electronic ink display screen refreshing method and display system
CN114489383A (en) * 2022-01-28 2022-05-13 广州文石信息科技有限公司 Electronic ink screen equipment and display method of electronic ink screen
CN114677974A (en) * 2022-02-25 2022-06-28 珠海读书郎软件科技有限公司 Refreshing control method for electronic ink screen, storage medium and equipment
CN114677974B (en) * 2022-02-25 2023-09-26 珠海读书郎软件科技有限公司 Refreshing control method, storage medium and device for electronic ink screen
CN115116403A (en) * 2022-08-29 2022-09-27 惠科股份有限公司 Electronic ink screen, control method and device thereof, and computer-readable storage medium
CN115116403B (en) * 2022-08-29 2023-01-31 惠科股份有限公司 Electronic ink screen, control method and device thereof, and computer readable storage medium

Also Published As

Publication number Publication date
CN113225427B (en) 2022-03-18
CN108476306A (en) 2018-08-31
CN113225427A (en) 2021-08-06
CN108476306B (en) 2021-04-20

Similar Documents

Publication Publication Date Title
WO2018120546A1 (en) Image display method and terminal device
KR101401216B1 (en) Mirroring graphics content to an external display
TWI519957B (en) Application programming interface for providing native and non-native display utility
AU2013211505B2 (en) Immersive mode for a web browser
CN114648951B (en) Method for controlling dynamic change of screen refresh rate and electronic equipment
WO2018119575A1 (en) Display method and electronic device
US9727301B2 (en) Gesture-based prioritization of graphical output on remote displays
KR20160046620A (en) Display driver circuit and display system
CN106062705A (en) Cross-platform rendering engine
KR102534714B1 (en) Method for providing user interface related to note and electronic device for the same
US20180247613A1 (en) Display apparatus and control method thereof
AU2017266815A1 (en) Operating method for display corresponding to luminance, driving circuit, and electronic device supporting the same
US20150194131A1 (en) Image data output control method and electronic device supporting the same
KR20140046346A (en) Multi display apparatus and method for contorlling thereof
KR20100080407A (en) Peer-to-peer dynamically appendable logical displays
US10741128B2 (en) Dual scan out display system
US20150040059A1 (en) System, device, and method for scrolling content with motion blur on an electronic display
WO2022171054A1 (en) Display refreshing method and apparatus, and electronic device
US9984651B2 (en) Method and apparatus for displaying composition screen image by composing screen images of operating systems (OSs)
KR20220143667A (en) Reduced display processing unit delivery time to compensate for delayed graphics processing unit render times
WO2023093458A1 (en) Method for determining refresh mode of ink screen, and electronic device and storage medium
WO2023001163A1 (en) Screen refreshing method and device capable of improving dynamic effect performance
US20240071283A1 (en) Independent refresh rate for multiple monitors
US10068549B2 (en) Cursor handling in a variable refresh rate environment
CN106354449A (en) Document online demonstration method and client

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17886064

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17886064

Country of ref document: EP

Kind code of ref document: A1