CN116107479A

CN116107479A - Picture display method, electronic device and computer storage medium

Info

Publication number: CN116107479A
Application number: CN202310196717.7A
Authority: CN
Inventors: 曾锦和; 刘凌凌
Original assignee: Uc Mobile Co ltd
Current assignee: Uc Mobile Co ltd
Priority date: 2023-03-02
Filing date: 2023-03-02
Publication date: 2023-05-12
Anticipated expiration: 2043-03-02
Also published as: CN116107479B

Abstract

The embodiment of the application provides a picture display method, electronic equipment and a computer storage medium, wherein the picture display method comprises the following steps: determining that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied; generating corresponding first thumbnail pixels and second thumbnail pixels according to the thumbnail data corresponding to the picture to be displayed and the pre-stored color data, wherein the generation speed of the second thumbnail pixels is faster than that of the first thumbnail pixels; the second thumbnail pixel is displayed before the generation of the first thumbnail pixel is completed, and the second thumbnail pixel is replaced by the first thumbnail pixel for display after the generation of the first thumbnail pixel is completed. Through this embodiment of the application, realized under the condition that does not increase hardware cost, effectively promoted the display effect of picture, and then promoted the effect that the user used experience.

Description

Picture display method, electronic device and computer storage medium

Technical Field

The embodiment of the application relates to the technical field of image processing, in particular to a picture display method, electronic equipment and a computer storage medium.

Background

With the development of picture digitizing technology, most of the current pictures can be displayed on the screen of an electronic device. Since the screen of the electronic device displays information in a matrix of pixels, it is necessary for the picture to decode the original picture data into pixel data before displaying.

In practical applications, there are many scenes in which a picture needs to be displayed immediately, and this manner of displaying immediately requires the picture to finish decoding within a given limited time, which puts a high requirement on the hardware performance of the electronic device. If the hardware can not finish decoding the picture in a given time, the picture display is affected, so that the picture display effect is greatly reduced, and the user experience is further affected. Therefore, the method of changing time in space by a buffer memory mode and ensuring the picture display performance is generated. In the cache mode, for repeated pictures, the same pictures stored in the cache and displayed before the repeated pictures can be utilized to improve the speed and performance of picture display, and further improve the display effect. However, the above "buffer" method is also not effective in meeting the display requirement for most of the pictures, which are completely new, or in which the size of the picture is too large to be suitable for buffering, or in a scene such as a picture list page in which the picture is displayed by rapid sliding.

Therefore, how to effectively improve the display effect of the picture without increasing the hardware cost is a problem to be solved.

Disclosure of Invention

In view of the foregoing, embodiments of the present application provide a picture display scheme to at least partially solve the above-mentioned problems.

According to a first aspect of an embodiment of the present application, there is provided a picture display method, including: determining that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied; generating corresponding first thumbnail pixels and second thumbnail pixels according to the thumbnail data corresponding to the picture to be displayed and the pre-stored color data, wherein the generation speed of the second thumbnail pixels is faster than that of the first thumbnail pixels; the second thumbnail pixel is displayed before the generation of the first thumbnail pixel is completed, and the second thumbnail pixel is replaced by the first thumbnail pixel for display after the generation of the first thumbnail pixel is completed.

According to a second aspect of embodiments of the present application, there is provided an electronic device, including: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus; the memory is configured to store at least one executable instruction, where the executable instruction causes the processor to perform operations corresponding to the method according to the first aspect.

According to a third aspect of embodiments of the present application, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first aspect.

According to a fourth aspect of embodiments of the present application, there is provided a computer program product comprising computer instructions for instructing a computing device to perform the operations corresponding to the method according to the first aspect.

According to the scheme provided by the embodiment of the application, in a quick picture display scene, a thumbnail mode is used for displaying pictures. However, unlike the conventional thumbnail mode, in the scheme of the embodiment of the present application, two different modes are simultaneously adopted to generate thumbnail pixels for display on a display screen, one mode is to generate a first thumbnail pixel according to thumbnail data of a picture to be displayed, and the other mode is to generate a second thumbnail pixel according to pre-stored color data. Because the speed of generating thumbnail pixels based on color data is generally much faster than the speed of generating thumbnail pixels based on thumbnail data. Therefore, the second thumbnail pixel can be preferentially used for display. Although, in the fast picture display scene, the fast picture display can be realized by using the second thumbnail pixels alone, so that the display effect is improved to a certain extent. However, the display effect of the second thumbnail pixel is still different from that of the first thumbnail pixel. For this reason, in the solution of the embodiment of the present application, before the first thumbnail pixel is not completely generated, the first generated second thumbnail pixel is used for display, and once it is determined that the first thumbnail pixel is completely generated, the first thumbnail pixel is replaced for display. Therefore, the image display can effectively meet the requirement of quick image display, and the image display effect is overall better through the combined use of the first thumbnail pixels and the second thumbnail pixels. Therefore, the display effect of the picture is effectively improved under the condition that the hardware cost is not increased, and the use experience effect of a user is further improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description will briefly introduce the drawings that are required to be used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings may also be obtained according to these drawings for a person having ordinary skill in the art.

FIG. 1 is a schematic diagram of an exemplary system to which embodiments of the present application are applicable;

fig. 2A is a flowchart illustrating steps of a method for displaying a picture according to a first embodiment of the present application;

FIG. 2B is a schematic diagram of an example of a scenario in the embodiment shown in FIG. 2A;

fig. 3A is a schematic process diagram of a picture display method according to a second embodiment of the present application;

FIG. 3B is a schematic diagram of key process portions in the picture display method of the embodiment shown in FIG. 3A;

fig. 4 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.

Detailed Description

In order to better understand the technical solutions in the embodiments of the present application, the following descriptions will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the embodiments of the present application shall fall within the scope of protection of the embodiments of the present application.

Embodiments of the present application are further described below with reference to the accompanying drawings of embodiments of the present application.

Fig. 1 illustrates an exemplary system to which the check code generation method of the embodiments of the present application is applied. As shown in fig. 1, the system 100 may include a cloud service 102, a communication network 104, and/or one or more user devices 106, which are illustrated in fig. 1 as a plurality of user devices.

Cloud server 102 may be any suitable device for storing pictures, information, data, programs, and/or any other suitable type of content, including, but not limited to, distributed storage system devices, server clusters, computing cloud server clusters, and the like. In some embodiments, cloud server 102 may perform any suitable functions. For example, in some embodiments, cloud service 102 may return its required pictures to user device 106 upon request of user device 106.

In some embodiments, the communication network 104 may be any suitable combination of one or more wired and/or wireless networks. For example, the communication network 104 can include any one or more of the following: the internet, an intranet, a wide area network (Wide Area Network, WAN), a local area network (Loca l Area Network, LAN), a wireless network, a digital subscriber line (D igi ta l Subscr i ber L i ne, DSL) network, a frame relay network, an asynchronous transfer mode (Asynchronous Transfer Mode, ATM) network, a virtual private network (Vi rtua l Pr ivate Network, VPN), and/or any other suitable communication network. The user device 106 can be connected to the communication network 104 via one or more communication links (e.g., communication link 112), and the communication network 104 can be linked to the cloud service 102 via one or more communication links (e.g., communication link 114). The communication link may be any communication link suitable for transferring data between the user device 106 and the cloud service 102, such as a network link, a dial-up link, a wireless link, a hardwired link, any other suitable communication link, or any suitable combination of such links.

User device 106 may include any one or more user devices adapted to interact with a user and present images and/or sequences of images. In some embodiments, user device 106 may send a picture acquisition request to cloud server 102 to acquire and display a picture from cloud server 102. In some embodiments, user device 106 may comprise any suitable type of device. For example, in some embodiments, user devices 106 may include mobile devices, tablet computers, laptop computers, desktop computers, wearable computers, game consoles, media players, vehicle entertainment systems, and/or any other suitable type of user device.

Based on the above system, the embodiments of the present application provide a picture display method, which is described below through a plurality of embodiments.

Example 1

Referring to fig. 2A, a flowchart of steps of a picture display method according to a first embodiment of the present application is shown.

The picture display method of the present embodiment includes the following steps:

step S202: it is determined that the condition for generating the thumbnail of the picture to be displayed is satisfied, step S204 is performed.

The picture display may be displayed in a slow display scene or in a fast display scene. Generally, when the method is slow, the hardware can have enough time to decode the original picture for display, and when the method is fast, the decoding time is long, which may result in that the user gives up browsing the picture, or the waiting time of the user is too long, which results in poor browsing experience, etc.

In order to distinguish between slow display scenes and fast display scenes, in one possible approach, a display screen refresh rate may be used as a reference. The refresh rate of the display screen refers to the number of times the electron beam repeats, scans, and is in hertz, the screen image. Higher refresh rate means faster screen change, requiring pictures to be displayed at faster speed; the lower the refresh rate, the slower the speed at which the pictures are displayed. Based on this, in the embodiment of the present application, if the refresh rate of the display screen is greater than the preset refresh rate threshold, it is considered that the display screen is a fast display scene, and the condition for generating the thumbnail pixels of the picture to be displayed is satisfied. Wherein the refresh rate threshold may be set as appropriate by those skilled in the art depending on the circumstances, and may be, for example, 50-70 hertz. In another possible manner, whether the scene is displayed quickly may be determined according to the relationship between the display screen refresh rate and the picture decoding time consumption threshold T. For example, a picture decoding time consumption threshold T (ms) is set, when the refresh rate of the display screen is 60HZ, an interval between frames is 16 (ms) (1000 ms/60 hz=16 ms (result after rounding)), and if the picture decoding time consumption threshold T is greater than 16ms, it is determined that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied as a fast display scene. For another example, when the refresh rate of the display screen is 120HZ, the interval between each frame is 8 (ms) (1000 ms/120 hz=8 ms (rounded result)), if the picture decoding time consumption threshold T is greater than 8ms, it is determined that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied. In yet another possible way, an image decoding time consumption threshold, still exemplified as T, may be set. For example, if the speed of the user sliding the page (unit pixel per millisecond) is used as a basis, the time taken for displaying the picture on the window of the screen is "the number of pixels of the screen resolution in the sliding direction"/"the speed of the user sliding the page (unit pixel per millisecond)", denoted as y (ms), and when y is smaller than T, it is determined that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied for rapidly displaying the scene. If the size of the picture to be displayed is based on the size, if the result of (resolution of the picture is wide) and the decoding performance of the device (pixels per millisecond) is expressed as z (ms), that is, the estimated time for decoding the picture is consumed, and when z is greater than T, the condition that the scene is displayed quickly and the thumbnail pixels of the picture to be displayed are generated is satisfied is determined.

If the current display scene is determined to be a quick display scene, it can be determined that the picture needs to be displayed in the form of a thumbnail, that is, the condition of generating the thumbnail pixels of the picture to be displayed is satisfied. Further, the following step of generating a thumbnail may be performed.

However, in order to determine the implementation of quick display of the picture in the quick display scene, in a feasible manner, the steps may be implemented as follows: if the original image pixels corresponding to the picture to be displayed are not stored in the memory, and/or the thumbnail pixels corresponding to the thumbnail data corresponding to the picture to be displayed are not stored in the memory, determining that the condition of generating the thumbnail pixels of the picture to be displayed is met. Because in some cases, if the picture to be displayed is already displayed, it may be stored in the memory, if so, it can be directly used; if not, the quick display scheme of the embodiments of the present application may be used. In addition, for the picture, the storage form may include the original picture and the thumbnail corresponding to the original picture, and if the thumbnail is preloaded into the memory, the thumbnail data in the memory may be used to generate the thumbnail pixel for further display; if not, the quick display scheme of the embodiments of the present application may be used. The two above-mentioned judgments can be used alternatively or in combination. By selecting an application mode, the flow can be simplified, and the quick display scheme of the embodiment of the application can be triggered as soon as possible; by combining the modes, the method can carry out comprehensive judgment, ensures that the method can be used immediately when available data exists in the memory, and also improves the speed and the efficiency of quick display.

However, the present invention is not limited thereto, and other modes similar to the above-described modes may be applied to the modes of the embodiments of the present application.

Step S204: and generating corresponding first thumbnail pixels and second thumbnail pixels according to the thumbnail data corresponding to the picture to be displayed and the pre-stored color data.

Wherein the second thumbnail pixel is generated faster than the first thumbnail pixel.

When the condition of generating the thumbnail pixels of the picture to be displayed is determined to be satisfied, whether the picture to be displayed or the thumbnail thereof is already present in the electronic device where the display screen is located or not is determined to be satisfied, the generating of the first and second thumbnail pixels is performed simultaneously (e.g., in parallel) without judgment, that is, the generating of the corresponding first thumbnail pixel (corresponding to the picture to be displayed and/or the thumbnail case thereof) according to the thumbnail data corresponding to the picture to be displayed is performed simultaneously, and the generating of the corresponding second thumbnail pixel (corresponding to the picture not to be displayed and the thumbnail case thereof) according to the pre-stored color data. The pre-stored color data can be set by a person skilled in the art according to actual needs, can be set as default color data, and can also be generated according to pictures.

The specific manner in which the first and second thumbnail pixels are generated may be different from case to case. In one possible way, this step may be implemented as: simultaneously, performing a first judgment on whether thumbnail data corresponding to the picture to be displayed are stored or not and a second judgment on whether pre-stored color data are stored in a memory or not; generating a corresponding first thumbnail pixel based on a picture to be displayed or the thumbnail data according to a judging result of the first judgment; and generating a corresponding second thumbnail pixel based on the color data according to the judgment result of the second judgment. In this way, most of the situations that may occur in practical applications can be covered to ensure smooth generation of thumbnail pixels.

For the first thumbnail pixel, if the judging result of the first judgment indicates that the thumbnail data corresponding to the picture to be displayed is stored, decoding the thumbnail data to generate the corresponding first thumbnail pixel; and if the judgment result of the first judgment indicates that the thumbnail data is not stored, generating a first thumbnail pixel based on the reduction of the picture to be displayed. Therefore, when the data related to the picture to be displayed is locally stored in the electronic equipment where the display screen is located, the data can be effectively utilized, and pixels corresponding to the thumbnail with better display effect can be generated. If the electronic device does not store the thumbnail data locally but has the picture to be displayed (i.e. original image data), the thumbnail pixels are generated by shrinking, so that the number of pixels can be greatly reduced while the thumbnail pixels are ensured to be generated, and the generation efficiency is improved.

In a quick display scene of a picture, most of the quick display scenes need to be displayed through a thumbnail first, such as when a user performs quick picture browsing and sliding operation or quick looking up operation of a picture list. For the picture to be displayed, the thumbnail of the picture to be displayed is likely to exist and be stored, or the thumbnail is likely to not exist or be not stored, so that the existing picture resource can be effectively utilized, and the rapid generation of the first thumbnail pixel can be realized.

In addition, in order to avoid the situation that the thumbnail pixel generated at this time is stored and eliminated (such as elimination caused by memory update) when being reused later, and thus needs to be regenerated, in one possible manner, if the judgment result of the first judgment indicates that the thumbnail data is not stored, the representative color of the picture to be displayed is obtained, and the representative color is stored in the resident memory. Because the space occupied by the color data in the memory is smaller, the color data can be resident in the memory, if the subsequent use requirement exists, the representative color of the picture to be displayed can be directly obtained from the memory, and the thumbnail pixel of the picture to be displayed is generated by adopting a second thumbnail generation mode based on the representative color. Thus, the generation efficiency of thumbnail pixels is improved. It should be noted that this operation of generating the representative color may be performed in parallel with the operation of generating the first thumbnail pixel based on the picture to be displayed or the thumbnail data thereof, or may be performed out of order.

In addition, for the manner of generating the first thumbnail pixel based on the reduction of the picture to be displayed, after the first thumbnail pixel is generated, the first thumbnail pixel generated by the reduction may be stored in the picture file corresponding to the picture to be displayed. In one possible approach, the "thumbnail data" portion of the "artwork data" may be used to store the generated thumbnail pixels based on the data structure of the "artwork data" so that the thumbnail pixels can be stored in a picture file for multiplexing in a later process. For example, in the current industry standard, thumbnail data may be stored in an exif data structure in a picture file, which is supported by commonly used jpeg, webp, heic, etc. picture formats of future standards, so that many picture files have thumbnail data built in. Based on this, thumbnail pixels can be stored in the original exif data structure to be able to adapt and better utilize and participate in the consumption and generation of data stored in the exif. Preferably, the process of storing the thumbnail pixels into the picture file can be operated independently of the picture display link, i.e. the time consumed for storing the picture file does not affect the screen display picture.

And for the second thumbnail pixel, in a feasible manner, if the judging result of the second judgment on whether the memory stores the pre-stored color data indicates that the memory stores the pre-stored color data, generating a corresponding second thumbnail pixel by using the pre-stored color data; and if the judging result of the second judgment indicates that the memory does not store the pre-stored color data, generating a corresponding second thumbnail pixel by using the default color data. The pre-stored color data is typically representative color data of the picture to be displayed, and the default color data can be set by those skilled in the art according to actual requirements. As described above, both the thumbnail data and the thumbnail pixels may be eliminated due to the memory usage change, and the representative color generated according to the picture to be displayed will reside in the memory as the pre-stored color data corresponding to the picture. Therefore, if the picture to be displayed needs to be displayed again and the memory data of the picture to be displayed is eliminated, the corresponding thumbnail pixels can be quickly generated according to the representative color. However, if neither the picture to be displayed nor the thumbnail data thereof nor the representative color thereof is stored, the thumbnail pixels may be generated using default color data to achieve the effect of preparing the pixels necessary to display the picture in hardware as fast as possible. Because the mode of generating the thumbnail pixels based on the color is greatly greater than the mode of decoding the thumbnail data to generate the thumbnail pixels, the second thumbnail pixels generated based on the color data can be used for transition before the first thumbnail pixels cannot be obtained, so that the picture display effect and the user browsing experience are improved.

It should be noted that the specific implementation of the pre-stored color data is not limited to the above-mentioned manner of generating the representative color according to the picture to be displayed, and it may also be set by a person skilled in the art, and may be different from the color represented by the default color data.

In addition, the pre-stored color data may be single color data (representing a single color) or may be multiple color data (representing multiple colors). If the pre-stored color data includes a plurality of color data, generating a corresponding second thumbnail pixel using the pre-stored color data may include: determining a corresponding thumbnail pixel generation rule according to the number of pre-stored color data; and generating a corresponding second thumbnail pixel by using the pre-stored color data according to the determined thumbnail pixel generation rule. The thumbnail pixel generation rules can be flexibly set by those skilled in the art according to actual requirements, including but not limited to: a rule of generating the second thumbnail pixels based on an average value of the plurality of color data, a rule of generating the second thumbnail pixels based on a normal distribution of the plurality of color data, and the like, to which the embodiment of the present application is not limited. Therefore, the attractiveness and the color richness of the generated second thumbnail pixel can be improved, and the display effect of the second thumbnail pixel is further improved.

In the embodiments of the present application, unless otherwise specified, the numbers of "multiple", "plural", and the like related to "multiple" mean two or more.

As can be seen from the above description, the thumbnail pixel generation process can take 4 specific forms, including:

(1) Directly acquiring thumbnail data of picture data of a picture to be displayed, and decoding the thumbnail data to generate a corresponding first thumbnail pixel;

(2) Based on a picture to be displayed, namely original picture data, generating a corresponding first thumbnail pixel through scaling factor immediate reduction decoding;

(3) Generating a corresponding second thumbnail pixel based on pre-stored color data, such as color data representing a color;

(4) Based on the default color data, a corresponding second thumbnail pixel is generated.

Thus, the generation time of thumbnail pixels for quick display is greatly accelerated, and the performance of displayed 'pictures' can be ensured to meet the ultra-high resolution and ultra-high refresh rate in a quick display scene.

In addition, alternatively, the first thumbnail pixel may be stored in the memory after the first thumbnail pixel is generated; after the second thumbnail pixel is generated, judging whether thumbnail pixels corresponding to the picture to be displayed exist in the memory or not; if not, the second thumbnail pixel is stored in the memory. In this way, on the one hand, multiplexing of subsequent thumbnail pixels is facilitated; on the other hand, for the second thumbnail pixel, the display effect is inferior to that of the first thumbnail pixel, so if the first thumbnail pixel exists in the memory, the second thumbnail pixel is not stored any more; if the second thumbnail pixel is stored in the memory, repeated storage is not needed, so that the storage efficiency is improved.

In addition, although the first thumbnail pixel or the second thumbnail pixel may be stored in the memory so as to facilitate subsequent multiplexing, the memory space is limited, and as the display of the picture is refreshed, the generated first thumbnail pixel and/or second thumbnail pixel may be stored in the memory, and then memory elimination is performed when the elimination condition is satisfied. Wherein, the eliminating conditions and specific eliminating modes can be set by a person skilled in the art according to actual requirements, and the embodiment of the application is not limited. For example, when the storage space of the memory is full, thumbnail pixels with the storage time being ranked at the front, or thumbnail pixels with the storage time reaching a preset duration, or random elimination, etc. may be eliminated, so as to ensure effective utilization of the memory space.

Step S206: the second thumbnail pixel is displayed before the generation of the first thumbnail pixel is completed, and the second thumbnail pixel is replaced with the first thumbnail pixel for display after the generation of the first thumbnail pixel is completed.

Because the display effect of the first thumbnail pixel is better than that of the second thumbnail pixel, but the generation speed is slower than that of the second thumbnail pixel, when the picture needs to be displayed quickly, the generated second thumbnail pixel can be used for displaying first, then the second thumbnail pixel is replaced after the first thumbnail pixel is generated, so that the picture displayed quickly has a better display effect, and the browsing experience of a user is improved.

After that, optionally, if it is determined that the display duration of the first thumbnail pixel or the second thumbnail pixel reaches the preset duration, decoding the picture to be displayed, and generating an original image pixel corresponding to the picture to be displayed; and displays the original picture element. The preset duration may be set by those skilled in the art according to actual needs, which is not limited in the embodiments of the present application. If the display duration of the thumbnail pixels reaches the preset duration, the user hopes to browse the picture in more detail, and the display of the picture is possibly switched from a fast display scene to a slow display scene, and during the display of the thumbnail pixels, the electronic equipment with the display screen can have enough time to decode the picture to be displayed, generate corresponding original picture pixels and display the original picture pixels, so that the user can know the original picture condition and detail information of the picture to be displayed.

Hereinafter, the above-described process is exemplarily described with a specific example, as shown in fig. 2B.

In this example, it is assumed that the user wants to browse a certain photo website X, and sends a request to the server where the photo website X is located through the link web address of the photo website X displayed in the user device. After receiving the request, the server returns a large number of pictures in the picture website X to the user equipment.

Then, if the user browses the picture returned by the picture website X through the user equipment, the web page for displaying the picture is scrolled rapidly, for example, the scroll causes the refresh rate of the display screen of the user equipment to exceed 60 Hz, so that the user equipment is triggered to determine that the picture is displayed in the form of the thumbnail, and the condition that the user equipment determines that the thumbnail pixel for generating the picture to be displayed is met can be considered.

Assume again that the server returns 100 pictures to the user device, and the scrolling operation of the current user corresponds to thumbnail displays of 15 th-17 th pictures. And further, supposing that thumbnail data are simultaneously contained in the picture file corresponding to the returned picture. On the one hand, the user equipment triggers the decoding of the thumbnail data of the 15 th-17 th pictures, and the first thumbnail pixels corresponding to the 15 th-17 th pictures are generated and are indicated as 15A-17A. The operation of decoding the thumbnail data of the 15 th to 17 th pictures can be performed in parallel through a plurality of processes, and can be sequentially performed in series under the condition of slightly lower requirements on display effects. On the other hand, assuming that the representative color of the 15 th-17 th picture does not exist in the user device, in this case, the user device uses default color data, which is assumed to be color data corresponding to blue in this example, to generate a second thumbnail pixel corresponding to the 15 th-17 th picture, denoted as 15B-17B, while decoding the thumbnail data.

Since 15B-17B is generated faster than 15A-17A, the user equipment will first display 15B-17B, e.g., 50ms. Then, 15A-17A is fully generated, and then after 50ms of 15B-17B display, 15A-17A will be replaced.

Subsequently, if the user performs the quick scrolling operation again, the displayed picture may still display the corresponding second thumbnail pixel first and then display the corresponding first thumbnail pixel according to the above manner until the quick scrolling operation of the user is stopped.

It can be seen that, with the present embodiment, in a quick picture display scene, a picture is displayed using a thumbnail manner. However, unlike the conventional thumbnail mode, in the scheme of the embodiment of the present application, two different modes are simultaneously adopted to generate thumbnail pixels for display on a display screen, one mode is to generate a first thumbnail pixel according to thumbnail data of a picture to be displayed, and the other mode is to generate a second thumbnail pixel according to pre-stored color data. Because the speed of generating thumbnail pixels based on color data is generally much faster than the speed of generating thumbnail pixels based on thumbnail data. Therefore, the second thumbnail pixel can be preferentially used for display. Although, in the fast picture display scene, the fast picture display can be realized by using the second thumbnail pixels alone, so that the display effect is improved to a certain extent. However, the display effect of the second thumbnail pixel is still different from that of the first thumbnail pixel. For this reason, in the solution of the embodiment of the present application, before the first thumbnail pixel is not completely generated, the first generated second thumbnail pixel is used for display, and once it is determined that the first thumbnail pixel is completely generated, the first thumbnail pixel is replaced for display. Therefore, the image display can effectively meet the requirement of quick image display, and the image display effect is overall better through the combined use of the first thumbnail pixels and the second thumbnail pixels. Therefore, the display effect of the picture is effectively improved under the condition that the hardware cost is not increased, and the use experience effect of a user is further improved.

Example two

The embodiment describes a picture display scheme of the present application with reference to fig. 3A and 3B by using a specific example of a picture display process. It should be clear to those skilled in the art that some of the procedures or steps in the present embodiment are optional or alternative steps, and are not necessary steps for implementing the picture display scheme in the embodiment of the present application.

Referring to fig. 3A, a process diagram of a picture display method according to a second embodiment of the present application is shown.

step S302: in a fast display scene, a picture is requested to be displayed.

As previously described, the fast display scene may be determined based on, for example, a display screen refresh rate and/or a picture decoding time consumption threshold.

Step S304: judging whether an original image pixel exists in the memory of the equipment where the display screen is positioned; if yes, the original picture pixels are directly displayed through a display screen; if not, step S306 is performed.

The original image pixels represent pixels corresponding to an image to be displayed (i.e., original image data).

Step S306: judging whether thumbnail pixels of the picture to be displayed exist in the memory or not; if yes, go to step S308; if not, it is determined that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied, and the process advances to step S310.

Step S308: the thumbnail pixels are displayed, and step S314 is further performed.

Step S310: comprising step S310 (1) and step S310 (2).

Wherein step S310 (1) includes:

step S310 (1) -1: judging whether the picture to be displayed has thumbnail data or not; if yes, go to step S310 (1) -2; if not, step S310 (1) -3 is performed.

In this embodiment, the picture to be displayed is also referred to as an original image.

Step S310 (1) -2: the thumbnail data is decoded to generate a first thumbnail pixel. Then, step S312 is performed.

Step S310 (1) -3: calculating the representative color of the picture to be displayed and storing the representative color into a memory. Then, steps S310 (1) -4 are performed.

The calculation of the representative color may take an average of all pixels of the picture to be displayed, or pixels corresponding to a number of colors whose number is ranked top, or the like, or a color whose number is ranked first.

Further, the representative color may be 1 color or n colors, where n is 2 or more.

Step S310 (1) -4: and performing the operation of reducing the picture to be displayed to generate the thumbnail pixels, and obtaining the corresponding first thumbnail pixels. Then, steps S310 (1) -5 are performed.

If the original image data of the picture to be displayed does not contain thumbnail image data, thumbnail image pixels can be generated based on the picture to be displayed, namely, first thumbnail image pixels are generated by shrinking the picture with large resolution. And, after the first thumbnail pixel is completed, the first thumbnail pixel may also be stored in a picture file, as described in steps S310 (1) -5.

Step S310 (1) -5: and storing the generated first thumbnail pixels into a picture file of the picture to be displayed. Then, step S312 is performed.

In this embodiment, the generated first thumbnail pixel may be stored with thumbnail data in the picture file of the picture to be displayed, so that the first thumbnail pixel can be stored in the picture file for multiplexing at a later time. In the current industry standard, thumbnail data can be stored in EXI F data in a picture file, for example, commonly used jpeg, webp, heic and other picture files of future standards also support the format, and more picture files are internally provided with thumbnail data, so that the structure can be used for storing thumbnail pixels so as to better utilize and participate in consumption and generation of EXI F data. The use of built-in thumbnail data for decoding to generate thumbnail pixels is faster than computing the thumbnail pixels from the original image data of the picture to be displayed. Therefore, it is more preferable to use built-in thumbnail data in order to obtain a better thumbnail.

It should be noted that this step may be independent of the picture display process, i.e. the time consumed for storing the picture file does not affect the screen display of the picture.

For step S310 (2), which is the concurrent processing procedure of step S310 (1) described above, thumbnail pixels, that is, second thumbnail pixels, are generated by colors. The second thumbnail pixel may be generated using a default color or may be generated by a representative color. Thus, the effect of preparing the pixels necessary for displaying the picture as quickly as possible can be achieved based on the existing hardware.

Step S310 (2) includes:

step S310 (2) -1: judging whether the representing color of the picture to be displayed exists in the memory or not; if yes, go to step S310 (2) -2; if not, step S310 (2) -3 is performed.

The representative color may be the representative color calculated in S310 (1) and stored in the memory.

Also, the calculation of the representative color may be an average value of all pixels of the picture to be displayed, or pixels corresponding to a number of colors whose number is ranked top, or the like, or a color whose number is ranked first.

The representative color may be 1 color or n colors, where n is greater than or equal to 2.

Step S310 (2) -2: and generating a second thumbnail pixel according to the representative color data of the representative color in the memory. Then, steps S310 (2) -4 are performed.

Step S310 (2) -3: and generating a second thumbnail pixel according to the default color data of the default color. Then, steps S310 (2) -4 are performed.

Step S310 (2) -4: judging whether thumbnail pixels of the picture to be displayed exist in the memory or not; if yes, discarding the generated second thumbnail pixel; if not, step S312 is performed.

The thumbnail pixels of the picture to be displayed in the memory may be the first thumbnail pixels stored before or the second thumbnail pixels stored before.

As can be seen from the above process, step S310 (1) and step S310 (2) are performed simultaneously, and step S310 (1) generates a first thumbnail pixel with a higher priority, and stores the first thumbnail pixel in the memory for standby; the second thumbnail pixel generated in step S310 (2) has a lower priority (at least lower than the first thumbnail pixel), and once there are other thumbnail pixels in the memory, the storing is abandoned.

Also, as can be seen from the above, there are 4 possible ways of generating thumbnail pixels, namely:

o is generated based on the thumbnail data decoding of the picture to be displayed;

o is generated by instantly shrinking and decoding the picture to be displayed through a scaling factor;

o is generated based on the representative color;

o is generated based on a default color.

For example, step S310 is more conveniently understood, and is intercepted as shown in fig. 3B.

In fig. 3B, as described above, step S310 (1) and step S310 (2) are performed in parallel at the same time. The first thumbnail pixel generated in step S310 (1) has a relatively good effect, but the generated time consumption is approximately only capable of ensuring a 60 hz refresh rate under the existing hardware level and the common high-definition map; once the resolution of the picture is increased, the refresh rate of the device is increased to be more than 120 hz, or the list control of the interface is rapidly slid, so that the task of the picture to be displayed is greatly increased, the refresh rate of the picture to be displayed is insufficient to be more than 60 hz, and even the display effect is greatly reduced to form a poor effect of blocking. Whereas step S310 (2) prepares the thumbnail pixels representing the picture at the fastest speed that the device can achieve, its effect may be the approximate color of the picture, such as blue for a sea chart, yellow for a desert chart, black for a sky chart, etc. If the high refresh rate display system requests display of content before the first thumbnail pixel generated in step S310 (1) with the better display effect is not completed, the second thumbnail pixel prepared in step S310 (2) may be used in advance as a standby. After the first thumbnail pixel with better display effect generated in step S310 (1) is completed, the display priority of the first thumbnail pixel is higher than that of the second thumbnail pixel, and the second thumbnail pixel is replaced for display.

Wherein, a multi-level buffer structure can be established to buffer the first thumbnail pixels so as to improve the effect and performance of picture display. But when the cache is invalid, the high refresh rate equipment can display the picture at the fastest speed through the second thumbnail pixels, so that the blank of the picture position is avoided, and the display effect is improved.

Step S312: and storing the generated thumbnail pixels into a memory, and eliminating the thumbnail pixels according to the requirement. Then, step S308 is performed.

In this step, as shown in the figure, the thumbnail pixels stored in the memory may be the first thumbnail pixels or the second thumbnail pixels.

Step S314: and delaying for a preset time length.

The preset duration may be set by those skilled in the art according to actual needs, which is not limited in the embodiments of the present application.

Step S316: judging whether the thumbnail pixels are still displayed on the display screen; if yes, go to step S318; if not, ending the flow.

If the thumbnail pixels are still displayed, the user hopes to browse the detailed information of the picture to be displayed and needs to display the original picture pixels of the picture to be displayed, and the thumbnail pixels are indicated to possibly enter a slow display scene. Otherwise, it indicates that the user performs other operations, such as the user performs the quick scroll operation again, or the user closes the current application, or the user jumps from the current application to other applications, or the user jumps from the current page of the current application to other pages of the current application, and so on. Based on the above, the current quick display flow is ended.

Step S318: and decoding the picture to be displayed to generate an original image pixel. Then, step S320 is performed.

Step S320: the original image pixels are stored in a memory and are eliminated as required in the follow-up process. Then, the original image pixels are directly displayed through a display screen.

According to the embodiment, the generation time of the thumbnail pixels can be greatly accelerated on the premise of low cost based on the existing hardware level, the performance and the display speed of the picture display are ensured, the picture display effect under the condition of ultrahigh resolution or ultrahigh refresh rate can be met, and the browsing experience of a user is improved.

Example III

Referring to fig. 4, a schematic structural diagram of an electronic device according to a third embodiment of the present application is shown, and the specific embodiments of the present application do not limit the specific implementation of the electronic device.

As shown in fig. 4, the electronic device may include: a processor 402, a communication interface (Commun icat ions I nterface) 404, a memory 406, and a communication bus 408.

Wherein:

processor 402, communication interface 404, and memory 406 communicate with each other via communication bus 408.

A communication interface 404 for communicating with other electronic devices or servers.

The processor 402 is configured to execute the program 410, and may specifically perform relevant steps in the above-described embodiment of the picture display method.

In particular, program 410 may include program code including computer-operating instructions.

The processor 402 may be a CPU or a specific integrated circuit AS ic (App l icat ion Spec I f I cI ntegrated C I rcu it) or one or more integrated circuits configured to implement embodiments of the present application. The one or more processors comprised by the smart device may be the same type of processor, such as one or more CPUs; but may also be different types of processors such AS one or more CPUs and one or more AS ics.

Memory 406 for storing programs 410. The memory 406 may comprise high-speed RAM memory, and may also include non-volatile memory (non-vo l at i l e memory), such as at least one disk memory.

The program 410 may include a plurality of computer instructions, and the program 410 may specifically enable the processor 402 to perform operations corresponding to the picture display method described in any one of the foregoing method embodiments through the plurality of computer instructions.

The specific implementation of each step in the procedure 410 may refer to the corresponding steps and corresponding descriptions in the units in the above method embodiment, and have corresponding beneficial effects, which are not described herein. It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and modules described above may refer to corresponding procedure descriptions in the foregoing method embodiments, which are not repeated herein.

The present application also provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method described in any of the foregoing method embodiments. The computer storage media includes, but is not limited to: a read-only optical disk (Compact D i sc Read-On y Memory, CD-ROM), a random access Memory (Random Access Memory, RAM), a floppy disk, a hard disk, a magneto-optical disk, or the like.

The embodiments of the present application also provide a computer program product, which includes computer instructions that instruct a computing device to perform operations corresponding to any one of the above-mentioned method embodiments of the present application.

In addition, it should be noted that, the information related to the user (including, but not limited to, user equipment information, user personal information, etc.) and the data related to the embodiment of the present application (including, but not limited to, data for requesting a picture, data for interacting with a cloud service end, data for analyzing, stored data, displayed data, etc.) are information and data authorized by the user or sufficiently authorized by each party, and the collection, use and processing of the related data need to comply with the related legal regulations and standards of the related country and region, and are provided with corresponding operation entries for the user to select authorization or rejection.

It should be noted that, according to implementation requirements, each component/step described in the embodiments of the present application may be split into more components/steps, and two or more components/steps or part of operations of the components/steps may be combined into new components/steps, so as to achieve the purposes of the embodiments of the present application.

The above-described methods according to embodiments of the present application may be implemented in hardware, firmware, or AS software or computer code storable in a recording medium such AS a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk, or AS computer code originally stored in a remote recording medium or a non-transitory machine-readable medium and to be stored in a local recording medium downloaded through a network, so that the methods described herein may be stored on such software processes on a recording medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware such AS an application specific integrated circuit (App l icat ion Spec I f I C I ntegrated Ci rcu it, AS ic) or field programmable gate array (F ie l d Programmab l e Gate Array, FPGA). It is understood that a computer, processor, microprocessor controller, or programmable hardware includes a Memory component (e.g., random access Memory (Random Access Memory, RAM), read-On-i-y Memory, ROM), flash Memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor, or hardware, performs the methods described herein. Furthermore, when a general purpose computer accesses code for implementing the methods illustrated herein, execution of the code converts the general purpose computer into a special purpose computer for performing the methods illustrated herein.

Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.

The above embodiments are only for illustrating the embodiments of the present application, but not for limiting the embodiments of the present application, and various changes and modifications can be made by one skilled in the relevant art without departing from the spirit and scope of the embodiments of the present application, so that all equivalent technical solutions also fall within the scope of the embodiments of the present application, and the scope of the embodiments of the present application should be defined by the claims.

Claims

1. A picture display method, comprising:

determining that the condition for generating the thumbnail pixels of the picture to be displayed is satisfied; then

Generating corresponding first thumbnail pixels and second thumbnail pixels according to thumbnail data corresponding to the picture to be displayed and pre-stored color data, wherein the generation speed of the second thumbnail pixels is faster than that of the first thumbnail pixels;

The second thumbnail pixel is displayed before the generation of the first thumbnail pixel is completed, and the second thumbnail pixel is replaced by the first thumbnail pixel for display after the generation of the first thumbnail pixel is completed.

2. The method of claim 1, wherein the generating corresponding first and second thumbnail pixels simultaneously from the thumbnail data corresponding to the picture to be displayed and the pre-stored color data includes:

simultaneously, performing a first judgment on whether thumbnail data corresponding to the picture to be displayed are stored or not and a second judgment on whether pre-stored color data are stored in a memory or not;

generating a corresponding first thumbnail pixel based on the picture to be displayed or the thumbnail data according to the judging result of the first judgment; the method comprises the steps of,

and generating a corresponding second thumbnail pixel based on the color data according to the judging result of the second judgment.

3. The method of claim 2, wherein the generating the corresponding first thumbnail pixel based on the picture to be displayed or the thumbnail data according to the determination result of the first determination includes:

If the judging result of the first judgment indicates that the thumbnail data corresponding to the picture to be displayed is stored, decoding the thumbnail data to generate a corresponding first thumbnail pixel;

and if the judging result of the first judgment indicates that the thumbnail data is not stored, generating the first thumbnail pixel based on the reduction of the picture to be displayed.

4. The method of claim 3, wherein if the determination result of the first determination indicates that the thumbnail data is not stored, the method further comprises:

and obtaining the representative color of the picture to be displayed, and storing the representative color into a resident memory.

5. A method according to claim 3, wherein after said generating said first thumbnail pixel based on said picture reduction to be displayed, the method further comprises:

and storing the reduced first thumbnail pixels into a picture file corresponding to the picture to be displayed.

6. The method of claim 2, wherein the generating a corresponding second thumbnail pixel based on color data according to the determination result of the second determination includes:

if the judging result of the second judgment indicates that the memory stores the pre-stored color data, generating a corresponding second thumbnail pixel by using the pre-stored color data;

And if the judging result of the second judgment indicates that the memory does not store the pre-stored color data, generating a corresponding second thumbnail pixel by using the default color data.

7. The method of claim 6, wherein if the pre-stored color data includes a plurality of color data, generating a corresponding second thumbnail pixel using the pre-stored color data comprises:

determining a corresponding thumbnail pixel generation rule according to the number of the pre-stored color data;

and generating a corresponding second thumbnail pixel by using the pre-stored color data according to the determined thumbnail pixel generation rule.

8. The method of any of claims 1-7, wherein the method further comprises:

after the first thumbnail pixel is generated, storing the first thumbnail pixel into a memory;

the method comprises the steps of,

after the second thumbnail pixel is generated, judging whether the thumbnail pixel corresponding to the picture to be displayed exists in a memory or not; and if not, storing the second thumbnail pixels into a memory.

9. The method of any of claims 1-7, wherein the method further comprises:

if the display time length of the first thumbnail pixel or the second thumbnail pixel reaches the preset time length, decoding the picture to be displayed to generate an original picture pixel corresponding to the picture to be displayed;

And displaying the original picture pixels.

10. The method of any of claims 1-7, wherein the determining that the condition to generate the thumbnail pixels of the picture to be displayed is satisfied comprises:

and if the original image pixels corresponding to the picture to be displayed are not stored in the memory, and/or the thumbnail pixels corresponding to the thumbnail data corresponding to the picture to be displayed are not stored in the memory, determining that the condition of generating the thumbnail pixels of the picture to be displayed is met.

11. The method of any of claims 1-7, wherein the method further comprises:

and storing the generated first thumbnail pixels and/or the generated second thumbnail pixels into a memory, and performing memory elimination when the elimination condition is met.

12. An electronic device, comprising: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus;

the memory is configured to store at least one executable instruction that causes the processor to perform operations corresponding to the method of any one of claims 1-11.

13. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1-11.

14. A computer program product comprising computer instructions that instruct a computing device to perform operations corresponding to the method of any one of claims 1-11.