CN112188179B - Image thumbnail display method, image thumbnail display device, and storage medium - Google Patents

Image thumbnail display method, image thumbnail display device, and storage medium Download PDF

Info

Publication number
CN112188179B
CN112188179B CN202010889251.5A CN202010889251A CN112188179B CN 112188179 B CN112188179 B CN 112188179B CN 202010889251 A CN202010889251 A CN 202010889251A CN 112188179 B CN112188179 B CN 112188179B
Authority
CN
China
Prior art keywords
image
dynamic range
high dynamic
color
image thumbnail
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010889251.5A
Other languages
Chinese (zh)
Other versions
CN112188179A (en
Inventor
李�瑞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202010889251.5A priority Critical patent/CN112188179B/en
Publication of CN112188179A publication Critical patent/CN112188179A/en
Application granted granted Critical
Publication of CN112188179B publication Critical patent/CN112188179B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The present disclosure relates to an image thumbnail display method, an image thumbnail display apparatus, and a storage medium. The image thumbnail display method includes: acquiring a media file of an image thumbnail to be displayed, wherein the media file comprises a high dynamic range image corresponding to the image thumbnail; converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a threshold value of the specified bit number; based on the designated color bitmap format, a color bitmap for displaying the image thumbnail is generated and the image thumbnail is displayed. The image thumbnail of the high dynamic range image can be normally displayed through the present disclosure.

Description

Image thumbnail display method, image thumbnail display device, and storage medium
Technical Field
The present disclosure relates to the field of image display technologies, and in particular, to an image thumbnail display method, an image thumbnail display apparatus, and a storage medium.
Background
Compared with a Standard-Dynamic Range image (Standard-Dynamic Range), a High-Dynamic Range image (HDR 10+) has clearer light and shade gradation and richer image colors, and can reproduce a real scene more vividly.
At present, in order to display a high dynamic range image well and obtain the best experience, a display device matched with the high dynamic range image is also needed to realize the high dynamic range image, and therefore, the use cost of a user is increased. In addition, due to current technical means, good display of high dynamic range image thumbnails is currently at a low level.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides an image thumbnail display method, an image thumbnail display apparatus, and a storage medium.
According to a first aspect of the embodiments of the present disclosure, a method for displaying an image thumbnail is provided, including obtaining a media file of an image thumbnail to be displayed, where the media file includes a high dynamic range image corresponding to the image thumbnail; converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold value; and generating a color bitmap for displaying the image thumbnail and displaying the image thumbnail based on the specified color bitmap format.
In one embodiment, the generating a color bitmap based on the specified color bitmap format comprises: acquiring metadata of the high dynamic range image converted into the designated color bitmap format, and encapsulating the metadata in a video frame; generating a color bitmap based on metadata in the video frame.
In another embodiment, the generating a color bitmap based on metadata in the video frame comprises: acquiring pixel metadata of a specified frame at a specified time from the video frame according to a frame index; generating a color bitmap based on the pixel metadata.
In yet another embodiment, before generating a color bitmap for displaying the image thumbnail based on the designated color bitmap format, the image thumbnail display method further includes: and if the color gamut of the high dynamic range image is not consistent with the color gamut displayed by the image thumbnail, converting the color gamut of the high dynamic range image into the color gamut displayed by the image thumbnail.
In yet another embodiment, the converting the color bitmap format of the high dynamic range image into a specified color bitmap format includes: converting the color bitmap format of the high dynamic range image to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
In another embodiment, the acquiring a media file of a thumbnail of an image to be displayed includes: and acquiring a high dynamic range image or a high dynamic range video of the image thumbnail to be displayed.
According to a second aspect of the embodiments of the present disclosure, an image thumbnail display apparatus is provided, which includes an obtaining module, configured to obtain a media file of an image thumbnail to be displayed, where the media file includes a high dynamic range image corresponding to the image thumbnail; the processing module is used for converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold value; and the generating module is used for generating a color bitmap for displaying the image thumbnail and displaying the image thumbnail based on the specified color bitmap format.
In one embodiment, the generation module is configured to generate a color bitmap based on the specified color bitmap format in the following manner: acquiring metadata of the high dynamic range image after being converted into the specified color bitmap format, and encapsulating the metadata in a video frame; generating a color bitmap based on metadata in the video frame.
In another embodiment, the generating module is configured to generate a color bitmap based on metadata in the video frame in the following manner: acquiring pixel metadata of a specified frame at a specified time from the video frame according to a frame index; generating a color bitmap based on the pixel metadata.
In still another embodiment, the image thumbnail display apparatus further includes: and the conversion module is used for responding to the inconsistency of the color gamut of the high dynamic range image and the color gamut displayed by the image thumbnail and converting the color gamut of the high dynamic range image into the color gamut displayed by the image thumbnail.
In yet another embodiment, the processing module is configured to convert the color bitmap format of the high dynamic range image into a specified color bitmap format as follows: converting the color bitmap format of the high dynamic range image to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
In another embodiment, the obtaining module is configured to obtain a media file of an image thumbnail to be displayed in the following manner: and acquiring a high dynamic range image or a high dynamic range video of the image thumbnail to be displayed.
According to a third aspect of the embodiments of the present disclosure, there is provided an image thumbnail display apparatus including a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instruction to execute the image thumbnail display method described in the first aspect of the present disclosure or any implementation manner of the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a mobile terminal, enable the mobile terminal to perform the image thumbnail display method described in the first aspect of the present disclosure or any implementation manner of the first aspect.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the color bitmap format of the high dynamic range image of the image thumbnail to be displayed is converted into the designated color bitmap format, the bit number corresponding to the color component in the designated color bitmap format is greater than the threshold value of the designated bit number, so that the color bitmap for displaying the image thumbnail is generated and displayed based on the designated color bitmap format, the color richness of the displayed image thumbnail is increased, and the finally displayed image thumbnail can be ensured to be richer in image color and meet the color richness requirement of the high dynamic range image, so that the thumbnail of the high dynamic range image can be normally displayed, and the experience and satisfaction of a user in the using process are increased.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating an image thumbnail display method according to an exemplary embodiment.
Fig. 2 shows a flowchart for generating a color bitmap based on a specified color bitmap format in an image thumbnail display method.
Fig. 3 is a schematic diagram showing a color gamut horseshoe diagram.
Fig. 4 shows a flowchart for generating a color bitmap based on metadata in a video frame in an image thumbnail display method.
Fig. 5 is a flowchart illustrating another image thumbnail display method according to an exemplary embodiment.
Fig. 6 is a diagram showing the display effect of an image thumbnail of a current high dynamic range image.
Fig. 7 is a diagram showing a display effect of an image thumbnail of a high dynamic range image to which an image thumbnail display method is applied.
Fig. 8 is a block diagram illustrating an image thumbnail display apparatus according to an exemplary embodiment.
Fig. 9 is a block diagram illustrating an apparatus for thumbnail display of images according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosure, as detailed in the appended claims.
With the development of the times, videos or images with ultra high definition, high dynamic range and wide color gamut are gradually popularized. Among them, a High-Dynamic Range image (HDR 10+ for short) is a new form of video or image display widely popularized at present. Compared with a Standard-Dynamic Range image, the high-Dynamic Range image has clearer light and shade gradation and richer image colors, namely, the black seen by a user is darker or the displayed white is brighter, and the more comprehensive color display can ensure that a video picture or an image can more vividly reproduce a real scene.
With the development of high dynamic range image technology and the gradual application of cameras matched with the high dynamic range image technology, videos or images with high dynamic range image formats are on the market gradually increasing. For a high dynamic range image, an electro-optical conversion curve adopts SMPTE ST.2084; the chromaticity space adopts 4:2: 0; the color gamut adopts ITU-R BT.2020; the metadata adopts SMPTE ST.2086. Videos or images having a high dynamic range image format are widely accepted because they can exhibit more abundant colors.
In the related art, a captured video or image may be displayed in the form of an image thumbnail on an image display apparatus. When an image display device (for example, a terminal such as a mobile phone) displays an image thumbnail, a color Bitmap (Bitmap) is usually generated in a Bitmap. The Bitmap format of the image thumbnail displayed by the current image display device is RGB _888, that is, the size occupied by the color component red, green, blue represented by one pixel point is respectively: red: 8bit, Green: 8bit, Blue: 8 bit. However, the high dynamic range image has a Bitmap format that typically has richer color components, e.g., the high dynamic range image Bitmap format is RGB _ 161616. Therefore, the existing image display device (for example, a mobile phone or other terminal) does not support the display of the high dynamic range image thumbnail, and the screen display of the video thumbnail with the high dynamic range image format is grayish, which results in poor user experience.
The invention provides an image thumbnail display method, which increases the bit number of a color component in a Bitmap format to define a new Bitmap format, and converts the color Bitmap format of a high dynamic range image into the new Bitmap format with the increased bit number of the color component when the image thumbnail of the high dynamic range image is displayed, so that the color richness of the displayed image thumbnail is increased, the image color of the finally displayed image thumbnail is ensured to be richer, and the experience and satisfaction of a user in the using process are increased.
In an exemplary embodiment of the present disclosure, the image thumbnail display method may be applied to a scene in which a media file of an image thumbnail to be displayed is displayed. The media file may be a still image including a high dynamic range image, or may be a high dynamic range video including a high dynamic range image.
Fig. 1 is a flowchart illustrating an image thumbnail display method according to an exemplary embodiment.
In an exemplary embodiment of the present disclosure, as shown in fig. 1, an image thumbnail display method includes the following steps.
In step S11, the media file of the image thumbnail to be displayed is acquired. The media files comprise high dynamic range images corresponding to the image thumbnails.
In one possible embodiment, obtaining a media file for a thumbnail of an image to be displayed may be accomplished by obtaining a high dynamic range image or a high dynamic range video. In an example, the high dynamic range image to which the image thumbnail corresponds may be a still image that originates from a format having a high dynamic range image. In another example, the high dynamic range image to which the image thumbnail corresponds may also be derived from a video frame image in the high dynamic range video.
In step S12, the color bitmap format of the high dynamic range image is converted into a specified color bitmap format, wherein the number of bits corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold.
In one possible embodiment, the color bitmap format of the dynamic range image may be converted to a color bitmap format with an increased number of bits of color components, i.e., the color bitmap format of the high dynamic range image is converted to a specified color bitmap format. And the bit number corresponding to the color component in the specified color bitmap format is greater than the threshold value of the specified bit number. It is to be understood that the threshold for the specified number of bits may be the number of bits currently corresponding to a color component in a color map format of a high dynamic range image, and in an example of the present disclosure, the threshold for the specified number of bits may be 8.
In an example, if the number of bits corresponding to the color component in the color bitmap format of the high dynamic range image is 8, the color bitmap format of the high dynamic range image can be converted into the high dynamic range image with the number of bits corresponding to the color component in the color bitmap format being 10 through the color bitmap format conversion of the high dynamic range image.
It should be noted that the threshold of the designated bit number may also be a preset value, and the threshold of the designated bit number may be adjusted according to actual situations.
In one example, the number of bits corresponding to a color component in the color map format of the high dynamic range image may be 10, 16, or 32 after color map format conversion. The bit number corresponding to the color component in the color map format of the high dynamic range image after the color map format conversion can be adjusted according to the actual situation, and in the disclosure, the bit number corresponding to the color component in the color map format of the high dynamic range image after the color map format conversion is not specifically limited.
As a possible embodiment, the number of bits corresponding to the color component in the color map format of the high dynamic range image after color map format conversion may be 10. On one hand, through color map format conversion, the bit number corresponding to the color component in the color map format of the high dynamic range image can be expanded from 8 to 10, and for any color component, the number that can be expressed is 28256 to 210Therefore, the richness of the high dynamic range image subjected to color map format conversion can be increased, and the display effect of the image thumbnail of the high dynamic range image can be prevented from being grayed to a certain extent. On the other hand, the bit number corresponding to the color component in the color map format of the dynamic range image is set to 10, and compared with the bit number set to 16 or 32, the occupation of system resources can be reduced, so that the running speed of the system is prevented from being influenced, and the experience and satisfaction of a user in the using process are improved.
In step S13, based on the designated color bitmap format, a color bitmap for displaying an image thumbnail is generated and the image thumbnail is displayed.
In the process of displaying the image, the picture of the image can be displayed according to the color bitmap corresponding to the image. Therefore, in displaying the image thumbnail of the high dynamic range image, it is also necessary to first generate a color bitmap of the high dynamic range image.
In an application process, a color bitmap for displaying an image thumbnail may be generated based on a specified color bitmap format. It should be noted that, because the bit number corresponding to the color component in the color bitmap format can satisfy that the image with the color bitmap format can display richer colors, the color bitmap for displaying the image thumbnail generated based on the designated color bitmap format can also have richer colors, thereby making the image color of the displayed image thumbnail richer.
The color bitmap format of the high dynamic range image of the image thumbnail to be displayed is converted into the designated color bitmap format, the bit number corresponding to the color component in the designated color bitmap format is greater than the threshold value of the designated bit number, so that the color bitmap for displaying the image thumbnail is generated and displayed based on the designated color bitmap format, the color richness of the displayed image thumbnail is increased, and the finally displayed image thumbnail can be ensured to be richer in image color and meet the color richness requirement of the high dynamic range image, so that the thumbnail of the high dynamic range image can be normally displayed, and the experience and satisfaction of a user in the using process are increased.
The present disclosure will explain a process of generating a color bitmap based on a specified color bitmap format according to the following embodiments.
Fig. 2 shows a flowchart for generating a color bitmap based on a specified color bitmap format in an image thumbnail display method.
In an exemplary embodiment of the present disclosure, generating a color bitmap based on a specified color bitmap format may include steps S21 and S22, which will be described separately below.
In step S21, metadata of the high dynamic range image after conversion into the specified color bitmap format is acquired and encapsulated in a video frame.
In step S22, a color bitmap is generated based on the metadata in the video frame.
During application, metadata of the high dynamic range image after conversion into a specified color bitmap format (e.g., the number of bits corresponding to a color component in the color bitmap format may be 10) may be obtained and encapsulated in a video frame. Further, based on the metadata encapsulated in the video frame, a color bitmap of the high dynamic range image that has been converted into a specified color bitmap format is generated. Wherein the generated color bitmap of the high dynamic range image converted into the specified color bitmap format may lay the foundation for ensuring that the displayed image thumbnail image is more colorful.
It should be noted that, since the high dynamic range image corresponds to the specific color gamut BT2020, after the color bitmap format of the high dynamic range image is converted into the designated color bitmap format, the color gamut corresponding to the high dynamic range image and the image thumbnail of the high dynamic range image is still the color gamut BT2020. The range outlined by the dotted line of the color gamut horseshoe diagram shown in fig. 3 is the range of the color gamut BT2020.
The present disclosure will explain a process of generating a color bitmap based on metadata in a video frame according to the following embodiments.
Fig. 4 shows a flowchart for generating a color bitmap based on metadata in a video frame in an image thumbnail display method.
In an exemplary embodiment of the present disclosure, as shown in fig. 4, generating a color bitmap based on metadata in a video frame may include steps S31 and S32. The steps will be described separately below.
In step S31, pixel metadata specifying a frame at a specified time is acquired from the video frame by the frame index.
In step S32, a color bitmap is generated based on the pixel metadata.
In the disclosed embodiment, pixel metadata of a frame at a specified time can be specified in a video frame by a frame index, and a color bitmap can be generated based on the pixel metadata. In one example, pixel metadata for a given frame at a given time may be obtained from a video frame (VideoFrame) via getFrameAtIndex/getFrameAtTime.
It is understood that, during the application process, any video frame image in a segment of high dynamic range video may be acquired, for example, the 59 th frame video frame image in the high dynamic range video may be acquired, and the video frame image displayed in the 40 th frame in the high dynamic range video may also be acquired. In one example, the image color of the image thumbnail of the video frame image representing the whole high-dynamic video is enriched by acquiring the pixel metadata of the video frame image and generating the color bitmap based on the pixel metadata, so that the experience and satisfaction of the user in the using process are increased.
Through the embodiment of the disclosure, the thumbnail of any video frame image in the high dynamic video can be selected to represent the whole high dynamic range video. Because the image color displayed by the image thumbnail of any video frame image is richer, the real scene can be relatively vividly reproduced, and the display is not limited to the display of the image thumbnail of a specific video frame image, so that the flexibility and the expansibility in the application process are improved.
As described above, since the high dynamic range image corresponds to the specific color gamut BT2020, after the color bitmap format of the high dynamic range image is converted into the specified color bitmap format, the color gamut corresponding to the high dynamic range image and the image thumbnail of the high dynamic range image is still the color gamut BT2020. Since the final image displayed by the system is realized by the normal color gamut SRGB, if the high dynamic range image converted into the designated color bitmap format is not subjected to the color gamut conversion, the display effect of the image thumbnail of the high dynamic range image will be affected. Wherein, the range framed by the dotted line of the color gamut horseshoe diagram shown in fig. 3 is the range of the color gamut BT 2020; the range framed by the solid line of the color gamut horseshoe diagram shown in fig. 3 is the range of the normal color gamut SRGB.
In order to secure the display effect of the image thumbnail of the high dynamic range image, the present disclosure will explain an image thumbnail display method by the following embodiments.
Fig. 5 is a flowchart illustrating another image thumbnail display method according to an exemplary embodiment.
In an exemplary embodiment of the present disclosure, as shown in fig. 5, the image thumbnail display method includes steps S41 through S44. The respective steps will be explained below.
In step S41, the media file of the image thumbnail to be displayed is acquired. The media files comprise high dynamic range images corresponding to the image thumbnails.
In step S42, the color bitmap format of the high dynamic range image is converted into a specified color bitmap format, wherein the number of bits corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold.
In step S43, if the color gamut of the high dynamic range image does not match the color gamut of the image thumbnail display, the color gamut of the high dynamic range image is converted into the color gamut of the image thumbnail display.
In step S44, based on the designated color bitmap format, a color bitmap for displaying an image thumbnail is generated and the image thumbnail is displayed.
Step S41, step S42, and step S44 are the same as step S11 to step S13 in the previous embodiment, and for explanation, description, and beneficial effects thereof, please refer to the description of step S11 to step S13, which is not repeated herein. Step S43 will be described in detail below.
After the color bitmap format of the high dynamic range image is converted into the designated color bitmap format, the color gamut corresponding to the high dynamic range image and the image thumbnail of the high dynamic range image is still the color gamut BT2020, and if the image thumbnail of the high dynamic range image subjected to the color bitmap format conversion is directly displayed, the situation that the image component in the image thumbnail is reduced may occur, and the display effect of the image thumbnail is poor.
In one possible embodiment, after the color bitmap format of the high dynamic range image is converted into the designated color bitmap format, it is further determined whether the color gamut of the high dynamic range image subjected to the color bitmap format conversion is consistent with the color gamut displayed by the image thumbnail. In an example, if the color gamut displayed by the image thumbnail is the normal color gamut SRGB, and the normal color gamut SRGB is different from the color gamut BT2020 of the high dynamic range image, the color gamut of the high dynamic range image (the color gamut BT2020) needs to be converted into the color gamut of the image thumbnail display (the normal color gamut SRGB), and then a color bitmap for displaying the image thumbnail is generated based on the designated color bitmap format and the image thumbnail is displayed.
In another possible embodiment, after the color bitmap format of the high dynamic range image is converted into the designated color bitmap format, and the color gamut of the high dynamic range image converted into the color bitmap format is determined to be consistent with the color gamut displayed by the image thumbnail, the color bitmap for displaying the image thumbnail may be generated and the image thumbnail may be displayed based on the designated color bitmap format without converting the color gamut of the high dynamic range image converted into the color bitmap format.
According to the embodiment of the disclosure, the color gamut of the high dynamic range image after being converted by the color bitmap format is judged, and if the color gamut of the high dynamic range image is consistent with the color gamut displayed by the image thumbnail, the color bitmap for displaying the image thumbnail can be generated and the image thumbnail can be displayed based on the specified color bitmap format; if the color gamut of the high dynamic range image is not consistent with the color gamut displayed by the image thumbnail, the color gamut of the high dynamic range image needs to be converted into the color gamut displayed by the image thumbnail, and then a color bitmap for displaying the image thumbnail is generated and the image thumbnail is displayed based on the specified color bitmap format. Through the implementation mode disclosed by the invention, the displayed image thumbnail can be ensured to have clearer light and shade levels and richer image colors, and a real scene can be more vividly reproduced, so that the experience and satisfaction of a user in the use process are improved.
It should be noted that, in the process of converting the color bitmap format of the high dynamic range image into the designated color bitmap format, a specific port is often required to implement the conversion, so as to ensure the accurate and efficient conversion of the color bitmap format of the high dynamic range image into the designated color bitmap format.
The present disclosure will explain a process of converting a color bitmap format of a high dynamic range image into a specified color bitmap format by the following embodiments.
In one possible embodiment of the present disclosure, converting the color bitmap format of the high dynamic range image to the specified color bitmap format may be accomplished by: the color bitmap format of the high dynamic range image is converted to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
During the application process, a new interface may be created. Wherein the created new interface has the ability to generate a specified color bitmap format. For example, the specified color bitmap format may be RGBA _1010102, that is, the size of R, G, B color component and alpha component represented by a pixel point, where R is 10bit, G is 10bit, B is 10bit, and a is 2 bit. During the application process, the created new interface can inform the underlying coding part, convert the color bitmap format of the high dynamic range image into a specified color bitmap format, and encapsulate the high dynamic range image into a video frame.
In one example, the created interface (i.e., the new interface) corresponding to the specified color bitmap format may be an existing interface of the system, but the interface is not currently provided to the application developer, and therefore, during the application process, the interface needs to be updated first to ensure that the specified color bitmap format generated by the interface can be called by the system.
The embodiments of the present disclosure will be described below with reference to practical applications.
Fig. 6 is a diagram showing the display effect of an image thumbnail of a current high dynamic range image.
In a possible embodiment, a media file of an image thumbnail to be displayed is obtained, where the media file may be a certain video frame image in a segment of high dynamic range video, and it should be noted that the video frame image is a high dynamic range image. If the image thumbnail of the video frame image is directly displayed, the screen will appear grayish, as shown in fig. 6, which results in poor user experience.
In order to solve the above problem, the color bitmap format of the acquired high dynamic range image may be converted into a specified color bitmap format. Taking the example that the bit number corresponding to the color component in the color bitmap format of the high dynamic range image is 8, in the application process, the color bitmap format of the high dynamic range image may be converted, so that the bit number corresponding to the color component in the color bitmap format of the converted high dynamic range image is 10. At this time, the number of any color component in the color bitmap format of the converted high dynamic range image that can be represented may satisfy the possibility that the image thumbnail of the high dynamic range image has a normal display.
Further, in order to better ensure that the displayed image thumbnail of the high dynamic range image has clearer light and shade gradation and richer image colors, and further can more vividly reproduce a real scene, the color gamut judgment can be carried out on the high dynamic range image after being converted by the color bitmap format, and if the color gamut of the high dynamic range image is consistent with the color gamut displayed by the image thumbnail, the color bitmap for displaying the image thumbnail can be directly generated based on the specified color bitmap format and the image thumbnail is displayed; if the color gamut of the high dynamic range image is not consistent with the color gamut displayed by the image thumbnail, the color gamut of the high dynamic range image needs to be converted into the color gamut displayed by the image thumbnail, and then a color bitmap for displaying the image thumbnail is generated and the image thumbnail is displayed based on the specified color bitmap format.
Wherein the conversion of the color gamut of the high dynamic range image can be achieved by the following embodiments.
In the application process, the pixel metadata of the specified frame at the specified time may be obtained according to the frame index, that is, the pixel metadata of the specified frame at the specified time may be obtained from the video frame (VideoFrame) through getframeattandex/getframeattattime. And saves the pixel metadata to a temporary variable mTemp. In one example, gamut conversion for high dynamic range images may be achieved by gamut converting temporary variables. In one possible embodiment, the transformation matrix may be derived from matrix (1) and matrix (2): mBt2020ToSrgb ═ mxzyztosrgb ═ mBt2020 ToXyz. Wherein, the matrix (1) is mBt2020ToXyz ═ mat4(bt2020. getgbtoxyz ()); matrix (2) is mxyzztosrgb ═ mat4(srgb.
In an example, the temporary variable mTemp may be gamut converted based on a conversion matrix, i.e., mTemp ═ mBt2020ToSrgb @ mTemp. At this time, the gamut conversion for the high dynamic range image is completed.
Further, on the premise that the gamut conversion of the high dynamic range image is completed, a color bitmap for displaying an image thumbnail is generated and the image thumbnail is displayed based on the specified color bitmap format. In an example, the above mTemp metadata after completion of the gamut conversion may be sent to a bitmap. The display effect of the image thumbnail of the high dynamic range image after the image thumbnail display method according to the present embodiment is applied is shown in fig. 7.
As can be seen from the above description, the present disclosure provides an image thumbnail display method by converting a color bitmap format of a high dynamic range image of an image thumbnail to be displayed into a specified color bitmap format, and generating a color bitmap for displaying the image thumbnail based on the specified color bitmap format and displaying the image thumbnail. Because the bit number corresponding to the color component in the designated color bitmap format is greater than the threshold value of the designated bit number, the color richness of the image thumbnail to be displayed after the color bitmap format conversion is ensured to be increased, the bright-dark level of the finally displayed image thumbnail is ensured to be clearer, the image color is richer, the real scene can be more vividly reproduced, and the experience and satisfaction of a user in the using process are increased.
Based on the same concept, the embodiment of the present disclosure also provides an image thumbnail display apparatus.
It is to be understood that the image thumbnail display apparatus provided in the embodiments of the present disclosure includes hardware structures and/or software modules corresponding to the respective functions in order to implement the functions described above. The disclosed embodiments can be implemented in hardware or a combination of hardware and computer software, in combination with the exemplary elements and algorithm steps disclosed in the disclosed embodiments. Whether a function is performed in hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
Fig. 8 is a block diagram illustrating an image thumbnail display apparatus according to an exemplary embodiment.
In an exemplary embodiment of the present disclosure, as shown in fig. 8, the image thumbnail display apparatus includes an acquisition module 110, a processing module 120, and a generation module 130. Each module will be described separately below.
The acquisition module 110 may be configured to: and acquiring a media file of the image thumbnail to be displayed, wherein the media file comprises a high dynamic range image corresponding to the image thumbnail.
The processing module 120 may be configured for: and converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a threshold value of the specified bit number.
The generation module 130 may be configured for: based on the designated color bitmap format, a color bitmap for displaying the image thumbnail is generated and the image thumbnail is displayed.
In an exemplary embodiment of the present disclosure, the generating module 130 may be configured to generate the color bitmap based on the specified color bitmap format in the following manner: acquiring metadata of the high dynamic range image converted into a specified color bitmap format, and packaging the metadata in a video frame; a color bitmap is generated based on metadata in the video frame.
In an exemplary embodiment of the present disclosure, the generating module 130 may be configured to generate the color bitmap based on the metadata in the video frame in the following manner: acquiring pixel metadata of a specified frame at a specified time from a video frame according to a frame index; a color bitmap is generated based on the pixel metadata.
In an exemplary embodiment of the present disclosure, the image thumbnail display apparatus further includes a conversion module. The conversion module will be described in detail below.
The conversion module may be configured to: in response to the color gamut of the high dynamic range image not coinciding with the color gamut of the image thumbnail display, the color gamut of the high dynamic range image is converted to the color gamut of the image thumbnail display.
In an exemplary embodiment of the present disclosure, the processing module 120 may be configured to convert the color bitmap format of the high dynamic range image into the specified color bitmap format in the following manner: the color bitmap format of the high dynamic range image is converted to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
In an exemplary embodiment of the present disclosure, the obtaining module 110 may be configured to obtain a media file of an image thumbnail to be displayed in the following manner: and acquiring a high dynamic range image or a high dynamic range video of the image thumbnail to be displayed.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 9 is a block diagram illustrating an apparatus 200 for image thumbnail display according to an exemplary embodiment. For example, the apparatus 200 for image thumbnail display may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 9, the apparatus 200 for image thumbnail display may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input/output (I/O) interface 212, a sensor component 214, and a communication component 216.
The processing component 202 can generally control overall operation of the apparatus 200 for image thumbnail display, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or a portion of the steps of the image thumbnail display method described above. Further, the processing component 202 can include one or more modules that facilitate interaction between the processing component 202 and other components. For example, the processing component 202 can include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
The memory 204 may be configured to store various types of data to support operations at the apparatus 200 for image thumbnail display. Examples of such data may include instructions for any application or method operating on the apparatus for image thumbnail display 200, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 204 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 206 may provide power to various components of the apparatus 200 for image thumbnail display. The power components 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the apparatus 200 for display of image thumbnails.
The multimedia component 208 may include a screen providing an output interface between the apparatus for image thumbnail display 200 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel may include one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 may include a front facing camera and/or a rear facing camera. When the apparatus for image thumbnail display 200 is in an operation mode, such as a photographing mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 210 may be configured to output and/or input audio signals. For example, the audio component 210 may include a Microphone (MIC) that may be configured to receive an external audio signal when the apparatus 200 for image thumbnail display is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 may also include a speaker for outputting audio signals.
The I/O interface 212 may provide an interface between the processing component 202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 214 can include one or more sensors that can be used to provide various aspects of status assessment for the apparatus 200 for image thumbnail display. For example, the sensor component 214 can detect an open/closed state of the apparatus 200 for image thumbnail display, a relative positioning of components, such as a display and a keypad of the apparatus 200 for image thumbnail display, a change in position of the apparatus 200 for image thumbnail display or a component of the apparatus 200 for image thumbnail display, the presence or absence of user contact with the apparatus 200 for image thumbnail display, orientation or acceleration/deceleration of the apparatus 200 for image thumbnail display, and a change in temperature of the apparatus 200 for image thumbnail display. The sensor assembly 214 may include a proximity sensor that may be configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, which may be used in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 216 may be configured to facilitate communication between the apparatus 200 for image thumbnail display and other devices in a wired or wireless manner. The apparatus 200 for image thumbnail display may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an example embodiment, the communication component 216 may receive a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 can further include a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 200 for image thumbnail display may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements for performing the above-described image thumbnail display method.
In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 204, is also provided that includes instructions executable by the processor 220 of the apparatus for image thumbnail display 200 to perform the image thumbnail display method described above. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is understood that "a plurality" in this disclosure means two or more, and other words are analogous. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. The singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It will be further understood that the terms "first," "second," and the like are used to describe various information and that such information should not be limited by these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the terms "first," "second," and the like are fully interchangeable. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.
It will be further understood that the terms "central," "longitudinal," "lateral," "front," "rear," "upper," "lower," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used herein to denote orientations and positional relationships, based on the orientation or positional relationship shown in the drawings, and are used merely to facilitate description of the embodiments and to simplify the description, but do not indicate or imply that the referenced devices or elements must be constructed and operated in a specific orientation.
In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are only a subset of the embodiments of the present disclosure, and not all embodiments. The embodiments described above by reference to the drawings are exemplary and intended to be illustrative of the present disclosure, and should not be construed as limiting the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure. The embodiments of the present disclosure are described in detail above with reference to the accompanying drawings.
It will be further understood that, unless otherwise specified, "connected" includes direct connections between the two without the presence of other elements, as well as indirect connections between the two with the presence of other elements.
It will be further appreciated that while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. An image thumbnail display method characterized by comprising:
acquiring a media file of an image thumbnail to be displayed, wherein the media file comprises a high dynamic range image corresponding to the image thumbnail;
converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold value;
acquiring metadata of the high dynamic range image converted into the designated color bitmap format, and encapsulating the metadata in a video frame;
acquiring pixel metadata of a specified frame at specified time from the video frame according to a frame index;
generating a color bitmap for displaying the image thumbnail based on the pixel metadata and displaying the image thumbnail.
2. The image thumbnail display method according to claim 1, wherein before generating a color bitmap for displaying the image thumbnail based on the designated color bitmap format, the image thumbnail display method further comprises:
and if the color gamut of the high dynamic range image is not consistent with the color gamut displayed by the image thumbnail, converting the color gamut of the high dynamic range image into the color gamut displayed by the image thumbnail.
3. The image thumbnail display method according to claim 1, wherein said converting the color bitmap format of the high dynamic range image into a specified color bitmap format comprises:
converting the color bitmap format of the high dynamic range image to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
4. The image thumbnail display method according to claim 1, wherein said acquiring the media file of the image thumbnail to be displayed comprises:
and acquiring a high dynamic range image or a high dynamic range video of the image thumbnail to be displayed.
5. An image thumbnail display apparatus characterized by comprising:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a media file of an image thumbnail to be displayed, and the media file comprises a high dynamic range image corresponding to the image thumbnail;
the processing module is used for converting the color bitmap format of the high dynamic range image into a specified color bitmap format, wherein the bit number corresponding to the color component in the specified color bitmap format is greater than a specified bit number threshold value;
the generating module is used for acquiring the metadata of the high dynamic range image after being converted into the specified color bitmap format and packaging the metadata into a video frame; acquiring pixel metadata of a specified frame at specified time from the video frame according to a frame index; and generating a color bitmap for displaying the image thumbnail based on the pixel metadata and displaying the image thumbnail.
6. The image thumbnail display device according to claim 5, further comprising:
and the conversion module is used for responding to the inconsistency between the color gamut of the high dynamic range image and the color gamut displayed by the image thumbnail and converting the color gamut of the high dynamic range image into the color gamut displayed by the image thumbnail.
7. The image thumbnail display apparatus according to claim 5, wherein said processing module is configured to convert a color bitmap format of said high dynamic range image into a specified color bitmap format in the following manner:
converting the color bitmap format of the high dynamic range image to a specified color bitmap format based on an interface corresponding to the specified color bitmap format.
8. The image thumbnail display apparatus according to claim 5, wherein said obtaining module is configured to obtain the media file of the image thumbnail to be displayed in the following manner:
and acquiring a high dynamic range image or a high dynamic range video of the image thumbnail to be displayed.
9. An image thumbnail display apparatus characterized by comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: the image thumbnail display method according to any one of claims 1 to 4 is executed.
10. A non-transitory computer-readable storage medium having instructions therein, which when executed by a processor of a mobile terminal, enable the mobile terminal to perform the image thumbnail display method of any one of claims 1 through 4.
CN202010889251.5A 2020-08-28 2020-08-28 Image thumbnail display method, image thumbnail display device, and storage medium Active CN112188179B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010889251.5A CN112188179B (en) 2020-08-28 2020-08-28 Image thumbnail display method, image thumbnail display device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010889251.5A CN112188179B (en) 2020-08-28 2020-08-28 Image thumbnail display method, image thumbnail display device, and storage medium

Publications (2)

Publication Number Publication Date
CN112188179A CN112188179A (en) 2021-01-05
CN112188179B true CN112188179B (en) 2022-07-08

Family

ID=73924843

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010889251.5A Active CN112188179B (en) 2020-08-28 2020-08-28 Image thumbnail display method, image thumbnail display device, and storage medium

Country Status (1)

Country Link
CN (1) CN112188179B (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101082992A (en) * 2007-07-06 2007-12-05 浙江大学 Drawing of real time high dynamic range image and display process
JP2014204175A (en) * 2013-04-01 2014-10-27 キヤノン株式会社 Image processing apparatus and control method thereof
JP6302600B2 (en) * 2014-09-26 2018-03-28 ドルビー ラボラトリーズ ライセンシング コーポレイション Coding and decoding perceptually quantized video content
JP2018107664A (en) * 2016-12-27 2018-07-05 キヤノン株式会社 Image processing device, image processing method, imaging apparatus, and program
JP7086587B2 (en) * 2017-02-24 2022-06-20 インターデジタル ヴイシー ホールディングス， インコーポレイテッド Method and device for reconstructing image data from decoded image data

Also Published As

Publication number Publication date
CN112188179A (en) 2021-01-05

Similar Documents

Publication Publication Date Title
CN109345485B (en) Image enhancement method and device, electronic equipment and storage medium
US20210058595A1 (en) Method, Device, and Storage Medium for Converting Image
CN106710540B (en) Liquid crystal display method and device
WO2021036991A1 (en) High dynamic range video generation method and device
CN110958401B (en) Super night scene image color correction method and device and electronic equipment
US20220094846A1 (en) Method for selecting image based on burst shooting and electronic device
KR102617258B1 (en) Image processing method and apparatus
US20240129620A1 (en) Video Shooting Method and Electronic Device
JP2018509663A (en) Image type identification method, apparatus, program, and recording medium
US10204403B2 (en) Method, device and medium for enhancing saturation
EP4318383A1 (en) Video processing method and apparatus
CN110619610B (en) Image processing method and device
CN105528765A (en) Method and device for processing image
CN111338743B (en) Interface processing method and device and storage medium
CN114067003A (en) Color gamut conversion method and device, electronic equipment and storage medium
CN106375787B (en) Video playing method and device
CN116668862B (en) Image processing method and electronic equipment
CN106612425B (en) Image adjusting method and terminal device
CN112188179B (en) Image thumbnail display method, image thumbnail display device, and storage medium
CN116048323B (en) Image processing method and electronic equipment
CN118018835A (en) Image capturing method, image capturing device, image capturing apparatus, and storage medium
CN111835977B (en) Image sensor, image generation method and device, electronic device, and storage medium
CN117119316B (en) Image processing method, electronic device, and readable storage medium
CN116017171B (en) Image processing method and device, electronic equipment, chip and storage medium
CN118118789A (en) Image generation method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant