WO2024109207A1

WO2024109207A1 - Method for displaying thumbnail, and electronic device

Info

Publication number: WO2024109207A1
Application number: PCT/CN2023/114173
Authority: WO
Inventors: 许集润
Original assignee: 荣耀终端有限公司
Priority date: 2022-11-22
Filing date: 2023-08-22
Publication date: 2024-05-30
Also published as: CN116668837A; CN118433524A; CN116668837B

Abstract

The present application relates to the field of terminals and provides a method for displaying a thumbnail, and an electronic device. The method comprises: displaying a first display interface at a first moment, the first display interface containing a first control, a thumbnail display area and a first preview image; detecting a first operation in respect of the first control, the first operation being used for instructing a start of photographing; in response to the first operation, saving a first thumbnail in a photo album application, and generating a second thumbnail; detecting a second operation in respect of the first control, the second operation being used for instructing an end of photographing; and, in response to the second operation, successively displaying in the thumbnail display area the first thumbnail, the second thumbnail and a third thumbnail, the image quality of the third thumbnail being superior to that of the second thumbnail. The technical solution of the present application can solve the problem of relatively long photographing response time of the electronic device, allowing the electronic device to quickly display the thumbnails.

Description

Method and electronic device for displaying thumbnail images

This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 22, 2022, with application number 202211467867.9 and application name “Method and electronic device for displaying thumbnail images”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the field of terminals, and in particular, to a method and electronic device for displaying thumbnail images.

Background technique

With the development of the camera function in electronic devices, the application of camera applications in electronic devices is becoming more and more widespread. In the camera application, when the electronic device completes a shooting, a thumbnail image will be displayed in the shooting interface; users usually regard the display of the thumbnail image by the electronic device as the end of a shooting; wherein, the image content in the thumbnail image is consistent with the image content of the image actually shot this time, and the image corresponding to the thumbnail image stored in the album can be found according to the thumbnail image; because currently the electronic device will trigger the electronic device to generate thumbnail images and shot images only after the electronic device detects the user's operation of popping up the shooting control; the electronic device cannot display the thumbnail image at the moment of detecting the pop-up shooting control, that is, the time between the electronic device detecting the pop-up shooting control and displaying the thumbnail image is too long; the user's shooting waiting time is long, making the user's shooting experience poor.

Therefore, how to quickly display thumbnail images and shorten the shooting waiting time becomes a problem that needs to be solved urgently.

Summary of the invention

The present application provides a method and electronic device for displaying thumbnail images, which can quickly display thumbnail images and improve shooting experience.

In a first aspect, a method for displaying a thumbnail image is provided, which is applied to an electronic device, comprising:

Displaying a first display interface at a first moment, the first display interface including a first control, a thumbnail display area and a first preview image, wherein the first control is a control for instructing shooting; the thumbnail display area is used to display thumbnail images, the first preview image is an image generated by preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment;

detecting a first operation on the first control, where the first operation is used to instruct to start shooting;

In response to the first operation, a first thumbnail image is saved in an album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image after a first image processing; the second thumbnail image is a thumbnail image generated by the first image after a second image processing, and the first image processing is different from the second image processing;

detecting a second operation on the first control, where the second operation is used to indicate ending shooting;

In response to the second operation, the first thumbnail image, the second thumbnail image and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.

In a possible implementation, the first operation may be an operation of clicking a shooting control, or the first operation may be an operation of instructing shooting through voice; or an operation of instructing to start shooting through other instructions; this application does not impose any limitation on this.

In a possible implementation, the second operation is an operation of popping up a shooting control; or an operation of ending shooting by voice instruction; or an operation of ending shooting by other instructions.

It should be understood that the operation of popping up the shooting control may refer to the operation of the electronic device detecting that the user's finger leaves the shooting control; or the operation of the electronic device detecting that the user's finger releases the shooting control, etc.

In a possible implementation, the image quality may include image detail information, image texture information, image brightness, or an image quality assessment result obtained by any image quality assessment algorithm; the present application does not impose any limitation on this.

In an embodiment of the present application, a shooting operation is divided into a first operation (for example, an operation of clicking a shooting control) and a second operation (for example, an operation of popping up a shooting control); when the electronic device detects the first operation, the electronic device is triggered to save a first thumbnail image (for example, a false thumbnail image) in a camera application and generate a second thumbnail image (for example, a real thumbnail image); when the electronic device detects the second operation, the first thumbnail image, the second thumbnail image, and the third thumbnail image (for example, a thumbnail image obtained based on the captured image) are displayed in sequence in a display area of a display interface; after the second operation is detected, the first thumbnail image is quickly triggered to be displayed; the thumbnail image can be displayed at the moment the electronic device detects the second operation, thereby improving the shooting response speed; reducing the user's shooting waiting time, and improving the shooting experience.

It should be noted that, in an embodiment of the present application, the first thumbnail image, the second thumbnail image and the third thumbnail image may correspond to the same shooting of the user; for the same shooting, the display of the first thumbnail image, the second thumbnail image and the third thumbnail image are mutually exclusive; for example, if the first thumbnail image is displayed in the display interface in the camera application, the second thumbnail image and the third thumbnail image will not be displayed in the display interface; if the second thumbnail image is displayed in the display interface in the camera application, the first thumbnail image and the third thumbnail image will not be displayed in the display interface; if the third thumbnail image is displayed in the display interface in the camera application, the first thumbnail image and the second thumbnail image will not be displayed in the display interface; for example, at time T1, the first thumbnail image is displayed; at time T2, the second thumbnail image is displayed; at time T3, the third thumbnail image is displayed; time T1 is earlier than time T2; time T2 is earlier than time T3.

In combination with the first aspect, in some implementations of the first aspect, the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.

In a possible implementation, the first image processing may include downsampling processing or part of ISP processing; the second image processing may include multi-frame image fusion processing, ISP processing and other software algorithms of image processing.

It should be understood that in the embodiment of the present application, the time required for the first image processing is shorter than the time required for the second image processing.

In some implementations of the first aspect, the first thumbnail image is generated by performing thumbnail processing on the first preview image. For example, the first preview image is scaled based on the size of the thumbnail display area to generate the first thumbnail image.

In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:

In response to the second operation, generating a first captured image;

The first captured image is scaled based on the size of the thumbnail display area to generate the third thumbnail image.

It should be understood that the third thumbnail image is obtained by scaling the first captured image based on the thumbnail display area; Compared with the second thumbnail image, the first captured image does not need to be downsampled; in addition, the first captured image can be an image after fusion processing based on multiple frames of Raw images; therefore, the image quality of the third thumbnail image is better than that of the second thumbnail image.

In an embodiment of the present application, when the electronic device detects the operation of popping up a shooting control, it triggers the electronic device to generate a first captured image, and the first captured image can be a real image taken; by scaling the first captured image, a third thumbnail image can be obtained, that is, a thumbnail image of the first captured image.

In combination with the first aspect, in some implementations of the first aspect, the electronic device includes a storage module, the storage module includes a first storage area, and further includes:

When the electronic device generates the second thumbnail image but does not generate the first captured image, replacing the first thumbnail image in the first storage area with the second thumbnail image;

When the electronic device generates the first captured image, the second thumbnail image in the first storage area is replaced by the first captured image.

In an embodiment of the present application, after generating a second thumbnail image (e.g., a real thumbnail image), the first thumbnail image (e.g., a false thumbnail image) stored in the electronic device is directly replaced by the second thumbnail image. After generating a first captured image (e.g., a captured image), the second thumbnail image (e.g., a real thumbnail image) stored in the electronic device is directly replaced by the first captured image; and the first thumbnail image, the second thumbnail image and the first thumbnail image are directly replaced in an embodiment of the present application, which can reduce the storage space of the electronic device occupied by the thumbnail images.

In a possible implementation manner, scaling is performed on the first preview image to generate the first thumbnail image.

It should be understood that in the embodiments of the present application, since the second thumbnail image is a thumbnail image obtained after image processing based on the Raw image; and the first thumbnail image is a thumbnail image obtained by directly scaling the preview image; since the preview image usually has a lower resolution than the Raw image captured by the image sensor, the image quality of the second thumbnail image is better than the image quality of the first thumbnail image.

In an embodiment of the present application, after the electronic device detects the operation of clicking a shooting control, it can trigger a process of saving a false thumbnail image in an album application; thereby, when the electronic device detects the pop-up shooting control, it can quickly display a false thumbnail image in the display interface to respond to the user's shooting operation; thereby reducing the time the user waits for shooting and improving the user's shooting experience.

Acquire time information when the first operation is detected; and select the first image from a zero-second delay queue in the electronic device based on the time information.

In a possible implementation manner, the time information when the first operation is detected and the first moment may be the same moment.

In combination with the first aspect, in some implementations of the first aspect, the second image processing includes first algorithm processing and second algorithm processing, the first algorithm is an algorithm of a first color space, the second algorithm is an algorithm for converting an image in the first color space into an image in a second color space, and the generating of the first captured image includes:

Processing the first image with the first algorithm to obtain an image in the first color space;

Performing fusion processing on at least two frames of images in the first color space to obtain a fused image;

The fused image is processed by the second algorithm to generate the first captured image.

In a possible implementation, the first algorithm is an algorithm for the Raw color space; the second algorithm converts the Raw image Like the algorithm for converting to YUV color space.

It should be understood that the first captured image may refer to a true image generated by a single photographing operation; compared with generating the second thumbnail image, the first captured image does not need to be downsampled; in addition, the first captured image may be an image after fusion processing based on multiple frames of Raw images; therefore, the image quality of the first captured image is better than the image quality of the second thumbnail image; in addition, the image quality of the third thumbnail image obtained by scaling the first captured image is better than the image quality of the second thumbnail image.

In combination with the first aspect, in some implementations of the first aspect, the first operation is an operation of clicking the first control; and the second operation is an operation of popping up the first control.

In combination with the first aspect, in some implementations of the first aspect, the image quality includes image texture information or image brightness information.

In a second aspect, a method for displaying a thumbnail image is provided, which is applied to an electronic device and includes:

Displaying a first display interface at a first moment, the first display interface including a first control, a thumbnail display area and a first preview image; wherein the first control is a control for instructing shooting; the thumbnail display area is used to display thumbnail images; the first preview image is an image generated by preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment;

In response to the second operation, sequentially displaying the first thumbnail image and the second thumbnail image in the thumbnail display area; and generating a third thumbnail image, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image;

Before generating the third thumbnail image, detecting a third operation on the first control, the third operation being used to instruct starting shooting;

In response to the third operation, a fourth thumbnail image is saved in the photo album application, and a fifth thumbnail image is generated; wherein the fourth thumbnail image is a thumbnail image generated by processing the second image through the first image; the fifth thumbnail image is a thumbnail image generated by processing the second image through the second image; the second image is an image captured in real time by the electronic device at a second moment, and the second moment is later than the first moment;

detecting a fourth operation on the first control, the fourth operation being used to indicate the end of shooting;

In response to the fourth operation, the fourth thumbnail image, the fifth thumbnail image and the sixth thumbnail image are sequentially displayed in the thumbnail display area, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.

It should be understood that the first thumbnail image, the second thumbnail image and the third thumbnail image correspond to the first photographing operation; the fourth thumbnail image, the fifth thumbnail image and the sixth thumbnail image correspond to the second photographing operation; the photographing times of the two photographing operations are different; wherein the first thumbnail image may be a false thumbnail image of the first photographing operation; the second thumbnail image is a real thumbnail image of the first photographing operation; the third thumbnail image is a thumbnail image generated based on the actual photographed image of the first photographing operation; the fourth thumbnail image may be a false thumbnail image of the second photographing operation; the fifth thumbnail image is a real thumbnail ... The sixth thumbnail image is a real thumbnail image of the second photographing operation; and the sixth thumbnail image is a thumbnail image generated based on the actual photographed image of the second photographing operation.

In combination with the second aspect, in some implementations of the second aspect, the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.

In combination with the second aspect, in some implementations of the second aspect, generating the third thumbnail image includes:

In response to the second operation, generating a first captured image;

In conjunction with the second aspect, in some implementations of the second aspect, the method further includes:

In response to the fourth operation, generating a second captured image;

The second captured image is scaled based on the size of the thumbnail display area to generate the sixth thumbnail image.

In combination with the second aspect, in certain implementations of the second aspect, the electronic device includes a storage module, the storage module includes a first storage area and a second storage area, the first storage area is used to store the first thumbnail image, the second thumbnail image or the first captured image; the second storage area is used to store the fourth thumbnail image, the fifth thumbnail image or the second captured image; the first storage area and the second storage area are different storage areas in the storage module.

In an embodiment of the present application, a storage module in an electronic device corresponds to one storage area for one shooting. After a false thumbnail image, a real thumbnail image or a shot image of one shooting is generated, replacement storage is performed only in the storage area corresponding to the shooting; different shootings correspond to different storage areas in the cache module.

In conjunction with the second aspect, in some implementations of the second aspect, the present invention further includes:

When the second thumbnail image is generated and the first captured image is not generated, replacing the first thumbnail image in the first storage area with the second thumbnail image;

When the first photographed image is generated, the second thumbnail image in the first storage area is replaced by the first photographed image.

When the fifth thumbnail image is generated and the second captured image is not generated, replacing the fourth thumbnail image in the second storage area with the fifth thumbnail image;

When the second photographed image is generated, the fifth thumbnail image in the second storage area is replaced by the second photographed image.

In combination with the second aspect, in some implementations of the second aspect, the first operation and the third operation are operations of clicking the first control; and the second operation and the fourth operation are operations of popping up the first control.

In combination with the second aspect, in some implementations of the second aspect, the image quality includes image texture information or image brightness information.

In a third aspect, an electronic device is provided, the electronic device comprising one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute:

A first display interface is displayed at a first moment, wherein the first display interface includes a first control, a thumbnail display area, and a first preview image; wherein the first control is a control for indicating shooting; the thumbnail display area for displaying thumbnail images; the first preview image is an image generated by preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment;

In combination with the third aspect, in certain implementations of the third aspect, the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.

In combination with the third aspect, in some implementations of the third aspect, the one or more processors call the computer instructions to cause the electronic device to execute:

In response to the second operation, generating a first captured image;

In combination with the third aspect, in some implementations of the third aspect, the electronic device includes a storage module, the storage module includes a first storage area, and the one or more processors call the computer instructions to cause the electronic device to execute:

Acquire time information when the first operation is detected;

The first image is selected from a zero-second delay queue in the electronic device based on the time information.

In combination with the third aspect, in some implementations of the third aspect, the second image processing includes a first algorithm processing and a second algorithm processing, and the one or more processors call the computer instructions to cause the electronic device to execute:

Processing the first image with a first algorithm to obtain an image in a first color space;

The fused image is processed by a second algorithm to generate the first captured image.

In combination with the third aspect, in some implementations of the third aspect, the first operation is an operation of clicking the first control; and the second operation is an operation of popping up the first control.

In combination with the third aspect, in some implementations of the third aspect, the image quality includes image texture information or image brightness information.

In a fourth aspect, an electronic device is provided, the electronic device comprising one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute:

In response to the third operation, a fourth thumbnail image is saved in the album application, and a fifth thumbnail image is generated; wherein the fourth thumbnail image is a thumbnail image generated by processing the second image through the first image; the fifth thumbnail image is a thumbnail image generated by processing the second image through the second image; the second image is an image captured in real time by the electronic device at a second moment, and the second moment is later than the first moment;

In combination with the fourth aspect, in certain implementations of the fourth aspect, the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.

In conjunction with the fourth aspect, in some implementations of the fourth aspect, the one or more processors call the computer instructions to cause the electronic device to execute:

In response to the second operation, generating a first captured image;

In response to the fourth operation, generating a second captured image;

In conjunction with the fourth aspect, in some implementations of the fourth aspect, the electronic device includes a storage module. The storage module includes a first storage area and a second storage area, the first storage area is used to store the first thumbnail image, the second thumbnail image or the first captured image; the second storage area is used to store the fourth thumbnail image, the fifth thumbnail image or the second captured image; the first storage area and the second storage area are different storage areas in the storage module.

In combination with the fourth aspect, in some implementations of the fourth aspect, the first operation and the third operation are operations of clicking the first control; and the second operation and the fourth operation are operations of popping up the first control.

In combination with the fourth aspect, in certain implementations of the fourth aspect, the image quality includes image texture information or image brightness information.

According to a fifth aspect, an electronic device is provided, comprising a module/unit for executing the method for displaying thumbnail images according to the first aspect or any one of the implementations of the first aspect.

In a sixth aspect, an electronic device is provided, comprising a module/unit for executing the method for displaying thumbnail images in the second aspect or any one of the implementations of the second aspect.

In the seventh aspect, an electronic device is provided, comprising one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method for displaying thumbnail images in any aspect or any implementation of any aspect.

In an eighth aspect, a chip system is provided, which is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any aspect or any one of the methods for displaying thumbnail images in any aspect.

In a ninth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an electronic device, the electronic device executes the method for displaying thumbnail images in any aspect or any implementation of any aspect.

In a tenth aspect, a computer program product is provided, comprising: a computer program code, which, when executed by an electronic device, enables the electronic device to execute the method for displaying thumbnail images in any aspect or any implementation of any aspect.

In the embodiment of the present application, the shooting operation is divided into a first operation (for example, the operation of clicking the shooting control) and a second operation (for example, the operation of popping up the shooting control); when the electronic device detects the first operation, the trigger The electronic device saves a first thumbnail image (e.g., a false thumbnail image) in a camera application and generates a second thumbnail image (e.g., a real thumbnail image); when the electronic device detects a second operation, the first thumbnail image, the second thumbnail image, and the third thumbnail image (e.g., thumbnail images obtained based on captured images) are sequentially displayed in a display area of the display interface; after the second operation is detected, the first thumbnail image is quickly triggered to be displayed; the thumbnail image can be displayed at the moment the electronic device detects the second operation, thereby improving the speed of shooting response; reducing the user's shooting waiting time and improving the shooting experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a hardware system of an electronic device applicable to the present application;

FIG2 is a schematic diagram of an application scenario applicable to an embodiment of the present application;

FIG3 is a schematic flow chart of a method for displaying thumbnail images provided in an embodiment of the present application;

FIG4 is a schematic flow chart of another method for displaying thumbnail images provided in an embodiment of the present application;

FIG5 is a schematic diagram of a software architecture provided in an embodiment of the present application;

FIG6 is a schematic diagram of a graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG7 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG8 is a schematic diagram of another graphical user interface provided by an embodiment of the present application and applicable to an embodiment of the present application;

FIG9 is a schematic diagram of another software architecture provided in an embodiment of the present application;

FIG10 is a schematic diagram of a graphical user interface applicable to an embodiment of the present application;

FIG11 is a schematic diagram of another graphical user interface applicable to an embodiment of the present application;

FIG12 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG13 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG14 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG15 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG16 is a schematic diagram of another graphical user interface provided in an embodiment of the present application and applicable to an embodiment of the present application;

FIG17 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

FIG. 18 is a schematic diagram of the structure of another electronic device provided in an embodiment of the present application.

Detailed ways

In the embodiments of the present application, the following terms "first", "second", etc. are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present embodiment, unless otherwise specified, "multiple" means two or more.

In order to facilitate the understanding of the embodiments of the present application, the relevant concepts involved in the embodiments of the present application are first briefly described.

1. Thumbnail images

A thumbnail image refers to an image with a smaller resolution cached in an electronic device. The image quality of a thumbnail image is poorer than that of a captured image. Compared with the captured image in the electronic device, the resolution of the thumbnail image is smaller. Optionally, the thumbnail image in the shooting interface can be indexed to the actual captured image in the album.

2. Zero shutter lag (ZSL) queue

Before taking a picture, an electronic device usually displays an image of the picture to be taken in the electronic device; these displayed images are also called preview images; wherein the electronic device caches the preview images and the actual taken images in chronological order in an image queue, which is called a ZSL queue.

Optionally, the images in the ZSL queue may be Raw images.

FIG. 1 shows a hardware system of an electronic device suitable for the present application.

The electronic device 100 can be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, etc. The embodiment of the present application does not impose any restrictions on the specific type of the electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

It should be noted that the structure shown in FIG1 does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in FIG1, or the electronic device 100 may include a combination of some of the components shown in FIG1, or the electronic device 100 may include sub-components of some of the components shown in FIG1. The components shown in FIG1 may be implemented in hardware, software, or a combination of software and hardware.

Exemplarily, the processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated devices. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile Mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM interface, and USB interface.

Exemplarily, in an embodiment of the present application, the processor 110 may be used to execute a method for displaying thumbnail images provided by an embodiment of the present application; for example, a first display interface is displayed at a first moment, the first display interface including a first control, a thumbnail display area and a first preview image; wherein the first control is a control for indicating shooting; the thumbnail display area is used to display thumbnail images; the first preview image is an image generated by preview processing of a first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment; a first operation on the first control is detected, the first operation is used to indicate starting shooting, and the shooting may include taking a photo; in response to the first operation, the first thumbnail image is saved in an album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image after first image processing; the second thumbnail image is a thumbnail image generated by the first image after second image processing, and the first image processing is different from the second image processing; a second operation on the first control is detected, the second operation is used to indicate ending shooting; in response to the second operation, the first thumbnail image, the second thumbnail image and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.

The connection relationship between the modules shown in Fig. 1 is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of multiple connection modes in the above embodiments.

The wireless communication function of the electronic device 100 can be implemented through components such as the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The electronic device 100 can realize the display function through the GPU, the display screen 194 and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

Display screen 194 may be used to display images or videos.

Optionally, the display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

Exemplarily, the electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

Exemplarily, the ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted to the camera photosensitive element through the camera, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithmic optimization on the noise, brightness and color of the image, and the ISP can also optimize the exposure and color temperature of the shooting scene and other parameters. In some embodiments, the ISP can be set in the camera 193.

Exemplarily, the camera 193 (also referred to as a lens) is used to capture static images or videos. It can be triggered to start by an application program instruction to realize the photo function, such as taking an image of any scene. The camera may include components such as an imaging lens, a filter, and an image sensor. The light emitted or reflected by the object enters the imaging lens, passes through the filter, and finally converges on the image sensor. The imaging lens is mainly used to converge the light emitted or reflected by all objects in the photographing angle (also referred to as the scene to be photographed, the target scene, or the scene image that the user expects to shoot) to form an image; the filter is mainly used to filter out the redundant light waves in the light (for example, light waves other than visible light, such as infrared); the image sensor may be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The image sensor is mainly used to perform photoelectric conversion on the received light signal, convert it into an electrical signal, and then transmit the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, etc. format.

Exemplarily, the digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Exemplarily, a video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

Exemplarily, the gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, the y-axis, and the z-axis) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used in scenarios such as navigation and somatosensory games.

For example, the acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally the x-axis, y-axis, and z-axis). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 180E can also be used to identify the posture of the electronic device 100 as an input parameter for applications such as horizontal and vertical screen switching and pedometers.

Exemplarily, the distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, for example, in a shooting scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

Exemplarily, the ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touch.

Exemplarily, the fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement functions such as unlocking, accessing application locks, taking photos, and answering calls.

For example, the touch sensor 180K is also called a touch control device. The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a touch control screen. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor 180K can transmit the detected touch operation to the touch screen. The touch sensor 180K is passed to the application processor to determine the type of touch event. A visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be arranged on the surface of the electronic device 100 and at a different position from the display screen 194.

Currently, the electronic device is triggered to generate a real thumbnail image and a captured image (for example, a real image) only after it detects that the user has popped up a shooting control. As a result, the electronic device is unable to display the thumbnail image at the moment when the shooting control is detected to have been popped up, that is, the time between the electronic device detecting that the shooting control has been popped up and displaying the thumbnail image is too long. As a result, the user's shooting waiting time is long, resulting in a poor shooting experience for the user.

In view of this, an embodiment of the present application provides a method and an electronic device for displaying thumbnail images; in an embodiment of the present application, by dividing the shooting operation into an operation of clicking a shooting control and an operation of popping up the shooting control, when the electronic device detects the operation of clicking the shooting control, it triggers the electronic device to save a false thumbnail image in an album application and generate a real thumbnail image; wherein, the false thumbnail image refers to a thumbnail image obtained by scaling the preview image; the real thumbnail image refers to a thumbnail image generated after selecting the original image data for image processing; when the electronic device detects the operation of the user popping up the shooting control, it triggers the display of the false thumbnail image; so that the thumbnail image can be displayed at the moment the electronic device detects the operation of popping up the shooting control, thereby improving the shooting response speed; reducing the user's shooting waiting time and improving the shooting experience.

In addition, when the pop-up shooting control is detected, the generation of the shooting image is triggered; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image; after the shooting image is generated, the real thumbnail image can be replaced by the thumbnail image obtained by scaling the shooting image; it can improve the shooting response speed while ensuring the image quality of the thumbnail image.

FIG. 2 is a schematic diagram of an application scenario of the method for displaying thumbnail images provided in an embodiment of the present application.

Exemplarily, after the electronic device runs the camera application, it displays a preview interface 201, as shown in (a) in FIG. 2 ; the preview interface 201 includes a preview image, a thumbnail display control 202 and a shooting control 203, wherein the thumbnail display control 202 is used to display a thumbnail image of the image that was captured last time; at a first moment, the electronic device detects an operation of clicking the shooting control 203, as shown in (b) in FIG. 2 ; at a second moment, the electronic device detects an operation of the user popping up the shooting control 203, and displays a display interface 204, as shown in (c) in FIG. 2 ; the thumbnail image displayed in the thumbnail display control 202 in the display interface 204 is still the thumbnail image of the image that was captured last time; at a third moment, the electronic device displays a display interface 205, and the thumbnail display control 202 in the display interface 205 displays a thumbnail image of the image that was captured this time, as shown in (d) in FIG. 2 .

It should be understood that users usually regard the thumbnail image of the captured image displayed in the display interface as the completion of the shooting. Therefore, since the electronic device cannot display the thumbnail image at the moment of detecting the pop-up shooting control, the user thinks that the shooting response is too slow and the shooting experience is poor.

In an embodiment of the present application, a method for displaying thumbnail images and an electronic device are provided; the method for displaying thumbnail images provided according to the embodiment of the present application can solve the problem of long shooting response time of the electronic device, so that the electronic device can quickly display thumbnail images.

Optionally, the method for displaying thumbnails in the embodiment of the present application can be applied to the shooting mode of the camera application; or, the method for displaying thumbnails in the embodiment of the present application can be applied to the quick shooting mode of the camera application.

It should be noted that the method for displaying thumbnail images in the embodiment of the present application can be applied to night scene shooting in shooting mode, but is not applicable to night scene shooting mode; because in night scene shooting mode, each image obtained by the electronic device A frame of image is obtained by fusing a long exposure image, a normal exposure image and a short exposure image; in an embodiment of the present application, when a click on the shooting control is detected, the electronic device is triggered to generate a false thumbnail image and a real thumbnail image, and when a pop-up shooting control is detected; after the false thumbnail image is displayed in the electronic device, the user may move the electronic device if he thinks that the shooting is completed; however, the short exposure image and the long exposure image may not have been generated at this time; after moving the electronic device, there will be differences in the contents of the short exposure image, the long exposure image and the normal exposure image, resulting in poor image quality; therefore, the method for displaying thumbnail images provided in the embodiment of the present application is not suitable for night scene mode.

It should be understood that the above is an example of an application scenario and does not limit the application scenario of the present application.

The method for displaying thumbnail images provided in the embodiment of the present application is described in detail below in conjunction with Figures 3 to 16.

Fig. 3 is a schematic flow chart of a method for displaying thumbnail images provided by an embodiment of the present application. The method 300 may be executed by the electronic device shown in Fig. 1; the method 300 includes S310 to S350, and S310 to S350 are described in detail below.

S310: Display a first display interface at a first moment.

Among them, the first display interface includes a first control, a thumbnail display area and a first preview image; among them, the first control is a control for indicating shooting; the thumbnail display area is used to display thumbnail images; the first preview image is an image generated after preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment.

Optionally, as shown in Figure 5, the camera module can send the first image captured at the first moment to the preview storage module and the ZSL queue storage module respectively; wherein the preview storage module is used to store preview images, which are images generated by preview processing of the images captured by the camera module; the images stored in the ZSL queue storage module are used to generate actual captured images for taking photos.

Exemplarily, the first display interface may be as shown in (a) of FIG. 6 ; the first control may refer to the control 612 shown in (a) of FIG. 6 ; and the display area may refer to the area where the control 613 shown in (a) of FIG. 6 is located.

Optionally, a camera application may be run before S310 .

For example, the user may instruct the electronic device to run the camera application by clicking the icon of the “Camera” application.

Exemplarily, when the electronic device is in the lock screen state, the user can instruct the electronic device to run the camera application by sliding the gesture to the right on the display screen of the electronic device. Alternatively, the electronic device is in the lock screen state, and the lock screen interface includes an icon of the camera application. The user instructs the electronic device to run the camera application by clicking the icon of the camera application. Alternatively, when the electronic device is running other applications, the application has the permission to call the camera application; the user can instruct the electronic device to run the camera application by clicking the corresponding control. For example, when the electronic device is running an instant messaging application, the user can instruct the electronic device to run the camera application by selecting the control of the camera function.

It should be understood that the above is an example of the operation of running a camera application; the electronic device may also run a camera application through voice instructions or other operations; this application does not impose any limitation on this.

It should also be understood that running the camera application may refer to launching the camera application.

S320: Detect a first operation on a first control.

The first operation is used to instruct to start shooting. The shooting may include taking a photo.

Optionally, the shooting operation may be a photo taking operation.

Exemplarily, as shown in (c) of FIG. 6 , the first operation may be a click operation on the control 612 .

Optionally, in an embodiment of the present application, the above description is given by taking the first operation as a click operation as an example; in an embodiment of the present application, the first operation may also be an operation of shooting through voice instructions; or, an operation of starting shooting through other instructions; the present application does not impose any limitation on this.

S330: In response to the first operation, save the first thumbnail image in the photo album application and generate a second thumbnail image.

The first thumbnail image is a thumbnail image generated by performing a first image processing on the first image; the second thumbnail image is a thumbnail image generated by performing a second image processing on the first image, and the first image processing is different from the second image processing.

Exemplarily, the first thumbnail image may be the thumbnail image displayed in the control 613 in (a) of FIG. 7 ; the second thumbnail image may be the thumbnail image displayed in the control 613 in (c) of FIG. 7 .

In a possible implementation manner, generating the first thumbnail image includes:

The first preview image is scaled to generate a first thumbnail image. The specific implementation method can refer to the related description of the first process 430 in the subsequent FIG. 4, which will not be repeated here.

In an embodiment of the present application, after the electronic device detects the operation of clicking a shooting control, it can trigger a process of saving a false thumbnail image in the album application; thereby, when the electronic device detects the pop-up shooting control, it can quickly display a false thumbnail image in the display interface to respond to the user's shooting operation; thereby reducing the time the user waits for shooting and improving the user's shooting experience.

Optionally, it also includes:

In response to the second operation, a first captured image is generated; and the first captured image is scaled based on the size of the thumbnail display area to generate a third thumbnail image.

It should be understood that the third thumbnail image is obtained by scaling the first captured image based on the thumbnail display area; compared with the second thumbnail image, the first captured image does not need to be downsampled; in addition, the first captured image can be an image based on the fusion of multiple frames of Raw images; therefore, the image quality of the third thumbnail image is better than that of the second thumbnail image.

Optionally, the second image processing includes a first algorithm processing and a second algorithm processing, the first algorithm is an algorithm of the first color space, and the second algorithm is an algorithm for converting an image in the first color space into an image in the second color space, and generating the first captured image includes:

The first image is processed by a first algorithm to obtain an image in a first color space; at least two frames of images in the first color space are fused to obtain a fused image; and the fused image is processed by a second algorithm to generate a first captured image.

Optionally, the specific implementation method can refer to the related description of the second process 440 shown in the subsequent FIG. 4, which will not be described here. Elaborate.

Exemplarily, the first image may be original image data, that is, the first image may be a Raw image; and the first algorithm may include an algorithm in a Raw color space.

For example, the algorithms of the Raw color space may include but are not limited to: black level correction (Black Level Correction, BLC), lens shading correction (Lens Shading Correction, LSC) and other algorithms.

Among them, black level correction is used to correct the black level. Black level refers to the video signal level without a line of light output on a calibrated display device. The reason for black level correction is: on the one hand, due to the dark current of the image sensor, there is a problem of voltage output of the pixel even in the absence of light; on the other hand, due to the insufficient accuracy of the image sensor when performing analog-to-digital conversion. Lens Shading Correction (LSC) is used to eliminate the problem of inconsistent color and brightness around the image and the center of the image caused by the lens optical system.

For example, the second algorithm includes an algorithm for converting a Raw image into a YUV color space.

Optionally, it also includes:

Acquire time information when a first operation is detected; and select a first image from a zero-second delay queue in the electronic device based on the time information.

In an embodiment of the present application, when an operation of clicking a shooting control is detected, the electronic device can be triggered to generate a second thumbnail image, i.e., a real thumbnail image; compared with the existing scheme, in which the process of generating a real thumbnail image is triggered after a pop-up shooting operation is detected, in an embodiment of the present application, the time for triggering the electronic device to generate a real thumbnail image is advanced, thereby reducing the time it takes for the electronic device to respond to shooting; reducing the time the user waits for shooting, and improving the user's shooting experience.

S340: Detect a second operation on the first control.

The second operation is used to indicate the end of shooting.

Exemplarily, the second operation may be an operation of popping up a shooting control, as shown in (a) of FIG. 7 .

Optionally, the above is an example description of the second operation; in an embodiment of the present application, the second operation may also be an operation of ending shooting through voice instructions; or, an operation of ending shooting through other instructions; the present application does not impose any limitation on this.

S350: In response to the second operation, display the first thumbnail image, the second thumbnail image, and the third thumbnail image in sequence in the thumbnail display area.

The image quality of the third thumbnail image is better than that of the second thumbnail image.

It should be noted that, in an embodiment of the present application, the first thumbnail image, the second thumbnail image and the third thumbnail image may correspond to the same shooting of the user; for the same shooting, the display of the first thumbnail image, the second thumbnail image and the third thumbnail image are mutually exclusive; for example, if the first thumbnail image is displayed in the display interface in the camera application, the second thumbnail image and the third thumbnail image will not be displayed in the display interface; if the second thumbnail image is displayed in the display interface in the camera application, the first thumbnail image and the third thumbnail image will not be displayed in the display interface; if the third thumbnail image is displayed in the display interface in the camera application, the first thumbnail image and the second thumbnail image will not be displayed in the display interface; for example, at time T1, the first thumbnail image is displayed; the second thumbnail image is displayed at time T2; and the third thumbnail image is displayed at time T3. Image; time T1 is earlier than time T2; time T2 is earlier than time T3.

Optionally, the electronic device includes a storage module, the storage module includes a first storage area, and further includes:

When the electronic device generates the second thumbnail image and does not generate the first captured image, the first thumbnail image in the first storage area is replaced by the second thumbnail image;

Example 1

When the electronic device detects a shooting operation, that is, the electronic device detects a first operation and a second operation; for example, the electronic device detects an operation of clicking a shooting control and an operation of popping up the shooting control.

Exemplarily, for a single shot, as shown in (a) in FIG. 7 , at time T(12) the first thumbnail image is displayed in the thumbnail control 613, i.e. a false thumbnail image is displayed; as shown in (c) in FIG. 7 , at time T(13) the second thumbnail image is displayed in the thumbnail control 613, i.e. a real thumbnail image is displayed; as shown in (a) in FIG. 8 , at time T(14) the third thumbnail image is displayed in the thumbnail control 613, i.e. a thumbnail image of the captured image is displayed, wherein time T(12) is earlier than time T(13), and time T(13) is earlier than time T(14).

Optionally, if the electronic device detects the first operation once and the second operation once, the first thumbnail image, the second thumbnail image, and the third thumbnail image include a first photographed object.

Optionally, it also includes:

In response to the second operation, a first image is generated; and scaling processing is performed on the first image to generate a third thumbnail image.

Exemplarily, the implementation method of generating the first image can refer to the relevant description of the third process 470 in the subsequent Figure 4, which will not be repeated here; the implementation method of generating the third thumbnail image can refer to the relevant description of S480 in the subsequent Figure 4, which will not be repeated here.

In an embodiment of the present application, when the electronic device detects the operation of popping up a shooting control, it triggers the electronic device to generate a first image, and the first image may refer to a captured image, that is, a real image taken; by scaling the first image, a third thumbnail image, that is, a thumbnail image of the captured image, can be obtained.

Optionally, generating a first image includes:

The second image is processed by the first algorithm to obtain an image in the first color space; at least two frames of images in the first color space are fused to obtain a fused image; and the fused image is processed by the second algorithm to generate the first image.

Exemplarily, time information when the first operation is detected can be obtained; based on the time information, a second image is selected from a zero-second delay queue in the electronic device; the second image is processed by an algorithm in a Raw color space to obtain a processed Raw image; and at least two frames of processed Raw images are fused to obtain a first image.

It should be understood that the first image may refer to a true image generated by taking an image once; compared with the second thumbnail image, the first image does not need to be downsampled; in addition, the first image may be an image after fusion processing based on multiple frames of Raw images; therefore, the image quality of the first image is better than the image quality of the second thumbnail image; in addition, the image quality of the third thumbnail image obtained by scaling the first image is better than the image quality of the second thumbnail image.

When the electronic device generates the first thumbnail image and does not generate the second thumbnail image, storing the first thumbnail image in the first storage area;

When the electronic device generates the second thumbnail image but does not generate the first image, the first thumbnail image in the first storage area is replaced by the second thumbnail image;

When the electronic device generates the first image, the second thumbnail image in the first storage area is replaced by the first image.

Exemplarily, as shown in (b) of FIG. 7 , a cache module may be included in the album application of the electronic device; at time T(12), the first storage location in the cache module is used to store a first thumbnail image (e.g., a false thumbnail image 1); as shown in (d) of FIG. 7 , at time T(13), the first storage area in the cache module is used to store a second thumbnail image (e.g., a real thumbnail image 11); for example, at time T(13), the false thumbnail image may be replaced by the real thumbnail image, the false thumbnail image may be deleted and the real thumbnail image may be stored in the same storage area; at time T(14), the first storage area in the cache module is used to store a first image (e.g., a captured image); for example, at a third time, the real thumbnail image may be replaced by the captured image, the real thumbnail image may be deleted and the captured image may be stored in the same storage space.

It should be understood that the above-mentioned false thumbnail images, real thumbnail images and captured images correspond to the same shooting of the user; in other words, the above-mentioned false thumbnail images, real thumbnail images and captured images correspond to the same time of the user clicking the shooting control and popping up the shooting control; in addition, for the same shooting, displaying false thumbnail images, displaying real thumbnails and displaying thumbnail images of captured images are mutually exclusive; for example, if a false thumbnail image is displayed in the display interface of the camera application, the real thumbnail image and the thumbnail image of the captured image will not be displayed in the display interface; if the real thumbnail image is displayed in the display interface of the camera application, the false thumbnail image and the thumbnail image of the captured image will not be displayed in the display interface; if the thumbnail image of the captured image is displayed in the display interface of the camera application, the false thumbnail image and the real thumbnail image will not be displayed in the display interface.

In an embodiment of the present application, after generating a second thumbnail image (e.g., a real thumbnail image), the first thumbnail image (e.g., a false thumbnail image) stored in the electronic device is directly replaced by the second thumbnail image. After generating a first image (e.g., a captured image), the second thumbnail image (e.g., a real thumbnail image) stored in the electronic device is directly replaced by the first image; compared with storing the first thumbnail image, the second thumbnail image and the first thumbnail image, directly performing replacement processing in an embodiment of the present application can reduce the storage space of the electronic device occupied by the thumbnail images.

Example 2

For the electronic device detecting at least two shooting operations, that is, the electronic device detects at least two first operations and at least two second operations; for example, the electronic device detects the operation of clicking the shooting control for the first time and the operation of popping up the shooting control for the first time; before generating the captured image of the first shot, the electronic device detects the operation of clicking the shooting control for the second time and the operation of popping up the shooting control for the second time.

Optionally, the electronic device detects a first operation and a second operation once, which means that the electronic device detects a shooting operation; if the number of shooting operations detected by the electronic device is greater than once, the first thumbnail image and the second thumbnail image include the first shooting object, the third thumbnail image includes the second shooting object, and the first shooting object is different from the second shooting object.

Exemplarily, the first subject included in the first thumbnail image and the second thumbnail image is the subject 811 shown in (c) of FIG. 10 ; the second subject included in the third thumbnail image is the subject 815 shown in (a) of FIG. 11 .

Optionally, the electronic device includes a storage module, the storage module includes a first storage area and a second storage area, and further includes:

When the electronic device generates the second thumbnail image, the first thumbnail image in the first storage area is replaced by the second thumbnail image;

When the electronic device generates the third thumbnail image, the third thumbnail image is stored in the second storage area.

Exemplarily, as shown in (b) of FIG. 11 , the album application of the electronic device may include a cache module; at time T(22), the electronic device generates a first thumbnail, and the first storage location in the cache module is used to store the first thumbnail image (e.g., false thumbnail image 1); as shown in (d) of FIG. 11 , at time T(23), the electronic device generates a second thumbnail image, and the first storage area in the cache module is used to store the second thumbnail image (e.g., real thumbnail image 11); for example, at time T(23), the false thumbnail image can be replaced by the real thumbnail image, the false thumbnail image can be deleted and the real thumbnail image can be stored in the same storage area; as shown in (d) of FIG. 12 , at time T(25), a third thumbnail image is generated, that is, a false thumbnail image taken for the second time is generated; the second storage area in the cache module is used to store the third image (e.g., false thumbnail image 2 taken for the second time).

Optionally, it also includes:

In response to the second operation, a third image of the first photographed object is generated; the second thumbnail image in the first storage area is replaced by the third image, and the image quality of the third image is better than that of the second thumbnail image.

Exemplarily, the third image may refer to a photographic image taken for the first time; as shown in (b) in FIG. 13 , after the electronic device generates a photographic image taken for the first time, the second thumbnail image (for example, the real thumbnail image 11) stored in the cache module may be replaced by the photographic image.

Optionally, after the display area displays the third thumbnail image, the method further includes:

A fourth thumbnail image is displayed in the display area, the fourth thumbnail image is a thumbnail image of the second photographed object, and the image quality of the fourth thumbnail image is better than that of the third thumbnail image.

Exemplarily, the fourth thumbnail image may refer to a real thumbnail image photographed for the second time, and the real thumbnail image photographed for the second time may be a thumbnail image as shown in the control 813 in (c) of FIG. 13 .

Optionally, it also includes:

The third thumbnail image in the second storage area is replaced by the fourth thumbnail image.

Exemplarily, as shown in (b) and (d) of FIG. 13 , after the electronic device generates a fourth thumbnail image (e.g., the real thumbnail image 22) taken for the second time, the third thumbnail image (e.g., the false thumbnail image 2) in the cache module can be replaced by the real thumbnail image 22.

Optionally, it also includes:

A second preview image of the second photographed object is obtained, and the second preview image is stored in a camera application of the electronic device; and the second preview image is scaled to generate a third thumbnail image.

Exemplarily, after the electronic device detects the operation of clicking the shooting control for the second time, the process of generating a false thumbnail image of the second shot can be triggered; thereby, when the electronic device detects the shooting control popping up for the second time, a false thumbnail image can be quickly displayed in the display interface to respond to the user's shooting operation; thereby reducing the time the user waits to shoot and improving the user's shooting experience.

In an embodiment of the present application, the shooting operation is divided into a first operation (for example, an operation of clicking a shooting control) and a second operation (for example, an operation of popping up a shooting control); when the electronic device detects the first operation, the electronic device is triggered to generate a first thumbnail image (for example, a false thumbnail image) and a second thumbnail image (for example, a real thumbnail image); when the electronic device detects the second operation, the first thumbnail image, the second thumbnail image and the third thumbnail image (for example, thumbnail images obtained based on the shot image) are sequentially displayed in the display area of the display interface; after the second operation is detected, the first thumbnail image is quickly triggered to be displayed; the thumbnail image can be displayed at the moment the electronic device detects the second operation, thereby improving the shooting response speed; reducing the user's shooting waiting time and improving the shooting experience.

The implementation method of the embodiment of the present application is described in detail below in conjunction with Figures 4 to 14.

Implementation method 1

Exemplarily, when the electronic device detects a shooting operation (for example, the operation of clicking a shooting control and the operation of popping up the shooting control), the electronic device generates a false thumbnail image, a real thumbnail image and a shot image in sequence; and displays the false thumbnail image, the real thumbnail image and a thumbnail image of the shot image in sequence in the thumbnail display control in the shooting interface.

Fig. 4 is a schematic flow chart of another method for displaying thumbnail images provided by an embodiment of the present application. The method 400 may be executed by the electronic device shown in Fig. 1; the method includes S410 to S480, and S410 to S480 are described in detail below.

It should be noted that S410 to S480 are described by taking the electronic device detecting a user's shooting process as an example; that is, when the electronic device detects a user clicking and popping up operation of the shooting control, the processing flow of displaying thumbnail images.

S401. Run the camera application.

Exemplarily, a user can instruct an electronic device to run a camera application by clicking on the icon of the "Camera" application. Alternatively, when the electronic device is in a lock screen state, the user can instruct the electronic device to run a camera application by sliding to the right on the display screen of the electronic device. Alternatively, the electronic device is in a lock screen state, and the lock screen interface includes an icon of a camera application, and the user instructs the electronic device to run the camera application by clicking on the icon of the camera application. Alternatively, when the electronic device is running other applications, the application has the permission to call the camera application; the user can instruct the electronic device to run the camera application by clicking on the corresponding control. For example, when the electronic device is running an instant messaging application, the user can instruct the electronic device to turn on the camera application by selecting the control of the camera function.

It should be understood that the above description is an example of the operation of running the camera application; The electronic device may be instructed to run a camera application program in response to an indication operation or other operation; this application does not impose any limitation on this.

S420: Detecting an operation of clicking a shooting control.

Optionally, S420 is illustrated by the operation of clicking a shooting control; S420 may also be an operation of detecting an instruction to start shooting; for example, instructing the electronic device to start shooting through voice or other instruction information.

It should be understood that in the embodiments of the present application, the shooting operation may include: an operation of indicating the start of shooting and an operation of ending shooting; for example, the shooting operation may include: an operation of clicking a shooting control and an operation of popping up a shooting control.

It should be noted that the operation of popping up the shooting control may refer to the operation of the electronic device detecting that the user's finger leaves the shooting control; or the operation of the electronic device detecting that the user's finger releases the shooting control, etc.

In an embodiment of the present application, when the electronic device detects the operation of the user's shooting control, the first process 430 and the second process 440 can be triggered simultaneously; the first process 430 is a process for the electronic device to generate a false thumbnail image; the second process 440 is a process for the electronic device to generate a real thumbnail image; wherein, the process for generating a real thumbnail image can be any existing algorithm for generating thumbnail images.

Optionally, when the electronic device detects the operation of clicking the shooting control, the first process and the second process may be triggered simultaneously; that is, the process of triggering the generation of a quick thumbnail image and the process of triggering the generation of a real thumbnail image.

Exemplarily, the first process 430 includes S431 and S432; S431 and S432 are described in detail below.

S431. Obtain a preview image.

It should be understood that the preview image is an image acquired from a storage module of the electronic device.

Exemplarily, the preview image may be an image stored in a pre-storage module in the camera application, as shown in FIG5 .

Optionally, the preview image may be in JPEG format, JPG format or other formats.

S432: Process the preview image to generate a false thumbnail image.

Exemplarily, the preview image may be a frame of processed image in JPEG format; the image in JPEG format may be scaled to obtain a false thumbnail image.

It should be understood that in the embodiment of the present application, the false thumbnail image is an image obtained by directly scaling the preview image; therefore, the process of generating the false thumbnail image takes a shorter time, and the false thumbnail image can be generated quickly in a shorter time.

Exemplarily, the second process 440 includes S441 and S442; S441 and S442 are described in detail below.

S441. Select an image frame in the ZSL queue.

Optionally, an image frame may be selected in the ZSL queue according to time information, wherein the time information may be acquired when an operation of clicking a capture control is detected in S420; for example, a timestamp may be acquired when a click-to-capture operation is detected.

Exemplarily, when the electronic device detects the operation of clicking the shooting control, the time information obtained is time marker 1; the ZSL queue includes: time marker 1-image frame 1, time marker 2-image frame 2, time marker 3-image frame 3; based on time marker 1, the electronic device can select image frame 1 in the ZSL queue.

Optionally, the image frames stored in the ZSL queue may be Raw images; wherein the Raw images refer to original image data collected by the image sensor.

S442: Process the selected image frame to generate a real thumbnail image.

Exemplarily, the selected Raw image can be processed and converted into a YUV image; the YUV image can be converted into an RGB image for display; in addition, the YUV image can be converted into other formats (for example, JPEG format (JPG format), GIF format, DNG format or RAW format, etc.) for storage.

It should be understood that since the real thumbnail image is a thumbnail image obtained after image processing based on the Raw image; and the false thumbnail image is a thumbnail image obtained by directly scaling the preview image stored in the electronic device; therefore, the timeliness of generating the false thumbnail image is higher than that of generating the real thumbnail image.

Optionally, the electronic device may first generate a quick thumbnail image and then generate a real thumbnail image.

It should also be understood that since the real thumbnail image is a thumbnail image obtained after image processing based on the Raw image; and the false thumbnail image is a thumbnail image obtained by directly scaling the preview image; and since the preview image usually has a lower resolution than the Raw image captured by the image sensor, the image quality of the real thumbnail image is better than that of the false thumbnail image.

Optionally, S442 includes but is not limited to the following steps:

1. Down-sample the selected Raw image to obtain a Raw image after down-sampling;

2. Execute the Raw domain algorithm on the Raw image after downsampling to obtain a processed Raw image; wherein the Raw domain algorithm includes but is not limited to: black level correction processing, lens shading correction and other algorithms;

3. Convert the processed Raw image to YUV color space to obtain a downsampled YUV image; that is, obtain a real thumbnail image.

4. Convert the downsampled YUV image into an RGB image, which is used to be displayed on a display screen of an electronic device; in addition, convert the downsampled YUV image into an image in another storage format, which is used to be stored in an electronic device.

S450: Detecting an operation of popping up a shooting control.

It should be understood that the operation of popping up the shooting control may include the operation of the electronic device detecting that the user's finger leaves the shooting control; or the operation of the electronic device detecting that the user's finger releases the shooting control, etc.

Optionally, the above S450 may also refer to detecting an operation indicating the end of shooting; for example, detecting a voice instruction or other operation indicating the end of shooting.

In an embodiment of the present application, when the electronic device detects the operation of popping up a shooting control, it can trigger the execution of the third process 470 and the display of a false thumbnail image; wherein the third process 470 is a process for generating a captured image; optionally, the process for generating a captured image can be any existing algorithm for generating a captured image.

Optionally, when the electronic device detects the operation of popping up the shooting control, it can trigger the simultaneous execution of the third process 470 and the display of the false thumbnail image.

S461. At a first moment, display a false thumbnail image.

Exemplarily, a schematic diagram of an interface for displaying a false thumbnail image at the first moment is shown in (a) of the subsequent FIG. 6 .

Optionally, while the false thumbnail image is displayed, the false thumbnail image may be stored in the electronic device.

Exemplarily, at the moment when the electronic device detects the operation of popping up the shooting control, an instruction can be sent; the false thumbnail image is stored in the gallery, and the false thumbnail image is displayed in the electronic device.

In an embodiment of the present application, after the electronic device detects the operation of popping up the shooting control, the electronic device can quickly display a false thumbnail image in the shooting interface; when the user is shooting, he usually looks at the thumbnail image displayed in the shooting interface. The operation is to complete a shooting process; in an embodiment of the present application, since the electronic device can quickly display a false thumbnail image in the shooting interface within a short time when the user pops up the shooting control; in other words, the electronic device can respond to the user's shooting operation in a short time, so that the user perceives that the shooting is completed, thereby improving the user's shooting experience.

It should be understood that when a false thumbnail image is displayed, the real thumbnail image may not have been generated yet; in this case, the false thumbnail image can be displayed in the shooting interface first; after the real thumbnail image is generated, the false thumbnail image can be replaced by the real thumbnail image and the real thumbnail image can be displayed in the shooting interface.

S462: At the second moment, display the real thumbnail image.

Among them, the second moment is after the first moment.

Exemplarily, a schematic diagram of an interface for displaying a real thumbnail image at the second moment is shown in (a) of the subsequent FIG. 7 .

Optionally, the real thumbnail image may be stored in the electronic device while the real thumbnail image is displayed.

Optionally, a cache module may be included in the album application of the electronic device; at a first moment, the first storage space in the cache module is used to store false thumbnail images; at a second moment, the first storage space in the cache module is used to store real thumbnail images; for example, at the second moment, the false thumbnail images can be replaced by real thumbnail images, the false thumbnail images can be deleted and the real thumbnail images can be stored in the same storage space.

In an embodiment of the present application, after a real thumbnail image is generated, the false thumbnail image stored in the electronic device is directly replaced by the real thumbnail image; compared with storing the false thumbnail image and the real thumbnail image, the direct replacement process in the embodiment of the present application can reduce the storage space of the electronic device occupied by the thumbnail image.

Exemplarily, the third process 470 includes S471 and S472; S471 and S472 are described in detail below.

S471. Select an image frame in the ZSL queue.

Optionally, an image frame may be selected from the ZSL queue according to time information of detecting an operation of clicking the shooting control.

It should be understood that when a user takes a picture, he usually wants to obtain the image of the moment when the shooting control is clicked; therefore, when generating a captured image, the electronic device can select an image frame in the ZSL queue based on the time information of detecting the operation of clicking the shooting control.

Optionally, the image frame used to generate the captured image may be directly acquired from the second process 440 .

S472: Generate a captured image based on the selected image frame.

Exemplarily, the selected Raw image can be processed and converted into a YUV image; the YUV image can be converted into an RGB image for display; in addition, the YUV image can be converted into other formats (for example, JPEG format, JPG format, GIF format, etc.) for storage.

It should be understood that the difference between a captured image and a real thumbnail image is that, generally speaking, the resolution and image quality of a captured image are better than those of a real thumbnail image.

Optionally, S472 includes but is not limited to the following steps:

1. Perform a Raw domain algorithm on the selected Raw image to obtain a processed Raw image; wherein the Raw domain algorithm includes but is not limited to: black level correction processing, lens shading correction and other algorithms;

2. Fusing the Raw images after multiple frames are processed to obtain a fused Raw image;

Exemplarily, a fusion process is performed on a long-exposure Raw image, a short-exposure Raw image, and a normal-exposure Raw image to obtain a fused Raw image.

3. The fused Raw image is converted to the YUV color space to obtain a YUV image; that is, the captured image is obtained;

4. Convert the YUV image into an RGB image, scale the RGB image, and obtain a thumbnail image corresponding to the captured image;

Optionally, the YUV image may be scaled to obtain a small-sized YUV image; the small-sized YUV image may be converted into a small-sized RGB image; and the small-sized RGB image may be displayed.

5. Convert the YUV image into an image in another storage format, and the image in another storage format is used to store in an electronic device. Optionally, the above is an example to illustrate the entity method of S472; S472 can refer to any existing algorithm for generating a captured image, and this application does not impose any limitation on this.

S480: At the third moment, display a thumbnail image of the captured image.

Among them, the third moment is after the second moment.

Exemplarily, a schematic diagram of an interface for displaying thumbnail images of captured images at the third moment is shown in (a) of the subsequent FIG. 8 .

Optionally, the thumbnail image of the captured image may refer to a thumbnail image obtained by scaling the captured image after the captured image is generated.

It should be understood that, assuming that the image size of the false thumbnail image is a first size, the image size of the real thumbnail image is a second size, and the image size of the captured image is a third size; wherein the first size is the same as the second size; the third size is larger than the first size, or the third size is larger than the second size.

It should be understood that the captured image may refer to a true image generated by capturing an image once; compared with a real thumbnail image, the captured image does not need to be downsampled; in addition, the captured image may be an image based on the fusion processing of multiple frames of Raw images; therefore, the image quality of the captured image is better than the image quality of the real thumbnail image.

It should be noted that after the electronic device generates a captured image, a thumbnail image obtained by scaling the captured image can be displayed in the display interface of the camera application, as shown in (a) in Figure 8; at this time, the captured image is stored in the album application, such as image 111 shown in (b) in Figure 8.

Exemplarily, for the same photographed object, the false thumbnail is shown as 1 in FIG. 4 ; the real thumbnail is shown as 11 in FIG. 4 ; and the photographed image is shown as 111 in FIG. 4 .

Optionally, the captured image is stored in an album application of the electronic device; when the captured image is stored, the real thumbnail image can be directly replaced by the captured image.

Exemplarily, a cache module may be included in an album application of an electronic device; at a first moment, a first storage space in the cache module is used to store false thumbnail images; at a second moment, the first storage space in the cache module is used to store real thumbnail images; for example, at the second moment, the false thumbnail images can be replaced by real thumbnail images, the false thumbnail images can be deleted and the real thumbnail images can be stored in the same storage space; at a third moment, the first storage space in the cache module is used to store captured images; for example, at the third moment, the real thumbnail images can be replaced by captured images, the real thumbnail images can be deleted and the captured images can be stored in the same storage space.

It should be understood that the above-mentioned false thumbnail image, the real thumbnail image and the photographed image correspond to the same photographing of the user; In short, the above-mentioned false thumbnail images, real thumbnail images and captured images correspond to the same click of the user on the shooting control and the pop-up shooting control; in addition, for the same shooting, displaying false thumbnail images, displaying real thumbnails and displaying thumbnail images of captured images are mutually exclusive; for example, if a false thumbnail image is displayed in the display interface of the camera application, the real thumbnail image and the thumbnail image of the captured image will not be displayed in the display interface; if the real thumbnail image is displayed in the display interface of the camera application, the false thumbnail image and the thumbnail image of the captured image will not be displayed in the display interface; if the thumbnail image of the captured image is displayed in the display interface of the camera application, the false thumbnail image and the real thumbnail image will not be displayed in the display interface.

Optionally, in an embodiment of the present application, for one shot, the time required for the electronic device to generate a false thumbnail image is less than the time required to generate a real thumbnail image; the time required for the electronic device to generate a real thumbnail image is less than the time required to generate a thumbnail image of the shot image.

In an embodiment of the present application, after a captured image is generated, the real thumbnail image stored in the electronic device is directly replaced by the captured image; compared with the captured image and the real thumbnail image, direct replacement processing is performed in an embodiment of the present application, which can reduce the storage space of the electronic device occupied by the thumbnail image.

In an embodiment of the present application, by dividing the shooting operation into an operation of clicking a shooting control and an operation of popping up the shooting control, when the electronic device detects the operation of clicking the shooting control, the electronic device is triggered to generate a false thumbnail image and a real thumbnail image; wherein the false thumbnail image refers to a thumbnail image obtained by scaling the preview image; the real thumbnail image refers to a thumbnail image generated after selecting the original image data for image processing; when the electronic device detects the operation of the user popping up the shooting control, the false thumbnail image is triggered to be displayed; so that the thumbnail image can be displayed at the moment the electronic device detects the operation of popping up the shooting control, thereby improving the speed of the shooting response; reducing the user's shooting waiting time and improving the shooting experience.

FIG5 is a software architecture diagram provided in an embodiment of the present application.

As shown in FIG. 5 , the software architecture provided in the embodiment of the present application may include an application layer, an application framework layer, a hardware abstraction layer and a hardware layer.

Exemplarily, the application layer may include a series of application packages. As shown in FIG5 , the application package may include a camera application and a photo album application.

For example, as shown in FIG. 5 , the camera application may include a preview storage module; the preview storage module is used to store preview images.

Exemplarily, the application framework layer provides an application programming interface (API) and a programming framework for the application programs of the application layer. The application framework layer includes some predefined functions.

For example, as shown in Figure 5, in the embodiment of the present application, the application framework layer may include a click shooting control detection mode, a false thumbnail image generation module, a pop-up shooting control detection module, and a thumbnail image display module. The functions of each module will be described in detail in subsequent embodiments and will not be repeated here.

Exemplarily, the hardware abstraction layer may provide an interface between other modules and the hardware layer.

For example, as shown in FIG5 , the hardware abstraction layer may include a real thumbnail image generation module, a ZSL queue storage module, an image frame selection module, and a captured image generation mode. The functions of each module will be described in detail in the subsequent embodiments. I won’t go into details about this.

Exemplarily, the hardware layer may include a series of hardware modules. As shown in FIG5 , the hardware layer may include a camera module.

Next, taking the detection of a user's shooting operation as an example, the interaction process between the modules in the electronic device is described in detail in combination with the software architecture diagram shown in FIG. 5 .

S511. The camera application sends an instruction for capturing an image to the camera module.

Exemplarily, after the camera application is run, the camera application may send an instruction to capture an image to the camera module.

It should be understood that after the camera module obtains the instruction to capture the image, two data streams can be generated; one data stream is used to generate the preview image; and the other data stream is used to generate the captured image later.

S512: The camera module sends the image frame to the preview storage module.

Exemplarily, the image frames sent by the camera module to the preview storage module are used to generate a preview image.

S513. The camera module sends the image frame to the ZSL queue storage module.

Exemplarily, the image frames sent by the camera module to the preview storage module are used to generate captured images.

Optionally, S513 and S512 may be performed simultaneously. For example, when the click-to-shoot control detection module detects the operation of clicking the shoot control, steps S513 and S514 are triggered.

S514: A shooting control in the machine application is clicked, triggering a photo event; the click shooting module detects the operation of the shooting control being clicked.

Specifically, for the description of the block detecting the operation of clicking the shooting control, reference may be made to the related description in the aforementioned step S420, which will not be repeated here.

S515: The click-to-shoot detection module sends information to the false thumbnail image generation module, where the information may include time information when the click of the shooting control is detected.

S516: The false thumbnail image generating module is used to obtain a preview image from the preview storage module according to the time information; and perform scaling processing on the preview image to generate a false thumbnail image.

Optionally, the implementation method of generating the false thumbnail image may refer to the related description of the first process 430 shown in FIG. 4 , which will not be described in detail here.

S517: The click-to-shoot detection module sends information to the image frame selection module. The information may include time information when the click of the shooting control is detected.

S518, the image frame selection module is used to obtain the original image data from the ZSL queue storage module according to the time information.

S519: The real thumbnail image generation module is used to perform image processing on the original image data sent by the image rotation module to generate a real thumbnail image.

Optionally, the implementation method of generating the real thumbnail image may refer to the relevant description of the second process 440 shown in FIG. 4 , which will not be repeated here.

S520: A pop-up shooting control detection module is used to detect an operation of popping up a shooting control in a camera application.

Optionally, when the pop-up shooting control detection module detects the operation of pop-up shooting control, step S521 and step S525 may be triggered.

S521, a pop-up shooting control is detected and an instruction is sent to a thumbnail image display module, where the instruction is used to instruct the thumbnail image display module to display a thumbnail image.

S522: The thumbnail image display module obtains the false thumbnail image in the false thumbnail image generation module.

S523: The camera application obtains the false thumbnail image sent by the thumbnail image display module and displays the false thumbnail image. picture.

S524: The photo album application obtains the false thumbnail image sent by the thumbnail image display module, and displays and stores the false thumbnail image.

S525, the pop-up shooting control detection control is used to send an instruction to the shooting image generation module, where the instruction is used to instruct the shooting image generation module to acquire an image frame to generate a shooting image.

S526, the captured image generation module is used to obtain the image frames in the ZSL queue storage module, and process the image frames to generate captured images.

Optionally, the implementation method of generating the captured image may refer to the relevant description of the third process 470 shown in FIG. 4 , which will not be repeated here.

S527: The real thumbnail image generation module is used to send the real thumbnail image to the thumbnail image display module after generating the real thumbnail image.

S528: The camera application obtains the real thumbnail image sent by the thumbnail image display module, and displays the real thumbnail image.

S529: The photo album application obtains the real thumbnail image sent by the thumbnail image display module, displays the real thumbnail image and replaces the stored false thumbnail image with the real thumbnail image.

S530: The captured image generation module is used to send the captured image to the thumbnail image display module after generating the captured image.

S531. The camera application is used to obtain the captured image sent by the thumbnail image display module and display the thumbnail image of the captured image.

S532: The photo album application is used to obtain the captured image sent by the thumbnail image display module, display the captured image, and replace the stored real thumbnail image with the captured image.

In an embodiment of the present application, by dividing the shooting operation into an operation of clicking a shooting control and an operation of popping up the shooting control, when the electronic device detects the operation of clicking the shooting control, it triggers the electronic device to generate a false thumbnail image and a real thumbnail image; wherein the false thumbnail image refers to a thumbnail image obtained by scaling the preview image; the real thumbnail image refers to a thumbnail image generated after selecting the original image data for image processing; when the electronic device detects the operation of the user popping up the shooting control, the false thumbnail image is triggered to be displayed; so that the thumbnail image can be displayed at the moment the electronic device detects the operation of popping up the shooting control, thereby improving the speed of the shooting response; reducing the user's shooting waiting time and improving the shooting experience.

6 and 7 , an example is given below with reference to a schematic diagram of an interface in which an electronic device detects a shooting operation.

Exemplarily, at time T(10), the electronic device detects that a camera application is running, as shown in (a) of FIG6 , which is a preview interface 610 of the camera application; the preview interface 610 includes a first photographed object 611, a photographing control 612, and a thumbnail display control 613; wherein the thumbnail image displayed in the thumbnail display control 613 is a thumbnail image of the last photographed image; (b) of FIG6 is a schematic diagram of an album application, wherein the album display interface 620 includes a first photographed image 621 and a second photographed image 622; secondly, the album application includes a cache module 630, and the cache module 630 includes the first photographed image 621 and the second photographed image 622.

For example, according to FIG. 6 (a) and FIG. 6 (b), it can be seen that the thumbnail control in the preview interface 610 The thumbnail image displayed in the thumbnail control 612 is the thumbnail image corresponding to the first captured image 621; if the electronic device detects the operation of clicking the thumbnail control 612, it can index to the first captured image 621 in the album application and display the first captured image 621.

It should be understood that the cache module 630 is not displayed in the display interface 620 of the camera application; the cache module 630 is a module in the electronic device for storing images.

Exemplarily, at time T(11), the electronic device detects the operation of clicking the shooting control 612, as shown in (c) of FIG. 6 ; at this time, the thumbnail image displayed in the thumbnail display control 613 is the thumbnail image of the last completed shooting image (for example, the thumbnail image of the first shot image 621); when the electronic device detects the operation of the user clicking the shooting control 612, the display interface of the album application is as shown in (d) of FIG. 6 ; at time T(12), the electronic device detects the operation of popping up the shooting control 612, and displays a false thumbnail image of the first shooting object in the display interface 614; wherein the shooting interface 614 includes the second shooting object 615, and the thumbnail image displayed in the thumbnail display control 613 is the false thumbnail image of the first shooting object 611, as shown in (a) of FIG. 7 ; at this time, the display interface 620 of the album application The display module 616 includes a false thumbnail image 1 of the first photographed object, a first photographed image 621 and a second photographed image 622; the cache module 630 includes a false thumbnail image of the first photographed object, the first photographed image and the second photographed image; at time T(13), after the electronic device generates a real thumbnail image, a display interface 616 is displayed, and the display interface 616 includes the second photographed object 615, a thumbnail display control 612 and a shooting control 612, and the thumbnail display control 613 displays the real thumbnail image of the first photographed object, as shown in (c) of Figure 7; at this time, the camera application displays a display interface 624 including the real thumbnail image 11 of the first photographed object, the first photographed image 621 and the second photographed image 622; the cache module 630 stores the real thumbnail image of the first photographed object, the first photographed image 621 and the second photographed image 622.

It should be noted that after the real thumbnail image of the first subject is generated in the electronic device, the real thumbnail image is displayed in the display interface, and the false thumbnail image of the first subject is replaced by the real thumbnail image of the first subject in the album application.

Optionally, the implementation method of generating a false thumbnail image of the first photographed object may refer to the first process 430 shown in FIG. 4 , which will not be described in detail here.

Optionally, the implementation method of generating a real thumbnail image of the first photographed object can refer to the second process 440 shown in FIG. 4 , which will not be described in detail here.

Exemplarily, at time T(14), after the electronic device generates a photographed image of the first photographed object, a display interface 617 is displayed, wherein the display interface 617 includes a second photographed object 615, a thumbnail display control 613, and a photographing control 612; a thumbnail image of the photographed image of the first photographed object is displayed in the thumbnail display control 613, as shown in (a) in FIG8 ; at this time, the camera application displays a display interface 625, wherein the display interface 625 includes a photographed image 111 of the first photographed object, a first photographed image 621, and a second photographed image 622; and the cache module 630 stores the photographed image of the first photographed object, the first photographed image, and the second photographed image.

It should be noted that after the captured image of the first subject is generated in the electronic device, a thumbnail image of the captured image is displayed in the display interface, and the real thumbnail image of the first subject is replaced by the captured image of the first subject in the album application.

Optionally, the implementation method of generating the captured image of the first captured object may refer to the third process 470 shown in FIG. 4 , which will not be described in detail here.

In the embodiment of the present application, the shooting operation is divided into the operation of clicking the shooting control and the operation of popping up the shooting control. When the electronic device detects the operation of clicking the shooting control, the electronic device is triggered to generate a false thumbnail image and a real thumbnail image. a thumbnail image; wherein, a false thumbnail image refers to a thumbnail image obtained by scaling the preview image; a real thumbnail image refers to a thumbnail image generated after selecting the original image data for image processing; when the electronic device detects that the user pops up the shooting control, the false thumbnail image is triggered to be displayed; so that the thumbnail image can be displayed at the moment when the electronic device detects that the shooting control is popped up, thereby improving the shooting response speed; reducing the user's shooting waiting time and improving the shooting experience.

Implementation method 2

Optionally, the electronic device detects two shooting operations; for example, the electronic device detects in sequence: a first click on the shooting control, a first pop-up of the shooting control, a second click on the shooting control, and a second pop-up of the shooting control.

Example 1

Optionally, when the electronic device generates the false thumbnail image of the second shot, the electronic device has generated the false thumbnail image of the first shot and the real thumbnail image of the first shot, but has not generated the photographed image of the first shot.

For example, the order in which the electronic device generates images is: a false thumbnail image 1 taken for the first time, a real thumbnail image 11 taken for the first time, a false thumbnail image 2 taken for the second time, an image 111 taken for the first time, a real thumbnail image 22 taken for the second time, and an image 222 taken for the second time.

FIG. 9 is a software architecture diagram provided in an embodiment of the present application.

As shown in FIG. 9 , the software architecture provided in the embodiment of the present application may include an application layer, an application framework layer, a hardware abstraction layer and a hardware layer.

Exemplarily, the application layer may include a series of application packages. As shown in FIG9 , the application package may include a camera application and a photo album application.

For example, as shown in FIG. 9 , the camera application may include a preview storage module; the preview storage module is used to store preview images.

For example, as shown in Figure 9, in the embodiment of the present application, the application framework layer may include a click shooting control detection mode, a false thumbnail image generation module, a pop-up shooting control detection module, and a thumbnail image display module. The functions of each module will be described in detail in the subsequent embodiments, and will not be repeated here.

For example, as shown in Figure 9, the hardware abstraction layer may include a real thumbnail image generation module, a ZSL queue storage module, an image frame selection module and a captured image generation mode. The functions of each module will be described in detail in subsequent embodiments and will not be repeated here.

Exemplarily, the hardware layer may include a series of hardware modules. As shown in FIG9 , the hardware layer may include a camera module.

Next, taking the above scenario 1 as an example, in combination with the software architecture diagram shown in FIG. 9 , the interaction process between the modules in the electronic device is described in detail.

S711. The camera application sends an instruction to capture an image to the camera module.

For example, after the camera application is run, the camera application may send a captured image to the camera module. instruction.

S712: The camera module sends the image frame to the preview storage module.

S713. The camera module sends the image frame to the ZSL queue storage module.

Optionally, S713 and S712 may be executed simultaneously.

S714: The shooting control in the machine application is clicked, triggering a photo event; the click shooting module detects the operation of clicking the shooting control; for example, the operation of clicking the shooting control for the first time is detected.

Specifically, for the description of detecting the operation of clicking the shooting control, please refer to the description in the aforementioned step S420, which will not be repeated here.

S715. The click-to-shoot detection module sends first information to the false thumbnail image generation module. The first information may include time information 1 when the first click on the shooting control is detected.

S716 , the false thumbnail image generation module is used to obtain the preview image 1 from the preview storage module according to the time information 1 ; and perform scaling processing on the preview image 1 to generate a false thumbnail image 1 .

For example, the false thumbnail image generation module is used to obtain a preview image 1 from the preview storage module according to the time information 1 when the shooting control is first detected to be clicked; and to perform scaling processing on the preview image 1 to generate a false thumbnail image 1.

Exemplarily, the implementation method of generating the false thumbnail image 1 can refer to the relevant description of the first process 430 in FIG. 4 , which will not be described in detail here.

S717. The click-to-shoot detection module sends second information to the image frame selection module. The second information may include time information 1 when the first click on the shooting control is detected.

S718, the image frame selection module is used to obtain the original image data 1 from the ZSL queue storage module according to the time information 1.

S719, the real thumbnail image generation module is used to perform image processing on the original image data 1 sent by the image selection module to generate a real thumbnail image 11.

S720: A pop-up shooting control detection module is used to detect an operation of popping up a shooting control in a camera application.

Exemplarily, the pop-up shooting control detection module detects the first pop-up shooting control operation.

Optionally, in an embodiment of the present application, the pop-up shooting control detection module and the click shooting control detection module may be the same module; the present application does not impose any limitation on this.

Optionally, when the pop-up shooting control detection module detects the first pop-up shooting control operation, it can trigger the process of displaying a false thumbnail image 1 (for example, S721 to S724) and generating a first shot image (for example, S725 and S726).

Exemplarily, the process of displaying a false thumbnail image and generating a captured image of the first capture may be triggered simultaneously.

S721: Pop-up shooting control detection sends a first instruction to the thumbnail image display module, where the first instruction is used to instruct the thumbnail image display module to display a thumbnail image.

S722. The thumbnail image display module obtains the false thumbnail image 1 in the false thumbnail image generation module.

S723 . The camera application obtains the false thumbnail image 1 sent by the thumbnail image display module, and displays the false thumbnail image 1 .

S724 . The album application obtains the false thumbnail image 1 sent by the thumbnail image display module, and displays and stores the false thumbnail image 1 .

S725 . The pop-up shooting control detection control is used to send a second instruction to the shot image generation module, where the second instruction is used to instruct the shot image generation module to acquire an image frame to generate a shot image 111 .

S726, the captured image generation module is used to obtain the image frames in the ZSL queue storage module, and process the image frames to generate the captured image 111.

Exemplarily, the implementation method of generating the captured image 111 can refer to the relevant description of the third process 470 in FIG. 4 , which will not be repeated here.

S727 . The real thumbnail image generating module is used to generate the real thumbnail image 11 , and after generating the real thumbnail image 11 , send the real thumbnail image 11 to the thumbnail image display module.

Exemplarily, the implementation method of generating the real thumbnail image 11 can refer to the relevant description of the second process 440 in FIG. 4 , which will not be described in detail here.

S728 . The camera application obtains the real thumbnail image 11 sent by the thumbnail image display module, and displays the real thumbnail image 11 .

S729 . The album application obtains the real thumbnail image 11 sent by the thumbnail image display module, displays the real thumbnail image, and replaces the stored false thumbnail image 1 with the real thumbnail image 11 .

S730: The click shooting module detects an operation of clicking on the shooting control; for example, detecting an operation of clicking on the shooting control for the second time.

S731. The false thumbnail image generation module is used to obtain time information 2 of the second click on the capture control from the click capture detection module.

S732 , the false thumbnail image generation module is used to obtain the preview image 2 from the preview storage module according to the time information 2 of the second detection of clicking the shooting control; and perform scaling processing on the preview image 2 to generate a false thumbnail image 2.

For example, the false thumbnail image generation module is used to obtain a preview image 2 from the preview storage module according to the time information 2 of the second detection of clicking the shooting control; and to perform scaling processing on the preview image 2 to generate a false thumbnail image 2.

Exemplarily, the implementation method of generating the false thumbnail image 2 can refer to the relevant description of the first process 430 in FIG. 4 , which will not be described in detail here.

S733. The false thumbnail image generating module is used to send the false thumbnail image 2 to the thumbnail image display module after generating the false thumbnail image 2.

S734: The pop-up shooting control detection module is used to detect the operation of popping up the shooting control in the camera application.

For example, the pop-up shooting control module detects the second pop-up shooting control operation.

Optionally, when the pop-up shooting control detection module detects the second pop-up shooting control operation, it can trigger the process of displaying the false thumbnail image 2 and generating the second shooting image.

S735 . The pop-up shooting control detection module is used to send a third instruction to the thumbnail image display module, where the third instruction is used to instruct the thumbnail image display module to display thumbnail image 2 .

S736 . The camera application is used to receive the false thumbnail image 2 sent by the thumbnail image display module, and display the false thumbnail image 2 .

S737, the album application is used to receive the false thumbnail image 2 sent by the thumbnail image display module, display and store Fake thumbnail image 2.

S738. The captured image generation module is used to send the captured image 111 to the thumbnail image display module after generating the captured image 111 captured for the first time.

It should be noted that since the time information 2 of the second click on the shooting control is later than the time information 1 of the first click on the shooting control, the camera application usually displays the thumbnail image closest to the current moment based on the time information; therefore, after displaying the false thumbnail image 2 of the second shot in the camera application, the electronic device will no longer display the thumbnail image of the first shot image 111.

S739. The camera application is used to receive the captured image sent by the thumbnail image display module, display the captured image, and replace the stored real thumbnail image with the captured image.

S740, the image frame selection module is used to obtain the time information 2 of the second click of the shooting control from the click shooting module.

S741, the image frame selection module is used to obtain the original image data 2 from the ZSL queue storage module according to the time information 2.

S742 , the real thumbnail image generation module is used to perform image processing on the original image data 2 sent by the image selection module to generate a real thumbnail image 22 .

S743: The pop-up shooting control detection module is used to detect the operation of popping up the shooting control in the camera application.

Exemplarily, the pop-up shooting control detection module is used to detect the operation of popping up the shooting control in the camera application for the second time.

S744. The pop-up shooting control detection control is used to send a fourth instruction to the shooting image generation module, where the fourth instruction is used to instruct the shooting image generation module to obtain an image frame to generate a second shooting image 222.

S745, the captured image generation module is used to obtain the image frames in the ZSL queue storage module, and process the image frames to generate the captured image 222.

Exemplarily, the implementation method of generating the captured image 222 can refer to the relevant description of the third process 470 in FIG. 4 , which will not be repeated here.

S746: The captured image generation module is used to generate a real thumbnail image 22 captured for the second time, and after generating the real thumbnail image 22, send the real thumbnail image 22 to the thumbnail image display module.

Exemplarily, the implementation method of generating the real thumbnail image 22 can refer to the relevant description of the second process 440 in FIG. 4 , which will not be described in detail here.

S747 . The camera application obtains the real thumbnail image 22 sent by the thumbnail image display module, and displays the real thumbnail image 22 .

S748 . The album application is used to receive the real thumbnail image 22 sent by the thumbnail image display module, display the real thumbnail image 22 , and replace the stored false thumbnail image 2 with the real thumbnail image 22 .

S749, the captured image generation module is used to send the captured image 222 to the thumbnail image display module after generating the captured image 222.

S750 , the camera application is used to receive the captured image 222 sent by the thumbnail image display module, and display a thumbnail image of the captured image 222 .

S751 . The photo album application is used to receive the captured image 222 sent by the thumbnail image display module, display the captured image 222 , and replace the stored real thumbnail image 22 with the captured image 222 .

Optionally, the click-to-shoot control detection module and the pop-up-to-shoot control detection module shown in FIG9 may be the same module; or they may be different modules, and this application does not impose any limitation on this.

The interface schematic diagram of the above example 1 is described below with reference to FIG. 10 to FIG. 14 .

Exemplarily, at time T(20), the electronic device detects that a camera application is running, as shown in (a) of FIG10 , which is a preview interface 810 of the camera application; the preview interface 810 includes a first photographed object 811, a photographing control 812, and a thumbnail display control 813; wherein the thumbnail image displayed in the thumbnail display control 813 is a thumbnail image of the last photographed image; (b) of FIG10 shows a display interface 820 of an album application, and the display interface 820 includes a first photographed image 821; secondly, the album application includes a cache module 830, and the cache module 830 includes the first photographed image 821.

For example, according to (a) and (b) in Figure 10, it can be seen that the thumbnail image displayed in the thumbnail control 812 in the preview interface 810 is the thumbnail image corresponding to the first captured image 821; if the electronic device detects the operation of clicking the thumbnail control 812, it can index to the first captured image 821 in the album application and display the first captured image 821.

It should be understood that the cache module 830 is not displayed in the display interface 820 of the camera application; the cache module 830 is a module in the electronic device for storing images.

Exemplarily, at time T(21), the electronic device detects an operation of clicking on the shooting control 812; for example, the first operation of clicking on the shooting control 812 is detected, as shown in (c) in FIG. 10; at this time, the thumbnail image displayed in the thumbnail display control 813 is a thumbnail image of the last completed image shooting (for example, a thumbnail image of the first shot image 821); when the electronic device detects an operation of the user clicking on the shooting control 812, the display interface of the photo album application is shown in (d) in FIG. 10; at time T(22), the electronic device detects an operation of popping up the shooting control 812 and displays a display interface 814; for example, the first operation of popping up the shooting control 812 is detected and the display interface 814 is displayed; wherein the display interface 814 includes a second shooting object 815 and a thumbnail display control 813, and the thumbnail image displayed in the thumbnail display control 813 is a false thumbnail of the first shooting object 811 11(a); at this time, as shown in (b) of FIG11, the display interface 823 of the album application includes a false thumbnail image 1 of the first photographed object and the first photographed image 821; the cache module 830 includes the false thumbnail image of the first photographed object and the first photographed image; at time T(23), after the electronic device generates a real thumbnail image of the first photographed object, the display interface 816 is displayed; the display interface 816 includes the second photographed object 815, the thumbnail display control 813 and the shooting control 812, and the thumbnail display control 8613 displays the real thumbnail image of the first photographed object, as shown in (c) of FIG11; at this time, as shown in (d) of FIG11, the camera application displays the display interface 824 including the real thumbnail image 11 of the first photographed object and the first photographed image 821; the cache module 830 stores the real thumbnail image of the first photographed object and the first photographed image picture.

It should be noted that after the real thumbnail image of the first subject is generated in the electronic device, the real thumbnail image of the first subject is displayed in the display interface, and the false thumbnail image 1 of the first subject is replaced by the real thumbnail image 11 of the first subject in the album application.

Exemplarily, at time T(24), the electronic device detects an operation of clicking the shooting control 812 and displays a display interface 816; for example, an operation of clicking the shooting control 812 for the second time is detected, as shown in (a) in FIG. 12 ; the display interface 816 includes a second shooting object 815 and a thumbnail display control 813, and the thumbnail display control 813 displays a real thumbnail image of the first shooting object 811; at this time, as shown in (b) in FIG. 12 , the display interface 824 of the album application includes a real thumbnail image 11 of the first shooting object and a first shooting image 821; the cache module 830 includes a real thumbnail image of the first shooting object and the first shooting image. At time T(25), the electronic device detects the operation of popping up the shooting control 812 and displays the display interface 817; for example, the operation of popping up the shooting control 812 for the second time is detected and the display interface 817 is displayed; wherein the display interface 817 includes a third shooting object and a thumbnail display control 813, and the thumbnail image displayed in the thumbnail display control 813 is a false thumbnail image of the second shooting object 815, as shown in (c) in FIG. 12; at this time, as shown in (d) in FIG. 12, the display interface 825 of the book application includes a false thumbnail image 2 of the second shooting object, a real thumbnail image 11 of the first shooting object and the first shooting image 821; the cache module 830 includes a false thumbnail image of the second shooting object, a real thumbnail image of the first shooting object and the first shooting image.

It should be understood that at time T(24) and time T(25), the electronic device has not yet generated the first captured image of the subject, and has detected the second capturing operation.

Exemplarily, at time T(26), as shown in (a) in FIG. 13 , after the electronic device generates a captured image of the first subject, a display interface 817 including a third subject, a shooting control 812 and a thumbnail display control 813 is displayed; the display interface 817 includes At this time, as shown in (b) in FIG. 13 , the display interface 826 of the album application includes a false thumbnail image 2 of the second subject, a captured image 111 of the first subject and the first captured image 821; the cache module 830 includes a false thumbnail image of the second subject, a real image of the first subject and the first captured image.

Optionally, after the captured image of the first subject is generated in the electronic device, the real thumbnail image of the first subject is replaced by the captured image of the first subject in the album application.

It should be understood that since the second shooting operation is performed later than the first shooting; therefore, after the electronic device displays the thumbnail image of the second photographed object, even if the electronic device generates a photographed image of the first photographed object, the display interface in the camera application will not display the thumbnail image of the photographed image of the first photographed object in the thumbnail display control; therefore, the display interface of the camera application at time T(26) is the same as that at time T(25).

It should also be understood that the second shooting and the first shooting are two independent shooting processes; therefore, in the cache module in the camera application, in the same shooting process, the thumbnail image generated earlier will be replaced by the real thumbnail image generated later; the real thumbnail image generated earlier will be replaced by the shooting image generated later; however, the image captured for the second time will not replace the image captured for the first time.

Exemplarily, at time T(27), the electronic device generates a real thumbnail image of the second photographed object and displays a display interface 818, as shown in (c) in FIG. 13 ; wherein the display interface 818 includes a third photographed object and a thumbnail display control 813, and the thumbnail display control 813 displays a real thumbnail image of the second photographed object; at this time, as shown in (d) in FIG. 13 , the display interface 827 of the album application includes a real thumbnail image 22 of the second photographed object, a photographed image 111 of the first photographed object, and a first photographed image 821; and the real thumbnail image of the second photographed object, the photographed image of the first photographed object, and the first photographed image in the cache module 830.

Exemplarily, at time T(28), the electronic device generates a real image of the second photographed object and displays a display interface 819, as shown in (a) in FIG. 14 ; wherein the display interface 819 includes a third photographed object and a thumbnail display control 813, and the thumbnail display control 813 displays a thumbnail image of the photographed image of the second photographed object 815; at this time, as shown in (b) in FIG. 14 , the display interface 828 of the album application includes the photographed image 222 of the second photographed object, the photographed image 111 of the first photographed object, and the first photographed image 821; and the photographed image of the second photographed object, the photographed image of the first photographed object, and the first photographed image in the cache module 830.

It should be noted that after the captured image is generated, the captured image is stored in the album application, and a thumbnail image of the captured image after scaling is displayed in the camera application; and after the electronic device generates a real thumbnail image or a false thumbnail image, the real thumbnail image or the false thumbnail image is stored in the album application, and the real thumbnail image or the false thumbnail image is displayed in the camera application.

Optionally, the implementation method of generating the captured image of the second captured object may refer to the third process 470 shown in FIG. 4 , which will not be described in detail here.

Example 2

Optionally, when the electronic device generates the false thumbnail image of the second shot, the electronic device has generated the false thumbnail image of the first shot, the real thumbnail image of the first shot and the photographed image of the first shot. The specific implementation process can be referred to the relevant description of Example 1, which will not be repeated here.

Example 3

Optionally, when the electronic device generates the false thumbnail image of the second shot, the electronic device has generated the false thumbnail image of the first shot, and has not generated the real thumbnail image of the first shot and the photographed image of the first shot. The specific implementation process can be referred to the relevant description of Example 1, which will not be repeated here.

The following describes, in conjunction with FIG. 15 and FIG. 16 , a schematic diagram of an interface for enabling display of a false thumbnail image in an electronic device, that is, executing the method for displaying thumbnail images according to an embodiment of the present application.

In one example, after the electronic device detects the operation of clicking the smart control 840 as shown in (b) of FIG. 15 , the method for displaying thumbnail images provided in an embodiment of the present application is executed.

Exemplarily, after the electronic device runs a camera application, a preview interface as shown in (a) of FIG. 15 is displayed; the preview interface includes a preview image and a smart control 840; the electronic device detects an operation of clicking the smart control 840, as shown in (b) of FIG. 15; after the electronic device detects the operation of clicking the smart control 840, the method for displaying a thumbnail image provided in an embodiment of the present application is executed.

In one example, as shown in (d) of FIG. 16 , after the electronic device detects the operation of clicking the control 851 , the method for displaying thumbnail images provided in an embodiment of the present application is executed.

Exemplarily, after a camera application is run in an electronic device, a preview interface as shown in (a) of FIG. 16 may be displayed; the preview interface includes a preview image and a setting control 850; the electronic device detects an operation of clicking the setting control 850, as shown in (b) of FIG. 16; after the electronic device detects the operation of clicking the setting control 850, the setting interface is displayed, as shown in (c) of FIG. 16; the setting interface includes a control 851 for quickly thumbnailing images; the electronic device detects an operation of clicking the control 851 for quickly thumbnailing images, as shown in (d) of FIG. 16; after the electronic device detects the operation of clicking the control 851 for quickly thumbnailing images, the method for displaying thumbnail images provided in an embodiment of the present application is executed.

It should be noted that the above is an example of a display interface of an electronic device applied to a photo-taking scene, and the present application does not impose any limitation on this.

It should be understood that the above examples are intended to help those skilled in the art understand the embodiments of the present application, rather than to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of the present application.

The above describes in detail the method for displaying thumbnail images provided by the embodiment of the present application in conjunction with Figures 1 to 16; the following describes in detail the device embodiment of the present application in conjunction with Figures 17 to 18. It should be understood that the device in the embodiment of the present application can execute the various methods of the aforementioned embodiment of the present application, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

FIG17 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 900 includes a display module 910 and a processing module 920 .

In one implementation, the display module 910 is used to display a first display interface at a first moment, wherein the first display interface includes a first control, a thumbnail display area, and a first preview image; wherein the first control is a control for indicating shooting; the thumbnail display area is used to display a thumbnail image; and the first preview image is a first image captured by the electronic device. an image generated by preview processing of the first image, the first image being the image captured in real time by the electronic device at the first moment; the processing module 920 is used to detect a first operation on the first control, the first operation being used to indicate the start of shooting, and the shooting may include taking a photo; in response to the first operation, the first thumbnail image is saved in the album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image after the first image processing; the second thumbnail image is a thumbnail image generated by the first image after the second image processing, and the first image processing is different from the second image processing; a second operation on the first control is detected, the second operation being used to indicate the end of shooting; the display module 910 is also used to display the first thumbnail image, the second thumbnail image and the third thumbnail image in sequence in the thumbnail display area in response to the second operation, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.

Optionally, as an embodiment, the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.

Optionally, as an embodiment, the processing module 920 is further configured to:

In response to the second operation, generating a first captured image;

Optionally, as an embodiment, the electronic device includes a storage module, the storage module includes a first storage area, and the processing module 920 is further used to:

Optionally, as an embodiment, the processing module 920 is specifically configured to:

Acquire time information when the first operation is detected;

Optionally, as an embodiment, the second image processing includes a first algorithm processing and a second algorithm processing, the first algorithm is an algorithm of a first color space, and the second algorithm is an algorithm for converting an image in the first color space into an image in a second color space, and the processing module 920 is specifically used for:

Optionally, as an embodiment, the first operation is an operation of clicking the first control; and the second operation is an operation of popping up the first control.

Optionally, as an embodiment, the image quality includes image texture information or image brightness information.

In one implementation, the display module 910 is used to display a first display interface at a first moment, wherein the first display interface includes a first control, a thumbnail display area, and a first preview image; wherein the first control is a control for indicating shooting; the thumbnail display area is used to display a thumbnail image; the first preview image is an image generated by preview processing of a first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment; the processing module 920 is used to detect a first operation on the first control, wherein the first operation is used to indicate starting shooting, and the shooting may include taking a photo; in response to the first operation, A first thumbnail image is saved in an album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image through a first image processing; the second thumbnail image is a thumbnail image generated by the first image through a second image processing, and the first image processing is different from the second image processing; a second operation on the first control is detected, and the second operation is used to indicate the end of shooting; the display module 910 is used to display the first thumbnail image and the second thumbnail image in sequence in the thumbnail display area in response to the second operation; and a third thumbnail image is generated, and the image quality of the third thumbnail image is better than that of the second thumbnail image; the processing module 920 is used to detect a third operation on the first control before generating the third thumbnail image, and the third The operation is used to indicate the start of shooting; in response to the third operation, a fourth thumbnail image is saved in the album application, and a fifth thumbnail image is generated; wherein the fourth thumbnail image is a thumbnail image generated by processing the second image through the first image; the fifth thumbnail image is a thumbnail image generated by processing the second image through the second image; the second image is an image captured in real time by the electronic device at a second moment, and the second moment is later than the first moment; a fourth operation on the first control is detected, and the fourth operation is used to indicate the end of shooting; the display module 910 is used to display the fourth thumbnail image, the fifth thumbnail image and the sixth thumbnail image in the thumbnail display area in sequence in response to the fourth operation, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.

In response to the second operation, generating a first captured image;

In response to the fourth operation, generating a second captured image;

Optionally, as an embodiment, the electronic device includes a storage module, the storage module includes a first storage area and a second storage area, the first storage area is used to store the first thumbnail image, the second thumbnail image or the first captured image; the second storage area is used to store the fourth thumbnail image, the fifth thumbnail image or the second captured image; the first storage area and the second storage area are different storage areas in the storage module.

When the second captured image is generated, the second storage area is The fifth thumbnail image is replaced.

Optionally, as an embodiment, the first operation and the third operation are operations of clicking the first control; the second operation and the fourth operation are operations of popping up the first control.

It should be noted that the electronic device 900 is implemented in the form of a functional module. The term "module" here can be implemented in the form of software and/or hardware, and is not specifically limited to this.

For example, a "module" can be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and memory for executing one or more software or firmware programs, a combined logic circuit, and/or other suitable components that support the described functions.

Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

Fig. 18 shows a schematic diagram of the structure of an electronic device provided by the present application. The dotted lines in Fig. 18 indicate that the unit or the module is optional; the electronic device 1000 can be used to implement the method for displaying thumbnail images described in the above method embodiment.

The electronic device 1000 includes one or more processors 1001, which can support the method of displaying thumbnail images in the method embodiment of the electronic device 1000. The processor 1001 can be a general-purpose processor or a special-purpose processor. For example, the processor 1001 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, such as discrete gates, transistor logic devices or discrete hardware components.

Optionally, the processor 1001 may be used to control the electronic device 1000, execute software programs, and process data of the software programs. The electronic device 1000 may also include a communication unit 1005 to implement input (reception) and output (transmission) of signals.

For example, the electronic device 1000 may be a chip, the communication unit 1005 may be an input and/or output circuit of the chip, or the communication unit 1005 may be a communication interface of the chip, and the chip may be a component of a terminal device or other electronic devices.

For another example, the electronic device 1000 may be a terminal device, and the communication unit 1005 may be a transceiver of the terminal device, or the communication unit 1005 may include one or more memories 1002 in 1000, on which a program 1004 is stored. The program 1004 may be executed by the processor 1001 to generate instructions 1003, so that the processor 1001 executes the method for displaying thumbnail images described in the above method embodiment according to the instructions 1003.

Optionally, data may also be stored in the memory 1002 .

Optionally, the processor 1001 may also read data stored in the memory 1002 . The data may be stored at the same storage address as the program 1004 , or may be stored at a different storage address from the program 1004 .

Optionally, the processor 1001 and the memory 1002 may be provided separately or integrated together, for example, integrated on a system on chip (SOC) of a terminal device.

Exemplarily, the memory 1002 may be used to store information related to the method for displaying thumbnail images provided in the embodiments of the present application. Program 1004, the processor 1001 can be used to call the related program 1004 of the method for displaying thumbnail images stored in the memory 1002 when executing the method for displaying thumbnail images, and execute the method for displaying thumbnail images in the embodiment of the present application; for example, displaying a first display interface at a first moment, the first display interface including a first control, a thumbnail display area and a first preview image; wherein the first control is a control for indicating shooting; the thumbnail display area is used to display thumbnail images; the first preview image is an image generated by the preview processing of the first image collected by the electronic device, and the first image is an image collected in real time by the electronic device at the first moment; detecting a first operation on the first control The first operation is used to indicate the start of shooting, and shooting may include taking a photo; in response to the first operation, a first thumbnail image is saved in the album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image through the first image processing; the second thumbnail image is a thumbnail image generated by the first image through the second image processing, and the first image processing is different from the second image processing; a second operation on the first control is detected, and the second operation is used to indicate the end of shooting; in response to the second operation, the first thumbnail image, the second thumbnail image and the third thumbnail image are displayed in sequence in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.

Optionally, the present application further provides a computer program product, which, when executed by the processor 1001, implements the method for displaying thumbnail images in any method embodiment of the present application.

For example, the computer program product may be stored in the memory 1002 , such as program 1004 , which is converted into an executable target file that can be executed by the processor 1001 after preprocessing, compilation, assembly, and linking.

Optionally, the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method for displaying thumbnail images in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

For example, the computer-readable storage medium is, for example, memory 1002. Memory 1002 may be a volatile memory or a nonvolatile memory, or memory 1002 may include both a volatile memory and a nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the embodiments of the electronic device described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

In addition, the term "and/or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.

The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims. In short, the above are only preferred embodiments of the technical solution of the present application, and are not used to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

A method for displaying thumbnail images, characterized in that it is applied to an electronic device, comprising:

Displaying a first display interface at a first moment, the first display interface including a first control, a thumbnail display area, and a first preview image, wherein the first control is a control for instructing shooting, the thumbnail display area is used to display a thumbnail image, the first preview image is an image generated by preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment;

detecting a first operation on the first control, where the first operation is used to instruct to start shooting;

In response to the first operation, a first thumbnail image is saved in an album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image after a first image processing; the second thumbnail image is a thumbnail image generated by the first image after a second image processing, and the first image processing is different from the second image processing;

detecting a second operation on the first control, where the second operation is used to indicate ending shooting;

In response to the second operation, the first thumbnail image, the second thumbnail image and the third thumbnail image are sequentially displayed in the thumbnail display area, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image.
The method as claimed in claim 1 is characterized in that the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.
The method according to claim 1 or 2, further comprising:

In response to the second operation, generating a first captured image;

The first captured image is scaled based on the size of the thumbnail display area to generate the third thumbnail image.
The method according to claim 3, wherein the electronic device comprises a storage module, the storage module comprises a first storage area, and further comprises:

When the electronic device generates the second thumbnail image but does not generate the first captured image, replacing the first thumbnail image in the first storage area with the second thumbnail image;

When the electronic device generates the first captured image, the second thumbnail image in the first storage area is replaced by the first captured image.
The method according to claim 3 or 4, characterized in that it also includes:

Acquire time information when the first operation is detected;

The first image is selected from a zero-second delay queue in the electronic device based on the time information.
The method according to any one of claims 3 to 5, characterized in that the second image processing includes a first algorithm processing and a second algorithm processing, the first algorithm is an algorithm of a first color space, the second algorithm is an algorithm for converting an image in the first color space into an image in a second color space, and the generating of the first captured image includes:

Processing the first image with the first algorithm to obtain an image in the first color space;

Performing fusion processing on at least two frames of images in the first color space to obtain a fused image;

The fused image is processed by the second algorithm to generate the first captured image.
The method according to any one of claims 1 to 6, characterized in that the first operation is an operation of clicking the first control; and the second operation is an operation of popping up the first control.
The method according to any one of claims 1 to 7, characterized in that the image quality includes image texture information or image brightness information.
A method for displaying thumbnail images, characterized in that it is applied to an electronic device, comprising:

Displaying a first display interface at a first moment, the first display interface including a first control, a thumbnail display area and a first preview image; wherein the first control is a control for instructing shooting; the thumbnail display area is used to display thumbnail images; the first preview image is an image generated by preview processing of the first image captured by the electronic device, and the first image is an image captured in real time by the electronic device at the first moment;

detecting a first operation on the first control, where the first operation is used to instruct to start shooting;

In response to the first operation, a first thumbnail image is saved in an album application, and a second thumbnail image is generated; wherein the first thumbnail image is a thumbnail image generated by the first image after a first image processing; the second thumbnail image is a thumbnail image generated by the first image after a second image processing, and the first image processing is different from the second image processing;

detecting a second operation on the first control, where the second operation is used to indicate ending shooting;

In response to the second operation, sequentially displaying the first thumbnail image and the second thumbnail image in the thumbnail display area; and generating a third thumbnail image, wherein the image quality of the third thumbnail image is better than that of the second thumbnail image;

Before generating the third thumbnail image, detecting a third operation on the first control, the third operation being used to instruct starting shooting;

In response to the third operation, a fourth thumbnail image is saved in the photo album application, and a fifth thumbnail image is generated; wherein the fourth thumbnail image is a thumbnail image generated by processing the second image through the first image; the fifth thumbnail image is a thumbnail image generated by processing the second image through the second image; the second image is an image captured in real time by the electronic device at a second moment, and the second moment is later than the first moment;

detecting a fourth operation on the first control, the fourth operation being used to indicate the end of shooting;

In response to the fourth operation, the fourth thumbnail image, the fifth thumbnail image and the sixth thumbnail image are sequentially displayed in the thumbnail display area, wherein the image quality of the sixth thumbnail image is better than that of the fifth thumbnail image.
The method as claimed in claim 9 is characterized in that the first image processing includes downsampling processing; and the algorithm complexity of the second image processing is higher than the algorithm complexity of the first image processing.
The method according to claim 9 or 10, characterized in that generating the third thumbnail image comprises:

In response to the second operation, generating a first captured image;

The first captured image is scaled based on the size of the thumbnail display area to generate the third thumbnail image.
The method according to claim 11, further comprising:

In response to the fourth operation, generating a second captured image;

The second captured image is scaled based on the size of the thumbnail display area to generate the sixth thumbnail image.
The method according to claim 12, characterized in that the electronic device includes a storage module, the storage module includes a first storage area and a second storage area, the first storage area is used to store the first thumbnail image, the second thumbnail image or the first captured image; the second storage area is used to store The fourth thumbnail image, the fifth thumbnail image or the second captured image; the first storage area and the second storage area are different storage areas in the storage module.
The method according to claim 13, further comprising:

When the second thumbnail image is generated and the first captured image is not generated, replacing the first thumbnail image in the first storage area with the second thumbnail image;

When the first photographed image is generated, the second thumbnail image in the first storage area is replaced by the first photographed image.
The method according to claim 13 or 14, further comprising:

When the fifth thumbnail image is generated and the second captured image is not generated, replacing the fourth thumbnail image in the second storage area with the fifth thumbnail image;

When the second photographed image is generated, the fifth thumbnail image in the second storage area is replaced by the second photographed image.
The method according to any one of claims 9 to 15, characterized in that the first operation and the third operation are operations of clicking the first control; and the second operation and the fourth operation are operations of popping up the first control.
The method according to any one of claims 9 to 16, characterized in that the image quality includes image texture information or image brightness information.
An electronic device, comprising:

one or more processors and memory;

The memory is coupled to the one or more processors, and the memory is used to store computer program code, wherein the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method as described in any one of claims 1 to 8, or 9 to 17.
A chip system, characterized in that the chip system is applied to an electronic device, the chip system comprises one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 8, or 9 to 17.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the method described in any one of claims 1 to 8, or 9 to 17.
A computer program product, characterized in that the computer program product comprises a computer program code, and when the computer program code is executed by an electronic device, the electronic device executes the method described in any one of claims 1 to 8, or 9 to 17.