CN117453104B

CN117453104B - Image acquisition method and electronic equipment

Info

Publication number: CN117453104B
Application number: CN202311616856.7A
Authority: CN
Inventors: 李占魁
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-11-30
Filing date: 2023-11-30
Publication date: 2024-05-24
Anticipated expiration: 2043-11-30
Also published as: CN117453104A

Abstract

The application provides an image acquisition method and electronic equipment, which are applied to the electronic equipment, wherein the method comprises the following steps: displaying a first interface, wherein the first interface is an interface of a first application program in the electronic equipment; acquiring a first image in response to a first operation on a first interface; performing first processing on the first image, and simultaneously, responding to second operation on the first interface, displaying a second interface which is not an interface of the first application program, wherein the second operation is used for changing the first application program from running in the foreground to running in the background, and before the first processing of the first image is finished, adjusting the running priority of the first application program from the first priority to the second priority; and based on the second priority, when a second image is obtained, saving the second image, wherein the second image is obtained by processing the first image. Therefore, the application can avoid the situation of losing the graph as far as possible by improving the priority of the first application program, and ensure the use experience of the user.

Description

Image acquisition method and electronic equipment

Technical Field

The application relates to the field of terminals, in particular to an image acquisition method and electronic equipment.

Background

In electronic devices such as mobile phones and tablet computers, cameras are generally configured, camera application programs are installed, and the electronic devices can obtain images acquired by the cameras based on the camera application programs.

At present, when a camera application program receives shooting operation indicated by a user, an initial image acquired by a camera can be obtained, then the initial image can be processed to obtain a processed image, and after the camera application program obtains the processed image, the processed image is stored.

However, the above process of obtaining the processed image generally takes a relatively long time, and in this process, if the camera application runs in the background, and an abnormal situation such as insufficient memory resources occurs, the electronic device may stop running of the camera application in the background, so that the camera application cannot obtain the processed image, and further, the camera application does not store the processed image, which results in the occurrence of a image loss phenomenon, and affects the shooting experience of the user.

Disclosure of Invention

The application provides an image acquisition method and electronic equipment, which avoid the situation of losing pictures as much as possible and ensure the use experience of users.

In a first aspect, the present application provides an image acquisition method, applied to an electronic device, the method comprising:

Displaying a first interface, wherein the first interface is an interface of a first application program in the electronic equipment; responding to a first operation of a first interface, acquiring a first image, wherein the first operation is shooting operation, and the first image is an initial image acquired by a camera of the electronic equipment; performing first processing on the first image, and simultaneously, responding to second operation on the first interface, displaying a second interface, wherein the second interface is not an interface of the first application program, and the second operation is used for changing the first application program from running in the foreground to running in the background; before the first processing of the first image is finished, the operation priority of the first application program is adjusted from the first priority to the second priority, the first priority is smaller than the priority of the resident service module and smaller than the priority of the application program operated in the foreground, the second priority is larger than or equal to the priority of the resident service module and larger than the priority of the application program operated in the foreground, and the resident service module is a module which is continuously operated after being started in the electronic equipment; and based on the second priority, when a second image is obtained, saving the second image, wherein the second image is obtained by processing the first image.

Wherein the first application may be a camera application.

In the method, before the first processing of the first image is finished, the operation priority of the first application program can be adjusted so that the priority of the first application program is greater than or equal to the priority of the resident service module and greater than the priority of the application program operated in the foreground, so that the first application program can be in a state with higher operation priority, the condition that the first application program operated in the background is terminated due to insufficient memory resources can be avoided as far as possible, the first application program can obtain the second image and save the second image, and based on the condition, the occurrence of the image loss phenomenon can be prevented, and the shooting experience of a user can be improved.

With reference to the first aspect, in certain implementations of the first aspect, before the first processing of the first image ends, adjusting the running priority of the first application from the first priority to the second priority includes:

before the first processing of the first image is finished, when the first application program is detected to run in the background, starting a first function of the first application program, wherein the first function is used for keeping the first application program in a running state;

And associating the first function with the resident service module according to a first association condition so as to adjust the running priority of the first application program from the first priority to the second priority, wherein the first association condition is that the priority of the application program corresponding to the first function is greater than or equal to the priority of the resident service module, and the priority of the resident service module is greater than the priority of the application program running in the foreground.

In the method, before the first processing of the first image is finished, when the first application program is detected to run in the background, the first function of the first application program is started, and the first function is associated with the resident service module based on the first association condition, so that the priority of the first application program is greater than or equal to the priority of the resident service module and greater than the priority of the application program running in the foreground under the condition that the first application program is in a continuous running state, and the condition that the first application program running in the background is terminated due to insufficient memory resources is avoided to the greatest extent, and the first application program can obtain the second image.

With reference to the first aspect, in certain implementation manners of the first aspect, based on the second priority, when the first application obtains the second image, saving the second image includes:

And based on the second priority, when a second image is obtained within a preset time period, storing the second image.

In the method, when the first application program can obtain the second image within the preset time, the second image is stored, the first application program is prevented from being continuously in a state of receiving the second image, and normal operation of the first application program and other application programs and software modules in the electronic equipment is ensured.

With reference to the first aspect, in certain implementation manners of the first aspect, based on the second priority, after the storing the second image when the first application obtains the second image within the preset time period, the method further includes:

Releasing the association of the first function and the resident service module; the first function is turned off.

In the method, after the first application program obtains the second image within the preset time, the first application program is not required to be in a state with higher running priority, so that the association between the resident service module and the first function can be released, the first function is closed, and the first application program is prevented from being in a state with higher running priority, and the normal running of other software modules or application programs in the electronic equipment is prevented from being influenced.

With reference to the first aspect, in certain implementations of the first aspect, the method further includes:

based on the second priority, when the first application program does not obtain the second image within the preset time, the association between the first function and the resident service module is released; the first function is turned off.

In the method, when the first application program does not obtain the second image within the preset time, the first application program may not obtain the second image, so that the association between the resident service module and the first function can be released, the first function can be closed, and the first application program is prevented from being in a state with higher running priority continuously, and the normal running of other software modules or application programs in the electronic equipment is prevented from being influenced.

when the first application program is detected to run in the foreground, the association between the first function and the resident service module is released; the first function is turned off.

In the method, when the first application program is detected to run in the foreground, the priority of the first application program is indicated to be recovered, and at this time, the priority of the first application program is higher and is not easy to be stopped from running by the electronic device due to factors such as insufficient system memory resources, and the like, then the association between the resident service module and the first function can be released, and the first function is closed, so that the first application program is prevented from being continuously in a state with higher running priority and affecting the normal running of other software modules or application programs in the electronic device.

With reference to the first aspect, in certain implementations of the first aspect, after acquiring the first image in response to a first operation on the first interface, the method further includes:

And performing second processing on the first image, wherein the second processing comprises compression processing and size processing, the image obtained by the first processing is a third image, the third image is a thumbnail image, the first processing comprises enhancement processing, the image obtained by the enhancement processing is a second image, the second image is an enhancement image, the quality of the second image is higher than that of the first image, and the duration of the second processing is shorter than that of the first processing.

In the method, the duration of the second processing is smaller than that of the first processing, so that the first application program can acquire and display the thumbnail image in advance, the user feels that the shooting speed of the electronic equipment is improved, and the shooting experience of the user can be improved.

With reference to the first aspect, in certain implementations of the first aspect, the enhancement process includes one or more of a brightness adjustment, an exposure adjustment, a contrast adjustment, a sharpening process, a hue process, a saturation adjustment, a color temperature adjustment, and a beauty treatment.

For example, the enhancement processing includes sharpening processing, saturation adjustment, and beautifying processing.

With reference to the first aspect, in some implementations of the first aspect, the first interface further includes a preview box, the preview box is used for displaying the thumbnail image, and is used for triggering to display the enhanced image, and the second operation is an operation on the preview box or an operation for exiting the first application program.

In the above method, since the user may enter the gallery application program through the preview frame to view the captured image, or may first exit the first application program and then open the gallery application program, the second operation may be an operation of the preview frame or an operation of exiting the first application program.

With reference to the first aspect, in some implementations of the first aspect, when the second operation is an operation on the preview box, displaying the second interface in response to the second operation on the first interface includes:

displaying a third image in a preview frame when the first application program obtains the third image; and responding to a second operation on the preview frame, displaying a second interface, wherein the second interface is an interface of a second application program, and when the electronic equipment displays the second interface, the second application program runs in the foreground and the first application program runs in the background.

The second application may be a gallery application.

In the above method, when the preview frame displays the third image, the user may enter the second application program through the preview frame to view the captured image, so when receiving the operation on the preview frame, the electronic device may display a second interface, where the second interface is an interface of the second application program.

In a second aspect, the present application provides an electronic device comprising one or more processors, a memory and one or more computer programs, wherein the one or more computer programs are stored on the memory, which when executed by the one or more processors, cause the electronic device to perform the image acquisition method of the first aspect and any one of the possible implementations of the first aspect.

In a third aspect, the present application provides a chip system comprising a processor for invoking and running a computer program from a memory, such that an electronic device on which the chip system is installed performs the image acquisition method of the first aspect and any one of the possible implementations of the first aspect.

In a fourth aspect, the present application provides a computer readable storage medium comprising a computer program which, when run on an electronic device, causes the electronic device to perform the image acquisition method of the first aspect and any one of the possible implementations of the first aspect.

In a fifth aspect, the present application provides a computer program product for, when run on a computer, causing the computer to perform the image acquisition method of the first aspect and any one of the possible implementations of the first aspect.

It will be appreciated that the advantages of the second to fifth aspects may be found in the relevant description of the first aspect, and are not described here again.

Drawings

FIG. 1 is a schematic diagram of a human-computer interaction interface provided in the prior art;

FIG. 2 is a schematic diagram of a man-machine interface according to the prior art;

fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

Fig. 4 is a schematic software architecture of an electronic device according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

FIG. 6 is a flowchart of an image capturing method according to an embodiment of the present application;

FIG. 7 is a flowchart of an image capturing method according to an embodiment of the present application;

FIG. 8 is a flowchart of an image capturing method according to an embodiment of the present application;

FIG. 9 is a flowchart of an image capturing method according to an embodiment of the present application;

Fig. 10 is a flowchart of an image acquisition method according to an embodiment of the application.

Detailed Description

In the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c alone may represent: a alone, b alone, c alone, a combination of a and b, a combination of a and c, b and c, or a combination of a, b and c, wherein a, b, c may be single or plural. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

For ease of understanding, the description of the concepts related to the embodiments of the application is given in part by way of example for reference.

1. An initial image.

The initial (raw) image may be understood as an original image obtained by converting the captured light source signal into a digital signal by a photosensitive element of the camera (complementary metal oxide semiconductor (comple mentarymetal oxide semiconductor, CMOS) or charge coupled device (charge coupled device, CCD)).

2. Thumbnail image.

The thumbnail image is a small-sized, low-resolution version of the original image. Thumbnail images are typically used for previewing or quick browsing of the original image content.

In a camera application program, after the electronic equipment completes one shooting, thumbnail images are displayed in a preview frame in a shooting interface; typically, the user can view the electronic device display thumbnail image as the end of one shot.

Thumbnail images are typically small in size, facilitating quick loading and display on the interface, typically only a few tenths of an initial image or even less. Thus, the storage space and the transmission bandwidth can be saved, and the user experience can be improved.

The resolution of the thumbnail image is relatively low, only the overall features of the image are shown, and details are not of interest, so that it is possible to quickly generate and load and still provide good preview results when viewed on a smaller size preview frame.

The foregoing is a simplified description of the terminology involved in the embodiments of the present application, and is not described in detail below.

It can be appreciated that, in electronic devices such as mobile phones and tablet computers, a camera is generally configured, and a camera application program is installed, so that the electronic device can obtain an image acquired by the camera based on the camera application program.

At present, when a camera application program receives shooting operation indicated by a user, an initial image acquired by a camera can be obtained, so that a thumbnail image can be obtained according to the initial image and displayed in a preview frame, and the initial image can be processed to obtain a processed enhanced image, and after the camera application program obtains the enhanced image, the processed enhanced image is stored.

However, in the implementation manner, in the process of obtaining the enhanced image, if the camera application program runs in the background, and abnormal conditions such as insufficient memory resources occur, the electronic device may stop running of the camera application program in the background, so that the camera application program cannot obtain the enhanced image, and further the camera application program does not store the processed or image, which results in the occurrence of a image loss phenomenon, and affects the shooting experience of the user.

Specifically, when the image processing algorithm for processing the initial image is run at a hardware abstraction layer of the electronic device and the thumbnail image is displayed in the preview frame, if a user opens a gallery application program based on the preview frame, the gallery application program runs in the foreground, and the camera application program runs in the background, the priority of the gallery application program running in the foreground is higher than the priority of the camera application program running in the background, at this time, the image processing algorithm occupies the memory of the electronic device in the running process, and the gallery application program of the electronic device or other application programs still running in the foreground may occupy the memory of the electronic device, so that the memory occupation amount of the electronic device is increased, the memory is tense, and abnormal situations such as insufficient memory resources and the like easily occur.

If abnormal conditions such as insufficient memory resources occur, a system low memory termination daemon (low memory killer daemon, LMKD) of the electronic device can kill a camera application program process running in the background, namely, the operation of the camera application program in the background is stopped, so that the camera application program cannot receive an enhanced image processed by an image processing algorithm, further, the enhanced image cannot be stored, and the storage of a source file of the enhanced image to a gallery application program fails.

In addition, when the thumbnail image is displayed in the preview frame, if the user opens the gallery application program based on the preview frame, the gallery application program may display the thumbnail image, and within a preset period of time, if the gallery application program obtains the enhanced image, the electronic device may replace the thumbnail image with the enhanced image, and if the gallery application program does not obtain the enhanced image, the gallery application program may delete the thumbnail image, and there will be no currently photographed image in the electronic device.

Thus, after the user shoots an image based on the camera application program, the user exits the camera application program and enters the interface of the file management application program, the interface of the gallery application program or the sharing interface of the instant messaging application program, and the like, the currently shot image cannot be found, and the scene is a lost image scene of the camera application program.

Based on the foregoing description, in conjunction with fig. 1-2, a detailed description will be given of a method for implementing an image capturing method in the prior art by an electronic device. For convenience of explanation, in fig. 1 to fig. 2, an electronic device is taken as a mobile phone, and a shooting direction of the mobile phone is taken as a vertical screen direction as an example.

Referring to fig. 1-2, fig. 1-2 show a schematic diagram of a man-machine interaction interface provided in the prior art.

The mobile phone may display an interface 11 as shown in fig. 1 (a), and the interface 11 is used to display icons of various Applications (APPs) installed on the mobile phone. For example, control 1001 may be included in interface 11. Wherein control 1001 is used to display an icon of camera APP.

Upon receiving a user-triggered operation (e.g., a click, double click, or long press operation, etc.) on control 1001 of fig. 1 (a), the handset may change from an interface 11 as shown in fig. 1 (a) to an interface 12 as shown in fig. 1 (b).

In fig. 1 (b), the interface 12 may include: control 1002, viewfinder 1003, and preview 1004. The control 1002 is used to trigger the mobile phone to take an image. The viewfinder 1003 is used to display an image captured by the camera. The preview box 1004 is used for displaying a thumbnail image corresponding to the photographed image and triggering the preview of the photographed image stored in the mobile phone. At this time, a thumbnail image corresponding to the initial image last shot by the mobile phone is displayed in the preview box 1004.

After receiving the operation that the user triggers the control 1002 shown in (b) in fig. 1, the camera application program invokes the camera to collect an image through the camera driver of the driving layer, and after the camera collects the initial image, the initial image is sent to the camera application program, the camera application program may send the initial image to the image processing module of the hardware abstraction layer, and the image processing module may generate a thumbnail image through the initial image and send the thumbnail image to the camera application program, so that the mobile phone may change from displaying the interface 12 shown in (b) in fig. 1 to displaying the interface 13 shown in (a) in fig. 2.

In fig. 2 (a), a thumbnail image corresponding to the currently captured image is displayed in a preview box 1004 in the interface 13.

In addition, the image processing module can generate a processed enhanced image through the initial image and send the enhanced image to the camera application program; wherein, the image quality of the enhanced image is higher and the generation time is longer.

Upon receiving the user's operation to trigger the preview pane 1004 shown in fig. 2 (a), the mobile phone may change from displaying the interface 13 shown in fig. 2 (a) to displaying the interface 14 shown in fig. 2 (b).

The interface 14 is an interface of a gallery application program, the gallery application program runs in the foreground, and the camera application program runs in the background, and the running priority of the gallery application program running in the foreground is higher than the running priority of the camera application program running in the background.

At this time, the image processing algorithm used for processing the image in the image processing module occupies the memory of the electronic device, and the gallery application program may also occupy the memory of the electronic device, so that the memory occupation amount of the electronic device is increased, the memory is tense, and abnormal situations such as insufficient memory resources and the like easily occur.

If abnormal conditions such as insufficient memory resources occur in the mobile phone, the system low memory termination daemon can stop running the camera application program process in the background, so that the camera application program cannot receive the processed enhanced image sent by the image processing module.

At this time, the camera application stops running, the camera application does not receive the processed enhanced image sent by the image processing module, and in fig. 2 (b), the image displayed in the interface 12 is the received thumbnail image, which has smaller size, lower resolution and low definition.

In summary, in the prior art, if abnormal situations such as insufficient memory resources occur, the electronic device may stop running the process of the camera application program in the background, so that the camera application program cannot save the processed enhanced image generated by the image processing module of the hardware abstraction layer according to the initial image, resulting in the occurrence of a image loss phenomenon, and affecting the shooting experience of the user.

In view of the foregoing, the present application may provide an image acquisition method, an electronic device, a chip system, a computer readable storage medium, and a computer program product, where when it is detected that a camera application is running in the background, the running priority of the camera application may be updated, so that the priority of the camera application is greater than or equal to the priority of a resident service module in the electronic device and greater than the priority of an application running in the foreground, thereby, the running priority of the camera application may be improved, and it may be prevented that the camera application running in the background is terminated by the electronic device due to insufficient memory resources, etc., so that it may be ensured that the camera application receives an enhanced image obtained by processing an initial image sent by an image processing module, and thus, occurrence of a lost image phenomenon may be avoided, and a photographing experience of a user may be ensured.

The method is not only suitable for detecting that the priority of the operation of the camera application program needs to be improved when the camera application program runs in the background, but also can prevent the camera application program from being stopped by the electronic equipment due to insufficient memory resources and other conditions, so that the camera application program can obtain the scene of the image; the method is also suitable for a scene that when other application programs run in the background, the priority of the running of the other application programs needs to be improved, and the other application programs are prevented from being stopped to run by the electronic equipment due to the conditions of insufficient memory resources and the like, so that the other application programs can execute related tasks.

The electronic device may be an electronic device with a display screen and camera hardware and corresponding software support.

For example, the electronic device may be a mobile phone, a tablet computer, a vehicle-mounted device, a notebook computer, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), a smart car, a smart television, a robot, or the like.

It should be noted that, in some possible implementations, the electronic device may also be referred to as a terminal device, a User Equipment (UE), or the like, which is not limited by the embodiment of the present application.

For convenience of description, fig. 3 illustrates an electronic device 100 as an example of a mobile phone.

As shown in fig. 3, in some embodiments, the electronic device 100 may include a processor 101, a communication module 102, a display screen 103, and the like.

The processor 101 may include one or more processing units, for example: processor 101 may include an application processor (application processor, AP), a modem processor, a graphics processor, an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video stream codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural-Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors 101.

The controller may be a neural hub and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 101 for storing instructions and data.

The communication module 102 may include an antenna 1 and an antenna 2, a mobile communication module, and/or a wireless communication module.

The display screen 103 is used for displaying images or videos in a human-computer interaction interface. The display screen 103 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an organic light-emitting diode (OLED), an active-matrix organic LIGHT EMITTING diode (AMOLED), a flexible light-emitting diode (FLED), miniLED, microLED, a Micro-OLED, a quantum dot LIGHT EMITTING diodes (QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 103, N being a positive integer greater than 1.

The camera 104 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 may include 1 or N cameras 104, N being a positive integer greater than 1.

As shown in fig. 3, in some embodiments, the electronic device 100 may further include a sensor 105, an internal memory 106, an external memory interface 107, a USB interface 108, a charge management module 109, a power management module 110, a battery 111, and the like.

The charge management module 109 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger.

In some wired charging embodiments, the charging management module 109 may receive a charging input of a wired charger through the USB interface 108.

In some wireless charging embodiments, the charge management module 109 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 109 may also supply power to the electronic device 100 through the power management module 110 while charging the battery 111.

Optionally, the electronic device 100 may also include peripheral devices such as a mouse, keys, indicator lights, keyboard, speakers, microphone, etc.

It is to be understood that the structure illustrated in the present embodiment does not constitute a specific limitation on the electronic apparatus 100.

In other embodiments, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Fig. 4 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application. When the image acquisition method provided by the embodiment of the present application is applied to the electronic device 100 shown in fig. 4, software in the electronic device 100 may be divided into an application layer 201, an application framework layer (FWK) 202, a hardware abstraction layer (hardware abstraction layer, HAL) 203, and a driver layer 204 as shown in fig. 4.

The application layer 201 may have a plurality of applications installed therein, and may include a camera application (camera application) for implementing a photographing function.

The camera application program refers to a computer program running on an operating system and capable of executing a photographing task.

In the embodiment of the present application, the camera application may be an application having a photographing function. For example, an application program with a function of sharing short video may be used as the camera application program in the embodiment of the present application if the application program has a shooting function.

The electronic device may turn on a keep-alive function of the camera application, where the keep-alive function is used to keep the camera application in a continuously running state, so as to keep functional usability of the camera application, for example, a background receives an image corresponding to the thumbnail image generated by the image processing algorithm.

Application framework layer 202 the application framework layer provides a basic set of functions and services that are invoked and used by the application layer 201.

The application framework layer 202 may include, among other things, resident service modules and system management service modules.

The resident service module can be any resident service module in the application framework layer 202, and is characterized in that the resident service module is started when the electronic equipment is started and closed when the electronic equipment is shut down.

For example, the resident service module may be a memory lookup module.

The system management service module is used for managing and controlling the life cycle of the application program, starting and destroying the components of the application program and processing system-level events, and can detect whether the application program runs in the foreground.

The hardware abstraction layer 203 is a piece of software located between the operating system kernel and the hardware circuitry, and is typically used to abstract the hardware to implement the interaction between the operating system and the hardware circuitry at the logic level. In an embodiment of the present application, the hardware abstraction layer 203 may include a camera hardware abstraction layer (CAMERA HARDWARE Abstraction Layer, CAMERA HAL) that enables a camera application to interact with a camera at a logical layer.

The hardware abstraction layer 203 may include an image processing module, which is configured to run an image processing algorithm, where the image processing algorithm is configured to generate a thumbnail image from an initial image, and generate an enhanced image from the initial image.

The driver layer 204 may have a plurality of drivers (drivers) installed therein for driving the hardware operation.

Wherein the driving layer 204 may include a camera driver. The camera driver is connected with the camera 104 and is used for driving the camera 104 to collect images.

It should be noted that, other contents may be included in the application layer 201, the application framework layer 202, the hardware abstraction layer 203, and the driver layer 204, which are not limited in detail herein.

Based on the foregoing description, with reference to fig. 5, an image acquisition method implemented by an electronic device according to an embodiment of the present application will be described in detail. For convenience of explanation, in fig. 5, an electronic device is taken as a mobile phone, and a shooting direction of the mobile phone is taken as a vertical screen direction as an example.

Referring to fig. 5, fig. 5 is a schematic diagram illustrating a man-machine interaction interface according to an embodiment of the application.

When the camera application program is detected to run in the background, the running priority of the camera application program can be updated, so that the priority of the camera application program is greater than or equal to the priority of a resident service module in the electronic equipment and greater than the priority of the application program running in the foreground, and the running priority of the camera application program can be improved.

In the process that the image processing module generates the enhanced image according to the initial image, if abnormal conditions such as insufficient memory resources and the like occur in the mobile phone, the system kills a process with low priority, namely, stops running, namely, if abnormal conditions such as insufficient memory resources and the like occur in the mobile phone, the system stops running of an application program of a foreground and running of a resident service module preferentially, and finally stops running of a camera application program at a background, so that the camera application program is difficult to stop running by the system, and the camera application program is ensured to be capable of receiving the processed image sent by the image processing module.

If the camera application receives the processed enhanced image sent by the image processing module, after receiving the operation of triggering the preview pane 1004 shown in fig. 2 (a), the mobile phone may change from displaying the interface 13 shown in fig. 2 (a) to displaying the interface 15 shown in fig. 5.

In fig. 5, the image displayed in the interface 15 is the processed enhanced image received by the camera application program, and has larger size, higher resolution and higher definition.

In summary, when the camera application program runs in the background, the priority of the camera application program is improved, so that the camera application program can receive the enhanced image sent by the image processing module, the occurrence of the phenomenon of image loss can be avoided, and when a user looks over the shot image, the user can see the processed image with higher quality, thereby ensuring the shooting experience of the user.

Based on the above description of the scene, the electronic device is taken as an example, and the image acquisition method provided by the embodiment of the application is described in detail with reference to the attached drawings and application scene.

Referring to fig. 6, fig. 6 is a flowchart illustrating an image acquisition method according to an embodiment of the application.

As shown in fig. 6, the image acquisition method provided by the present application may include:

S11, the camera application program displays a first interface, wherein the first interface comprises a shooting control.

The electronic device may display the first interface in a plurality of ways.

In some embodiments, the electronic device includes a camera Application (APP), and after receiving an operation (such as clicking, double clicking, or long clicking) triggered by a user on an icon of the application, the electronic device may display an interface, where the interface is the first interface.

In other embodiments, the electronic device includes a camera application, a voice assistant is added to the electronic device, after receiving a specific wake word input by a user, the voice assistant can wake up, and after receiving an instruction to open the camera application input by the user, the electronic device can display an interface, where the interface is a first interface.

For example, the voice assistant may be YOYO, after receiving "hello" of the user voice input, YOYO may wake up to YOYO, and after receiving the voice indication "open camera application" of the user voice input, the electronic device may display the first interface.

The camera application program can be a system camera application program or a third-party camera application program; the application is not limited to the type of camera application.

S12, the camera application program responds to the first operation of the first interface and sends a shooting request to the camera driver.

Wherein the first operation may be accomplished in a variety of ways.

In some embodiments, the first operation may be a click operation; the first interface may include a first control, where the first control is used to trigger shooting an image, and after the electronic device detects a click operation on the first control, the camera application may send a shooting request to the camera driver in response to the click operation.

The application does not limit the parameters such as the display position, the display style, the display size and the like of the first control.

In other embodiments, the first operation may be a voice operation; the electronic equipment is added with a voice assistant, after receiving a specific wake-up word input by the voice of the user, the voice assistant can wake up, and after receiving an indication of a shooting image input by the voice of the user, the camera application program can send a shooting request to the camera driver.

For example, the voice assistant may be YOYO, after receiving "hello" of the user voice input, YOYO may wake up yoyoyo, and after receiving the voice indication "take image" of the user voice input, the camera application may send a take request to the camera driver.

It should be appreciated that the above description is exemplified with the first operation being a click operation or a voice operation; the first operation may also be an operation of instructing to take an image by other means, and the present application is not limited to the first operation.

The shooting request is used for indicating the camera to drive and call the camera to collect images.

The camera application program sends a shooting request to the camera driver, so that the camera driver can call the camera to collect images.

S13, driving the camera to call the camera.

The camera driver is a module used for calling the camera in a driving layer of the electronic equipment.

After receiving a shooting request sent by a camera application program, the camera can call the camera, so that the camera is convenient to collect images.

S14, the camera performs image acquisition to obtain an initial image.

The initial image is an original image obtained by converting the captured light source signals into digital signals by the camera.

It can be understood that, when the camera application program displays the first interface, the camera application program can call the camera through the camera drive to continuously collect images, and the initial image is a frame of image collected by the camera when the camera application program receives the first operation.

S15, the camera sends an initial image to the camera application program through the camera driver.

Based on S14, the camera may collect the initial image, and thus, the initial image may be sent to the camera driver, and the camera driver may send the initial image to the camera application program after receiving the initial image, so that the camera application program may further process the initial image.

S16, when the camera application program receives the initial image, the camera application program sends the initial image to the image processing module.

The image processing module is a software module in an application program framework layer of the electronic device. The image processing module is used for running an image processing algorithm, and the image processing algorithm is used for generating a thumbnail according to the initial image and generating an enhanced image according to the initial image.

When the camera application program receives the initial image, the camera application program can send the initial image to the image processing module, so that the image processing module can further process the initial image.

In some embodiments, the image processing module further processing the initial image may include: a thumbnail image is generated from the initial image and/or an enhanced image is generated from the initial image.

S17, the image processing module processes the initial image to generate a thumbnail image.

It should be appreciated that after the electronic device obtains the initial image, a thumbnail image needs to be displayed in the preview box of the first interface, so that the user can preview and view the image photographed at this time.

In some embodiments, the image processing module may execute a first image processing algorithm for compressing the initial image to obtain a thumbnail image, and generate a thumbnail image from the initial image.

In another embodiment, the size of the thumbnail image may be different from the initial image, and the first image processing algorithm may further adjust the size of the initial image to obtain a thumbnail image having a preset size.

The first image processing algorithm may include an algorithm that compresses the initial image.

The first image processing algorithm may further include an algorithm for adjusting the size of the thumbnail image, the algorithm being for adjusting the size of the thumbnail image to a preset size.

The application can store the first image processing algorithm in the electronic device and/or the storage device communicated with the electronic device, and is convenient for the electronic device to call the first image processing algorithm to generate the thumbnail image according to the initial image.

In addition, the processing duration of the first image processing algorithm is short, the image processing module can quickly obtain the thumbnail images and send the thumbnail images to the camera application program, the camera application program can be guaranteed to obtain and display the thumbnail images in advance, a user feels that the shooting speed of the electronic equipment is improved, and the shooting experience of the user can be improved.

S18, the image processing module processes the initial image to generate an enhanced image.

It should be understood that, under the influence of ambient light, weather, etc., the quality of the initial image obtained by the camera may be relatively low, and after the initial image is obtained, the image processing module may further perform enhancement processing on the initial image, so as to obtain an image with higher quality.

Wherein the enhancement process includes one or more of brightness adjustment, exposure adjustment, contrast adjustment, sharpening process, hue process, saturation adjustment, color temperature adjustment, and beauty treatment.

In some embodiments, the image processing module may run a second image processing algorithm to enhance the initial image to obtain an enhanced image.

The second image processing algorithm may include one or more of an algorithm for adjusting brightness, an algorithm for adjusting exposure, an algorithm for adjusting contrast, an algorithm for sharpening, an algorithm for hue, an algorithm for adjusting saturation, an algorithm for adjusting color temperature, and an algorithm for beauty treatment, among others.

For example, the second image algorithm includes an algorithm for sharpening processing, an algorithm for adjusting saturation, and an algorithm for beautifying processing, and then the enhanced image obtained by the enhancement processing is an image obtained by subjecting the initial image to sharpening processing, saturation adjustment, and beautifying processing.

Based on the method, the image processing module carries out enhancement processing on the initial image, the obtained enhanced image is an image with higher quality, so that a user can see the image with higher quality when looking over the shot image, and the shooting experience of the user is ensured.

It should be noted that, the second image processing algorithm for obtaining the enhanced image with higher quality is generally run for a longer time than the first image processing algorithm for obtaining the thumbnail image, and the image processing module may not obtain the enhanced image after the camera application displays the thumbnail image in the preview frame.

Wherein, S17 and S18 may be performed simultaneously or sequentially.

S19, the image processing module sends the thumbnail image to the camera application program.

Based on S17, the image processing module may obtain the thumbnail image, and thus, the image processing module may transmit the thumbnail image to the camera application program, so that the camera application program may display the thumbnail image.

S20, the camera application program displays the thumbnail image in a preview box of the first interface.

The first interface may further include a preview box, where the preview box is configured to display a thumbnail image corresponding to the captured image, and trigger to view the captured image stored in the mobile phone.

After receiving the thumbnail images, the camera application program can save the thumbnail images and display the thumbnail images in a preview frame, so that a user can preview and view the currently shot images in time.

It should be understood that, before receiving the thumbnail image corresponding to the initial image currently acquired, the preview frame of the first interface displays the thumbnail image corresponding to the initial image acquired last time by the camera, as shown in (b) of fig. 1; after receiving the thumbnail image corresponding to the initial image currently acquired, the camera application may replace the thumbnail image obtained last time with a new thumbnail image, as shown in (a) of fig. 2, thereby realizing the update of the thumbnail image.

Based on the above description, the image processing module may directly generate the thumbnail image according to the initial image and send the thumbnail image to the camera application program, where the camera application program may display the thumbnail image through the preview frame, instead of sending the thumbnail image to the camera application program after obtaining the enhanced image with higher quality according to the initial image, where the camera application program obtains the thumbnail image according to the enhanced image and displays the thumbnail image through the preview frame, so that by means of obtaining and displaying the thumbnail image in advance, the user perceives that the shooting speed of the electronic device is improved, and the shooting experience of the user may be improved.

S21, the system management service module detects that the camera application program runs in the background.

The system management service module is a software module of an application program framework layer of the electronic equipment; the system management service module is used for managing and controlling the life cycle of the application program, starting and destroying the components of the application program and processing system-level events.

Wherein the camera application displays an interface of the camera application and may indicate that the camera application is running in the foreground in response to a user operation and when providing real-time updated content or functionality.

For example, when a camera application displays an interface, a user may take an image, take a video, based on the interface, while the camera application is running in the foreground.

Similarly, the camera application does not display the interface of the camera application, but continues to perform some tasks in the background, indicating that the camera application is running in the background.

The background application is not visible to the user. The resource usage of background applications is often limited to preserve the performance and battery life of the electronic device. That is, the operation priority of the background application program is low, and if the situation of insufficient memory resources and the like occurs, the application program operated in the background can be stopped by the electronic device.

For example, when the camera application does not display an interface, but still continues in the background to perform the task of receiving the thumbnail image, enhancing the image, and the like sent by the image processing module, the camera application runs in the background.

There may be a number of situations where the system management service module detects that the camera application is running in the background.

It should be appreciated that after the current shot is completed, the user may have a need to view the shot image immediately, and the user may view the shot image through an entry into the gallery application provided by the preview box in the first interface.

In some embodiments, upon receiving a user operation on the preview pane, the electronic device may switch from the interface of the camera application to the interface of the gallery application, thereby causing the system management service module to detect that the camera application is running in the background.

It should also be appreciated that the user may also exit the camera application through a related operation and open the gallery application or file management application again, etc., to view the captured image.

In other embodiments, upon receiving the exit operation, the camera application may exit the foreground operation, thereby causing the system management service module to detect that the camera application is running in the background.

S22, the system management service module sends a starting request to the camera application program.

The starting request is used for indicating the camera application program to start the keep-alive function; the keep-alive function is used for keeping the camera application program in a state of continuous running in the background so as to keep the function availability of the camera application program in the background running, for example, the background receives images, and the camera application program can be prevented from being closed by the system.

The keep-alive function is a service of a system empty load which is self-defined in the camera application program, is a service which runs in the system and has no actual business logic, and the camera application program can periodically send some empty commands or execute some operations without actual effects through the keep-alive function so as to maintain the running state of the camera application program.

Based on the above, when the camera application program is detected to run in the background, the system management service module can send a starting request to the camera application program to instruct the camera application program to start the keep-alive function, so that the camera application program runs continuously in the background, and the camera application program can be ensured to receive the image sent by the image processing module.

S23, the camera application program starts a keep-alive function.

When a starting request sent by the system management service module is received, the camera application program can start a keep-alive function to keep the camera application program to run continuously in the background, and the camera application program is prevented from being closed or terminated in the background due to insufficient system memory resources or other factors.

S24, the camera application program sends a binding request to the resident service module.

Wherein the binding request is used to indicate that the resident service module is bound to the keep-alive functionality.

It should be understood that the resident service module is a software module in the application framework layer of the electronic device; the resident service module has the characteristics of being started when the electronic equipment is started and being closed when the electronic equipment is shut down, namely, the resident service module can normally run after the electronic equipment is started and before the electronic equipment is shut down and can not be stopped by the system.

Specifically, the system resident service module typically does not need to interact with the user, but has a need to run continuously, such as background downloads, task scheduling, and the like. The system resident services module is generally considered to be a support for system stability and function operation, and therefore enjoys a higher priority on system resource allocation to ensure proper operation.

In some embodiments, the resident service module may be a memory kill service (INTELLIGENT ANTI-MALWARE AND REAL-time encryption, IWARE) that is started when the electronic device is powered on, and the memory kill service is generally used to detect and clear malware or abnormal processes in the memory, so as to ensure safe and stable operation of the system.

In other embodiments, the resident service module may be a broadcast service that is started when the electronic device is powered on, and the broadcast service module is typically used for information transfer and propagation to ensure safe and stable operation of the system.

The present application is not particularly limited as to the type of resident service module.

The binding request comprises a binding mechanism, wherein the binding mechanism is that the operation priority of the camera application program is greater than or equal to the priority of the resident service module.

The binding mechanism, in which the value of the foreground application may be set to 0, may indicate the size of the priority through the Adj field, with smaller values indicating lower priorities.

It should be understood that, generally, the running priority of the background application is lower than that of the foreground application, and lower than that of the resident service module, and if the camera application runs in the background, the running application in the background may be stopped by the electronic device preferentially if the situation of insufficient memory resources and the like occurs.

After the keep-alive function is started, the camera application program can send a binding request to the resident service module, so that the resident service module can be conveniently bound with the keep-alive function based on the binding request, and the running priority of the camera application program is higher than or equal to the priority of the resident service module on the basis of continuous running of the camera application program in the background.

In addition, it should be noted that, generally, the operation priority of the resident service module is greater than that of the foreground application, so if the resident service module is bound to the keep-alive function, the operation priority of the camera application corresponding to the keep-alive service is greater than or equal to that of the resident service, and the priority of the resident service module is greater than that of the application running in the foreground.

S25, binding the resident service module with the keep-alive function.

It should be appreciated that the priority of the application running in the background is less than the running priority of the resident service module and less than the priority of the application running in the foreground before the resident service module is bound to the keep-alive function.

The implementation process of binding the resident service module and the keep-alive function is as follows: setting the operation priority of the camera application program corresponding to the keep-alive service to be greater than or equal to the operation priority of the resident service, wherein the priority of the resident service module is greater than the operation priority of the application program operated by the foreground.

It can be seen that after the resident service module is bound to the keep-alive function, the priority of the camera application program running in the background is greater than or equal to the running priority of the resident service module, and the priority of the resident service module is greater than the priority of the application program running in the foreground.

For example, the application program operated in the foreground is a gallery application program, and then after the resident service module is bound with the keep-alive function, the operation priority of the camera application program is greater than or equal to the operation priority of the resident service module, and the priority of the resident service module is greater than the operation priority of the gallery application program.

When the operation priority of the camera application program is greater than or equal to the operation priority of the resident service module, and the priority of the resident service module is greater than the operation priority of the application program operated by the foreground, if the conditions of insufficient memory resources and the like occur, the application program operated by the foreground can be preferentially stopped by the electronic device, and if the conditions of insufficient memory resources and the like occur again, compared with the camera application program, the operation of the resident service module and the application program operated by the foreground can be preferentially stopped by the electronic device, so that the image sent by the image processing module can be received.

That is, when the camera application program runs in the background, the running priority of the camera application program can be improved by dynamically adjusting the priority, so that the camera application program runs continuously in the background and is not easy to be terminated by the system, and the camera application program can be ensured to receive the image sent by the image processing module.

In some embodiments, the resident service module implementing the binding process may be implemented by a bind service (bind service) method in a system of the electronic device.

The binding service is a mechanism for allowing a binding relationship to be established between an application program and a system service module.

S26, the image processing module sends a processing message to the camera application program.

Wherein the processing message is used to represent the processing result of the image processing module, the processing message may include the enhanced image.

In some embodiments, based on S25, since the operation priority of the camera application is greater than or equal to the priority of the resident service module, and the priority of the resident service module is greater than the priority of the application operated in the foreground, the operation of the camera application in the background is not easy to terminate, the image processing module can process the initial image, generate the enhanced image, and send a processing message including the enhanced image to the camera application.

S27, the camera application program stores the enhanced image.

Based on S26, the camera application may obtain the enhanced image, and thus, the camera application may save the enhanced image.

In some embodiments, the camera application may save the enhanced image to a gallery application.

In the application, when the system management service module detects that the camera application program runs in the background, the camera application program can start the keep-alive function through the starting request, and the resident service module and the keep-alive function are bound through the binding request, so that the camera application program is ensured to run continuously, the running priority of the camera application program corresponding to the keep-alive function is higher than the priority of the resident service module, and the priority of the resident service module is higher than the priority of the application program running in the foreground, therefore, the camera application program can be continuously in a state with higher running priority, the condition that the camera application program running in the background is terminated due to insufficient memory resources can be avoided as far as possible, the camera application program can receive the enhanced image sent by the image processing module, and the shooting experience of a user can be improved based on the fact that the image loss phenomenon is prevented.

Specifically, in conjunction with the descriptions of S26 and S27 in fig. 6 above, after the resident service module is bound to the keep-alive function, various situations may occur:

In case 1, the image processing module finishes processing within a preset duration, or the processing duration is longer than or equal to the preset duration, and sends a processing message to the camera application program, where the processing message may indicate that the image processing is successful, or may indicate that the image processing is failed.

And 2, the camera application program does not receive the processing message within the preset time.

And 3, detecting that the camera application program runs in the foreground by the system management service module.

Based on the above description, the electronic apparatus may employ the following manner for case 1.

Next, the specific implementation procedure of case 1 of the present application will be described in detail with reference to fig. 7.

Referring to fig. 7, fig. 7 is a flowchart illustrating an image acquisition method according to an embodiment of the application.

As shown in fig. 7, the image acquisition method provided by the present application may include:

S31, the image processing module finishes processing within a preset time length, or the processing time length is longer than or equal to the preset time length, and sends a processing message to the camera application program.

Wherein the processing message is used for representing the processing result of the image processing module. There may be a variety of situations in which a message is processed.

In some embodiments, based on S25 that the running priority of the camera application is greater than or equal to the priority of the resident service module, and the priority of the resident service module is greater than the priority of the application running in the foreground, the running of the camera application in the background is not easy to terminate, and the image processing module can process the initial image within the preset duration, generate the enhanced image, and send the processing message to the camera application.

If the image processing module can process the initial image within the preset duration to obtain the enhanced image, the processing message carries the enhanced image obtained according to the initial image.

In other embodiments, when the processing time period is greater than or equal to the preset time period, the image processing module may send a processing message to the camera application program without processing the enhanced image by the second image processing algorithm.

If the processing time is overtime, the processing time length is longer than or equal to the preset time length, and the processing information is used for indicating that the image processing module is processing the initial image.

In other embodiments, when the second image processing algorithm fails, such that the processing time period is greater than or equal to the preset time period, the image processing module may send a processing message to the camera application program without processing the enhanced image by the second image processing algorithm.

If the second image processing algorithm fails, the processing time length is longer than or equal to the preset time length, and the processing information carries an error code which is used for indicating that the second image processing algorithm fails to process the initial image.

S32, the camera application program judges whether the image processing is successful or not.

Wherein the camera application may determine that the image processing was successful when the enhanced image is carried in the processing message.

The camera application may determine that the image processing failed when the enhanced image is not carried in the processing message.

When the image processing is successful, the camera application may execute S33; upon failure of image processing, the camera application may execute S34.

S33, the camera application program stores the enhanced image.

Based on S32, if the image processing is successful, the camera application may obtain the enhanced image, and thus, the camera application may save the enhanced image.

If the image processing fails, when the operation of the user on the preview frame is received, the electronic device switches from the interface of the camera application program to the interface of the gallery application program, and at this time, the image displayed on the interface of the gallery application program is a thumbnail image; if the image processing is successful, the electronic device can replace the saved thumbnail image with the enhanced image, and at this time, the image displayed on the interface of the gallery application program is the enhanced image.

S34, the camera application program sends a unbinding request to the resident service module.

The unbinding request is used for indicating that the resident service module is unbinding from the keep-alive function.

When the image processing is successful, the camera application program can obtain the enhanced image without binding the resident service module with the keep-alive function, so that the priority of the camera application program is improved, and therefore, the camera application program can send a unbinding request to the resident service module, and unbinding of the resident service module with the keep-alive function is facilitated.

When the image processing fails, the camera application program can not obtain the enhanced image, and the resident service module and the keep-alive function are not required to be bound, so that the priority of the camera application program is improved, and therefore, the camera application program can send a unbinding request to the resident service module, and the resident service module and the keep-alive function are conveniently unbinding.

S35, the resident service module is unbound with the keep-alive function.

The implementation process of unbinding the resident service module and the keep-alive function is as follows: the priority order of the camera application program, the foreground running application program and the resident service module corresponding to the updated keep-alive function is the priority order before the resident service module is bound with the keep-alive function.

It should be appreciated that the priority of the application running in the background is less than the priority of the application running in the foreground and less than the running priority of the resident service module before the resident service module is bound to the keep-alive function.

Then, after the resident service module is unbound with the keep-alive function, the priority of the application program running in the background is smaller than the priority of the application program running in the foreground, and is smaller than the running priority of the resident service module, i.e. the priority of the camera application program corresponding to the keep-alive function is smaller than the priority of the application program running in the foreground, and is smaller than the running priority of the resident service module.

When the camera application program is not required to be in a state with higher running priority, the priority of the camera application program is restored to the state before binding, so that the camera application program is prevented from being in a state with higher running priority, and normal running of resident service modules or other application programs in other electronic equipment is prevented from being influenced.

S36, the resident service module sends a closing request to the camera application program.

Wherein S36 is an optional step.

In some embodiments, the camera application may directly perform S37 while performing S34 after performing S33.

In other embodiments, the camera application may perform S37 after performing S34.

In other embodiments, the resident service module may send a shutdown request to the camera application after executing S35, and the camera application may execute S37 based on the shutdown request.

Wherein the close request is used to instruct the camera application to close the keep-alive functionality.

When the image processing is successful, the camera application program can obtain the enhanced image, and the camera application program is enabled to continuously run in the background without a keep-alive function; when the image processing fails, the camera application program can not obtain the enhanced image, and the camera application program can continue to run in the background without the keep-alive function, so that after the resident service module is unbound with the keep-alive function, a closing request can be sent to the camera application program, and the camera application program can send the function of closing the keep-alive.

S37, the camera application program closes the keep-alive function.

Based on S36, after receiving the shutdown request, the camera application may shutdown the keep-alive function, thereby avoiding that the camera application is continuously in a state with a higher operation priority, and affecting the normal operation of software modules or applications in other electronic devices.

In the application, when the system management service module detects that the camera application program runs in the background, the camera application program can start the keep-alive function through the starting request, and the resident service module and the keep-alive function are bound through the binding request, so that the running priority of the camera application program corresponding to the keep-alive function is higher than the running priority of the resident service module on the basis of ensuring that the camera application program can run continuously, the camera application program can be in a state with higher running priority, and thus, the condition that the camera application program running in the background is terminated due to insufficient memory can be avoided as far as possible, the camera application program can receive the enhanced image sent by the image processing module within the preset time, and on the basis, the occurrence of the phenomenon of losing images can be prevented, and the shooting experience of a user can be improved.

In addition, when the processing time is longer than or equal to the preset time, the image processing module may not obtain the enhanced image, and the camera application program may be notified by the processing message, and the camera application program may unbind the resident service module and the keep-alive function by unbinding the request, and the resident service module may close the keep-alive function by closing the request, so that the camera application program is prevented from being in a state with higher running priority continuously, and the normal running of software modules or application programs in other electronic devices is prevented from being affected.

In addition, after the camera application program receives the enhanced image sent by the image processing module within the preset time, the camera application program is not required to be in a state with higher running priority, so that the camera application program can unbind the resident service module and the keep-alive function through unbinding the request, and the resident service module can close the keep-alive function through closing the request, so that the camera application program is prevented from being in a state with higher running priority, and the normal running of software modules or application programs in other electronic equipment is prevented from being influenced.

Based on the description of the embodiment described above with respect to fig. 7, the electronic device may employ the following manner for case 2.

Next, the detailed implementation procedure of case 2 of the present application will be described in detail with reference to fig. 7.

Referring to fig. 8, fig. 8 is a flowchart illustrating an image acquisition method according to an embodiment of the application.

As shown in fig. 8, the image acquisition method provided by the present application may include:

s41, the camera application program does not receive the processing message within a preset time period.

In the running process of the algorithm for generating the enhanced image from the initial image, if the conditions of insufficient memory resources and the like occur, the electronic device can kill the algorithm for generating the enhanced image from the initial image, namely, the running of the algorithm for generating the enhanced image from the initial image is terminated, so that the image processing module cannot send a processing message to the camera application program.

In some embodiments, when the electronic device terminates the execution of the algorithm that generates the enhanced image from the initial image, the image processing module has not yet obtained the enhanced image, and then the image processing module cannot continue to generate the enhanced image, and the image processing module cannot send a processing message to the camera application.

In some embodiments, when the electronic device terminates the execution of the algorithm that generates the enhanced image from the initial image, the image processing module has obtained the enhanced image, and then the image processing module cannot send the enhanced image to the camera application.

Based on this, if the electronic device terminates the operation of the algorithm that generates the enhanced image, the image processing module will not send a processing message to the camera application, which will not receive the processing message within the preset time period.

S42, the camera application program sends a unbinding request to the resident service module.

When the camera application program does not receive the processing message within the preset time length, which means that the camera application program can not receive the enhanced image, the camera application program does not need to bind the resident service module with the keep-alive function, so that the priority of the camera application program is improved, and therefore, the camera application program can send a unbinding request to the resident service module, and the resident service module is conveniently unbinding with the keep-alive function.

S43, the resident service module is unbound with the keep-alive function.

The implementation of S43 is similar to that of S35 in the embodiment shown in fig. 7, and will not be described herein.

S44, the resident service module sends a closing request to the camera application program.

The camera application program does not receive the processing information within the preset time length, which means that the camera application program can not receive the enhanced image, and then the camera application program does not need to continuously run in the background through the keep-alive function, so that after the resident service module and the keep-alive function are unbound, a closing request can be sent to the camera application program, and the camera application program can conveniently send the closing keep-alive function.

S45, the camera application program closes the keep-alive function.

The implementation of S45 is similar to that of S37 in the embodiment shown in fig. 7, and will not be described herein.

In the application, if the conditions of insufficient memory resources and the like occur, the electronic equipment can terminate the operation of the algorithm for generating the enhanced image, then the image processing module can not send a processing message to the camera application program, the camera application program can not receive the processing message within the preset time, and the camera application program can not receive the enhanced image, then the camera application program does not need to bind the resident service module with the keep-alive function, so that the priority of the camera application program is improved, the resident service module and the keep-alive function can be unbound through the unbinding request, and the resident service module can close the keep-alive function through the closing request, so that the camera application program is prevented from being continuously in a state with higher operation priority, and the normal operation of resident software modules or other application programs in other electronic equipment is prevented from being influenced.

Based on the description of the embodiments described above with respect to fig. 6 and 7, the electronic device may employ the following manner for case 3.

Next, the detailed implementation procedure of case 3 of the present application will be described in detail with reference to fig. 9.

Referring to fig. 9, fig. 9 is a flowchart illustrating an image acquisition method according to an embodiment of the application.

As shown in fig. 9, the image acquisition method provided by the present application may include:

S51, the system management service module detects that the camera application program runs in the foreground.

There are various situations, in which the camera application is triggered to run in the foreground, so that the system management service module can detect that the camera application runs in the foreground.

In some embodiments, the electronic device currently displays an interface of a gallery application, the gallery application is running in the foreground, the camera application has received the enhanced image, the interface of the gallery application has displayed the enhanced image, and upon receiving a user-indicated operation to open the camera application, the electronic device displays the interface of the camera application, the camera application is running in the foreground.

It should be appreciated that if the image camera application has received an enhanced image, the user has seen the enhanced image based on the gallery application, whereby the user may want to capture the image again, performing an operation of opening the camera application.

In other embodiments, the electronic device displays an interface of a gallery application, the gallery application is running in the foreground, the algorithm for generating the enhanced image is still running, the camera application has not received the enhanced image, and when an operation of opening the camera application indicated by a user is received, the electronic device displays the interface of the camera application, and the camera application is running in the foreground.

It should be appreciated that even though the image camera application has not received the enhanced image, the user may want to capture the image again, performing the operation of opening the camera application.

The application does not limit the mode of triggering the camera application program to run in the foreground.

It should be noted that, in general, the running priority of the application program running in the foreground is greater than the running priority of the application program running in the background, and if the system management service module detects that the camera application program runs in the foreground, the running priority of the camera application program is higher, so that the enhanced image sent by the image processing module can be received.

Based on the above description, if the system management service module detects that the camera application is running in the foreground, the camera application does not need to keep the keep-alive function open, nor does the resident service module need to bind with the keep-alive function.

S52, the system management service module sends a unbinding request to the camera application program.

The system management service module detects that the camera application program runs in the foreground, and indicates that the priority of the camera application program is restored, at the moment, the camera application program does not need the keep-alive function any more, and the resident service module and the keep-alive function do not need to be bound, so that the system management service module can send a unbinding request to the camera application program, and the camera application program can send the unbinding request to the resident service module conveniently, so that the resident service module and the keep-alive function are unbinding.

S53, the camera application program sends a unbinding request to the resident service module.

The system management service module detects that the camera application program runs in the foreground, and indicates that the priority of the camera application program is restored, at this time, the priority of the camera application program is higher, and the operation of the camera application program is not easy to be terminated by the electronic equipment due to factors such as insufficient system memory, and the resident service module and the keep-alive function are not required to be bound, so that the priority of the camera application program is improved, and therefore, the camera application program can send a unbinding request to the resident service module, and unbinding of the resident service module and the keep-alive function is facilitated.

S54, the resident service module is unbound with the keep-alive function.

The implementation of S54 is similar to that of S35 in the embodiment shown in fig. 7, and will not be described herein.

S55, the resident service module sends a closing request to the camera application program.

Based on the above description, the system management service module detects that the camera application program runs in the foreground, which indicates that the priority of the camera application program is restored, and then the camera application program does not need to pass through the keep-alive function, so that the camera application program continues to run in the background, and after the resident service module is unbound with the keep-alive function, a closing request can be sent to the camera application program, so that the camera application program can send the function of closing the keep-alive.

S56, the camera application program closes the keep-alive function.

The implementation of S56 is similar to that of S37 in the embodiment shown in fig. 7, and will not be described herein.

In the application, the system management service module detects that the camera application program runs in the foreground, which means that the priority of the camera application program is restored, at the moment, the priority of the camera application program is higher, and the camera application program is not easy to be stopped by the electronic equipment due to factors such as insufficient system memory resources, and the like, then the camera application program does not need to be bound with the keep-alive function, so that the priority of the camera application program is improved, the camera application program can be unbound with the keep-alive function through a unbinding request, the resident service module can be unbound with the keep-alive function, and the resident service module can be closed through a closing request, so that the camera application program is prevented from being continuously in a state with higher running priority, and the normal running of software modules or application programs in other electronic equipment is influenced.

Based on the foregoing embodiments, the image acquisition method provided by the present application is described below.

Illustratively, the present application provides an image acquisition method.

For ease of illustration, the image acquisition method of the present application may be performed by the electronic device of FIG. 3.

Referring to fig. 10, fig. 10 is a flowchart illustrating an image acquisition method according to an embodiment of the application.

As shown in fig. 10, the image acquisition method provided by the present application may include:

S301, displaying a first interface, wherein the first interface is an interface of a first application program in the electronic equipment.

The first interface may refer to the interface 11 shown in fig. 1 (b), and the related description about the first interface in fig. 6 is not repeated herein.

The specific implementation of S301 may be referred to the description related to (b) in fig. 1, and the description related to S11 in fig. 6, which are not described herein.

S302, responding to a first operation of a first interface, acquiring a first image, wherein the first operation is shooting operation, and the first image is an initial image acquired by a camera of the electronic equipment.

The first operation may refer to the operation of the control 1002 in (b) in fig. 1, and the related description about the first operation in fig. 6 is not repeated herein.

The first image may refer to an image in the viewfinder 1003 in fig. 1 (b), and a related description about the initial image in fig. 6, which will not be repeated here.

The specific implementation of S302 may be referred to the description related to (b) in fig. 1, and the description related to S12 in fig. 6, which are not described herein.

S303, performing first processing on the first image, and simultaneously, responding to second operation on the first interface, displaying a second interface, wherein the second interface is not an interface of the first application program, and the second operation is used for changing the operation of the first application program from the foreground operation to the background operation.

The first process may refer to the description of S18 in fig. 6, which is not described herein.

When the second operation is an operation on the preview pane, the second operation may refer to an operation on the preview pane 1004 in (b) in fig. 1, and a related description of an operation on the preview pane in fig. 6, which are not described herein.

When the second interface is an interface of the gallery application, the second interface may refer to the interface 15 shown in fig. 5, and the related description about the gallery application in fig. 6 will not be described herein.

The specific implementation of S303 may be referred to the description related to (a) in fig. 2, and the description related to S21 in fig. 6, which are not described herein.

And S304, before the first processing of the first image is finished, adjusting the operation priority of the first application program from the first priority to the second priority, wherein the first priority is smaller than the priority of the resident service module and smaller than the priority of the application program operated in the foreground, and the second priority is larger than or equal to the priority of the resident service module and larger than the priority of the application program operated in the foreground, and the resident service module is a module which is continuously operated after being started in the electronic equipment.

The specific implementation of S304 may be referred to in fig. 6 for descriptions related to S21-S25, and will not be described herein.

And S305, based on the second priority, when a second image is obtained, storing the second image, wherein the second image is obtained by processing the first image.

The second image may refer to the image in fig. 5, and the related description about the enhanced image in fig. 6 is not described herein.

The specific implementation of S305 may be referred to in fig. 6 for description of S26-S27, which is not repeated here.

According to the image acquisition method, before the first processing of the first image is finished, the operation priority of the first application program can be adjusted, so that the priority of the first application program is greater than or equal to that of the resident service module and greater than that of the application program operated in the foreground, and therefore the first application program can be in a state with higher operation priority, the condition that the first application program operated in the background is terminated due to insufficient memory resources can be avoided as much as possible, the first application program can acquire and store the second image, and based on the condition, the phenomenon of image loss can be prevented, and the shooting experience of a user can be improved.

In some embodiments, the image acquisition method of the present application may include:

Before the first processing of the first image is finished, when the first application program is detected to run in the background, starting a first function of the first application program, wherein the first function is used for keeping the first application program in a running state; and associating the first function with the resident service module according to a first association condition so as to adjust the running priority of the first application program from the first priority to the second priority, wherein the first association condition is that the priority of the application program corresponding to the first function is greater than or equal to the priority of the resident service module, and the priority of the resident service module is greater than the priority of the application program running in the foreground.

The specific implementation manner of the above steps may be referred to the related descriptions of S21-S25 in fig. 6, and will not be described herein.

In some embodiments, the image acquisition method of the present application may include: and based on the second priority, when a second image is obtained within a preset time period, storing the second image.

The specific implementation manner of the above steps may be referred to the related descriptions of S31-S33 in fig. 7, and will not be described herein.

In some embodiments, the image acquisition method of the present application may include: releasing the association of the first function and the resident service module; the first function is turned off.

The specific implementation manner of the above steps may be referred to the related descriptions of S34-S37 in fig. 7, which are not repeated here.

The first application program does not obtain the second image within the preset duration may be divided into two cases, where case 1: the algorithm for performing the first processing on the first image is not completed in a preset time period due to factors such as faults, so that the processing time period is longer than or equal to the preset time period; case 2: the algorithm for performing the first processing on the first image terminates the operation of the algorithm due to the occurrence of the conditions of insufficient memory resources and the like.

The specific implementation of the above steps for the case 1 may be referred to the relevant description of S34-S37 in fig. 7, and will not be described herein.

The specific implementation of the above steps for the case 1 may be referred to the relevant descriptions of S41-S45 in fig. 8, and will not be repeated here.

In some embodiments, the image acquisition method of the present application may include: the method further comprises the steps of:

The specific implementation manner of the above steps may be referred to the related descriptions of S51-S56 in fig. 9, and will not be described herein.

The second process may refer to the description of S17 in fig. 6, which is not described herein.

The specific implementation of the above steps can be seen in the relevant descriptions of S17-S18 in fig. 6, and will not be repeated here.

In some embodiments, the enhancement process includes one or more of brightness adjustment, exposure adjustment, contrast adjustment, sharpening process, hue process, saturation adjustment, color temperature adjustment, and beauty process.

For example, the enhancement processing includes sharpening processing, saturation adjustment, and beautifying processing, and the enhanced image is an image obtained through the sharpening processing, saturation adjustment, and beautifying processing.

In some embodiments, the first interface further includes a preview pane for displaying the thumbnail image and for triggering the display of the enhanced image, the second operation being an operation on the preview pane or an operation to exit the first application.

When the second interface is an interface of the gallery application, the specific implementation manner of the above steps may be referred to the related description of (a) in fig. 2, and the related descriptions of S20-S21 in fig. 6, which are not repeated here.

Illustratively, the present application provides an electronic device comprising a processor; the computer code or instructions in the memory, when executed by the processor, cause the electronic device to perform the image acquisition method of the previous embodiment.

Illustratively, the present application provides an electronic device comprising: a memory and a processor; the memory is coupled with the processor and is used for storing program codes or instructions; the processor is configured to invoke the program code or instructions in the memory to cause the electronic device to perform the image acquisition method of the previous embodiment.

Illustratively, the present application provides a chip system for use with an electronic device including a memory, a display screen, and a sensor; the chip system includes: one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a circuit; the interface circuit is used for receiving signals from the memory and sending signals to the processor, wherein the signals comprise computer codes or instructions stored in the memory; when the processor executes the computer code or instructions, the electronic device performs the image acquisition methods of the previous embodiments.

Illustratively, the present application provides a computer-readable storage medium having code or instructions stored therein which, when executed on an electronic device, cause the electronic device to perform the image acquisition method of the previous embodiments.

The present application illustratively provides a computer program product for causing an electronic device to implement the image acquisition method of the previous embodiments when the computer program product is run on a computer.

In the above-described embodiments, all or part of the functions may be implemented by software, hardware, or a combination of software and hardware. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer codes or instructions. When the computer program code or instructions are loaded and executed on a computer, the processes or functions in accordance with the present application are fully or partially produced. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer code or instructions may be stored in a computer readable storage medium. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disks, hard disks, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid State Disk (SSD)) or the like.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: a Read Only Memory (ROM) or a random access memory (random access memory, RAM), a magnetic disk or an optical disk, or the like.

Claims

1. An image acquisition method, applied to an electronic device, comprising:

displaying a first interface, wherein the first interface is an interface of a first application program in the electronic equipment;

Responding to a first operation of the first interface, acquiring a first image, wherein the first operation is shooting operation, and the first image is an initial image acquired by a camera of the electronic equipment;

Performing first processing on the first image, and simultaneously, responding to second operation on the first interface, displaying a second interface, wherein the second interface is not an interface of the first application program, and the second operation is used for changing the first application program from running in the foreground to running in the background;

According to a first association condition, the first function and a resident service module are associated so that the running priority of the first application program is adjusted from a first priority to a second priority, the first association condition is that the priority of the application program corresponding to the first function is greater than or equal to the priority of the resident service module, the resident service module is a module which continuously runs after being started in the electronic equipment, the priority of the resident service module is greater than the priority of the application program running in the foreground, the first priority is less than the priority of the resident service module and is less than the priority of the application program running in the foreground, and the second priority is greater than or equal to the priority of the resident service module and is greater than the priority of the application program running in the foreground;

Based on the second priority, when a second image is obtained, the second image is saved, wherein the second image is obtained by processing the first image;

disassociating the first function from the resident service module.

2. The method of claim 1, wherein the saving the second image when the second image is obtained based on the second priority comprises:

And based on the second priority, when the second image is obtained within a preset time period, storing the second image.

3. The method of claim 2, wherein after the disassociating the first function from the resident service module, the method further comprises:

And closing the first function.

4. A method according to any one of claims 1 to 3, further comprising:

based on the second priority, when the second image is not obtained within a preset time period, the association between the first function and the resident service module is released;

And closing the first function.

5. A method according to any one of claims 1 to 3, further comprising:

releasing the association of the first function and the resident service module when the first application program is detected to run in the foreground;

And closing the first function.

6. A method according to any one of claims 1 to 3, wherein, in response to a first operation on the first interface, after acquiring a first image, the method further comprises:

and performing second processing on the first image, wherein the second processing comprises compression processing and size processing, the image obtained by the first processing is a third image, the third image is a thumbnail image, the first processing comprises enhancement processing, the image obtained by the enhancement processing is the second image, the second image is an enhancement image, the quality of the second image is higher than that of the first image, and the duration of the second processing is shorter than that of the first processing.

7. The method of claim 6, wherein the enhancement process comprises one or more of a brightness adjustment, an exposure adjustment, a contrast adjustment, a sharpening process, a hue process, a saturation adjustment, a color temperature adjustment, and a beauty treatment.

8. The method of claim 6, wherein the first interface further comprises a preview box for displaying the thumbnail image and for triggering display of the enhanced image, the second operation being an operation on the preview box or an operation to exit the first application.

9. The method of claim 8, wherein when the second operation is an operation on the preview pane, the displaying a second interface in response to the second operation on the first interface comprises:

displaying the third image in the preview frame when the third image is obtained;

And responding to a second operation of the preview frame, displaying the second interface, wherein the second interface is an interface of a second application program, and when the electronic equipment displays the second interface, the second application program runs in a foreground and the first application program runs in a background.

10. An electronic device, comprising:

One or more processors, memory, and one or more computer programs; wherein the one or more computer programs are stored on the memory, which when executed by the one or more processors, cause the electronic device to perform the image acquisition method of any of claims 1-9.

11. A chip system, characterized in that the chip system comprises a processor for calling and running a computer program from a memory, so that an electronic device on which the chip system is mounted performs the image acquisition method according to any one of claims 1 to 9.

12. A computer readable storage medium comprising a computer program, characterized in that the computer program, when run on an electronic device, causes the electronic device to perform the image acquisition method according to any one of claims 1 to 9.