CN116708987A - Image shooting method and device, electronic equipment and storage medium - Google Patents

Image shooting method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116708987A
CN116708987A CN202210173049.1A CN202210173049A CN116708987A CN 116708987 A CN116708987 A CN 116708987A CN 202210173049 A CN202210173049 A CN 202210173049A CN 116708987 A CN116708987 A CN 116708987A
Authority
CN
China
Prior art keywords
image
data
shooting
image shooting
raw data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210173049.1A
Other languages
Chinese (zh)
Inventor
马祖宇
张墅潇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202210173049.1A priority Critical patent/CN116708987A/en
Publication of CN116708987A publication Critical patent/CN116708987A/en
Pending legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Studio Devices (AREA)

Abstract

The disclosure relates to an image shooting method and device, electronic equipment and storage medium. Wherein, this method is applied to image capturing device, includes: responding to an image shooting instruction initiated by a user through an image shooting application, and executing image acquisition operation; caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application; and generating a buffer finishing event under the condition that the acquired image original data is buffered, so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting.

Description

Image shooting method and device, electronic equipment and storage medium
Technical Field
The disclosure relates to the field of image processing, and in particular relates to an image shooting method and device, electronic equipment and a storage medium.
Background
With the advent of the national photography era, the image photographing needs of users are becoming more and more abundant. In some scenes, a user may need to perform continuous image capturing operations on the same subject to capture an image of the subject in a specific state.
In the related art, in order to ensure the picture quality of each image obtained by capturing during continuous capturing, the electronic device is usually required to perform next image capturing based on completing the image processing of the previous image, which results in that the related art cannot ensure the continuous capturing speed while considering the picture quality of the image.
Disclosure of Invention
The disclosure provides an image shooting method and device, electronic equipment and storage medium, which can ensure continuous shooting speed while considering the picture quality of images.
According to a first aspect of the present disclosure, there is provided an image photographing method, applied to an image photographing apparatus, including:
responding to an image shooting instruction initiated by a user through an image shooting application, and executing image acquisition operation;
caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application;
and generating a buffer finishing event under the condition that the acquired image original data is buffered, so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting.
According to a second aspect of the present disclosure, there is provided an image capturing apparatus applied to an image capturing device, including:
an execution unit which responds to an image shooting instruction initiated by a user through an image shooting application and executes image acquisition operation;
the caching unit caches the acquired image raw data into an image data caching queue, wherein the image raw data cached in the image data caching queue is used for generating an image presented to the image shooting application;
and the generation unit is used for generating a buffer finishing event to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting under the condition that the acquired image original data is buffered.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of the first aspect by executing the executable instructions.
According to a fourth aspect of the present disclosure there is provided a computer readable storage medium having stored thereon computer instructions which when executed by a processor perform the steps of the method according to the first aspect.
In the technical scheme of the disclosure, an image data buffer queue is introduced, so that the image acquisition operation and the image processing operation are relatively independent. On the basis, the next image acquisition operation can be executed only by completing the caching operation of the original image data, and is irrelevant to the image processing operation. Then, even if a more complex image processing algorithm is adopted, the continuous shooting speed is not affected. Therefore, the method and the device can give consideration to the image quality and the continuous shooting speed in the continuous shooting scene.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart of an image photographing method shown in an exemplary embodiment of the present disclosure;
fig. 2 is a flowchart of another image photographing method shown in an exemplary embodiment of the present disclosure;
FIG. 3A is a schematic diagram of a camera application interface shown in an exemplary embodiment of the present disclosure;
FIG. 3B is a schematic diagram of an image raw data processing flow shown in an exemplary embodiment of the present disclosure;
fig. 4 is a flowchart of yet another image photographing method shown in an exemplary embodiment of the present disclosure;
Fig. 5 is a block diagram of an image photographing device according to an exemplary embodiment of the present disclosure;
fig. 6 is a block diagram of another image photographing device shown in an exemplary embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
In order to improve the picture quality of the photographed image, a complex image processing algorithm is usually built in the software of the electronic device by each large manufacturer, so as to obtain an image with higher picture quality by processing the collected original data of the image.
In the related art, in the process of performing continuous image capturing, the image capturing apparatus is generally required to allow the image capturing apparatus to perform the next image capturing after completing the processing task of the previous image. Specifically, when a user triggers a shooting control included in a camera application, the image shooting device may invoke an image sensor to collect image raw data, and process the collected image raw data through an image processor. After the shooting control is detected to be triggered, the camera application needs to be adjusted to a state incapable of shooting until the original data of the image acquired at the time is processed, and then the camera application is in a state capable of shooting.
The method can effectively avoid the situation that the collected image original data cannot be processed in time because the collected image original data is continuously collected when the collected image original data is not processed in the continuous shooting process. It should be understood that when the original image data cannot be processed in time, the original image data acquired later is likely to cover the original image data acquired earlier, and thus the image cannot be output normally, for example, there is a possibility that the image cannot be generated or the image quality is reduced. Therefore, the shooting mechanism in the related art aims to solve the situation, and further ensure that the device can normally output images.
However, although the photographing mechanism in the related art can solve the above-described problems, the mechanism also results in a failure to achieve both image quality and continuous photographing speed in a scene of continuous photographing.
For example, when the image capturing apparatus is in the normal capturing mode, the image capturing apparatus usually processes the original image data by a relatively complex image processing algorithm in order to ensure the quality of the captured image. Under the condition, due to the adoption of a complex image processing algorithm, when the image processor processes the acquired image original data, a long time is required to be consumed, further the next image acquisition operation cannot be performed in time, the continuous shooting speed is influenced, and the situation that a key lens is missed easily occurs.
When the image capturing device is in the continuous shooting mode, the related art generally adopts a simpler image processing algorithm to process the collected image raw data. Although the continuous shooting speed can be ensured, the image quality of the finally shot image is poor due to the simpler image processing algorithm. In other words, the continuous shooting mode in the related art increases the continuous shooting speed at the expense of image quality.
Therefore, the disclosure proposes an image capturing method to avoid the problem that the image quality and the continuous shooting speed cannot be considered when continuous shooting is performed in the related art.
Fig. 1 is a diagram illustrating an image photographing method according to an exemplary embodiment of the present disclosure. The method is applied to an image photographing apparatus. As shown in fig. 1, the method may include the steps of:
step 102, image acquisition operation is performed in response to an image capturing instruction initiated by a user through an image capturing application.
As can be seen from the above description, the related art cannot achieve both continuous shooting speed and image quality, because the related art needs to allow the next image acquisition operation when the original image data acquired by the previous image acquisition operation is processed. The image shooting mechanism aims to solve the technical problem that an image cannot be normally output when the image processing speed is not in line with the image acquisition speed.
In view of this, the present disclosure has created an image data buffer queue for buffering the acquired image raw data in an image capturing apparatus in order to solve the technical problem that "the image processing speed cannot normally output an image when the image acquisition speed is not followed while the continuous shooting speed and the image quality are simultaneously taken into consideration. On the basis, after the image shooting equipment performs one-time image acquisition operation, the acquired image original data can be preferentially cached in the image data cache queue. After the acquisition operation of the image original data is completed, on one hand, the image shooting device can process the cached image original data to generate an image, and then the image is presented in the image shooting application; on the other hand, the image capturing apparatus may adjust the image capturing application to a state that allows image capturing so that the image capturing apparatus may perform the image capturing operation at any time.
It should be understood that, after the image data buffer queue is introduced, the image capturing device only needs to buffer the image data buffer queue after the image raw data is acquired. After the caching of the image original data is completed, even if the image acquisition operation is continuously executed, the image original data acquired later can be continuously cached in the queue without covering the image original data acquired earlier. Therefore, the present disclosure can perform the next image acquisition operation only after the buffering of the image raw data is completed. In this process, the image capture device may also asynchronously read image raw data from the image data cache queue for processing to obtain images presented to the image capture application.
Obviously, the image acquisition operation and the image processing operation are mutually independent due to the introduced image data cache queue, namely, the two operations can be executed asynchronously, so that the speed of the image acquisition operation is not influenced even if a more complex image processing algorithm is adopted. Therefore, when the technical scheme disclosed by the invention is adopted, the image quality and the continuous shooting speed can be considered when the continuous shooting of the images is carried out.
The image data buffer queues in the present disclosure may be allocated in advance or temporarily allocated when image capturing is required. When the image data cache queue is pre-allocated, the image shooting device can set the memory space of the preset storage amount in the memory as the image data cache queue when the device is started, or set the memory space of the preset storage amount in the memory as the image data cache queue when a user starts the image shooting application; when the image data cache queue is temporarily allocated, the user may trigger the image capturing control, so that when the image capturing device captures an image, a memory space of a preset memory amount in the memory is set as the image data cache queue. Of course, the above-mentioned timing of setting the image data buffer queue is merely illustrative, and particularly when to set the image data buffer queue may be set by those skilled in the art according to actual needs, which is not limited in this disclosure.
It should be noted that the size of the capacity of the image data buffer queue may also be set based on the real-time load condition of the image capturing apparatus. For example, when the image data buffer queue is required to be set, the memory occupation parameter of the image capturing device may be read, and the image data buffer queue may be set according to the memory occupation parameter, for example, the memory occupation parameter may be inversely related to the capacity of the image data buffer queue, that is, if the occupation parameter is larger and the occupied space of the memory is larger, the image data buffer queue with smaller capacity is set. By the method, the situation that the normal operation of the equipment is influenced by setting a large capacity for the image data cache queue under the condition that the memory occupation is large can be effectively avoided. Of course, the foregoing examples are merely illustrative, and in particular, how much capacity is allocated to the image data buffer queue, which may be set by those skilled in the art according to actual needs, and the disclosure is not limited thereto.
It is noted that the capacity of the image data buffer queue is necessarily required to be larger than the data amount of the image raw data of the single image, and therefore, when setting the image buffer capacity, it is also possible to refer to the parameters of the image captured by the image capturing apparatus. Of course, the capacity of the image data buffer queue is set, and specifically, how many images of the image raw data can be buffered, and also can be determined by those skilled in the art according to actual requirements, which is not limited in this disclosure.
And step 104, caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application.
In the present disclosure, the collected image raw data is cached in the image data cache queue, so the image capturing device also reads the image raw data from the image data cache queue to process and obtain the image presented to the image capturing application.
As described above, the image capturing apparatus can process the image raw data using a more complex image processing algorithm to improve the image quality thereof. Therefore, after the image raw data is read from the image data buffer queue, a plurality of processing steps can be sequentially performed on the read image raw data, and the processed image is displayed in the image capturing application. Wherein the plurality of process steps may be preset by a skilled artisan, and the disclosure is not limited thereto. For example, in performing portrait shooting, the plurality of processing steps may include: face recognition, background blurring, image quality optimization, and the like.
In the present disclosure, the various process steps described above may be performed in different ways.
In an embodiment, the present disclosure may preset a plurality of image processing algorithms for performing a plurality of processing steps for image raw data, respectively. Then, when the image raw data is read, the read image raw data can be sequentially processed based on a plurality of preset image processing algorithms. In other words, the steps in the present embodiment are all completed by the corresponding image processing algorithm.
In another embodiment, the image processing algorithm preset in the present disclosure may include a plurality of portions, wherein different portions are used to perform different processing steps for the original data of the image. Then, when the image raw data is read, the read image raw data may be sequentially processed based on a plurality of portions included in the image processing algorithm. In other words, the steps in the present embodiment are all completed by presetting a plurality of codes in the image processing algorithm.
In the present disclosure, since the image capturing operation and the image processing operation are relatively independent, after the image raw data obtained by the plurality of image capturing operations is stored in the image data buffer queue, the plurality of image raw data can be image-processed based on different orders.
For example, the image raw data may be sequentially read from the image data buffer queue according to the acquisition order of the respective image raw data. After the original data of each image is read, the plurality of processing steps can be respectively executed for the read original data of each image. For another example, the image raw data may be read from the image data buffer queue in the order of the data amount of the image raw data, for example, the image raw data may be read from the image data buffer queue in the order of the data amount from small to large or from large to small. Of course, the above examples are merely illustrative, and the specific reading manner can be set by those skilled in the art according to actual requirements, which is not limited in this disclosure.
It should be noted that, in the case of completing any processing step of any image raw data, on the one hand, the next step may be continuously performed on any image raw data; alternatively, either processing step may be performed on the next image raw data. By the method, different steps can be simultaneously executed on a plurality of image original data, the image processing efficiency is improved, and the problem of low image processing efficiency caused by the fact that processing of next image original data is started only when the processing of the previous image original data is finished in the related art is avoided.
And step 106, generating a buffer finishing event to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting under the condition that the acquired image original data is buffered.
In the present disclosure, after the collected image raw data is cached in the image data cache queue, a corresponding cached completion event may be generated, so that the image capturing application knows that the collected image raw data has been cached, and further adjusts the image capturing application to a state that allows image capturing.
It should be appreciated that since the cached event is used to inform the image raw data of the cached completion, it may also be used to instruct the image capture device to read and process the cached image raw data to generate an image for presentation in the image capture application. It should be noted that, in practical applications, the image processing operation is usually performed by the image processor, so the buffered event is actually used to instruct the image processor to read and process the image raw data from the image data buffer queue.
In the present disclosure, after receiving an image capturing instruction, the image capturing apparatus may adjust an image capturing application to a state where image capturing is impossible, so as to avoid the influence on the capturing process caused by frequent receiving of the image capturing instruction in the process of performing the image capturing operation.
Wherein the image capturing application can be brought into different states in different ways when the image capturing device is in different capturing modes.
In an embodiment, the image capturing apparatus may be in a normal capturing mode, and the image capturing instruction initiated by the user through the operation may be a single capturing instruction. On the basis, a user can initiate the image shooting instruction by triggering an image shooting control contained in the image shooting application, and the image shooting equipment can call an image sensor to perform image acquisition operation on one hand and cache the acquired image raw data into an image data cache queue after detecting the image shooting instruction; on the other hand, the image shooting control can be switched to a locking state which cannot be triggered, so that the image shooting application cannot perform image shooting operation.
In this embodiment, after the acquired image raw data is cached, a cached finishing event may be generated, so as to instruct the image capturing device to switch the image capturing control to the unlocking state that allows triggering, so that the image capturing application is in a state that allows performing the image capturing operation. Obviously, after the image capturing control is switched to the unlocking state, the user can trigger the image capturing control again to instruct the image capturing device to execute the image capturing operation again.
In another embodiment, the image capturing apparatus may be in a continuous shooting mode, and the image capturing instruction initiated by the user through the operation may be a continuous capturing instruction. On the basis, a user can execute multiple image shooting operations by triggering an image shooting control contained in one image shooting application.
In this embodiment, after detecting the image capturing instruction, the image capturing device may also call the image sensor to perform an image capturing operation, and cache the captured image raw data into the image data cache queue; after the image shooting device finishes the buffering and generates the buffering finishing event, the buffering finishing event can be uploaded to the image shooting application to instruct the image shooting application to call the image sensor to perform image acquisition operation again. Because in the continuous shooting mode, the image capturing operation and the image buffering operation may be performed continuously in this embodiment until the number of times of the image capturing operation reaches the set number of continuous shots.
It should be understood that, since the present embodiment is in the continuous shooting mode, the operation of performing the state adjustment of the image capturing application need not be performed intentionally in actual operation, but may be regarded as being in a different state depending on whether or not it is performing the image capturing operation. When an instruction for instructing to perform an image capturing operation is not received (i.e., when an uploaded buffering completion event is not received), the image capturing application may be regarded as: in a state where image capturing is impossible; when an instruction is received to perform an image capturing operation (i.e., when an uploaded cached event is received), the image capturing application may be regarded as: a state in which the image acquisition operation is allowed.
It should be noted that the image capturing device in the present disclosure may be any type of electronic device, for example, the image capturing device may be a mobile terminal such as a smart phone or a tablet computer, or may be a fixed terminal such as a smart television or a PC (personal computer ). It should be understood that, only electronic devices having an image capturing function may be used as the image capturing device in the present disclosure, and specifically, which type of electronic device is used as the image capturing device in the technical solution of the present disclosure may be determined by those skilled in the art according to actual needs, which is not limited in the present disclosure.
As can be seen from the above description, the image capturing apparatus in the present disclosure can perform an image capturing operation to acquire image raw data of a subject in the event that an image capturing instruction initiated by a user based on an image capturing application is detected. The acquired image raw data is cached in an image data cache queue created in the image capturing device for use in generating an image presented in the image capturing application. Under the condition that the acquired image original data is cached, a caching finishing event can be generated so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting, and therefore the image shooting equipment is convenient to perform next image acquisition operation.
It should be understood that, in the related art, when continuous shooting operation is performed, the acquired image raw data needs to be processed immediately, and in the process of image processing, the image shooting application is in a state that image shooting cannot be performed, until the image processing is completed, the image shooting application is adjusted to a state that shooting is allowed to be performed, so that the next image acquisition operation is performed. Such an image capturing mechanism causes the image capturing apparatus to reduce the continuous shooting speed if a more complex image processing algorithm is adopted when performing the continuous shooting operation of the image, and to reduce the image quality if a simpler image processing algorithm is adopted. As can be seen, the image capturing method in the related art cannot achieve both the image quality and the continuous shooting speed in the continuous shooting state.
In the present disclosure, the image data buffer queue for buffering the original image data is set, so that the strong binding between the image acquisition operation and the image processing operation is released, and the image acquisition operation and the image processing operation can be executed asynchronously. On the basis, the next image acquisition operation can be executed only by caching the original image data of the previous image. Since the condition for continuing to perform the image acquisition operation is that the image raw data of the previous image is completely cached and is irrelevant to the image processing operation, even if a more complex image processing algorithm is adopted, the continuous shooting speed is not affected. Therefore, the technical scheme of the present disclosure can give consideration to the image quality and the continuous shooting speed.
Further, the present disclosure may perform a plurality of steps on the image raw data to improve the image quality of the processed image when performing the image processing operation. When any processing step of the original image data is executed, the processing step can be executed for the next original image data. Therefore, the method and the device can process a plurality of image original data at the same time, improve the image processing efficiency, and avoid the problem of low image processing efficiency caused by the fact that the next image original data is processed under the condition that the previous image original data is processed in the related technology.
In the following, taking a manual continuous shooting by a smart phone as an example, the technical scheme of the disclosure is introduced.
Fig. 2 is a flowchart of another image photographing method shown in an exemplary embodiment of the present disclosure. As shown in fig. 2, the method comprises the steps of:
step 201, a camera application is started.
In the present embodiment, a camera application may be installed in advance in the smartphone as an image capturing application in the present disclosure. Then, the user can start the camera application by triggering the camera application icon in the smart phone.
After the camera application is started, a camera application interface as shown in fig. 3A may be displayed, which includes a preview screen 31 and an image capture control 32.
Step 202, detecting that an image capture control is triggered.
In this implementation, the user may trigger the image capture control 32 to instruct the smartphone to perform an image capture operation.
And 203, calling an image sensor to acquire image raw data and locking an image shooting control.
In this embodiment, when the smart phone detects that the image capturing control in the camera application is triggered, an image capturing instruction may be generated to instruct the camera application to call the image sensor to perform image capturing on the subject, and meanwhile, the image capturing control may be switched to a locked state, so as to avoid frequent receiving of the image capturing instruction in the image capturing process.
Step 204, the image raw data is cached in an image data cache queue.
In this embodiment, after the image sensor collects the image raw data, the collected image raw data may be cached in the image data cache queue.
Step 205, judging whether the original data of the image is cached; if yes, go to step 206; otherwise, go to step 209A.
Step 206, generating a router event and uploading the event to the camera application.
In this embodiment, after the image raw data is cached, a router event may be generated as the cached data event.
It should be noted that, in the related art, the shitter event is usually generated when the original image data is processed, so as to indicate that the camera application may continue the image capturing operation. In this embodiment, the shift event is generated after the original data of the image is cached, which is used to instruct the camera application to release the locked state of the image capturing control, and allow the user to continuously trigger the image capturing control to perform the image capturing operation; on the other hand, the method is used for informing an image processor that the image original data is cached, and the image original data can be read from an image data cache queue to generate an image.
Step 207A, unlock the image capture control.
Step 208A, judging whether the image capturing control is triggered; if yes, go to step 203, otherwise, go to step 209A.
In this embodiment, after the image capturing control is released, the user may trigger the image capturing control again to perform the next image capturing operation.
Step 209A, no operation is performed.
In step 207B, the image processor is invoked to read the image raw data from the image data cache queue.
Step 208B, performing image processing on the image raw data based on a preset image processing algorithm.
In this embodiment, the image processor may process the image raw data based on a preset image processing algorithm after reading the image raw data from the image data buffer queue. In this embodiment, a plurality of image processing algorithms may be preset to sequentially process the image raw data.
For example, assume that the current photographing mode is a portrait mode. The preset image processing algorithm may then comprise an identification algorithm for face recognition, a blurring algorithm for background blurring, a picture quality optimization algorithm for adjusting the sharpness of the picture. On the basis, the image processor can preferentially process the original image data by adopting an identification algorithm so as to identify the position of the shot main body; then, carrying out background blurring on the image processed by the recognition algorithm through a blurring algorithm; and finally, optimizing the image quality of the image subjected to background blurring by an image quality optimization algorithm.
In this example, in the case where a plurality of image raw data are contained in the image data buffer queue, the image processor may process the plurality of image raw data at the same time. Assuming that the image data cache queues already cache the image raw data A, B and C, the image processor can continue to perform background blurring on the image raw data A through face recognition on one hand after finishing face recognition on the image raw data A; on the other hand, the face recognition can be performed on the image raw data B based on a recognition algorithm. After the image processor finishes background blurring for the image original data A, on one hand, the image quality of the image original data A subjected to background blurring can be continuously optimized; on the other hand, the background blurring can be performed on the image original data B based on the blurring algorithm, the face recognition can be performed on the image original data C based on the face recognition algorithm, and the like. The processing stages of the respective image raw data in the image processor can be referred to as shown in fig. 3B. It should be noted that, in other cases, the number of the image raw data and the processing steps to be executed are similar, and will not be described in detail herein.
According to the technical scheme, after the image acquisition operation is completed, the smart phone can generate the router event only by caching the acquired image raw data, so as to instruct the camera application to release the locking state of the image shooting control, so that the user can trigger the image shooting control to perform the next image acquisition operation, and besides, the router event is also used for instructing the image processor to start processing the cached image raw data. Obviously, compared with the mode in the related art, the mode enables a user to shoot images at shorter time intervals when the user performs manual continuous shooting, so that the situation that a key lens is missed is avoided, and meanwhile, the continuous shooting speed is not influenced even though a more complex image processing algorithm is adopted, so that the image quality of the shot images can be ensured.
In the following, taking automatic continuous shooting through a smart phone as an example, the technical scheme of the present disclosure is introduced. It should be noted that in the next embodiment, most of the operation manners are similar to those of the previous embodiment, and the related content can refer to the description of the previous embodiment, which is not repeated in the next embodiment.
Fig. 4 is a flowchart of yet another image photographing method according to an exemplary embodiment of the present disclosure. As shown in fig. 4, the method comprises the steps of:
step 401, a camera application is started.
Similar to the above embodiment, a camera application may be installed in advance in the smart phone as an image capturing application in the present disclosure. Then, the user can start the camera application by triggering the camera application icon in the smart phone.
In step 402, it is detected that an image capture control is triggered.
Similar to the previous embodiment, the user may trigger the image capture control to instruct the smartphone to perform the image capture operation.
Step 403, calling an image sensor to collect image raw data.
Similar to the previous embodiment, when the smart phone detects that the image capturing control in the camera application is triggered, an image capturing instruction can be generated to instruct the camera application to call the image sensor to perform image capturing on the subject, and meanwhile, the image capturing control can be switched to a locked state, so that frequent receiving of the image capturing instruction in the image capturing process is avoided.
It is stated that, because the embodiment is in the continuous shooting mode, the locking state of the image shooting control needs to be continued until the shooting times reach the set continuous shooting times, so as to avoid affecting the normal acquisition of the image due to frequent receiving of the image shooting instruction.
Step 404, the image raw data is cached in an image data cache queue.
Similar to the previous embodiment, after the image sensor collects the image raw data, the collected image raw data can be cached in the image data cache queue.
Step 405, judging whether the original data of the image is cached; if yes, go to step 406; otherwise, go to step 409.
Step 406, generate a router event, upload to the camera application, and jump to step 403.
Similar to the previous embodiment, after the image raw data is cached, a router event is generated as the cached finishing event.
Unlike the previous embodiment, the shift event is used to instruct the camera application to call the image sensor again to perform the next image acquisition operation; on the other hand, the method is used for informing the image processor that the image original data is cached, and the image original data can be read from the image data cache queue to generate an image.
It should be noted that before the camera application calls the image sensor again, it is further necessary to determine whether the number of continuous shooting has reached the set number, if so, the image processor is not called any more, otherwise, the call is continued.
Step 407, calling the image processor to read the image original data from the image data cache queue.
In step 408, image processing is performed on the image raw data based on a preset image processing algorithm.
Step 409, no operation is performed.
According to the technical scheme, after the image acquisition operation is completed, the smart phone can generate a router event only by caching the acquired image raw data, so as to instruct the camera application to call the image sensor to perform the next image acquisition operation. In addition, the shift event is also used for instructing the image processor to start processing the cached image raw data. Obviously, compared with the mode in the related art, the mode enables the smart phone to shoot images at shorter time intervals when the smart phone is in the continuous shooting mode, so that the situation that a key lens is missed is avoided, and meanwhile, the continuous shooting speed is not influenced even though a complex image processing algorithm is adopted, so that the image quality of the shot images can be ensured.
Fig. 5 is a block diagram of an image photographing device according to an exemplary embodiment of the present disclosure. Referring to fig. 5, the apparatus includes an execution unit 501, a cache unit 502, and a generation unit 503.
An execution unit 501 that executes an image capturing operation in response to an image capturing instruction initiated by a user through an image capturing application;
the caching unit 502 caches the collected image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application;
and a generating unit 503 for generating a buffer finishing event to instruct the image capturing device to adjust the image capturing application to a state allowing image capturing when the acquired image raw data is buffered.
Optionally, the execution unit 501 is further configured to:
reading image original data from the image data cache queue, and sequentially executing a plurality of processing steps on the read image original data;
and displaying the processed image in the image shooting application.
Optionally, the execution unit 501 is further configured to:
sequentially processing the read image original data based on a plurality of preset image processing algorithms corresponding to different processing steps; or alternatively, the process may be performed,
and processing the read image original data in sequence based on a plurality of parts corresponding to different processing steps in a preset image processing algorithm.
Optionally, the execution unit 501 is further configured to:
sequentially reading the image original data from the image data cache queue according to the acquisition sequence of each image original data;
and respectively executing a plurality of processing steps on each read image raw data, wherein any processing step is executed on the next image raw data when any processing step of any image raw data is completed.
Optionally, the cached finishing event is further used for instructing the image capturing device to read and process the cached original image data so as to generate an image presented to the image capturing application.
As shown in fig. 6, fig. 6 is a block diagram of another image capturing apparatus according to an exemplary embodiment of the present disclosure, which further includes, on the basis of the foregoing embodiment shown in fig. 5: switching unit 504, uploading unit 505.
Optionally, the image shooting instruction is a single shooting instruction;
a switching unit 504, responsive to the image capturing instruction, for switching an image capturing control included in the image capturing application to a locked state that cannot be triggered, so that the image capturing application cannot perform an image capturing operation;
The buffer finishing event is used for indicating the image shooting device to switch the image shooting control to an unlocking state allowing triggering so that the image shooting application is in a state allowing image shooting operation.
Optionally, the image shooting instruction is a continuous shooting instruction;
and the uploading unit 505 uploads the generated cached event to the image shooting application to instruct the image shooting application to call an image sensor assembled in the image shooting device to perform image acquisition operation.
For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the objectives of the disclosed solution. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Correspondingly, the disclosure also provides an image shooting device, which comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the image capturing method according to any of the above embodiments, for example, the method may include: responding to an image shooting instruction initiated by a user through an image shooting application, and executing image acquisition operation; caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application; and generating a buffer finishing event under the condition that the acquired image original data is buffered, so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting.
Accordingly, the present disclosure also provides an electronic device including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by the one or more processors, where the one or more programs include instructions for implementing the image capturing method according to any of the foregoing embodiments, for example, the method may include: responding to an image shooting instruction initiated by a user through an image shooting application, and executing image acquisition operation; caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application; and generating a buffer finishing event under the condition that the acquired image original data is buffered, so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting.
Fig. 7 is a block diagram illustrating an apparatus 700 for implementing an image photographing method according to an exemplary embodiment. For example, apparatus 700 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.
Referring to fig. 7, an apparatus 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.
The processing component 702 generally controls overall operation of the apparatus 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 702 can include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operations at the apparatus 700. Examples of such data include instructions for any application or method operating on the apparatus 700, contact data, phonebook data, messages, pictures, videos, and the like. The memory 704 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 706 provides power to the various components of the device 700. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 700.
The multimedia component 708 includes a screen between the device 700 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front-facing camera and/or a rear-facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the apparatus 700 is in an operational mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the device 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 further includes a speaker for outputting audio signals.
The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of the apparatus 700. For example, the sensor assembly 714 may detect an on/off state of the device 700, a relative positioning of the components, such as a display and keypad of the device 700, a change in position of the device 700 or a component of the device 700, the presence or absence of user contact with the device 700, an orientation or acceleration/deceleration of the device 700, and a change in temperature of the device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate communication between the apparatus 700 and other devices in a wired or wireless manner. The apparatus 700 may access a wireless network based on a communication standard, such as WiFi,2G or 3G,4G LTE, 5G NR (New Radio), or a combination thereof. In one exemplary embodiment, the communication component 716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 704, including instructions executable by processor 720 of apparatus 700 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
The foregoing description of the preferred embodiments of the present disclosure is not intended to limit the disclosure, but rather to cover all modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present disclosure.

Claims (10)

1. An image capturing method, characterized by being applied to an image capturing apparatus, comprising:
responding to an image shooting instruction initiated by a user through an image shooting application, and executing image acquisition operation;
Caching the acquired image raw data into an image data cache queue, wherein the image raw data cached in the image data cache queue is used for generating an image presented to the image shooting application;
and generating a buffer finishing event under the condition that the acquired image original data is buffered, so as to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting.
2. The method of claim 1, wherein the image capture instruction is a single capture instruction;
the method further comprises the steps of: responding to the image shooting instruction, and switching an image shooting control contained in the image shooting application to a locking state which cannot be triggered so that the image shooting application cannot perform image shooting operation;
the buffer finishing event is used for indicating the image shooting device to switch the image shooting control to an unlocking state allowing triggering so that the image shooting application is in a state allowing image shooting operation.
3. The method of claim 1, wherein the image capturing instruction is a continuous capturing instruction; the method further comprises the steps of:
Uploading the generated cached events to the image shooting application to instruct the image shooting application to call an image sensor assembled in the image shooting equipment to perform image acquisition operation.
4. The method as recited in claim 1, further comprising:
reading image original data from the image data cache queue, and sequentially executing a plurality of processing steps on the read image original data;
and displaying the processed image in the image shooting application.
5. The method of claim 4, wherein the sequentially performing a plurality of processing steps on the read image raw data comprises:
sequentially processing the read image original data based on a plurality of preset image processing algorithms corresponding to different processing steps; or alternatively, the process may be performed,
and processing the read image original data in sequence based on a plurality of parts corresponding to different processing steps in a preset image processing algorithm.
6. The method of claim 4, wherein the step of determining the position of the first electrode is performed,
the reading the image original data from the image data cache queue comprises the following steps: sequentially reading the image original data from the image data cache queue according to the acquisition sequence of each image original data;
The method sequentially executes a plurality of processing steps on the read image original data, including: and respectively executing a plurality of processing steps on each read image raw data, wherein any processing step is executed on the next image raw data when any processing step of any image raw data is completed.
7. The method of claim 1, wherein the cached event is further used to instruct the image capture device to read and process cached image raw data to generate an image presented to the image capture application.
8. An image photographing apparatus, characterized by being applied to an image photographing device, comprising:
an execution unit which responds to an image shooting instruction initiated by a user through an image shooting application and executes image acquisition operation;
the caching unit caches the acquired image raw data into an image data caching queue, wherein the image raw data cached in the image data caching queue is used for generating an image presented to the image shooting application;
and the generation unit is used for generating a buffer finishing event to instruct the image shooting equipment to adjust the image shooting application to a state allowing image shooting under the condition that the acquired image original data is buffered.
9. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to implement the method of any of claims 1-7 by executing the executable instructions.
10. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method of any of claims 1-7.
CN202210173049.1A 2022-02-24 2022-02-24 Image shooting method and device, electronic equipment and storage medium Pending CN116708987A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210173049.1A CN116708987A (en) 2022-02-24 2022-02-24 Image shooting method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210173049.1A CN116708987A (en) 2022-02-24 2022-02-24 Image shooting method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116708987A true CN116708987A (en) 2023-09-05

Family

ID=87826238

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210173049.1A Pending CN116708987A (en) 2022-02-24 2022-02-24 Image shooting method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116708987A (en)

Similar Documents

Publication Publication Date Title
EP3512190A1 (en) Method and device for acquiring image, terminal and computer-readable storage medium
JP5190117B2 (en) System and method for generating photos with variable image quality
CN107743191B (en) Terminal, anti-shake photographing method thereof and storage device
JP4910584B2 (en) Imaging device, mobile phone, imaging control method, imaging control program, and program recording medium
CN111031177A (en) Screen recording method, device and readable storage medium
CN111385456A (en) Photographing preview method and device and storage medium
CN115002332A (en) Shooting processing method and device, electronic equipment and storage medium
JP2012165122A (en) Imaging apparatus, control method and program therefor
CN111343386B (en) Image signal processing method and device, electronic device and storage medium
CN116708987A (en) Image shooting method and device, electronic equipment and storage medium
CN111698414B (en) Image signal processing method and device, electronic device and readable storage medium
CN112087570B (en) Image shooting method and device, electronic equipment and readable storage medium
CN116416323A (en) Image processing method and device, electronic equipment and storage medium
CN107707819B (en) Image shooting method, device and storage medium
CN114339357A (en) Image acquisition method, image acquisition device and storage medium
CN115134505B (en) Preview picture generation method and device, electronic equipment and storage medium
CN114339015B (en) Photographing processing method, photographing processing device and storage medium
CN117956268A (en) Preview frame rate control method and device thereof
US11838655B2 (en) Image acquiring method and apparatus, electronic device, and storage medium
CN114390211B (en) Exposure convergence method, device, electronic equipment and storage medium
CN114339017B (en) Distant view focusing method, device and storage medium
CN112087572B (en) Method and device for controlling zoom of lens, electronic equipment and readable storage medium
CN115733913A (en) Continuous photographing method and device and storage medium
CN116489498A (en) Image preview method, image preview device, electronic device, and storage medium
CN116366968A (en) Image shooting method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination