CN115278052A - Image processing method and device, electronic equipment and computer readable storage medium - Google Patents
Image processing method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN115278052A CN115278052A CN202210712897.5A CN202210712897A CN115278052A CN 115278052 A CN115278052 A CN 115278052A CN 202210712897 A CN202210712897 A CN 202210712897A CN 115278052 A CN115278052 A CN 115278052A
- Authority
- CN
- China
- Prior art keywords
- image
- processing
- frame information
- frame
- processing parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 11
- 238000012545 processing Methods 0.000 claims abstract description 250
- 238000000034 method Methods 0.000 claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 22
- 230000001360 synchronised effect Effects 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Landscapes
- Studio Devices (AREA)
Abstract
The application provides an image processing method, an image processing device, an electronic device and a computer readable storage medium, wherein the method comprises the following steps: determining a first image frame to be processed by an image signal processor, and searching first frame information of the first image frame in a context queue of the image signal processor; and determining a first processing parameter according to the first frame information, and sending a first processing instruction containing the first processing parameter to the image signal processor. The method and the device have the advantages that the corresponding relation between the processing parameters and the image frames is stored through the context queue, the image processing is carried out on the image frames to be processed according to the processing parameters corresponding to the image frames to be processed during the image processing, the characteristic that the processing parameters have real-time performance is fully utilized, the condition that the image frames and the processing parameters are not synchronous due to the fact that hysteresis exists in the process of sending the processing parameters is avoided, and the condition that the image processing result and a scene are not synchronous is further avoided.
Description
[ technical field ] A method for producing a semiconductor device
The present application relates to the field of image processing, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for image processing.
[ background of the invention ]
With the rapid development of the intelligent terminal, the functions of the image acquisition device of the intelligent terminal are more abundant and powerful, the user is not limited to the basic communication function of the mobile phone any more, and good user experience becomes the target of more and more pursuits of multiple users. For users, it is very important that the image capturing device can still output high-quality real-time images under different scenes. Therefore, the image effect and real-time performance of the image acquisition device of the intelligent terminal have become core competitiveness, and for the image acquisition device, the capability and efficiency of synchronizing the image frame and the processing parameter play an important role in the image quality and the scene adaptability.
In the prior art, when an image is processed by an image acquisition device, a processing parameter issued by a processor to an image signal processor has hysteresis, so that the image signal processor cannot process a current frame by using the processing parameter corresponding to the current frame, and only can perform image processing by using the existing processing parameter (usually, the processing parameter of the previous image frame), thereby violating the original intention of real-time performance of the processing parameter. With the requirement for higher image quality, for a mode of highly dynamic scene switching, the situation that an image obtained by processing is not synchronous with a scene occurs by adopting the existing image processing method, and user experience is influenced.
Therefore, how to avoid the situation that the processed image is not synchronous with the scene and further improve the user experience is a technical problem to be solved in the field.
[ summary of the invention ]
In order to solve the problem that an image obtained by processing is not synchronous with a scene in the prior art, the application provides an image processing method, an image processing device, image processing equipment and a computer-readable storage medium.
A method of image processing, comprising:
determining a first image frame to be processed by an image signal processor, and searching first frame information of the first image frame in a context queue of the image signal processor, wherein the frame information stored in the context queue is the frame information of the image frame corresponding to a pre-acquired processing parameter;
and determining a first processing parameter according to the first frame information, and sending a first processing instruction containing the first processing parameter to an image signal processor, wherein the first processing instruction is used for instructing the image signal processor to perform image processing according to the first processing parameter.
Preferably, before determining the first image frame to be processed by the image signal processor, the method further comprises:
receiving a second image frame acquired by an image acquisition device, and determining second frame information of the second image frame;
sending a second processing instruction containing the second frame information to a first processor, wherein the second processing instruction is used for instructing the first processor to determine a second processing parameter corresponding to the second image frame according to the second frame information;
receiving the second processing parameter sent by the first processor;
and establishing a corresponding relation between the second processing parameter and the second frame information, and storing the second frame information into the context queue.
Preferably, the receiving the second processing parameter sent by the first processor includes:
receiving a data issuing instruction sent by the first processor, and determining a first memory for storing the second processing parameter and a first memory address of the first memory;
receiving the second processing parameter, and writing the second processing parameter into the first memory;
the establishing of the corresponding relationship between the second processing parameter and the second frame information includes:
and receiving data issuing completion information sent by the first processor, storing the first memory address into a first register, and establishing a corresponding relation between the first register and the second frame information.
Preferably, the determining a first processing parameter according to the first frame information includes:
determining a second register corresponding to the first frame information;
and reading a second memory address from the second register, and reading the first processing parameter from a second memory corresponding to the second memory address.
Preferably, the category of the first processing parameter includes a preview parameter and a photographing parameter;
the context queues comprise a first context queue and a second context queue;
the storing the second frame information into the context queue includes:
acquiring category identification information of the first processing parameter, and determining the category of the first processing parameter as a preview parameter or a photographing parameter according to the category identification information;
if the type of the first processing parameter is a preview parameter, storing the first frame information into the first context queue;
and if the type of the first processing parameter is the photographing parameter, storing the first frame information into the second context queue.
Preferably, if the category of the first processing parameter is a photographing parameter, storing the first frame information into the second context queue includes:
if the category of the first processing parameter is a photographing parameter, judging whether the second context queue is full;
if the second context queue is not full, storing the first frame information into the second context queue;
and if the second context queue is full, deleting the frame information at the head position of the second context queue, and storing the first frame information in the tail position of the second context queue.
Preferably, said searching for the first frame information of the first image frame in the context queue of the image signal processor comprises:
acquiring an image acquisition mode of the first image frame;
if the image acquisition mode is a preview mode, searching the first frame information in the first context queue;
and if the image acquisition mode is a photographing mode, searching the first frame information in the second context queue.
An apparatus for image processing, comprising:
the device comprises a determining module, a processing module and a processing module, wherein the determining module is used for determining a first image frame to be processed by an image signal processor and searching first frame information of the first image frame in a context queue of the image signal processor, and the frame information stored in the context queue is frame information of an image frame corresponding to a pre-acquired processing parameter;
the first sending module is configured to determine a first processing parameter according to the first frame information, and send a first processing instruction including the first processing parameter to an image signal processor, where the first processing instruction is used to instruct the image signal processor to perform image processing according to the first processing parameter.
An electronic device, comprising:
a processor and a memory for storing at least one instruction which is loaded and executed by the processor to implement a method of image processing as described above.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of image processing as described above.
The image processing method provided by the embodiment of the application determines a first image frame to be processed by an image signal processor, searches first frame information of the first image frame to be processed by the image signal processor in a context queue, if the first frame information can be found in the context queue, proves that a first processing parameter corresponding to the first image frame is issued in advance, sends a first processing instruction containing the first processing parameter to the image signal processor at the moment, so that the image signal processor performs image processing on the first image frame according to the first processing parameter, avoids the condition that the image frame and the processing parameter are not synchronous due to hysteresis property existing in issuing of the processing parameter, stores the corresponding relation between the processing parameter and the image frame through the context queue, performs image processing on the image frame to be processed according to the processing parameter corresponding to the image frame to be processed during the image processing, fully utilizes the characteristic that the processing parameter has real-time property, and avoids the condition that an image processing result is not synchronous with a scene.
[ description of the drawings ]
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a flowchart of a method for image processing according to an embodiment of the present disclosure;
FIG. 2 is a flow chart of another method of image processing provided by an embodiment of the present application;
FIG. 3 is a diagram illustrating a context queue according to an embodiment of the present application;
fig. 4 is a schematic diagram of frame information provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
[ detailed description ] embodiments
For better understanding of the technical solutions of the present application, the following detailed descriptions of the embodiments of the present application are provided with reference to the accompanying drawings.
It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
For convenience of understanding, the embodiments of the present application describe application scenarios related to the embodiments of the present application:
the Image Signal Processor (ISP) is responsible for receiving raw Signal data of the Sensor (Sensor) in the whole imaging link of the Image capturing device, and can be understood as a first step processing flow of photographing and recording of the whole Image capturing device, and is used for processing an Image Signal output by the Image Signal Sensor. The system has a core leading position in an image acquisition device system and is important equipment for forming an image acquisition device.
The image signal processor mainly has the functions of post-processing signals output by the front-end image sensor, such as linear correction, noise removal, dead pixel removal, interpolation, white balance, automatic exposure control and the like, can better restore field details under different optical conditions only by depending on an ISP (internet service provider), determines the imaging quality of the camera to a great extent by the ISP technology, is an operation processing unit in the photographing process, and is equivalent to the brain of an image acquisition device.
In the process of image shooting, the optical lens is used for focusing light on the sensor, the sensor is used for converting an optical signal into an electric signal, the ISP is used for processing the signal obtained by the sensor to obtain a visible image, and finally, the mobile phone or the image acquisition device processor is used for processing, storing and displaying the image. The ISP controls the ISP logic unit through the ISP firmware running on the ISP, so that the lens and the sensor are correspondingly controlled, and functions of automatic aperture, automatic exposure, automatic white balance and the like are further completed.
The ISP comprises an ISP logic unit and ISP firmware, wherein the ISP logic unit can complete a part of algorithm processing and can also count the real-time information of the current image. The ISP firmware performs feedback control on the lens, the sensor and the ISP logic unit by acquiring the image statistical information of the ISP logic unit and recalculating to achieve the purpose of automatically adjusting the image quality.
The ISP firmware contains three parts, one is the ISP control unit and the underlying algorithm library, one is the Auto Focus (AF), auto Exposure (AE), auto White Balance (AWB) algorithm library, and one is the sensor library. The basic idea of ISP firmware design is to provide a 3A algorithm library separately, an ISP control unit schedules a basic algorithm library and the 3A algorithm library, and simultaneously a sensor library registers function call-back to the ISP basic algorithm library and the 3A algorithm library respectively so as to realize differentiated sensor adaptation.
Before the ISP processes the image, the bottom layer software firstly sends the frame information of the picture to be processed to the upper layer software, the upper layer software issues the corresponding processing parameter, and the ISP receives the processing parameter to process the current image. However, since the processing parameters of the image signal processor are issued at the same time as the current frame is processed, the image signal processor cannot process the current frame using the processing parameters corresponding to the current frame, and thus the image signal processor can only be configured by using the existing processing parameters, which violates the original purpose of real-time performance of the processing parameters.
For example, when a dark scene is suddenly switched to a high-brightness scene, the conventional image processing method cannot process an image according to the processing parameters corresponding to the high-brightness scene picture or process the image according to the processing parameters corresponding to the dark scene picture, and the high-brightness scene picture is overexposed and overexposed due to the excessive difference between the parameters of exposure compensation, brightness, contrast and the like of the high-brightness scene and the dark scene, so that the user experience is greatly influenced. The present application provides an image processing method for solving the above problems.
Example one
Referring to fig. 1, a flowchart of an image processing method according to an embodiment of the present application is shown, where the method includes the following steps:
step S01, determining a first image frame to be processed by an image signal processor, and searching first frame information of the first image frame in a context queue of the image signal processor.
In this embodiment of the present application, the frame information stored in the context queue is frame information of an image frame corresponding to a pre-acquired processing parameter, and an object of the embodiment of the present application is to enable the image signal processor to process the first image frame according to a first processing parameter corresponding to the first image frame to be processed, so that after the first image frame to be processed by the image signal processor is determined, the first frame information of the first image frame needs to be searched in the context queue, if the first frame information can be searched in the context queue, it is proved that the first processing parameter corresponding to the first image frame has been issued in advance, and at this time, the corresponding first processing parameter is directly determined according to the first frame information.
In a specific embodiment, if the first frame information is not queried in the context queue, it is proved that the first processing parameter corresponding to the first image frame is not issued, and at this time, an instruction for processing the image may be further sent to the image signal processor, so that the image signal processor processes the first image frame according to the current processing parameter or the processing parameter corresponding to the previous frame.
In a specific embodiment, the frame information may be a frame number of the image frame, attribute information of the image frame, or other information capable of characterizing an identity of the image frame, and the specific category of the frame information is not specifically limited in the present application.
In a specific embodiment, the first image frame to be processed by the image signal processor is determined, which may be specifically determined by detecting whether the image signal processor is activated, and if activated, proving that the image signal processor is preparing to process the image frame, the image frame to be processed by the image signal processor is determined to be the first image frame.
It should be noted that, the image processing process is very rapid, the image frames are collected from the image collecting device, processed by other bottom-layer modules and sent to the image signal processor for image processing, the time consumed in the whole process is about 3ms, and the image frames cannot be sensed by human eyes, so that the user cannot be affected.
And S02, determining a first processing parameter according to the first frame information, and sending a first processing instruction containing the first processing parameter to an image signal processor.
In the embodiment of the application, the first processing instruction is used for instructing the image signal processor to perform image processing according to the first processing parameter, and after the first frame information determines the first processing parameter, the first processing instruction containing the first processing parameter is sent to the image signal processor, so that the image signal processor performs image processing on the first image frame according to the first processing parameter, the characteristic that the processing parameter has real-time property is fully utilized, and the condition that the image frame and the processing parameter are not synchronous due to the fact that hysteresis exists in issuing of the processing parameter is avoided.
For example, when a dark scene is suddenly switched to a high-brightness scene, the scheme in the application may first receive a processing parameter corresponding to an image frame of the high-brightness scene, then establish a corresponding relationship between the processing parameter and frame information of the image frame of the high-brightness scene, and store the frame information in a context queue of an image signal processor. When the image frame to be processed of the image signal processor is detected to be the high-brightness scene image frame, the frame information of the high-brightness scene image frame is searched in the context queue, if the frame information is searched, it is proved that the processing parameter corresponding to the high-brightness scene image frame is issued in advance, at the moment, the corresponding processing parameter is determined according to the frame information, and the processing parameter is sent to the image signal processor, so that the image signal processor performs firmware updating according to the processing parameter corresponding to the high-brightness scene image frame, and processes the high-brightness scene image frame according to the updated firmware, thereby avoiding the situations of overexposure, overexposure and the like of the obtained high-brightness scene image, and greatly improving user experience.
In one embodiment, the image processing parameter mentioned herein may be firmware update data, and the image signal processor, after receiving the first processing parameter, performs firmware update according to the first processing parameter and performs image processing on the first image frame according to the updated firmware.
In a specific embodiment, in order to avoid that the stored frame information is too much and the context queue cannot be stored continuously after being full, the first processing parameter may be determined according to the first frame information after step S02 is executed, and the first processing instruction including the first processing parameter is sent to the image signal processor, and then the first frame information is deleted from the context queue, thereby ensuring that the context queue has a storage space capable of storing new frame information.
The image processing method provided by the embodiment of the application determines a first image frame to be processed by an image signal processor, searches first frame information of the first image frame to be processed by the image signal processor in a context queue, if the first frame information can be found in the context queue, proves that a first processing parameter corresponding to the first image frame is issued in advance, sends a first processing instruction containing the first processing parameter to the image signal processor at the moment, so that the image signal processor performs image processing on the first image frame according to the first processing parameter, avoids the condition that the image frame and the processing parameter are not synchronous due to hysteresis property existing in issuing of the processing parameter, stores the corresponding relation between the processing parameter and the image frame through the context queue, performs image processing on the image frame to be processed according to the processing parameter corresponding to the image frame to be processed during the image processing, fully utilizes the characteristic that the processing parameter has real-time property, and avoids the condition that an image processing result is not synchronous with a scene.
Example two
On the basis of the first embodiment, please refer to fig. 2, which is a flowchart of another image processing method provided in the embodiment of the present application, the method includes the following steps:
and S11, receiving a second image frame acquired by the image acquisition device, and determining second frame information of the second image frame.
And step S12, sending a second processing instruction containing the second frame information to the first processor.
In an embodiment, after sending the second processing instruction including the second frame information to the first processor, the first processor determines a second processing parameter corresponding to the second image frame according to the second frame information, and feeds the second processing parameter back to the second processor, so that the second processor establishes a corresponding relationship between the second processing parameter and the second frame information, and stores the second frame information in the context queue.
And step S13, receiving the second processing parameter sent by the first processor.
Step S14, establishing the corresponding relation between the second processing parameter and the second frame information, and storing the second frame information into the context queue.
The context queue in the embodiment of the application is used for storing frame information of an image frame, and if the frame information of a certain image frame is stored in the context queue, it is proved that processing parameters corresponding to the image frame, which are sent by the first processor, have been received in advance.
In an embodiment, please refer to fig. 3, which is a schematic diagram of a context queue according to an embodiment of the present application, in which frame information of a plurality of image frames is stored.
In a specific embodiment, the corresponding relationship between the second processing parameter and the second frame information of the second image frame is established, which may be specifically that the second processing parameter and the second frame information are stored in a preset corresponding relationship table; the second frame information may be used as the identification information of the second processing parameter, or the storage location information of the second processing parameter and the second frame information may be stored in a preset correspondence table.
It should be noted that, in the present application, the establishment manner of the corresponding relationship between the second processing parameter and the second frame information is not particularly limited, as long as the purpose of determining the second processing parameter according to the second frame information can be achieved.
Step S01, determining a first image frame to be processed by an image signal processor, and searching first frame information of the first image frame in a context queue of the image signal processor.
And S02, determining a first processing parameter according to the first frame information, and sending a first processing instruction containing the first processing parameter to an image signal processor.
In an embodiment, to save the storage space and improve the access speed of the processing parameters, the processing parameters sent by the first processor may be stored in a preset memory, that is, the second processing parameters sent by the first processor are received in step S13, which may be implemented by performing the following steps:
step S21, receiving a data issuing instruction sent by the first processor, and determining a first memory storing the second processing parameter and a first memory address of the first memory.
And step S22, receiving the second processing parameter, and writing the second processing parameter into the first memory.
On this basis, in an embodiment, in step S14, the establishing of the corresponding relationship between the second processing parameter and the second frame information may specifically be:
and receiving data issuing completion information sent by the first processor, storing the first memory address into a first register, and establishing a corresponding relation between the first register and the second frame information.
On the basis, in a specific embodiment, as mentioned in step S02, a first processing parameter is determined according to the first frame information, and the corresponding can be implemented by performing the following steps:
and step S31, determining a second register corresponding to the first frame information.
In an embodiment, please refer to fig. 4, which is a schematic diagram of frame information provided in an embodiment of the present application, where the frame information includes a virtual address, a physical address, and frame ID information of a register, and a corresponding second memory may be determined according to the second frame information.
Step S32, reading a second memory address from the second register, and reading the first processing parameter from a second memory corresponding to the second memory address.
The embodiment of the application aims to establish a corresponding relationship between a processing parameter and frame information in advance, and then store the frame information into a context queue of an image signal processor, so that before the image signal processor processes an image frame, the corresponding processing parameter can be determined according to the frame information in the context queue, and then the image signal processor processes the image frame after updating a firmware, thereby avoiding the situation that the processed image is not synchronous with a scene.
EXAMPLE III
The image acquisition mode comprises a preview mode and a photographing mode, wherein a mobile phone camera is taken as an example, and the preview mode refers to a mode that a preview picture appears on a screen after the mobile phone camera is clicked to enter a camera application; the photographing mode is a mode in which a photograph is generated after a photographing button is clicked. The image signal processor processes the image frame by adopting different processing parameters for the preview mode and the photographing mode respectively.
For such a situation, in order to avoid increasing the number of times of interaction between the upper layer software in the first processor and the lower layer software in the second processor, the first processor usually issues two processing parameters under different scenes directly for one image frame, and the lower layer software selects the corresponding processing parameters for image processing according to the image acquisition mode.
Thus, in one particular embodiment, the categories of the first processing parameters may include preview parameters and photo parameters, and the context queue may include a first context queue and a second context queue.
On this basis, the step S14 of storing the second frame information into the context queue may be specifically implemented by performing the following steps:
step S41, obtaining the category identification information of the first processing parameter, and determining the category of the first processing parameter as a preview parameter or a photographing parameter according to the category identification information.
Step S42, if the type of the first processing parameter is a preview parameter, storing the first frame information into the first context queue.
Step S40, if the type of the first processing parameter is a photographing parameter, storing the first frame information into the second context queue.
In an embodiment, if the type of the first processing parameter mentioned in step S43 is a photographing parameter, the first frame information is stored in the second context queue, which may specifically be:
if the category of the first processing parameter is a photographing parameter, judging whether the second context queue is full;
if the second context queue is not full, storing the first frame information into the second context queue;
and if the second context queue is full, deleting the frame information at the head position of the second context queue, and storing the first frame information in the tail position of the second context queue.
Here, taking a mobile phone camera as an example, in the embodiment of the present application, the reason for determining whether the second context queue is full is that after the camera application is started, the image acquisition device may continuously acquire image frames, and correspondingly, the first processor may continuously issue the preview parameters and the photographing parameters, and in the preview mode, the processing of the image frames is real-time, the image signal processor may continuously process the image frames, and the frame information corresponding to the preview parameters may also be continuously deleted in the first context queue, so that the first context queue may not be fully loaded.
In the photographing mode, the image signal processor does not process the image frames in real time, but processes the image frames by using the photographing parameters corresponding to the frame information in the second context queue only when the image acquisition mode of the image frames is the photographing mode, that is, when the user clicks the photographing button, that is, the frame information corresponding to the photographing parameters is not deleted in real time in the first context queue, but is deleted only when the image acquisition mode of the image frames is the photographing mode, so that the second context queue is fully loaded, and further before the first frame information is stored in the second context queue, whether the second context queue is fully loaded needs to be judged.
On the basis of the foregoing embodiment, in a specific embodiment, as mentioned in step S01, the first frame information of the first image frame is searched in the context queue of the image signal processor, which may be specifically implemented by performing the following steps:
and S51, acquiring an image acquisition mode of the first image frame.
Step S52, if the image capturing mode is the preview mode, searching for the first frame information in the first context queue.
Step S53, if the image capturing mode is the photographing mode, searching for the first frame information in the second context queue.
In the embodiment of the application, when the processing parameters are issued, the frame information corresponding to the preview mode and the photographing mode is respectively stored in different queues, and when the image signal processor processes the image frames, the corresponding processing parameters are selected according to the image acquisition mode to perform the image processing after the firmware is updated, so that the accuracy of the image processing is ensured.
Example four
Referring to fig. 4, a schematic structural diagram of an image processing apparatus according to an embodiment of the present application is shown, the apparatus including:
a determining module 100, configured to determine a first image frame to be processed by an image signal processor, and search first frame information of the first image frame in a context queue of the image signal processor, where the frame information stored in the context queue is frame information of an image frame corresponding to a pre-obtained processing parameter;
a first sending module 200, configured to determine a first processing parameter according to the first frame information, and send a first processing instruction including the first processing parameter to an image signal processor, where the first processing instruction is used to instruct the image signal processor to perform image processing according to the first processing parameter.
On the basis of the above embodiment, in a specific embodiment, the apparatus may further include:
the first receiving module is used for receiving a second image frame acquired by the image acquisition device and determining second frame information of the second image frame;
a second sending module, configured to send a second processing instruction including the second frame information to a first processor, where the second processing instruction is used to instruct the first processor to determine, according to the second frame information, a second processing parameter corresponding to the second image frame;
a second receiving module, configured to receive the second processing parameter sent by the first processor;
and the establishing module is used for establishing the corresponding relation between the second processing parameter and the second frame information and storing the second frame information into the context queue.
On the basis of the foregoing embodiments, in a specific embodiment, the first receiving module 100 may include:
the first receiving unit is used for receiving a data issuing instruction sent by the first processor and determining a first memory for storing the second processing parameter and a first memory address of the first memory;
a second receiving unit, configured to receive the second processing parameter, and write the second processing parameter into the first memory;
the setup module 200 may include:
and the third receiving unit is used for receiving data issuing completion information sent by the first processor, storing the first memory address into a first register, and establishing a corresponding relation between the first register and the second frame information.
On the basis of the above embodiments, in a specific embodiment, the first sending module 400 may include:
the first determining unit is used for determining a second register corresponding to the first frame information;
and the reading unit is used for reading a second memory address from the second register and reading the first processing parameter from a second memory corresponding to the second memory address.
On the basis of the foregoing embodiment, in a specific embodiment, the first processing parameter includes a first preview parameter and a first photographing parameter;
the context queues comprise a first context queue and a second context queue;
the setup module 200 may include:
the second determining unit is used for acquiring the category identification information of the first processing parameter and determining the category of the first processing parameter as a preview parameter or a photographing parameter according to the category identification information;
a first storage unit, configured to store the first frame information into the first context queue if the type of the first processing parameter is a preview parameter;
and the second storage unit is used for storing the first frame information into the second context queue if the type of the first processing parameter is the photographing parameter.
On the basis of the above embodiments, in a specific embodiment, the second storage unit may include:
a determining subunit, configured to determine whether the second context queue is full if the type of the first processing parameter is a photographing parameter;
a first storage subunit, configured to store the first frame information into the second context queue if the second context queue is not full;
and the second storage subunit is configured to delete the frame information at the head position of the second context queue if the second context queue is full, and store the first frame information in the tail position of the second context queue.
Based on the foregoing embodiments, in a specific embodiment, the determining module 300 may include:
the acquisition unit is used for acquiring the image acquisition mode of the second image frame;
a first searching unit, configured to search the first frame information in the first context queue if the image acquisition mode is a preview mode;
and the second searching unit is used for searching the first frame information in the second context queue if the image acquisition mode is a photographing mode.
EXAMPLE five
The embodiment provides an electronic device, which includes a processor and a memory, where the memory is used to store at least one instruction, and the instruction is loaded and executed by the processor to implement the above detection method for a laser scanning unit, and the execution manner and the beneficial effects are similar, and are not described herein again.
The embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the detection method of the laser scanning unit is implemented, and the execution mode and the beneficial effect of the detection method are similar, and are not described herein again.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (10)
1. A method of image processing, comprising:
determining a first image frame to be processed by an image signal processor, and searching first frame information of the first image frame in a context queue of the image signal processor, wherein the frame information stored in the context queue is frame information of the image frame corresponding to a pre-acquired processing parameter;
and determining a first processing parameter according to the first frame information, and sending a first processing instruction containing the first processing parameter to an image signal processor, wherein the first processing instruction is used for instructing the image signal processor to perform image processing according to the first processing parameter.
2. The method of claim 1, wherein prior to determining the first image frame to be processed by the image signal processor, the method further comprises:
receiving a second image frame acquired by an image acquisition device, and determining second frame information of the second image frame;
sending a second processing instruction containing the second frame information to a first processor, wherein the second processing instruction is used for instructing the first processor to determine a second processing parameter corresponding to the second image frame according to the second frame information;
receiving the second processing parameter sent by the first processor;
and establishing a corresponding relation between the second processing parameter and the second frame information, and storing the second frame information into the context queue.
3. The method of claim 2, wherein the receiving the second processing parameter sent by the first processor comprises:
receiving a data issuing instruction sent by the first processor, and determining a first memory for storing the second processing parameter and a first memory address of the first memory;
receiving the second processing parameter, and writing the second processing parameter into the first memory;
the establishing of the corresponding relationship between the second processing parameter and the second frame information includes:
and receiving data issuing completion information sent by the first processor, storing the first memory address into a first register, and establishing a corresponding relation between the first register and the second frame information.
4. The method of claim 3, wherein determining the first processing parameter according to the first frame information comprises:
determining a second register corresponding to the first frame information;
and reading a second memory address from the second register, and reading the first processing parameter from a second memory corresponding to the second memory address.
5. The method according to any one of claims 2 to 4, wherein the categories of the first processing parameter include a preview parameter and a photographing parameter;
the context queues comprise a first context queue and a second context queue;
the storing the second frame information into the context queue includes:
acquiring category identification information of the first processing parameter, and determining the category of the first processing parameter as a preview parameter or a photographing parameter according to the category identification information;
if the type of the first processing parameter is a preview parameter, storing the first frame information into the first context queue;
and if the type of the first processing parameter is the photographing parameter, storing the first frame information into the second context queue.
6. The method of claim 5, wherein storing the first frame information in the second context queue if the category of the first processing parameter is a photographing parameter comprises:
if the category of the first processing parameter is a photographing parameter, judging whether the second context queue is full;
if the second context queue is not full, storing the first frame information into the second context queue;
and if the second context queue is full, deleting the frame information at the head position of the second context queue, and storing the first frame information in the tail position of the second context queue.
7. The method of claim 5, wherein said searching a context queue of said image signal processor for first frame information of said first image frame comprises:
acquiring an image acquisition mode of the first image frame;
if the image acquisition mode is a preview mode, searching the first frame information in the first context queue;
and if the image acquisition mode is a photographing mode, searching the first frame information in the second context queue.
8. An apparatus for image processing, comprising:
the device comprises a determining module, a processing module and a processing module, wherein the determining module is used for determining a first image frame to be processed by an image signal processor and searching first frame information of the first image frame in a context queue of the image signal processor, and the frame information stored in the context queue is frame information of an image frame corresponding to a pre-acquired processing parameter;
the first sending module is configured to determine a first processing parameter according to the first frame information, and send a first processing instruction including the first processing parameter to an image signal processor, where the first processing instruction is used to instruct the image signal processor to perform image processing according to the first processing parameter.
9. An electronic device, comprising:
a processor and a memory for storing at least one instruction which is loaded and executed by the processor to implement the method of image processing according to any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of image processing according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210712897.5A CN115278052A (en) | 2022-06-22 | 2022-06-22 | Image processing method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210712897.5A CN115278052A (en) | 2022-06-22 | 2022-06-22 | Image processing method and device, electronic equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115278052A true CN115278052A (en) | 2022-11-01 |
Family
ID=83761034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210712897.5A Pending CN115278052A (en) | 2022-06-22 | 2022-06-22 | Image processing method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115278052A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109300095A (en) * | 2018-08-27 | 2019-02-01 | 深圳Tcl新技术有限公司 | Image enchancing method, system and computer readable storage medium |
| WO2019114724A1 (en) * | 2017-12-14 | 2019-06-20 | 捷开通讯(深圳)有限公司 | Camera thumbnail image generating method, mobile terminal, and storage medium |
| CN110445977A (en) * | 2018-05-04 | 2019-11-12 | 安凯(广州)微电子技术有限公司 | The parameter setting method and terminal device of image-signal processor |
| CN110795054A (en) * | 2019-10-21 | 2020-02-14 | Oppo广东移动通信有限公司 | Image quality adjusting method and related product |
| CN111345033A (en) * | 2019-03-12 | 2020-06-26 | 深圳市大疆创新科技有限公司 | Parameter synchronization method, shooting device and movable platform |
| US20200314356A1 (en) * | 2019-03-29 | 2020-10-01 | Nathaniel Webster Storer | Optimized video review using motion recap images |
| CN113448623A (en) * | 2021-06-29 | 2021-09-28 | 北京紫光展锐通信技术有限公司 | Image frame processing method, electronic device, chip and storage medium |
| CN113676673A (en) * | 2021-08-10 | 2021-11-19 | 广州极飞科技股份有限公司 | Image acquisition method, image acquisition system and unmanned equipment |
-
2022
- 2022-06-22 CN CN202210712897.5A patent/CN115278052A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019114724A1 (en) * | 2017-12-14 | 2019-06-20 | 捷开通讯(深圳)有限公司 | Camera thumbnail image generating method, mobile terminal, and storage medium |
| CN110445977A (en) * | 2018-05-04 | 2019-11-12 | 安凯(广州)微电子技术有限公司 | The parameter setting method and terminal device of image-signal processor |
| CN109300095A (en) * | 2018-08-27 | 2019-02-01 | 深圳Tcl新技术有限公司 | Image enchancing method, system and computer readable storage medium |
| CN111345033A (en) * | 2019-03-12 | 2020-06-26 | 深圳市大疆创新科技有限公司 | Parameter synchronization method, shooting device and movable platform |
| US20200314356A1 (en) * | 2019-03-29 | 2020-10-01 | Nathaniel Webster Storer | Optimized video review using motion recap images |
| CN110795054A (en) * | 2019-10-21 | 2020-02-14 | Oppo广东移动通信有限公司 | Image quality adjusting method and related product |
| CN113448623A (en) * | 2021-06-29 | 2021-09-28 | 北京紫光展锐通信技术有限公司 | Image frame processing method, electronic device, chip and storage medium |
| CN113676673A (en) * | 2021-08-10 | 2021-11-19 | 广州极飞科技股份有限公司 | Image acquisition method, image acquisition system and unmanned equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8797423B2 (en) | System for and method of controlling a parameter used for detecting an objective body in an image and computer program | |
| US8493464B2 (en) | Resolution adjusting method | |
| WO2021169686A1 (en) | Photo capture control method and apparatus and computer readable storage medium | |
| CN111491102A (en) | Detection method and system for photographing scene, mobile terminal and storage medium | |
| CN110430370B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US8525913B2 (en) | Digital photographing apparatus, method of controlling the same, and computer-readable storage medium | |
| US7106376B1 (en) | Method and system for improving image quality of portrait images using a focus zone shift | |
| CN113298735A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| US20120229678A1 (en) | Image reproducing control apparatus | |
| JP2003050990A (en) | Image processor and program making computer function as the image processor | |
| CN110266965B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20120075495A1 (en) | Electronic camera | |
| CN108307114B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN115278052A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| JP2011135380A (en) | Image capturing apparatus, image sharing method, and image sharing program | |
| JP4499275B2 (en) | Electronic camera system and electronic camera | |
| JP7246894B2 (en) | Imaging device and its control method | |
| CN114449150A (en) | Photographing method, photographing device, terminal and computer-readable storage medium | |
| JP5406619B2 (en) | MOVING IMAGE REPRODUCTION DEVICE, IMAGING DEVICE, CONTROL METHOD THEREOF, AND PROGRAM | |
| WO2023245391A1 (en) | Preview method and apparatus for camera | |
| JP5803873B2 (en) | Exposure device, exposure method, and program | |
| CN112422809B (en) | Image pickup apparatus, control method of image pickup apparatus, and computer readable medium | |
| CN112218008B (en) | Device control method, device, storage medium and electronic device | |
| US20240214516A1 (en) | Communication device and control device | |
| JP4872801B2 (en) | Imaging apparatus, imaging method, and imaging program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |