CN118018835A - Image capturing method, image capturing device, image capturing apparatus, and storage medium - Google Patents
Image capturing method, image capturing device, image capturing apparatus, and storage medium Download PDFInfo
- Publication number
- CN118018835A CN118018835A CN202211399052.1A CN202211399052A CN118018835A CN 118018835 A CN118018835 A CN 118018835A CN 202211399052 A CN202211399052 A CN 202211399052A CN 118018835 A CN118018835 A CN 118018835A
- Authority
- CN
- China
- Prior art keywords
- image
- image data
- filter effect
- parameter
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000000694 effects Effects 0.000 claims abstract description 170
- 238000006243 chemical reaction Methods 0.000 claims abstract description 109
- 238000012545 processing Methods 0.000 claims abstract description 97
- 230000004927 fusion Effects 0.000 claims description 108
- 238000013507 mapping Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 abstract description 12
- 230000006870 function Effects 0.000 description 15
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012856 packing Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 102100039334 HAUS augmin-like complex subunit 1 Human genes 0.000 description 1
- 101100177185 Homo sapiens HAUS1 gene Proteins 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The present disclosure relates to an image capturing method, an image capturing apparatus, an image capturing device, and a storage medium. The image shooting method comprises the following steps: acquiring original image data; performing filter effect processing and image format conversion on the original image data through an image signal processor to obtain first image data, wherein the filter effect processing is used for generating a target filter effect; and generating a target image according to the first image data. According to the method, the filter effect is generated on the original image data through the image signal processor, the image format conversion is carried out, the limitation of CPU performance is avoided in the image processing process, and the filter can be added for the high-resolution image.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image capturing method, an image capturing device, an image capturing apparatus, and a storage medium.
Background
With the development of image processing technology and the wide application in various image capturing devices, a stable and efficient image processing flow is realized at present, that is, the image capturing device is adopted to collect an image, and then an image processing algorithm is adopted to further process the collected image so as to obtain a final output image.
In the related art, an image capturing apparatus captures an original image through an ISP and adds a filter effect to the original image using an image processing algorithm, but when capturing an image, the image capturing apparatus does not support adding a filter effect to a high-resolution image in real time using the image processing algorithm due to a CPU (Central Processing Unit ) performance limit of the image capturing apparatus.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides an image capturing method, apparatus, image capturing device, and storage medium.
According to a first aspect of embodiments of the present disclosure, there is provided an image capturing method, the method including:
acquiring original image data;
Performing filter effect processing and image format conversion on the original image data through an image signal processor to obtain first image data, wherein the filter effect processing is used for generating a target filter effect;
and generating a target image according to the first image data.
In some embodiments, the image signal processor includes a color space conversion module, and the performing, by the image signal processor, the filter effect processing and the image format conversion on the raw image data to obtain the first image data includes:
and performing filter effect processing and image format conversion on the original image data through the color space conversion module to obtain the first image data.
In some embodiments, the filtering effect processing and the image format conversion are performed on the original image data by an image signal processor to obtain first image data, including:
Acquiring fusion parameters corresponding to the target filter effect according to the target filter effect, wherein the fusion parameters are used for converting the image format of the original image data and generating the target filter effect for the original image data;
And carrying out the filter effect processing and the image format conversion on the original image data based on the fusion parameters by the image signal processor to obtain the first image data.
In some embodiments, the fusion parameters are determined from conversion parameters for converting an image format of the raw image data and filter conversion parameters that generate the target filter effect for the raw image data.
In some embodiments, the fusion parameters include a first fusion parameter and a fusion deviation parameter; the conversion parameters comprise a first conversion parameter and a conversion deviation parameter; the fusion parameters are determined as follows:
Taking the product of the first conversion parameter and the filter conversion parameter as the first fusion parameter; and taking the product of the conversion deviation parameter and the filter conversion parameter as the fusion deviation parameter.
In some embodiments, the performing the filter effect processing and the image format conversion on the original image data based on the fusion parameter to obtain the first image data includes:
and taking the sum of the product of the preset channel parameter corresponding to the original image data and the first fusion parameter and the fusion deviation parameter as the preset channel parameter corresponding to the first image data.
In some embodiments, the obtaining, according to the target filter effect, a fusion parameter corresponding to the target filter effect includes:
and acquiring the fusion parameters corresponding to the target filter effect according to the mapping relation between the filter effect and the corresponding fusion parameters.
In some embodiments, the method further comprises:
Establishing a mapping relation between the target filter effect and the corresponding fusion parameter according to the identifier of the filter effect and the corresponding fusion parameter;
And storing the identification of the target filter effect and the corresponding fusion parameters correspondingly according to the mapping relation.
According to a second aspect of embodiments of the present disclosure, there is provided an image capturing apparatus including:
a data acquisition module configured to acquire original image data;
An image signal processor configured to perform filter effect processing and image format conversion on the original image data to obtain first image data, wherein the filter effect processing is used for generating a target filter effect;
and the generation module is configured to generate a target image according to the first image data.
In some embodiments, the image signal processor includes a color space conversion module configured to perform the filter effect processing and the image format conversion on the raw image data to obtain the first image data.
In some embodiments, the image signal processor is configured to:
Acquiring fusion parameters corresponding to the target filter effect according to the target filter effect, wherein the fusion parameters are used for converting the image format of the original image data and generating the target filter effect for the original image data;
and carrying out the filter effect processing and the image format conversion on the original image data based on the fusion parameters to obtain the first image data.
In some embodiments, the fusion parameters are determined from conversion parameters for converting an image format of the raw image data and filter conversion parameters that generate the target filter effect for the raw image data.
In some embodiments, the fusion parameters include a first fusion parameter and a fusion deviation parameter; the conversion parameters comprise a first conversion parameter and a conversion deviation parameter; the fusion parameters are determined as follows:
Taking the product of the first conversion parameter and the filter conversion parameter as the first fusion parameter; and taking the product of the conversion deviation parameter and the filter conversion parameter as the fusion deviation parameter.
In some embodiments, the image signal processor is configured to use a sum of the product of the preset channel parameter corresponding to the original image data and the first fusion parameter and the fusion deviation parameter as the preset channel parameter corresponding to the first image data.
In some embodiments, the image signal processor is configured to obtain the fusion parameter corresponding to the target filter effect from the image capturing apparatus according to a mapping relationship between the filter effect and the corresponding fusion parameter.
In some embodiments, the apparatus further comprises:
The relation establishing module is configured to establish a mapping relation between the filter effect and the corresponding fusion parameter according to the identifier of the filter effect and the corresponding fusion parameter;
and the parameter storage module is configured to store the identification of the target filter effect and the corresponding fusion parameter in the image pickup equipment according to the mapping relation.
According to a third aspect of the embodiments of the present disclosure, there is provided an image pickup apparatus including:
A processor;
a memory for storing processor-executable instructions;
Wherein the processor is configured to perform the image capturing method according to any of the first aspects of the embodiments of the present disclosure.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, which when executed by a processor of an image capturing apparatus, causes the image capturing apparatus to perform the image capturing method according to any one of the first aspects of embodiments of the present disclosure.
The method has the following beneficial effects:
According to the image shooting method, after the original image data are obtained, the filter effect processing and the image format conversion are directly carried out on the original image data through the image signal processor, namely, the functions of converting the image format and generating the target filter effect for the original image data are realized through the image signal processor.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a flowchart illustrating an image photographing method according to an exemplary embodiment;
FIG. 2 is a flowchart illustrating an image capture method according to an exemplary embodiment;
FIG. 3 is a schematic diagram illustrating a filter effect according to an exemplary embodiment;
FIG. 4 is a flowchart illustrating an image processing process according to an exemplary embodiment;
FIG. 5 is a flowchart illustrating an image processing procedure in the related art according to an exemplary embodiment;
FIG. 6 is a flowchart illustrating an image capture process according to an exemplary embodiment;
FIG. 7 is an image processing flow shown in accordance with an exemplary embodiment;
FIG. 8 is a flow of image processing in a related art, shown in accordance with an exemplary embodiment;
FIG. 9 is a schematic diagram illustrating one resolution and frame rate selection in accordance with an exemplary embodiment;
fig. 10 is a device block diagram of an image photographing device according to an exemplary embodiment;
fig. 11 is a block diagram of an image capturing apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The image shooting method provided by the embodiment of the disclosure is executed by the image shooting equipment, and the image shooting equipment can be electronic equipment with an image shooting function such as a smart phone and a tablet personal computer.
Fig. 1 is a flowchart illustrating an image capturing method according to an exemplary embodiment, referring to fig. 1, an execution subject of an embodiment of the present disclosure is an image capturing apparatus, the method including the steps of:
Step S101, original image data is acquired.
The original image data is image data which is directly acquired by a camera module in the camera equipment and is not processed, and the original image data can be image data in a RAW format; the raw image data may be data in RGB (Red Green Blue) format, that is, the raw image data is data in a matrix representation including RGB values of respective pixels.
Step S102, performing filter effect processing and image format conversion on the original image data by an image signal processor to obtain first image data, wherein the filter effect processing is used for generating a target filter effect.
In an embodiment of the present disclosure, an image pickup apparatus includes an image signal processor, through which a target filter effect is generated for original image data after the original image data is acquired, and performs image format conversion on the original image data. The filter effect means that the special effect is added to the corresponding image or the color of the image is adjusted by changing the image data, for example, the filter effect can be the addition of the love special effect, the glasses special effect and the like to the image.
For example, the image sensor generates image data in a RAW format, transmits the image data in the RAW format to an image signal processor (IMAGE SIGNAL Processing, ISP), and the ISP can convert the image data in the RAW format into image data in a format of a high-efficiency video Container (HIGH EFFICIENCY IMAGE Container, HEIC), a portable network graphic (Portable Network Graphics, JPG), or the like. And, the target filter effect can be generated for the original image data while converting the image format.
Step 103, generating a target image according to the first image data.
In the embodiment of the disclosure, after the first image data is obtained by the image signal processor, the target image can be obtained directly based on the first image data, or an image processing algorithm can be continuously adopted to process the first image data, and then the target image can be obtained based on the processed first image data.
According to the image shooting method, after the original image data are obtained, the filter effect processing and the image format conversion are directly carried out on the original image data through the image signal processor, namely, the functions of converting the image format and generating the target filter effect for the original image data are realized through the image signal processor. The function of converting the image format and generating the filter effect is realized by the hardware module of the ISP, and the function of generating the filter effect is realized by using the hardware module of the ISP under the condition that the hardware structure of the image pickup equipment is not required to be changed.
Fig. 2 is a flowchart illustrating an image capturing method according to an exemplary embodiment, referring to fig. 2, an execution subject of an embodiment of the present disclosure is an image capturing apparatus, the method including the steps of:
step S201, original image data is acquired.
The original image data is image data which is directly acquired by a camera module in the image capturing device and is not processed, the original image data can be data in an RGB format, namely, the original image data is data which adopts a matrix to express and contains RGB values of each pixel point, and the original image data can also be called as image data in a RAW format. For example, the raw image data may be represented as the following matrix:
wherein, R comprises R value of each pixel point, G comprises G value of each pixel point, and B comprises B value of each pixel point.
In some embodiments, a camera module in an image capture device includes an image sensor through which raw image data of a scene is acquired.
Step S202, according to the target filter effect, obtaining fusion parameters corresponding to the target filter effect.
The fusion parameters corresponding to the target filter effect are used for converting the image format of the original image data and generating the target filter effect for the original image data, and the fusion parameters comprise parameter information for converting the image format and parameter information for generating the target filter effect. Each filter effect has a corresponding fusion parameter, the fusion parameters in the image capturing equipment are parameters stored in the image capturing equipment in advance, and in the image capturing process, the fusion parameters corresponding to the selected target filter effect can be directly obtained from the stored fusion parameters.
In some embodiments, the fusion parameters are determined from conversion parameters for converting an image format of the original image data and filter conversion parameters that generate a target filter effect for the original image data. The image format of the original image data is RGB format, and the conversion parameters are used for converting the RGB format into YUV format (YCbCr, a pixel format) or other image formats; the filter conversion parameters are used for representing the corresponding filter effects, and the filter conversion parameters corresponding to different filter effects are different.
In some embodiments, the conversion parameters include a first conversion parameter for converting an RGB format of the original image data into another image format and a conversion deviation parameter for adjusting a deviation generated from the original image data when the image format conversion is performed. The manner of determining the fusion parameters includes: taking the product of the first conversion parameter and the filter conversion parameter as a first fusion parameter; taking the product of the conversion deviation parameter and the filter conversion parameter as a fusion deviation parameter.
For example, taking the original image data belonging to the BT601 standard as an example, the first conversion parameters are:
the conversion deviation parameters are as follows:
The filter conversion parameters are as follows:
The first fusion parameter is the result of the calculation of the following formula:
The fusion deviation parameter is the calculation result of the following formula:
It should be noted that, the fusion parameters in the embodiments of the present disclosure may be determined by other electronic devices using the foregoing embodiments and then sent to the image capturing device in the embodiments of the present disclosure for storage, or may be determined by the image capturing device in the embodiments of the present disclosure using the foregoing embodiments before image capturing is performed and then stored, which is not limited by the embodiments of the present disclosure.
In the embodiment of the disclosure, the mapping relationship between the filter effect and the corresponding fusion parameter refers to one-to-one correspondence between each filter effect and the fusion parameter. The map is stored in the image pickup apparatus, and after the user selects the target filter effect, fusion parameters corresponding to the selected target filter effect are acquired from the image pickup apparatus according to the map.
In some embodiments, a mapping relationship between the filter effect and the corresponding fusion parameter is established according to the identifier of the filter effect and the corresponding fusion parameter, wherein the mapping relationship comprises the identifier of the filter effect and the corresponding fusion parameter; and storing the identification of the filter effect and the corresponding fusion parameters in the image pickup equipment according to the mapping relation. In this case, acquiring the fusion parameter corresponding to the target filter effect from the image capturing apparatus according to the mapping relationship between the filter effect and the corresponding fusion parameter, including: and acquiring fusion parameters corresponding to the identifiers from the image pickup equipment according to the mapping relation and the identifiers of the selected target filter effects.
Optionally, in the shooting process of the image capturing device, the user selects one filter effect from the multiple filter effects, the camera component generates an image shooting request carrying the identifier based on the identifier of the selected filter effect, and then the image capturing device acquires the fusion parameter corresponding to the identifier based on the identifier carried in the image shooting request and the mapping relation.
Optionally, the image capturing device stores fusion parameters corresponding to different filter effects in different tables, and acquiring the fusion parameters corresponding to the filter effects from the image capturing device includes: and reading fusion parameters corresponding to the filter effect from the table.
In some embodiments, the image capturing apparatus is installed with a camera application, a plurality of filter effects are displayed in a capturing interface when capturing an image by the camera application, and then a user can select a desired filter effect from the plurality of filter effects. See, for example, a schematic diagram of the filter effect shown in fig. 3.
In addition, in some embodiments, the filter conversion parameters corresponding to the filter effect may be obtained through continuous debugging. That is, according to the final display effect of the filter effect, an initial filter conversion parameter is set first, then based on the initial filter conversion parameter and the image data for debugging, the image data after the filter effect is added is determined, if the display effect achieved by the image data after the filter effect is not the final display effect of the filter effect, the initial filter conversion parameter is adjusted until the display effect achieved by the image data after the filter effect is not the final display effect of the filter effect.
It should be noted that, the step of acquiring the target filter effect versus the fusion parameter may be performed by a processor of the image capturing apparatus or may be performed by an image signal processor, which is not limited in the embodiment of the present disclosure.
In step S203, the image signal processor performs filter effect processing and image format conversion on the original image data based on the fusion parameters to obtain first image data.
In an embodiment of the disclosure, an image signal processor converts an image format of original image data and generates a target filter effect for the original image data based on a fusion parameter, and the obtained first image data is the image data having the converted image format and the target filter effect.
In some embodiments, the sum of the product of the preset channel parameter corresponding to the original image data and the first fusion parameter and the fusion deviation parameter is used as the preset channel parameter corresponding to the first image data by the image signal processor.
The preset channel parameters corresponding to the original image data are channel parameters of three channels of RGB, the preset channel parameters corresponding to the target image number are channel parameters corresponding to the converted image format, the RGB format is converted into the YUV format, and the preset channel parameters corresponding to the first image data are channel parameters of three channels of YUV.
For example, the preset channel parameters corresponding to the first image data may be represented as the following matrix:
wherein Y comprises the Y value of each pixel point, U comprises the U value of each pixel point, and V comprises the V value of each pixel point.
For example, the process of the preset channel parameter corresponding to the first image data may be expressed by the following formula:
It should be noted that, in the embodiment of the present disclosure, the first fusion parameter is expressed only by using the product of the first conversion parameter and the filter conversion parameter, and the fusion deviation parameter is expressed by using the product of the conversion deviation parameter and the filter conversion parameter, where in practical application, it is adopted that Calculated result of/>Is calculated by the computer.
In addition, in some embodiments, the image signal processor includes a color space conversion (Color Space Transformation, CST) module, and the filter effect processing and the image format conversion are performed on the original image data by the image signal processor to obtain first image data, including: and performing filter effect processing and image format conversion on the original image data through a color space conversion module to obtain first image data. The specific embodiment of the processing performed by the color space conversion module is the same as the embodiment in step S203, and will not be described here again.
Step S204, generating a target image according to the first image data.
In the embodiment of the disclosure, after the first image data is obtained by the image signal processor, the target image can be obtained directly based on the first image data, or an image processing algorithm may be continuously adopted to process the first image data, and then the target image is obtained based on the processed first image data, for example, the image processing algorithm is adopted to enhance the image quality of the first image data or realize other functions.
In addition, in some embodiments, the first image data is encoded, and the encoded first image data is stored in a file to obtain a final image file.
For example, referring to the flowchart of the image processing procedure shown in fig. 4, first, original image data is acquired through a camera module, then image format conversion and filter effect processing are performed on the original image data through an ISP to obtain first image data, then image quality enhancement or other processing is performed on the first image data through an image processing algorithm, finally the processed first image data is encoded, and the encoded first image data is stored in a file to obtain a final image file.
In the related art, the image format is converted by the ISP, and then the filter effect processing is performed on the converted image data by adopting an image processing algorithm. See, for example, the following formula:
For example, referring to the flowchart of the image processing procedure in the related art shown in fig. 5, first, original image data is acquired through a camera module, then image format conversion is performed on the original image data through an ISP to obtain first image data, then filter effect processing, image quality enhancement or other processing is performed on the first image data through an image processing algorithm, finally the processed first image data is encoded, and the encoded first image data is stored in a file to obtain a final image file.
By comparing the flowcharts of the image processing procedures shown in fig. 4 and 5, it can be determined that the image capturing method provided in the embodiment of the present disclosure advances the step of performing the filter effect processing on the original image data, and the image signal processor performs the filter effect processing on the original image data, instead of performing the image format conversion on the original image data by the image signal processor, and then performing the filter effect processing on the first image data by other modules in the image capturing apparatus.
According to the image shooting method, after the original image data are obtained, the filter effect processing and the image format conversion are directly carried out on the original image data through the image signal processor, namely, the functions of converting the image format and generating the target filter effect for the original image data are realized through the image signal processor. The function of converting the image format and generating the filter effect is realized by the hardware module of the ISP, and the function of generating the filter effect is realized by using the hardware module of the ISP under the condition that the hardware structure of the image pickup equipment is not required to be changed.
In addition, in the embodiment of the disclosure, the color space conversion module in the ISP further performs filter effect processing, so that the color space conversion module has a function of generating a filter effect.
Fig. 6 is a flowchart showing an image capturing process according to an exemplary embodiment, and is performed by an image capturing apparatus including an image sensor, an ISP, and a processor, referring to fig. 6. Firstly, generating a RAW image by an image sensor, namely generating original image data, transmitting the RAW image to an ISP, performing image format conversion and filter effect processing on the RAW image by the ISP to obtain first image data, outputting the first image data to a processor, and finally performing other image processing on the first image data by the processor to obtain a target image. The embodiment of each step in fig. 6 is the same as the embodiment in fig. 2, and will not be described again.
In addition, from the aspect of program implementation flow, the image processing flow provided by the embodiment of the present disclosure is also different from the image processing flow in the related art, for example, see the image processing flow shown in fig. 7 and 8, where the image processing flow in fig. 7 is the image processing flow in the embodiment of the present disclosure, and the image processing flow in the related art is fig. 8. Comparing the flows of fig. 7 and 8, it can be seen that, in the embodiment of the disclosure, when the camera application issues an image request, the image request carries the identifier of the target filter effect, while the image request given in the related art does not carry the identifier of the target filter effect; then, in the stage of obtaining the parameters, in the embodiment of the present disclosure, the tuning parameters are obtained by packing fusion parameters selected according to the identification of the target filter effect, while in the related art, the tuning parameters are obtained by packing according to a fixed image conversion matrix; then, the processing flow in the embodiment of the present disclosure is the same as that in the related art, in which the tuning parameter is sent to the hardware platform, written into the register of the image capturing apparatus, and then after the original image data is received, the original image data is returned to the image processing flow in an image frame format, that is, the original image data is processed by the ISP, and finally the processed first image data is obtained, where the processing of the original image data by the ISP in the embodiment of the present disclosure includes: performing image format conversion and adding a target filter effect to the original image data, and processing the original image data by the ISP in the related art includes: and performing image format conversion on the original image data. And then, continuing to perform image post-processing on the obtained first image data, wherein the image post-processing comprises processing by adopting an image processing algorithm and image coding.
The above embodiments are described taking a single frame image as an example, and in some embodiments, the image processing algorithm provided in the embodiments of the disclosure is equally applicable to processing video data. In addition, because the video data comprises a plurality of image data, compared with the image processing mode in the related art, the image processing mode in the embodiment of the disclosure is adopted to process each image data in the video data, so that a better processing effect can be realized.
Also, for a video photographing scene having a high resolution and a high frame rate and requiring a filter effect to be added, for example, for a video photographing scene having a resolution of 8K and a frame rate of 24FPS (FRAMES PER seconds of transmission frame number) at photographing in fig. 9, the image processing method in the related art does not support an operation of a high resolution image in real time using an image processing algorithm due to a limitation of the computing power of the image capturing apparatus, that is, does not support a filter effect to be added to a high resolution image. The function of adding the filter effect is integrated into the hardware module of the ISP, and the function of adding the filter effect for the video with high resolution and high frame rate can be provided for the user on the premise of not changing the hardware structure, not increasing the power consumption and not increasing the calculation force requirement, so that the use experience of the user is improved. In addition, the image processing mode disclosed by the embodiment of the invention can achieve the same effect in the video shooting scene with low resolution and low frame rate and the need of adding the filter effect, can optimize indexes such as memory and power consumption, and improves the smoothness of the imaging equipment in use.
Fig. 10 is a block diagram of an apparatus of an image photographing apparatus according to an exemplary embodiment, see fig. 10, including:
a data acquisition module 1001 configured to acquire original image data;
an image signal processor 1002 configured to perform filter effect processing and image format conversion on the original image data to obtain first image data, the filter effect processing being used to generate a target filter effect;
the generation module 1003 is configured to generate a target image from the first image data.
According to the image shooting device, after the original image data are obtained, the filter effect processing and the image format conversion are directly carried out on the original image data through the image signal processor, namely, the functions of converting the image format and generating the target filter effect for the original image data are realized through the image signal processor. The function of converting the image format and generating the filter effect is realized by the hardware module of the ISP, and the function of generating the filter effect is realized by using the hardware module of the ISP under the condition that the hardware structure of the image pickup equipment is not required to be changed.
In some embodiments, the image signal processor 1002 includes a color space conversion module configured to filter effect process and image format convert the raw image data to obtain the first image data.
In some embodiments, the image signal processor 1002 is configured to:
Acquiring fusion parameters corresponding to the target filter effect according to the target filter effect, wherein the fusion parameters are used for converting the image format of the original image data and generating the target filter effect for the original image data;
And performing filter effect processing and image format conversion on the original image data based on the fusion parameters to obtain first image data.
In some embodiments, the fusion parameters are determined from conversion parameters for converting an image format of the original image data and filter conversion parameters that generate a target filter effect for the original image data.
In some embodiments, the fusion parameters include a first fusion parameter and a fusion deviation parameter; the conversion parameters comprise a first conversion parameter and a conversion deviation parameter; the fusion parameters were determined as follows:
Taking the product of the first conversion parameter and the filter conversion parameter as a first fusion parameter; taking the product of the conversion deviation parameter and the filter conversion parameter as a fusion deviation parameter.
In some embodiments, the image signal processor 1002 is configured to take the sum of the product of the preset channel parameter corresponding to the original image data and the first fusion parameter and the fusion deviation parameter as the preset channel parameter corresponding to the first image data.
In some embodiments, the image signal processor 1002 is configured to obtain the fusion parameters corresponding to the target filter effect from the image capturing apparatus according to the mapping relationship between the filter effect and the corresponding fusion parameters.
In some embodiments, the apparatus further comprises:
the relation establishing module is configured to establish a mapping relation between the filter effect and the corresponding fusion parameter according to the identifier of the filter effect and the corresponding fusion parameter;
and the parameter storage module is configured to store the identification of the target filter effect and the corresponding fusion parameters in the image pickup equipment according to the mapping relation.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
The embodiment of the present disclosure also provides an image capturing apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the image capturing method in the above-described embodiments.
Fig. 11 is a block diagram of an image capturing apparatus 1100 according to an exemplary embodiment.
Referring to fig. 11, the image capturing apparatus 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power component 1106, a multimedia component 1108, an audio component 1110, an input/output (I/O) interface 1112, a sensor component 1114, and a communication component 1116.
The processing component 1102 generally controls overall operations of the image capture apparatus 1100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1102 may include one or more processors 1120 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 1102 can include one or more modules that facilitate interactions between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate interaction between the multimedia component 1108 and the processing component 1102.
The memory 1104 is configured to store various types of data to support operations at the image pickup apparatus 1100. Examples of such data include instructions for any application or method operating on the image capture device 1100, contact data, phonebook data, messages, pictures, videos, and the like. The memory 1104 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 1106 supplies power to various components of the image capturing apparatus 1100. The power supply component 1106 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the image capture device 1100.
The multimedia component 1108 includes a screen between the image capture device 1100 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, multimedia component 1108 includes a front camera and/or a rear camera. When the image capturing apparatus 1100 is in an operation mode, such as a photographing mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 1110 is configured to output and/or input an audio signal. For example, the audio component 1110 includes a Microphone (MIC) configured to receive external audio signals when the image capturing apparatus 1100 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 further comprises a speaker for outputting audio signals.
The I/O interface 1112 provides an interface between the processing component 1102 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 1114 includes one or more sensors for providing status assessment of various aspects of the image capture device 1100. For example, the sensor assembly 1114 may detect an on/off state of the image capturing apparatus 1100, a relative positioning of the components, such as a display and a keypad of the image capturing apparatus 1100, a change in position of the image capturing apparatus 1100 or a component of the image capturing apparatus 1100, the presence or absence of a user's contact with the image capturing apparatus 1100, an orientation or acceleration/deceleration of the image capturing apparatus 1100, and a change in temperature of the image capturing apparatus 1100. The sensor assembly 1114 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1116 is configured to facilitate wired or wireless communication between the image capture device 1100 and other devices. The image capturing apparatus 1100 can access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 1116 further includes a Near Field Communication (NFC) module to facilitate short range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the image capture device 1100 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as a memory 1104 including instructions executable by the processor 1120 of the image capture device 1100 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
The present disclosure also provides a non-transitory computer-readable storage medium, which when executed by a processor of an image capturing apparatus, enables the image capturing apparatus to perform the image capturing method in the above embodiments.
Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (12)
1. An image capturing method, the method comprising:
acquiring original image data;
Performing filter effect processing and image format conversion on the original image data through an image signal processor to obtain first image data, wherein the filter effect processing is used for generating a target filter effect;
and generating a target image according to the first image data.
2. The image capturing method according to claim 1, wherein the image signal processor includes a color space conversion module, and the performing, by the image signal processor, the filter effect processing and the image format conversion on the original image data to obtain the first image data includes:
and performing filter effect processing and image format conversion on the original image data through the color space conversion module to obtain the first image data.
3. The image capturing method according to claim 1, wherein the performing, by the image signal processor, filter effect processing and image format conversion on the raw image data to obtain first image data includes:
Acquiring fusion parameters corresponding to the target filter effect according to the target filter effect, wherein the fusion parameters are used for converting the image format of the original image data and generating the target filter effect for the original image data;
And carrying out the filter effect processing and the image format conversion on the original image data based on the fusion parameters by the image signal processor to obtain the first image data.
4. The image capturing method according to claim 3, wherein the fusion parameter is determined based on a conversion parameter for converting an image format of the original image data and a filter conversion parameter for generating the target filter effect for the original image data.
5. The image capturing method according to claim 4, wherein the fusion parameters include a first fusion parameter and a fusion deviation parameter; the conversion parameters comprise a first conversion parameter and a conversion deviation parameter; the fusion parameters are determined as follows:
Taking the product of the first conversion parameter and the filter conversion parameter as the first fusion parameter; and taking the product of the conversion deviation parameter and the filter conversion parameter as the fusion deviation parameter.
6. The image capturing method according to claim 5, wherein the performing the filter effect processing and the image format conversion on the original image data based on the fusion parameter to obtain the first image data includes:
and taking the sum of the product of the preset channel parameter corresponding to the original image data and the first fusion parameter and the fusion deviation parameter as the preset channel parameter corresponding to the first image data.
7. The image capturing method according to any one of claims 1 to 6, wherein the obtaining, according to the target filter effect, a fusion parameter corresponding to the target filter effect includes:
and acquiring the fusion parameters corresponding to the target filter effect according to the mapping relation between the filter effect and the corresponding fusion parameters.
8. The image capturing method according to claim 7, characterized in that the method further comprises:
Establishing a mapping relation between the filter effect and the corresponding fusion parameter according to the identifier of the filter effect and the corresponding fusion parameter;
And storing the identification of the target filter effect and the corresponding fusion parameters correspondingly according to the mapping relation.
9. An image capturing apparatus, the apparatus comprising:
a data acquisition module configured to acquire original image data;
An image signal processor configured to perform filter effect processing and image format conversion on the original image data to obtain first image data, wherein the filter effect processing is used for generating a target filter effect;
and the generation module is configured to generate a target image according to the first image data.
10. The image capturing device of claim 9, wherein the image signal processor includes a color space conversion module configured to perform the filter effect processing and the image format conversion on the raw image data to obtain the first image data.
11. An image pickup apparatus, characterized by comprising:
A processor;
a memory for storing processor-executable instructions;
Wherein the processor is configured to perform the method of any of claims 1-8.
12. A non-transitory computer-readable storage medium, characterized in that instructions in the storage medium, when executed by a processor of an image capturing apparatus, enable the image capturing apparatus to perform the image capturing method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211399052.1A CN118018835A (en) | 2022-11-09 | 2022-11-09 | Image capturing method, image capturing device, image capturing apparatus, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211399052.1A CN118018835A (en) | 2022-11-09 | 2022-11-09 | Image capturing method, image capturing device, image capturing apparatus, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118018835A true CN118018835A (en) | 2024-05-10 |
Family
ID=90945069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211399052.1A Pending CN118018835A (en) | 2022-11-09 | 2022-11-09 | Image capturing method, image capturing device, image capturing apparatus, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118018835A (en) |
-
2022
- 2022-11-09 CN CN202211399052.1A patent/CN118018835A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11704771B2 (en) | Training super-resolution convolutional neural network model using a high-definition training image, a low-definition training image, and a mask image | |
| KR101831077B1 (en) | Method and device for switching color gamut mode | |
| CN109345485B (en) | Image enhancement method and device, electronic equipment and storage medium | |
| US9591256B2 (en) | Methods and devices for video communication | |
| JP6328275B2 (en) | Image type identification method, apparatus, program, and recording medium | |
| US20160381276A1 (en) | Method and user terminal for capturing video frame | |
| CN106657780B (en) | Image preview method and device | |
| KR101727169B1 (en) | Method and apparatus for generating image filter | |
| CN111953904B (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN112114765A (en) | Screen projection method and device and storage medium | |
| CN111953903A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| US11348365B2 (en) | Skin color identification method, skin color identification apparatus and storage medium | |
| CN111726516A (en) | Image processing method and device | |
| CN104536713B (en) | Method and device for displaying characters in image | |
| CN106375787B (en) | Video playing method and device | |
| CN111447360A (en) | Application program control method and device, storage medium and electronic equipment | |
| US11900637B2 (en) | Image processing method and apparatus, and storage medium | |
| WO2021169810A1 (en) | Video processing method, and server | |
| CN118018835A (en) | Image capturing method, image capturing device, image capturing apparatus, and storage medium | |
| CN110784721A (en) | Picture data compression method and device, electronic equipment and storage medium | |
| CN111724398A (en) | Image display method and device | |
| CN111538447A (en) | Information display method, device, equipment and storage medium | |
| CN118317203A (en) | Image processing method and device, electronic equipment and chip | |
| CN114500819B (en) | Shooting method, shooting device and computer readable storage medium | |
| CN110876013B (en) | Method and device for determining image resolution, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |