CN113992850B - ISP-based image processing method and device, storage medium and image pickup apparatus - Google Patents
ISP-based image processing method and device, storage medium and image pickup apparatus Download PDFInfo
- Publication number
- CN113992850B CN113992850B CN202111221020.8A CN202111221020A CN113992850B CN 113992850 B CN113992850 B CN 113992850B CN 202111221020 A CN202111221020 A CN 202111221020A CN 113992850 B CN113992850 B CN 113992850B
- Authority
- CN
- China
- Prior art keywords
- image
- image processing
- file
- isp
- processing algorithm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides an ISP-based image processing method and device, a storage medium and image pickup equipment, wherein the method comprises the following steps: determining a current shooting scene mode; acquiring a corresponding calibration image file; processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode to obtain a simulation image; optimizing the parameter configuration file of the image processing algorithm according to the simulation image, and processing the calibration image file according to the optimized image processing algorithm to obtain the target image. According to the invention, the calibration image file is processed by the image processing algorithm, and the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is prestored, the pre-stored calibration image file is processed without continuous shooting, so that the algorithm debugging obstacle caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided, and the algorithm debugging efficiency and the algorithm debugging accuracy are improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to an ISP-based image processing method and apparatus, a storage medium, and an image capturing device.
Background
Currently, since the defects in the hardware of the camera sensor cause many defects in the original digital image output from the camera sensor, ISP (Image Signal Processing ) technology has been developed, and the variety of image processing algorithms in the ISP module has been increased due to continuous optimization and expansion, such as black level correction, dead point correction, white balance correction, lens shading correction, and the like. However, with the development of cameras and the continuous increase of shooting requirements, new algorithms may be required to process images in different scenes to adapt to different scene requirements, such as night scene mode, portrait beauty, background blurring mode, etc.
Taking the night view mode as an example, the image quality of the common photographing mode photographed at night is not objective, and there is a large defect in the alignment direction of the dynamic object, whether from the definition of the highlight or the brightness of the dim light. In order to solve this problem, a night scene mode algorithm of a third party is generally implanted in a raw domain of an ISP flow to process an image. However, to solve this problem, debugging of algorithm parameters is not avoided, and often, the parameters of such a large algorithm are thousands of, which is very difficult if a perfect parameter collocation is to be debugged. The device integrating the algorithm and the comparison device are usually required to photograph the same object in different environments, the obtained images are compared, and the algorithm is debugged according to the comparison result.
However, the above method needs to continuously shoot images, so that a great deal of time is wasted, meanwhile, due to the influence of factors such as shooting environment, shooting angle, shake and the like, the difficulty of image comparison is increased, time is wasted, the algorithm debugging difficulty is also increased, and the debugging efficiency and accuracy are not high.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems existing in the prior art.
Therefore, a first object of the present invention is to provide an ISP-based image processing method, which processes a calibration image file through an image processing algorithm, and performs debugging and optimization on the image processing algorithm according to a processing result, because the calibration image file is pre-stored, the pre-stored calibration image file is processed without continuous shooting, so that algorithm debugging obstacles caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided, and thus, algorithm debugging efficiency is improved, and algorithm debugging accuracy is improved.
To this end, a second object of the present invention is to propose an ISP-based image processing apparatus.
To this end, a third object of the present invention is to propose a computer readable storage medium.
To this end, a fourth object of the present invention is to propose an image pickup apparatus.
To achieve the above object, an embodiment of a first aspect of the present invention proposes an ISP-based image processing method, the method comprising: determining a current shooting scene mode; acquiring a calibration image file corresponding to the current shooting scene mode; processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image; and optimizing the parameter configuration file of the image processing algorithm according to the simulation image, and processing the calibration image file according to the optimized image processing algorithm to obtain a target image.
According to the ISP-based image processing method, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain the simulation image, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, the calibration image file is processed according to the optimized image processing algorithm to obtain the target image, therefore, the calibration image file is processed through the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is prestored, algorithm debugging barriers caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided through processing the prestored calibration image file, so that algorithm debugging efficiency is improved, and meanwhile algorithm debugging accuracy is improved.
In some embodiments, obtaining a calibration image file corresponding to the current shooting scene mode includes: acquiring an initial image shot in a current shooting scene; and replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain the calibration image file.
In some embodiments, optimizing a parameter profile of the image processing algorithm from the simulation image includes: and comparing the simulation image with a preset image, and optimizing a parameter configuration file of the image processing algorithm according to a comparison result.
In some embodiments, optimizing the parameter configuration file of the image processing algorithm according to the comparison result includes: if the simulation image has defects relative to the preset image, debugging the parameter configuration file of the image processing algorithm until the simulation image processed according to the debugged image processing algorithm has no defects relative to the preset image.
In some embodiments, the current shooting scene mode includes any one of a night scene mode, a portrait mode, a background blurring mode, and a wide-angle lens mode.
In order to achieve the above object, a second aspect of the present invention provides an ISP-based image processing apparatus, comprising: the determining module is used for determining the current shooting scene mode; the acquisition module is used for acquiring a calibration image file corresponding to the current shooting scene mode; the first processing module is used for processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image; and the second processing module is used for optimizing the parameter configuration file of the image processing algorithm according to the simulation image, and processing the calibration image file according to the optimized image processing algorithm to obtain a target image.
According to the ISP-based image processing device, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain the simulation image, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, the calibration image file is processed according to the optimized image processing algorithm to obtain the target image, therefore, the calibration image file is processed through the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is prestored, algorithm debugging barriers caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided through processing the prestored calibration image file, so that the algorithm debugging efficiency is improved, and meanwhile the algorithm debugging accuracy is improved.
In some embodiments, the acquiring module is specifically configured to: acquiring an initial image shot in a current shooting scene; and replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain the calibration image file.
In some embodiments, the second processing module is specifically configured to: and comparing the simulation image with a preset image, and optimizing a parameter configuration file of the image processing algorithm according to a comparison result.
In order to achieve the above object, an embodiment of a third aspect of the present invention provides a non-transitory computer-readable storage medium having stored thereon an ISP-based image processing program that, when executed by a processor, implements the ISP-based image processing method as described in the above embodiment.
According to the non-transitory computer readable storage medium, when the ISP-based image processing program stored on the non-transitory computer readable storage medium is executed by a processor, the calibration image file is processed through the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is pre-stored, the pre-stored calibration image file is processed without continuous shooting, the algorithm debugging barrier caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided, so that the algorithm debugging efficiency is improved, and the algorithm debugging accuracy is improved.
In order to achieve the above object, a fourth aspect of the present invention provides an image pickup apparatus including: the ISP-based image processing apparatus described in the above embodiment; alternatively, the image pickup apparatus includes: a processor, a memory, and an ISP-based image processing program stored on the memory and executable on the processor, which when executed by the processor implements the ISP-based image processing method as described in the above embodiments.
According to the image pickup apparatus provided by the embodiment of the invention, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module, a simulation image is obtained, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, and the calibration image file is processed according to the optimized image processing algorithm, so that the target image is obtained, the calibration image file is processed according to the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the pre-stored calibration image file is pre-stored, the algorithm debugging obstacle caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided without continuous shooting, so that the algorithm debugging efficiency is improved, and the algorithm debugging accuracy is improved.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the invention will become apparent and may be better understood from the following description of embodiments taken in conjunction with the accompanying drawings in which:
FIG. 1 is a flow chart of an ISP-based image processing method according to one embodiment of the invention;
FIG. 2 is a flowchart of an ISP-based image processing method in accordance with a specific embodiment of the present invention;
FIG. 3 is a block diagram of an ISP-based image processing apparatus according to one embodiment of the present invention;
fig. 4 is a block diagram of an image capturing apparatus according to one embodiment of the present invention.
Detailed Description
For a more complete understanding of the nature and the technical content of the embodiments of the present invention, reference should be made to the following detailed description of embodiments of the invention, taken in conjunction with the accompanying drawings, which are meant to be illustrative only and not limiting of the embodiments of the invention. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may still be practiced without these details. In other instances, well-known structures and devices may be shown simplified in order to simplify the drawing.
An ISP-based image processing method according to an embodiment of the present invention is described below with reference to fig. 1 and 2, and as shown in fig. 1, the ISP-based image processing method according to an embodiment of the present invention at least includes steps S1 to S4.
Step S1, determining a current shooting scene mode.
In an embodiment, the current shooting scene mode includes a night scene mode, a portrait beautifying mode, a background blurring mode, a wide-angle lens mode and the like, different shooting scene modes can be selected by a user according to different shooting requirements, and correspondingly, image processing algorithms corresponding to the different shooting scene modes are different, and processing modes of shooting images are also different. And by determining the current shooting scene mode, shooting of the image in the current shooting scene mode is facilitated, so that a corresponding image processing algorithm is called for processing the shot image, and finally, the image required by the user is output.
And S2, acquiring a calibration image file corresponding to the current shooting scene mode.
In an embodiment, the calibration image file is an image file stored in advance in a file system specified directory, multiple groups of offline image files are obtained by shooting an object for multiple times, and the offline image file with relatively good image quality is used as the calibration image file and stored in the file system specified directory of the image capturing device, such as a mobile phone, so as to facilitate subsequent calling and use.
It will be appreciated that the calibration image file includes a digital image buffer (buffer) and metadata, the digital image buffer referring to the raw digital image file acquired from the camera sensor, such as the raw image acquired by the image sensor. Metadata data refers to various attributes of an image at the time of photographing, such as attribute data of ISO (International Standards Organization, sensitivity), exposure time, white balance gain, and color correction matrix. The calibration image file corresponding to the current shooting scene mode is acquired, so that the calibration image file is convenient to replace an image file shot in real time for image processing, and because the calibration image file is pre-stored, the calibration image file is used without continuous shooting, debugging obstacles caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided, and therefore, the debugging efficiency is improved, and meanwhile, the debugging accuracy is improved. Under different shooting scene modes, the pre-stored calibration image files correspond to different images due to different image processing requirements.
And step S3, processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image.
In an embodiment, after a calibration image file of a current shooting scene mode is acquired, an image processing algorithm corresponding to the current shooting scene mode in the ISP module is called according to the current shooting scene mode, for example, if the current shooting scene mode is a night scene mode, then an image processing algorithm corresponding to a night mode is called, and for example, if the current shooting scene mode is a portrait beautifying mode, then an image processing algorithm corresponding to the portrait beautifying mode is called. And further, the calibration image file is processed based on the corresponding image processing algorithm fetched in the ISP module, so that the simulation image after the calibration image file stored in the file system in advance is processed can be obtained.
It can be understood that the image processing algorithm of different shooting scene modes is written into a specific node in the ISP module so as to process the calibration image file in different scene modes, thereby achieving different requirements on image processing in different scenes.
And S4, optimizing a parameter configuration file of the image processing algorithm according to the simulation image, and processing the calibration image file according to the optimized image processing algorithm to obtain the target image.
In an embodiment, the target image is an image of optimal quality in the current shooting scene mode or an image that can satisfy the user's needs. After the simulation image is obtained, whether the simulation image has defects is detected, if the simulation image has defects, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, for example, the parameter configuration file in the image processing algorithm is modified, after the modification is completed, the photographing process is triggered again, the calibration image file is simulated again, and the simulation image is output again until the target image is obtained.
It can be understood that the simulation images output under different parameter configuration files have the same uncontrollable factors except for the parameter configuration files, for example, the uncontrollable factors such as shooting angles and shaking conditions are the same, so that the target image with optimal quality can be obtained only by optimizing the parameter configuration files in the image processing algorithm.
According to the ISP-based image processing method, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain the simulation image, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, the calibration image file is processed according to the optimized image processing algorithm to obtain the target image, therefore, the calibration image file is processed through the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is prestored, algorithm debugging barriers caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided through processing the prestored calibration image file, so that algorithm debugging efficiency is improved, and meanwhile algorithm debugging accuracy is improved.
In some embodiments, obtaining a calibration image file corresponding to a current shooting scene mode includes: acquiring an initial image shot in a current shooting scene; and replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain a calibration image file.
In an embodiment, in the process of acquiring an initial image photographed in a current photographing scene, for example, when a photographing procedure is triggered, a preset digital image file is used to replace a digital image file corresponding to the initial image, and preset data information is used to replace data information corresponding to the initial image, so that when the photographing procedure is triggered, the obtained image file is a calibration image file. The initial image is replaced by the calibration image file of the current shooting scene mode, and when an image processing algorithm is used for image processing, continuous shooting is not needed, debugging obstacles caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided, so that the debugging efficiency is improved, and meanwhile, the debugging accuracy is improved.
In some embodiments, optimizing a parameter profile of an image processing algorithm from a simulated image includes: and comparing the simulation image with a preset image, and optimizing a parameter configuration file of an image processing algorithm according to a comparison result.
In an embodiment, the preset image may be understood as at least the image quality to be achieved, after the simulated image is obtained, each parameter of the image may be compared with the preset image, for example, the parameter configuration file of the image processing algorithm may be adjusted and optimized according to the comparison result, so as to debug and optimize the image processing algorithm, after the image processing algorithm is debugged and optimized, the calibration image is processed again according to the optimized image processing algorithm, and then the image processing algorithm is optimized according to the processing result, so that continuous adjustment of the image processing algorithm is realized.
In some embodiments, optimizing the parameter profile of the image processing algorithm based on the comparison results includes: if the simulated image has defects relative to the preset image, debugging the parameter configuration file of the image processing algorithm until the simulated image processed according to the debugged image processing algorithm has no defects relative to the preset image.
In an embodiment, if the simulated image has a defect compared with the preset image, for example, the definition of the simulated image is lower, at this time, debugging is performed on the parameter configuration file of the image processing algorithm, and processing is continued on the calibration image file after the debugging is completed, so as to obtain the simulated image, by continuously adjusting the configuration file parameters of the image processing algorithm, triggering the photographing procedure again after the parameter adjustment is completed, processing the calibration image file again until the simulated image in the current photographing scene has no defect relative to the preset image, if the definition is higher than or equal to the preset image, stopping debugging the parameter configuration file, and outputting the image corresponding at this time, namely the target image.
In other embodiments, when the calibration image file is processed, the calibration image file, the debugging algorithm configuration file, the shooting action and the simulation process can be integrated, so that one-key debugging is realized, and the debugging efficiency of the image processing algorithm is improved.
An ISP-based image processing method according to an embodiment of the present invention will be described with reference to fig. 2, and as shown in fig. 2, a flowchart of an ISP-based image processing method according to an embodiment of the present invention is shown.
Step S11, photographing in a night scene mode.
Step S12, an initial image photographed in the current photographing scene is acquired.
Step S13, replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain a calibration image file.
And S14, processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image.
And S15, comparing the simulation image with a preset image.
Step S16, judging whether the simulated image has defects relative to the preset image, if so, executing step S17; if not, go to step S18.
Step S17, debugging the parameter configuration file of the image processing algorithm.
Step S18, ends.
According to the ISP-based image processing method, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain the simulation image, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, the calibration image file is processed according to the optimized image processing algorithm to obtain the target image, therefore, the calibration image file is processed through the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is prestored, algorithm debugging barriers caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided through processing the prestored calibration image file, so that algorithm debugging efficiency is improved, and meanwhile algorithm debugging accuracy is improved.
An ISP-based image processing apparatus according to an embodiment of the present invention is described below.
As shown in fig. 3, an ISP-based image processing apparatus 2 according to an embodiment of the present invention includes: the device comprises a determining module 20, an acquiring module 21, a first processing module 22 and a second processing module 23, wherein the determining module 20 is used for determining the current shooting scene mode; the acquisition module 21 is used for acquiring a calibration image file corresponding to the current shooting scene mode; the first processing module 22 is configured to process the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module, so as to obtain a simulation image; the second processing module 23 is configured to optimize a parameter configuration file of the image processing algorithm according to the simulation image, and process the calibration image file according to the optimized image processing algorithm to obtain the target image.
According to the ISP-based image processing device 2 provided by the embodiment of the invention, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain the simulation image, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, and the calibration image file is processed according to the optimized image processing algorithm to obtain the target image, so that the calibration image file is processed by the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the calibration image file is pre-stored, the algorithm debugging obstruction caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided by processing the pre-stored calibration image file without continuous shooting, thereby improving the algorithm debugging efficiency and the algorithm debugging accuracy.
In some embodiments, the obtaining module 21 is specifically configured to: acquiring an initial image shot in a current shooting scene; and replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain a calibration image file.
In some embodiments, the second processing module 23 is specifically configured to: and comparing the simulation image with a preset image, and optimizing a parameter configuration file of an image processing algorithm according to a comparison result.
In some embodiments, the second processing module 23 is specifically configured to: when the simulated image has defects relative to the preset image, debugging the parameter configuration file of the image processing algorithm until the simulated image processed according to the debugged image processing algorithm has no defects relative to the preset image.
In order to achieve the above object, an embodiment of a third aspect of the present invention provides a non-transitory computer-readable storage medium having stored thereon an ISP-based image processing program that, when executed by a processor, implements the ISP-based image processing method as described in the above embodiment.
An image pickup apparatus according to an embodiment of the present invention is described below.
In a specific embodiment, the image capturing device is, for example, but not limited to, an electronic device such as a camera, a mobile phone, a tablet computer, a wearable device, etc. with a photographing function.
In some embodiments, an image capturing apparatus includes: the ISP-based image processing apparatus 2 of the above embodiment, that is, the electronic device may include: a determining module 20 for determining a current shooting scene mode; and an acquisition module 21 for acquiring a calibration image file corresponding to the current shooting scene mode; and a first processing module 22 for processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image; and a second processing module 23, configured to optimize the parameter configuration file of the image processing algorithm according to the simulation image, and process the calibration image file according to the optimized image processing algorithm to obtain a target image. Thus, in some embodiments, when the image capturing apparatus is performing image processing, its specific implementation is similar to that of the ISP-based image processing apparatus 2 described in any one of the above embodiments of the present invention, and reference may be made specifically to the foregoing description of the ISP-based image processing apparatus 2, which is omitted herein for redundancy reduction.
In other embodiments, as shown in FIG. 4, the image capture device includes at least one processor 1000, one processor 1000 being illustrated in FIG. 4; and a memory (memory) 2000, which may further include a communication interface (Communication Interface) 3000 and a bus 4000. The processor 1000, the memory 2000, and the communication interface 3000 may communicate with each other through the bus 4000. The communication interface 3000 may be used for information transfer. The processor 1000 may invoke logic instructions in the memory 2000 to perform the ISP-based image processing method of the above-described embodiment.
Further, the logic instructions in the memory 2000 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product.
The memory 2000 is a computer readable storage medium, and may be used to store a software program, a computer executable program, and program instructions/modules corresponding to the methods in the embodiments of the present invention. The processor 1000 performs functional applications and data processing by executing software programs, instructions and modules stored in the memory 2000, i.e., implements the ISP-based image processing method in the above-described method embodiment.
The memory 2000 may include a storage program area that may store an operating system, at least one application program required for functions, and a storage data area; the storage data area may store data created according to the use of the terminal device, etc. In addition, the memory 2000 may include a high-speed random access memory, and may also include a nonvolatile memory.
The technical solution of the embodiment of the present invention may be embodied in the form of a software product, where the software product is stored in a storage medium, and includes one or more instructions to cause a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method of the embodiment of the present invention. And the aforementioned storage medium may be a non-transitory storage medium including: a plurality of media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or a transitory storage medium.
It should be noted that, when the image capturing apparatus of the embodiment of the present invention performs photographing, its specific implementation manner is similar to that of the image processing method based on ISP of the embodiment of the present invention, and specific please refer to the description of the method section, so that redundancy is reduced and no further description is given here.
According to the image pickup apparatus provided by the embodiment of the invention, the calibration image file corresponding to the current shooting scene mode is obtained, the calibration image file is processed based on the image processing algorithm corresponding to the current shooting scene mode in the ISP module, a simulation image is obtained, the parameter configuration file of the image processing algorithm is optimized according to the simulation image, and the calibration image file is processed according to the optimized image processing algorithm, so that the target image is obtained, the calibration image file is processed according to the image processing algorithm, the image processing algorithm is debugged and optimized according to the processing result, and because the pre-stored calibration image file is pre-stored, the algorithm debugging obstacle caused by uncontrollable factors such as shooting environment and shooting angle change can be avoided without continuous shooting, so that the algorithm debugging efficiency is improved, and the algorithm debugging accuracy is improved.
When used in the present invention, although the terms "first," "second," etc. may be used in the present invention to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without changing the meaning of the description, so long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first element and the second element are both elements, but may not be the same element.
The terminology used in the present invention is used for the purpose of describing embodiments only and is not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a," "an," and "the" (the) are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this disclosure is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, when used in the present disclosure, the terms "comprises," "comprising," and/or variations thereof, mean that the recited features, integers, steps, operations, elements, and/or components are present, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The aspects, implementations, or features of the described embodiments can be used alone or in any combination. Aspects of the described embodiments may be implemented in software, hardware, or a combination of software and hardware. The described embodiments may also be embodied by a computer-readable medium having stored thereon computer-readable code comprising instructions executable by at least one computing device. The computer readable medium may be associated with any data storage device that can store data which can be thereafter read by a computer system. Computer readable media for example may include read-only memory, random-access memory, CD-ROM, HDD, DVD, magnetic tape, optical data storage devices, and the like. The computer readable medium can also be distributed over a network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The technical description above refers to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration implementations in accordance with the described embodiments. While these embodiments are described in sufficient detail to enable those skilled in the art to practice them, these embodiments are non-limiting; other embodiments may be used, and changes may be made without departing from the scope of the described embodiments. For example, the order of operations described in the flowcharts is non-limiting, and thus the order of two or more operations illustrated in the flowcharts and described in accordance with the flowcharts may be changed in accordance with several embodiments. As another example, in several embodiments, one or more operations illustrated in the flowcharts and described in accordance with the flowcharts are optional or may be deleted. In addition, certain steps or functions may be added to the disclosed embodiments or more than two of the step sequences may be substituted. All such variations are considered to be encompassed by the disclosed embodiments and the claims.
Additionally, terminology is used in the above technical description to provide a thorough understanding of the described embodiments. However, no overly detailed details are required to implement the described embodiments. Accordingly, the foregoing description of the embodiments has been presented for purposes of illustration and description. The embodiments presented in the foregoing description and examples disclosed in accordance with these embodiments are provided separately to add context and aid in the understanding of the described embodiments. The foregoing description is not intended to be exhaustive or to limit the described embodiments to the precise form of the invention. Several modifications, alternative adaptations and variations are possible in light of the above teachings. In some instances, well known process steps have not been described in detail in order to avoid unnecessarily obscuring the described embodiments.
Claims (6)
1. An ISP-based image processing method, comprising:
determining a current shooting scene mode;
acquiring a calibration image file corresponding to the current shooting scene mode, wherein acquiring the calibration image file corresponding to the current shooting scene mode comprises: acquiring an initial image shot in a current shooting scene; replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain the calibration image file;
processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image;
optimizing the parameter configuration file of the image processing algorithm according to the simulation image, processing the calibration image file according to the optimized image processing algorithm to obtain a target image, wherein,
optimizing a parameter configuration file of the image processing algorithm according to the simulation image, wherein the optimizing comprises the following steps:
and comparing the simulation image with a preset image, and optimizing a parameter configuration file of the image processing algorithm according to a comparison result, wherein the preset image is a high-image-quality image, and the high-image-quality image parameters comprise image definition.
2. The ISP-based image processing method of claim 1, wherein optimizing the parameter profile of the image processing algorithm based on the comparison result comprises:
if the simulation image has defects relative to the preset image, debugging the parameter configuration file of the image processing algorithm until the simulation image processed according to the debugged image processing algorithm has no defects relative to the preset image.
3. The ISP-based image processing method of claim 1, wherein the current shooting scene mode comprises any one of a night scene mode, a portrait beauty mode, a background blurring mode and a wide-angle lens mode.
4. An ISP-based image processing apparatus comprising:
the determining module is used for determining the current shooting scene mode;
the acquisition module is used for acquiring a calibration image file corresponding to the current shooting scene mode, wherein the acquisition module is specifically used for: acquiring an initial image shot in a current shooting scene; replacing the digital image file corresponding to the initial image with a preset digital image file, and replacing the data information corresponding to the initial image with preset data information to obtain the calibration image file;
the first processing module is used for processing the calibration image file based on an image processing algorithm corresponding to the current shooting scene mode in the ISP module to obtain a simulation image;
a second processing module, configured to optimize the parameter configuration file of the image processing algorithm according to the simulation image, process the calibration image file according to the optimized image processing algorithm to obtain a target image, where,
optimizing a parameter configuration file of the image processing algorithm according to the simulation image, wherein the optimizing comprises the following steps: and comparing the simulation image with a preset image, and optimizing a parameter configuration file of the image processing algorithm according to a comparison result, wherein the preset image is a high-image-quality image, and the high-image-quality image parameters comprise image definition.
5. A non-transitory computer-readable storage medium, wherein the computer-readable storage medium has stored thereon an ISP-based image processing program which, when executed by a processor, implements the ISP-based image processing method according to any one of claims 1 to 3.
6. An image pickup apparatus, characterized by comprising:
the ISP-based image processing apparatus of claim 4; or alternatively
A processor and a memory on which an ISP-based image processing program is stored which is executable on the processor, the ISP-based image processing program implementing the ISP-based image processing method according to any one of claims 1-3 when executed by the processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111221020.8A CN113992850B (en) | 2021-10-20 | 2021-10-20 | ISP-based image processing method and device, storage medium and image pickup apparatus |
| PCT/CN2021/140342 WO2023065523A1 (en) | 2021-10-20 | 2021-12-22 | Isp-based image processing method and apparatus, storage medium, and camera device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111221020.8A CN113992850B (en) | 2021-10-20 | 2021-10-20 | ISP-based image processing method and device, storage medium and image pickup apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113992850A CN113992850A (en) | 2022-01-28 |
| CN113992850B true CN113992850B (en) | 2023-06-20 |
Family
ID=79739616
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111221020.8A Active CN113992850B (en) | 2021-10-20 | 2021-10-20 | ISP-based image processing method and device, storage medium and image pickup apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113992850B (en) |
| WO (1) | WO2023065523A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115589539B (en) * | 2022-11-29 | 2023-05-09 | 荣耀终端有限公司 | Image adjustment method, device and storage medium |
| CN117038064B (en) * | 2023-10-07 | 2024-01-09 | 之江实验室 | Evaluation method, device, storage medium and equipment for auxiliary analysis algorithm |
| CN117135345B (en) * | 2023-10-19 | 2024-01-02 | 芯动微电子科技(武汉)有限公司 | Simulation verification method and device for image signal processing |
| CN117319789A (en) * | 2023-11-29 | 2023-12-29 | 荣耀终端有限公司 | Image simulation method, device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005033502A (en) * | 2003-07-14 | 2005-02-03 | Seiko Epson Corp | Image processor |
| CN108347558A (en) * | 2017-12-29 | 2018-07-31 | 维沃移动通信有限公司 | A kind of method, apparatus and mobile terminal of image optimization |
| CN110490960A (en) * | 2019-07-11 | 2019-11-22 | 阿里巴巴集团控股有限公司 | A kind of composograph generation method and device |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004070715A (en) * | 2002-08-07 | 2004-03-04 | Seiko Epson Corp | Image processor |
| CN105339840B (en) * | 2013-12-06 | 2019-06-14 | 华为终端有限公司 | The photographic method and bimirror head apparatus of bimirror head apparatus |
| CN105872350A (en) * | 2015-12-08 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Adjusting method and device for photographing parameter of camera |
| US20170163878A1 (en) * | 2015-12-08 | 2017-06-08 | Le Holdings Beijing Co Ltd | Method and electronic device for adjusting shooting parameters of camera |
| CN108243489B (en) * | 2018-01-17 | 2020-09-11 | 维沃移动通信有限公司 | Photographing control method and mobile terminal |
| CN109978757B (en) * | 2019-03-20 | 2023-08-22 | 维沃移动通信有限公司 | Image processing method and terminal equipment |
| CN112147967A (en) * | 2019-06-27 | 2020-12-29 | 北京新能源汽车股份有限公司 | Automatic generation method and device for scene test case of automobile controller |
| CN111127341A (en) * | 2019-12-05 | 2020-05-08 | Oppo广东移动通信有限公司 | Image processing method and apparatus, and storage medium |
| CN115835032A (en) * | 2021-02-26 | 2023-03-21 | 维沃移动通信有限公司 | Image processing method and device, electronic equipment and readable storage medium |
-
2021
- 2021-10-20 CN CN202111221020.8A patent/CN113992850B/en active Active
- 2021-12-22 WO PCT/CN2021/140342 patent/WO2023065523A1/en unknown
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005033502A (en) * | 2003-07-14 | 2005-02-03 | Seiko Epson Corp | Image processor |
| CN108347558A (en) * | 2017-12-29 | 2018-07-31 | 维沃移动通信有限公司 | A kind of method, apparatus and mobile terminal of image optimization |
| CN110490960A (en) * | 2019-07-11 | 2019-11-22 | 阿里巴巴集团控股有限公司 | A kind of composograph generation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023065523A1 (en) | 2023-04-27 |
| CN113992850A (en) | 2022-01-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113992850B (en) | ISP-based image processing method and device, storage medium and image pickup apparatus | |
| US11665427B2 (en) | Still image stabilization/optical image stabilization synchronization in multi-camera image capture | |
| CN111028189B (en) | Image processing method, device, storage medium and electronic equipment | |
| KR102293443B1 (en) | Image processing method and mobile terminal using dual camera | |
| US8861806B2 (en) | Real-time face tracking with reference images | |
| CN106060249B (en) | Photographing anti-shake method and mobile terminal | |
| US6967680B1 (en) | Method and apparatus for capturing images | |
| CN111028190A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| JP6308748B2 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
| CN109922275B (en) | Self-adaptive adjustment method and device of exposure parameters and shooting equipment | |
| JP6720881B2 (en) | Image processing apparatus and image processing method | |
| US20150195482A1 (en) | Method, system and smartphone that chooses optimal image to reduce shutter shake | |
| US8988545B2 (en) | Digital photographing apparatus and method of controlling the same | |
| CN110177212B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| JP2007324856A (en) | Imaging apparatus and imaging control method | |
| CN110365897B (en) | Image correction method and device, electronic equipment and computer readable storage medium | |
| CN110740266B (en) | Image frame selection method and device, storage medium and electronic equipment | |
| CN111405185A (en) | Zoom control method and device for camera, electronic equipment and storage medium | |
| KR20120071972A (en) | Digital image signal processing apparatus and method for controlling the same | |
| CN116308992A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| US10235742B2 (en) | Image processing apparatus, image capturing apparatus, image processing method, and non-transitory computer-readable storage medium for adjustment of intensity of edge signal | |
| US8629925B2 (en) | Image processing apparatus, image processing method, and computer program | |
| WO2016019786A1 (en) | Object motion trajectory photographing method and system, and computer storage medium | |
| CN112118394B (en) | Dim light video optimization method and device based on image fusion technology | |
| CN110072050B (en) | Self-adaptive adjustment method and device of exposure parameters and shooting equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |