WO2023279457A1 - 高动态范围图像合成方法、系统、图像处理设备和介质 - Google Patents
高动态范围图像合成方法、系统、图像处理设备和介质 Download PDFInfo
- Publication number
- WO2023279457A1 WO2023279457A1 PCT/CN2021/109194 CN2021109194W WO2023279457A1 WO 2023279457 A1 WO2023279457 A1 WO 2023279457A1 CN 2021109194 W CN2021109194 W CN 2021109194W WO 2023279457 A1 WO2023279457 A1 WO 2023279457A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image data
- frame
- frame image
- short
- long
- Prior art date
Links
- 238000001308 synthesis method Methods 0.000 title claims abstract description 26
- 230000000694 effects Effects 0.000 claims abstract description 38
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 12
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 12
- 238000000034 method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 14
- 239000002131 composite material Substances 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 230000009467 reduction Effects 0.000 claims description 3
- 238000001035 drying Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 8
- 230000001360 synchronised effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
Definitions
- the present application relates to the technical field of image processing, and in particular to a high dynamic range image synthesis method, system, image processing device and medium.
- High-Dynamic Range images (High-Dynamic Range, referred to as HDR), compared with ordinary images, can provide more dynamic range and image details, according to different exposure times of LDR (Low-Dynamic Range, low dynamic range images), And use the LDR image corresponding to the best detail at each exposure time to synthesize the final HDR image. It can better reflect the visual effect in the real environment.
- LDR Low-Dynamic Range, low dynamic range images
- Traditional HDR technology controls the exposure time of each frame of image to achieve the effect of alternating long and short exposure images, output bright and dark original image data, and then synthesize the bright and dark original image data into one frame. Because the traditional HDR technology combines two long and short frames into one, the finished video cannot reach the highest frame rate that the image acquisition device can support, which reduces the smoothness of the display.
- a high dynamic range image synthesis method comprising: collecting image data to be synthesized, the image data to be synthesized includes multi-frame image data, and the multi-frame image data includes a plurality of long-frame image data and short-frame image data arranged alternately ; Obtain the current frame image data in the image data to be synthesized, obtain the target frame image data of the previous frame of the current frame image data, and synthesize the current frame image data and the target frame image data into a synthetic frame Image data, generating target video data according to the synthesized frame image data.
- a high dynamic range image synthesis system comprising: an acquisition module, configured to acquire image data to be synthesized, the image data to be synthesized includes multi-frame image data, and the multi-frame image data includes a plurality of long-frame image data arranged alternately and short frame image data; synthesis module, used to obtain the current frame image data in the image data to be synthesized, obtain the target frame image data of the last frame of the current frame image data, and combine the current frame image data and The target frame image data is synthesized into synthesized frame image data, and target video data is generated according to the synthesized frame image data.
- An image processing device includes: a processor and a memory, the processor is coupled to the memory, a computer program is stored in the memory, and the processor executes the computer program to implement the above method.
- a storage medium stores a computer program, and the computer program can be executed by a processor to implement the above method.
- image data to be synthesized including a plurality of long frame image data and short frame image data arranged alternately, synthesize the current frame image data and the target frame image data of the previous frame of the current frame data into synthesized frame image data, and synthesize the frame image data according to the
- the target video data is generated from the data, and the long and short frames are synthesized for compensation, which can achieve an excellent high dynamic range image compensation effect.
- the current frame image data and the target frame image data of the previous frame of the current frame data are synthesized to increase the frame rate of the target video data.
- the playback smoothness will be greatly improved, the exposure time of long-frame image data is long, and the low-light source image effect of the target video data at night is excellent, thereby effectively improving the video quality of the target video data and improving the playback effect.
- FIG. 1 is a schematic flow chart of the first embodiment of the high dynamic range image synthesis method provided by the present invention
- Fig. 2 is a schematic diagram of the composition structure of the high dynamic range image synthesis method provided by the present invention.
- Fig. 3 is a schematic flow chart of the second embodiment of the high dynamic range image synthesis method provided by the present invention.
- Fig. 4 is a schematic flow chart of the third embodiment of the high dynamic range image synthesis method provided by the present invention.
- FIG. 5 is a schematic structural diagram of an embodiment of a high dynamic range image synthesis system provided by the present invention.
- FIG. 6 is a schematic structural diagram of an embodiment of an image processing device provided by the present invention.
- Fig. 7 is a schematic structural diagram of an embodiment of a storage medium provided by the present invention.
- FIG. 1 is a schematic flowchart of a first embodiment of a high dynamic range image synthesis method provided by the present invention.
- the high dynamic range image synthesis method provided by the present invention comprises the following steps:
- S101 Collect image data to be synthesized.
- the image data to be synthesized includes multiple frames of image data, and the multiple frames of image data include a plurality of long frame image data and short frame image data arranged alternately.
- HDR is used to collect image data to be synthesized to support 1080P Take a shooting device with P60 frames and 1080P P30 + long-short exposure HDR output as an example.
- the image sensor of the shooting device continuously outputs long-frame image data and short-frame image data with one long exposure time and one short exposure time every 1/30 second.
- FIG. 2 is a schematic diagram of a synthesis structure of the high dynamic range image synthesis method provided by the present invention.
- the multi-frame image data includes long frame 0 and short frame 0 , long frame 1 and short frame 1 , long frame 2 and short frame 2 , long frame 3 and short frame 3 .
- the shooting device can always be in the shooting state, the number of long-frame image data and short-frame image data is not limited, and can always be in an increasing state, and the long-frame image data and short-frame image data are output in pairs, and the two numbers are the same.
- S102 Obtain the current frame image data in the image data to be synthesized, obtain the target frame image data located in the previous frame of the current frame image data, synthesize the current frame image data and the target frame image data into synthesized frame image data, and The image data generates target video data.
- the image data of the current frame in the image data to be synthesized is obtained, the image data of the current frame is the image data corresponding to the latest received frame, and the image data of the previous frame of the latest received frame is obtained Target frame image data, since multi-frame image data includes multiple long frame image data and short frame image data arranged alternately, so one of the current frame image data and the target frame image data must be long frame image data and the other is short frame image data.
- the short frame 0 is the current frame image data
- the long frame 0 is the target frame image data
- the long frame 0 and short frame 0 are synthesized into a synthesized frame 1
- the long frame 1 is the current frame image data
- the short frame 0 is the target frame image data
- the short frame 0 and the long frame 1 are synthesized into a synthetic frame 1.
- the short frame 1 is the current frame image data
- the long frame 1 is the target frame image data
- the long frame 1 is synthesized Combined with short frame 1 to form synthetic frame 2
- the current frame image data of the latest captured frame is synthesized with the target frame image data of the previous frame to generate synthetic frame image data
- the generated synthetic frame image data Combine according to time sequence to generate target video data.
- the time of synthesizing the frame image data can be obtained according to the acquisition time of the long frame image data and the acquisition time of the short frame image data of the synthesized frame, for example, taking an average value, or the acquisition time of the long frame image data and the short frame image data The acquisition time is given different weights and then taken the average value and other methods.
- this step is not performed; if the current frame of image data corresponds to other than the first frame in the multi-frame image data For any frame, execute this step.
- image effect calculation processing is performed on the synthesized frame image data, and the image effect calculation processing includes screen brightness gain compensation, color GAMMA value correction, color temperature adjustment, color saturation adjustment, and noise reduction , de-drying, sharpness adjustment, smoothness adjustment, light-dark contrast adjustment, image cropping, and rotation.
- the image data to be synthesized including multiple long frame image data and short frame image data arranged alternately is obtained, and the current frame image data and the target frame located one frame above the current frame image data are combined
- the image data is synthesized into the synthesized frame image data, and the target video data is generated according to the synthesized frame image data, and the long and short frames are synthesized for compensation, which can achieve an excellent high dynamic range image compensation effect, so that the frame rate of the target video data is increased, and its playback smoothness will be improved.
- the exposure time of the long-frame image data is long, and the low-light source image effect of the target video data at night is excellent, thereby effectively improving the video quality of the target video data and improving the playback effect.
- FIG. 3 is a schematic flowchart of a second embodiment of the high dynamic range image synthesis method provided by the present invention.
- the high dynamic range image synthesis method provided by the present invention comprises the following steps:
- S301 Obtain image processing parameters of a target image processing device, and plan a dedicated space for long frames and a dedicated space for short frames according to the image processing parameters.
- the image processing parameters of the target image processing device are acquired, and the image processing parameters include image resolution Resolution (representing the size of a single frame data processing amount), frame rate Frame Rate (the amount of data processing amount per unit time) ), SDRAM (synchronous dynamic random-access memory, synchronous dynamic random access memory) (DDR (Double Data Rate, double rate synchronous dynamic random access memory)) memory space size, SDRAM (DDR) memory space access efficiency. Plan the dedicated space for long frames and the dedicated space for short frames according to the image processing parameters.
- the temporary storage space is planned in units of frames according to the resolution.
- the frame-dedicated space can store one frame of long-frame image data
- the short-frame dedicated space can store one frame of short-frame image data.
- the long frame dedicated space may store several frames of long frame image data
- the short frame dedicated space may store several frames of short frame image data.
- the size of the DDR memory space is not enough to support the storage of a single frame of image data.
- the planning of the temporary storage space is changed to the unit of behavior.
- One space can be planned as a dedicated space for long frames, and another space can be used as a dedicated space for short frames.
- 1080P image data 1080 rows, according to the size of SDRAM (DDR) memory space, determine the number of rows of long frame image data that can be stored at one time in the dedicated space for long frames, and determine the number of rows that can be stored at one time in the special space for short frames.
- the number of rows of frame image data Determine the number of rows that can be stored at one time while also considering SDRAM (DDR)
- the access efficiency of the memory space if the number of lines is too small, it may cause too many times of single frame image data processing to exceed the SDRAM storage speed limit.
- the image data to be synthesized includes multiple frames of image data, and the multiple frames of image data include a plurality of long frame image data and short frame image data arranged alternately.
- step S302 is basically the same as step S101 in the first embodiment of the high dynamic range image synthesis method provided by the present invention, and will not be repeated here.
- S303 Store the long-frame image data in the long-frame dedicated space, and store the short-frame image data in the short-frame dedicated space.
- the long-frame dedicated space can store one frame of long-frame image data
- the short-frame dedicated space can store one frame of short-frame image data, then store the currently acquired long-frame image data into the long-frame dedicated space Space, store the currently acquired short-frame image data into the short-frame dedicated space.
- the long-frame image data is stored in the long-frame dedicated space
- the short-frame image data is stored in the short-frame dedicated space.
- the frame image data is synthesized into short frame image data required for synthesizing frame image data
- short frame image data is synthesized into long frame image data required for synthesizing frames.
- data identifier 0 is added to long frame 0 and short frame 0 to indicate that long frame 0 and short frame 0 can be synthesized into frame 0
- data identifiers are added to long frame 1 and short frame 0 1, to indicate that long frame 1 and short frame 0 can be combined into frame 1, and so on.
- space identifiers are added to the dedicated space for long frames and the dedicated space for short frames.
- the identifier for the dedicated space for long frames is A
- the identifier for the dedicated space for short frames is B.
- A is supplemented with B
- the frame is synthesized 01 is programming instructions for B complementing A, etc., and merges the long frame image data and short frame image data in the long frame dedicated space and short frame dedicated space.
- store the long-frame image data in the long-frame dedicated space and before storing the short-frame image data in the short-frame dedicated space, determine whether the long-frame dedicated space and the short-frame dedicated space have stored long-frame image data and stored short frame image data. Since the long-frame dedicated space and short-frame dedicated space are fixed spaces once planned, when old data is stored and new data is received, the new data will overwrite the old data and be stored in process. Therefore, if it is determined that the long-frame dedicated space and the short-frame dedicated space have not yet stored stored long-frame image data and stored short-frame image data, the long-frame image data will be stored in the long-frame dedicated space as stored long-frame image data.
- the short frame image data is stored in the short frame dedicated space as the stored short frame image data, if the long frame dedicated space and the short frame dedicated space store the stored long frame image data and the stored short frame image data, then the Overwrite the stored long-frame image data with the long-frame image data and store it in the long-frame dedicated space as the new stored long-frame image data, and store the short-frame image data over the stored short-frame image data in the short-frame dedicated space as the new The stored short frame image data.
- S304 Obtain the current frame image data in the image data to be synthesized, obtain the target frame image data located in the previous frame of the current frame image data, synthesize the current frame image data and the target frame image data into synthesized frame image data, and The image data generates target video data.
- step S304 is basically the same as step S102 in the first embodiment of the high dynamic range image synthesis method provided by the present invention, and will not be repeated here.
- the received long frame 0 is stored in the long frame dedicated space
- the received short frame 0 is stored in the short frame dedicated space.
- Merge long frame 0 and short frame 0 into composite frame 0 then receive long frame 1, overwrite long frame 0 and store it in the space dedicated to long frame, merge long frame 1 and short frame 0 into composite frame 1, and then receive short frame 0
- short frame 1 is overwritten with short frame 0 and stored in the short frame dedicated space
- long frame 1 and short frame 1 are merged into composite frame 2, and so on.
- the image processing parameters of the target image processing device are obtained, and the long frame dedicated space and the short frame dedicated space are planned according to the image processing parameters, the long frame image data is stored in the long frame dedicated space, and the short frame is stored in the short frame dedicated space.
- Image data is stored in the special space for short frames, which can avoid storage pressure on SDRAM and effectively ensure the smooth generation of target video data.
- FIG. 4 is a schematic flowchart of a third embodiment of the high dynamic range image synthesis method provided by the present invention.
- the high dynamic range image synthesis method provided by the present invention comprises the following steps:
- S401 Obtain a sensing parameter and/or a preset image brightness parameter, and acquire a target exposure time according to the sensing parameter and/or the preset image brightness parameter.
- the target image processing device is provided with a sensor, and the acquired sensing parameters can be used to perceive the brightness of the current scene, and obtain an exposure time matching the brightness of the current scene.
- the preset picture brightness parameter input by the user may also be obtained, and the target exposure time may be obtained according to the brightness of the current scene and/or the brightness of the picture desired by the user.
- a parameter comparison table can be preset, and the parameter comparison table includes target exposure times corresponding to different screen brightnesses, and the target exposure time can be obtained by looking up the table.
- S402 Obtain preset image display effect parameters, obtain exposure time ratios corresponding to the long-frame image data and short-frame image data according to the preset image display effect parameters, and collect image data to be synthesized according to the target exposure time and exposure time ratio.
- the preset picture display effect parameters are obtained, such as the strength of the HDR setting effect, and the exposure time ratio corresponding to the long-frame image data and the short-frame image data is obtained according to the preset picture display effect parameters.
- the larger the exposure ratio the more obvious the effect of HDR, but the more serious side effects such as ghosting will be.
- the image data to be synthesized is collected according to the target exposure time and the exposure time ratio.
- S403 Perform preliminary image processing on the image data to be synthesized, so that the screen brightness of the image data to be synthesized meets user requirements.
- preliminary image processing is performed on the image data to be synthesized, that is, preliminary image processing is performed on the long-frame image data and the short-frame image data, so that the brightness of the long-frame image data and the short-frame image data conforms to the user’s
- the brightness of the synthesized frame image data can meet the user's demand, so that the target video data can meet the user's demand.
- the image data to be synthesized includes multiple frames of image data, and the multiple frames of image data include multiple long frame image data and short frame image data arranged alternately.
- S405 Obtain the current frame image data in the image data to be synthesized, acquire the target frame image data located in the previous frame of the current frame image data, synthesize the current frame image data and the target frame image data into synthesized frame image data, and The image data generates target video data.
- steps S404-S405 are basically the same as steps S101-S102 in the first embodiment of the high dynamic range image synthesis method provided by the present invention, and will not be repeated here.
- the sensing parameters and/or preset screen brightness parameters are obtained, and the target exposure time is obtained according to the sensing parameters and/or preset screen brightness parameters; the preset screen display effect parameters are obtained, according to Presetting the image display effect parameters to obtain the exposure time ratio corresponding to the long-frame image data and the short-frame image data, and collecting the image data to be synthesized according to the target exposure time and the exposure time ratio can effectively improve the display quality of the image data to be synthesized, so that The quality of the target video data is guaranteed.
- FIG. 5 is a schematic structural diagram of an embodiment of a high dynamic range image synthesis system provided by the present invention.
- the high dynamic range image synthesis system includes: an acquisition module 11 and a synthesis module 12 .
- the acquiring module 11 is used for acquiring image data to be synthesized.
- the image data to be synthesized includes multiple frames of image data, and the multiple frames of image data include a plurality of long frame image data and short frame image data arranged alternately.
- Synthesizing module 12 is used for obtaining the current frame image data in the image data to be synthesized, obtains the target frame image data positioned at the previous frame of the current frame image data, synthesizes the current frame image data and the target frame image data into synthetic frame image data, Target video data is generated from the synthesized frame image data.
- the acquiring module 11 is also used to acquire the image processing parameters of the target image processing device, plan the long-frame dedicated space and the short-frame dedicated space according to the image processing parameters, store the long-frame image data in the long-frame dedicated space, and store the short-frame image data in the Dedicated space for short frames.
- the acquisition module 11 is also used to add data identifiers to the long frame image data and short frame image data and/or add space identifiers to the long frame dedicated space and short frame dedicated space, the data identifier and/or space identifier are used to indicate that composite frames can be synthesized The long-frame image data and short-frame image data.
- Acquisition module 11 is also used for judging whether the long-frame dedicated space and the short-frame dedicated space have stored long-frame image data and stored short-frame image data; if not, the long-frame image data will be stored in the long-frame dedicated space, As stored long-frame image data, store short-frame image data into short-frame dedicated space as stored short-frame image data; if so, overwrite long-frame image data with stored long-frame image data and store in long-frame dedicated space , as the new stored long-frame image data, the short-frame image data is overwritten with the stored short-frame image data and stored in the short-frame dedicated space as the new stored short-frame image data.
- the obtaining module 11 is also used to obtain sensing parameters and/or preset screen brightness parameters, and obtain target exposure time according to the sensing parameters and/or preset screen brightness parameters; obtain preset screen display effect parameters, and obtain preset screen display effect parameters
- the parameter acquisition corresponds to the exposure time ratio of the long-frame image data and the short-frame image data, and the image data to be synthesized is collected according to the target exposure time and the exposure time ratio.
- the acquisition module 11 is also used for performing preliminary image processing on the image data to be synthesized, so that the screen brightness of the image data to be synthesized meets user requirements.
- the synthesis module 12 is also used to perform image effect calculation processing on the synthesized frame image data, obtain the processed frame data, and generate target video data according to the processed frame data;
- the image effect calculation process includes picture brightness gain compensation, color GAMMA value correction, color temperature adjustment, color At least one of saturation adjustment, noise reduction, dryness removal, sharpness adjustment, smoothness adjustment, light and dark contrast adjustment, image cropping, and rotation.
- the high dynamic range image synthesis system acquires image data to be synthesized including a plurality of long frame image data and short frame image data arranged alternately, and combines the current frame image data and the image data located in the current frame
- the target frame image data of the previous frame is synthesized into synthesized frame image data, and the target video data is generated according to the synthesized frame image data, and the long and short frames are synthesized for compensation, which can achieve excellent high dynamic range image compensation effect and increase the frame rate of the target video data , the playback smoothness will be greatly improved, the exposure time of the long-frame image data is long, and the low-light source image effect of the target video data at night is excellent, thereby effectively improving the video quality of the target video data and improving the playback effect.
- FIG. 6 is a schematic structural diagram of an embodiment of an image processing device provided by the present invention.
- the image processing device 20 includes a processor 21 and a memory 22 .
- the processor 21 is coupled to the memory 22 .
- a computer program is stored in the memory 22, and the processor 21 executes the computer program to realize the methods shown in Fig. 1 , Fig. 3-Fig. 4 when working.
- FIG. 6 For the detailed method, reference may be made to the above, which will not be repeated here.
- the image processing device acquires the image data to be synthesized including a plurality of long frame image data and short frame image data arranged alternately, and combines the current frame image data with the frame located above the current frame image data
- the target frame image data is synthesized into the synthesized frame image data, and the target video data is generated according to the synthesized frame image data, and the long and short frames are synthesized for compensation, which can achieve an excellent high dynamic range image compensation effect, so that the frame rate of the target video data is improved, and its playback
- the smoothness will be greatly improved, the exposure time of the long-frame image data is long, and the low-light source image effect of the target video data at night is excellent, thereby effectively improving the video quality of the target video data and improving the playback effect.
- FIG. 7 is a schematic structural diagram of an embodiment of a storage medium provided by the present invention.
- At least one computer program 31 is stored in the storage medium 30, and the computer program 31 is used to be executed by a processor to implement the methods shown in Fig. 1, Fig. 3-Fig.
- the computer-readable storage medium 30 may be a storage chip in the terminal, a hard disk, or a mobile hard disk, USB flash drive, optical disk, and other readable and writable storage tools, and may also be a server or the like.
- the computer program in the storage medium can be used to obtain the image data to be synthesized including a plurality of long frame image data and short frame image data arranged alternately, and combine the current frame image data and the current frame image data
- the target frame image data of the last frame of the image data is synthesized into the synthesized frame image data, and the target video data is generated according to the synthesized frame image data, and the long and short frames are synthesized for compensation, which can achieve excellent high dynamic range image compensation effect, making the frame of the target video data If the rate is increased, the smoothness of playback will be greatly improved.
- the exposure time of long-frame image data is long, and the low-light source image effect of the target video data at night is excellent, thereby effectively improving the video quality of the target video data and improving the playback effect.
- Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
- Volatile memory can include random access memory (RAM) or external cache memory.
- RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
- SRAM Static RAM
- DRAM Dynamic RAM
- SDRAM Synchronous DRAM
- DDRSDRAM Double Data Rate SDRAM
- ESDRAM Enhanced SDRAM
- SLDRAM Synchronous Chain Synchlink DRAM
- Rambus direct RAM
- DRAM direct memory bus dynamic RAM
- RDRAM memory bus dynamic RAM
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
本申请公开了一种高动态范围图像合成方法，包括：采集待合成图像数据，待合成图像数据包括多帧图像数据，多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据；获取待合成图像数据中的当前帧图像数据，获取位于当前帧图像数据的上一帧的目标帧图像数据，将当前帧图像数据和目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据。本申请还公开了高动态范围图像合成系统、图像处理设备和介质。本申请有效提升目标视频数据的视频质量，改善播放效果。
Description
本申请涉及图像处理技术领域，尤其涉及一种高动态范围图像合成方法、系统、图像处理设备和介质。
高动态范围图像（High-Dynamic Range，简称HDR），相比普通的图像，可以提供更多的动态范围和图像细节，根据不同的曝光时间的LDR（Low-Dynamic Range，低动态范围图像），并利用每个曝光时间相对应最佳细节的LDR图像来合成最终HDR图像。它能够更好地反映出真实环境中的视觉效果。
传统HDR技术是控制每一帧图像的曝光时间，达成长短曝光的交替图像效果，输出一亮一暗的原始影像资料，再将一亮一暗的原始影像资料，合成为1帧画面。因为传统HDR技术是两两长短帧画面二合一合成，所以成品视频达不到图像采集设备所能支持的最高帧率，降低了显示的流畅度。
基于此，有必要针对上述问题，提出了高动态范围图像合成方法、系统、图像处理设备和介质。
一种高动态范围图像合成方法，包括：采集待合成图像数据，所述待合成图像数据包括多帧图像数据，所述多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据；获取所述待合成图像数据中的当前帧图像数据，获取所述当前帧图像数据的上一帧的目标帧图像数据，将所述当前帧图像数据和所述目标帧图像数据合成为合成帧图像数据，根据所述合成帧图像数据生成目标视频数据。
一种高动态范围图像合成系统，包括：获取模块，用于采集待合成图像数据，所述待合成图像数据包括多帧图像数据，所述多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据；合成模块，用于获取所述待合成图像数据中的当前帧图像数据，获取所述当前帧图像数据的上一帧的目标帧图像数据，将所述当前帧图像数据和所述目标帧图像数据合成为合成帧图像数据，根据所述合成帧图像数据生成目标视频数据。
一种图像处理设备，包括：处理器、存储器，所述处理器耦接所述存储器，所述存储器中存储有计算机程序，所述处理器执行所述计算机程序以实现如上所述的方法。
一种存储介质，存储有计算机程序，所述计算机程序能够被处理器执行以实现如上所述的方法。
采用本发明实施例，具有如下有益效果：
获取包括多个相间排列的长帧图像数据和短帧图像数据的待合成图像数据，将当前帧图像数据和当前帧数据上一帧的目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据，长短帧合成进行补偿，可以实现优秀的高动态范围图像补偿效果，当前帧图像数据和当前帧数据上一帧的目标帧图像数据合成，使得目标视频数据的帧率提升，其播放平顺度会大幅提升，长帧图像数据的曝光时间长，目标视频数据的夜间低光源影像效果优秀，从而有效提升目标视频数据的视频质量，改善播放效果。
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
其中：
图1为本发明提供的高动态范围图像合成方法的第一实施例的流程示意图；
图2是本发明提供的高动态范围图像合成方法的合成结构示意图；
图3是本发明提供的高动态范围图像合成方法的第二实施例的流程示意图；
图4是本发明提供的高动态范围图像合成方法的第三实施例的流程示意图；
图5是本发明提供的高动态范围图像合成系统的一实施例的结构示意图；
图6是本发明提供的图像处理设备的一实施例的结构示意图；
图7是本发明提供的存储介质的一实施例的结构示意图。
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
请参阅图1，图1是本发明提供的高动态范围图像合成方法的第一实施例的流程示意图。本发明提供的高动态范围图像合成方法包括如下步骤：
S101：采集待合成图像数据，待合成图像数据包括多帧图像数据，多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据。
在一个具体的实施场景中，采用HDR的方式采集待合成图像数据，以支持1080P
P60帧和1080P P30 + 长短曝HDR输出的拍摄装置为例，拍摄装置的图像传感器每1/30秒接连输出曝光时间一长一短的长帧图像数据和短帧图像数据。具体的，请结合参阅图2，图2是本发明提供的高动态范围图像合成方法的合成结构示意图。如图2中所示的，多帧图像数据包括长帧0和短帧0、长帧1和短帧1、长帧2和短帧2、长帧3和短帧3。长帧0和短帧0的时长之和为1/30秒，且长帧0的时长大于1/60秒，而短帧0的时长小于1/60秒，长帧1和短帧1、长帧2和短帧2、长帧3和短帧3的时长关系与长帧0和短帧0相同，此处不再进行赘述。拍摄装置可以一直处于拍摄状态，长帧图像数据和短帧图像数据的数量不做限制，可以一直处于增加的状态，且长帧图像数据和短帧图像数据成对输出，两者数量相同。
S102：获取待合成图像数据中的当前帧图像数据，获取位于当前帧图像数据的上一帧的目标帧图像数据，将当前帧图像数据和目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据。
在一个具体的实施场景中，获取待合成图像数据中的当前帧图像数据，当前帧图像数据为目前最新接收到的一帧对应的图像数据，获取目前最新接收到的一帧的上一帧的目标帧图像数据，由于多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据，所以当前帧图像数据和目标帧图像数据中必然一者为长帧图像数据一者为短帧图像数据。
请继续参阅图2，例如，若短帧0为当前帧图像数据，则长帧0为目标帧图像数据，将长帧0和短帧0合成为合成帧0，若长帧1为当前帧图像数据，则短帧0为目标帧图像数据，将短帧0和长帧1合成为合成帧1，若短帧1为当前帧图像数据，则长帧1为目标帧图像数据，将长帧1和短帧1合成为合成帧2，以此类推，最新采集到的一帧的当前帧图像数据与其前一帧的目标帧图像数据进行合成，生成合成帧图像数据，将生成的合成帧图像数据依据时间顺序进行组合，生成目标视频数据。合成帧图像数据的时间可以是根据合成该合成帧的长帧图像数据的采集时间和短帧图像数据的采集时间获取，例如取平均值，或者为长帧图像数据的采集时间和短帧图像数据的采集时间赋予不同的权重后取平均值等方法。
在其他实施场景中，若当前帧图像数据对应的为多帧图像数据中的第一帧，则不执行该步骤，若当前帧图像数据对应为多帧图像数据中除了第一帧之外的其他任意一帧，则执行该步骤。
在其他实施场景中，在获取合成帧图像数据后，对合成帧图像数据进行图像效果运算处理，图像效果运算处理包括画面亮度增益补偿、色彩GAMMA值校正、色温调整、色彩饱和度调整、降噪、除燥、锐利度调整、平滑度调整、明暗对比度调整、图像裁切、旋转中的至少一种。获取处理帧数据，根据处理帧数据生成目标视频数据，可以进一步提升目标视频数的显示质量，改善用户体验。
将最新接收的一帧的当前帧图像数据和最新接收的一帧的上一帧的目标帧图像数据合成为合成帧图像数据，可以有效提升目标视频数据的帧率，在本实施场景中，支持1080P
P60帧和1080P P30帧 +
HDR输出的拍摄装置，其输出的目标视频数据的规格为1080P P60 + HDR。因为帧率倍增，其播放平顺度会大幅优于传统HDR技术的效果。HDR技术因为长帧图像数据的曝光时间超过1/60秒，因此输出的目标视频数据的夜间低光源影像效果会大幅优于单纯1080P
P60帧的视频数据。因为采用同样的图像处理机制（长短帧合成以进行补偿），因此在高动态范围图像补偿效果上，目标视频数据与1080P
P30帧 + HDR的视频数据一样表现优秀。
通过上述描述可知，在本实施场景中，获取包括多个相间排列的长帧图像数据和短帧图像数据的待合成图像数据，将当前帧图像数据和位于当前帧图像数据上一帧的目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据，长短帧合成进行补偿，可以实现优秀的高动态范围图像补偿效果，使得目标视频数据的帧率提升，其播放平顺度会大幅提升，长帧图像数据的曝光时间长，目标视频数据的夜间低光源影像效果优秀，从而有效提升目标视频数据的视频质量，改善播放效果。
请参阅图3，图3是本发明提供的高动态范围图像合成方法的第二实施例的流程示意图。本发明提供的高动态范围图像合成方法包括如下步骤：
S301：获取目标图像处理设备的图像处理参数，根据图像处理参数规划长帧专用空间和短帧专用空间。
在一个具体的实施场景中，获取目标图像处理设备的图像处理参数，图像处理参数包括图像分辨率 Resolution (表示单帧数据处理量的大小)、帧率 Frame Rate (单位时间内数据处理量的大小)、SDRAM（synchronous dynamic random-access memory，同步动态随机存取内存）(DDR（Double Data Rate，双倍速率同步动态随机存储器）) 内存空间的大小、SDRAM (DDR) 内存空间的存取效率。根据图像处理参数规划长帧专用空间和短帧专用空间。
若DDR内存空间大小足够支持单帧图像数据的存储，暂存空间依据分辨率的不同以帧为单位来进行规划，可以规划一个空间作为长帧专用空间，规划另一个空间短帧专用空间，长帧专用空间可以存储一帧长帧图像数据，短帧专用空间可以存储一帧短帧图像数据。在其他实施场景中，长帧专用空间可以存储若干帧长帧图像数据，短帧专用空间可以存储若干帧短帧图像数据。
若DDR内存空间大小，不足以支持单帧图像数据的存储。暂存空间的规划就改以行为单位，可以规划一个空间作为长帧专用空间，规划另一个空间短帧专用空间。例如1080P的图像数据= 1080行，根据SDRAM (DDR) 內存空間的大小，确定长帧专用空间一次性可以存储的长帧图像数据的行数，确定短帧专用暂存空一次性可以存储的短帧图像数据的行数。确定一次性可以存储的行数同时还要考虑SDRAM
(DDR) 内存空间的存取效率，若行数过小，可能会导致单帧图像数据需要处理的次数太多超过而SDRAM存储速度极限。
S302：采集待合成图像数据，待合成图像数据包括多帧图像数据，多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据。
在一个具体的实施场景中，步骤S302与本发明提供的高动态范围图像合成方法的第一实施例中的步骤S101基本一致，此处不再进行赘述。
S303：将长帧图像数据存入长帧专用空间，将短帧图像数据存入短帧专用空间。
在一个具体的实施场景中，长帧专用空间可以存储一帧长帧图像数据，短帧专用空间可以存储一帧短帧图像数据，则将当前获取的一帧长帧图像数据存入长帧专用空间，将当前获取的一帧短帧图像数据存入短帧专用空间。
在其他实施场景中，长帧图像数据存入长帧专用空间，将短帧图像数据存入短帧专用空间时，为长帧图像数据和短帧图像数据添加数据标识，数据标识用于指长帧图像数据合成合成帧图像数据所需的短帧图像数据和短帧图像数据合成合成帧所需的长帧图像数据。例如图2中所示的应用场景，在长帧0和短帧0上添加数据标识0，以指示长帧0和短帧0可以合成帧0，在长帧1和短帧0上添加数据标识1，以指示长帧1和短帧0可以合成帧1，以此类推。
在其他实施场景中，长帧专用空间和短帧专用空间添加空间标识，长帧专用空间的空间标识为A，短帧专用空间的空间标识为B，根据合成帧00为A补B，合成帧01为B补A等等编程指示，将长帧专用空间和短帧专用空间中的长帧图像数据和短帧图像数据合并。
在其他实施场景中，将长帧图像数据存入长帧专用空间，将短帧图像数据存入短帧专用空间之前，判断长帧专用空间和短帧专用空间是否存储有已存储长帧图像数据和已存储短帧图像数据。由于长帧专用空间和短帧专用空间一经规划即为固定空间，因此当存储有旧数据，又接收到新数据的情况下，会将新数据覆盖旧数据进程存储。因此，若判定长帧专用空间和短帧专用空间尚未存储有已存储长帧图像数据和已存储短帧图像数据，则将将长帧图像数据存入长帧专用空间，作为已存储长帧图像数据，将短帧图像数据存入短帧专用空间，作为已存储短帧图像数据，若长帧专用空间和短帧专用空间存储有已存储长帧图像数据和已存储短帧图像数据，则将将长帧图像数据覆盖已存储长帧图像数据存入长帧专用空间，作为新的已存储长帧图像数据，将短帧图像数据覆盖已存储短帧图像数据存入短帧专用空间，作为新的已存储短帧图像数据。
S304：获取待合成图像数据中的当前帧图像数据，获取位于当前帧图像数据的上一帧的目标帧图像数据，将当前帧图像数据和目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据。
在一个具体的实施场景中，步骤S304与本发明提供的高动态范围图像合成方法的第一实施例中的步骤S102基本一致，此处不再进行赘述。
在图2所示的应用场景中，假设长帧专用空间和短帧专用空间起初均为空，则接收到长帧0存入长帧专用空间，接收到短帧0存入短帧专用空间，将长帧0和短帧0合并为合成,0，再接收到长帧1，覆盖长帧0存入长帧专用空间，将长帧1和短帧0合并为合成帧1，再接收到短帧1，将短帧1覆盖短帧0存入短帧专用空间，将长帧1和短帧1合并为合成帧2，以此类推。
通过上述描述可知，在本实施例中获取目标图像处理设备的图像处理参数，根据图像处理参数规划长帧专用空间和短帧专用空间，将长帧图像数据存入长帧专用空间，将短帧图像数据存入短帧专用空间，可以避免对SDRAM造成存储压力，有效确保目标视频数据的顺利生成。
请参阅图4，图4是本发明提供的高动态范围图像合成方法的第三实施例的流程示意图。本发明提供的高动态范围图像合成方法包括如下步骤：
S401：获取传感参数和/或预设画面亮度参数，根据传感参数和/或预设画面亮度参数获取目标曝光时间。
在一个具体的实施场景中，目标图像处理设备设置有传感器，获取的传感参数可以用于感知当前场景的亮度，获取与当前场景的亮度匹配的曝光时间。还可以获取用户输入的预设画面亮度参数，根据当前场景的亮度和/或用户想要的画面亮度，可以获取目标曝光时间。进一步地，可以预设一参数对照表，该参数对照表包括不同的画面亮度对应的目标曝光时间，可以通过查表获取目标曝光时间。
S402：获取预设画面显示效果参数，根据预设画面显示效果参数获取对应于长帧图像数据和短帧图像数据的曝光时长比例，根据目标曝光时间和曝光时长比例采集待合成图像数据。
在一个具体的实施场景中，获取预设画面显示效果参数，例如HDR设定效果的强弱，根据预设画面显示效果参数获取对应于长帧图像数据和短帧图像数据的曝光时长比例，长短曝光的比值越大，HDR的效果越明显，但副作用如鬼影等也会越严重。根据目标曝光时间和曝光时长比例采集待合成图像数据。
S403：对待合成图像数据进行初步图像处理，以使得待合成图像数据的画面亮度符合用户需求。
在一个具体的实施场景中，对待合成图像数据进行初步图像处理，也就是说对长帧图像数据和短帧图像数据进行初步图像处理，以使得长帧图像数据和短帧图像数据的亮度符合用户需求，这样合成的合成帧图像数据的亮度才会符合用户需求，从而目标视频数据才会符合用户需求。
S404：采集待合成图像数据，待合成图像数据包括多帧图像数据，多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据。
S405：获取待合成图像数据中的当前帧图像数据，获取位于当前帧图像数据的上一帧的目标帧图像数据，将当前帧图像数据和目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据。
在一个具体的实施场景中，步骤S404-S405与本发明提供的高动态范围图像合成方法的第一实施例中的步骤S101-S102基本一致，此处不再进行赘述。
通过上述描述可知，在本实施例中，获取传感参数和/或预设画面亮度参数，根据传感参数和/或预设画面亮度参数获取目标曝光时间； 获取预设画面显示效果参数，根据预设画面显示效果参数获取对应于长帧图像数据和短帧图像数据的曝光时长比例，根据目标曝光时间和曝光时长比例采集待合成图像数据，能够有效提升待合成图像数据的显示质量，从而使得目标视频数据的质量得到保障。
请参阅图5，图5是本发明提供的高动态范围图像合成系统的一实施例的结构示意图。高动态范围图像合成系统包括：获取模块11和合成模块12。
获取模块11用于采集待合成图像数据，待合成图像数据包括多帧图像数据，多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据。合成模块12用于获取待合成图像数据中的当前帧图像数据，获取位于当前帧图像数据的上一帧的目标帧图像数据，将当前帧图像数据和目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据。
获取模块11还用于获取目标图像处理设备的图像处理参数，根据图像处理参数规划长帧专用空间和短帧专用空间，将长帧图像数据存入长帧专用空间，将短帧图像数据存入短帧专用空间。
获取模块11还用于为长帧图像数据和短帧图像数据添加数据标识和/或为长帧专用空间和短帧专用空间添加空间标识，数据标识和/或空间标识用于指示能够合成合成帧的长帧图像数据和短帧图像数据。
获取模块11还用于判断长帧专用空间和短帧专用空间是否存储有已存储长帧图像数据和已存储短帧图像数据；若否，则将将长帧图像数据存入长帧专用空间，作为已存储长帧图像数据，将短帧图像数据存入短帧专用空间，作为已存储短帧图像数据；若是，则将将长帧图像数据覆盖已存储长帧图像数据存入长帧专用空间，作为新的已存储长帧图像数据，将短帧图像数据覆盖已存储短帧图像数据存入短帧专用空间，作为新的已存储短帧图像数据。
获取模块11还用于获取传感参数和/或预设画面亮度参数，根据传感参数和/或预设画面亮度参数获取目标曝光时间； 获取预设画面显示效果参数，根据预设画面显示效果参数获取对应于长帧图像数据和短帧图像数据的曝光时长比例，根据目标曝光时间和曝光时长比例采集待合成图像数据。
获取模块11还用于对待合成图像数据进行初步图像处理，以使得待合成图像数据的画面亮度符合用户需求。
合成模块12还用于对合成帧图像数据进行图像效果运算处理，获取处理帧数据，根据处理帧数据生成目标视频数据；图像效果运算处理包括画面亮度增益补偿、色彩GAMMA值校正、色温调整、色彩饱和度调整、降噪、除燥、锐利度调整、平滑度调整、明暗对比度调整、图像裁切、旋转中的至少一种。
通过上述描述可知，在本实施场景中，高动态范围图像合成系统获取包括多个相间排列的长帧图像数据和短帧图像数据的待合成图像数据，将当前帧图像数据和位于当前帧图像数据上一帧的目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据，长短帧合成进行补偿，可以实现优秀的高动态范围图像补偿效果，使得目标视频数据的帧率提升，其播放平顺度会大幅提升，长帧图像数据的曝光时间长，目标视频数据的夜间低光源影像效果优秀，从而有效提升目标视频数据的视频质量，改善播放效果。
请参阅图6，图6是本发明提供的图像处理设备的一实施例的结构示意图。图像处理设备20包括处理器21、存储器22。处理器21耦接存储器22。存储器22中存储有计算机程序，处理器21在工作时执行该计算机程序以实现如图1、图3-图4所示的方法。详细的方法可参见上述，在此不再赘述。
通过上述描述可知，在本实施场景中，图像处理设备获取包括多个相间排列的长帧图像数据和短帧图像数据的待合成图像数据，将当前帧图像数据和位于当前帧图像数据上一帧的目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据，长短帧合成进行补偿，可以实现优秀的高动态范围图像补偿效果，使得目标视频数据的帧率提升，其播放平顺度会大幅提升，长帧图像数据的曝光时间长，目标视频数据的夜间低光源影像效果优秀，从而有效提升目标视频数据的视频质量，改善播放效果。
请参阅图7，图7是本发明提供的存储介质的一实施例的结构示意图。存储介质30中存储有至少一个计算机程序31，计算机程序31用于被处理器执行以实现如图1、图3-图4所示的方法，详细的方法可参见上述，在此不再赘述。在一个实施例中，计算机可读存储介质30可以是终端中的存储芯片、硬盘或者是移动硬盘或者优盘、光盘等其他可读写存储的工具，还可以是服务器等等。
通过上述描述可知，在本实施例中存储介质中的计算机程序可以用于获取包括多个相间排列的长帧图像数据和短帧图像数据的待合成图像数据，将当前帧图像数据和位于当前帧图像数据上一帧的目标帧图像数据合成为合成帧图像数据，根据合成帧图像数据生成目标视频数据，长短帧合成进行补偿，可以实现优秀的高动态范围图像补偿效果，使得目标视频数据的帧率提升，其播放平顺度会大幅提升，长帧图像数据的曝光时间长，目标视频数据的夜间低光源影像效果优秀，从而有效提升目标视频数据的视频质量，改善播放效果。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，的程序可存储于一非易失性计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限，RAM以多种形式可得，诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink) DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。
以上实施例仅表达了本申请的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对本申请专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。
Claims (10)
- 一种高动态范围图像合成方法，其特征在于，包括：采集待合成图像数据，所述待合成图像数据包括多帧图像数据，所述多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据；获取所述待合成图像数据中的当前帧图像数据，获取位于所述当前帧图像数据的上一帧的目标帧图像数据，将所述当前帧图像数据和所述目标帧图像数据合成为合成帧图像数据，根据所述合成帧图像数据生成目标视频数据。
- 根据权利要求1所述的高动态范围图像合成方法，其特征在于，所述采集待合成图像数据的步骤之前，包括：获取目标图像处理设备的图像处理参数，根据所述图像处理参数规划长帧专用空间和短帧专用空间；所述获取目标图像处理设备采集的待合成图像数据的步骤之后，包括：将所述长帧图像数据存入所述长帧专用空间，将所述短帧图像数据存入所述短帧专用空间。
- 根据权利要求2所述的高动态范围图像合成方法，其特征在于，所述将所述长帧图像数据存入所述长帧专用空间，将所述短帧图像数据存入所述短帧专用空间的步骤，包括：为所述长帧图像数据和所述短帧图像数据添加数据标识和/或为所述长帧专用空间和所述短帧专用空间添加空间标识，所述数据标识和/或所述空间标识用于指示能够合成所述合成帧的长帧图像数据和短帧图像数据。
- 根据权利要求2所述的高动态范围图像合成方法，其特征在于，所述将所述长帧图像数据存入所述长帧专用空间，将所述短帧图像数据存入所述短帧专用空间的步骤，包括：判断所述长帧专用空间和所述短帧专用空间是否存储有已存储长帧图像数据和已存储短帧图像数据；若否，则将所述长帧图像数据存入所述长帧专用空间，作为所述已存储长帧图像数据，将所述短帧图像数据存入所述短帧专用空间，作为所述已存储短帧图像数据；若是，则将所述长帧图像数据覆盖所述已存储长帧图像数据存入所述长帧专用空间，作为新的已存储长帧图像数据，将所述短帧图像数据覆盖所述已存储短帧图像数据存入所述短帧专用空间，作为新的已存储短帧图像数据。
- 根据权利要求1所述的高动态范围图像合成方法，其特征在于，所述采集待合成图像数据的步骤，包括：获取传感参数和/或预设画面亮度参数，根据所述传感参数和/或所述预设画面亮度参数获取目标曝光时间；获取预设画面显示效果参数，根据所述预设画面显示效果参数获取对应于所述长帧图像数据和所述短帧图像数据的曝光时长比例，根据所述目标曝光时间和所述曝光时长比例采集所述待合成图像数据。
- 根据权利要求1所述的高动态范围图像合成方法，其特征在于，所述采集待合成图像数据的步骤之后，包括：对所述待合成图像数据进行初步图像处理，以使得所述待合成图像数据的画面亮度符合用户需求。
- 根据权利要求1所述的高动态范围图像合成方法，其特征在于，所述根据所述合成帧图像数据生成目标视频数据的步骤，包括：对所述合成帧图像数据进行图像效果运算处理，获取处理帧数据，根据所述处理帧数据生成所述目标视频数据；所述图像效果运算处理包括画面亮度增益补偿、色彩GAMMA值校正、色温调整、色彩饱和度调整、降噪、除燥、锐利度调整、平滑度调整、明暗对比度调整、图像裁切、旋转中的至少一种。
- 一种高动态范围图像合成系统，其特征在于，包括：获取模块，用于采集待合成图像数据，所述待合成图像数据包括多帧图像数据，所述多帧图像数据包括多个相间排列的长帧图像数据和短帧图像数据；合成模块，用于获取所述待合成图像数据中的当前帧图像数据，获取所述当前帧图像数据的上一帧的目标帧图像数据，将所述当前帧图像数据和所述目标帧图像数据合成为合成帧图像数据，根据所述合成帧图像数据生成目标视频数据。
- 一种图像处理设备，其特征在于，包括：处理器、存储器，所述处理器耦接所述存储器，所述存储器中存储有计算机程序，所述处理器执行所述计算机程序以实现如权利要求1-7任一项所述的方法。
- 一种存储介质，其特征在于，存储有计算机程序，所述计算机程序能够被处理器执行以实现如权利要求1-7任一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110758985.4 | 2021-07-05 | ||
| CN202110758985.4A CN113572972B (zh) | 2021-07-05 | 2021-07-05 | 高动态范围图像合成方法、系统、图像处理设备和介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023279457A1 true WO2023279457A1 (zh) | 2023-01-12 |
Family
ID=78163721
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/109194 WO2023279457A1 (zh) | 2021-07-05 | 2021-07-29 | 高动态范围图像合成方法、系统、图像处理设备和介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113572972B (zh) |
| WO (1) | WO2023279457A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116033274B (zh) * | 2023-02-27 | 2023-06-09 | 江苏游隼微电子有限公司 | 一种兼容3d降噪的图像宽动态方法 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764959A (zh) * | 2008-12-25 | 2010-06-30 | 昆山锐芯微电子有限公司 | 图像拾取系统及图像处理方法 |
| JP2011211620A (ja) * | 2010-03-30 | 2011-10-20 | Olympus Imaging Corp | 撮像装置、撮像システム、撮像方法 |
| CN102420944A (zh) * | 2011-04-25 | 2012-04-18 | 展讯通信（上海）有限公司 | 一种高动态范围图像合成方法及装置 |
| CN106254782A (zh) * | 2016-09-28 | 2016-12-21 | 北京旷视科技有限公司 | 图像处理方法及装置和相机 |
| US20170193894A1 (en) * | 2015-12-31 | 2017-07-06 | Sipix Technology Inc. | Electronic paper display apparatus and driving method thereof |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6879731B2 (en) * | 2003-04-29 | 2005-04-12 | Microsoft Corporation | System and process for generating high dynamic range video |
| CN101867727B (zh) * | 2009-04-16 | 2011-12-07 | 华为技术有限公司 | 一种视频处理方法及装置 |
| JP5333522B2 (ja) * | 2011-06-06 | 2013-11-06 | カシオ計算機株式会社 | 動画生成装置、動画生成方法、および、プログラム |
| CN103873781B (zh) * | 2014-03-27 | 2017-03-29 | 成都动力视讯科技股份有限公司 | 一种宽动态摄像机实现方法及装置 |
| US9704269B2 (en) * | 2014-11-21 | 2017-07-11 | Texas Instruments Incorporated | Efficient methodology to process wide dynamic range images |
| KR102273656B1 (ko) * | 2014-11-24 | 2021-07-05 | 삼성전자주식회사 | 광역 역광 보정 영상의 노이즈 레벨 제어 장치, 및 이를 포함하는 영상 처리 시스템 |
| CN107197167B (zh) * | 2016-03-14 | 2019-12-20 | 杭州海康威视数字技术股份有限公司 | 一种获得图像的方法及装置 |
| CN109218613B (zh) * | 2018-09-18 | 2020-08-14 | Oppo广东移动通信有限公司 | 高动态范围图像合成方法、装置、终端设备和存储介质 |
| CN110572585B (zh) * | 2019-08-26 | 2021-03-23 | Oppo广东移动通信有限公司 | 图像处理方法、装置、存储介质及电子设备 |
-
2021
- 2021-07-05 CN CN202110758985.4A patent/CN113572972B/zh active Active
- 2021-07-29 WO PCT/CN2021/109194 patent/WO2023279457A1/zh unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764959A (zh) * | 2008-12-25 | 2010-06-30 | 昆山锐芯微电子有限公司 | 图像拾取系统及图像处理方法 |
| JP2011211620A (ja) * | 2010-03-30 | 2011-10-20 | Olympus Imaging Corp | 撮像装置、撮像システム、撮像方法 |
| CN102420944A (zh) * | 2011-04-25 | 2012-04-18 | 展讯通信（上海）有限公司 | 一种高动态范围图像合成方法及装置 |
| US20170193894A1 (en) * | 2015-12-31 | 2017-07-06 | Sipix Technology Inc. | Electronic paper display apparatus and driving method thereof |
| CN106254782A (zh) * | 2016-09-28 | 2016-12-21 | 北京旷视科技有限公司 | 图像处理方法及装置和相机 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113572972A (zh) | 2021-10-29 |
| CN113572972B (zh) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8977073B2 (en) | Apparatus and method for blending multiple images | |
| US8723978B2 (en) | Image fusion apparatus and method | |
| US11431915B2 (en) | Image acquisition method, electronic device, and non-transitory computer readable storage medium | |
| US20060232679A1 (en) | Multicamera system, image pickup apparatus, controller, image pickup control method, image pickup apparatus control method, and image pickup method | |
| US9307162B2 (en) | Local enhancement apparatus and method to generate high dynamic range images by blending brightness-preserved and brightness-adjusted blocks | |
| JP5696783B2 (ja) | 画像処理装置 | |
| US20120169900A1 (en) | Image processing device and image processing method | |
| KR101915036B1 (ko) | 실시간 비디오 스티칭 방법, 시스템 및 컴퓨터 판독 가능 기록매체 | |
| CN105657243A (zh) | 防抖动的延时摄影方法和装置 | |
| JP2017011327A (ja) | 画像処理装置、画像処理方法及びプログラム | |
| WO2023279457A1 (zh) | 高动态范围图像合成方法、系统、图像处理设备和介质 | |
| US9591170B2 (en) | Image processing apparatus, and control method and program of image processing apparatus | |
| KR20180106549A (ko) | 360도 파노라마 영상 콘텐츠 처리 장치 및 그 제어방법 | |
| CN112991163B (zh) | 一种全景图像的获取方法、装置及设备 | |
| JP2007267379A (ja) | 画像の歪曲補正を行う画像処理装置、撮像装置及び画像の歪曲補正方法 | |
| CN111462021A (zh) | 图像处理方法、装置、电子设备和计算机可读存储介质 | |
| TW201801515A (zh) | 影像產生方法及影像拍攝裝置 | |
| JPH10285488A (ja) | 映像信号処理回路 | |
| CN113225494B (zh) | 逐行曝光的图像生成方法、系统、图像处理设备和介质 | |
| KR20150019192A (ko) | Avm 시스템을 위한 영상 합성 장치 및 그 방법 | |
| JP2008079248A (ja) | 合成映像表示装置 | |
| US7760938B1 (en) | Algorithm to enhance the contrast of a monochrome image | |
| JP2013162247A (ja) | 画像処理装置およびその制御方法 | |
| JP2013162247A5 (zh) | ||
| JP5820213B2 (ja) | 画像処理装置及びその方法、撮像装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| NENP | Non-entry into the national phase |
Ref country code: DE |