WO2022004518A1 - Dispositif de traitement de signal vidéo, procédé de traitement de signal vidéo et dispositif de formation d'image - Google Patents

Dispositif de traitement de signal vidéo, procédé de traitement de signal vidéo et dispositif de formation d'image Download PDF

Info

Publication number
WO2022004518A1
WO2022004518A1 PCT/JP2021/023749 JP2021023749W WO2022004518A1 WO 2022004518 A1 WO2022004518 A1 WO 2022004518A1 JP 2021023749 W JP2021023749 W JP 2021023749W WO 2022004518 A1 WO2022004518 A1 WO 2022004518A1
Authority
WO
WIPO (PCT)
Prior art keywords
video signal
luminance
signal
signal processing
region
Prior art date
Application number
PCT/JP2021/023749
Other languages
English (en)
Japanese (ja)
Inventor
英樹 志村
浩二 神谷
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Priority to US17/928,454 priority Critical patent/US20230215131A1/en
Priority to JP2022533913A priority patent/JPWO2022004518A1/ja
Publication of WO2022004518A1 publication Critical patent/WO2022004518A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/66—Transforming electric information into light information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing

Definitions

  • the present technology relates to a video signal processing device for processing a video signal obtained by an image pickup device such as a video camera, a video signal processing method, and an image pickup device.
  • HDR High Dynamic Range
  • SDR Standard Dynamic Range
  • Known techniques for HDR and LDR video signal processing include a technique for simultaneously generating an HDR image and an LDR image (see Patent Document 1), a technique for converting an LDR image into an HDR image (see Patent Document 2), and the like.
  • LDR is synonymous with SDR.
  • an information signal of a high-frequency luminance change component for a high-luminance region is generated as a contrast enhancement signal from a video signal captured by a camera capable of imaging with HDR, and the above-mentioned image pickup is performed.
  • the SDR video signal in which the contrast in the high-luminance region is emphasized is produced. The technology to be obtained is disclosed.
  • Patent Document 3 is merely a method of adding the contrast-enhanced signal in the high-luminance region of the video signal to the luminance-suppressed video signal, the effect of improving the visibility in the low-luminance region cannot be expected.
  • An object of the present technology relates to a video signal processing device, a video signal processing method, and an image pickup device capable of generating a video signal having improved visibility in terms of both contrast and brightness.
  • the video signal processing device which is the first embodiment of the present technology, is A first video signal processing that generates a brightness-suppressed video signal of a second dynamic range narrower than the first dynamic range from a pixel signal obtained by an imaging unit capable of obtaining a pixel signal of the first dynamic range.
  • Department and A second video signal processing unit that generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal and a gain-up signal of the pixel signal in the luminance region from the pixel signal and adds them to the luminance suppressed video signal. Equipped with.
  • the first video signal processing unit may be configured to generate a luminance suppressed video signal from the pixel signal by knee processing.
  • the second video signal processing unit is configured to generate the gain-up signal by multiplying the pixel signal in the luminance region of the luminance-suppressed video signal by a gain determined according to the luminance value of the pixel signal. It's okay.
  • the first dynamic range is HDR.
  • the second dynamic range may be SDR.
  • the video signal processing device may further include a first output unit that outputs an output video signal generated by the second video signal processing unit.
  • the first output unit may be configured to output the output video signal to the viewfinder.
  • the second video signal processing unit further generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal from the pixel signal, and belongs to the higher luminance side than the luminance region of the luminance suppressed video signal. It may be configured so that it is possible to generate an information signal of the luminance change component of the region.
  • the second video signal processing unit uses the generated information signal of the luminance change component in the region belonging to the high-luminance side, the information signal of the luminance change component in the luminance region of the luminance suppression video signal, and the pixels of the luminance region. It may be configured to be added to the luminance suppressed video signal together with the gain-up signal of the signal.
  • the video signal processing device may further include a third video signal processing unit that generates a video signal having the first dynamic range from the pixel signal obtained by the imaging unit.
  • the video signal processing device may further include a second output unit that outputs a video signal having the first dynamic range.
  • the second video signal processing unit generates an information signal of a luminance change component in a region belonging to a luminance region higher than the luminance region of the luminance suppressed video signal from the pixel signal, and uses the video signal in the first dynamic range. It may be configured to further add.
  • the video signal processing method which is the second embodiment of the present technology, is A brightness-suppressed video signal having a second dynamic range narrower than that of the first dynamic range is generated from a pixel signal obtained by an imaging unit capable of obtaining a pixel signal having a first dynamic range. From the pixel signal, an information signal of a luminance change component in the luminance region of the luminance-suppressed video signal and a gain-up signal of the pixel signal in the luminance region are generated and added to the luminance-suppressed video signal.
  • An image pickup device which is a third embodiment of the present technology.
  • An image pickup unit capable of obtaining a pixel signal having a first dynamic range
  • a first video signal processing unit that generates a luminance-suppressed video signal having a second dynamic range narrower than the first dynamic range from the pixel signal obtained by the imaging unit.
  • a second video signal processing unit that generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal and a gain-up signal of the pixel signal in the luminance region from the pixel signal and adds them to the luminance suppressed video signal. Equipped with.
  • FIG. 1 is a block diagram showing a configuration of an imaging system according to a first embodiment of the present technology.
  • the image pickup system 1 includes an image pickup unit 10, a video signal processing device 20, a viewfinder 30, an operation input unit 40, and a control unit 50.
  • the image pickup unit 10 has an optical block 101 and an image pickup element unit 102.
  • the optical block 101 has a lens, a focus adjustment mechanism, a shutter mechanism, an aperture (iris) mechanism, and the like.
  • the optical block 101 forms an image of the reflected light from the subject on the image pickup surface of the image pickup element 102 of the image pickup element unit 102 by a lens.
  • the image sensor unit 102 includes an image sensor, an analog signal processing circuit, an A / D conversion circuit, and the like.
  • the image sensor is composed of a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Sensor) image sensor, and the like.
  • the image pickup unit 10 can obtain a pixel signal having a relatively wide first dynamic range, such as HDR (High Dynamic Range).
  • the video signal processing device 20 generates a video signal having a second dynamic range narrower than that of the first dynamic range, such as SDR, from the pixel signal of the first dynamic range obtained by the imaging unit 10.
  • the video signal processing device 20 includes a first video processing unit 210 and a second video processing unit 220.
  • the first video processing unit 210 includes a pre-processing unit 211, a gain adjusting unit 212, a matrix unit 213, a detail processing unit 214, a knee processing unit 215, and an SDR gamma processing unit 216.
  • the preprocessing unit 211 performs signal correction processing such as defect correction and lens aberration correction for the pixel signal obtained by the image pickup unit 10.
  • the gain adjusting unit 212 performs gain adjustment such as RGB gain adjustment for white balance adjustment.
  • the matrix unit 213 performs debayer processing, linear matrix processing, and the like on the pixel signal that has passed through the gain adjustment unit 212 to obtain color image data which is a first video signal having a first dynamic range.
  • the detail processing unit 214 processes the details of the color image data which is the first video signal.
  • the knee processing unit 215 performs knee processing of the color image data which is the first video signal to generate a luminance-suppressed video signal having a second dynamic range narrower than the first dynamic range.
  • the SDR gamma processing unit 216 performs gamma processing for display display on the color image data of the second dynamic range.
  • the second video processing unit 220 includes a dynamic contrast extraction unit 221, a source signal gain up processing unit 222, a first addition unit 223, and a second addition unit 224.
  • the dynamic contrast extraction unit 221 generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal as a contrast-enhanced signal.
  • the original signal gain-up processing unit 222 generates a signal obtained by multiplying the pixel signal in the luminance region of the luminance-suppressed video signal by a gain determined according to the luminance value as a gain-up signal.
  • the first addition unit 223 synthesizes the contrast emphasis signal and the gain up signal.
  • the second addition unit 224 synthesizes the contrast enhancement signal and the gain-up signal, which are the outputs of the first addition unit 223, with the luminance suppression video signal of the second dynamic range generated by the first image processing unit 210.
  • the output video signal is generated by adding the signal.
  • the formatter / output unit 227 converts the output video signal output from the second addition unit 224 into an SDR video transmission format and outputs it to, for example, a viewfinder 30.
  • the SDR video can be transmitted to an external video device such as a CCU (camera control unit) or an external display through a camera cable in addition to the viewfinder 30.
  • the operation input unit 40 receives inputs such as various operation commands and mode settings from the user, and is composed of, for example, a button, a switch, a dial, a touch panel sensor provided on the screen of the VF17, and the like.
  • the control unit 50 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. Programs and various parameters executed by the CPU are stored in the RAM or ROM.
  • the control unit 50 interprets the information of the user's operation input received by the operation input unit 40, and controls the image pickup system 1 according to the interpreted input information.
  • FIG. 2 is a diagram showing a comparison of HDR and SDR ranges. Assuming that the SDR range is 100%, the HDR range is, for example, 600% and 1200%. As shown in FIG. 3, there is a method of knee-correcting an HDR video signal based on a predetermined luminance value (knee correction point) as one of the methods of generating an SDR video signal from an HDR video signal. However, according to this method, "whitening" in which the contrast in the high-luminance region of the video signal obtained by knee correction is remarkably compressed and “whiteout" due to the limit occur.
  • the signal is high.
  • this method cannot be expected to have an effect of improving visibility in areas other than the high-luminance area. Therefore, a method of adding the contrast enhancement signal in the low luminance region to the luminance suppression video signal with respect to the knee correction point can be considered.
  • the amount of change in brightness in the low-luminance region is smaller than that in the high-luminance region, it is difficult to significantly improve the visibility of the dark image.
  • FIG. 4 is a diagram showing the luminance waveform of the original signal S0 in the low luminance region in the pixel signal (referred to as “original signal”) input to the dynamic contrast extraction unit 221 and the original signal gain up processing unit 222. ..
  • the vertical axis represents the luminance value (%) represented by the SDR range as 100%, and the horizontal axis represents time.
  • the luminance value of the original signal S0 changes in the range of about 0% to about 20%.
  • FIG. 5 shows a contrast emphasis signal S1 which is an information signal of a luminance change component generated by the dynamic contrast extraction unit 221 from the original signal S0 shown in FIG.
  • FIG. 6 is a diagram showing an output video signal S3 obtained by adding the contrast emphasis signal S1 and the gain up signal S2 of FIG. 5 to the original signal S0 of FIG.
  • the original signal gain-up processing unit 222 gains a signal obtained by multiplying the pixel signal by a gain determined according to the luminance value of the pixel signal so that the luminance value of the output video signal does not overtake. It was decided to generate it as an up signal.
  • the gain determined according to the luminance value of the pixel signal will be described.
  • FIG. 7 is a graph showing an example of the relationship between the luminance value of the original signal S0, the gain-up signal S2, and the gain magnification.
  • the gain-up signal S2 is obtained by multiplying the original signal S0 by 1, for example, the original signal in the luminance region of about 10-60%.
  • the gain-up signal S2 is obtained by multiplying the original signal S0 by 0-1 times.
  • the gain-up signal S2 in the luminance region of about 0% to 10% is used as the gain-up signal S2, and the original signal S0 in the luminance region of about 10-60%.
  • x may be the luminance (%) of the original signal, and the gain magnification may be obtained by subtracting 1/8 x from 1.
  • the gain-up signal S2 in the luminance region having a luminance of about 10-60% can be lowered on average, and the luminance value obtained by adding the gain-up signal S2 to the luminance value of the original signal S0. It is easy to manage overtaking avoidance.
  • FIG. 9 shows the high-luminance system 1 of the above-described embodiment, which generates an information signal of a high-luminance change component in a region belonging to the high-luminance side with respect to the knee correction point, for example, the highest luminance region, as a contrast-enhanced signal.
  • a dynamic contrast extraction unit 231 for a region is added.
  • the contrast-enhanced signal generated by the dynamic contrast extraction unit 231 for the high-luminance region is generated by the contrast-enhanced signal generated by the dynamic contrast extraction unit 221 for the low-luminance region and the original signal gain-up processing unit 222. It is further added by the third adder 225 to the signal obtained by adding the gain-up signal.
  • This addition signal is added to the luminance suppression video signal generated by the first video processing unit 210 by the second adder 224, and is output to the viewfinder 30 or the like as an SDR video signal through the formatter / output unit 227. ..
  • This configuration it is possible to improve the visibility of both the low-luminance side region and the high-luminance side region with respect to the knee correction point. For example, it is possible to improve the visibility of the image in the illuminated high-luminance area while focusing on the low-luminance area when shooting a dark area.
  • FIG. 10 shows an image pickup system 1 of the above embodiment to which a third image processing unit 240 that generates an HDR image signal from a pixel signal obtained by the image pickup apparatus is added.
  • the third video processing unit 240 has a matrix unit 241, a detail processing unit 242, a knee processing unit 243, an OETF unit 244, and a formatter / output unit 227.
  • the matrix unit 241 performs debayer processing, linear matrix processing, and the like on the pixel signal that has passed through the gain adjustment unit 212 to obtain color image data.
  • the detail processing unit 242 processes the details of the color image data.
  • the knee processing unit 243 performs knee processing of color image data.
  • the OETF unit 244 performs gradation compression on color image data by an OETF (Optical-Electro Transfer Function) for HDR, and performs gamma signal processing.
  • the formatter / output unit 245 converts the color image data that has passed through the OETF unit 244 into an HDR video transmission format.
  • the HDR video signal generated by the third video processing unit 240 is transmitted as a main line video to an external video device such as a CCU (camera control unit) or an external display through a camera cable.
  • the contrast-enhanced signal generated by the dynamic contrast extraction unit 231 for the high-luminance region is generated by the third image processing unit 240.
  • the HDR video signal may be added by the adder 225. As a result, an HDR video signal with enhanced contrast can be obtained.
  • the control unit 50 has a gain-up function, a contrast enhancement function in a low-luminance region, and a high-luminance by selecting a mode for the generation of the contrast enhancement signal and the gain-up signal. Controls the on / off of the contrast enhancement function of the area.
  • the viewfinder 30 displays a UI (User Interface) screen for the user setting. With respect to this UI, the user can input settings using, for example, the operation input unit 40. The setting input is received and held by the control unit 50.
  • UI User Interface
  • the modes include an overall contrast enhancement mode, a contrast enhancement mode in a high brightness region, a contrast enhancement mode other than a high brightness region, a contrast enhancement mode in a low brightness region, and a contrast enhancement mode in a high brightness region + a low brightness region. ..
  • FIG. 11 is a diagram showing a state of the video signal processing device 20 in the overall contrast enhancement mode.
  • the dynamic contrast extraction unit 221 in the low-luminance region is set by the control unit 50 to generate a contrast enhancement signal in the entire region on the low-luminance side with respect to the knee correction point.
  • the dynamic contrast extraction unit 231 in the high-luminance region is set by the control unit 50 so as to generate a contrast enhancement signal in the entire region on the high-luminance side with respect to the knee correction point.
  • the original signal gain up processing unit 222 is turned off.
  • the contrast-enhanced signal generated by the dynamic contrast extraction unit 221 in the low-luminance region is added to the video signal generated by the first image processing unit 210, and the contrast generated by the dynamic contrast extraction unit 231 in the high-luminance region.
  • the emphasis signal is added to the video signal generated by the third video processing unit 240.
  • the contrast enhancement mode in the high-luminance region is a mode in which the contrast component of the region belonging to the high-luminance side with respect to the knee correction point, for example, the highest luminance region, is added to the output video signal of the first image processing unit 210.
  • FIG. 12 is a diagram showing a state of the video signal processing device 20 in the contrast enhancement mode in the high luminance region.
  • the dynamic contrast extraction unit 231 in the high-luminance region is controlled by the control unit 50 so as to generate a contrast enhancement signal in an region belonging to the high-luminance side with respect to the knee correction point, for example, the highest-luminance region.
  • Both the dynamic contrast extraction unit 221 and the original signal gain-up processing unit 222 in the low-luminance region are turned off.
  • an HDR video signal to which the contrast enhancement signal in the highest luminance region is added can be obtained, it is possible to prevent overexposure from occurring when light or the like is strong, and the visibility in the high luminance region is improved. This makes it easier to focus on the high-brightness area.
  • the contrast enhancement mode other than the high-luminance region In the contrast enhancement mode other than the high-luminance region, the contrast component of the region other than the highest luminance region in the region on the high-luminance side with respect to the knee correction point and the region on the low-luminance side with respect to the knee correction point is added to the third.
  • This mode adds to the video signal generated by the video processing unit 240 and the luminance suppressed video signal output from the first video processing unit 210, and is particularly used when fog or the like is generated.
  • the brightness of the video signal tends to be high due to fog. Therefore, if the contrast of the fog area of the image is emphasized, the fog will be in focus. This mode is used to avoid such a situation.
  • FIG. 13 is a diagram showing a state of the video signal processing device 20 in the contrast enhancement mode other than the high luminance region.
  • the dynamic contrast extraction unit 221 in the low-luminance region is set by the control unit 50 to generate a contrast enhancement signal in the region on the low-luminance side with respect to the knee correction point.
  • the dynamic contrast extraction unit 231 in the high-luminance region is set by the control unit 50 so as to generate a contrast-enhanced signal in a region other than the highest luminance region in the region on the high-luminance side with respect to the knee correction point. ..
  • the original signal gain up processing unit 222 is turned off.
  • the contrast enhancement signal generated by the dynamic contrast extraction unit 221 in the low brightness region is added to the brightness suppression video signal output from the first image processing unit 210, and is generated by the dynamic contrast extraction unit 231 in the high brightness region.
  • the contrast-enhanced signal is added to the video signal generated by the third video processing unit 240.
  • the contrast enhancement mode in the low-luminance region is a mode in which the contrast component and the gain-up signal in the low-luminance region are added to the luminance suppression video signal output from the first video processing unit 210. Equivalent to.
  • the contrast enhancement mode of the high-luminance region + the low-luminance region corresponds to the one described in the first modification.
  • the dynamic contrast extraction unit 221 in the low-luminance region is set by the control unit 50 so as to generate a contrast enhancement signal in the region on the low-luminance side with respect to the knee correction point.
  • the dynamic contrast extraction unit 231 in the high-luminance region generates an information signal of the high-luminance change component in the region belonging to the high-luminance side with respect to the knee correction point, for example, the highest luminance region, as a contrast enhancement signal. It is set by the control unit 50.
  • the original signal gain up processing unit 222 is set to ON.
  • the region on the high-luminance side that generates the contrast-enhanced signal does not necessarily have to be the highest-luminance region.
  • it may be a region belonging to the high luminance side, such as a luminance region having an intermediate height in the region on the luminance side with respect to the knee correction point.
  • the present technology can have the following configurations.
  • a first which generates a brightness-suppressed video signal having a second dynamic range narrower than the first dynamic range from a pixel signal obtained by an imaging unit capable of obtaining a pixel signal having a first dynamic range.
  • Video signal processing unit and A second video signal processing unit that generates an information signal of a brightness change component in the luminance region of the luminance-suppressed video signal and a gain-up signal of the pixel signal in the luminance region from the pixel signal and adds the gain-up signal to the luminance-suppressed video signal.
  • a video signal processing device comprising.
  • the first video signal processing unit is a video signal processing device configured to generate a luminance suppressed video signal from the pixel signal by knee processing. (3) The video signal processing device according to (1) or (2) above.
  • the second video signal processing unit is configured to generate the gain-up signal by multiplying the pixel signal in the luminance region of the luminance-suppressed video signal by a gain determined according to the luminance value of the pixel signal.
  • Video signal processing device (4) The video signal processing device according to any one of (1) to (3) above.
  • a video signal processing device in which the first dynamic range is HDR and the second dynamic range is SDR.
  • a video signal processing device further comprising a first output unit that outputs an output video signal generated by the second video signal processing unit.
  • the first output unit is a video signal processing device configured to output the output video signal to a viewfinder.
  • the second video signal processing unit further generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal from the pixel signal, and belongs to the higher luminance side than the luminance region of the luminance suppressed video signal.
  • a video signal processing device configured to generate an information signal of a luminance change component in a region.
  • the second video signal processing unit uses the generated information signal of the luminance change component in the region belonging to the high brightness side, the information signal of the luminance change component in the luminance region of the luminance suppression video signal, and the pixels of the luminance region.
  • a video signal processing device configured to be added to the luminance suppressed video signal together with a signal gain-up signal.
  • a video signal processing device further comprising a third video signal processing unit that generates a video signal having the first dynamic range from the pixel signal obtained by the imaging unit.
  • a video signal processing device further comprising a second output unit that outputs a video signal having the first dynamic range.
  • the video signal processing device (11) The video signal processing device according to (9) above.
  • the second video signal processing unit generates an information signal of a luminance change component in a region belonging to a luminance region higher than the luminance region of the luminance suppressed video signal from the pixel signal, and obtains an information signal of the luminance change component in the first dynamic range video signal.
  • a video signal processing device configured to add more.
  • a brightness-suppressed video signal having a second dynamic range narrower than that of the first dynamic range is generated from a pixel signal obtained by an imaging unit capable of obtaining a pixel signal having a first dynamic range.
  • (13) The video signal processing method according to (12) above.
  • a video signal processing method for generating a gain-up signal by multiplying a pixel signal in a luminance region of the luminance-suppressed video signal by a gain determined according to the luminance value of the pixel signal (15) The video signal processing method according to any one of (12) to (14) above. A video signal processing method in which the first dynamic range is HDR and the second dynamic range is SDR. (16) The video signal processing method according to any one of (12) to (15) above. A video signal processing method for outputting an output video signal generated by the second video signal processing unit. (17) The video signal processing method according to (16) above. A video signal processing method for outputting the output video signal to a viewfinder. (18) The video signal processing method according to any one of (12) to (17) above.
  • the generated luminance-suppressed image includes the information signal of the luminance change component in the region belonging to the high-luminance side, the information signal of the luminance change component in the luminance region of the luminance-suppressed video signal, and the gain-up signal of the pixel signal in the luminance region.
  • An image pickup unit capable of obtaining a pixel signal having a first dynamic range
  • a first video signal processing unit that generates a luminance-suppressed video signal having a second dynamic range narrower than the first dynamic range from the pixel signal obtained by the imaging unit.
  • a second video signal processing unit that generates an information signal of a luminance change component in the luminance region of the luminance-suppressed video signal and a gain-up signal of the pixel signal in the luminance region from the pixel signal and adds the gain-up signal to the luminance-suppressed video signal.
  • An imaging device comprising.
  • the first video signal processing unit is an image pickup device configured to generate a luminance suppressed video signal from the pixel signal by knee processing.
  • the second video signal processing unit is configured to generate the gain-up signal by multiplying the pixel signal in the luminance region of the luminance-suppressed video signal by a gain determined according to the luminance value of the pixel signal.
  • Imaging device The image pickup apparatus according to any one of (23) to (25) above.
  • An image pickup apparatus further comprising a first output unit that outputs an output video signal generated by the second video signal processing unit.
  • the first output unit is an image pickup device configured to output the output video signal to a viewfinder.
  • the image pickup apparatus according to any one of (23) to (28) above.
  • the second video signal processing unit further generates an information signal of a luminance change component in the luminance region of the luminance suppressed video signal from the pixel signal, and belongs to the higher luminance side than the luminance region of the luminance suppressed video signal.
  • An image pickup device configured to generate an information signal of a luminance change component in a region.
  • the second video signal processing unit uses the generated information signal of the luminance change component in the region belonging to the high-luminance side, the information signal of the luminance change component in the luminance region of the luminance suppression video signal, and the pixels of the luminance region.
  • An image pickup device configured to be added to the luminance suppression video signal together with a signal gain-up signal.
  • An image pickup apparatus further comprising a third video signal processing unit that generates a video signal having the first dynamic range from the pixel signal obtained by the image pickup unit.
  • An image pickup apparatus further comprising a second output unit that outputs a video signal having the first dynamic range.
  • the second video signal processing unit generates an information signal of a luminance change component in a region belonging to a luminance region higher than the luminance region of the luminance suppressed video signal from the pixel signal, and uses the video signal in the first dynamic range.
  • An image pickup device configured to add more.
  • Imaging unit 20 Video signal processing method 30 ... Viewfinder 210 ... First video signal processing unit 220 . Second video signal processing unit 221 ... Dynamic contrast extraction unit 222 ... Original signal gain up processing unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Studio Devices (AREA)

Abstract

Ce dispositif de traitement de signal d'image est pourvu : d'une première unité de traitement de signal vidéo servant à générer, à partir d'un signal de pixels obtenu par une unité de formation d'image capable d'obtenir un signal de pixels ayant une première région dynamique, un signal vidéo à luminance inhibée ayant une seconde plage dynamique qui est plus étroite que la première plage dynamique ; et d'une seconde unité de traitement de signal vidéo servant à générer, à partir du signal de pixels, un signal d'informations concernant une composante de changement de luminance d'une région de luminance du signal vidéo à luminance inhibée et un signal d'augmentation de gain pour le signal de pixels de la région de luminance, et à ajouter ces signaux au signal vidéo à luminance inhibée.
PCT/JP2021/023749 2020-06-30 2021-06-23 Dispositif de traitement de signal vidéo, procédé de traitement de signal vidéo et dispositif de formation d'image WO2022004518A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/928,454 US20230215131A1 (en) 2020-06-30 2021-06-23 Video signal processing apparatus, video signal processing method, and imaging apparatus
JP2022533913A JPWO2022004518A1 (fr) 2020-06-30 2021-06-23

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-113488 2020-06-30
JP2020113488 2020-06-30

Publications (1)

Publication Number Publication Date
WO2022004518A1 true WO2022004518A1 (fr) 2022-01-06

Family

ID=79316194

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/023749 WO2022004518A1 (fr) 2020-06-30 2021-06-23 Dispositif de traitement de signal vidéo, procédé de traitement de signal vidéo et dispositif de formation d'image

Country Status (3)

Country Link
US (1) US20230215131A1 (fr)
JP (1) JPWO2022004518A1 (fr)
WO (1) WO2022004518A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014518024A (ja) * 2011-03-24 2014-07-24 コーニンクレッカ フィリップス エヌ ヴェ イメージ・グレーディングを分析するための装置及び方法
WO2018169003A1 (fr) * 2017-03-15 2018-09-20 ソニー株式会社 Dispositif d'imagerie, procédé de traitement de signaux vidéo, et programme de traitement de signaux vidéo
JP2020017079A (ja) * 2018-07-25 2020-01-30 株式会社朋栄 トーンマッピング処理及びトーンマッピングパラメータの自動調整更新によるｈｄｒ映像変換方法及びその装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014518024A (ja) * 2011-03-24 2014-07-24 コーニンクレッカ フィリップス エヌ ヴェ イメージ・グレーディングを分析するための装置及び方法
WO2018169003A1 (fr) * 2017-03-15 2018-09-20 ソニー株式会社 Dispositif d'imagerie, procédé de traitement de signaux vidéo, et programme de traitement de signaux vidéo
JP2020017079A (ja) * 2018-07-25 2020-01-30 株式会社朋栄 トーンマッピング処理及びトーンマッピングパラメータの自動調整更新によるｈｄｒ映像変換方法及びその装置

Also Published As

Publication number Publication date
US20230215131A1 (en) 2023-07-06
JPWO2022004518A1 (fr) 2022-01-06

Similar Documents

Publication Publication Date Title
JP6911202B2 (ja) 撮像制御方法および撮像装置
JP4293174B2 (ja) 撮像装置および画像処理装置
US10194091B2 (en) Image capturing apparatus, control method therefor, program, and recording medium
JP2007124604A (ja) 画像処理装置およびその処理方法
JP2009089357A (ja) 撮像装置、撮像方法、プログラム、および集積回路
JP2019071568A (ja) 画像処理装置及び画像処理方法、プログラム、記憶媒体
JP2010200177A (ja) 撮像装置及び画像処理プログラム
JP6873679B2 (ja) 撮像装置、撮像装置の制御方法及びプログラム
JP6108680B2 (ja) 撮像装置及びその制御方法、プログラム、並びに記憶媒体
JP2009200743A (ja) 画像処理装置および画像処理方法および画像処理プログラムおよび撮像装置
CN110278386B (zh) 图像处理方法、装置、存储介质及电子设备
KR20160030350A (ko) 화상 처리 장치 및 화상 처리 방법
WO2022004518A1 (fr) Dispositif de traitement de signal vidéo, procédé de traitement de signal vidéo et dispositif de formation d'image
JP4940661B2 (ja) 画像処理装置、画像処理方法および撮像装置
JP5744490B2 (ja) 画像処理方法、画像処理装置、記憶媒体及びプログラム
KR101750986B1 (ko) 영상 처리 장치, 방법, 및 컴퓨터 판독가능 저장매체
JP2021164112A (ja) 撮像装置、画像処理装置、および画像処理プログラム
JP2006094419A (ja) 画像信号処理装置及び画像信号処理方法
JP2011181019A (ja) 俯瞰画像生成装置
JP2016220031A (ja) 画像処理装置及び画像処理方法
JP2020053960A (ja) 撮像装置、該撮像装置の制御方法、及びプログラム
US11641525B2 (en) Image capturing apparatus capable of displaying live view image high in visibility, method of controlling image capturing apparatus, and storage medium
JP2008306326A (ja) 画像処理装置および画像処理方法
JP5307572B2 (ja) 撮像システム、映像信号処理プログラム、および撮像方法
JP2023162633A (ja) 撮像装置、及び撮像装置の制御方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21834373

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022533913

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21834373

Country of ref document: EP

Kind code of ref document: A1