WO2015107880A1 - Dispositif de traitement d'image, procédé de traitement d'image et programme comprenant un support d'enregistrement - Google Patents

Dispositif de traitement d'image, procédé de traitement d'image et programme comprenant un support d'enregistrement Download PDF

Info

Publication number
WO2015107880A1
WO2015107880A1 PCT/JP2015/000087 JP2015000087W WO2015107880A1 WO 2015107880 A1 WO2015107880 A1 WO 2015107880A1 JP 2015000087 W JP2015000087 W JP 2015000087W WO 2015107880 A1 WO2015107880 A1 WO 2015107880A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame image
image
frame
luminance
interest
Prior art date
Application number
PCT/JP2015/000087
Other languages
English (en)
Japanese (ja)
Inventor
真人 戸田
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2015557764A priority Critical patent/JP6582994B2/ja
Publication of WO2015107880A1 publication Critical patent/WO2015107880A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57—Control of contrast or brightness

Definitions

  • the present invention relates to an image processing apparatus, an image processing method, and a recording medium on which a program is recorded.
  • Photosensitivity seizures are abnormal responses to light stimuli that jump into the eye, with symptoms resembling epilepsy such as convulsions and impaired consciousness.
  • Non- Patent Document 1 In order to prevent such influence from affecting viewers, attempts have been made to suppress the distribution of video content that affects the human body.
  • ITU International Telecommunications Union
  • Non-Patent Document 2 In Japan, the Japan Broadcasting Corporation and the Japan Broadcasting Corporation have established guidelines for the production of animations in particular, and are demanding compliance with those involved in broadcasting (Non-Patent Document 2).
  • the current shooting environment includes many flickers (for example, general flashes with large brightness changes) and large changes in saturation (for example, red flashes) that can trigger photosensitivity attacks.
  • flickers for example, general flashes with large brightness changes
  • saturation for example, red flashes
  • means for alerting the viewer with a telop or the like is taken.
  • One of the shooting environments, including many flickers that can trigger photosensitivity attacks in news footage is a press conference. In a press conference, a short-time bright area is repeatedly generated by a flash emitted from a news photographer at the time of shooting, and many blinks are repeated in the video content.
  • a liquid crystal display detects a scene (image) that induces a photosensitivity seizure, and reduces the luminance of the backlight unit with respect to the scene (image) that induces the photosensitivity seizure, thereby allowing viewing and listening. Prevent the effects of photosensitivity attacks on the elderly.
  • ⁇ Flickering large brightness change
  • large change in saturation that can induce photosensitivity seizures may occur not only in the entire image but also in some areas of the video. Since the related method corrects the entire image uniformly without making these determinations, a decrease in contrast or brightness occurs in an area that does not need to be corrected originally and the luminance or saturation does not change significantly. The image quality may deteriorate.
  • an object of the present invention is to provide an image processing apparatus, an image processing method, and a program capable of generating a video in which fluctuations in luminance or saturation are suppressed with respect to a video that may induce a photosensitivity seizure. Is to provide.
  • the present invention compares a frame image of interest and a frame image before and after the image in which the luminance or saturation changes in a contradictory manner, and the variation rate of the luminance or saturation of the frame of interest exceeds a predetermined threshold. It has a determination part which determines whether it is a frame image containing a change area.
  • a frame generation unit that generates an interpolated frame image that is an attention frame image without the fluctuation region based on a frame image other than the attention frame image.
  • the image processing apparatus includes a frame image synthesis unit that generates an output frame image obtained by synthesizing the frame image of interest and the interpolation frame image based on a determination result of the determination unit.
  • the present invention compares a frame image of interest and a frame image before and after the image in which the luminance or saturation changes in a contradictory manner, and the variation rate of the luminance or saturation of the frame of interest exceeds a predetermined threshold. It is determined whether the frame image includes a fluctuation region. Furthermore, an interpolated frame image that is an attention frame image without the fluctuation region is generated based on a frame image other than the attention frame image. Further, the image processing method generates an output frame image obtained by combining the frame image of interest and the interpolated frame image based on a determination result of the determination unit.
  • the present invention compares a frame image of interest and a frame image before and after the image in which the luminance or saturation changes in a contradictory manner, and the variation rate of the luminance or saturation of the frame of interest exceeds a predetermined threshold. It is determined whether the frame image includes a fluctuation region. Furthermore, an interpolated frame image that is an attention frame image without the fluctuation region is generated based on a frame image other than the attention frame image. The program further causes the computer to generate an output frame image obtained by combining the frame image of interest and the interpolated frame image based on the determination result of the determination unit.
  • the present invention it is possible to generate an image in which variation in luminance or saturation is suppressed with respect to an image that may induce a photosensitivity seizure.
  • FIG. 1 is a block diagram of an image processing apparatus according to the first embodiment.
  • FIG. 2 is a schematic diagram showing a rectangular area luminance calculation method.
  • FIG. 3 is a schematic diagram illustrating a method of selecting a frame image that does not include a fluctuation region.
  • FIG. 4 is a schematic diagram for explaining a case where the correction becomes unstable.
  • FIG. 5 is a graph showing an example of a method for setting the value of the rate of change in local area luminance in the output frame image.
  • FIG. 6 is a flowchart showing the operation of the image processing apparatus according to the first embodiment.
  • FIG. 7 is a block diagram of an image processing apparatus according to the second embodiment.
  • FIG. 8 is a flowchart showing the operation of the image processing apparatus according to the second embodiment.
  • FIG. 9 is a block diagram of an image processing apparatus according to the third embodiment of the present invention.
  • FIG. 10 is a diagram showing a hardware configuration in which the image processing apparatus according to the first to third embodiments is realized by
  • FIG. 1 is a block diagram of an image processing apparatus according to the first embodiment of the present invention.
  • the image processing apparatus includes a flash frame determination unit 11, a frame interpolation unit 12, and a frame image synthesis unit 13. Then, the image processing apparatus according to the first embodiment inputs a group of frame images from time (t ⁇ m) to time (t + m) configured by a preset number of frames 2m + 1. Further, the image processing apparatus is a frame image including a variation region caused by blinking (a large variation in luminance) due to flashing or the like, in which the attention frame image that is the input frame image at time t may induce a photosensitivity seizure. Determine if there is.
  • the image processing apparatus When the variation area is included, the image processing apparatus generates an output frame image in which the influence of blinking is reduced (luminance variation is suppressed) by appropriately suppressing the variation area by the correction process.
  • the fluctuation region means a bright region that is brighter (brightness increases) in the frame image of interest than in other frame images.
  • the flash frame determination unit 11 receives an input frame image group as an input, and whether the frame image of interest (the input frame image at time t) is a frame image including a variation area due to blinking (a large variation in luminance) that affects the viewer. Determine.
  • One method for determining whether a target frame image is a frame including a variable region is a method of using the rate of change in local region luminance between the target frame image and another input frame image.
  • Local area luminance represents the luminance value of the pixel peripheral area in each pixel of the input frame image group.
  • a method of calculating the local area luminance first, for each pixel of the input frame image group, color information expressed in RGB (Red-Green-Blue) or the like is converted into luminance information representing brightness, and then converted. There is a method of calculating the luminance value of the pixel peripheral region by performing smoothing processing on the periphery of the target pixel with respect to the luminance information.
  • YUV luminance component (Y) and color difference components (U and V)
  • YCbCr or YPbPr luminance which is a color system used for broadcasting
  • YCbCr or YPbPr luminance which is a color system used for broadcasting
  • YPbPr luminance which is a color system used for broadcasting
  • YCbCr or YPbPr luminance which is a color system used for broadcasting
  • an average value is obtained around the pixel of interest (x + i, y + j), the pixel region (2p + 1) * (2q + 1) represented by q pixels above and below, and p pixels left and right respectively.
  • the local region luminance l t (x, y) at the pixel position (x, y) of the target frame image (input frame image at time t) is the luminance information Y of the target frame image (input frame image at time t).
  • t it can be expressed as in equation (1).
  • Expression (2) a weighted average using a preset weight w may be used.
  • the change rate of the local area luminance represents a fluctuation ratio of the local area luminance between the pixel of the target frame image and the pixel of another input frame image at the same position.
  • the local region luminance fluctuation ratio r t ⁇ t + k (x, y) between the frame of interest that is the input frame at the time t at the pixel position (x, y) and the frame at the time (t + k) in the input frame group is expressed by Equation (4). It is calculated as follows.
  • the flash frame determination unit 11 determines, based on the local region luminance fluctuation ratio, whether the region of interest includes an area that is brighter than other frame images. As a result, when the frame image of interest includes a region that is significantly brighter (brightness is increased) compared to other frame images that are temporally before and after, the frame of interest image blinks (has a higher luminance). It is determined that the frame image includes a variation region due to (change).
  • the area ratio ⁇ (the ratio of the area where light blinks in the display area) is used. This is a method of determining whether or not the local area luminance fluctuation ratio r t ⁇ t + k exceeding the threshold value ⁇ exceeds the area ratio ⁇ .
  • the flash frame determination unit 11 determines the flag flag t ⁇ t + k. Is 1. Otherwise, the flash frame determination unit 11 sets the determination flag flag t ⁇ t + k to 0. A determination flag is calculated for the combination of the target frame image and another predetermined input frame image. If there are frame images with the determination flag set to 1 at each of the preceding and following times of the target frame image, the target frame image It is determined that the frame image includes a variation area due to blinking.
  • the flash frame determination unit 11 may use a method using a variation ratio of the luminance of the rectangular area as another method for determining whether the frame image of interest is a frame image including a fluctuation area due to blinking of light.
  • the rectangular area luminance represents an average luminance value for each rectangular area designated in advance in each frame image.
  • the rectangular area luminance in a rectangular area of 10 ⁇ 10 blocks is obtained by dividing an input frame image into rectangular areas of 10 ⁇ 10 blocks as shown in FIG.
  • the index of the luminance value the Y value of the YUV color system, the Y value of the XYZ color system, the V value of the HSV color system, and the like are used as in the local area luminance calculation.
  • the variation ratio of the rectangular area luminance represents the variation ratio of the rectangular area luminance of the target block of the target frame image and the rectangular area luminance of the block of another input frame image at the same position.
  • R t ⁇ t + k (i, j) is calculated as shown in Equation (5).
  • the determination using the rectangular region luminance variation ratio is performed by adding another frame image to the attention frame image in the combination of the attention frame image at time t and another predetermined input frame image. It is determined whether a region that is larger and brighter is included. A value of the determination flag is set, and when there is a frame image with the determination flag being 1 at each of the preceding and following times of the target frame image, it is determined that the target frame is a frame image including a change area due to light blinking.
  • the threshold luminance ⁇ and the area rate ⁇ of the luminance fluctuation rate set in advance are used, and the luminance fluctuation ratio of the rectangular area exceeding the threshold ⁇ is the area rate ⁇ .
  • the flash frame determination unit 11 outputs analysis information as a flash determination result.
  • the analysis information includes a determination flag between the frame image of interest and another input frame image.
  • the flash frame determination unit 11 can calculate a determination flag between input frame images other than the target frame image, similarly to the analysis information.
  • the calculated determination flag may be output as auxiliary information together with the analysis information.
  • the frame interpolation unit 12 inputs the input frame image group other than the target frame image and the analysis information output from the flash frame determination unit 11. When it is determined that the target frame image is a frame image including a fluctuation region due to the blinking of light, the frame interpolation unit 12 uses the input frame image group other than the attention frame image as the attention that has no fluctuation region due to the blinking of light. A frame image is generated and output as an interpolated frame image.
  • the frame interpolation unit 12 first selects a frame image to be used for generating an interpolation frame image and synthesizes them to generate an interpolation frame image.
  • a method of selecting a frame image there is a method of selecting a frame image that does not include a fluctuating region due to blinking of light before and after the closest to the frame image of interest.
  • a specific selection method there is a method using a determination flag calculated by the flash frame determination unit 11. In this method, out of the frame images whose determination flag is 1, the respective frames before and after the closest to the target frame image are selected. For example, with respect to the frame image at time t including the fluctuation region shown in FIG.
  • the selection of the use frame image may be corrected by using a determination flag between input frame images other than the target frame image which is input auxiliary information.
  • the correction is assumed, for example, when a frame image at time (t + k) is selected as a use frame in selection using a determination flag between a frame image of interest and another frame image.
  • the selected frame image is changed to time (t + k + 1).
  • one of the methods for generating the interpolated frame image I es ⁇ t at time t is the input frame image I t + e at time (t + e) and using the input frame image I t-f of the time (t-f), is calculated by the equation (6).
  • estimates a motion vector of each pixel of the input frame image I t + e and I t-f, the motion compensated interpolation, the method of generating an interpolation frame image I es-t It may be used.
  • FIG. 4 is a schematic diagram for explaining the reason why the correction becomes unstable.
  • a case where five frames from time (t ⁇ 2) to time (t + 2) are set as an input frame image group, and a case where a frame image including a fluctuating region continuous for three frames is included in the video sequence. Assumed.
  • the input frame image group is case2 in FIG. 4, blinking can be detected and corrected.
  • the frame image synthesis unit 13 synthesizes the target frame image and the interpolated frame image based on the determination result of the luminance variation in the target frame image (input frame image at time t), and outputs an output frame image in which blinking due to flash or the like is suppressed. Generate and output.
  • the determination flag in the target frame image at time t is used. That is, when the determination flag is 0, the frame image synthesis unit 13 outputs the input frame image of interest (the input frame image at time t) as an output frame image.
  • the determination flag is 1, the frame image synthesis unit 13 And the interpolated frame image are combined and output as an output frame image.
  • the frame image composition unit 13 calculates a composition ratio in each pixel when it is determined that the frame image of interest is an image including a fluctuation region due to blinking of light and an interpolated frame image is generated. An output image is generated by processing. In other cases, the frame image synthesis unit 13 sets the input frame image of interest as an output image. Given the composition ratio u (x, y) at the pixel of interest at pixel position (x, y) and the value of the interpolated frame image I t-es (x, y) at time t, the value of the output image at that position I t-out (x, y) is calculated as shown in Equation (7).
  • the composition ratio there is a method using a change rate of local area luminance between a target frame image and an interpolated frame image.
  • the local area luminance change rate rt -es between the target frame image and the interpolated frame image can be calculated using the same method as the local area luminance change rate of the flash frame determination unit 11.
  • the composition ratio u (x, y) at the pixel of interest at the pixel position (x, y) is determined by changing the local area luminance change rate r t-es (x, y) at the same position to a preset r t-es (
  • the local area luminance change rate value r tar (x, y) in the output frame image corresponding to the value of x, y) is used.
  • the local area luminance change rate in the output frame image can be calculated as in equation (8) so that r tar (x, y).
  • a method of setting the local area luminance change rate value r tar in the output frame image as shown in the graph of FIG.
  • r tar r t-es is set for a small value r t-es .
  • r tar is set to a set maximum value and not larger than that value.
  • the composition ratio there is also a method using the change rate of the luminance of the rectangular area. Specifically, the rectangular area luminance of the output image corresponding to the change rate R t-es of the rectangular area luminance calculated using the same method as that of the flash frame determination unit 11 and a preset value of R t-es.
  • the composite ratio U for each rectangular area is calculated from the rate of change of.
  • the synthesis ratio u for each pixel can be obtained from the calculated synthesis ratio ⁇ for each rectangular area using linear interpolation or bicubic interpolation.
  • the flash frame determination unit 11 determines whether or not the frame image of interest at time t is a frame image that includes a fluctuating region due to flashing of light by flash or the like that may induce a photosensitivity attack (S11).
  • the frame interpolation unit 12 is closest to the target frame image based on the input frame image group other than the target frame based on the analysis information that is the determination result of the luminance variation in the target frame image (the input frame image at time t). A frame image that does not include a fluctuation region due to blinking of the front and rear lights is selected. That is, the frame interpolation unit 12 receives the analysis information from the flash frame determination unit 11, and selects the input frame images before and after the closest to the target frame image from among the input frame images whose analysis information determination flag is 1. . Further, the frame interpolating unit 12 generates an interpolated frame image by using the selected frame images at the previous and subsequent times as a target frame image having no fluctuation region due to blinking of light (S12).
  • the frame image composition unit 13 receives a determination result including analysis information from the flash frame determination unit 11. Subsequently, the frame image synthesis unit 13 synthesizes the attention frame image that is the input frame image at time t and the interpolation frame image based on the determination result of the luminance variation in the attention frame image (input frame image at time t), An output image in which blinking due to flash or the like is suppressed is generated and output (S13). That is, when the determination flag is 0, the input frame image of interest (the input frame image at time t) is output as an output frame image. When the determination flag is 1, the frame of interest image and the interpolation frame image are combined. To output as an output frame image.
  • the effect of the first embodiment can generate an image in which fluctuations in luminance are suppressed with respect to an image including a large luminance change that may induce a photosensitivity seizure.
  • the reason for this is that, for the frame image of interest, a frame image with no luminance change estimated from other frame images is synthesized while changing the synthesis weight for each pixel, thereby correcting mainly areas with large luminance changes, This is because information lost due to overexposure can be restored.
  • the present invention is not limited to this.
  • the present invention can be similarly applied to the case where the fluctuation region is a dark region that is darker (the luminance is smaller) in the frame image of interest than the other frame images.
  • luminance variation that is, a general flash has been described, but the present invention can be similarly applied to saturation variation such as red flash.
  • FIG. 7 is a block diagram of an image processing apparatus according to the second embodiment of the present invention.
  • the image processing apparatus includes a flash frame determination unit 21, a frame interpolation unit 22, and a frame image synthesis unit 23.
  • a group of frame images from time (t ⁇ m) to time (t + m) composed of a preset number of frames m is input and blinking is performed.
  • An output frame image with reduced influence is generated.
  • the frame image composition unit 13 calculates the composition ratio
  • the local area luminance variation ratio and the rectangular area luminance variation ratio between the target frame image and the interpolation frame image are calculated. Need to be calculated, and the processing amount becomes relatively large.
  • the image processing apparatus according to the second embodiment of the present invention is based on a local area luminance variation rate or a rectangular region luminance variation ratio between input frame images. By interpolating the variation rate of the local region luminance and the variation rate of the rectangular region luminance, the amount of calculation for calculating these is suppressed.
  • the flash frame determination unit 21 includes an input frame image group as an input, and includes a fluctuation region due to blinking that causes the frame image of interest at time t to harm the viewer. It is determined whether it is a frame image.
  • the flash frame determination unit 21 calculates the local region luminance variation ratio and the rectangular region luminance variation ratio, and calculates the calculated local region luminance variation ratio and the rectangle. The only difference is that the region luminance fluctuation ratio is output.
  • the flash frame determination unit 21 localizes the frame image of interest at the time t at the pixel position (x, y) and the frame image at the time (t + k) in the input frame image group.
  • the area luminance fluctuation ratio r ′ t ⁇ t + k (x, y) is calculated as in Expression (9).
  • the calculation formula of Formula (9) differs from the calculation formula of Formula (4) in that the denominator uses the local region luminance of the target frame image.
  • the rectangular area luminance variation ratio is used for flash frame determination, the rectangular area luminance of the target frame at time t at the block position (i, j) and the rectangular area of the frame at time (t + k) in the input frame group.
  • the luminance variation ratio R ′ t ⁇ t + k (i, j) is calculated as in Expression (10).
  • ⁇ is set as the threshold value of the luminance variation rate.
  • the threshold value ⁇ ′ of the luminance variation rate in the flash frame determination unit 21 may be set as shown in Expression (11).
  • the frame interpolation unit 22 has the same function as the frame interpolation unit 12 of the first embodiment.
  • the frame interpolation unit 22 generates an attention frame image that does not have a fluctuation region due to blinking of light, and at the same time, based on the input region luminance fluctuation rate, a region luminance between the attention frame image and the generated interpolation frame image Is generated and output as the interpolated area luminance fluctuation rate.
  • the frame interpolation unit 22 calculates the local area luminance fluctuation rate rt -es between the target frame image and the generated interpolated frame image.
  • the frame interpolation unit 22 calculates the rectangular area luminance fluctuation rate R t-es between the frame image of interest and the generated interpolated frame image.
  • the frame interpolation unit 22 receives analysis information from the flash frame determination unit 21. Similar to the frame interpolation unit 12, the frame interpolation unit 22, based on the analysis information that is the determination result of the luminance variation in the target frame image (input frame image at time t), the light before and after the closest to the target frame image. An interpolated frame image is generated as a focused frame image that does not include a fluctuation region due to blinking. That is, the frame interpolation unit 22 selects the input frame images before and after the closest to the target frame image from among the input frame images whose analysis information determination flag is 1.
  • the frame interpolation unit 22 generates an interpolated frame image by using the selected frame images at the previous and subsequent times as a target frame image having no fluctuation region due to the blinking of light. Further, the frame interpolation unit 22 synthesizes the input region luminance fluctuation rate by the same processing as that of the interpolation frame image, and calculates the composite region luminance fluctuation rate. For example, when the local area luminance fluctuation rate is used for flash frame determination and the equation (6) is used for interpolation frame image calculation, the combined local area luminance fluctuation rate r ′ t at the pixel position (x, y). -Es is calculated as shown in Equation (12).
  • the frame interpolation unit 22 calculates the interpolation area luminance fluctuation rate to be output by the calculation formula of Formula (14) or Formula (15).
  • the frame image composition unit 23 receives the determination result from the flash frame determination unit 21. Similar to the frame image synthesis unit 13 of the first embodiment, the frame image synthesis unit 23 synthesizes the target frame image and the interpolated frame image based on the analysis information included in the determination result of the target frame image, and performs flash Generate and output an output image that suppresses blinking due to the above.
  • the frame image composition unit 23 calculates the interpolated area luminance fluctuation calculated by the frame interpolation unit 22 for calculating the composition weight of the target frame image and the interpolated frame image. It is different in using rate.
  • the flash frame determination unit 21 determines whether or not the frame image of interest at time t is a frame image that includes a variation region due to blinking of light due to flash or the like that may induce a photosensitivity seizure. Based on the determination (S21).
  • the frame interpolation unit 22 generates an interpolated frame image that is an attention frame image that does not have a fluctuation region due to blinking of light based on the input frame image group other than the attention frame (S22).
  • the frame interpolation unit 22 calculates a region luminance fluctuation rate between the target frame image and the interpolation frame image (S23).
  • the frame image synthesis unit 23 synthesizes the target frame image and the interpolation frame image, and generates and outputs an output image in which blinking due to flash or the like is suppressed (S24).
  • FIG. 9 is a block diagram of an image processing apparatus according to the third embodiment of the present invention.
  • the image processing apparatus includes an acquisition unit 30 and a correction unit 31.
  • the acquisition unit 30 acquires the luminance change rate in the time direction of the video and a predetermined ratio in the entire area of the frame image.
  • the rate of change in luminance in the time direction is, for example, the threshold value ⁇ of the luminance variation rate described above.
  • the acquisition unit 30 acquires these values from the outside and holds them.
  • the correction unit 31 inputs an image having a luminance change that exceeds the change rate at the above-described ratio, and the ratio or the change rate of the luminance between the frames forming the video is less than the acquired change rate or change rate of the luminance.
  • the luminance of at least a partial region of at least a part of the frame forming the video is corrected. Specifically, by identifying a region of a frame that exceeds the rate or rate of change in luminance, and replacing the luminance of that region with, for example, the luminance of a pixel in the same position as the region of the other frame, As a whole, an image with no change in luminance exceeding the rate of change at the rate described above is generated.
  • the luminance of the region may be replaced with an average value or intermediate luminance of the luminance of the pixels in the region at the same position as the region of the previous and subsequent frames.
  • Blinks that can induce photosensitivity seizures may occur not only in the entire frame, but also in some areas of the frame.
  • the related methods so far correct the entire frame uniformly without discriminating the blinking location.
  • the image processing apparatus according to the present embodiment can suppress performing correction more than necessary for an area that does not need to be corrected and does not blink.
  • the embodiment according to the present invention can be applied to a video editing system for editing video recorded on a hard disk or the like.
  • the present invention can be applied to a video camera, a display terminal, or the like.
  • FIG. 10 is a diagram illustrating a hardware configuration in which the image processing apparatus according to the first to third embodiments is realized by a computer apparatus.
  • the image processing apparatus includes a CPU (Central Processing Unit) 91, a communication I / F (communication interface) 92 for network connection, a memory 93, and a storage device 94 such as a hard disk for storing programs. Including.
  • CPU Central Processing Unit
  • I / F communication interface
  • storage device 94 such as a hard disk for storing programs.
  • the CPU 91 of the image processing apparatus is connected to an input device 95 and an output device 96 via a system bus 97.
  • the CPU 91 operates the operating system to control each functional unit in the first to third embodiments. Further, the CPU 91 reads out programs and data from the recording medium mounted on the drive device to the memory 93, for example.
  • the CPU 91 has a function of processing an input information signal, for example, and executes various functions based on a program.
  • the storage device 94 is, for example, an optical disk, a flexible disk, a magnetic optical disk, an external hard disk, or a semiconductor memory. A part of the storage medium of the storage device 94 is a nonvolatile storage device, and stores a program therein.
  • the program is connected to a communication network.
  • the input device 95 is realized by, for example, a mouse, a keyboard, a built-in key button, a card slot, or a touch panel, and is used for an input operation.
  • the output device 96 is realized by a display, for example, and is used for outputting and confirming information processed by the CPU 91.
  • the first to third embodiments are realized by the hardware configuration shown in FIG.
  • the means for realizing each unit included in the image processing apparatus is not particularly limited. That is, each realization means may be realized by one physically coupled device, or two or more physically separated devices may be connected by wire or wirelessly and realized by these plural devices. Good.
  • a determination unit that determines whether the frame image includes a variable region;
  • a frame generation unit that generates an interpolated frame image that is an attention frame image without the fluctuation region based on a frame image other than the attention frame image;
  • An image processing apparatus comprising: a frame image synthesis unit that generates an output frame image obtained by synthesizing the frame image of interest and the interpolated frame image based on a determination result of the determination unit.
  • Additional remark 2 The image processing apparatus of Additional remark 1 which selects the frame image of each time before and after which adjoins temporally which does not contain the said fluctuation
  • the fluctuation ratio is a fluctuation ratio of local area luminance that is a weighted average value of luminance around each pixel.
  • luminance of a frame image and an interpolation frame image is calculated using the fluctuation ratio of the local area brightness
  • An image processing apparatus according to 1.
  • a frame image of interest in a video whose luminance or saturation changes in a contradictory manner is compared with the frame images before and after the image, and the variation rate of the luminance or saturation of the frame of interest exceeds a predetermined threshold value. Determine whether it is a frame image that includes a variable region, Based on a frame image other than the target frame image, an interpolated frame image that is a target frame image without the fluctuation region is generated, An image processing method for generating an output frame image obtained by synthesizing the frame image of interest and the interpolated frame image based on a determination result of the determination unit.
  • Additional remark 8 The image processing method of Additional remark 7 which selects the frame image of each time before and behind which does not contain the said fluctuation
  • the fluctuation ratio is a fluctuation ratio of local area luminance that is a weighted average value of luminance around each pixel.
  • luminance of a frame image and an interpolation frame image is calculated using the fluctuation ratio of the local area brightness
  • luminance or saturation changes contrary is compared with the frame image before and behind it, and the variation
  • Additional remark 14 The program of Additional remark 13 which selects the frame image of each time before and after which adjoins temporally which does not contain the said fluctuation
  • the fluctuation ratio is a fluctuation ratio of local area luminance that is a weighted average value of luminance around each pixel.
  • Supplementary note 17 calculates the fluctuation ratio of the local area luminance between the frame image and the interpolation frame image using the fluctuation ratio of the local area luminance between the frame image of interest and the frame image selected to generate the interpolation frame image. The program described in.
  • An acquisition unit that acquires a change rate of luminance in a time direction of a video and a predetermined ratio in the entire region of the frame image;
  • the video having a change in luminance that exceeds the rate of change at the rate, the rate or change rate of the luminance between each frame forming the video is less than the acquired rate of change of luminance or the rate of change.
  • An image processing apparatus comprising: a correction unit that corrects luminance of at least a part of a region of a part of the frame.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Television Systems (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

　La présente invention concerne un dispositif de traitement d'image, un procédé de traitement d'image et un programme qui peuvent générer, pour une vidéo ayant la possibilité de provoquer une épilepsie photosensible, une vidéo dans laquelle un changement de luminance ou de saturation est supprimé. La présente invention est un dispositif de traitement d'image comprenant : une unité de détermination destinée à comparer une image de trame d'intérêt et des images de trames précédant et suivant l'image de trame d'intérêt dans une vidéo dans laquelle la luminance ou la saturation se modifie en alternance et à déterminer si l'image de trame d'intérêt comprend une zone de changement dans laquelle une vitesse de changement de luminance ou de saturation dépasse un seuil prescrit ; une unité de génération de trame destinée à générer, en fonction d'images de trames autres que l'image de trame d'intérêt, une image de trame interpolée qui est une image de trame d'intérêt dans laquelle la zone de changement est non existante ; et une unité de synthèse d'image de trame destinée à générer, en fonction du résultat de détermination par le moyen de détermination, une image de trame délivrée dans laquelle l'image de trame d'intérêt et l'image de trame interpolée sont synthétisées.
PCT/JP2015/000087 2014-01-14 2015-01-09 Dispositif de traitement d'image, procédé de traitement d'image et programme comprenant un support d'enregistrement WO2015107880A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2015557764A JP6582994B2 (ja) 2014-01-14 2015-01-09 画像処理装置、画像処理方法及びプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-003880 2014-01-14
JP2014003880 2014-01-14

Publications (1)

Publication Number Publication Date
WO2015107880A1 true WO2015107880A1 (fr) 2015-07-23

Family

ID=53542777

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/000087 WO2015107880A1 (fr) 2014-01-14 2015-01-09 Dispositif de traitement d'image, procédé de traitement d'image et programme comprenant un support d'enregistrement

Country Status (2)

Country Link
JP (1) JP6582994B2 (fr)
WO (1) WO2015107880A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10742923B2 (en) 2018-10-25 2020-08-11 International Business Machines Corporation Detection of photosensitive triggers in video content
CN115174969A (zh) * 2022-07-01 2022-10-11 抖音视界(北京)有限公司 视频的推送方法、装置和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000115778A (ja) * 1998-09-25 2000-04-21 Sarnoff Corp ビデオ・デ―タ中のフラッシュ・フレ―ムの検出および符号化
JP2004242055A (ja) * 2003-02-06 2004-08-26 Sony Corp 信号処理装置および方法、記録媒体、並びにプログラム
JP2006180470A (ja) * 2004-11-26 2006-07-06 Canon Inc 画像処理装置及び画像処理方法
JP2008124956A (ja) * 2006-11-15 2008-05-29 Nippon Hoso Kyokai <Nhk> 動きベクトル補正装置、動きベクトル補正プログラム、補間フレーム生成装置及び映像補正装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000115778A (ja) * 1998-09-25 2000-04-21 Sarnoff Corp ビデオ・デ―タ中のフラッシュ・フレ―ムの検出および符号化
JP2004242055A (ja) * 2003-02-06 2004-08-26 Sony Corp 信号処理装置および方法、記録媒体、並びにプログラム
JP2006180470A (ja) * 2004-11-26 2006-07-06 Canon Inc 画像処理装置及び画像処理方法
JP2008124956A (ja) * 2006-11-15 2008-05-29 Nippon Hoso Kyokai <Nhk> 動きベクトル補正装置、動きベクトル補正プログラム、補間フレーム生成装置及び映像補正装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10742923B2 (en) 2018-10-25 2020-08-11 International Business Machines Corporation Detection of photosensitive triggers in video content
US11153526B2 (en) 2018-10-25 2021-10-19 International Business Machines Corporation Detection of photosensitive triggers in video content
CN115174969A (zh) * 2022-07-01 2022-10-11 抖音视界(北京)有限公司 视频的推送方法、装置和存储介质

Also Published As

Publication number Publication date
JP6582994B2 (ja) 2019-10-02
JPWO2015107880A1 (ja) 2017-03-23

Similar Documents

Publication Publication Date Title
US10397486B2 (en) Image capture apparatus and method executed by image capture apparatus
JP4783985B2 (ja) 映像処理装置、映像表示装置及びそれに用いる映像処理方法並びにそのプログラム
US10459318B2 (en) Image display apparatus method and storage medium for modifying display luminance
US9672603B2 (en) Image processing apparatus, image processing method, display apparatus, and control method for display apparatus for generating and displaying a combined image of a high-dynamic-range image and a low-dynamic-range image
US10672134B2 (en) Image processing apparatus, imaging apparatus, image processing method, and storage medium storing image processing program
JP5089783B2 (ja) 画像処理装置及びその制御方法
WO2016157838A1 (fr) Dispositif de traitement de signaux, procédé de traitement de signaux, et programme
US20180025700A1 (en) Image processing apparatus and display apparatus
US9672650B2 (en) Image processing apparatus, image processing method, and storage medium
JPWO2019146226A1 (ja) 画像処理装置、および出力情報制御方法、並びにプログラム
EP3639238B1 (fr) Codage de gestion d&#39;affichage inverse à couche unique de bout en bout efficace
WO2017159182A1 (fr) Dispositif de commande d&#39;affichage, appareil d&#39;affichage, récepteur de télévision, procédé de commande de dispositif de commande d&#39;affichage, programme de commande et support d&#39;enregistrement
WO2020031742A1 (fr) Dispositif de traitement d&#39;image, procédé de traitement d&#39;image et programme
US7894667B2 (en) Image processing method and apparatus thereof
JP6582994B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP2018061130A (ja) 画像処理装置、画像処理方法、及びプログラム
US10205922B2 (en) Display control apparatus, method of controlling the same, and non-transitory computer-readable storage medium
KR102136716B1 (ko) 관심영역 기반의 화질개선 장치와 그를 위한 컴퓨터로 읽을 수 있는 기록 매체
JP5365881B2 (ja) 画像処理装置、画像処理方法
JP2009290828A (ja) 画像処理装置及び画像処理方法
JP6708131B2 (ja) 映像処理装置、映像処理方法及びプログラム
JP2008123472A (ja) 映像信号処理装置
JP2020030262A (ja) 画像表示装置とその制御方法
JP6693269B2 (ja) 映像処理装置、映像処理方法及びプログラム
JP2024516080A (ja) ビューア適応状態に基づく輝度調整

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15737513

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2015557764

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15737513

Country of ref document: EP

Kind code of ref document: A1