WO2015025999A1 - Procédé de modification d'ensemble des couleurs d'une vidéo et support d'enregistrement associé - Google Patents

Procédé de modification d'ensemble des couleurs d'une vidéo et support d'enregistrement associé Download PDF

Info

Publication number
WO2015025999A1
WO2015025999A1 PCT/KR2013/007761 KR2013007761W WO2015025999A1 WO 2015025999 A1 WO2015025999 A1 WO 2015025999A1 KR 2013007761 W KR2013007761 W KR 2013007761W WO 2015025999 A1 WO2015025999 A1 WO 2015025999A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
video
reference image
color information
images
Prior art date
Application number
PCT/KR2013/007761
Other languages
English (en)
Korean (ko)
Inventor
황영배
김선주
김제우
Original Assignee
전자부품연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 전자부품연구원 filed Critical 전자부품연구원
Publication of WO2015025999A1 publication Critical patent/WO2015025999A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes

Definitions

  • the present invention relates to a color conversion method, and more particularly, to a computer-readable recording medium having a batch color conversion method of a moving picture for collectively converting color of a moving picture and a program for executing the method on a computer. It is about.
  • the video is composed of a number of consecutive frames.
  • all the frames are stored in RAW and then subjected to proper image processing (eg, white balance, gamma correction, etc.).
  • image processing eg, white balance, gamma correction, etc.
  • RAW has a very large data capacity, it is virtually difficult to have a video in RAW format, and it takes a very long time because many frames need to be color-transformed in order to convert the color of the entire video.
  • Embodiments of the present invention provide a batch color converting method of a moving picture and a recording medium thereof capable of batch converting colors for a whole image or a partial image of a moving picture.
  • a step of dividing a video into a plurality of shot SHOT
  • Selecting at least one shot from among the shots and designating at least one reference video from among the images forming the shot Inputting a target image including the same image as the reference image and having color information different from the reference image; Converting color information of the reference image into color information of the target image; And converting all the color information of all the images constituting the selected shot into a conversion relationship between the converted reference image and the target image.
  • step 5 it may further include a six step to repeat the steps from step 2 to step 5.
  • the video segmentation in the first step may be performed by calculating a difference between pixel values of two adjacent images and determining that the difference is the same shot if the difference is less than a threshold value, and determining the same shot if the difference is greater than or equal to the threshold value. It is available.
  • the reference image in step 2 may be the first image of the selected shot.
  • the method may further include a step 2-1 of calculating a difference between pixel values of the first image and other images of the selected shot, and adding the image having the highest difference as a new reference image among the images having the difference greater than or equal to a threshold value. can do.
  • step 5-1 of comparing the color information of the converted entire images with the color information of the target image, respectively; Adding an image having the largest difference in color information to a reference image when an image having a difference in color information from the target image is greater than or equal to a threshold value among all the converted images;
  • the method may further include steps 5-3 for performing steps 4 and 5 again.
  • the target image may be an image taken by using the same camera as the reference image, but may be an image having a different image setting, an image taken by using a camera different from the reference image, or include the same scene as the reference image.
  • the image may be an image downloaded through the Internet, or may be an image obtained by processing the reference image using image editing software.
  • step 4 the same physical position in the reference image and the target image
  • Step 4-1 of searching for a corresponding point having the same feature in the device Radiating calibration of the reference image and the target image so that the camera response functions have a linear function; And 4-3 calculating the color conversion matrix to convert the color information.
  • a computer-readable recording medium having recorded thereon a program for executing the method according to one aspect of the present invention may be provided.
  • the color of the video when the color of at least one image is converted for a shot that constitutes a video, the color of the video may be converted very efficiently since the color may be converted collectively for the other image forming the shot. Batch conversion is possible.
  • FIG. 1 is a flowchart illustrating a batch color conversion method of a video according to an embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating an operation S120 in FIG. 1 in detail.
  • FIG. 3 is a flowchart illustrating an operation S140 in detail in FIG. 1.
  • FIG. 4 is a flowchart illustrating in detail the steps added after S150 in FIG. 1.
  • FIG. 1 is a flowchart illustrating a batch color conversion method (hereinafter, referred to as a batch color conversion method) of a video according to an embodiment of the present invention.
  • a batch color conversion method hereinafter, referred to as a batch color conversion method
  • Step 1 is a step of dividing a video into a plurality of shots.
  • a moving picture is made up of a large number of continuous frames (FRAME).
  • FRAME continuous frames
  • the frame corresponds to the basic unit forming the video.
  • the frame has been described as having the same meaning as 'image'.
  • the plurality of consecutive frames may constitute one shot.
  • a shot may be defined as a collection of frames with a similar image as a whole.
  • the video is composed of a plurality of shots.
  • the scene change in the video may also be understood as a shot (SHOT) has changed.
  • the plurality of shots may constitute one scene according to a semantic relationship.
  • Such scenes may vary depending on the intention of the video editor (or director). That is, the scenes may vary according to how the editor groups a plurality of shots. Therefore, completely different images may exist in one scene.
  • the segmentation of the video does not mean the division of the scene, but rather the division of the shot, which is a set of frames having similar images as a whole.
  • the difference may be determined as the same shot. If this is the case, a method of judging and dividing into another shot may be used (shot boundary detection).
  • the threshold may be preset.
  • the method may compare the entire color histogram between the images, determine that the shot is the same shot if the difference between the color histograms is less than the threshold value, and determine if the difference is the other shot. .
  • the user may manually divide the shot.
  • the audio information when audio information is included in the video, the audio information may be used.
  • the audio information since a person's voice has unique pitch information for each individual, a method of dividing a shot by analyzing a change in pitch and detecting a change in a speaker may be used.
  • a method of dividing a video into a plurality of shots may use various known methods, and is not limited to the above-mentioned method (S110).
  • any one shot is selected from the divided shots, and at least one reference image is designated among the images (frames) constituting the shot.
  • one shot is composed of a plurality of images.
  • the images have similar pixel values and color histogram values.
  • the reference image may be at least one of a plurality of images forming a shot.
  • the reference image may be the first image (frame) of the selected shot (DEFAULT value).
  • the first image of the selected shot is referred to as a first reference image.
  • a plurality of reference images may be designated. This is because an image having a large difference in pixel value and color histogram value from another image may belong to the same shot, and in this case, a color conversion result may be deteriorated.
  • an image added as a reference image in addition to the first reference image will be referred to as a second reference image.
  • FIG. 2 is a flowchart illustrating in detail S120 of FIG. 1.
  • the second reference image may be designated through the same steps as in FIG. 2.
  • a difference in color information between the first reference image and other images of the selected shot is calculated. Images in the same shot have relatively similar color information, but there may be a difference in color information between the images, and in some cases, the difference may be large (S122). Meanwhile, in the present specification, color information refers to color characteristics such as brightness, saturation, color, etc. of an image as well as a color model such as RGB (Red-Green-Blue) obtained from an image.
  • RGB Red-Green-Blue
  • the process may proceed to S130.
  • a predetermined threshold value for example, the threshold value is 10%
  • the second reference image may be additionally designated even after the color conversion is performed, and this will be described later (above S120).
  • Step 3 is a step of inputting a target image.
  • the target image includes the same image as the reference image, and means an image having color information different from that of the reference image. That is, the target image is an image having color information which is a target of conversion of color information of the reference image.
  • the target image may include the same image as the reference image and is not limited to a specific kind.
  • the target image is an image taken using the same camera as the reference image, but the image has a different image setting (where the image setting means image setting such as white balance, gamma correction, picture style, brightness adjustment, etc.). Can be.
  • the image setting means image setting such as white balance, gamma correction, picture style, brightness adjustment, etc.
  • the target image may be an image taken using a different camera from the reference image (different cameras have different spectral sensitivity, gamma, style, etc.).
  • the target image may be an image downloaded through the Internet when it includes the same scene as the reference image.
  • the target image may be an image obtained by processing the reference image using image editing software (editing tools such as Photoshop and paint shop).
  • image editing software editing tools such as Photoshop and paint shop.
  • an image taken using a digital single-lens reflex camera is different from an image taken using a smartphone. That is, since the photographing equipment is different, the colors of the two people are different.
  • the reference image is converted into a target image through a batch color conversion method of a video according to an embodiment of the present invention. Can be converted to have the same color.
  • the video taken with the DSLR can be converted like the video taken with a smartphone.
  • the reverse is also possible (more than S130).
  • Step 4 is a step of converting color information of the reference image into color information of the target image when the target image is input as in S130 (color correction).
  • the color information conversion method may use various color correction methods known in the art.
  • step S140 may be applied to the color correction method of the corresponding image described in the patent.
  • step S140 of the present invention may include the contents of the patent, which will be briefly described below.
  • FIG. 5 is a flowchart illustrating an operation S140 in detail in FIG. 1.
  • step 4 is a step 4-1 of searching for a corresponding point having the same feature while having the same physical location in the reference image and the target image, and a camera response function of the reference image and the target image.
  • Radiation calibration means that the camera response function of the image is calculated to have a linear function, and the inverse function of the image is added to the image to calibrate the camera response function to be a linear function.
  • a 4-3 step of converting color information by calculating a color conversion matrix A detailed description of each step is described in detail in Korean Patent Registration No. 10-1227936, and will be omitted here.
  • the color information of the reference image is converted into the color information of the target image (S140).
  • Step 5 is a step of converting all of the color information of all the images forming the selected shot in a conversion relationship between the converted reference image and the target image. That is, when the color information of the reference image is converted in step 4, a conversion relationship between the reference image and the target image is derived, and color information of all images in the same shot may be collectively converted.
  • all images in the same shot are images having relatively similar color information to the reference image. Therefore, converting all the images in the same shot to the color information of the converted reference image can be relatively fast and reliable.
  • images in the same shot have relatively similar color information, but there may be a difference in color information between the images, and in some cases, the difference may be large. Therefore, a plurality of reference images may be designated from the beginning, but after converting the color information for all images in the same shot, it is possible to additionally specify the reference image according to the conversion result.
  • FIG. 6 is a flowchart illustrating in detail the steps added after S150 in FIG. 1.
  • color information of the entire images (images in the same shot) converted in operation S150 is compared with color information of the target image, respectively (S151).
  • the difference in color information from the target image is less than a threshold value among the entire images from which the color information is converted, it may be considered that the color conversion of the entire images is properly performed. Therefore, it may proceed to the next step (S160).
  • step 5 When the process up to step 5 is completed, the color conversion is performed for the selected shot among the plurality of shots that constitute the video. Therefore, when a color conversion is to be performed for other shots, a new shot is selected and repeated steps S120 to S150 are performed. By repeating the above process, images may be collectively converted to have the same or similar color information as the desired target image for the entire video.
  • the color of at least one image when converted for a shot that constitutes a video, the color may be collectively converted for other images forming the shot. You can batch convert the colors of the video.
  • image processing software since it is possible to use an image processed by another camera setting, another camera, or image editing software as a target image having color information to be converted, there is an advantage that it is not necessary to separately store the RAW of each image of the video.
  • the batch color converting method for moving images according to the present invention described above may be embodied as computer readable codes on a computer readable recording medium.
  • the computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may also be implemented in the form of a carrier wave.
  • the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
  • functional programs, codes, and code segments for implementing the color correction method of the corresponding image may be easily inferred by programmers in the art.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Image Processing (AREA)

Abstract

L'invention concerne un procédé de modification d'ensemble des couleurs d'une vidéo et un support d'enregistrement associé. Un procédé de modification d'ensemble des couleurs d'une vidéo, selon un mode de réalisation de la présente invention, comporte: une première étape consistant à segmenter une vidéo en une pluralité de séquences; une deuxième étape consistant à sélectionner une des séquences et à désigner au moins one image de référence parmi des images constituant la séquence; une troisième étape consistant à introduire une image visée comprenant la même image que l'image de référence et dotée d'informations de couleurs différentes de celles de l'image de référence; une quatrième étape consistant à substituer aux informations de couleurs de l'image de référence les informations de couleurs de l'image visée; et une cinquième étape consistant à substituer à toutes les informations de couleurs de toutes les images constituant la séquence sélectionnée les informations de couleurs modifiées de l'image de référence.
PCT/KR2013/007761 2013-08-20 2013-08-29 Procédé de modification d'ensemble des couleurs d'une vidéo et support d'enregistrement associé WO2015025999A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2013-0098569 2013-08-20
KR20130098569A KR101492060B1 (ko) 2013-08-20 2013-08-20 동영상의 일괄 컬러 변환 방법 및 그 기록매체

Publications (1)

Publication Number Publication Date
WO2015025999A1 true WO2015025999A1 (fr) 2015-02-26

Family

ID=52483765

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2013/007761 WO2015025999A1 (fr) 2013-08-20 2013-08-29 Procédé de modification d'ensemble des couleurs d'une vidéo et support d'enregistrement associé

Country Status (2)

Country Link
KR (1) KR101492060B1 (fr)
WO (1) WO2015025999A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11232616B2 (en) 2018-09-03 2022-01-25 Samsung Electronics Co., Ltd Methods and systems for performing editing operations on media

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050190965A1 (en) * 2004-02-28 2005-09-01 Samsung Electronics Co., Ltd Apparatus and method for determining anchor shots
KR20070107628A (ko) * 2007-08-15 2007-11-07 (주)코인미디어 랩 동영상 샷의 분류
JP2008300981A (ja) * 2007-05-29 2008-12-11 Canon Inc 画像処理装置および画像処理方法
KR20110016505A (ko) * 2008-06-17 2011-02-17 코닌클리케 필립스 일렉트로닉스 엔.브이. 컬러 조정
KR20110023694A (ko) * 2009-08-28 2011-03-08 한국전자통신연구원 촬영된 영상의 컬러 변환 시스템 및 그 제어 방법

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110071854A (ko) * 2009-12-21 2011-06-29 한국전자통신연구원 입체 영상 시스템에서 영상 데이터의 색상 보정 장치 및 방법
KR101227936B1 (ko) * 2011-05-31 2013-01-30 전자부품연구원 대응 영상의 컬러 보정 방법 및 그 기록매체

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050190965A1 (en) * 2004-02-28 2005-09-01 Samsung Electronics Co., Ltd Apparatus and method for determining anchor shots
JP2008300981A (ja) * 2007-05-29 2008-12-11 Canon Inc 画像処理装置および画像処理方法
KR20070107628A (ko) * 2007-08-15 2007-11-07 (주)코인미디어 랩 동영상 샷의 분류
KR20110016505A (ko) * 2008-06-17 2011-02-17 코닌클리케 필립스 일렉트로닉스 엔.브이. 컬러 조정
KR20110023694A (ko) * 2009-08-28 2011-03-08 한국전자통신연구원 촬영된 영상의 컬러 변환 시스템 및 그 제어 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11232616B2 (en) 2018-09-03 2022-01-25 Samsung Electronics Co., Ltd Methods and systems for performing editing operations on media

Also Published As

Publication number Publication date
KR101492060B1 (ko) 2015-02-12

Similar Documents

Publication Publication Date Title
KR100658998B1 (ko) 화상 처리 장치, 화상 처리 방법, 및 그 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체
WO2009131350A2 (fr) Sélection de la meilleure image
US8164649B2 (en) White balance adjusting device, imaging apparatus, and recording medium storing white balance adjusting program
WO2010095873A2 (fr) Ajustement de l'équilibre automatique des blancs
CN109862389B (zh) 一种视频处理方法、装置、服务器及存储介质
US20110075924A1 (en) Color adjustment
CN108012135B (zh) 图像处理方法及装置、计算机可读存储介质和计算机设备
JP7152065B2 (ja) 画像処理装置
WO2015102232A1 (fr) Procédé et appareil électronique pour partager des valeurs de réglage de photographie, et système de partage
CN108174173B (zh) 拍摄方法及装置、计算机可读存储介质和计算机设备
CN107547839A (zh) 基于图像分析的远程控制平台
CN107464225A (zh) 图像处理方法、装置、计算机可读存储介质和移动终端
CN115297257B (zh) 一种多路视频流获取方法、装置及设备
WO2015025999A1 (fr) Procédé de modification d'ensemble des couleurs d'une vidéo et support d'enregistrement associé
WO2017086522A1 (fr) Procédé de synthèse d'image d'incrustation couleur sans écran d'arrière-plan
CN113099191B (zh) 一种图像处理方法及装置
CN112995633B (zh) 图像的白平衡处理方法、装置、电子设备和存储介质
WO2010123171A1 (fr) Procédé utilisant la courbe des caractéristiques de couleurs de la caméra pour corriger la couleur en fonction des modifications affectant la brillance de l'image
JP2009239772A (ja) 撮像装置、画像処理装置、および画像処理方法、並びにプログラム
JP4013024B2 (ja) 動画処理装置、動画処理方法、および記録媒体
CN108111831A (zh) 拍摄方法、成像装置、计算机可读存储介质和计算机设备
CN112995634B (zh) 图像的白平衡处理方法、装置、电子设备和存储介质
CN114630095B (zh) 目标场景图像的自动白平衡方法及装置、终端
JP4110731B2 (ja) 動画処理装置、動画処理方法、および記録媒体
WO2023090695A1 (fr) Système et procédé de synthèse d'images à faible lumière

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13892005

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13892005

Country of ref document: EP

Kind code of ref document: A1