WO2020122481A3 - 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법 - Google Patents

기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법 Download PDF

Info

Publication number
WO2020122481A3
WO2020122481A3 PCT/KR2019/016719 KR2019016719W WO2020122481A3 WO 2020122481 A3 WO2020122481 A3 WO 2020122481A3 KR 2019016719 W KR2019016719 W KR 2019016719W WO 2020122481 A3 WO2020122481 A3 WO 2020122481A3
Authority
WO
WIPO (PCT)
Prior art keywords
output
encoding
machine learning
original frame
processing unit
Prior art date
Application number
PCT/KR2019/016719
Other languages
English (en)
French (fr)
Other versions
WO2020122481A2 (ko
WO2020122481A9 (ko
Inventor
신재섭
류성걸
손세훈
김형덕
김효성
Original Assignee
주식회사 픽스트리
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 픽스트리 filed Critical 주식회사 픽스트리
Priority to US17/413,947 priority Critical patent/US11575897B2/en
Publication of WO2020122481A2 publication Critical patent/WO2020122481A2/ko
Publication of WO2020122481A3 publication Critical patent/WO2020122481A3/ko
Publication of WO2020122481A9 publication Critical patent/WO2020122481A9/ko

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

본 발명은 코덱 내에서 기계 학습을 통해 학습된 파라미터를 학습하여 인코딩 시 압축 과정에서 발생하는 영상의 품질 저하를 보상하는 기술적 사상에 관한 것으로서, 일실시예에 따른 영상 처리 장치는 입력된 원본 프레임을 저장하는 입력 프레임 버퍼, 상기 저장된 원본 프레임에 대한 인코딩을 처리하는 인코딩 처리부, 상기 인코딩된 원본 프레임을 다중화를 위해 출력 스트림으로서 출력하는 출력 스트림 버퍼, 상기 출력 스트림을 다중화하여 송출하도록 제어하는 다중화 처리부를 포함하고, 상기 인코딩 처리부는, 상기 저장된 원본 프레임과, 상기 인코딩 처리 후 복원된 복원 프레임을 이용한 기계 학습에 기초하여 학습된 필터 파라미터를 출력하고 디코딩 측 장치에서는 상기 출력된 필터 파라미터를 이용해서 상기 출력 스트림을 디코딩하는 것을 특징으로 한다.
PCT/KR2019/016719 2018-12-13 2019-11-29 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법 WO2020122481A2 (ko)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/413,947 US11575897B2 (en) 2018-12-13 2019-11-29 Image processing apparatus and operation method for learning parameiers based on machine learning

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2018-0161366 2018-12-13
KR1020180161366A KR102192980B1 (ko) 2018-12-13 2018-12-13 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법

Publications (3)

Publication Number Publication Date
WO2020122481A2 WO2020122481A2 (ko) 2020-06-18
WO2020122481A3 true WO2020122481A3 (ko) 2020-08-06
WO2020122481A9 WO2020122481A9 (ko) 2020-09-24

Family

ID=71076909

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/016719 WO2020122481A2 (ko) 2018-12-13 2019-11-29 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법

Country Status (3)

Country Link
US (1) US11575897B2 (ko)
KR (1) KR102192980B1 (ko)
WO (1) WO2020122481A2 (ko)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180001428A (ko) * 2016-06-24 2018-01-04 한국과학기술원 Cnn 기반 인루프 필터를 포함하는 부호화 방법과 장치 및 복호화 방법과 장치
US20180139450A1 (en) * 2016-11-15 2018-05-17 City University Of Hong Kong Systems and methods for rate control in video coding using joint machine learning and game theory
KR20180052651A (ko) * 2015-09-03 2018-05-18 미디어텍 인크. 비디오 코딩에서의 신경망 기반 프로세싱의 방법 및 장치
KR20180108288A (ko) * 2017-03-24 2018-10-04 주식회사 엔씨소프트 영상 압축 장치 및 방법
KR20180119753A (ko) * 2017-04-26 2018-11-05 강현인 압축 파라미터를 이용한 영상 복원용 머신러닝 알고리즘 및 이를 이용한 영상 복원방법

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120100448A (ko) * 2011-03-04 2012-09-12 (주)스프링웨이브 머신 러닝을 이용한 동영상 압축 기법 및 장치
MY186413A (en) * 2012-09-28 2021-07-22 Sony Corp Image processing device and method
US10007977B2 (en) * 2015-05-11 2018-06-26 Netflix, Inc. Techniques for predicting perceptual video quality
KR102592076B1 (ko) 2015-12-14 2023-10-19 삼성전자주식회사 딥러닝 기반 영상 처리 장치 및 방법, 학습 장치
KR101803471B1 (ko) 2016-02-15 2017-12-01 성균관대학교 산학협력단 컨볼루션 신경망 기반의 영상 패턴화를 이용한 딥러닝 시스템 및 이를 이용한 영상 학습방법
KR20180100976A (ko) * 2017-03-03 2018-09-12 한국전자통신연구원 딥 신경망 기반 블러 영상 학습을 이용한 영상 부호화/복호화 방법 및 장치
KR101906796B1 (ko) 2017-07-03 2018-10-11 한국씨텍(주) 딥러닝 기반 영상 분석 장치 및 영상 분석 방법
GB2611192B (en) * 2018-01-26 2023-06-14 Mediatek Inc Method and apparatus of neural networks with grouping for video coding
US11889070B2 (en) * 2018-03-23 2024-01-30 Sharp Kabushiki Kaisha Image filtering apparatus, image decoding apparatus, and image coding apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180052651A (ko) * 2015-09-03 2018-05-18 미디어텍 인크. 비디오 코딩에서의 신경망 기반 프로세싱의 방법 및 장치
KR20180001428A (ko) * 2016-06-24 2018-01-04 한국과학기술원 Cnn 기반 인루프 필터를 포함하는 부호화 방법과 장치 및 복호화 방법과 장치
US20180139450A1 (en) * 2016-11-15 2018-05-17 City University Of Hong Kong Systems and methods for rate control in video coding using joint machine learning and game theory
KR20180108288A (ko) * 2017-03-24 2018-10-04 주식회사 엔씨소프트 영상 압축 장치 및 방법
KR20180119753A (ko) * 2017-04-26 2018-11-05 강현인 압축 파라미터를 이용한 영상 복원용 머신러닝 알고리즘 및 이를 이용한 영상 복원방법

Also Published As

Publication number Publication date
WO2020122481A2 (ko) 2020-06-18
KR20200073079A (ko) 2020-06-23
US20220086442A1 (en) 2022-03-17
WO2020122481A9 (ko) 2020-09-24
KR102192980B1 (ko) 2020-12-18
US11575897B2 (en) 2023-02-07

Similar Documents

Publication Publication Date Title
MX2020007663A (es) Procesamiento de una nube de puntos.
PH12018500454A1 (en) Method and apparatus of nueral network based processing in video coding
PH12017502274A1 (en) Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus for signaling sao parameters
MY187403A (en) Apparatus and method for video motion compensation with selectable interpolation filter
PL409213A1 (pl) Sposób i urządzenie do kodowania obrazu oraz sposób i urządzenie do dekodowania obrazu
MY197611A (en) Apparatus and method for video motion compensation
WO2008120577A1 (ja) 画像符号化及び復号化の方法及び装置
WO2012173403A3 (ko) 영상 정보 인코딩 및 디코딩 방법
JP2016534654A5 (ko)
WO2020122478A3 (ko) 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법
MY193174A (en) Apparatus and method for video motion compensation
WO2009050889A1 (ja) 映像復号方法及び映像符号化方法
MY175432A (en) Video encoding method with bit depth adjustment for fixedpoint conversion and apparatus therefor, and video decoding method and apparatus therefor
EP4307676A3 (en) Method for coding image on basis of selective transform and device therefor
EP3962085A3 (en) Image encoding and decoding method, encoding and decoding device, encoder and decoder
MY185713A (en) Apparatus and method for video motion compensation
MY184187A (en) Speech/audio bitstream decoding method and apparatus
MY164248A (en) Image coding and decoding method, image data processing method, and devices thereof
WO2017052407A8 (en) Adaptive sharpening filter for predictive coding
RU2016141278A (ru) Устройство обработки изображения и способ
MX2022009122A (es) Un codificador, un decodificador y los métodos correspondientes para el filtrado de bucle adaptativo.
WO2020122481A3 (ko) 기계 학습 기반으로 파라미터를 학습하는 영상 처리 장치 및 동작 방법
MX2022005905A (es) Metodo y aparato para se?alizacion de compensacion de movimiento envolvente horizontal en la codificacion de video vr360.
GB2546882A (en) Alternating block constrained decision mode coding
WO2010098556A3 (ko) 영상 부호화/복호화 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19896246

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19896246

Country of ref document: EP

Kind code of ref document: A2