CA2858786A1 - Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy - Google Patents
Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy Download PDFInfo
- Publication number
- CA2858786A1 CA2858786A1 CA2858786A CA2858786A CA2858786A1 CA 2858786 A1 CA2858786 A1 CA 2858786A1 CA 2858786 A CA2858786 A CA 2858786A CA 2858786 A CA2858786 A CA 2858786A CA 2858786 A1 CA2858786 A1 CA 2858786A1
- Authority
- CA
- Canada
- Prior art keywords
- auxiliary
- quality
- level
- map
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 331
- 239000013598 vector Substances 0.000 claims abstract description 203
- 238000007670 refining Methods 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 91
- 238000012545 processing Methods 0.000 claims description 21
- 238000003860 storage Methods 0.000 claims description 20
- 230000007704 transition Effects 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 11
- 238000001914 filtration Methods 0.000 claims description 5
- 230000001419 dependent effect Effects 0.000 claims description 4
- 230000004931 aggregating effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 42
- 230000006870 function Effects 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 12
- 239000011159 matrix material Substances 0.000 description 10
- 230000002146 bilateral effect Effects 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 210000004872 soft tissue Anatomy 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 150000002739 metals Chemical class 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/53—Multi-resolution motion estimation; Hierarchical motion estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201161558302P | 2011-11-10 | 2011-11-10 | |
| US61/558,302 | 2011-11-10 | ||
| US13/303,554 | 2011-11-23 | ||
| US13/303,554 US9300980B2 (en) | 2011-11-10 | 2011-11-23 | Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy |
| PCT/IB2012/002286 WO2013068825A1 (en) | 2011-11-10 | 2012-11-09 | Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2858786A1 true CA2858786A1 (en) | 2013-05-16 |
Family
ID=47351870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2858786A Abandoned CA2858786A1 (en) | 2011-11-10 | 2012-11-09 | Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy |
Country Status (7)
| Country | Link |
|---|---|
| US (3) | US9300980B2 (cg-RX-API-DMAC10.html) |
| EP (1) | EP2777274B1 (cg-RX-API-DMAC10.html) |
| KR (1) | KR102263625B1 (cg-RX-API-DMAC10.html) |
| CN (1) | CN104170388B (cg-RX-API-DMAC10.html) |
| CA (1) | CA2858786A1 (cg-RX-API-DMAC10.html) |
| IN (1) | IN2014CN04195A (cg-RX-API-DMAC10.html) |
| WO (1) | WO2013068825A1 (cg-RX-API-DMAC10.html) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013034981A2 (en) | 2011-09-08 | 2013-03-14 | Offshore Incorporations (Cayman) Limited, | System and method for visualizing synthetic objects withinreal-world video clip |
| US9300980B2 (en) * | 2011-11-10 | 2016-03-29 | Luca Rossato | Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy |
| KR20150020568A (ko) * | 2012-05-14 | 2015-02-26 | 루카 로사토 | 시간을 따라 샘플들의 시퀀스들의 블렌딩에 기초한 인코딩과 디코딩 |
| US20140301463A1 (en) * | 2013-04-05 | 2014-10-09 | Nokia Corporation | Method and apparatus for video coding and decoding |
| US20150030208A1 (en) * | 2013-07-29 | 2015-01-29 | Irida Labs S.A. | System and a method for motion estimation based on a series of 2d images |
| US20150124873A1 (en) * | 2013-11-01 | 2015-05-07 | Microsoft Corporation | Chroma Down-Conversion and Up-Conversion Processing |
| US9131202B1 (en) | 2014-05-30 | 2015-09-08 | Paofit Holdings Pte. Ltd. | Systems and methods for motion-vector-aided video interpolation using real-time smooth video playback speed variation |
| JP6336341B2 (ja) * | 2014-06-24 | 2018-06-06 | キヤノン株式会社 | 撮像装置及びその制御方法、プログラム、記憶媒体 |
| US9508026B2 (en) | 2014-07-01 | 2016-11-29 | Irida Labs S.A. | System and a method for camera motion analysis and understanding from a video sequence |
| KR101642200B1 (ko) * | 2014-12-19 | 2016-07-22 | 포항공과대학교 산학협력단 | 객체의 움직임 분석을 이용한 모션 효과 생성 장치 및 방법 |
| US10410398B2 (en) * | 2015-02-20 | 2019-09-10 | Qualcomm Incorporated | Systems and methods for reducing memory bandwidth using low quality tiles |
| PL3284255T3 (pl) | 2015-04-13 | 2023-10-30 | V-Nova International Limited | Kodowanie wielu sygnałów z docelową szybkością transmisji danych sygnału w zależności od informacji o złożoności |
| US9704298B2 (en) | 2015-06-23 | 2017-07-11 | Paofit Holdings Pte Ltd. | Systems and methods for generating 360 degree mixed reality environments |
| RU2730435C1 (ru) | 2017-04-21 | 2020-08-21 | Зенимакс Медиа Инк. | Системы и способы рендеринга с адаптируемым качеством под управлением кодировщика |
| US10432962B1 (en) * | 2018-03-13 | 2019-10-01 | Pixelworks, Inc. | Accuracy and local smoothness of motion vector fields using motion-model fitting |
| US11611773B2 (en) * | 2018-04-06 | 2023-03-21 | Qatar Foundation For Education, Science And Community Development | System of video steganalysis and a method for the detection of covert communications |
| US10983201B2 (en) * | 2018-10-29 | 2021-04-20 | Dji Technology, Inc. | User interface for displaying point clouds generated by a lidar device on a UAV |
| GB2618714B (en) | 2019-03-20 | 2024-03-13 | V Nova Int Ltd | Low complexity enhancement video coding |
| US11313990B2 (en) * | 2019-04-04 | 2022-04-26 | The Johns Hopkins University | Large volume holographic imaging systems and associated methods |
| GB2619640B (en) | 2019-07-05 | 2024-06-05 | V Nova Int Ltd | Quantization of residuals in video coding |
| CN110910324B (zh) * | 2019-11-19 | 2023-04-14 | 山东神戎电子股份有限公司 | 红外视频的去竖条纹方法 |
| GB2598701B (en) | 2020-05-25 | 2023-01-25 | V Nova Int Ltd | Wireless data communication system and method |
| WO2022211462A1 (ko) * | 2021-04-02 | 2022-10-06 | 현대자동차주식회사 | 동적 메시 코딩을 위한 장치 및 방법 |
| CN114025168B (zh) * | 2021-09-30 | 2023-08-04 | 浙江大华技术股份有限公司 | 视频图像的处理方法、处理设备、电子设备以及存储介质 |
| US12657655B2 (en) * | 2021-12-03 | 2026-06-16 | Nvidia Corporation | Temporal image blending using one or more neural networks |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5477272A (en) * | 1993-07-22 | 1995-12-19 | Gte Laboratories Incorporated | Variable-block size multi-resolution motion estimation scheme for pyramid coding |
| US5612735A (en) * | 1995-05-26 | 1997-03-18 | Luncent Technologies Inc. | Digital 3D/stereoscopic video compression technique utilizing two disparity estimates |
| US20020196854A1 (en) * | 2001-06-15 | 2002-12-26 | Jongil Kim | Fast video encoder using adaptive hierarchical video processing in a down-sampled domain |
| JP2003037842A (ja) * | 2001-07-26 | 2003-02-07 | Monolith Co Ltd | 画像符号化方法、復号方法および画像符号化装置、復号装置 |
| KR20060121820A (ko) * | 2003-08-22 | 2006-11-29 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 레이트-왜곡-복잡성 최적화된 비디오 코딩을 위한 모션벡터들의 결합된 공간-시간-배향-스케일 예측 및 코딩 |
| US8036494B2 (en) | 2004-04-15 | 2011-10-11 | Hewlett-Packard Development Company, L.P. | Enhancing image resolution |
| KR100664929B1 (ko) | 2004-10-21 | 2007-01-04 | 삼성전자주식회사 | 다 계층 기반의 비디오 코더에서 모션 벡터를 효율적으로압축하는 방법 및 장치 |
| JP2006174415A (ja) * | 2004-11-19 | 2006-06-29 | Ntt Docomo Inc | 画像復号装置、画像復号プログラム、画像復号方法、画像符号化装置、画像符号化プログラム及び画像符号化方法 |
| US7479425B2 (en) * | 2005-01-20 | 2009-01-20 | Chartered Semiconductor Manufacturing, Ltd | Method for forming high-K charge storage device |
| WO2006124885A2 (en) * | 2005-05-12 | 2006-11-23 | Kylintv, Inc. | Codec for iptv |
| US20080111923A1 (en) * | 2006-11-09 | 2008-05-15 | Scheuermann W James | Processor for video data |
| US9204149B2 (en) * | 2006-11-21 | 2015-12-01 | Vixs Systems, Inc. | Motion refinement engine with shared memory for use in video encoding and methods for use therewith |
| CN105263012A (zh) * | 2007-03-16 | 2016-01-20 | 汤姆森许可贸易公司 | 用于将文本与三维内容相结合的系统和方法 |
| JP2009089332A (ja) * | 2007-10-03 | 2009-04-23 | Sony Corp | 動き予測方法及び動き予測装置 |
| JP4882956B2 (ja) * | 2007-10-22 | 2012-02-22 | ソニー株式会社 | 画像処理装置および画像処理方法 |
| US20110081093A1 (en) * | 2008-06-05 | 2011-04-07 | Fabien Racape | Image coding method with texture synthesis |
| CN102217314B (zh) * | 2008-09-18 | 2017-07-28 | 汤姆森特许公司 | 用于视频图像删减的方法和装置 |
| EP2209086A1 (en) * | 2009-01-15 | 2010-07-21 | Telefonaktiebolaget L M Ericsson (publ) | Image processing |
| US9300980B2 (en) * | 2011-11-10 | 2016-03-29 | Luca Rossato | Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy |
| US20140169467A1 (en) * | 2012-12-14 | 2014-06-19 | Ce Wang | Video coding including shared motion estimation between multple independent coding streams |
-
2011
- 2011-11-23 US US13/303,554 patent/US9300980B2/en active Active
-
2012
- 2012-11-09 CN CN201280066702.9A patent/CN104170388B/zh active Active
- 2012-11-09 IN IN4195CHN2014 patent/IN2014CN04195A/en unknown
- 2012-11-09 WO PCT/IB2012/002286 patent/WO2013068825A1/en not_active Ceased
- 2012-11-09 CA CA2858786A patent/CA2858786A1/en not_active Abandoned
- 2012-11-09 KR KR1020147015734A patent/KR102263625B1/ko active Active
- 2012-11-09 EP EP12799276.6A patent/EP2777274B1/en active Active
-
2016
- 2016-03-16 US US15/071,369 patent/US9628817B2/en active Active
-
2017
- 2017-04-05 US US15/479,966 patent/US9967568B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| KR20140092898A (ko) | 2014-07-24 |
| US9300980B2 (en) | 2016-03-29 |
| US9628817B2 (en) | 2017-04-18 |
| US20130294514A1 (en) | 2013-11-07 |
| US20160198159A1 (en) | 2016-07-07 |
| EP2777274B1 (en) | 2021-05-19 |
| US9967568B2 (en) | 2018-05-08 |
| CN104170388B (zh) | 2019-01-25 |
| CN104170388A (zh) | 2014-11-26 |
| WO2013068825A1 (en) | 2013-05-16 |
| IN2014CN04195A (cg-RX-API-DMAC10.html) | 2015-09-04 |
| US20170208333A1 (en) | 2017-07-20 |
| EP2777274A1 (en) | 2014-09-17 |
| KR102263625B1 (ko) | 2021-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2777274B1 (en) | Upsampling of motion maps in resolution scalable video coding | |
| US11595653B2 (en) | Processing of motion information in multidimensional signals through motion zones and auxiliary information through auxiliary zones | |
| EP2074586A2 (en) | Image enhancement | |
| US10284810B1 (en) | Using low-resolution frames to increase frame rate of high-resolution frames | |
| CA2842439A1 (en) | Adaptive upsampling for spatially scalable video coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |
Effective date: 20181109 |