JP6437663B2 - 視聴体験とシステム制約に基づくコーディングパラメタの適合化 - Google Patents
視聴体験とシステム制約に基づくコーディングパラメタの適合化 Download PDFInfo
- Publication number
- JP6437663B2 JP6437663B2 JP2017542085A JP2017542085A JP6437663B2 JP 6437663 B2 JP6437663 B2 JP 6437663B2 JP 2017542085 A JP2017542085 A JP 2017542085A JP 2017542085 A JP2017542085 A JP 2017542085A JP 6437663 B2 JP6437663 B2 JP 6437663B2
- Authority
- JP
- Japan
- Prior art keywords
- decoder
- video
- parameters
- viewing experience
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000006978 adaptation Effects 0.000 title description 10
- 238000000034 method Methods 0.000 claims description 18
- 238000012360 testing method Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 5
- 230000007613 environmental effect Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000001537 neural effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000006461 physiological response Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/162—User input
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/395—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability involving distributed video coding [DVC], e.g. Wyner-Ziv video coding or Slepian-Wolf video coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Description
センサデータに基づいてユーザ視聴体験を推定するステップと、
デコーダパラメータを用いる際に制約を分析するステップと、
推定および分析ステップに基づいて可変デコーダパラメータからデコーダパラメータを選択するステップとを含む。
Claims (12)
- センサデータに基づいてユーザ視聴体験を推定するように構成された推定器を備え、かつ、デコーダパラメータを用いる際に制約を分析するように構成された制約分析器を備える、可変デコーダパラメータから選択されたデコーダパラメータに基づいてビデオを復号するように構成されたビデオデコーダであって、推定器および制約分析器に結合される、可変デコーダパラメータから前記デコーダパラメータを選択するように構成された選択器をさらに備え、
選択器が所定規則のセットに従ってユーザ視聴体験と制約が均衡されるようにデコーダパラメータを選択するように構成される、ビデオデコーダ。 - 選択器が選択されたデコーダパラメータをコーデックパラメータに変換するように構成され、ビデオデコーダがコーデックパラメータをビデオエンコーダに送信するための通信モジュールをさらに備える、請求項1に記載のビデオデコーダ。
- 制約が、計算要件、メモリ使用量、バッテリ使用および帯域幅使用の1つまたは複数を含む、請求項1または2に記載のビデオデコーダ。
- センサデータが環境パラメータを測定するように構成され、ユーザ視聴体験が環境パラメータとユーザ視聴体験との所定の相関関係に基づいて推定される、請求項1から3のいずれか一項に記載のビデオデコーダ。
- センサデータが心拍数、視線および光条件の少なくとも1つを含むユーザ条件を測定するように構成され、ユーザ視聴体験がユーザ条件の所定の解釈に基づいて推定される、請求項1から4のいずれか一項に記載のビデオデコーダ。
- デコーダパラメータを変更しながらユーザ視聴体験の変化が観察されるように、センサデータが収集されながらデコーダパラメータが変更されるテストループを含む、請求項5に記載のビデオデコーダ。
- 請求項1から6のいずれか一項に記載のビデオデコーダから、選択されたデコーダパラメータから変換されたコーデックパラメータを受信するための通信モジュールを備える、コーデックパラメータに基づいてビデオを符号化するように構成された、ビデオエンコーダ。
- 請求項1から6のいずれか一項に記載のビデオデコーダを備え、かつ請求項7に記載のビデオエンコーダを備え、ビデオエンコーダがネットワーク機器を介して前記ビデオデコーダと接続される、ビデオシステム。
- デコーダパラメータに基づいてビデオを復号するための方法であって、
− センサデータに基づいてユーザ視聴体験を推定するステップと、
− デコーダパラメータを用いる際に制約を分析するステップと、
− 前記推定および前記分析に基づいて可変デコーダパラメータから前記デコーダパラメータを選択するステップとを含む、ビデオを復号するための方法であって、
前記選択するステップが、所定規則のセットに従ってユーザ視聴体験と制約を均衡させるステップを含む、方法。 - 方法が、前記デコーダパラメータをコーデックパラメータに変換するステップと、前記コーデックパラメータをビデオエンコーダに送信するステップとをさらに含む、請求項9に記載の方法。
- 実行されたときに、データ処理装置に請求項9または10に記載の方法のステップを実行させる命令を含む、コンピュータ可読記憶媒体。
- 実行されたときに、データ処理装置に請求項9または10に記載の方法のステップを実行させる命令を含む、コンピュータプログラム。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15305214.7A EP3057318A1 (en) | 2015-02-13 | 2015-02-13 | Adapting coding parameters based on viewing experience and system constraints |
EP15305214.7 | 2015-02-13 | ||
PCT/EP2016/052628 WO2016128354A1 (en) | 2015-02-13 | 2016-02-08 | Adapting coding parameters based on viewing experience and system constraints |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2018511966A JP2018511966A (ja) | 2018-04-26 |
JP6437663B2 true JP6437663B2 (ja) | 2018-12-12 |
Family
ID=52596904
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017542085A Active JP6437663B2 (ja) | 2015-02-13 | 2016-02-08 | 視聴体験とシステム制約に基づくコーディングパラメタの適合化 |
Country Status (5)
Country | Link |
---|---|
US (1) | US10531081B2 (ja) |
EP (1) | EP3057318A1 (ja) |
JP (1) | JP6437663B2 (ja) |
CN (1) | CN107211120A (ja) |
WO (1) | WO2016128354A1 (ja) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2558644A (en) * | 2017-01-13 | 2018-07-18 | Nokia Technologies Oy | Video encoding |
US10735770B2 (en) * | 2018-09-13 | 2020-08-04 | Tencent America LLC | Method and device using high layer syntax architecture for coding and decoding |
CN116348952A (zh) * | 2023-02-09 | 2023-06-27 | 北京小米移动软件有限公司 | 一种音频信号处理、装置、设备及存储介质 |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11122624A (ja) * | 1997-10-16 | 1999-04-30 | Matsushita Electric Ind Co Ltd | ビデオデコーダ処理量を低減する方法および装置 |
JP2000115771A (ja) | 1998-10-09 | 2000-04-21 | Sony Corp | 画像送信装置および方法、画像受信装置および方法、画像通信システム、並びに提供媒体 |
US20080320509A1 (en) * | 2001-01-16 | 2008-12-25 | Gustafson Joseph E | Quantitative Assessment of Marketing Strategies |
US6704362B2 (en) * | 2001-07-06 | 2004-03-09 | Koninklijke Philips Electronics N.V. | Resource scalable decoding |
KR100587417B1 (ko) * | 2003-12-22 | 2006-06-08 | 한국전자통신연구원 | 주파수 분할 다중화를 사용하는 무선통신 시스템에서의적응 송수신 장치 및 그 방법 |
JP5030495B2 (ja) * | 2006-07-14 | 2012-09-19 | ソニー株式会社 | 再生装置、再生方法、プログラム、および記録媒体 |
US8443398B2 (en) * | 2006-11-01 | 2013-05-14 | Skyfire Labs, Inc. | Architecture for delivery of video content responsive to remote interaction |
JP2008288859A (ja) * | 2007-05-17 | 2008-11-27 | Olympus Corp | 高度な色再現が可能な映像表示システム |
US8125314B2 (en) * | 2008-02-05 | 2012-02-28 | International Business Machines Corporation | Distinguishing between user physical exertion biometric feedback and user emotional interest in a media stream |
US8964828B2 (en) * | 2008-08-19 | 2015-02-24 | Qualcomm Incorporated | Power and computational load management techniques in video processing |
KR20120018145A (ko) * | 2009-05-06 | 2012-02-29 | 톰슨 라이센싱 | 프리젠테이션 장치 능력에 따라서 최적화된 멀티미디어 콘텐츠를 전송하기 위한 방법 및 시스템 |
US20110095875A1 (en) * | 2009-10-23 | 2011-04-28 | Broadcom Corporation | Adjustment of media delivery parameters based on automatically-learned user preferences |
US9894314B2 (en) * | 2010-06-15 | 2018-02-13 | Dolby Laboratories Licensing Corporation | Encoding, distributing and displaying video data containing customized video content versions |
US9186077B2 (en) * | 2012-02-16 | 2015-11-17 | Google Technology Holdings LLC | Method and device with customizable power management |
US8768089B2 (en) * | 2012-03-23 | 2014-07-01 | Futurewei Technologies, Inc. | System and method for filtering an image |
US9245497B2 (en) * | 2012-11-01 | 2016-01-26 | Google Technology Holdings LLC | Systems and methods for configuring the display resolution of an electronic device based on distance and user presbyopia |
US9794026B2 (en) * | 2013-04-12 | 2017-10-17 | Qualcomm Incorporated | Adaptive data interference cancellation |
KR102062764B1 (ko) * | 2013-07-19 | 2020-02-21 | 삼성전자주식회사 | 모바일 단말 화면을 위한 3k해상도를 갖는 디스플레이 영상 생성 방법 및 장치 |
US10506257B2 (en) * | 2015-09-28 | 2019-12-10 | Cybrook Inc. | Method and system of video processing with back channel message management |
US10510146B2 (en) * | 2016-10-06 | 2019-12-17 | Qualcomm Incorporated | Neural network for image processing |
US10735154B2 (en) * | 2017-03-23 | 2020-08-04 | Huawei Technologies Co., Ltd. | Methods and apparatus for coding sub-channel selection |
-
2015
- 2015-02-13 EP EP15305214.7A patent/EP3057318A1/en not_active Withdrawn
-
2016
- 2016-02-08 JP JP2017542085A patent/JP6437663B2/ja active Active
- 2016-02-08 US US15/549,519 patent/US10531081B2/en active Active
- 2016-02-08 CN CN201680009643.XA patent/CN107211120A/zh not_active Withdrawn
- 2016-02-08 WO PCT/EP2016/052628 patent/WO2016128354A1/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
CN107211120A (zh) | 2017-09-26 |
EP3057318A1 (en) | 2016-08-17 |
US20180027232A1 (en) | 2018-01-25 |
WO2016128354A1 (en) | 2016-08-18 |
US10531081B2 (en) | 2020-01-07 |
JP2018511966A (ja) | 2018-04-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Sengupta et al. | HotDASH: Hotspot aware adaptive video streaming using deep reinforcement learning | |
US20220030244A1 (en) | Content adaptation for streaming | |
Liu et al. | 360 innovations for panoramic video streaming | |
CN110620892B (zh) | 视频通信中的视频标注技术 | |
CN109618565B (zh) | 流式视频用户体验质量的自动测量方法和系统 | |
JP6437663B2 (ja) | 視聴体験とシステム制約に基づくコーディングパラメタの適合化 | |
WO2019231619A1 (en) | Systems and methods game streaming | |
Yarnagula et al. | QoE for mobile clients with segment-aware rate adaptation algorithm (SARA) for DASH video streaming | |
CN110087071A (zh) | 基于感知的图像处理装置及相关方法 | |
CN116506665A (zh) | 自适应码率控制的vr串流方法、系统、装置及存储介质 | |
CN114173160B (zh) | 直播推流方法及装置 | |
CN115996292A (zh) | 流控模型训练方法、装置、计算机设备和存储介质 | |
Zhang et al. | A QOE-driven approach to rate adaptation for dynamic adaptive streaming over http | |
CN112866756A (zh) | 一种多媒体文件的码率控制方法、装置、介质和设备 | |
US11936698B2 (en) | Systems and methods for adaptive video conferencing | |
Wilk et al. | A content-aware video adaptation service to support mobile video | |
AT&T | ||
CN115426526B (zh) | 一种视频播放方法、装置、存储介质及设备 | |
Qin | Adaptive Bitrate Streaming Over Cellular Networks: Rate Adaptation and Data Savings Strategies | |
US20240244225A1 (en) | Content-aware, machine-learning-based rate control | |
US20240244227A1 (en) | Quality-metric-agnostic rate control | |
US20240244228A1 (en) | Rate control based on machine learning for video encoders | |
US11870833B2 (en) | Methods and systems for encoder parameter setting optimization | |
CN118102005B (zh) | 视频数据处理方法、装置、设备以及介质 | |
US20240121400A1 (en) | Video Encoding Complexity Predictor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20180619 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20180918 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20181030 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20181114 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6437663 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |