CN116743609A - 一种基于语义通信的视频流媒体的QoE评估方法及装置 - Google Patents
一种基于语义通信的视频流媒体的QoE评估方法及装置 Download PDFInfo
- Publication number
- CN116743609A CN116743609A CN202311013701.4A CN202311013701A CN116743609A CN 116743609 A CN116743609 A CN 116743609A CN 202311013701 A CN202311013701 A CN 202311013701A CN 116743609 A CN116743609 A CN 116743609A
- Authority
- CN
- China
- Prior art keywords
- semantic
- streaming media
- qoe
- reconstructed video
- video streaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000006854 communication Effects 0.000 title claims abstract description 156
- 238000004891 communication Methods 0.000 title claims abstract description 150
- 238000011156 evaluation Methods 0.000 title claims abstract description 30
- 238000012512 characterization method Methods 0.000 claims abstract description 148
- 238000004458 analytical method Methods 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims description 44
- 238000006243 chemical reaction Methods 0.000 claims description 24
- 238000004364 calculation method Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 11
- 238000012549 training Methods 0.000 claims description 7
- 239000013598 vector Substances 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000000605 extraction Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000013507 mapping Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5061—Network service management, e.g. ensuring proper service fulfilment according to agreements characterised by the interaction between service providers and their network customers, e.g. customer relationship management
- H04L41/5067—Customer-centric QoS measurements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311013701.4A CN116743609B (zh) | 2023-08-14 | 2023-08-14 | 一种基于语义通信的视频流媒体的QoE评估方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311013701.4A CN116743609B (zh) | 2023-08-14 | 2023-08-14 | 一种基于语义通信的视频流媒体的QoE评估方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116743609A true CN116743609A (zh) | 2023-09-12 |
CN116743609B CN116743609B (zh) | 2023-10-17 |
Family
ID=87911756
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311013701.4A Active CN116743609B (zh) | 2023-08-14 | 2023-08-14 | 一种基于语义通信的视频流媒体的QoE评估方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116743609B (zh) |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103888846A (zh) * | 2014-03-04 | 2014-06-25 | 浙江大学 | 基于QoE的无线视频流业务自适应速率控制方法 |
CN111079601A (zh) * | 2019-12-06 | 2020-04-28 | 中国科学院自动化研究所 | 基于多模态注意力机制的视频内容描述方法、系统、装置 |
CN111163318A (zh) * | 2020-01-09 | 2020-05-15 | 北京大学 | 一种基于反馈优化的人机视觉编码方法和装置 |
CN112702602A (zh) * | 2020-12-04 | 2021-04-23 | 浙江智慧视频安防创新中心有限公司 | 一种视频编解码的方法及存储介质 |
CN114339238A (zh) * | 2020-09-29 | 2022-04-12 | 华为技术有限公司 | 视频编码的方法、视频解码的方法及其装置 |
CN114913250A (zh) * | 2021-12-24 | 2022-08-16 | 天翼数字生活科技有限公司 | 基于语义分割和匈牙利算法的视频编解码系统和方法 |
CN115905619A (zh) * | 2022-10-09 | 2023-04-04 | 上海哔哩哔哩科技有限公司 | 对视频的用户体验质量进行评价的方案 |
WO2023095932A1 (ko) * | 2021-11-23 | 2023-06-01 | 엘지전자 주식회사 | 시맨틱 기반 무선 통신 시스템에서 데이터를 전송하는 방법, 전송 기기, 프로세싱 장치 및 저장 매체, 그리고 데이터를 수신하는 방법, 수신 기기 및 저장 매체 |
US20230198663A1 (en) * | 2021-12-17 | 2023-06-22 | Lenovo (Singapore) Pte, Ltd. | Radio access network configuration for video approximate semantic communications |
-
2023
- 2023-08-14 CN CN202311013701.4A patent/CN116743609B/zh active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103888846A (zh) * | 2014-03-04 | 2014-06-25 | 浙江大学 | 基于QoE的无线视频流业务自适应速率控制方法 |
CN111079601A (zh) * | 2019-12-06 | 2020-04-28 | 中国科学院自动化研究所 | 基于多模态注意力机制的视频内容描述方法、系统、装置 |
CN111163318A (zh) * | 2020-01-09 | 2020-05-15 | 北京大学 | 一种基于反馈优化的人机视觉编码方法和装置 |
CN114339238A (zh) * | 2020-09-29 | 2022-04-12 | 华为技术有限公司 | 视频编码的方法、视频解码的方法及其装置 |
CN112702602A (zh) * | 2020-12-04 | 2021-04-23 | 浙江智慧视频安防创新中心有限公司 | 一种视频编解码的方法及存储介质 |
WO2023095932A1 (ko) * | 2021-11-23 | 2023-06-01 | 엘지전자 주식회사 | 시맨틱 기반 무선 통신 시스템에서 데이터를 전송하는 방법, 전송 기기, 프로세싱 장치 및 저장 매체, 그리고 데이터를 수신하는 방법, 수신 기기 및 저장 매체 |
US20230198663A1 (en) * | 2021-12-17 | 2023-06-22 | Lenovo (Singapore) Pte, Ltd. | Radio access network configuration for video approximate semantic communications |
CN114913250A (zh) * | 2021-12-24 | 2022-08-16 | 天翼数字生活科技有限公司 | 基于语义分割和匈牙利算法的视频编解码系统和方法 |
CN115905619A (zh) * | 2022-10-09 | 2023-04-04 | 上海哔哩哔哩科技有限公司 | 对视频的用户体验质量进行评价的方案 |
Non-Patent Citations (2)
Title |
---|
王煜 等: "视频语义模型及评价准则", 计算机学报, no. 03 * |
陶晓明 等: "面向体验质量的多媒体计算通信", 中国图像图形学报, vol. 26, no. 6 * |
Also Published As
Publication number | Publication date |
---|---|
CN116743609B (zh) | 2023-10-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111107395B (zh) | 一种视频转码的方法、装置、服务器和存储介质 | |
CN109286825B (zh) | 用于处理视频的方法和装置 | |
CN113242469B (zh) | 一种自适应视频传输配置方法和系统 | |
US8804815B2 (en) | Support vector regression based video quality prediction | |
Ries et al. | Video Quality Estimation for Mobile H. 264/AVC Video Streaming. | |
CN103414915B (zh) | 一种网站上传视频质量评价方法及装置 | |
KR102472971B1 (ko) | 인공지능 모델을 이용한 동영상 인코딩 최적화 방법, 시스템, 및 컴퓨터 프로그램 | |
CN110807757A (zh) | 基于人工智能的图像质量评估方法、装置及计算机设备 | |
CN108156459A (zh) | 可伸缩视频传输方法及系统 | |
US11798254B2 (en) | Bandwidth limited context based adaptive acquisition of video frames and events for user defined tasks | |
CN113452944B (zh) | 一种云手机的画面显示方法 | |
CN113962965A (zh) | 图像质量评价方法、装置、设备以及存储介质 | |
JP2024511103A (ja) | 近似値に基づいて画像又はビデオの品質を評価する方法及び装置、第1のモデルの訓練方法及び装置、電子機器、記憶媒体、並びにコンピュータプログラム | |
CN111340101A (zh) | 稳定性评估方法、装置、电子设备和计算机可读存储介质 | |
KR101465664B1 (ko) | 영상 데이터 품질 평가 장치, 방법 및 시스템 | |
CN116760988B (zh) | 基于人类视觉系统的视频编码方法和装置 | |
CN117061791B (zh) | 云视频帧自适应协作渲染方法、装置及计算机设备 | |
CN116743609B (zh) | 一种基于语义通信的视频流媒体的QoE评估方法及装置 | |
CN113452996A (zh) | 一种视频编码、解码方法及装置 | |
CN117831116A (zh) | 基于大模型蒸馏的奔跑事件检测方法及电子设备 | |
CN117478886A (zh) | 多媒体数据编码方法、装置、电子设备及存储介质 | |
CN109219960B (zh) | 视频编码质量平滑度的优化方法、装置、设备及存储介质 | |
CN116155873A (zh) | 一种云边协同的图像处理方法、系统、设备及介质 | |
CN112866683B (zh) | 基于视频前处理及转码的质量评估方法 | |
CN118175356A (zh) | 视频传输方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CB03 | Change of inventor or designer information |
Inventor after: Cheng Baoping Inventor after: Tao Xiaoming Inventor after: Zhang Jian Inventor after: Xie Xiaoyan Inventor after: Fu Tao Inventor after: Lin Jiaming Inventor after: Xu Hua Inventor after: Ge Ning Inventor after: Duan Yiping Inventor before: Cheng Baoping Inventor before: Tao Xiaoming Inventor before: Zhang Jian Inventor before: Xie Xiaoyan Inventor before: Fu Tao Inventor before: Lin Jiaming Inventor before: Xu Hua |
|
CB03 | Change of inventor or designer information |