WO2015016584A1 - Procédé et dispositif pour fournir un service multimédia - Google Patents

Procédé et dispositif pour fournir un service multimédia Download PDF

Info

Publication number
WO2015016584A1
WO2015016584A1 PCT/KR2014/006944 KR2014006944W WO2015016584A1 WO 2015016584 A1 WO2015016584 A1 WO 2015016584A1 KR 2014006944 W KR2014006944 W KR 2014006944W WO 2015016584 A1 WO2015016584 A1 WO 2015016584A1
Authority
WO
WIPO (PCT)
Prior art keywords
service
quality
sensor
server
multimedia
Prior art date
Application number
PCT/KR2014/006944
Other languages
English (en)
Korean (ko)
Inventor
박경모
유성열
황승오
서덕영
원대희
김규헌
박광훈
송재연
Original Assignee
삼성전자주식회사
경희대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사, 경희대학교 산학협력단 filed Critical 삼성전자주식회사
Publication of WO2015016584A1 publication Critical patent/WO2015016584A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/18—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/535—Tracking the activity of the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02—Power saving arrangements

Definitions

  • the present invention relates to a method and apparatus for adjusting the quality of multimedia data in a method for providing a multimedia service in a broadcasting and communication system.
  • the conventional service quality adjustment method does not consider the movement of the terminal or the concentration of the user's terminal, etc. Therefore, in order to minimize the power consumption, the service quality may be additionally considered by considering the movement of the terminal or the concentration of the terminal. How to adjust it.
  • an object of the present invention is to provide a method and apparatus for efficiently using radio resources and minimizing power consumption by adjusting service quality in consideration of a terminal usage environment.
  • a method for providing a multimedia service comprising: receiving multimedia data provided from a server, filtering the received multimedia data, decoding and rendering the filtered data; And measuring the user's awareness of the terminal through at least one sensor connected to the terminal, determining whether the quality of service of the multimedia data needs to be changed according to the measured awareness, and changing the service quality. If it is determined that there is a need, and transmitting the information necessary for the change of the quality of service to the server.
  • a receiver for receiving multimedia data provided from a server, a data filter for filtering the received multimedia data, and a decoder for decoding the filtered data
  • a renderer for rendering the decoded data
  • at least one sensor connected to a terminal to measure a user's perception of the terminal, and whether the quality of service of the multimedia data needs to be changed according to the perception measured by the sensor. If it is determined that it is necessary to change the quality of service, the state analysis unit for transmitting the information necessary for the change of the quality of service to the server.
  • 1 is a view showing an example of sensors that can be mounted on the terminal
  • FIG. 4 is a diagram illustrating a structure of an application program for providing a multimedia service according to an embodiment of the present invention.
  • 5 is a diagram illustrating types of RTCP messages.
  • FIG. 6 is a diagram illustrating an operation of an application program for providing a multimedia service according to an exemplary embodiment of the present invention.
  • FIG. 1 illustrates an example of sensors that can be mounted in a terminal.
  • FIG. 1 there may be various sensors capable of measuring a user's state in the terminal.
  • a method of controlling the quality of service is proposed. Therefore, in order to minimize power consumption, which is an object of the present invention, it is not preferable to use a power-consuming sensor such as a camera or a GPS, and sensors that consume less power and cost less than when transmitting and receiving data using a CPU operation or a network. That is, it is preferable to use an acceleration sensor, a gyroscope, etc. with little power consumption.
  • the degree of movement of the terminal is measured using an acceleration sensor. For example, you can measure when the user is stationary, walking at normal speed, running, or walking at high speed.
  • the values measured by the accelerometer have different ranges, and thus, when the values are out of a predetermined range, the user's movement state changes. If there is a lot of motion, the user can reduce the power consumption by transmitting a low quality video by using the low concentration of the user terminal.
  • the EEG sensor can measure the concentration of the user terminal through the EEG measurement, it is possible to properly adjust the service quality of the multimedia data according to the measured concentration.
  • the acceleration sensor in an environment in which the user walks or runs and uses the multimedia service, the user has less concentration on the terminal than when using the terminal in a stationary state. That is, even if a user concentrates on a moving direction than a terminal or focuses on a screen viewed by the terminal, the terminal moves according to the user's movement.
  • the video being watched by the user is encoded with a codec divided into multiple layers according to quality, such as SVC (Scalable Video Codec)
  • the quality can be adjusted according to the user's recognition. That is, the acceleration sensor may be used to determine whether the movement of the terminal is enough for the user to concentrate on the terminal, and thus, the user may provide an image having a quality adjusted so that the user cannot recognize the change in quality. This quality of service adjustment can reduce power consumption.
  • the brain recognizes the final image through three stages of image formation, exposure control, and detection.
  • the image delivered to the brain is a high quality, high resolution image, but the area of interest in the brain is part of the image.
  • the same high-quality simulated image in a graphic image is partially dependent on the state of the camera, the characteristics of the object being drawn, or the user's point of view of the graphic image.
  • CSF ie, recognition ability
  • 8 cps cycle per degree
  • the quality of service subject is a terminal (hereinafter referred to as client-driven QoS)
  • the terminal receives a multimedia service from a server
  • the quality of service is selected by using a sensor in which the terminal is embedded
  • the quality of service is a server (hereinafter, referred to as a client-driven QoS) Server-driven QoS)
  • the terminal sends the value measured by the sensor to the server
  • the server selects the quality of service based on this value. Therefore, an application program that receives multimedia data from a server and serves a user should be able to service video and audio and analyze measured values from various sensors embedded in the terminal. Power consumption for receiving a large amount of data required for multimedia services or for operations such as decoding is very large.
  • the present invention proposes a method for generating a parameter for adjusting service quality using sensors built in a terminal without directly inputting a quality of service that a user can consume.
  • the sensors measure the user's awareness or the service status of the terminal and analyze the information to adjust the service quality according to the situation. That is, it does not always maintain the same quality, but reduces the power consumption by degrading the quality in a proper situation.
  • the multimedia service application program simultaneously receives the multimedia data from the server in the multimedia data receiving unit 410, and the sensor measuring unit 450 measures the signal through one or more sensors built in the terminal, and measures the measurement.
  • the collected data is transmitted to the status analyzer 460 for use in analyzing the user's status.
  • the state analyzer 460 determines whether the user's recognition of the user's terminal or the quality of the multimedia data currently being serviced is appropriate using the data measured by various sensors through a state analysis algorithm. If it is determined that the quality of the multimedia data currently being serviced is higher than the recognition of the user's terminal, the service quality is determined according to the recognition of the user's terminal, and a value indicating this is transmitted to the data filter 420.
  • the data filter 420 filters and passes the multimedia data received from the multimedia data receiver 410 to the decoder 430.
  • the data filter 420 appropriately filters the multimedia data according to the quality of service change information transmitted from the state analyzer 460.
  • the decoder 430 decodes the data transmitted from the data filter 420, and the decoded data is rendered through the renderer 440 to serve the user.
  • the analysis result of the state analysis unit 460 is also reported to the server.
  • server-driven QoS the current state is processed for each sensor and reported to the server to adjust the quality of service based on the information received from the terminal by the server. To be able.
  • client-driven QoS the terminal selects the quality of service according to the user's state and requests the server to change the quality of service. This procedure is repeated until the multimedia service is terminated.
  • the value measured by the sensor using the Real Time Control Protocol (RTCP) Can be sent to the server.
  • 5 shows the types of RTCP messages.
  • the application-specific message is a packet for an application that wants to use a new application, and allows a new message type to be defined. Therefore, in the embodiment of the present invention, the data related to the quality of service change may be transmitted to the server by using the application designation message.
  • the measured value of the sensor may be transmitted to the server using an extended header of the Real Time Streaming Protocol (RTSP).
  • RTSP Real Time Streaming Protocol
  • FIG. 7 illustrates an operation sequence of an application program for providing a multimedia service according to an embodiment of the present invention.
  • a server and a socket are created through a call setup process 611, a connection operation is performed, and data is received (612) and filtering is performed (613).
  • data is received (612) and filtering is performed (613).
  • each sensor measures the current state at predetermined intervals.
  • the measured values extracted from the one or more sensors check the user's awareness or the state of the terminal through predetermined algorithms, and determine whether the service quality of the multimedia currently being service is appropriate (623). As a result of the determination, if the quality of service is appropriate, the process returns to the process of measuring the current state through the sensor (622).
  • the QoS control form of the currently connected server is checked (624).
  • the quality of service corresponding to the current state is determined (625), and the determined content is transmitted to the data filter to be applied to the filtering process (613).
  • the server measures the value measured by the sensor (626) and reports it to the server (627) so that the server can determine the quality of service.
  • the service quality value determined in step 625 is reported to the server (627). Thereafter, it is checked whether the service is terminated (629), and if not, the process returns to the process of measuring the current state through the sensor (622).
  • the data filter filters the received data according to the quality of service updated from time to time by the sensor (613) and passes it to the decoder.
  • the decoder decodes the filtered data according to the quality of service (614) and the decoded data is rendered through the renderer (615). After rendering, it is checked whether the service is terminated (617), and if not, the process returns to the process of receiving data (611).
  • adjusting the service quality of the multimedia data may be variously applied according to the type of sensor.
  • the accelerometer When using the accelerometer to measure the perception of the user's moving speed, it provides the highest quality when the user is stationary, provides a medium quality when moving at a normal speed within a certain range, When moving at speed it can provide a low quality.
  • the quality of service through a gyroscope most mobile terminals and video contents generate data at a ratio of 16: 9, so that a user holds a terminal horizontally and watches a video. The video size is noticeably different when you hold the video vertically. This difference is illustrated in FIGS. 7 and 8.
  • the video size when the terminal is held in the vertical direction is smaller than that when the terminal is held in the horizontal direction, it is overhead to service the same quality video as when the terminal is held in the horizontal direction. Therefore, in this case, receiving and servicing low quality video reduces power consumption.
  • the high-quality service may be provided, and when the concentration falls below a predetermined value, the power consumption may be reduced by providing a low-quality service.
  • adjusting the service quality of the multimedia data can be variously applied according to the type of data.
  • data combined with audio and video only the audio minus the video may be received and processed to reduce the quality of service.
  • the quality of service may be adjusted by adjusting the amount of each frame in I-frames, P-frames, and B-frames that constitute a group of pictures (GOP).
  • the amount of B-frames and P-frames can be increased to lower quality, and I-frames can be frequently received to provide high quality.
  • the power consumption can be reduced by lowering the step to enhance1 if normal speed motion is detected and to base if high speed motion is detected. have.
  • the amount of computation required for decoding is reduced and the amount of power consumed is also reduced.
  • power consumption can be reduced by appropriately adjusting the quality of service using a sensor built in the terminal when serving multimedia data.
  • the power consumption can be reduced by appropriately adjusting the quality of service according to the state of the user or the state of the terminal when serving multimedia data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

La présente invention concerne un procédé et un dispositif pour changer une qualité de service de données multimédias par utilisation d'un capteur. La présente invention consiste à : recevoir des données multimédias à partir d'un serveur ; filtrer les données multimédias reçues, décoder et restituer les données filtrées ; mesurer la prise de conscience, par un utilisateur, d'un terminal par l'intermédiaire d'au moins un capteur connecté au terminal ; déterminer, sur la base de la prise de conscience mesurée, s'il existe un besoin de changer la qualité de service de données multimédias ; et transmettre des informations nécessaires pour changer la qualité de service au serveur lorsqu'il est déterminé qu'il existe le besoin de changer la qualité de service.
PCT/KR2014/006944 2013-07-29 2014-07-29 Procédé et dispositif pour fournir un service multimédia WO2015016584A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020130089388A KR102118535B1 (ko) 2013-07-29 2013-07-29 멀티미디어 서비스 제공 방법 및 장치
KR10-2013-0089388 2013-07-29

Publications (1)

Publication Number Publication Date
WO2015016584A1 true WO2015016584A1 (fr) 2015-02-05

Family

ID=52432052

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/006944 WO2015016584A1 (fr) 2013-07-29 2014-07-29 Procédé et dispositif pour fournir un service multimédia

Country Status (2)

Country Link
KR (1) KR102118535B1 (fr)
WO (1) WO2015016584A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113965732A (zh) * 2021-12-01 2022-01-21 济南和普威视光电技术有限公司 一种低带宽视频传输方法和系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040009045A (ko) * 2002-07-22 2004-01-31 김인영 바이오피드백과 게임을 이용한 개인 휴대용 단말 기반의집중력 증진 방법 및 장치
KR100786389B1 (ko) * 2006-08-21 2007-12-17 한국전자통신연구원 적응적 서비스품질 미들웨어 시스템 및 그 시스템에서의서비스 지원 방법
KR100896688B1 (ko) * 2008-05-15 2009-05-14 경희대학교 산학협력단 단말의 성능을 고려한 멀티미디어 서비스 제공방법 및 그에사용되는 단말기
WO2011047335A1 (fr) * 2009-10-16 2011-04-21 Qualcomm Incorporated Transmission multimédia adaptative
WO2012134465A1 (fr) * 2011-03-30 2012-10-04 Empire Technology Development Llc Estimation de la qualité d'une expérience

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110032234A (ko) * 2009-09-22 2011-03-30 주식회사 케이티 네트워크 품질 상태에 기반한 콘텐츠 서비스 제공 방법 및 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040009045A (ko) * 2002-07-22 2004-01-31 김인영 바이오피드백과 게임을 이용한 개인 휴대용 단말 기반의집중력 증진 방법 및 장치
KR100786389B1 (ko) * 2006-08-21 2007-12-17 한국전자통신연구원 적응적 서비스품질 미들웨어 시스템 및 그 시스템에서의서비스 지원 방법
KR100896688B1 (ko) * 2008-05-15 2009-05-14 경희대학교 산학협력단 단말의 성능을 고려한 멀티미디어 서비스 제공방법 및 그에사용되는 단말기
WO2011047335A1 (fr) * 2009-10-16 2011-04-21 Qualcomm Incorporated Transmission multimédia adaptative
WO2012134465A1 (fr) * 2011-03-30 2012-10-04 Empire Technology Development Llc Estimation de la qualité d'une expérience

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113965732A (zh) * 2021-12-01 2022-01-21 济南和普威视光电技术有限公司 一种低带宽视频传输方法和系统

Also Published As

Publication number Publication date
KR20150014125A (ko) 2015-02-06
KR102118535B1 (ko) 2020-06-03

Similar Documents

Publication Publication Date Title
KR102314172B1 (ko) 360도 적응형 스트리밍에 대한 경험을 개선하기 위한 메트릭 및 메시지
US9600220B2 (en) Multi-device display configuration
US20170301203A1 (en) Reducing bandwidth via voice detection
CN104077098A (zh) 用于提高在装置之间共享屏幕的体验质量的方法和设备
JP2022516663A (ja) データ伝送方法と電子デバイス
EP3100245A1 (fr) Sélection et affichage de flux à débit adaptatif dans un système de sécurité vidéo
US11991233B2 (en) QoE metrics reporting for RTP-based 360-degree video delivery
KR102553273B1 (ko) 가상 현실 이미지들의 이미지 개선을 위한 방법 및 장치
CN105163059B (zh) 一种基于智能家居设备的视频通话方法及视频通话系统
US10192297B2 (en) Method and apparatus for creating, streaming, and rendering HDR images
CN113936119A (zh) 一种数据渲染方法、系统及装置
WO2017150792A1 (fr) Appareil et procédé pour fournir des contenus en utilisant un protocole de bureau virtuel sur internet
WO2015016584A1 (fr) Procédé et dispositif pour fournir un service multimédia
CN111866058B (zh) 数据处理方法及系统
US9055027B2 (en) Transmission method and electronic device
CN104580289B (zh) 一种对用户设备进行控制的方法、装置和系统
US11265356B2 (en) Network assistance functions for virtual reality dyanmic streaming
CN110753243A (zh) 图像处理方法、图像处理服务器及图像处理系统
Reznik User-adaptive mobile video streaming using MPEG-DASH
CN112689160B (zh) 一种应用于图像采集设备的视频传输方法及装置
AU2011296757A1 (en) Method and apparatus for generating control packet
TWI520048B (zh) 雲端影像資料輸出方法及雲端伺服器
US20140161199A1 (en) Method and apparatus for processing video image
KR101411636B1 (ko) 스마트 티비 기반의 상황 인지를 통한 엔스크린 서비스 제공 시스템, 장치, 방법 및 컴퓨터 판독 가능한 기록 매체
KR102126794B1 (ko) 영상 데이터 전송 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14832345

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14832345

Country of ref document: EP

Kind code of ref document: A1