WO2015130126A1 - Système de service de diffusion en continu de cloud, dispositif à cet effet, et procédé de service de diffusion en continu de cloud - Google Patents

Système de service de diffusion en continu de cloud, dispositif à cet effet, et procédé de service de diffusion en continu de cloud Download PDF

Info

Publication number
WO2015130126A1
WO2015130126A1 PCT/KR2015/001920 KR2015001920W WO2015130126A1 WO 2015130126 A1 WO2015130126 A1 WO 2015130126A1 KR 2015001920 W KR2015001920 W KR 2015001920W WO 2015130126 A1 WO2015130126 A1 WO 2015130126A1
Authority
WO
WIPO (PCT)
Prior art keywords
video data
audio data
data
streaming service
encoded video
Prior art date
Application number
PCT/KR2015/001920
Other languages
English (en)
Korean (ko)
Inventor
심화석
배태면
Original Assignee
에스케이플래닛 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이플래닛 주식회사 filed Critical 에스케이플래닛 주식회사
Publication of WO2015130126A1 publication Critical patent/WO2015130126A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/18—Arrangements for synchronising broadcast or distribution via plural systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/02—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information
    • H04H60/07—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information characterised by processes or methods for the generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2622—Signal amplitude transition in the zone between image portions, e.g. soft edges
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect

Definitions

  • the present invention relates to a cloud streaming service system, an apparatus therefor, and a cloud streaming service method. More particularly, the present invention relates to a cloud streaming service system, and more particularly, to decode the data without demultiplexing the video data and the audio data and synchronizing the video data with the audio data.
  • the present invention relates to a cloud streaming service system capable of minimizing a latency of a streaming service, an apparatus, and a cloud streaming service method therefor.
  • a low performance client terminal can process the data through a remote cloud server, which can solve the difficulty of using a content including a large amount of image processing.
  • Cloud computing technology is used to receive and display at the client terminal.
  • IT information technology
  • the execution screen is transmitted to the user device in a streaming manner, so that only the input and output in the user device, the user Regardless of the device's specifications and capabilities, it is called a cloud streaming service that enables a user to use desired content.
  • this method requires performance evaluation for the system where the actual synchronization is performed, and causes a waste of system resources due to time check.
  • the difference between the time value between the time of encoding the video / audio data and the time of decoding the video / audio signal is kept constant, or the difference between the time value between the video / audio decoding time and the actual representation time is kept constant.
  • the difference value is above or below a certain threshold, when skipping or repeatedly synchronizing the frame generates a lot of calculations and repetitions to keep the time value constant, it may cause jitter due to the skip.
  • video data and audio data are encoded and then multiplexed and transmitted according to respective compression protocols.
  • the cloud streaming service of the video data and the audio data of the video it is possible to immediately decode the video data and audio data without demultiplexing process and the synchronization process of the video data and audio data, so that the waiting time of the cloud streaming service ( To provide a cloud streaming service system, a device and a cloud streaming service method for minimizing the latency).
  • the present invention provides a means for solving the above problems, the service communication unit for transmitting the requested content to the user device connected through a communication network; And a streaming controller which transmits encoded video data and audio data of content requested by a user device in synchronization, and sequentially transmits the encoded video data and audio data in units of frames in accordance with a playback time of the user device. It provides a cloud streaming service device characterized in that.
  • the cloud streaming service apparatus may further include an encoder that encodes and outputs video data and audio data, or a service storage that stores video data and audio data, or encoded video data and audio data. .
  • the cloud streaming service apparatus connects two communication channels with a user device through a service communication unit, and causes the streaming control unit to transmit the encoded video data and audio data through the two communication channels, respectively.
  • the service communication unit may connect one communication channel with a user and a device, and the streaming control unit may alternately transmit encoded video data and audio data through one communication channel.
  • the streaming controller of the cloud streaming service apparatus according to the present invention may further include an identifier for distinguishing the video data and the audio data when transmitting the encoded video data and the audio data.
  • the cloud streaming service apparatus may further include a real-time broadcast receiving unit for receiving the real-time broadcast data provided to the encoder.
  • the present invention is another means for solving the above-described problems, connected to the cloud streaming service device, and receives the video data and audio data encoded in units of frames from the cloud streaming service device in accordance with the playback time, respectively,
  • a network receiver for classifying the encoded video data and the audio data and transferring the encoded video data and the audio data to the video decoder and the audio decoder, respectively;
  • a video decoding unit for decoding and outputting the encoded video data transmitted from the network receiver in order according to the reproduction time;
  • an audio decoding unit for decoding and outputting the encoded audio data transmitted from the network receiving unit in order according to the reproduction time.
  • the video decoding unit and the audio decoding unit may decode the video data and the audio data, respectively, in the order delivered from the network receiver without synchronization processing.
  • the video decoding unit may include a feeding buffer configured to store encoded video data transmitted from a network receiver; A decoding buffer for storing video data being decoded; And an output buffer for storing the decoded video data, wherein the audio decoding unit comprises: a feeding buffer for storing the encoded audio data transmitted from the network receiver; A decoding buffer for storing audio data being decoded; And an output buffer for storing the decoded audio data.
  • the network receiver receives the encoded video data and the audio data through different channels, respectively, and distinguishes the encoded video data and the audio data through the received channel.
  • an identifier for identifying a data type may be further received along with the encoded video data and audio data, and the encoded video data and the audio data may be distinguished using the received identifier.
  • the present invention is another means for solving the above-described problem, the synchronization of the encoded video data and audio data of the content requested by the user device to transmit in synchronization with each other, and sequentially transmitted in frame units in accordance with the playback time in the user device Cloud streaming service apparatus; And a user device configured to receive video data and audio data encoded in units of frames from a cloud streaming service device in accordance with a playback time, and decode and output the encoded video data and audio data according to a reception order. It provides a cloud streaming service system.
  • the present invention is another means for solving the above-mentioned problem, the cloud streaming service device sequentially transmits the encoded video data and audio data of the content requested from the user device in units of frames in accordance with the playback time in the user device Doing; And decoding and outputting, by the user device, encoded video data and audio data received according to a playback time from the cloud streaming service device without synchronization processing.
  • the transmitting may include transmitting the encoded video data and the audio data through different communication channels or alternately transmitting the encoded video data and the audio data. Only an identifier for identifying audio data may be further included and transmitted.
  • the present invention further provides a computer-readable recording medium having recorded thereon a program for executing the above-described cloud streaming service method.
  • a client streaming service device transmits encoded video data and audio data of a content requested by a user device in synchronization, and sequentially encodes the encoded video data and audio data in units of frames in accordance with a playback time of the user device.
  • FIG. 1 is a block diagram showing a cloud streaming service system according to the present invention.
  • FIG. 2 is a block diagram showing the configuration of a cloud streaming service apparatus according to the present invention.
  • FIG. 3 is a block diagram showing the configuration of a user device according to the present invention.
  • FIG. 4 is a message flow diagram illustrating a cloud streaming service method according to the present invention.
  • 5 and 6 are diagrams for explaining a cloud streaming service method according to the present invention.
  • a component when referred to as being "connected” or “connected” to another component, it means that it may be connected or connected logically or physically. In other words, although a component may be directly connected or connected to other components, it should be understood that other components may exist in the middle, and may be connected or connected indirectly.
  • Figure 1 is a block diagram showing a cloud streaming service system according to the present invention.
  • the cloud streaming service system includes a cloud streaming service device 100 and one or more user devices 200 connected through a communication network 10.
  • the cloud streaming service apparatus 100 transmits encoded video data and audio data of a content requested by the user apparatus 200 in synchronization, and reproduces the same on the user apparatus 200.
  • the user device can decode and output them as they are received without demultiplexing processing and synchronization processing between video and audio signals.
  • the user's waiting time is minimized.
  • the cloud streaming service device 100 is a device of a service provider for serving predetermined content to one or more user devices 200 through the communication network 10.
  • the cloud streaming service device 100 serves the content based on cloud computing technology, and executes various contents such as a game, a VOD, and a real time broadcast according to an input signal of the user device 200, and executes the result.
  • the streaming is transmitted to the user device 200.
  • the execution screen may include video data and audio data
  • the cloud streaming service apparatus 100 encodes and transmits the video data and audio data according to each compression protocol.
  • the cloud streaming service apparatus 100 encodes the video data and the audio data in units of frames, and transmits the encoded video data and the audio data to the user device 200 as it is without the multiplexing process as a bit stream. .
  • the cloud streaming service device 100 sequentially transmits the encoded video data and the audio data in the frame unit in accordance with the playback time of the user device 200.
  • the cloud streaming service apparatus 100 may transmit video data and audio data encoded at a 33 msec period according to a playback time.
  • the cloud streaming service device 100 preferably transmits in synchronization with the video data and audio data to be transmitted.
  • video data and audio data may be alternately transmitted at regular intervals.
  • the audio data may be transmitted once in a manner of being alternately transmitted.
  • the cloud streaming service device 100 connects two different channels with the user device 200, and transmits the encoded video data and the audio data through the two channels, respectively. That is, one of two channels transmits encoded video data, and the other channel transmits encoded audio data. Further, in another embodiment of the present invention, the cloud streaming service apparatus 100 sets an identifier for distinguishing video data from audio data, and whether the corresponding data is video data or audio data in the encoded video data and audio data, respectively. Only an identifier indicating the acknowledgment may be added and transmitted. In this case, the identifier may be expressed by, for example, a flag.
  • the user device 200 accesses the cloud streaming service device 100 and receives the video data and the audio data encoded in units of frames from the cloud streaming service device 100 according to a playback time, the received video is received.
  • Data and audio data can be decoded and output as they are.
  • the user device 200 decodes and outputs encoded video data and audio data, which are separately transmitted and received, without having to perform demultiplexing processing or synchronization processing through header parsing.
  • the communication network 10 for transmitting data by connecting the cloud streaming service apparatus 100 and the user apparatus 200 described above may include one or more communication schemes that are currently used or currently under development.
  • the communication network 10 may include a wireless LAN (WLAN), Wi-Fi, wireless communication such as Wibro, Wimax, High Speed Downlink Packet Access (HSDPA), CDMA, and LTE (Long).
  • WLAN wireless LAN
  • Wi-Fi wireless communication
  • wireless communication such as Wibro, Wimax, High Speed Downlink Packet Access (HSDPA), CDMA, and LTE (Long).
  • HSDPA High Speed Downlink Packet Access
  • CDMA Code Division Multiple Access
  • LTE Long
  • At least one of mobile communication such as Term Evolution, Ethernet, xDSL (ADSL, VDSL), Hybrid Fiber Coax (HFC), Fiber to The Curb (FTTC), and Fiber To The Home (FTTH) It can be made of a combination of communication networks according to.
  • the user device 200 for processing the above-described cloud streaming service may be any of various information communication devices used by the user as long as the user device 200 can communicate through the communication network 10.
  • the user device 200 may be applied to various terminals, such as a multimedia terminal, a wired terminal, a fixed terminal, and an Internet Protocol (IP) terminal.
  • IP Internet Protocol
  • the client terminal is not only a mobile communication terminal such as a mobile phone and a smart phone, but also a portable multimedia player (PMP), a mobile internet device (MID), a desktop PC, a tablet PC, a notebook, a notebook, It can be various devices such as a net book.
  • FIG. 2 is a block diagram showing the configuration of a cloud streaming service apparatus according to the present invention.
  • the cloud streaming service apparatus 100 includes a service communication unit 110, a streaming control unit 120, an encoding unit 130, a service storage unit 140, and a real-time broadcast receiving unit. 150 and the cloud computing processor 160.
  • the service communication unit 110 is a component for communicating with one or more user devices 200 through a communication network 10.
  • the service communication unit 110 may transmit and receive data based on one or more transmission protocols.
  • the service communication unit 110 forms a communication channel with the user device 200 requesting the service, and distinguishes the encoded video data and the audio data of the requested content through the formed communication channel to the user device 200.
  • the service communication unit 110 forms two communication channels with the user device 200, and then through the assigned communication channels, the encoded video data and audio data, respectively. send.
  • the two communication channels may be distinguished by different port values. In this case, since a communication channel through which video data is transmitted and a communication channel through which audio data is transmitted, the user device 200 may distinguish between video data and audio data based on the communication channel.
  • the service communication unit 110 transmits an identifier for distinguishing a data type, for example, video data and audio data, together with the encoded video data and audio data.
  • a data type for example, video data and audio data
  • the user device 200 may distinguish video data from audio data by using an identifier included in the received data.
  • the identifier may be, for example, a flag that specifies video and audio, respectively.
  • the streaming control unit 120 is a configuration for controlling the cloud streaming service.
  • the streaming control unit 120 according to the service request of the user device 200 connected through the service communication unit 110, the user device to the encoded video data and audio data of the content requested by the user device 200 Send to 200.
  • the streaming controller 120 according to the present invention transmits the encoded video data and the audio data to the user device 200 in synchronization with each other, but does not transmit the encoded video data and the audio data before reproduction.
  • the encoded video data and audio data are sequentially transmitted in frame units according to the playback time of the user device 200.
  • the streaming control unit 120 transmits a video having a compression rate of 30 fps, after transmitting encoded video data and audio data corresponding to a specific frame, the encoded video data and audio of the next frame after 33 msec. Data can be transferred.
  • the streaming control unit 120 according to the present invention transmits the encoded bit stream as it is, without packetizing and multiplexing the encoded video data and the audio data.
  • the streaming control unit 120 may include an identifier for identifying data types in the encoded video data and the audio data so as to distinguish whether the data received from the user device 200 is video data or audio data.
  • the encoder 130 is a configuration for generating the encoded video data and audio data. That is, the encoder 130 encodes video data and audio data of the content requested by the user device 200 according to a predetermined compression protocol. In this case, compression methods of the video data and the audio data may be different from each other. In addition, the encoder 130 may perform encoding by receiving video data and audio data from at least one of the service storage 140, the real-time broadcast receiver 150, and the cloud computing processor 160. .
  • the service storage unit 140 is a component for storing data and programs necessary for the operation of the cloud streaming service apparatus 100 according to the present invention, and may store programs and data for service execution. More specifically, the service storage 140 may store content data to be serviced in the user device 100.
  • the content data may include video data and audio data before encoding, and in some cases, the content data may include encoded video data and audio data.
  • the cloud streaming service apparatus 100 may service the user device 200 with content broadcast in real time.
  • the real-time broadcast receiver 150 may receive content broadcast in real time from an external device, for example, a broadcast service device such as CATV or IPTV.
  • a broadcast service device such as CATV or IPTV.
  • the cloud streaming service is a service that transmits the output (video and audio) to the user device 200 after executing or playing the content requested by the user instead.
  • the cloud streaming service apparatus 100 may further include a cloud computing processor 160.
  • the cloud computing processor 160 executes or plays the content requested by the user device 300 on behalf of the user device 300, and then outputs video data and / or audio data accordingly. In this case, the cloud computing processor 160 executes or plays the content according to an input signal transmitted from the user device 300.
  • the corresponding content is executed by the cloud computing processor 160 and the video data and audio data output as a result of the execution are encoded by the encoder 130. After encoding through), it is transmitted to the user device 200 through the streaming control unit 120.
  • the corresponding content is received by the real time broadcast receiver 150, encoded through the encoder 130, and then the streaming control unit 120. Is transmitted to the user device 200 through.
  • the content requested by the user device 300 may include one or more different types of content.
  • it may include a real-time broadcast and chat application.
  • the cloud computing processor 160 may mix and output the output of one or more contents to the service storage 140.
  • the cloud streaming service apparatus 100 includes a service communication unit 100, a streaming control unit 120, an encoding unit 130, a service storage unit 140, a real time broadcast receiving unit 150, and a cloud.
  • a cloud streaming service Through interworking between two or more components of the computing processor 160, a cloud streaming service according to the present invention is provided.
  • FIG. 3 is a block diagram showing the configuration of the user device 200 according to the present invention.
  • the user device 200 may include a network receiver 210, a video decoder 220, and an audio decoder 230.
  • FIG. 3 discloses components required for a cloud streaming service according to the present invention in functional units.
  • the user apparatus 200 may include various components in addition to the above-described components, hardware, software, and It can be implemented in a combination of hardware and software.
  • the network receiver 210 is a configuration for receiving data by accessing the cloud streaming service apparatus 100 through the communication network 10.
  • the network receiver 210 receives the video data and the audio data encoded in units of frames from the cloud streaming service apparatus 100 in accordance with a playback time, and classifies the received encoded video data and the audio data.
  • the video decoding unit 220 transfers the data to the video decoding unit 220 and the audio decoding unit 230, respectively.
  • the network receiver 210 does not demultiplex the received data, but distinguishes whether the received data is video data or audio data, and transmits the received data to the video decoder 220 as it is or the audio decoder 230. To pass).
  • the network receiver 210 receives the encoded video data and the audio data through different channels, respectively, and distinguishes the encoded video data and the audio data through the received channel.
  • an identifier for identifying a data type may be further received, and the encoded video data and audio data may be distinguished using the received identifier.
  • the network receiver 210 includes a network buffer 211 that stores data received through the communication network 10.
  • the video decoding unit 220 and the audio decoding unit 230 are each configured to decode the encoded video data and the audio data according to a corresponding compression algorithm.
  • the video decoding unit 220 and the audio decoding unit 230 decode and output the video data and the audio data transmitted from the network receiving unit 210 as they are received without separate synchronization processing.
  • the encoded video data and the audio data received by the network receiver 210 are transmitted according to the playback time in units of frames, the video data does not need to be synchronized between the video decoder 220 and the audio decoder 230. Data and audio data are synchronized and can be output at the time of reproduction.
  • the video decoding unit 220 may include a feeder buffer 221 for storing encoded video data transmitted from the network receiver 210, a decoding buffer 222 for storing video data being decoded, and decoding. And an output buffer 223 for storing the encoded video data, and the audio decoding unit 230 includes a feeder buffer 231 for storing the encoded audio data transmitted from the network receiver 210, and the audio being decoded.
  • a decoding buffer 232 for storing data, and an output buffer 233 for storing the decoded audio data, and a PTS buffer for existing synchronization processing is not necessary.
  • the user device 200 accesses the cloud streaming service device 100 to request a service, and correspondingly, the cloud streaming service device 100 provides the requested content.
  • the cloud streaming service device 100 may adjust encoded video data and audio data of the requested content to a playback time in frame units, respectively. 200) (S105, S110).
  • the cloud streaming service apparatus 100 receives a real-time broadcast through the real-time broadcast receiver 150 to transmit the encoded video data and the audio data, and the cloud computing processor 160.
  • the processor may further execute or play the requested content, and mix the real-time broadcast and the execution screen of the content.
  • the cloud streaming service apparatus 100 encodes the video data and the audio data to be transmitted in the unit of frame through these processes and transmits them in accordance with the playback time of the user device 100. For example, when the compression rate of the video is 30 frames per second (fps), the cloud streaming service apparatus 100 may transmit video data and audio data encoded at a 33 msec period according to a playback time. In addition, the cloud streaming service device 100 preferably transmits in synchronization with the video data and audio data to be transmitted.
  • the video data and audio data are encoded in units of frames, and the respective encoded bit streams are transmitted as they are without multiplexing, and the user apparatus 200 transmits the video data and the audio data so that the video data and the audio data can be distinguished.
  • the cloud streaming service device 100 forms two communication channels CH1 and CH2 different from the user device 200, as shown in FIG.
  • Video data VD1 and VD2 and audio data AD1 and AD2 can be transmitted to channels CH1 and CH2, respectively.
  • VD1 and VD2 denote encoded video data in units of frames, respectively
  • AD1 and AD2 denote encoded audio data in units of frames.
  • the user device 200 recognizes the data received on the communication channel CH1 as encoded video data and transfers the data to the video decoding unit 220 as it is, and the data received on the communication channel CH2 recognizes the encoded audio data as it is. Transfer to the audio decoding unit 230.
  • the cloud streaming service device 100 forms a communication channel CH with the user device 200, and encoded through the communication channel CH
  • the video data VD1, VD2 and audio data AD1, AD2 can be transmitted alternately.
  • the encoded video data VD1 and VD2 and the audio data AD1 and AD2 further include an identifier C for distinguishing a data type.
  • the identifier C indicates whether the data is video data or audio data.
  • the identifier C is a value assigned to a specific bit, such as a flag bit, and may indicate whether video data or audio data according to the value of the bit.
  • the user device 200 that receives the encoded video data and the audio data receives the video data and the audio data encoded in units of frames from the cloud streaming service apparatus 100 in accordance with a playback time
  • the received video data is received.
  • the user device 200 decodes and outputs coded video data and audio data which are separately transmitted and received without having to perform demultiplexing processing or synchronization processing through header parsing.
  • the cloud streaming service apparatus 100 transmits the encoded video data and the audio data of the next frame after a T time in accordance with the playback time of each frame (S125 and S130), whereby the user device 200 is encoded.
  • the video data and the audio data are decoded as they are received and output (S135 and S140).
  • the steps S125 to S140 are the same as the steps S105 to S120 described above.
  • the transmission, decoding and output of the encoded video data and audio data are repeatedly executed in accordance with the reproduction period T.
  • the user device 200 can decode and output the encoded video data and the audio data as soon as they are received without demultiplexing processing and the synchronization process between the video data and the audio data, so that the time required for the demultiplexing process and the synchronization processing The waiting time can be further reduced.
  • the cloud streaming service method according to the present invention described above may be implemented in software form readable through various computer means and recorded in a computer readable recording medium.
  • the recording medium may include a program command, a data file, a data structure, etc. alone or in combination.
  • Program instructions recorded on the recording medium may be those specially designed and constructed for the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts.
  • the recording medium may be magnetic media such as hard disks, floppy disks and magnetic tapes, optical disks such as Compact Disk Read Only Memory (CD-ROM), digital video disks (DVD), Magnetic-Optical Media, such as floppy disks, and hardware devices specially configured to store and execute program instructions, such as ROM, random access memory (RAM), flash memory, and the like. do.
  • program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler.
  • Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.
  • the processor mounted in the cloud streaming service device 100 or the user device 200 according to the present invention may process a program command for executing the method according to the present invention.
  • this processor may be a single-threaded processor, and in other implementations, the processor may be a multithreaded processor.
  • the processor is capable of processing instructions stored on memory or storage devices.
  • the cloud streaming service apparatus 100 or the user apparatus 200 according to the present invention may be driven by a command that causes one or more processors to perform the functions and processes described above.
  • such instructions may include interpreted instructions, such as script instructions such as JavaScript or ECMAScript instructions, or executable instructions or other instructions stored on a computer readable medium.
  • the device according to the present invention may be implemented in a distributed manner over a network, such as a server farm, or may be implemented in a single computer device.
  • the specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or modified from the structures and structural equivalents disclosed herein. It may be implemented in computer software, firmware or hardware, including, or a combination of one or more of them. Implementations of the subject matter described herein relate to one or more computer program products, ie computer program instructions encoded on a program storage medium of tangible type for controlling or by the operation of an apparatus according to the invention. It may be implemented as the above module.
  • the computer readable medium may be a machine readable storage device, a machine readable storage substrate, a memory device, a composition of materials affecting a machine readable propagated signal, or a combination of one or more thereof.
  • a computer program (also known as a program, software, software application, script or code) mounted on an apparatus according to the invention and executing a method according to the invention is a programming comprising a compiled or interpreted language or a priori or procedural language. It can be written in any form of language, and can be deployed in any form, including stand-alone programs or modules, components, subroutines, or other units suitable for use in a computer environment. Computer programs do not necessarily correspond to files in the file system.
  • a program may be in a single file provided to the requested program, in multiple interactive files (eg, a file that stores one or more modules, subprograms, or parts of code), or part of a file that holds other programs or data. (Eg, one or more scripts stored in a markup language document).
  • the computer program may be deployed to run on a single computer or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.
  • Implementations of the subject matter described herein may include, for example, a backend component such as a data server, or include a middleware component such as, for example, an application server, or a web browser or graphical user, for example, where a user may interact with the implementation of the subject matter described herein. It can be implemented in a computing system that includes a front end component such as a client computer having an interface or any combination of one or more of such back end, middleware or front end components. The components of the system may be interconnected by any form or medium of digital data communication such as, for example, a communication network.
  • a client streaming service device transmits encoded video data and audio data of a content requested by a user device in synchronization, and sequentially encodes the encoded video data and audio data in units of frames in accordance with a playback time of the user device.
  • transmitting it is possible to immediately decode and output as soon as it is received at the user device without receiving the demultiplexing process and the synchronization between the video and audio signals.
  • the waiting time for the demultiplexing process and the synchronization process can be reduced. Excellent effect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention concerne un système de service de diffusion en continu de Cloud capable de décoder immédiatement des données sans une étape de démultiplexage pour les données vidéo et les données audio et une étape de synchronisation pour les données vidéo et les données audio de manière à réduire au minimum le temps de latence d'un service de diffusion en continu de Cloud ; un dispositif à cet effet ; et un procédé de service de diffusion en continu de Cloud. La présente invention est mise en oeuvre de telle sorte que : un dispositif de service de Cloud émet des données vidéo et des données audio codées d'un contenu demandé dans un dispositif d'utilisateur en ajustant la synchronisation des données. Les données sont transmises séquentiellement dans des unités de trame conformément à un temps de reproduction dans le dispositif d'utilisateur. Le dispositif d'utilisateur reçoit respectivement les données vidéo et les données audio codées dans les unités de trame de la part du dispositif de service de diffusion en continu de Cloud conformément au temps de reproduction et décode et puis délivre en sortie les données vidéo et les données audio codées conformément à un ordre de réception.
PCT/KR2015/001920 2014-02-27 2015-02-27 Système de service de diffusion en continu de cloud, dispositif à cet effet, et procédé de service de diffusion en continu de cloud WO2015130126A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020140023622A KR101671311B1 (ko) 2014-02-27 2014-02-27 클라우드 스트리밍 서비스 시스템, 이를 위한 장치 및 클라우드 스트리밍 서비스 방법
KR10-2014-0023622 2014-02-27

Publications (1)

Publication Number Publication Date
WO2015130126A1 true WO2015130126A1 (fr) 2015-09-03

Family

ID=54009371

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/001920 WO2015130126A1 (fr) 2014-02-27 2015-02-27 Système de service de diffusion en continu de cloud, dispositif à cet effet, et procédé de service de diffusion en continu de cloud

Country Status (2)

Country Link
KR (1) KR101671311B1 (fr)
WO (1) WO2015130126A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114245170A (zh) * 2022-02-24 2022-03-25 国能信息技术有限公司 一种基于分流式传输的音视频单向传输调度方法及系统

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11161038B2 (en) * 2018-08-06 2021-11-02 Amazon Technologies, Inc. Systems and devices for controlling network applications

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110118292A (ko) * 2010-04-23 2011-10-31 (주)필링크 클라우드 컴퓨팅 및 스마트폰 제어를 통한 티브이 서비스 제공시스템
KR20120033450A (ko) * 2010-09-30 2012-04-09 에스케이플래닛 주식회사 단말기에 따른 적응적 화면 가상화 방법 및 시스템
KR20120082434A (ko) * 2009-09-29 2012-07-23 네트 파워 앤드 라이트 인코포레이티드 짧은 대기 시간의 전송 프로토콜을 위한 방법 및 시스템
KR101290977B1 (ko) * 2012-01-26 2013-07-30 한국외국어대학교 연구산학협력단 푸쉬 서버를 이용한 메시지 전송 방법 및 그 시스템

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0735776B1 (fr) * 1995-03-29 2004-01-28 Hitachi, Ltd. Décodeur pour des données vidéo et audio comprimées et multiplexées
JP2001309310A (ja) * 2000-04-26 2001-11-02 Matsushita Electric Ind Co Ltd マルチメディアデータ再生装置、マルチメディアデータ再生方法及び記録媒体

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120082434A (ko) * 2009-09-29 2012-07-23 네트 파워 앤드 라이트 인코포레이티드 짧은 대기 시간의 전송 프로토콜을 위한 방법 및 시스템
KR20110118292A (ko) * 2010-04-23 2011-10-31 (주)필링크 클라우드 컴퓨팅 및 스마트폰 제어를 통한 티브이 서비스 제공시스템
KR20120033450A (ko) * 2010-09-30 2012-04-09 에스케이플래닛 주식회사 단말기에 따른 적응적 화면 가상화 방법 및 시스템
KR101290977B1 (ko) * 2012-01-26 2013-07-30 한국외국어대학교 연구산학협력단 푸쉬 서버를 이용한 메시지 전송 방법 및 그 시스템

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
KANG, SEUNG SU ET AL.: "Reduction of Presentation Latency in Thin-Client of Cloud System", JOURNAL OF KOREA INFORMATION PROCESSING SOCIETY/COMPUTER AND COMMUNICATION SYSTEM, vol. 2, no. 4, April 2013 (2013-04-01), pages 2287-5891, XP055219894 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114245170A (zh) * 2022-02-24 2022-03-25 国能信息技术有限公司 一种基于分流式传输的音视频单向传输调度方法及系统
CN114245170B (zh) * 2022-02-24 2022-09-13 国能信息技术有限公司 一种基于分流式传输的音视频单向传输调度方法及系统

Also Published As

Publication number Publication date
KR20150101838A (ko) 2015-09-04
KR101671311B1 (ko) 2016-11-01

Similar Documents

Publication Publication Date Title
WO2012047004A2 (fr) Procédé de transmission d'un flux de données http échelonnable pour une reproduction naturelle lors de l'occurrence d'une commutation d'expression durant le flux de données http
WO2013077525A1 (fr) Procédé de commande et dispositif utilisant ce procédé
WO2011115424A2 (fr) Système de sortie de contenu et procédé de partage d'informations de codec dans le même système
WO2011142569A2 (fr) Procédé et appareil d'émission et de réception d'une vidéo codée en couches
WO2012125001A2 (fr) Procédé et appareil de configuration de contenu dans un système de radiodiffusion
WO2013077524A1 (fr) Procédé d'affichage d'interface utilisateur et dispositif l'utilisant
WO2018169255A1 (fr) Appareil électronique, et procédé de commande associé
WO2012106898A1 (fr) Procédé, dispositif et système pour la transmission et le traitement d'audio-vidéo multicanal
JP2008085515A5 (fr)
WO2011037406A2 (fr) Procédé et système pour une communication sans fil de données audio dans des réseaux sans fil
US20100198981A1 (en) Method and system for multimedia audio video transfer
CN101710997A (zh) 基于mpeg-2系统实现视、音频同步的方法及系统
WO2016129966A1 (fr) Support et dispositif d'enregistrement sur lesquels sont enregistrés un programme pour fournir un contenu de diffusion en direct à faible latence
WO2011111987A2 (fr) Appareil et procédé pour lire des données de contenu multimédia
WO2012030120A2 (fr) Procédés de transmission et de réception d'un fichier d'informations multimédias pour la lecture en continu selon le protocole http
WO2012039576A2 (fr) Procédé de traitement destiné à être mis en oeuvre en présence d'un commutateur d'expression au cours d'une transmission http en continu
WO2012068940A1 (fr) Procédé de surveillance d'un terminal via un réseau ip et un mcu
WO2019225788A1 (fr) Procédé et système de transmission et de lecture de vidéo à débit binaire dynamique en utilisant une pluralité de canaux
WO2015130126A1 (fr) Système de service de diffusion en continu de cloud, dispositif à cet effet, et procédé de service de diffusion en continu de cloud
WO2016003244A1 (fr) Procédé et dispositif pour recevoir des paquets multimédias dans un système multimédia
CN103957445A (zh) 一种基于应用虚拟化技术的视频重定向系统及方法
WO2018021616A1 (fr) Procédé de fonctionnement de client pour service de diffusion en continu
WO2015105376A1 (fr) Procédés et appareil d'alignement de minutage universel de présentation
WO2013154364A1 (fr) Procédé de restitution de diffusion en continu, et appareil informatique mettant en œuvre ce procédé
WO2019050067A1 (fr) Réglage de qualité vidéo

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15754987

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15754987

Country of ref document: EP

Kind code of ref document: A1