WO2017092434A1 - 音视频实时传输方法及装置、音视频实时播放方法及装置 - Google Patents

音视频实时传输方法及装置、音视频实时播放方法及装置 Download PDF

Info

Publication number
WO2017092434A1
WO2017092434A1 PCT/CN2016/096990 CN2016096990W WO2017092434A1 WO 2017092434 A1 WO2017092434 A1 WO 2017092434A1 CN 2016096990 W CN2016096990 W CN 2016096990W WO 2017092434 A1 WO2017092434 A1 WO 2017092434A1
Authority
WO
WIPO (PCT)
Prior art keywords
program
audio
video
slice
specific information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/096990
Other languages
English (en)
French (fr)
Inventor
郑吉剑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd filed Critical Le Holdings Beijing Co Ltd
Publication of WO2017092434A1 publication Critical patent/WO2017092434A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40—Network security protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • H04L63/0435—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply symmetric encryption, i.e. same key used for encryption and decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
    • H04N21/23476—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption by partially encrypting, e.g. encrypting the ending portion of a movie
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams

Definitions

  • the embodiments of the present invention relate to the field of audio and video technologies, and in particular, to a method and device for real-time transmission of audio and video, and a method and device for playing audio and video in real time.
  • the HLS (HTTP Live Streaming) protocol is an extended HTTP protocol developed by Apple Inc. for use in live webcast and on-demand scenarios.
  • the protocol encapsulates data using a Transport Stream (TS).
  • TS Transport Stream
  • Each transport stream carries data information such as video (Video), audio (Audio), and the like, and carries flow index information such as a Program Association Table (PAT) and a Program Map Table (PMT).
  • PAT Program Association Table
  • PMT Program Map Table
  • the HLS protocol supports encrypting the slice of the transport stream.
  • the encryption scheme is to encrypt each slice. Therefore, the operation amount of the encryption method is large, and the calculation amount of the receiving end when decrypting is corresponding. Increase. Therefore, the prior art encryption scheme requires either a separate hardware encryption and decryption device support or a strong processing capability of the CPU if the quality of the transmission is to be guaranteed.
  • the embodiment of the present invention provides a method and a device for real-time transmission of audio and video, a method and a device for playing audio and video in real time, which are used to solve the technical problem of excessive computation of encryption and decryption in the prior art.
  • the embodiment of the present application provides a real-time audio and video transmission method, including:
  • the encrypting the program specific information includes encrypting the program association table and the program map.
  • the method further includes:
  • the method further includes:
  • the application also provides a real-time audio and video playback method, including:
  • the program slice is downloaded, and the program slice is parsed based on the decrypted program specific information.
  • the encrypted program specific information slice includes an encrypted program association table and an encrypted program mapping table.
  • the decrypting the encrypted program specific information slice comprises: decrypting the encrypted program association table and the encrypted program mapping table.
  • the application provides an audio and video real-time transmission device, including:
  • An encryption module configured to encrypt program specific information and store the slice as program specific information
  • a multiplexer configured to multiplex the video original stream of the packet and the audio original stream of the packet into a program slice
  • a transmission module configured to transmit the program specific information and the program slice.
  • the encrypting the program specific information includes encrypting the program association table and the program map.
  • a video packetizer and an audio packetizer are also included:
  • the video packetizer configured to package the video original stream into a grouped video original stream
  • the audio packetizer is configured to package the audio original stream into a packetized audio original stream.
  • the video encoder configured to encode video data to form the video original stream
  • the audio encoder is configured to encode audio data to form the audio original stream.
  • the application provides an audio and video real-time playing device, including:
  • a first downloading module configured to download the encrypted program specific information slice
  • a decryption module configured to decrypt the encrypted program specific information slice to obtain decrypted program specific information
  • a second downloading module configured to download a program slice, and parse the program slice according to the decrypted program specific information.
  • the encrypted program specific information slice includes an encrypted program association table and an encrypted program mapping table.
  • the decryption module is further configured to decrypt the encrypted program association table and the encrypted program mapping table.
  • the embodiment of the present application provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium can store a computer program, and the program can implement the above-mentioned audio and video real-time transmission method when executed. Some or all of the steps.
  • the embodiment of the present application provides a non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium can store a computer program, and when the program is executed, the audio and video real-time playing method can be implemented. Some or all of the steps.
  • An embodiment of the present application further provides an electronic device, including: one or more processors; and a memory; wherein the memory stores instructions executable by the one or more processors, the instructions being The one or more processors are executed to enable the one or more processors to perform the above-described audio and video real-time transmission method of the present application.
  • An embodiment of the present application further provides an electronic device, including: one or more processors; and a memory; wherein the memory stores instructions executable by the one or more processors, the instructions being The one or more processors are executed to enable the one or more processors to perform the above-described audio and video real-time playback method of the present application.
  • An embodiment of the present application provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, The computer is caused to perform the above-mentioned audio and video real-time transmission method in the embodiment of the present application.
  • An embodiment of the present application provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, The computer is caused to perform the above-mentioned audio and video real-time playing method in the embodiment of the present application.
  • the audio and video real-time transmission method and device provided by the embodiments of the present application, the audio and video real-time playing method and device do not need to encrypt and decrypt each slice, and can simultaneously reduce the encryption operation amount of the transmission end and reduce the decryption operation amount of the receiving end. .
  • FIG. 1 is a schematic diagram of a format of a slice of a transport stream in the prior art
  • FIG. 2 is a schematic diagram of a format of a program slice of an audio and video real-time transmission method according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of a format of a program specific information slice according to an audio and video real-time transmission method according to an embodiment of the present application
  • FIG. 4 is a schematic structural diagram of a packet of a slice of a real-time audio and video transmission method according to an embodiment of the present application
  • FIG. 5 is a flowchart of a method for real-time transmission of audio and video according to an embodiment of the present application
  • FIG. 6 is a flowchart of a method for real-time playing audio and video according to an embodiment of the present application
  • FIG. 7 is a schematic structural diagram of an audio and video real-time transmission apparatus according to an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an audio and video real-time playing device according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of hardware of a device for real-time audio and video transmission according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of hardware of a device for playing audio and video in real time according to an embodiment of the present disclosure.
  • the present application will first introduce the format of the slice of the transport stream in the prior art.
  • FIG. 1 is a schematic diagram of a format of a slice of a transport stream in the prior art.
  • the transport stream is a hierarchical encapsulation format, and the program association table needs to be first found to obtain the number of program map tables in the transport stream, thereby obtaining the number of programs in the transport stream, where each program map corresponds to one program, and then A video packet identifier (PID) and an audio packet identifier of the program are obtained according to the program map.
  • PID video packet identifier
  • audio packet identifier of the program are obtained according to the program map.
  • the slice of the transport stream is used to facilitate the user to receive the transport stream at any time and ensure that the audio and video data in the slice is not pirated, and the transmission end periodically inserts the program association table and the program map into the transport stream.
  • the slice and encrypting each slice; thus causing the slice of the transport stream in the prior art to include at least two encrypted program association tables and a program map table, and the receiving end also needs to receive the slice after receiving All program association tables and program map tables in each slice are decrypted.
  • a program is cut into n slices, user A can receive from the program association table 1, and user B can receive from the program association table n to find the program map in the vicinity, thereby facilitating live broadcast;
  • the program encrypts the program association tables 1 to n and the program maps 1 to n in the transmission process, so the receiving end also needs to decrypt the received program association tables 1 to n and the program maps 1 to n. . Therefore, the prior art greatly increases redundant data in the transport stream.
  • FIG. 2 is a schematic diagram of a format of a program slice of an audio and video real-time transmission method according to an embodiment of the present application.
  • the transport stream in the embodiment of the present application is a packet-based stream, and each group of transport streams is divided into a plurality of slices. It should be noted that only one slice format is shown in FIG. 3, and the format of other slices is actually The slice format in Figure 2 is similar.
  • the program slice in the embodiment of the present application includes a packet 1, a packet 2, a packet n-1, and a packet n, and each of the program slices does not include a program association table and a program mapping table.
  • FIG. 3 is a schematic diagram of a format of a program specific information slice according to an audio and video real-time transmission method according to an embodiment of the present application.
  • the program specific information slice in this embodiment includes only two program specific information including an encrypted program association table and a program map, and does not include video data and audio data.
  • the program specific information slice can be stored as a file with the file name init.ts.
  • FIG. 4 is a schematic structural diagram of a packet of a slice of a real-time audio and video transmission method according to an embodiment of the present application.
  • the slice shown in this embodiment may be a program specific information slice or a program slice, and each slice includes a header and data, and each packet is 188 bytes or 204 bytes, of which 204 bytes are The packet is formed by adding 16 bytes of CRC check data after the 188-byte packet.
  • the header can also include an extended self-use area, with a header length of 4 bytes, and a total of 184 bytes from the usage area and packet data.
  • the packet header consists of a sync byte, a transmission error indicator, a payload unit start indicator, a transmission priority, a packet identifier, a transmission scrambling control, an adaptive zone control, and a continuous counter.
  • the packet correlation in the data stream can be detected by the automatic correlation feature of the bit string of the synchronization byte, and the packet synchronization can be established.
  • the error correction decoder can be used. Indicates a 1-bit error, but cannot correct the error; the payload unit start indicator indicates whether the packet has a determined start message; the transmission priority is used to assign a priority to the packet; the packet identifier value is determined by the user Determining, the decoder distinguishes different original stream (ES) packets according to the packet identifier to reconstruct the original stream; the transmission scrambling control can be used to indicate whether the packet content is scrambled; the adaptive area control is used to indicate that there is No adaptive zone, usually represented by 2 bits, for example, "01" means useful information, but no adaptive zone, "10” means no useful information, and there is adaptive zone, "11” means useful information and adaptive Area, "00” means no definition; the continuous counter can count the transmission order of the packet identifier. According to the reading
  • the packet identifier is a unique identifier in the transport stream, and the data content in the packet is determined by the packet identifier. If the packet identifier in the header of a packet in a transport stream is 0, then the data content of the packet is the program association table. If it is not 0, it is video data, audio data, program map, or other type of data.
  • FIG. 5 is a flowchart of a method for real-time transmission of audio and video according to an embodiment of the present application.
  • the real-time transmission of audio and video includes real-time transmission of video data and real-time transmission of audio data, so the original video stream and the audio original stream need to be packaged into a packetized video original stream and a packetized audio original stream, respectively;
  • the original stream, and the audio original stream of the packet are multiplexed and stored as a program slice; in addition, the embodiment needs to encrypt and package the program association table and the program mapping table separately, as follows:
  • S101 Encoding the video data to form an elementary stream (ES);
  • the video original stream is the original base stream output by the encoder, containing only the information necessary for the decoder and close to the original image.
  • the encoded original video stream may be in the MPEG-2 or MPEG-4 format, and may also be in the H.264 format or other formats, which is not limited in this application.
  • S102 Packet the video original stream into a packetized video elementary stream (PES);
  • PES packetized video elementary stream
  • the packetized video original stream exists in the form of a divided data packet, mainly by adding a time stamp to the video original stream, such as a description of the data frame, and the packetized video original stream provides a standard header and packing method, and provides decoding. Time sign.
  • the audio coding method in this step may be MPEG-1 audio coding, or may be edited by MPEG-2 AAC (Advanced Audio Coding).
  • the code is not limited in this application.
  • the audio packetizer 202 divides the audio original stream into segments or packs them into groups, and adds the corresponding header files to form a packet's original audio stream.
  • the packets of the original audio stream and the packets may be discontinuous.
  • S300 The grouped video original stream and the grouped audio original stream are multiplexed and stored as a program slice.
  • S400 is a package of program specific information slices, specifically: encrypting program specific information, and storing it as a program specific information slice. Encrypting the program specific information includes encrypting the program association table and the program map.
  • step S500 the program specific information and the program slice are transmitted.
  • FIG. 6 is a flowchart of a method for real-time playing audio and video according to an embodiment of the present application.
  • S301 Download the encrypted program specific information slice; the encrypted program specific information slice includes the encrypted program association table and the encrypted program mapping table.
  • decrypting the encrypted program specific information slice includes: decrypting the encrypted program association table and the encrypted program mapping table.
  • the program association table is parsed to obtain the package identifier of the program map.
  • the program association table with the packet identifier of 0 is first parsed to obtain the package identifier of the program map.
  • the program map table is searched according to the packet identifier of the mapping table; in the present embodiment, the number of program map tables is equal to the number of programs.
  • the packet identifier of the search video data and the packet identifier of the audio data are used to obtain video data and audio data.
  • the video data and the audio data are parsed according to the packet identifier of the video data and the packet identifier of the audio data.
  • the receiving end is usually a consumer electronic product, which can be a smart TV, a set top box, a projector, a video player, a personal computer, a smart phone, a tablet computer, and the like.
  • FIG. 7 is a schematic structural diagram of an audio and video real-time transmission apparatus according to an embodiment of the present application.
  • the audio-video real-time transmission apparatus 10 of the embodiment of the present application includes a video encoder 101, an audio encoder 201, a video packetizer 102, an audio packetizer 202, a multiplexer 300, an encryption module 400, and a transmission module 500.
  • the collected video data and audio data are analog data
  • sampling, quantization and compression coding are required to form a video original stream and an audio original stream
  • the video original stream and the audio original stream are continuous streams that are not segmented.
  • Video encoder 101 is operative to encode the video data into a video original stream.
  • the video original stream includes a plurality of access units, each of which is encoded data of an image.
  • the video coding method of the present application may be performed by using transform coding, entropy coding, motion estimation, motion compensation, or hybrid coding, which is not limited in this application.
  • the audio encoder 201 is for encoding the audio data separately to form an audio original stream.
  • the digital audio signal if the digital audio signal is directly transmitted without compression, it will occupy a large bandwidth. Therefore, it is necessary to use audio compression technology to process the audio data in order to effectively transmit the audio data.
  • the digital audio compression coding compresses the audio data signal as much as possible while ensuring that the signal does not cause distortion in the sense of hearing.
  • Digital audio compression coding is implemented by removing redundant components in the sound signal.
  • the audio coding method of the present application may be Waveform coding, parameter coding, or hybrid coding, which is not limited in this application.
  • Video packetizer 102 is used to packet the video original stream into a packetized video original stream.
  • the video packetizer 102 divides the video original stream into segments or packs them into groups, and adds corresponding header files to form a packetized video original stream.
  • the packets of the original video stream and the packets may be discontinuous. of.
  • the audio packetizer 202 is used to pack the audio original stream into a packetized audio original stream.
  • the audio packetizer 202 divides the audio original stream into segments or packs them into groups, and adds corresponding header files to form a grouped audio original stream.
  • the packets of the audio original stream and the packets may be discontinuous. of.
  • the multiplexer 300 is configured to multiplex the video original stream of the packet and the audio original stream of the packet into a program slice, and transmit the program specific information and the program slice.
  • the multiplexer 300 packs the program association table, the program map table, the packetized video original stream, and the packetized audio original stream into slices of a fixed length of 188 bytes at the time of transmission.
  • the encryption module 400 is configured to encrypt program specific information and store it as a program specific information slice.
  • the program specific information is encrypted, including encrypting the program association table and the program map.
  • the transmission module 500 is configured to transmit program specific information and program slices.
  • the above-mentioned audio and video real-time transmission device 100 provided by the embodiment of the present invention can be specifically applied to an electronic device in an actual application, and the related function module can be implemented by a hardware processor, which is usually a video server of various types.
  • FIG. 8 is a schematic structural diagram of an audio and video real-time playing device according to an embodiment of the present application.
  • the audio and video real-time playing device 400 of the embodiment of the present application includes a first downloading module 401, a decrypting module 402, and a second downloading module 403.
  • the first downloading module 401 is configured to download the encrypted program specific information slice; the encrypted program specific information
  • the slice includes an encrypted program association table and an encrypted program map.
  • the decryption module 402 is configured to decrypt the encrypted program specific information slice to obtain the decrypted program specific information; since the encrypted program specific information slice includes the encrypted program association table and the encrypted program mapping table, the decryption module 402 further It is used to decrypt the encrypted program association table and the encrypted program mapping table.
  • the second downloading module 403 is configured to download a program slice and parse the program slice according to the decrypted program specific information.
  • the foregoing technical solution of the embodiment of the present application does not need to periodically insert a program association table and a program mapping table, but only needs to separately package and encrypt the program association table and the program mapping table, so as to maintain the existing technology.
  • the transport stream in the middle is compatible, and at the same time reduces the effect of redundant data in the transport stream.
  • the embodiment of the present application further provides a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium can store a program, and when executed, the program can implement an audio and video provided by any one of the foregoing embodiments.
  • the embodiment of the present application further provides a non-transitory computer readable storage medium, where the non-transitory computer readable storage medium can store a program, and when executed, the program can implement an audio and video provided by any one of the foregoing embodiments.
  • FIG. 9 is a schematic diagram showing the hardware structure of an electronic device for real-time transmission of audio and video according to an embodiment of the present application. As shown in FIG. 9, the device includes:
  • processors 910 and memory 920 one processor 910 is taken as an example in FIG.
  • the apparatus for performing the audio-video real-time transmission method may further include: an input device 930 and an output device 940.
  • the processor 910, the memory 920, the input device 930, and the output device 940 may be connected by a bus or other means, as exemplified by a bus connection in FIG.
  • the memory 920 is a non-transitory computer readable storage medium and can be used to store non-volatile software programs.
  • the program, the non-volatile computer executable program and the module such as the program instruction/module corresponding to the audio and video real-time transmission method in the embodiment of the present application.
  • the processor 910 executes various functional applications and data processing of the electronic device by executing non-volatile software programs, instructions, and modules stored in the memory 920, that is, realizing the audio and video real-time transmission method of the above method embodiments.
  • the memory 920 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to use of the audio-visual real-time transmission device, and the like.
  • memory 920 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 920 can optionally include memory remotely located relative to processor 910, which can be connected to the audio and video real-time transmission device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 930 can receive input numeric or character information and generate key signal inputs related to user settings and function control of the audio and video real time transmission device.
  • Output device 940 can include a display device such as a display screen.
  • the one or more modules are stored in the memory 920, and when executed by the one or more processors 910, perform an audio and video real-time transmission method in any of the above method embodiments.
  • FIG. 10 is a schematic diagram showing the hardware structure of an electronic device for playing audio and video in real time according to an embodiment of the present invention. As shown in FIG. 10, the device includes:
  • processors 1010 and a memory 1020 are illustrated by one processor 1010 in FIG.
  • the apparatus for performing the audio and video real time playing method may further include: an input device 1030 and an output device 1040.
  • the processor 1010, the memory 1020, the input device 1030, and the output device 1040 may be connected by a bus or other means, as exemplified by a bus connection in FIG.
  • the memory 1020 is used as a non-transitory computer readable storage medium, and can be used for storing a non-volatile software program, a non-volatile computer executable program, and a module, such as a program corresponding to the audio and video real-time playing method in the embodiment of the present application. Instruction/module.
  • the processor 1010 runs the non-volatile software stored in the memory 1020 The program, the instruction, and the module, thereby performing various functions and applications of the server and data processing, that is, realizing the audio and video real-time playing method of the foregoing method embodiment.
  • the memory 1020 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to use of the audio-visual real-time playback device, and the like.
  • memory 1020 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 1020 can optionally include memory remotely located relative to processor 1010 that can be connected to an audiovisual real-time playback device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the input device 1030 can receive input numeric or character information and generate key signal inputs related to user settings and function control of the audio and video real time playback device.
  • the output device 1040 can include a display device such as a display screen.
  • the one or more modules are stored in the memory 1020, and when executed by the one or more processors 1010, perform an audio and video real-time playback method in any of the above method embodiments.
  • the electronic device of the embodiment of the invention exists in various forms, including but not limited to:
  • Mobile communication devices These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication.
  • Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
  • Ultra-mobile personal computer equipment This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access.
  • Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.
  • Portable entertainment devices These devices can display and play multimedia content. Such devices include: audio, preview players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.
  • the composition of the server includes a processor, a hard disk, a memory, and a system.
  • the bus, etc. is similar to a general-purpose computer architecture, but requires high processing power, stability, reliability, security, scalability, manageability, and the like.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种音视频实时传输方法，包括：将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；对节目特定信息进行加密，并存储为节目特定信息切片；传输所述节目特定信息及所述节目切片。一种音视频实时传输方法、音视频实时播放方法及装置。可以减少现有技术中加密及解密的运算量。

Description

音视频实时传输方法及装置、音视频实时播放方法及装置
本申请要求于2015年12月3日提交中国专利局、申请号为2015108860246、发明名称为“音视频实时传输方法及装置、音视频实时播放方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及音视频技术领域，尤其涉及一种音视频实时传输方法及装置、音视频实时播放方法及装置。
背景技术
HLS(HTTP Live Streaming)协议是苹果公司研发出的，用在网络直播和点播场景中的扩展HTTP协议，该协议使用传输流(Transport Stream，TS)的方式封装数据。每个传输流都携带视频(Video)、音频(Audio)等数据信息，以及携带节目关联表(Program Association Table，PAT)、节目映射表(Program Map Table，PMT)等流索引信息。
HLS协议中支持对传输流的切片进行加密，现有技术中的加密方案是对每个切片都要进行加密，因此该加密方式的运算量较大，接收端在解密时运算量也会相应的增大。因而，现有技术的加密方案，如果要保证传输的质量，要么需要单独的硬件加解密器件支持，要么要求CPU有较强的处理能力。
发明内容
本申请实施例提供一种音视频实时传输方法及装置、音视频实时播放方法及装置，用以解决现有技术中加密及解密的运算量过大的技术问题。
本申请实施例提供一种音视频实时传输方法，包括：
将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；
对节目特定信息进行加密，并存储为节目特定信息切片；
传输所述节目特定信息及所述节目切片。
进一步的，所述对节目特定信息进行加密包括对节目关联表和节目映射表加密。
进一步的，所述将分组的视频原始流以及分组的音频原始流复用后存储为节目切片的步骤之前还包括：
将视频原始流及音频原始流分别打包为分组的视频原始流和分组的音频原始流的步骤。
进一步的，所述将视频原始流及音频原始流分别打包为分组的视频原始流和分组的音频原始流的步骤之前还包括：
将视频数据及视频数据分别编码及形成所述视频原始流及所述音频原始流的步骤。
本申请还提供一种音视频实时播放方法，包括：
下载加密后的节目特定信息切片；
解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；
下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。
进一步的，所述加密后的节目特定信息切片包括加密后的节目关联表及加密后的节目映射表。
进一步的，所述解密所述加密后的节目特定信息切片包括：解密所述加密后的节目关联表及加密后的节目映射表。
本申请提供一种音视频实时传输装置，包括：
加密模块，用于对节目特定信息进行加密，并存储为节目特定信息切片；
复用器，用于将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；
传输模块，用于传输所述节目特定信息及所述节目切片。
进一步的，所述对节目特定信息进行加密包括对节目关联表和节目映射表加密。
进一步的，还包括视频分组器及音频分组器：
所述视频分组器，用于将视频原始流打包为分组的视频原始流；
所述音频分组器，用于将音频原始流打包为分组的音频原始流。
进一步的，还包括视频编码器和音频编码器：
所述视频编码器，用于将视频数据编码形成所述视频原始流；
所述音频编码器，用于将音频数据编码形成所述音频原始流。
本申请提供一种音视频实时播放装置，包括：
第一下载模块，用于下载加密后的节目特定信息切片；
解密模块，用于解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；
第二下载模块，用于下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。
进一步的，所述加密后的节目特定信息切片包括加密后的节目关联表及加密后的节目映射表。
进一步的，所述解密模块还用于解密所述加密后的节目关联表及加密后的节目映射表。
本申请实施例提供了一种非暂态计算机可读存储介质，其中，该非暂态计算机可读存储介质可存储有计算机程序，该程序执行时可实现上述的一种音视频实时传输方法的部分或全部步骤。
本申请实施例提供了一种非暂态计算机可读存储介质，其中，该非暂态计算机可读存储介质可存储有计算机程序，该程序执行时可实现上述的一种音视频实时播放方法的部分或全部步骤。
本申请实施例还提供了一种电子设备，包括：一个或多个处理器；以及，存储器；其中，所述存储器存储有可被所述一个或多个处理器执行的指令，所述指令被所述一个或多个处理器执行，以使所述一个或多个处理器能够执行本申请上述音视频实时传输方法。
本申请实施例还提供了一种电子设备，包括：一个或多个处理器；以及，存储器；其中，所述存储器存储有可被所述一个或多个处理器执行的指令，所述指令被所述一个或多个处理器执行，以使所述一个或多个处理器能够执行本申请上述音视频实时播放方法。
本申请实施例提供一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行本申请实施例上述音视频实时传输方法。
本申请实施例提供一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行本申请实施例上述音视频实时播放方法。
本申请实施例提供的音视频实时传输方法及装置、音视频实时播放方法及装置，不需要对每个切片都进行加密及解密，可以同时减少传输端的加密运算量，及减少接收端的解密运算量。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为现有技术中传输流的切片的格式示意图；
图2为本申请实施例一种音视频实时传输方法的节目切片的格式示意图；
图3为本申请实施例一种音视频实时传输方法的节目特定信息切片的格式示意图；
图4为本申请实施例一种音视频实时传输方法的切片的包的构成示意；
图5为本申请实施例一种音视频实时传输方法的流程图；
图6为本申请实施例一种音视频实时播放方法的流程图；
图7为本申请实施例一种音视频实时传输装置的结构示意图；
图8为本申请实施例一种音视频实时播放装置的结构示意图；
图9为本申请实施例提供的音视频实时传输方法的设备的硬件结构示意图；
图10为本申请实施例提供的音视频实时播放方法的设备的硬件结构示意图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
为更好的说明本申请实施例的技术方案及其所产生的有益效果，本申请将首先介绍现有技术中传输流的切片的格式。
图1为现有技术中传输流的切片的格式示意图。
传输流为层次型的封装格式，需要先找到节目关联表，以获取传输流中节目映射表的数量，以此获得传输流中节目的数量，其中每一张节目映射表对应一个节目，然后再根据节目映射表获取节目的视频包标示符(Packet Identification，PID)和音频包标示符。
根据HLS协议的规定，一个长时间的节目通常被切割分成多个时长为10秒的切片。因此，现有技术中传输流的切片，为了方便用户随时接收传输流并保证切片中的音视频数据不被盗播，传输端是周期性的将节目关联表和节目映射表插入到传输流的切片中，并且对每一个切片都进行加密；从而导致现有技术中的传输流的切片包括至少两张以上加密过的节目关联表和节目映射表，接收端在接收在接收到切片后同样需要对每一个切片中的所有节目关联表及节目映射表进行解密。
例如，图1中，一个节目被切割为n个切片，用户A可以从节目关联表1处接收，用户B可以从节目关联表n处接收，以就近找到节目映射表，从而方便直播；由于传输端在传输过程中对节目关联表1至n以及节目映射表1至n均进行了加密，因此接收端在接收到加密的节目关联表1至n以及节目映射表1至n也都需要进行解密。因此，现有技术极大的增加了传输流中的冗余数据。
本申请的发明人在经过长时间研究后发现在每一个切片中，并不需要周期性的插入节目关联表和节目映射表，而仅需要把节目关联表和节目映射表单独打包并加密，就可以达到既可保持与现有技术中的传输流兼容，又同时减少传输流中的冗余数据的效果。
以下将对本申请传输流的切片的格式进行说明。
图2为本申请实施例一种音视频实时传输方法的节目切片的格式示意图。
本申请实施例中的传输流是一种基于包的流，每一组传输流被分割为若干个切片，需要说明的是图3中仅示出了一个切片的格式，其它切片的格式其实与图2中的切片格式类似。
本申请实施例中的节目切片包括包1、包2……包n-1、包n，而且每个节目切片均不包括节目关联表和节目映射表。
图3为本申请实施例一种音视频实时传输方法的节目特定信息切片的格式示意图。
本实施例中的节目特定信息切片只包括有加密后的节目关联表和节目映射表这两个节目特定信息，而不包含视频数据和音频数据。节目特定信息切片可以将其存储为文件名为init.ts的文件。
图4为本申请实施例一种音视频实时传输方法的切片的包的构成示意图。
本实施例中所示出的切片可以是节目特定信息切片也可以是节目切片，每个切片均包括包头和数据，每个包是188个字节或204个字节，其中204个字节的包是在188个字节的包之后加上了16字节的CRC校验数据形成。
包头还可以包括扩展的自使用区，包头长度占4个字节，自使用区和包数据共占184个字节。包头包括同步字节、传输误码指示符、有效载荷单元起始指示符、传输优先、包识别符、传输加扰控制、自适应区控制和连续计数器8个部分组成。
其中，可以通过同步字节的位串的自动相关特性，检测数据流中的包限制，建立包同步；传输误码指示符，是指有不能消除的误码时，采用误码校正解码器可表示1位的误码，但无法校正该误码；有效载荷单元起始指示符，表示该包是否存在确定的起始信息；传输优先用于是给包分配优先权；包标示符值是由用户确定的，由解码器根据包标示符区别不同原始流(Elementary Stream，ES)的包，以重建原始流；传输加扰控制可用于指示包内容是否加扰；自适应区控制是用于表示有否自适应区，通常用2位来表示，比如“01”表示有用信息，但是无自适应区，“10”表示无有用信息，且有自适应区，“11”表示有用信息且有自适应区，“00”表示无定义；连续计数器可对包标示符传送顺序计数，根据连续计数器的读数，接收端可以判断是否有包丢失及包传送顺序错误。总而言之，包头对传输流具有同步、识别、检错及加密功能。
此外，包标示符是传输流中的唯一识别标志，包中的数据内容是由包标示符决定。如果一个传输流中的一个包的包头中的包标示符是0，那么该包的数据内容就是节目关联表，如果不是0，就是视频数据，音频数据，节目映射表，或者是其他类型数据。
图5为本申请实施例一种音视频实时传输方法的流程图。
音视频的实时传输包括对视频数据的实时传输和对音频数据的实时传输，因此需要将视频原始流及音频原始流分别打包为分组的视频原始流和分组的音频原始流；然后将分组的视频原始流，以及分组的音频原始流复用后存储为节目切片；除此之外，本实施例还需要对节目关联表和节目映射表分别进行加密后打包，具体如下：
分组的视频原始流的打包的具体步骤如下：
S101：将视频数据编码形成视频原始流(Elementary Stream，ES)；
视频原始流是由编码器输出的原始基础码流，只含有解码器所必需的，并与原始图像相接近的信息。编码后的视频原始流可以是MPEG-2或MPEG-4格式，还可以是H.264格式或者其他格式，本申请对此不作限定。
S102：将视频原始流打包为分组的视频原始流(Packet Elemental Stream，PES)；
分组的视频原始流，是以分割的数据包形式存在，主要是在视频原始流上加了时间戳等对数据帧的说明信息，分组的视频原始流提供标准的包头和打包方法，并提供解码的时间标志。
分组的音频原始流的打包的具体步骤如下：
S201：将音频数据编码形成音频原始流；
数字音频信号如果不加压缩地直接进行传送，将会占用极大的带宽，因此需要采用音频压缩技术对音频数据进行处理，才能有效地传输音频数据。本步骤中的音频编码方式可以是MPEG-1音频编码，也可以是MPEG-2AAC(Advanced Audio Coding)编 码，本申请对此不作限定。
S202：将视频原始流打包为分组的音频原始流。
音频分组器202把音频原始流分割成段或者是打包成组，并加上相应的头文件打包形成分组的音频原始流，音频原始流的包和包之间可以是不连续的。
在打包完成分组的视频原始流、分组的音频原始流之后，进入步骤S300；
S300：将分组的视频原始流和分组的音频原始流复用后存储为节目切片。
S400为节目特定信息切片的打包，具体为：对节目特定信息进行加密，并存储为节目特定信息切片。对节目特定信息进行加密包括对节目关联表和节目映射表加密。
最后进入步骤S500：传输节目特定信息及节目切片。
图6为本申请实施例一种音视频实时播放方法的流程图。
S301：下载加密后的节目特定信息切片；加密后的节目特定信息切片包括加密后的节目关联表及加密后的节目映射表。
S302：解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；具体而言，解密加密后的节目特定信息切片包括：解密加密后的节目关联表及加密后的节目映射表。
S303：下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。解析过程具体为：
首先，解析节目关联表，以获取节目映射表的包标示符；在本实施例中首先解析包标示符为0的节目关联表，以获取节目映射表的包标示符。
然后，根据映射表的包标示符搜索节目映射表；在本实施例中，节目映射表的数量等于节目的数量。
其次，根据节目映射表搜索视频数据的包标示符及音频数据的包标示符；在本实 施例中，搜索视频数据的包标示符及音频数据的包标示符就是为了获取视频数据及音频数据。
最后，根据视频数据的包标示符及音频数据的包标示符，解析视频数据及音频数据。
上述解析过程是由接收端完成，接收端通常为消费性电子产品，可以为智能电视、机顶盒、投影仪、视频播放器、个人计算机，智能手机，平板电脑等。
图7为本申请实施例一种音视频实时传输装置的结构示意图。
本申请实施例的音视频实时传输装置10包括：视频编码器101、音频编码器201、视频分组器102、音频分组器202、复用器300、加密模块400，以及传输模块500。
由于采集到的视频数据及音频数据均为模拟数据，因此需要进行抽样、量化及压缩编码形成视频原始流及音频原始流，视频原始流及音频原始流是不分段的连续码流。
视频编码器101用于将视频数据编码形成视频原始流。在本实施例中，视频原始流包括多个访问单元，每一个访问单元是一幅图像的编码数据。本申请的视频编码方式可以采用变换编码、熵编码、运动估计和运动补偿，或者是混合编码方式进行编码，本申请对此不作限定。
音频编码器201用于将音频数据分别编码形成音频原始流。在本实施例中，数字音频信号如果不加压缩地直接进行传送，将会占用极大的带宽，因此需要采用音频压缩技术对音频数据进行处理，才能有效地传输音频数据。数字音频压缩编码在保证信号在听觉方面不产生失真的前提下，对音频数据信号进行尽可能大的压缩。数字音频压缩编码采取去除声音信号中冗余成分的方法来实现。本申请的音频编码方式可以是 波形编码、参数编码，或者混合编码，本申请对此不作限定。
视频分组器102用于将视频原始流打包为分组的视频原始流。详而言之，视频分组器102把视频原始流分割成段或者是打包成组，并加上相应的头文件打包形成分组的视频原始流，视频原始流的包和包之间可以是不连续的。
音频分组器202用于将音频原始流打包为分组的音频原始流。详而言之，音频分组器202把音频原始流分割成段或者是打包成组，并加上相应的头文件打包形成分组的音频原始流，音频原始流的包和包之间可以是不连续的。
复用器300用于将分组的视频原始流以及分组的音频原始流复用后存储为节目切片，以及传输节目特定信息及节目切片。在本实施例中，复用器300在传输时将节目关联表、节目映射表、分组的视频原始流，以及分组的音频原始流打包成固定长度为188字节的切片。
加密模块400用于对节目特定信息进行加密，并存储为节目特定信息切片。本实施例中对节目特定信息进行加密，包括对节目关联表和节目映射表加密。
传输模块500用于传输节目特定信息及节目切片。
本申请实施例提供的上述音视频实时传输装置100在实际应用中可以具体应用于电子设备中，可以通过硬件处理器(hardware processor)来实现相关功能模块，该电子设备通常为各类视频服务器。
图8为本申请实施例一种音视频实时播放装置的结构示意图。
本申请实施例一种音视频实时播放装置400包括第一下载模块401、解密模块402，以及第二下载模块403。
第一下载模块401用于下载加密后的节目特定信息切片；加密后的节目特定信息 切片包括加密后的节目关联表及加密后的节目映射表。
解密模块402用于解密加密后的节目特定信息切片，得到解密后的节目特定信息；由于加密后的节目特定信息切片包括加密后的节目关联表及加密后的节目映射表，因此解密模块402还用于解密加密后的节目关联表及加密后的节目映射表。
第二下载模块403用于下载节目切片，并根据解密后的节目特定信息解析节目切片。
通过本申请实施例的上述技术方案，不需要周期性的插入节目关联表和节目映射表，而仅需要把节目关联表和节目映射表单独打包并加密，就可以达到既可保持与现有技术中的传输流兼容，又同时减少传输流中的冗余数据的效果。
本申请实施例还提供一种非暂态计算机可读存储介质，所述非暂态计算机可读存储介质可存储有程序，该程序执行时可实现执行前述任意一个实施例提供的一种音视频实时传输方法的各实现方式中的部分或全部步骤。
本申请实施例还提供一种非暂态计算机可读存储介质，所述非暂态计算机可读存储介质可存储有程序，该程序执行时可实现执行前述任意一个实施例提供的一种音视频实时播放方法的各实现方式中的部分或全部步骤。
图9是本申请实施例提供的音视频实时传输方法的电子设备的硬件结构示意图，如图9所示，该设备包括：
一个或多个处理器910以及存储器920，图9中以一个处理器910为例。
执行音视频实时传输方法的设备还可以包括：输入装置930和输出装置940。
处理器910、存储器920、输入装置930和输出装置940可以通过总线或者其他方式连接，图9中以通过总线连接为例。
存储器920作为一种非暂态计算机可读存储介质，可用于存储非易失性软件程 序、非易失性计算机可执行程序以及模块，如本申请实施例中的音视频实时传输方法对应的程序指令/模块。处理器910通过运行存储在存储器920中的非易失性软件程序、指令以及模块，从而执行电子设备的各种功能应用以及数据处理，即实现上述方法实施例的音视频实时传输方法。
存储器920可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储根据音视频实时传输装置的使用所创建的数据等。此外，存储器920可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中，存储器920可选包括相对于处理器910远程设置的存储器，这些远程存储器可以通过网络连接至音视频实时传输装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置930可接收输入的数字或字符信息，以及产生与音视频实时传输装置的用户设置以及功能控制有关的键信号输入。输出装置940可包括显示屏等显示设备。
所述一个或者多个模块存储在所述存储器920中，当被所述一个或者多个处理器910执行时，执行上述任意方法实施例中的音视频实时传输方法。
上述产品可执行本申请实施例所提供的方法，具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节，可参见本申请实施例所提供的方法。
图10是本申请实施例提供的音视频实时播放方法的电子设备的硬件结构示意图，如图10所示，该设备包括：
一个或多个处理器1010以及存储器1020，图10中以一个处理器1010为例。
执行音视频实时播放方法的设备还可以包括：输入装置1030和输出装置1040。
处理器1010、存储器1020、输入装置1030和输出装置1040可以通过总线或者其他方式连接，图10中以通过总线连接为例。
存储器1020作为一种非暂态计算机可读存储介质，可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块，如本申请实施例中的音视频实时播放方法对应的程序指令/模块。处理器1010通过运行存储在存储器1020中的非易失性软件 程序、指令以及模块，从而执行服务器的各种功能应用以及数据处理，即实现上述方法实施例的音视频实时播放方法。
存储器1020可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储根据音视频实时播放装置的使用所创建的数据等。此外，存储器1020可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中，存储器1020可选包括相对于处理器1010远程设置的存储器，这些远程存储器可以通过网络连接至音视频实时播放装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
输入装置1030可接收输入的数字或字符信息，以及产生与音视频实时播放装置的用户设置以及功能控制有关的键信号输入。输出装置1040可包括显示屏等显示设备。
所述一个或者多个模块存储在所述存储器1020中，当被所述一个或者多个处理器1010执行时，执行上述任意方法实施例中的音视频实时播放方法。
上述产品可执行本申请实施例所提供的方法，具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节，可参见本申请实施例所提供的方法。
本发明实施例的电子设备以多种形式存在，包括但不限于:
(1)移动通信设备:这类设备的特点是具备移动通信功能，并且以提供话音、数据通信为主要目标。这类终端包括:智能手机(例如iPhone)、多媒体手机、功能性手机，以及低端手机等。
(2)超移动个人计算机设备:这类设备属于个人计算机的范畴，有计算和处理功能，一般也具备移动上网特性。这类终端包括:PDA、MID和UMPC设备等，例如iPad。
(3)便携式娱乐设备:这类设备可以显示和播放多媒体内容。该类设备包括:音频、预览播放器(例如iPod)，掌上游戏机，电子书，以及智能玩具和便携式车载导航设备。
(4)服务器:提供计算服务的设备，服务器的构成包括处理器、硬盘、内存、系统 总线等，服务器和通用的计算机架构类似，但是由于需要提供高可靠的服务，因此在处理能力、稳定性、可靠性、安全性、可扩展性、可管理性等方面要求较高。
(5)其他具有数据交互功能的电子装置。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是：以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (18)

  1. 一种音视频实时传输方法，其特征在于，包括：
    将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；
    对节目特定信息进行加密，并存储为节目特定信息切片；
    传输所述节目特定信息及所述节目切片。
  2. 根据权利要求1所述的方法，其特征在于，
    所述对节目特定信息进行加密包括：对节目关联表和节目映射表加密。
  3. 根据权利要求2所述的方法，其特征在于，所述将分组的视频原始流以及分组的音频原始流复用后存储为节目切片的步骤之前还包括：
    将视频原始流及音频原始流分别打包为分组的视频原始流和分组的音频原始流的步骤。
  4. 根据权利要求3所述的方法，其特征在于，所述将视频原始流及音频原始流分别打包为分组的视频原始流和分组的音频原始流的步骤之前还包括：
    将视频数据及视频数据分别编码及形成所述视频原始流及所述音频原始流的步骤。
  5. 一种音视频实时播放方法，其特征在于，包括：
    下载加密后的节目特定信息切片；
    解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；
    下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。
  6. 根据权利要求5所述的方法，其特征在于，
    所述加密后的节目特定信息切片包括加密后的节目关联表及加密后的节目映射表。
  7. 根据权利要求6所述的方法，其特征在于，所述解密所述加密后的节目特 定信息切片包括：
    解密所述加密后的节目关联表及加密后的节目映射表。
  8. 一种音视频实时传输装置，其特征在于，包括：
    加密模块，用于对节目特定信息进行加密，并存储为节目特定信息切片；
    复用器，用于将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；
    传输模块，用于传输所述节目特定信息及所述节目切片。
  9. 根据权利要求8所述的装置，其特征在于，
    所述对节目特定信息进行加密包括：对节目关联表和节目映射表加密。
  10. 根据权利要求9所述的装置，其特征在于，还包括视频分组器及音频分组器：
    所述视频分组器，用于将视频原始流打包为分组的视频原始流；
    所述音频分组器，用于将音频原始流打包为分组的音频原始流。
  11. 根据权利要求10所述的装置，其特征在于，还包括视频编码器和音频编码器：
    所述视频编码器，用于将视频数据编码形成所述视频原始流；
    所述音频编码器，用于将音频数据编码形成所述音频原始流。
  12. 一种音视频实时播放装置，其特征在于，包括：
    第一下载模块，用于下载加密后的节目特定信息切片；
    解密模块，用于解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；
    第二下载模块，用于下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。
  13. 根据权利要求12所述的装置，其特征在于，
    所述加密后的节目特定信息切片包括：加密后的节目关联表及加密后的节目映射表。
  14. 根据权利要求13所述的装置，其特征在于，所述解密模块还用于解密所述加密后的节目关联表及加密后的节目映射表。
  15. 一种非暂态计算机可读存储介质，其特征在于，所述非暂态计算机可读存储介质存储计算机程序，所述计算机程序用于使所述计算机执行权利要求1-7任一所述方法。
  16. 一种电子设备，包括：
    一个或多个处理器；以及，
    存储器；其特征在于，
    所述存储器存储有可被所述一个或多个处理器执行的指令，所述指令被所述一个或多个处理器执行，以使所述一个或多个处理器：
    将分组的视频原始流以及分组的音频原始流复用后存储为节目切片；
    对节目特定信息进行加密，并存储为节目特定信息切片；
    传输所述节目特定信息及所述节目切片。
  17. 一种电子设备，包括：
    一个或多个处理器；以及，
    存储器；其特征在于，
    所述存储器存储有可被所述一个或多个处理器执行的指令，所述指令被所述一个或多个处理器执行，以使所述一个或多个处理器：
    下载加密后的节目特定信息切片；
    解密所述加密后的节目特定信息切片，得到解密后的节目特定信息；
    下载节目切片，并根据所述解密后的节目特定信息解析所述节目切片。
  18. 一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行权利要求1-7所述的方法。
PCT/CN2016/096990 2015-12-03 2016-08-26 音视频实时传输方法及装置、音视频实时播放方法及装置 Ceased WO2017092434A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510886024.6A CN105915493A (zh) 2015-12-03 2015-12-03 音视频实时传输方法及装置、音视频实时播放方法及装置
CN201510886024.6 2015-12-03

Publications (1)

Publication Number Publication Date
WO2017092434A1 true WO2017092434A1 (zh) 2017-06-08

Family

ID=56744049

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/096990 Ceased WO2017092434A1 (zh) 2015-12-03 2016-08-26 音视频实时传输方法及装置、音视频实时播放方法及装置

Country Status (2)

Country Link
CN (1) CN105915493A (zh)
WO (1) WO2017092434A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114449349A (zh) * 2020-10-30 2022-05-06 深圳Tcl新技术有限公司 节目录制方法、装置、设备及计算机可读存储介质
CN114640866A (zh) * 2022-05-18 2022-06-17 电子科技大学成都学院 一种基于随机动态的多通道加密方法、装置及系统
CN115412741A (zh) * 2022-08-31 2022-11-29 北京奇艺世纪科技有限公司 数据封装、解析方法、装置、电子设备及可读存储介质
CN118741245A (zh) * 2024-06-05 2024-10-01 陕西千山航空电子有限责任公司 一种飞参音视频的网络化回放方法及系统

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107342098B (zh) * 2017-07-20 2019-11-26 青岛海信电器股份有限公司 音频播放方法及装置
CN109561345B (zh) * 2018-12-14 2021-08-03 上海文广科技（集团）有限公司 基于avs+编码格式的数字电影打包方法
CN110809191B (zh) * 2019-10-08 2022-01-07 烽火通信科技股份有限公司 一种基于索引校验和实时转封装的视频防篡改方法及系统
CN111885412B (zh) * 2020-07-06 2022-08-09 深圳市宝泽科技有限公司 Hdmi信号传屏方法及无线传屏器
CN112954673B (zh) * 2021-02-03 2023-08-01 深圳市长丰影像器材有限公司 一种无线麦克风通道的加密方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1623327A (zh) * 2002-01-02 2005-06-01 索尼电子有限公司 部分加密和pid映射
CN101360226A (zh) * 2007-12-14 2009-02-04 华亚微电子（上海）有限公司 数字电视传送流的传输控制方法及其装置
EP2034729A2 (en) * 2007-06-21 2009-03-11 Panasonic Corporation Transmitting apparatus, receiving apparatus, and transmitting and receiving apparatus
CN102547401A (zh) * 2010-12-28 2012-07-04 索尼公司 按需切换式内容加密
CN104918108A (zh) * 2015-06-09 2015-09-16 烽火通信科技股份有限公司 一种基于hls协议的视频精确定位装置及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1623327A (zh) * 2002-01-02 2005-06-01 索尼电子有限公司 部分加密和pid映射
EP2034729A2 (en) * 2007-06-21 2009-03-11 Panasonic Corporation Transmitting apparatus, receiving apparatus, and transmitting and receiving apparatus
CN101360226A (zh) * 2007-12-14 2009-02-04 华亚微电子（上海）有限公司 数字电视传送流的传输控制方法及其装置
CN102547401A (zh) * 2010-12-28 2012-07-04 索尼公司 按需切换式内容加密
CN104918108A (zh) * 2015-06-09 2015-09-16 烽火通信科技股份有限公司 一种基于hls协议的视频精确定位装置及方法

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114449349A (zh) * 2020-10-30 2022-05-06 深圳Tcl新技术有限公司 节目录制方法、装置、设备及计算机可读存储介质
CN114449349B (zh) * 2020-10-30 2023-07-25 深圳Tcl新技术有限公司 节目录制方法、装置、设备及计算机可读存储介质
CN114640866A (zh) * 2022-05-18 2022-06-17 电子科技大学成都学院 一种基于随机动态的多通道加密方法、装置及系统
CN114640866B (zh) * 2022-05-18 2022-08-16 电子科技大学成都学院 一种基于随机动态的多通道加密方法、装置及系统
CN115412741A (zh) * 2022-08-31 2022-11-29 北京奇艺世纪科技有限公司 数据封装、解析方法、装置、电子设备及可读存储介质
CN118741245A (zh) * 2024-06-05 2024-10-01 陕西千山航空电子有限责任公司 一种飞参音视频的网络化回放方法及系统

Also Published As

Publication number Publication date
CN105915493A (zh) 2016-08-31

Similar Documents

Publication Publication Date Title
WO2017092434A1 (zh) 音视频实时传输方法及装置、音视频实时播放方法及装置
JP6839257B2 (ja) 送信方法、受信方法、送信装置および受信装置
JP7284906B2 (ja) メディアコンテンツの配信および再生
JP7100175B2 (ja) 送信方法及び送信装置
TWI502485B (zh) 用於顯示及傳輸媒體資訊之方法、裝置及電腦可讀儲存媒體
JP2009505515A (ja) 基本ストリーム・コンテンツの保護
US20130322628A1 (en) Apparatus and method for transceiving content in a digital broadcast system
BRPI0614675A2 (pt) protegendo conteúdo de fluxo elementar
US20150026459A1 (en) Method and system for encrypting multimedia streams
JP2017526228A (ja) 独立的に符号化されたタイルを組み込む基本ビットストリームを保護するためのシステムおよび方法
KR101145782B1 (ko) 모바일 컨텐츠 서비스를 제공하기 위한 경량화된 비디오 컨텐츠 암호화 및 복호화 방법
WO2017092433A1 (zh) 视频实时播放方法及装置
KR20160033027A (ko) 멀티미디어의 전송 또는 수신 방법 및 그 장치
US20180302674A1 (en) File generating method and file generating apparatus
CN110753259B (zh) 视频数据的处理方法、装置、电子设备及计算机可读介质
CN103501457B (zh) 一种节目播放的方法及设备
WO2017092435A1 (zh) 音视频实时传输方法及装置、传输流打包方法及复用器
CN117981328A (zh) 音视频的多路同步播放方法、装置、电子设备及存储介质
KR102210509B1 (ko) 멀티미디어 시스템에서 컨텐츠를 변환하는 방법 및 장치
CN105847897A (zh) 一种提供及处理视频下载的方法及设备
US10484725B2 (en) Information processing apparatus and information processing method for reproducing media based on edit file
TW201603568A (zh) 在典型廣播內容中媒體呈現描述傳訊

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869745

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16869745

Country of ref document: EP

Kind code of ref document: A1