WO2016095539A1 - Multimedia resource protection method, device, apparatus and computer storage medium - Google Patents

Multimedia resource protection method, device, apparatus and computer storage medium Download PDF

Info

Publication number
WO2016095539A1
WO2016095539A1 PCT/CN2015/086620 CN2015086620W WO2016095539A1 WO 2016095539 A1 WO2016095539 A1 WO 2016095539A1 CN 2015086620 W CN2015086620 W CN 2015086620W WO 2016095539 A1 WO2016095539 A1 WO 2016095539A1
Authority
WO
WIPO (PCT)
Prior art keywords
media stream
loading
media
interference
original
Prior art date
Application number
PCT/CN2015/086620
Other languages
French (fr)
Chinese (zh)
Inventor
郭怀印
Original Assignee
北京音之邦文化科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京音之邦文化科技有限公司 filed Critical 北京音之邦文化科技有限公司
Publication of WO2016095539A1 publication Critical patent/WO2016095539A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633—Control signals issued by server directed to the network components or client
    • H04N21/6332—Control signals issued by server directed to the network components or client directed to client
    • H04N21/6334—Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key

Abstract

A multimedia resource protection method, device, apparatus and computer storage medium, the method comprising: a server terminal determines a loading position of interference media according to a blank position in an original media stream (101); loading the interference media at the loading position in the original media stream to form a media stream to be transferred (102); and transmitting loading position information to an authorized client, such that the client plays the media stream to be transferred (103). The client receives the loading position information transmitted by a server terminal for interference media (201); and according to the loading position information, skipping the corresponding loading position when playing the media stream (202). The present invention reduces resource consumption and performance consumption, and improves user experience.

Description

多媒体资源的保护方法、装置、设备和计算机存储介质Method, device, device and computer storage medium for protecting multimedia resources
本申请要求了申请日为2014年12月19日，申请号为201410803358.8发明名称为“一种多媒体资源的保护方法和装置”的中国专利申请的优先权。The present application claims priority to Chinese Patent Application No. 2014-09-30, filed on Dec. 19, 2014, entitled "A Method and Apparatus for Protecting Multimedia Resources."
技术领域Technical field
本发明涉及多媒体技术，特别涉及一种多媒体资源的保护方法、装置、设备和计算机存储介质。The present invention relates to multimedia technologies, and in particular, to a method, an apparatus, a device, and a computer storage medium for protecting a multimedia resource.
背景技术Background technique
随着互联网技术的发展，多媒体资源在互联网中得到了广泛的传播。为了保护多媒体资源被恶意抓取利用和无价值传播，需要对多媒体资源进行保护。一般常见的多媒体资源的保护方式主要存在以下两种：With the development of Internet technology, multimedia resources have been widely spread on the Internet. In order to protect multimedia resources from malicious exploitation and valueless transmission, multimedia resources need to be protected. There are two main types of protection for common multimedia resources:
第一种方式：将多媒体资源使用自有格式编码或者进行加密后传输，这种方式的缺点是多媒体文件只能在自有平台播放，用户下载到其他播放器时则无法使用，影响用户体验。The first way: the multimedia resource is encoded by its own format or encrypted and transmitted. The disadvantage of this method is that the multimedia file can only be played on its own platform, and the user cannot use it when downloading to other players, which affects the user experience.
第二种方式：在多媒体资源中嵌入水印后传输，这种方式的缺点是对原始多媒体资源会造成质量损害，同时算法过于复杂，客户端在播放该多媒体资源时需要解密水印，资源和性能消耗巨大。The second way: embedding the watermark in the multimedia resource and transmitting it. The disadvantage of this method is that the original multimedia resource will cause quality damage, and the algorithm is too complicated. The client needs to decrypt the watermark when playing the multimedia resource, resource and performance consumption. huge.
发明内容Summary of the invention
有鉴于此，本发明提供了一种多媒体资源的保护方法、装置、设备和计算机存储介质，以便于降低资源和性能消耗，提高用户体验。In view of this, the present invention provides a method, an apparatus, a device, and a computer storage medium for protecting a multimedia resource, so as to reduce resource and performance consumption and improve user experience.
具体技术方案如下：The specific technical solutions are as follows:
本发明提供了一种多媒体资源的保护方法，该方法包括：The present invention provides a method for protecting a multimedia resource, the method comprising:
根据原始媒体流中的空白位置确定干扰媒体的加载位置； Determining a loading location of the interfering media according to a blank location in the original media stream;
在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；Loading the interference media in the loading location in the original media stream to form a media stream to be transmitted;
将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。Sending the loading location information to an authorized client, so that the authorized client plays the media stream to be transmitted.
根据本发明一优选实施方式，所述根据原始媒体流中的空白位置确定干扰媒体的加载位置包括：According to a preferred embodiment of the present invention, the determining, according to the blank location in the original media stream, the loading location of the interference media includes:
从所述原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置；或者，Randomly selecting one or more blank locations from the original media stream as loading locations for interfering media; or
将所述原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置；或者，One or more blank locations manually designated in the original media stream are used as loading locations for interfering media; or
按照预设的选取规则从所述原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。One or more blank locations are selected from the original media stream as preset loading rules according to a preset selection rule.
根据本发明一优选实施方式，所述原始媒体流中的空白位置采用以下方式确定：According to a preferred embodiment of the present invention, the blank position in the original media stream is determined in the following manner:
获取人工指定的空白位置；或者，Get a manually specified white space; or,
将检测到的静音段确定为原始媒体流中的空白位置；或者，Determining the detected silence segment as a blank location in the original media stream; or,
将检测到的过渡段确定为原始媒体流中的空白位置；Determining the detected transition segment as a blank location in the original media stream;
将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流中的空白位置。The position between the I frame and the previous frame in the original media stream is determined as a blank position in the original media stream.
根据本发明一优选实施方式，所述在原始媒体流中所述加载位置加载干扰媒体包括：According to a preferred embodiment of the present invention, the loading location loading interference media in the original media stream includes:
将原始媒体流和干扰媒体进行解压缩后，依据所述加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据进行压缩处理；或者， After decompressing the original media stream and the interference media, combining the data decompressed by the interference media with the data decompressed by the original media stream according to the loading location, and compressing the combined data; or
依据所述加载位置将原始媒体流与干扰媒体直接进行组合，其中所述原始媒体流与干扰媒体流采用相同的压缩处理方法。The original media stream is directly combined with the interference media according to the loading location, wherein the original media stream and the interference media stream adopt the same compression processing method.
根据本发明一优选实施方式，将所述加载位置信息发送给授权的客户端包括：According to a preferred embodiment of the present invention, the sending the loading location information to the authorized client includes:
以文件形式发送所述待传输的媒体流给授权的客户端，在所述待传输的媒体流的元数据中携带所述加载位置信息；或者，Transmitting the media stream to be transmitted to the authorized client in a file format, and carrying the loading location information in the metadata of the media stream to be transmitted; or
通过应用程序编程接口API发送所述待传输的媒体流给授权的客户端，在API文件中携带所述加载位置信息。The media stream to be transmitted is sent to the authorized client through the application programming interface API, and the loading location information is carried in the API file.
本发明还提供了一种多媒体资源的保护方法，该方法包括：The present invention also provides a method for protecting a multimedia resource, the method comprising:
接收服务器端发送的干扰媒体的加载位置信息；Receiving loading location information of the interference medium sent by the server;
依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。According to the loading location information, the corresponding loading location is skipped during the playback of the media stream.
根据本发明一优选实施方式，所述接收服务器端发送的干扰媒体的加载位置信息包括：According to a preferred embodiment of the present invention, the loading location information of the interference media sent by the receiving server includes:
接收服务器端以文件形式发送的媒体流，从媒体流的元数据中获取干扰媒体的加载位置信息；或者，Receiving a media stream sent by the server in the form of a file, and acquiring loading location information of the interference media from the metadata of the media stream; or
通过API接收服务器端发送的媒体流，从API文件中获取干扰媒体的加载位置信息。The media stream sent by the server is received through the API, and the loading location information of the interfering media is obtained from the API file.
根据本发明一优选实施方式，在播放媒体流的过程中跳过所述干扰媒体的加载位置包括：According to a preferred embodiment of the present invention, skipping the loading location of the interference media in the process of playing the media stream includes:
对所述媒体流进行解压缩，跳过所述干扰媒体的加载位置对解压缩后得到的媒体流进行播放；或者，Decompressing the media stream, skipping the loading location of the interference media, and playing the media stream obtained after decompression; or
跳过所述干扰媒体的加载位置对所述媒体流进行解压缩，对解压缩 后得到的原始媒体流进行播放。Unloading the media stream by skipping the loading location of the interference media, decompressing The original media stream obtained afterwards is played.
本发明还提供了一种多媒体资源的保护装置，该装置包括：The present invention also provides a multimedia resource protection device, the device comprising:
位置确定单元，用于根据原始媒体流中的空白位置确定干扰媒体的加载位置；a location determining unit, configured to determine, according to a blank location in the original media stream, a loading location of the interference medium;
干扰加载单元，用于在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；An interference loading unit, configured to load interference media in the loading location in the original media stream to form a media stream to be transmitted;
发送单元，用于将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。And a sending unit, configured to send the loading location information to the authorized client, so that the authorized client plays the media stream to be transmitted.
根据本发明一优选实施方式，所述位置确定单元，具体用于从所述原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置；或者，According to a preferred embodiment of the present invention, the location determining unit is specifically configured to randomly select one or more blank locations from the original media stream as loading locations of interference media; or
将所述原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置；或者，One or more blank locations manually designated in the original media stream are used as loading locations for interfering media; or
按照预设的选取规则从所述原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。One or more blank locations are selected from the original media stream as preset loading rules according to a preset selection rule.
根据本发明一优选实施方式，所述位置确定单元采用以下方式确定所述原始媒体流中的空白位置：According to a preferred embodiment of the present invention, the location determining unit determines a blank location in the original media stream in the following manner:
获取人工指定的空白位置；或者，Get a manually specified white space; or,
将检测到的静音段确定为原始媒体流中的空白位置；或者，Determining the detected silence segment as a blank location in the original media stream; or,
将检测到的过渡段确定为原始媒体流中的空白位置；Determining the detected transition segment as a blank location in the original media stream;
将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流中的空白位置。The position between the I frame and the previous frame in the original media stream is determined as a blank position in the original media stream.
根据本发明一优选实施方式，所述干扰加载单元，具体用于将原始 媒体流和干扰媒体进行解压缩后，依据所述加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据进行压缩处理；或者，According to a preferred embodiment of the present invention, the interference loading unit is specifically used to be original After the media stream and the interference media are decompressed, the data decompressed by the interference media is combined with the data decompressed by the original media stream according to the loading location, and the combined data is compressed; or
依据所述加载位置将原始媒体流与干扰媒体直接进行组合，其中所述原始媒体流与干扰媒体流采用相同的压缩处理方法。The original media stream is directly combined with the interference media according to the loading location, wherein the original media stream and the interference media stream adopt the same compression processing method.
根据本发明一优选实施方式，所述发送单元，具体用于以文件形式发送所述待传输的媒体流给授权的客户端，在所述待传输的媒体流的元数据中携带所述加载位置信息；或者，According to a preferred embodiment of the present invention, the sending unit is configured to send the media stream to be transmitted to an authorized client in a file format, and carry the loading location in the metadata of the media stream to be transmitted. Information; or,
通过API发送所述待传输的媒体流给授权的客户端，在API文件中携带所述加载位置信息。Sending, by the API, the media stream to be transmitted to the authorized client, and carrying the loading location information in the API file.
本发明还提供了一种多媒体资源的保护装置，该装置包括：The present invention also provides a multimedia resource protection device, the device comprising:
接收单元，用于接收服务器端发送的干扰媒体的加载位置信息；a receiving unit, configured to receive loading location information of the interference media sent by the server;
媒体流处理单元，用于依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。The media stream processing unit is configured to skip the corresponding loading location in the process of playing the media stream according to the loading location information.
根据本发明一优选实施方式，所述接收单元，具体用于接收服务器端以文件形式发送的媒体流，从媒体流的元数据中获取干扰媒体的加载位置信息；或者，According to a preferred embodiment of the present invention, the receiving unit is configured to receive a media stream sent by a server in a file format, and obtain loading location information of the interference media from the metadata of the media stream; or
通过API接收服务器端发送的媒体流，从API文件中获取干扰媒体的加载位置信息。The media stream sent by the server is received through the API, and the loading location information of the interfering media is obtained from the API file.
根据本发明一优选实施方式，所述媒体流处理单元包括：According to a preferred embodiment of the present invention, the media stream processing unit includes:
第一解压缩子单元，用于对所述媒体流进行解压缩；a first decompressing subunit, configured to decompress the media stream;
第一播放子单元，用于跳过所述干扰媒体的加载位置对解压缩后得到的媒体流进行播放。 The first play subunit is configured to skip the loading position of the interference media and play the media stream obtained after the decompression.
根据本发明一优选实施方式，所述媒体流处理单元包括：According to a preferred embodiment of the present invention, the media stream processing unit includes:
第二解压缩子单元，用于跳过所述干扰媒体的加载位置对所述媒体流进行解压缩；a second decompression subunit, configured to decompress the media stream by skipping a loading location of the interference medium;
第二播放子单元，用于对解压缩后得到的原始媒体流进行播放。The second play subunit is configured to play the original media stream obtained after decompression.
由以上技术方案可以看出，本发明中只要是授权的客户端都能够正常播放出原始多媒体流，不受播放平台的限制，提高了用户体验。并且客户端在播放媒体流的过程中仅需要跳过干扰媒体的加载位置，无需复杂的算法，降低了资源和性能消耗。It can be seen from the above technical solution that in the present invention, as long as the authorized client can play the original multimedia stream normally, it is not restricted by the playing platform, and the user experience is improved. Moreover, the client only needs to skip the loading position of the interfering media in the process of playing the media stream, and does not need a complicated algorithm, thereby reducing resource and performance consumption.
附图说明DRAWINGS
图1为本发明实施例提供的服务器端执行的流程；FIG. 1 is a flowchart of a server-side execution according to an embodiment of the present invention;
图2为本发明实施例提供的客户端执行的流程图；2 is a flowchart of a client execution according to an embodiment of the present invention;
图3为本发明实施例提供的设置于服务器端的装置结构图；3 is a structural diagram of an apparatus installed on a server according to an embodiment of the present invention;
图4为本发明实施例提供的设置于客户端的一种装置结构图；4 is a structural diagram of a device installed on a client according to an embodiment of the present invention;
图5为本发明实施例提供的设置于客户端的另一种装置结构图。FIG. 5 is a structural diagram of another apparatus installed on a client according to an embodiment of the present invention.
具体实施方式detailed description
为了使本发明的目的、技术方案和优点更加清楚，下面结合附图和具体实施例对本发明进行详细描述。The present invention will be described in detail below with reference to the drawings and specific embodiments.
本发明的出发点希望多媒体资源能够以最大范围地合理传播，又要防止多媒体资源被恶意抓取利用和无价值传播，核心思想在于，服务器在原始媒体流中的空白位置加载干扰媒体，形成待传输的媒体流，将干扰媒体的加载位置发送给授权的客户端，客户端依据接收到的干扰媒体的加载位置，在播放媒体流时跳过该加载位置，就能够播放出原始媒体流。 The starting point of the present invention is to hope that the multimedia resources can be reasonably propagated in the largest range, and the multimedia resources are prevented from being maliciously captured and used for valueless transmission. The core idea is that the server loads the interference media in the blank position in the original media stream to form a to-be-transmitted transmission. The media stream sends the loading location of the interfering media to the authorized client. The client can play the original media stream by skipping the loading location when playing the media stream according to the loading location of the received interference media.
下面结合图1和图2分别对服务器端和客户端执行的方法进行详细描述。The method performed by the server and the client will be described in detail below with reference to FIG. 1 and FIG. 2 respectively.
图1为本发明实施例提供的服务器端执行的流程，如图1中所示，该流程可以具体包括以下步骤：FIG. 1 is a flowchart of a server-side execution process according to an embodiment of the present invention. As shown in FIG. 1 , the process may specifically include the following steps:
在101中，根据原始媒体流中的空白位置确定干扰媒体的加载位置。In 101, the loading location of the interfering media is determined based on the blank location in the original media stream.
在本发明实施例中，干扰媒体的加载位置采用的是原始媒体流中的空白位置，这样客户端在播放媒体流时仅需要在加载位置跳过干扰媒体即可，无需进行复杂地剥离处理。In the embodiment of the present invention, the loading position of the interference medium is a blank position in the original media stream, so that the client only needs to skip the interference medium at the loading position when playing the media stream, and does not need to perform complicated stripping processing.
这里媒体流中的空白位置指的是，不包含有意义信息的位置。对于音频而言，其中声音的间隙可以看做是空白位置，在该空白位置允许存在一些噪声，即仅存在背景噪声的位置也可以看作是空白位置。这种空白位置多出现在句与句之间，段与段之间等。对于视频而言，其中出现画面空白的位置、较大的帧间隔位置等可以看做是空白位置，在该空白位置允许出现一些干扰信号，这种空白位置多出现在情节的转换位置，场景的转换位置等。对于连续的图片而言，其中较大的帧间隔位置可以看做是空白位置。The blank position in the media stream here refers to the location that does not contain meaningful information. For audio, the gap in the sound can be seen as a blank position where some noise is allowed, ie, where only background noise is present, it can also be considered a blank position. This kind of blank position appears between the sentence and the sentence, between the paragraph and the like. For the video, the position where the screen blank appears, the larger frame interval position, etc. can be regarded as a blank position, and some interference signals are allowed to appear in the blank position, and such blank positions often appear in the transition position of the plot, the scene Convert location, etc. For successive pictures, the larger frame interval can be considered as a blank position.
在确定原始媒体流中的空白位置时，无论哪种类型的媒体流都可以获取人工指定的空白位置，这种方式比较好理解，不详细描述。When determining the blank location in the original media stream, any type of media stream can obtain the manually specified blank location, which is better understood and not described in detail.
对于音频类型的媒体流，可以采用静音检测的方式，将检测到的静音段确定为原始媒体流中的空白位置。也可以采用过渡段检测的方式，将检测到的过渡段确定为原始媒体流中的空白位置。可以采用现有技术中的任意静音检测技术和过渡段检测技术获得的检测结果，在本发明实施例中不对静音检测和过渡段检测的具体方式进行限制。 For audio type media streams, the detected silence segment can be determined as a blank location in the original media stream by means of silence detection. The detected transition segment can also be determined as a blank position in the original media stream by means of transition segment detection. The detection result obtained by any of the mute detection technology and the transition segment detection technology in the prior art may be used, and the specific manner of the mute detection and the transition segment detection is not limited in the embodiment of the present invention.
对于视频类型的媒体流，同样可以采用过渡段检测的方式，将检测到的过渡段确定为原始媒体流中的空白位置。由于视频类型的媒体流是一帧帧的图像构成的，I帧通常是内容变化较大的帧，在视频或图像编码时通常采用I帧作为第一帧，因此，在本发明实施例中可以将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流的空白位置。For video type media streams, the detected transition segment can also be determined as a blank location in the original media stream by means of transition segment detection. Since the media stream of the video type is composed of the image of one frame, the I frame is usually a frame with a large content change, and the I frame is usually used as the first frame in the video or image encoding. Therefore, in the embodiment of the present invention, The position between the I frame and the previous frame in the original media stream is determined as the blank position of the original media stream.
对于连续播放的图片这种媒体流而言，同样可以将原始媒体流中I帧与其前一帧之前的位置确定为原始媒体流的空白位置。这里连续播放的图片可以是动画、动态图片等。For a media stream of a continuously played picture, the position of the I frame in the original media stream and its previous frame can also be determined as the blank position of the original media stream. The pictures played continuously here can be animations, dynamic pictures, and the like.
确定出干扰媒体的空白位置后，可以将原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置。也可以按照预设的选取规则从原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。例如每隔若干个空白位置确定一个空白位置作为加载位置，或者将前若干个空白位置确定为加载位置等等。为了增加被破解的难度，本发明实施例可以采用一种优选的方式，即从原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置。After determining the blank location of the interfering media, one or more blank locations manually designated in the original media stream may be used as the loading location of the interfering media. It is also possible to select one or more blank locations from the original media stream as the loading location of the interference media according to a preset selection rule. For example, a blank position is determined as a loading position every several blank positions, or the first several blank positions are determined as a loading position and the like. In order to increase the difficulty of being cracked, the embodiment of the present invention may adopt a preferred manner, that is, randomly select one or more blank locations from the original media stream as loading locations of the interference media.
在102中，在原始媒体流中的上述加载位置加载干扰媒体，形成待传输的媒体流。In 102, the interference media is loaded at the loading location in the original media stream to form a media stream to be transmitted.
对于音频类型的媒体流，加载的干扰媒体可以是干扰音或广告音等。对于视频类型的媒体流，加载的干扰媒体可以是干扰画面或广告画面等。对于连续播放的图片类型的媒体流，加载的干扰媒体可以是干扰图片或广告图片等。For audio type media streams, the loaded interference media can be interfering tones or advertising tones, and the like. For a video type media stream, the loaded interference media may be an interference screen or an advertisement screen or the like. For a media stream of a continuously played picture type, the loaded interference media may be an interference picture or an advertisement picture or the like.
本发明中的原始媒体流指的是已经被编码为一定格式但尚未被压缩的媒体流，干扰媒体的加载方式可以采用但不限于以下方式： The original media stream in the present invention refers to a media stream that has been encoded into a certain format but has not been compressed. The loading mode of the interference media may be, but is not limited to, the following:
第一种方式：现将原始媒体流和干扰媒体分别进行解压缩后，依据加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据再进行压缩处理。The first method: after decompressing the original media stream and the interference media respectively, combining the data decompressed by the interference media with the data decompressed by the original media stream according to the loading location, and compressing the combined data again. deal with.
这种方式可以适用于音频类型的媒体流或视频类型的媒体流。对于音频类型的媒体流，原始音频流和干扰音频分别解压缩得到PCM(Pulse Code Modulation，脉冲编码调制)数据，将原始音频流的PCM数据和干扰音频的PCM数据依据步骤101确定出的加载位置进行组合，然后对组合后的PCM数据进行压缩处理，形成待传输的音频流。对于视频类型的媒体流，原始视频流和干扰画面分别解压缩得到YUV(YUV是被欧洲电视系统所采用的一种颜色编码方法，Y指亮度信号，U、V指色度信号)数据，将原始视频流的YUV数据和干扰画面的YUV数据依据步骤101确定出的加载位置进行组合，然后对组合后的YUV数据进行压缩处理，形成待传输的视频流。This method can be applied to audio type media streams or video type media streams. For audio-type media streams, the original audio stream and the interfering audio are respectively decompressed to obtain PCM (Pulse Code Modulation) data, and the PCM data of the original audio stream and the PCM data of the interfering audio are determined according to the loading position determined in step 101. The combination is performed, and then the combined PCM data is compressed to form an audio stream to be transmitted. For the video type media stream, the original video stream and the interference picture are respectively decompressed to obtain YUV (YUV is a color coding method adopted by the European television system, Y refers to the luminance signal, U, V refers to the chrominance signal) data, and The YUV data of the original video stream and the YUV data of the interference picture are combined according to the loading position determined in step 101, and then the combined YUV data is compressed to form a video stream to be transmitted.
第二种方式：依据加载位置将原始媒体流与干扰媒体直接进行组合，这种方式需要原始媒体流与干扰媒体流采用了相同的压缩算法。也就是说，在压缩域对原始媒体流与干扰媒体流进行组合，这种方式可以适用于音频、视频和连续播放的图片的媒体流。The second method: directly combining the original media stream and the interference media according to the loading location, the original media stream and the interference media stream are required to adopt the same compression algorithm. That is to say, the original media stream and the interfering media stream are combined in the compressed domain, which can be applied to audio, video and media streams of continuously played pictures.
在103中，将步骤101确定出的加载位置信息发送给授权的客户端。将待传输的媒体流传输给授权的客户端后，授权的客户端就能够依据该加载位置信息播放媒体流。In 103, the loading location information determined in step 101 is sent to the authorized client. After the media stream to be transmitted is transmitted to the authorized client, the authorized client can play the media stream according to the loading location information.
通过本步骤服务器端对客户端进行了控制，即只有授权的客户端能够获取加载位置信息，从而顺利播放，而未授权的客户端播放出的媒体流是包含干扰媒体的。这里授权的客户端可以是存在合作关系的客户端， 购买了多媒体服务的客户端，或者确定为合法用户的客户端等等。Through this step, the server controls the client, that is, only the authorized client can obtain the loading location information to play smoothly, and the media stream played by the unauthorized client includes the interference media. The client authorized here can be a client with a cooperative relationship. A client that has purchased a multimedia service, or a client that is determined to be a legitimate user, and the like.
加载位置信息可以采用时间或者字节等来标识加载位置。The loading location information may identify the loading location by time or byte or the like.
待传输的媒体流可以通过API(Application Programming Interface，应用程序编程接口)发送给授权的客户端，也可以通过文件方式发送给授权的客户端。如果待传输的媒体流通过API发送给授权的客户端，则服务器端可以在API文件中携带加载位置信息，该加载位置信息可以进行加密处理。如果待传输的媒体流通过文件方式发送给授权的客户端，则服务器端可以在媒体流的MetaData(元数据)中携带加载位置信息。这样授权的客户端就能够获取到媒体流对应的干扰媒体加载位置信息。The media stream to be transmitted can be sent to an authorized client through an API (Application Programming Interface), or can be sent to an authorized client through a file. If the media stream to be transmitted is sent to the authorized client through the API, the server may carry the loading location information in the API file, and the loading location information may be encrypted. If the media stream to be transmitted is sent to the authorized client by using a file, the server may carry the loading location information in MetaData (metadata) of the media stream. The authorized client can obtain the interference media loading location information corresponding to the media stream.
图2为本发明实施例提供的客户端执行的流程图，如图2中所示，该流程可以包括以下步骤：2 is a flowchart of a client execution according to an embodiment of the present invention. As shown in FIG. 2, the process may include the following steps:
在201中，接收服务器端发送的干扰媒体的加载位置信息。In 201, the loading location information of the interference media sent by the server is received.
如果服务器端通过API发送媒体流，那么客户端可以从API文件中获取该媒体流中干扰媒体的加载位置信息。如果服务器端通过文件方式发送媒体流，那么客户端可以从媒体流的MetaData中获取干扰媒体的加载位置信息。If the server sends the media stream through the API, the client may obtain the loading location information of the interference media in the media stream from the API file. If the server sends the media stream through the file, the client can obtain the loading location information of the interference media from the MetaData of the media stream.
在202中，依据接收到的加载位置信息，在播放媒体流的过程中跳过对应的加载位置。In 202, according to the received loading location information, the corresponding loading location is skipped during the playback of the media stream.
对应于服务器端对干扰媒体的两种加载方式，客户端可以采用以下两种播放媒体流的方式：Corresponding to the two loading modes of the server-side interference media, the client can use the following two methods of playing media streams:
第一种方式：对媒体流进行解压缩，跳过干扰媒体的加载位置对解压缩后得到的媒体流进行播放。The first method is: decompressing the media stream, skipping the loading position of the interfering media, and playing the media stream obtained after decompressing.
这种方式适用于音频类型的媒体流或视频类型的媒体流。对于音频 类型的媒体流，对媒体流进行解压缩后，得到的是音频流的PCM数据和干扰音频的PCM数据的组合，跳过干扰媒体的加载位置对解压缩后的PCM数据进行播放，也就是仅对音频流的PCM数据进行播放，就能够播放出原始音频流。对于视频类型的媒体流，对媒体流进行解压缩后，得到的是视频流的YUV数据和干扰画面的YUV数据的组合，跳过干扰媒体的加载位置对解压缩后的YUV数据进行播放，也就是仅对视频流的PCM数据进行播放，就能够播放出原始视频流。This method is suitable for audio-type media streams or video-type media streams. For audio The media stream of the type, after decompressing the media stream, obtains a combination of the PCM data of the audio stream and the PCM data of the interfering audio, skipping the loading position of the interfering medium, and playing the decompressed PCM data, that is, only By playing the PCM data of the audio stream, the original audio stream can be played. For the video stream of the video type, after decompressing the media stream, a combination of the YUV data of the video stream and the YUV data of the interference picture is obtained, and the loaded position of the interfering medium is skipped to play the decompressed YUV data. That is, only the PCM data of the video stream is played, and the original video stream can be played.
第二种方式：跳过干扰媒体的加载位置对媒体流进行解压缩，对解压缩后得到的原始媒体流进行播放。这种方式适用于音频、视频和连续播放的图片的媒体流，实际上就是跳过干扰媒体仅对原始媒体流的部分进行解压缩，得到原始媒体流的部分再进行播放。The second method is: decompressing the media stream by skipping the loading position of the interference medium, and playing the original media stream obtained after decompressing. This method is applicable to media streams of audio, video, and continuously played pictures. In fact, skipping the interfering media only decompresses portions of the original media stream, and then obtains portions of the original media stream for playback.
这样，客户端就能够还原播放出原始的媒体流，其中不再包含干扰媒体。如果是非授权的客户端，由于无法获取到干扰媒体的加载位置，因此进行解压缩后，播放的媒体流中包含干扰媒体，虽然也能够播放，但牺牲了用户体验，如果是恶意抓取，显然无法进行有效利用，对于无价值传播也不能达到应有的效果。而授权客户端则能够正常播放无干扰的媒体流，质量不受损，用户体验很好，并且无需复杂的解密算法，资源和性能消耗很小。In this way, the client can restore the original media stream, which no longer contains interference media. If it is an unauthorized client, because the loading location of the interfering media cannot be obtained, after the decompression, the played media stream contains interference media, although it can also be played, but the user experience is sacrificed, if it is maliciously crawled, obviously It can't be used effectively, and it can't achieve the desired effect for the valueless spread. The authorized client can play the interference-free media stream normally, the quality is not damaged, the user experience is good, and no complicated decryption algorithm is needed, and the resource and performance consumption are small.
图3为本发明实施例提供的设置于服务器端的装置结构图，如图3中所示，该装置可以包括：位置确定单元01、干扰加载单元02和发送单元03。FIG. 3 is a structural diagram of an apparatus installed on a server according to an embodiment of the present invention. As shown in FIG. 3, the apparatus may include: a location determining unit 01, an interference loading unit 02, and a sending unit 03.
位置确定单元01根据原始媒体流中的空白位置确定干扰媒体的加载位置。具体可以采用以下方式确定干扰媒体的加载位置： The location determining unit 01 determines the loading location of the interfering media based on the blank location in the original media stream. Specifically, the loading position of the interference media can be determined in the following manner:
第一种方式：从原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置。The first way: randomly select one or more blank locations from the original media stream as the loading location of the interference media.
第二种方式：将原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置。The second way: one or more blank locations manually specified in the original media stream are used as loading locations for the interfering media.
第三种方式：按照预设的选取规则从原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。The third way: selecting one or more blank locations from the original media stream according to a preset selection rule as the loading location of the interference media.
位置确定单元01在确定原始媒体流中的空白位置时可以采用以下方式：The location determining unit 01 may adopt the following manner when determining a blank location in the original media stream:
第一种方式：获取人工指定的空白位置，无论哪种类型的媒体流都可以采用这种方式。The first way: Get manually specified blank locations, regardless of the type of media stream can be used this way.
第二种方式：将检测到的静音段确定为原始媒体流中的空白位置。对于音频类型的媒体流可以采用这种方式。The second way: determine the detected silence segment as a blank location in the original media stream. This can be done for audio type media streams.
第三种方式：将检测到的过渡段确定为原始媒体流中的空白位置。对于音频类型的媒体流或者视频类型的媒体流可以采用这种方式。The third way: determine the detected transition segment as a blank location in the original media stream. This can be done for audio-type media streams or video-type media streams.
第四种方式：将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流中的空白位置。对于音频类型的媒体流或者连续播放的图片这种媒体流可以采用这种方式。The fourth way is to determine the position between the I frame and the previous frame in the original media stream as a blank position in the original media stream. This can be done for media streams of audio type or continuously played pictures.
干扰加载单元02负责在原始媒体流中加载位置加载干扰媒体，形成待传输的媒体流。对于音频类型的媒体流，加载的干扰媒体可以是干扰音或广告音等。对于视频类型的媒体流，加载的干扰媒体可以是干扰画面或广告画面等。对于连续播放的图片类型的媒体流，加载的干扰媒体可以是干扰图片或广告图片等。The interference loading unit 02 is responsible for loading the location loading interference media in the original media stream to form a media stream to be transmitted. For audio type media streams, the loaded interference media can be interfering tones or advertising tones, and the like. For a video type media stream, the loaded interference media may be an interference screen or an advertisement screen or the like. For a media stream of a continuously played picture type, the loaded interference media may be an interference picture or an advertisement picture or the like.
干扰加载单元02可以具体采用以下方式： The interference loading unit 02 can specifically adopt the following methods:
第一种方式：将原始媒体流和干扰媒体进行解压缩后，依据加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据进行压缩处理。The first method: after decompressing the original media stream and the interference media, combining the data decompressed by the interference media with the data decompressed by the original media stream according to the loading location, and compressing the combined data.
这种方式可以适用于音频类型的媒体流或视频类型的媒体流。对于音频类型的媒体流，原始音频流和干扰音频分别解压缩得到PCM数据，将原始音频流的PCM数据和干扰音频的PCM数据依据位置确定单元01确定出的加载位置进行组合，然后对组合后的PCM数据进行压缩处理，形成待传输的音频流。对于视频类型的媒体流，原始视频流和干扰画面分别解压缩得到YUV数据，将原始视频流的YUV数据和干扰画面的YUV数据依据位置确定单元01确定出的加载位置进行组合，然后对组合后的YUV数据进行压缩处理，形成待传输的视频流。This method can be applied to audio type media streams or video type media streams. For the audio type media stream, the original audio stream and the interference audio are respectively decompressed to obtain PCM data, and the PCM data of the original audio stream and the PCM data of the interference audio are combined according to the loading position determined by the position determining unit 01, and then combined. The PCM data is compressed to form an audio stream to be transmitted. For the media stream of the video type, the original video stream and the interference picture are respectively decompressed to obtain YUV data, and the YUV data of the original video stream and the YUV data of the interference picture are combined according to the loading position determined by the position determining unit 01, and then combined. The YUV data is compressed to form a video stream to be transmitted.
第二种方式：依据加载位置将原始媒体流与干扰媒体直接进行组合，其中原始媒体流与干扰媒体流采用相同的压缩处理方法。也就是说，在压缩域对原始媒体流与干扰媒体流进行组合，这种方式可以适用于音频、视频和连续播放的图片的媒体流。The second method: directly combining the original media stream and the interference media according to the loading location, wherein the original media stream and the interference media stream adopt the same compression processing method. That is to say, the original media stream and the interfering media stream are combined in the compressed domain, which can be applied to audio, video and media streams of continuously played pictures.
发送单元03负责将加载位置信息发送给授权的客户端，以便客户端播放待传输的媒体流。其中加载位置信息可以采用时间或者字节等来标识加载位置。The sending unit 03 is responsible for transmitting the loading location information to the authorized client, so that the client plays the media stream to be transmitted. The loading location information may identify the loading location by time or byte.
待传输的媒体流可以通过API发送给授权的客户端，也可以通过文件方式发送给授权的客户端。如果待传输的媒体流通过API发送给授权的客户端，则发送单元03可以在API文件中携带加载位置信息。如果待传输的媒体流通过文件方式发送给授权的客户端，则发送单元03可以在媒体流的MetaData中携带加载位置信息。这样授权的客户端就能够获 取到媒体流对应的干扰媒体加载位置信息。The media stream to be transmitted can be sent to the authorized client through the API, or can be sent to the authorized client through the file. If the media stream to be transmitted is sent to the authorized client through the API, the sending unit 03 may carry the loading location information in the API file. If the media stream to be transmitted is sent to the authorized client by means of a file, the sending unit 03 may carry the loading location information in the MetaData of the media stream. Such authorized clients will be able to obtain The interference media loading location information corresponding to the media stream is obtained.
图4为本发明实施例提供的设置于客户端的装置结构图，如图4中所示，该装置可以包括：接收单元11和媒体流处理单元12。4 is a structural diagram of an apparatus installed on a client according to an embodiment of the present invention. As shown in FIG. 4, the apparatus may include: a receiving unit 11 and a media stream processing unit 12.
接收单元11负责接收服务器端发送的干扰媒体的加载位置信息。如果服务器端通过API发送媒体流，那么接收单元11可以从API文件中获取该媒体流中干扰媒体的加载位置信息。如果服务器端通过文件方式发送媒体流，那么接收单元11可以从媒体流的MetaData中获取干扰媒体的加载位置信息。The receiving unit 11 is responsible for receiving loading location information of the interference media sent by the server. If the server sends the media stream through the API, the receiving unit 11 may obtain the loading location information of the interference media in the media stream from the API file. If the server sends the media stream by file, the receiving unit 11 may obtain the loading location information of the interference media from the MetaData of the media stream.
媒体流处理单元12负责依据加载位置信息，在播放媒体流的过程中跳过对应的加载位置。The media stream processing unit 12 is responsible for skipping the corresponding loading location in the process of playing the media stream according to the loading location information.
对应于服务器端对干扰媒体的两种加载方式，这里媒体流处理单元12可以采用以下两种方式实现：Corresponding to the two loading modes of the server to the interference media, the media stream processing unit 12 can be implemented in the following two ways:
第一种方式：如图4中所示，媒体流处理单元12可以具体包括：第一解压缩子单元41和第一播放子单元42。其中第一解压缩子单元41对媒体流进行解压缩，第一播放子单元42跳过干扰媒体的加载位置对解压缩后得到的媒体流进行播放。The first mode: as shown in FIG. 4, the media stream processing unit 12 may specifically include: a first decompression subunit 41 and a first play subunit 42. The first decompressing sub-unit 41 decompresses the media stream, and the first playing sub-unit 42 skips the loading position of the interfering medium to play the decompressed media stream.
这种方式适用于音频类型的媒体流或视频类型的媒体流。对于音频类型的媒体流，对媒体流进行解压缩后，得到的是音频流的PCM数据和干扰音频的PCM数据的组合，跳过干扰媒体的加载位置对解压缩后的PCM数据进行播放，也就是仅对音频流的PCM数据进行播放。对于视频类型的媒体流，对媒体流进行解压缩后，得到的是视频流的YUV数据和干扰画面的YUV数据的组合，跳过干扰媒体的加载位置对解压缩后的YUV数据进行播放，也就是仅对视频流的PCM数据进行播放。 This method is suitable for audio-type media streams or video-type media streams. For the audio stream of the audio type, after decompressing the media stream, a combination of the PCM data of the audio stream and the PCM data of the interfering audio is obtained, and the decompressed PCM data is played by skipping the loading position of the interfering medium. That is, only the PCM data of the audio stream is played. For the video stream of the video type, after decompressing the media stream, a combination of the YUV data of the video stream and the YUV data of the interference picture is obtained, and the loaded position of the interfering medium is skipped to play the decompressed YUV data. That is, only the PCM data of the video stream is played.
第二种方式：如图5中所示，媒体流处理单元12可以包括第二解压缩子单元51和第二播放子单元52。其中，第二解压缩子单元51跳过干扰媒体的加载位置对媒体流进行解压缩，第二播放子单元52对解压缩后得到的原始媒体流进行播放。这种方式适用于音频、视频和连续播放的图片的媒体流，实际上就是跳过干扰媒体仅对原始媒体流的部分进行解压缩，得到原始媒体流的部分再进行播放。Second way: As shown in FIG. 5, the media stream processing unit 12 may include a second decompression subunit 51 and a second play subunit 52. The second decompressing sub-unit 51 decompresses the media stream by skipping the loading position of the interfering medium, and the second playing sub-unit 52 plays the original media stream obtained after decompressing. This method is applicable to media streams of audio, video, and continuously played pictures. In fact, skipping the interfering media only decompresses portions of the original media stream, and then obtains portions of the original media stream for playback.
这样，客户端就能够还原播放出原始的媒体流，其中不再包含干扰媒体。In this way, the client can restore the original media stream, which no longer contains interference media.
由以上描述可以看出，本发明提供的方法和装置可以具备以下优点：As can be seen from the above description, the method and apparatus provided by the present invention can have the following advantages:
1)本发明中只要是授权的客户端都能够正常播放出原始多媒体流，质量不受损且不受播放平台的限制，提高了用户体验。1) In the present invention, as long as the authorized client can play the original multimedia stream normally, the quality is not damaged and is not restricted by the playing platform, thereby improving the user experience.
2)客户端在播放媒体流的过程中仅需要跳过干扰媒体的加载位置，无需复杂的算法，降低了资源和性能消耗。2) The client only needs to skip the loading position of the interfering media in the process of playing the media stream, and does not need complicated algorithms, thereby reducing resource and performance consumption.
3)未授权的客户端虽然也可以播放媒体流，但其中会包含干扰媒体，牺牲了用户体验，对于恶意抓取显然无法进行有效利用，对于无价值传播也不能达到应有的效果。3) Although the unauthorized client can also play the media stream, it will contain the interference media, sacrificing the user experience. It is obviously unable to effectively use the malicious crawling, and it can not achieve the desired effect for the valueless communication.
在本发明所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division, and the actual implementation may have another division manner.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其 中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Can choose according to actual needs Some or all of the units are used to achieve the objectives of the solution of the embodiment.
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
上述以软件功能单元的形式实现的集成的单元，可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明保护的范围之内。 The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are made within the spirit and principles of the present invention, should be included in the present invention. Within the scope of protection.

Claims (21)

  1. 一种多媒体资源的保护方法，其特征在于，该方法包括：A method for protecting a multimedia resource, the method comprising:
    根据原始媒体流中的空白位置确定干扰媒体的加载位置；Determining a loading location of the interfering media according to a blank location in the original media stream;
    在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；Loading the interference media in the loading location in the original media stream to form a media stream to be transmitted;
    将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。Sending the loading location information to an authorized client, so that the authorized client plays the media stream to be transmitted.
  2. 根据权利要求1所述的方法，其特征在于，所述根据原始媒体流中的空白位置确定干扰媒体的加载位置包括：The method according to claim 1, wherein the determining, according to the blank position in the original media stream, the loading location of the interference medium comprises:
    从所述原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置；或者，Randomly selecting one or more blank locations from the original media stream as loading locations for interfering media; or
    将所述原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置；或者，One or more blank locations manually designated in the original media stream are used as loading locations for interfering media; or
    按照预设的选取规则从所述原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。One or more blank locations are selected from the original media stream as preset loading rules according to a preset selection rule.
  3. 根据权利要求1或2所述的方法，其特征在于，所述原始媒体流中的空白位置采用以下方式确定：The method according to claim 1 or 2, wherein the blank position in the original media stream is determined in the following manner:
    获取人工指定的空白位置；或者，Get a manually specified white space; or,
    将检测到的静音段确定为原始媒体流中的空白位置；或者，Determining the detected silence segment as a blank location in the original media stream; or,
    将检测到的过渡段确定为原始媒体流中的空白位置；Determining the detected transition segment as a blank location in the original media stream;
    将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流中的空白位置。The position between the I frame and the previous frame in the original media stream is determined as a blank position in the original media stream.
  4. 根据权利要求1所述的方法，其特征在于，所述在原始媒体流中所述加载位置加载干扰媒体包括： The method according to claim 1, wherein the loading location loading interference media in the original media stream comprises:
    将原始媒体流和干扰媒体进行解压缩后，依据所述加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据进行压缩处理；或者，After decompressing the original media stream and the interference media, combining the data decompressed by the interference media with the data decompressed by the original media stream according to the loading location, and compressing the combined data; or
    依据所述加载位置将原始媒体流与干扰媒体直接进行组合，其中所述原始媒体流与干扰媒体流采用相同的压缩处理方法。The original media stream is directly combined with the interference media according to the loading location, wherein the original media stream and the interference media stream adopt the same compression processing method.
  5. 根据权利要求1、2或4所述的方法，其特征在于，将所述加载位置信息发送给授权的客户端包括：The method according to claim 1, 2 or 4, wherein the sending the loading location information to the authorized client comprises:
    以文件形式发送所述待传输的媒体流给授权的客户端，在所述待传输的媒体流的元数据中携带所述加载位置信息；或者，Transmitting the media stream to be transmitted to the authorized client in a file format, and carrying the loading location information in the metadata of the media stream to be transmitted; or
    通过应用程序编程接口API发送所述待传输的媒体流给授权的客户端，在API文件中携带所述加载位置信息。The media stream to be transmitted is sent to the authorized client through the application programming interface API, and the loading location information is carried in the API file.
  6. 一种多媒体资源的保护方法，其特征在于，该方法包括：A method for protecting a multimedia resource, the method comprising:
    接收服务器端发送的干扰媒体的加载位置信息；Receiving loading location information of the interference medium sent by the server;
    依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。According to the loading location information, the corresponding loading location is skipped during the playback of the media stream.
  7. 根据权利要求6所述的方法，其特征在于，所述接收服务器端发送的干扰媒体的加载位置信息包括：The method according to claim 6, wherein the loading location information of the interference media sent by the receiving server comprises:
    接收服务器端以文件形式发送的媒体流，从媒体流的元数据中获取干扰媒体的加载位置信息；或者，Receiving a media stream sent by the server in the form of a file, and acquiring loading location information of the interference media from the metadata of the media stream; or
    通过API接收服务器端发送的媒体流，从API文件中获取干扰媒体的加载位置信息。The media stream sent by the server is received through the API, and the loading location information of the interfering media is obtained from the API file.
  8. 根据权利要求6或7所述的方法，其特征在于，在播放媒体流的过程中跳过所述干扰媒体的加载位置包括： The method according to claim 6 or 7, wherein skipping the loading location of the interfering medium during the playing of the media stream comprises:
    对所述媒体流进行解压缩，跳过所述干扰媒体的加载位置对解压缩后得到的媒体流进行播放；或者，Decompressing the media stream, skipping the loading location of the interference media, and playing the media stream obtained after decompression; or
    跳过所述干扰媒体的加载位置对所述媒体流进行解压缩，对解压缩后得到的原始媒体流进行播放。The media stream is decompressed by skipping the loading location of the interference medium, and the original media stream obtained after decompression is played.
  9. 一种多媒体资源的保护装置，其特征在于，该装置包括：A device for protecting a multimedia resource, the device comprising:
    位置确定单元，用于根据原始媒体流中的空白位置确定干扰媒体的加载位置；a location determining unit, configured to determine, according to a blank location in the original media stream, a loading location of the interference medium;
    干扰加载单元，用于在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；An interference loading unit, configured to load interference media in the loading location in the original media stream to form a media stream to be transmitted;
    发送单元，用于将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。And a sending unit, configured to send the loading location information to the authorized client, so that the authorized client plays the media stream to be transmitted.
  10. 根据权利要求9所述的装置，其特征在于，所述位置确定单元，具体用于从所述原始媒体流中随机选择一个或多于一个的空白位置作为干扰媒体的加载位置；或者，The device according to claim 9, wherein the location determining unit is configured to randomly select one or more blank locations from the original media stream as loading locations of interference media; or
    将所述原始媒体流中人工指定的一个或多于一个的空白位置作为干扰媒体的加载位置；或者，One or more blank locations manually designated in the original media stream are used as loading locations for interfering media; or
    按照预设的选取规则从所述原始媒体流中选择一个或多于一个的空白位置作为干扰媒体的加载位置。One or more blank locations are selected from the original media stream as preset loading rules according to a preset selection rule.
  11. 根据权利要求9或10所述的装置，其特征在于，所述位置确定单元采用以下方式确定所述原始媒体流中的空白位置：The apparatus according to claim 9 or 10, wherein said location determining unit determines a blank location in said original media stream in the following manner:
    获取人工指定的空白位置；或者，Get a manually specified white space; or,
    将检测到的静音段确定为原始媒体流中的空白位置；或者，Determining the detected silence segment as a blank location in the original media stream; or,
    将检测到的过渡段确定为原始媒体流中的空白位置； Determining the detected transition segment as a blank location in the original media stream;
    将原始媒体流中I帧与其前一帧之间的位置确定为原始媒体流中的空白位置。The position between the I frame and the previous frame in the original media stream is determined as a blank position in the original media stream.
  12. 根据权利要求9所述的装置，其特征在于，所述干扰加载单元，具体用于将原始媒体流和干扰媒体进行解压缩后，依据所述加载位置将干扰媒体解压缩后的数据与原始媒体流解压缩后的数据进行组合，将组合后的数据进行压缩处理；或者，The device according to claim 9, wherein the interference loading unit is configured to: after decompressing the original media stream and the interference media, and decompressing the data and the original media according to the loading location The stream-decompressed data is combined to compress the combined data; or,
    依据所述加载位置将原始媒体流与干扰媒体直接进行组合，其中所述原始媒体流与干扰媒体流采用相同的压缩处理方法。The original media stream is directly combined with the interference media according to the loading location, wherein the original media stream and the interference media stream adopt the same compression processing method.
  13. 根据权利要求9、10或12所述的装置，其特征在于，所述发送单元，具体用于以文件形式发送所述待传输的媒体流给授权的客户端，在所述待传输的媒体流的元数据中携带所述加载位置信息；或者，The device according to claim 9, 10 or 12, wherein the sending unit is configured to send the media stream to be transmitted to an authorized client in a file format, in the media stream to be transmitted. Carrying the loading location information in the metadata; or
    通过API发送所述待传输的媒体流给授权的客户端，在API文件中携带所述加载位置信息。Sending, by the API, the media stream to be transmitted to the authorized client, and carrying the loading location information in the API file.
  14. 一种多媒体资源的保护装置，其特征在于，该装置包括：A device for protecting a multimedia resource, the device comprising:
    接收单元，用于接收服务器端发送的干扰媒体的加载位置信息；a receiving unit, configured to receive loading location information of the interference media sent by the server;
    媒体流处理单元，用于依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。The media stream processing unit is configured to skip the corresponding loading location in the process of playing the media stream according to the loading location information.
  15. 根据权利要求14所述的装置，其特征在于，所述接收单元，具体用于接收服务器端以文件形式发送的媒体流，从媒体流的元数据中获取干扰媒体的加载位置信息；或者，The device according to claim 14, wherein the receiving unit is configured to receive a media stream that is sent by the server in a file format, and obtain loading location information of the interference media from the metadata of the media stream; or
    通过API接收服务器端发送的媒体流，从API文件中获取干扰媒体的加载位置信息。The media stream sent by the server is received through the API, and the loading location information of the interfering media is obtained from the API file.
  16. 根据权利要求14或15所述的装置，其特征在于，所述媒体流 处理单元包括：Apparatus according to claim 14 or 15, wherein said media stream The processing unit includes:
    第一解压缩子单元，用于对所述媒体流进行解压缩；a first decompressing subunit, configured to decompress the media stream;
    第一播放子单元，用于跳过所述干扰媒体的加载位置对解压缩后得到的媒体流进行播放。The first play subunit is configured to skip the loading position of the interference media and play the media stream obtained after the decompression.
  17. 根据权利要求14或15所述的装置，其特征在于，所述媒体流处理单元包括：The device according to claim 14 or 15, wherein the media stream processing unit comprises:
    第二解压缩子单元，用于跳过所述干扰媒体的加载位置对所述媒体流进行解压缩；a second decompression subunit, configured to decompress the media stream by skipping a loading location of the interference medium;
    第二播放子单元，用于对解压缩后得到的原始媒体流进行播放。The second play subunit is configured to play the original media stream obtained after decompression.
  18. 一种设备，包括a device, including
    一个或者多个处理器；One or more processors;
    存储器；Memory
    一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时：One or more programs, the one or more programs being stored in the memory, when executed by the one or more processors:
    根据原始媒体流中的空白位置确定干扰媒体的加载位置；Determining a loading location of the interfering media according to a blank location in the original media stream;
    在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；Loading the interference media in the loading location in the original media stream to form a media stream to be transmitted;
    将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。Sending the loading location information to an authorized client, so that the authorized client plays the media stream to be transmitted.
  19. 一种设备，包括a device, including
    一个或者多个处理器；One or more processors;
    存储器；Memory
    一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时： One or more programs, the one or more programs being stored in the memory, when executed by the one or more processors:
    接收服务器端发送的干扰媒体的加载位置信息；Receiving loading location information of the interference medium sent by the server;
    依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。According to the loading location information, the corresponding loading location is skipped during the playback of the media stream.
  20. 一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备：A non-volatile computer storage medium storing one or more programs, when the one or more programs are executed by a device, causing the device to:
    根据原始媒体流中的空白位置确定干扰媒体的加载位置；Determining a loading location of the interfering media according to a blank location in the original media stream;
    在原始媒体流中所述加载位置加载干扰媒体，形成待传输的媒体流；Loading the interference media in the loading location in the original media stream to form a media stream to be transmitted;
    将所述加载位置信息发送给授权的客户端，以便所述授权的客户端播放所述待传输的媒体流。Sending the loading location information to an authorized client, so that the authorized client plays the media stream to be transmitted.
  21. 一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备：A non-volatile computer storage medium storing one or more programs, when the one or more programs are executed by a device, causing the device to:
    接收服务器端发送的干扰媒体的加载位置信息；Receiving loading location information of the interference medium sent by the server;
    依据所述加载位置信息，在播放媒体流的过程中跳过对应的加载位置。 According to the loading location information, the corresponding loading location is skipped during the playback of the media stream.
PCT/CN2015/086620 2014-12-19 2015-08-11 Multimedia resource protection method, device, apparatus and computer storage medium WO2016095539A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410803358.8A CN104573413B (en) 2014-12-19 2014-12-19 A kind of guard method of multimedia resource and device
CN201410803358.8 2014-12-19

Publications (1)

Publication Number Publication Date
WO2016095539A1 true WO2016095539A1 (en) 2016-06-23

Family

ID=53089459

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/086620 WO2016095539A1 (en) 2014-12-19 2015-08-11 Multimedia resource protection method, device, apparatus and computer storage medium

Country Status (2)

Country Link
CN (1) CN104573413B (en)
WO (1) WO2016095539A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104573413B (en) * 2014-12-19 2018-01-09 北京音之邦文化科技有限公司 A kind of guard method of multimedia resource and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120066768A1 (en) * 2010-09-13 2012-03-15 Rovi Technologies Corporation Protection of internet delivered media
US20120151215A1 (en) * 2010-12-09 2012-06-14 Electronics And Telecommunications Research Institute Apparatus and method for protecting copyright of digital content, and apparatus and method for determining authenticity of digital content
CN103986979A (en) * 2014-05-14 2014-08-13 快车科技有限公司 Copyright protection method and system
CN103985388A (en) * 2014-04-17 2014-08-13 苏州乐聚一堂电子科技有限公司 Intelligent audio scrambling method and control device
CN104573413A (en) * 2014-12-19 2015-04-29 百度在线网络技术（北京）有限公司 Multimedia resource protection method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101558645B (en) * 2006-12-11 2012-05-23 汤姆森特许公司 Text-based anti-piracy system and method for digital cinema
JP2010512709A (en) * 2006-12-11 2010-04-22 トムソン ライセンシング Visible piracy prevention system and method for digital cinema
CN104065977B (en) * 2014-06-06 2018-05-15 北京音之邦文化科技有限公司 Audio/video file processing method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120066768A1 (en) * 2010-09-13 2012-03-15 Rovi Technologies Corporation Protection of internet delivered media
US20120151215A1 (en) * 2010-12-09 2012-06-14 Electronics And Telecommunications Research Institute Apparatus and method for protecting copyright of digital content, and apparatus and method for determining authenticity of digital content
CN103985388A (en) * 2014-04-17 2014-08-13 苏州乐聚一堂电子科技有限公司 Intelligent audio scrambling method and control device
CN103986979A (en) * 2014-05-14 2014-08-13 快车科技有限公司 Copyright protection method and system
CN104573413A (en) * 2014-12-19 2015-04-29 百度在线网络技术（北京）有限公司 Multimedia resource protection method and device

Also Published As

Publication number Publication date
CN104573413B (en) 2018-01-09
CN104573413A (en) 2015-04-29

Similar Documents

Publication Publication Date Title
US7072493B2 (en) Robust and stealthy video watermarking into regions of successive frames
US20060107056A1 (en) Techniques to manage digital media
US7496676B2 (en) Methods, data structures, and systems for processing media data streams
US20130042100A1 (en) Method and apparatus for forced playback in http streaming
JP4371245B2 (en) Image processing device
US20050163483A1 (en) Piracy prevention system
WO2021072878A1 (en) Audio/video data encryption and decryption method and apparatus employing rtmp, and readable storage medium
US20170329986A1 (en) Method and device for processing multimedia file
US7899752B2 (en) Method and system for preventing skipping playback of a special content section of a digital media stream
US20130003963A1 (en) Thwarting Unauthorized Content Copying Using Media Tracking Code
WO2016095539A1 (en) Multimedia resource protection method, device, apparatus and computer storage medium
US20130064288A1 (en) Secured content distribution
US20070086033A1 (en) Media distribution methods and systems with quality degradation
EP3985989A1 (en) Detection of modification of an item of content
CN101267624A (en) Method for storing stream media of TD mobile phone
KR101564421B1 (en) Device and method of processing videos
CN108449601B (en) Transmission method and device of movie data
US20220201372A1 (en) Live video streaming architecture with real-time frame and subframe level live watermarking
JP2021522759A (en) DRM content packaging device and DRM content packaging system including it and DRM content packaging method
KR102484385B1 (en) Image encoding apparatus and image decoding apparatus and methods of operations thereof
CN111698534B (en) Video processing method and device, electronic equipment and storage medium
JP2014175757A (en) Digital watermark processing system for generating digital watermark by coupling divided elements, server, program and method
KR20180099110A (en) Method and apparatus for video watermarking based on hash chain
JP2010068145A (en) Data transmitting device, data transmitting method, and data transmitting program, and data receiving device, data receiving method, and data receiving program, and data communication system
US8677001B2 (en) Streaming transmission method system, data processing apparatus and computer readable storage medium for making unwanted and malicious data unexecutable from voice or animation data streams

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15869050

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 13/10/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15869050

Country of ref document: EP

Kind code of ref document: A1