CN117579905A - Object management method based on multimedia data and related equipment - Google Patents

Object management method based on multimedia data and related equipment Download PDF

Info

Publication number
CN117579905A
CN117579905A CN202311418595.8A CN202311418595A CN117579905A CN 117579905 A CN117579905 A CN 117579905A CN 202311418595 A CN202311418595 A CN 202311418595A CN 117579905 A CN117579905 A CN 117579905A
Authority
CN
China
Prior art keywords
multimedia
data
segment
multimedia data
watermark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311418595.8A
Other languages
Chinese (zh)
Inventor
董磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202311418595.8A priority Critical patent/CN117579905A/en
Publication of CN117579905A publication Critical patent/CN117579905A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018Audio watermarking, i.e. embedding inaudible data in the audio signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Security & Cryptography (AREA)
  • Editing Of Facsimile Originals (AREA)

Abstract

The embodiment of the application discloses a method and related equipment for object management based on multimedia data, wherein the method comprises the following steps: acquiring multimedia data to be detected, wherein the multimedia data to be detected comprises a plurality of multimedia fragments, and at least one multimedia fragment of two adjacent multimedia fragments contains a watermark; based on the multimedia fragments containing watermarks in the two adjacent multimedia fragments, performing time length identification processing on each multimedia fragment to obtain the fragment time length of each multimedia fragment; combining segment durations of a plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected; an object that propagates the multimedia data to be detected is identified based on the object identification sequence. The technical scheme of the embodiment of the application can accurately position the object for transmitting the multimedia data.

Description

Object management method based on multimedia data and related equipment
Technical Field
The present invention relates to the field of computers and communication technologies, and more particularly, to a multimedia data-based object management method, a multimedia data-based object management apparatus, an electronic device, a computer-readable medium, and a computer program product.
Background
With the development of internet technology, illegal distribution of multimedia data is also becoming rampant. In the related art, the copyright of multimedia data is mainly protected by adding a watermark. However, it is difficult to accurately locate an object downloading or recording multimedia data only by watermarking in the multimedia data. Therefore, how to accurately locate the object that propagates the multimedia data is a problem that needs to be solved.
Disclosure of Invention
Embodiments of the present application provide a multimedia data-based object management method, a multimedia data-based object management apparatus, an electronic device, a computer-readable medium, and a computer program product, which can accurately locate an object that propagates multimedia data.
Other features and advantages of the present application will be apparent from the following detailed description, or may be learned in part by the practice of the application.
In a first aspect, an embodiment of the present application provides an object management method based on multimedia data, including:
acquiring multimedia data to be detected, wherein the multimedia data to be detected comprises a plurality of multimedia fragments, and at least one multimedia fragment of two adjacent multimedia fragments contains a watermark;
Based on the multimedia fragments containing watermarks in the two adjacent multimedia fragments, performing time length identification processing on each multimedia fragment to obtain the fragment time length of each multimedia fragment;
combining segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected;
and identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
In a second aspect, an embodiment of the present application provides an object management apparatus based on multimedia data, where the apparatus includes an acquisition unit, an identification unit, and a processing unit, where:
the acquisition unit is used for acquiring multimedia data to be detected, wherein the multimedia data to be detected comprises a plurality of multimedia fragments, and at least one of two adjacent multimedia fragments contains a watermark;
the identification unit is used for carrying out time length identification processing on each multimedia fragment based on the multimedia fragments containing watermarks in the two adjacent multimedia fragments to obtain the fragment time length of each multimedia fragment;
the processing unit is used for combining the segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected;
The processing unit is further used for identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
In a third aspect, embodiments of the present application provide an electronic device comprising one or more processors; and storage means for storing one or more computer programs which, when executed by the one or more processors, cause the electronic device to implement the multimedia data based object management method as described above.
In a fourth aspect, embodiments of the present application provide a computer-readable medium having stored thereon a computer program which, when executed by a processor of an electronic device, causes the electronic device to perform the object management method based on multimedia data as described above.
In a fifth aspect, embodiments of the present application provide a computer program product comprising a computer program stored in a computer readable medium, from which a processor of an electronic device reads and executes the computer program, causing the electronic device to perform the multimedia data based object management method as described above.
In the technical solution provided in the embodiments of the present application, the acquired multimedia data to be detected may be divided into a plurality of multimedia fragments by watermarking, because the multimedia data to be detected, at the stage of being pushed to the client of the object, has already established the association between the multimedia data to be detected and the object identification sequence of the object by the fragment duration of the plurality of multimedia fragments in the multimedia data to be detected. Therefore, the embodiment of the application can identify and divide the plurality of multimedia fragments of the multimedia data to be detected through the watermark. Then, the corresponding object identification sequence can be obtained according to the segment time lengths by further identifying the segment time length of each multimedia segment, so that the aim of accurately identifying the object spreading the multimedia data to be detected is fulfilled.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. It is evident that the figures in the following description are only some embodiments of the present application, from which other figures can be obtained without inventive effort for a person skilled in the art. In the drawings:
Fig. 1 is a schematic structural diagram of an object management system based on multimedia data according to an embodiment of the present application;
fig. 2 is a flow chart of an object management method based on multimedia data according to an embodiment of the present application;
fig. 3 is a schematic diagram of a correspondence between a segment duration and an identification character according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a correspondence between segment duration and identification characters according to another embodiment of the present disclosure;
FIG. 5 is a schematic diagram of a correspondence between segment durations and identification characters according to another embodiment of the present application;
fig. 6 is a flowchart of another object management method based on multimedia data according to an embodiment of the present application;
FIG. 7 is a schematic diagram of an encryption interface according to an embodiment of the present application;
fig. 8 is a schematic diagram of a process for acquiring a multimedia segment according to an embodiment of the present application;
FIG. 9 is a diagram of multimedia data including an end-of-sequence segment according to an embodiment of the present application;
fig. 10 is a schematic diagram of a slicing process of multimedia data according to an embodiment of the present application;
FIG. 11 is a schematic diagram of a process for identifying a propagation object according to an embodiment of the present application;
fig. 12 is a block diagram of an object management apparatus based on multimedia data according to an embodiment of the present application;
Fig. 13 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the content and operations/, nor do they necessarily have to be performed in the order described. For example, some operations may be decomposed, and some operations may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
Also to be described is: reference to "a plurality" in this application means two or more than two. "and/or" describes an association relationship of an association object, meaning that there may be three relationships, e.g., a and/or B may represent: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
Multimedia data refers to data formed from data in one or more media forms. In particular, media forms may include images, sounds, text, and the like. For example, the multimedia data may be video, audio, and the like.
With the development of the internet, people frequently contact various multimedia data every day, so that illegal transmission of the multimedia data is also becoming more and more serious. At present, the copyright of the multimedia data is mainly protected by adding a watermark. Among them, watermarking is a technique of adding identification information to digital media, and is generally used for protecting copyrights and preventing piracy. The watermark may be in the form of text, images, audio, etc., embedded in the digital media for identification in subsequent use and dissemination. However, it is difficult to accurately locate an object downloading or recording multimedia data only by watermarking in the multimedia data.
Further, the objects for transmitting the multimedia data can be positioned by transmitting the multimedia data containing different watermarks to different objects. The server operating pressure is caused by storing one watermark version of the multimedia data for each object; then, the multimedia data is required to be watermarked according to the watermarks corresponding to different objects at the cloud end, and the watermarked multimedia data is sent to the terminal equipment used by the corresponding objects.
Whether a bright watermark (watermark visible to an object) or a dark watermark (watermark hidden in multimedia data and not directly visible to the object) is added through the cloud, a certain transmission delay is caused in the watermark adding process, and the audiovisual experience is affected; meanwhile, the calculation modes of partial watermarks such as the dark watermarks are complex, so that some terminal devices cannot support the addition of the dark watermarks or output multimedia data added with the dark watermarks, and the objects using the terminal devices cannot be positioned and identified.
Based on this, the embodiment of the application provides an object management scheme based on multimedia data, in the scheme, the multimedia data pushed to each object is composed of a plurality of multimedia fragments, and at least one multimedia fragment of two adjacent multimedia fragments contains a watermark. Meanwhile, the segment duration of the multimedia segment is associated with the object identification sequence of the corresponding object.
Then, after the multimedia data to be detected is obtained, the segment duration of each multimedia segment in the multimedia data to be detected can be identified, and then the object identification sequence of the multimedia data to be detected is determined according to the segment durations of the multimedia segments, so that finally, the object for spreading the multimedia data to be detected is identified based on the object identification sequence.
Wherein the object identification sequence is used to identify a unique object. That is, the object identification sequences correspond to the objects one by one, and thus the objects that propagate the multimedia data to be detected can be identified by the object identification sequences. The multimedia data to be detected can be obtained by means of downloading or recording the identified object.
In addition, the actually acquired multimedia data to be detected is actually complete multimedia and is not directly divided into a plurality of multimedia fragments; therefore, it is necessary to determine a plurality of multimedia fragments in the multimedia data to be detected by detecting the fragments containing the watermark, the fragments not containing the watermark and/or the fragments containing different watermarks, and then determining the fragment duration of each multimedia fragment.
Then, the specific manner of identifying the segment duration of each multimedia segment in the multimedia data to be detected may be: and carrying out time length identification processing on each multimedia fragment in the multimedia data to be detected based on the multimedia fragments containing watermarks in two adjacent multimedia fragments in the multimedia data to be detected, thereby obtaining the fragment time length of each multimedia fragment in the multimedia data to be detected.
In addition, the association between the segment durations of the plurality of multimedia segments contained in one multimedia data and the object identification sequences of the respective objects may include any one of the following: the segment duration of the plurality of multimedia segments corresponds to the plurality of identification characters in the corresponding object identification sequence one by one, and the segment duration of part of the multimedia segments in the plurality of multimedia segments corresponds to the plurality of identification characters in the corresponding object identification sequence one by one.
Because the segment duration of the multimedia segment is associated with the object identification sequence of the corresponding object, the object identification sequence of the multimedia data to be detected can be obtained through the combination of the segment durations of the multimedia segments.
It can be seen that in the scheme, the segment duration of the plurality of multimedia segments contained in the multimedia data pushed to each object is associated with the object identification sequence of each object; thus, the multimedia data received by each object is different. Therefore, the method can obtain the corresponding object identification sequence according to the segment duration by identifying the segment duration of each multimedia segment in the multimedia data to be detected, thereby achieving the purpose of accurately identifying the object spreading the multimedia data to be detected.
Based on the above-mentioned object management scheme based on multimedia data, the embodiment of the present application provides an object management system based on multimedia data, and referring to fig. 1, the object management system based on multimedia data shown in fig. 1 may include a plurality of terminal devices 101 and a plurality of servers 102. Wherein, communication connection is established between any terminal equipment and any server. For example, the terminal device 101 may include any one or more of a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart car, and a smart wearable device. The terminal device 101 is internally operated with a multimedia playing client, a social client, a browser client, an information flow client, an education client, and the like. The server 102 may be a server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, web services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDNs), and basic cloud computing services such as big data and artificial intelligence platforms. Any terminal device 101 and any server 102 may be directly or indirectly connected through wired or wireless communication, which is not limited herein.
In some embodiments, the above-mentioned object management method based on multimedia data may be executed only by the server 102 in the object management system based on multimedia data shown in fig. 1, and specifically the execution process is as follows: the server 102 may obtain the multimedia data to be detected, where the multimedia data to be detected includes a plurality of multimedia segments, and at least one of two adjacent multimedia segments contains a watermark. Then, the server 102 may perform a duration recognition process on each multimedia segment in the multimedia data to be detected based on the multimedia segments containing watermarks in the two adjacent multimedia segments, so as to obtain a segment duration of each multimedia segment. The server 102 may then obtain the object identification sequence of the multimedia data to be detected through the segment durations of the plurality of multimedia segments. Finally, the objects that propagate the multimedia data to be detected may be identified by the server 102 based on the object identification sequence.
Optionally, the server 102 may also monitor or disable the account number of the identified object, so as to prevent and manage the propagation of the denormal path of the multimedia data.
In other embodiments, the above-mentioned object management method based on multimedia data may be operated in an object management system based on multimedia data, and the object management system based on multimedia data may include a terminal device and a server. Specifically, the object management method based on multimedia data may be implemented by the terminal device 101 and the server 102 included in the object management system based on multimedia data shown in fig. 1, and specifically the implementation process is as follows: the terminal device 101 may acquire multimedia data to be detected; then, the terminal device 101 may send the multimedia data to be detected to the server 102, and the server 102 performs a duration identification process on each multimedia segment in the multimedia data to be detected based on the multimedia segments containing watermarks in two adjacent multimedia segments in the multimedia data to be detected, so as to obtain a segment duration of each multimedia segment; the server 102 may then obtain the object identification sequence of the multimedia data to be detected through the segment durations of the plurality of multimedia segments. Finally, the server 102 may identify the object from which the multimedia data to be detected is propagated based on the object identification sequence.
Optionally, the server 102 may also prohibit the identified object from playing any other multimedia data to avoid the object from propagating other multimedia data.
It should be noted that, the embodiments of the present application may be used to detect objects that broadcast various types of multimedia data, such as video and audio, and may be applied to various scenes, including but not limited to various scenes such as cloud technology, AI (Artificial Intelligence ), smart medical, smart school, and the like, and may also be used in any application that supports playing multimedia data, such as shopping applications, video applications, payment applications, and the like, which is not limited thereto.
Specifically, if the technical scheme of the embodiment of the application is applied to a smart school scene, the server can be a teaching server for providing data processing service for a teaching client, and the teaching client can push a lesson video of a teacher in the school. The teaching server receives the video of lessons, which belongs to the teaching client side, of the script transmitted in other websites or applications and is used as the video to be detected. The teaching server can conduct time length identification processing on each teaching fragment in the video to be detected based on the teaching fragments containing watermarks in two adjacent teaching fragments in the video to be detected, and the fragment time length of each teaching fragment is obtained.
And then, the teaching server can obtain the object identification sequence of the video to be detected through the segment duration of the plurality of teaching segments. Finally, the teaching server can identify the object for propagating the video to be detected based on the obtained object identification sequence.
For example, the technical scheme of the embodiment of the application is applied to video application, the server can be a video server for providing data processing service for the video application, and entertainment videos such as television shows, movies, cartoons and the like can be pushed in the video application. The video server may receive entertainment video within a video application that is propagated in other websites or applications and serve as the video to be detected. The video server can perform time length identification processing on each entertainment segment in the video to be detected based on the entertainment segments containing watermarks in two adjacent entertainment segments in the video to be detected, so as to obtain the segment time length of each entertainment segment.
And then, the video server can obtain the object identification sequence of the video to be detected through the segment duration of the entertainment segments. Finally, the video server may identify the object from which the video to be detected propagated based on the obtained object identification sequence.
It should be noted that, in the specific embodiment of the present application, if data such as multimedia data relates to the object, when the embodiment of the present application is applied to a specific product or technology, permission or consent of the object needs to be obtained, and collection, use and processing of the related data need to comply with relevant laws and regulations and standards of relevant countries and regions.
Various implementation details of the technical solutions of the embodiments of the present application are set forth in detail below:
as shown in fig. 2, fig. 2 is a flowchart of a multimedia data-based object management method shown in an embodiment of the present application, which may be applied to the multimedia data-based object management system shown in fig. 1, and the method may be performed by a terminal device or a server, or may be performed by both the terminal device and the server, and in an embodiment of the present application, the method is described as an example by which the method is performed by the server, wherein the object management method may include S201 to S204, which are described in detail as follows:
s201, acquiring multimedia data to be detected.
In this embodiment of the present application, the multimedia data to be detected includes a plurality of multimedia segments, and at least one of the two adjacent multimedia segments contains a watermark. If two adjacent multimedia fragments contain watermarks, the watermarks contained in the two multimedia fragments can be the same or different.
Specifically, when the multimedia data to be detected includes video, the watermark contained in the multimedia segment in the multimedia data to be detected may be an image watermark or a text watermark; when the multimedia data to be detected includes audio, the watermark contained in the multimedia fragment in the multimedia data to be detected may also be a sound watermark.
In one embodiment, the server may periodically or aperiodically detect whether new multimedia data is uploaded to the illegal distribution platform, and if so, take the new multimedia data as the multimedia data to be detected.
The illegal distribution platform refers to a platform which does not have the copyright of the multimedia data but still plays the corresponding multimedia data, and the illegal distribution platform can be determined by a manager in the process of browsing other platforms.
Alternatively, the manager may directly go to the illegal transmission platform to determine whether new multimedia data is uploaded to the illegal transmission platform, and if so, acquire the new multimedia data by means of recording or downloading; and then the manager uploads the new multimedia data to the server as the multimedia data to be detected.
S202, based on the multimedia fragments containing watermarks in two adjacent multimedia fragments in the multimedia data to be detected, performing time length identification processing on each multimedia fragment in the multimedia data to be detected to obtain the fragment time length of each multimedia fragment.
In the embodiment of the present application, since the multimedia data to be detected is composed of a plurality of continuous data segments with unit duration, it is not possible to directly determine which multimedia segments the multimedia data to be detected is divided into. However, at least one multimedia segment containing a watermark is included in two adjacent multimedia segments in the multimedia data to be detected, so that a plurality of multimedia segments contained in the multimedia data to be detected can be determined by watermark identification on each data segment, and thus the segment duration of each multimedia segment can be obtained.
The unit duration may be set manually, or may be set by a terminal device or a server in the object management system based on multimedia data, which is not limited herein. For example, when the multimedia data is video, the unit time length may be a display time length of one frame of image, or may be 1 second, 1 millisecond, or the like, which is not limited herein.
In one embodiment, the specific manner of the duration identification process may include: sequentially carrying out watermark identification processing on each data segment with unit duration in the multimedia data to be detected to obtain watermark identification results of each data segment; if the watermark identification results corresponding to the adjacent data segments are matched, identifying the adjacent data segments as the same multimedia segment; and carrying out summation operation on the unit time length of the adjacent data fragments to obtain the fragment time length of the multimedia fragments corresponding to the adjacent data fragments.
Wherein the number of adjacent data segments may comprise two or more. The fact that the watermark identification results corresponding to adjacent data segments are matched means that the watermark identification results corresponding to adjacent data segments are the same or similar.
When the multimedia data to be detected contains only one watermark, the watermark identification result corresponding to each data segment can be used for representing whether the corresponding data segment contains the watermark. When the multimedia data to be detected contains a plurality of different watermarks, the watermark identification result corresponding to each data segment can contain watermark identification information containing watermarks of the corresponding data segments; alternatively, the watermark identification result corresponding to each data segment may be used to characterize that the corresponding data segment contains watermark identification information for the watermark or that the corresponding data segment does not contain the watermark. It should be noted that a watermark identification information is used to uniquely identify a watermark.
Then, the specific manner of determining whether the watermark identification results corresponding to the adjacent data segments match may include: if the watermark identification results corresponding to the adjacent data segments are the same, the watermark identification results corresponding to the adjacent data segments are determined to be matched.
Alternatively, since the above-mentioned multimedia data may contain one or more watermarks, one of the two adjacent multimedia segments may contain a watermark, or each of the two adjacent multimedia segments may contain a watermark.
When one of two adjacent multimedia fragments contains a watermark, the specific process of watermark identification processing may include: for each unit duration data segment in the multimedia data to be detected, if the data segment is identified to have no watermark, a watermark identification result used for representing that the data segment has no watermark is obtained, and if the data segment is identified to have watermark, a watermark identification result used for representing that the data segment has watermark is obtained.
When each of two adjacent multimedia segments contains a watermark, the specific process of watermark identification may include: identifying the watermark in each data segment according to each unit time length of the data segments in the multimedia data to be detected, and acquiring watermark identification information of the watermark in each data segment; and generating a watermark identification result containing corresponding watermark identification information based on the watermark identification information of each data segment.
The watermark identification result may be generated by: the watermark identification information of each data segment is used as the watermark identification result of each data segment. Optionally, the watermark identification result may also include watermark description information for describing the watermark, and the like, which is not limited herein.
S203, combining segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected.
In the embodiment of the application, the object identification sequence includes a plurality of identification characters arranged in sequence. Wherein the identification characters may be numerals, letters, symbols, etc., and are not limited herein. For example, the object identification sequence may be "0112", or "abcd", or "I-! @water. "or" 1a2b ", etc.
In addition, the number of the plurality of multimedia fragments may be the same as the number of the identification characters contained in the object identification sequence, or the number of the plurality of multimedia fragments may be greater than the number of the identification characters contained in the object identification sequence.
In one embodiment, when the number of the plurality of multimedia fragments is the same as the number of the identification characters included in the object identification sequence, the fragment duration of the plurality of multimedia fragments may correspond one-to-one to the plurality of identification characters included in the object identification sequence.
When the identification character is a number, the number may be corresponding to the segment duration, for example, the segment duration corresponding to the number 1 is 1 second, and the segment duration corresponding to the number 2 is 2 seconds. Alternatively, since there may be a number of 0 in the object identification sequence, the segment duration of the multimedia segment cannot be 0; therefore, another corresponding relationship between the number and the segment duration can be established, for example, the segment duration corresponding to the number 0 is set to be 1 second, the segment duration corresponding to the number 1 is set to be 2 seconds, the segment duration corresponding to the number 2 is set to be 3 seconds, and the like.
Similarly, when the identification character is a symbol or a character, a correspondence between the symbol or the character and the segment duration may be established. For example, the segment duration corresponding to the letter a may be set to 0 seconds, the segment duration corresponding to the letter b may be set to 1 second, the segment duration corresponding to the letter c may be set to 3 seconds, and so on.
The generating method of the object identification sequence of the multimedia data to be detected may specifically include: determining an identification character corresponding to the segment duration of each multimedia segment in the multimedia data to be detected; and combining the identification characters corresponding to each multimedia fragment according to the play sequence of each multimedia fragment in the multimedia data to be detected, so as to obtain an object identification sequence of the multimedia data to be detected.
Optionally, the arrangement sequence of the identification characters corresponding to each multimedia segment in the object identification sequence may be the same as or different from the play sequence of each multimedia segment in the multimedia data to be detected;
if the two sequences are different, a corresponding relationship exists between the arrangement sequence of the identification characters in the object identification sequence and the play sequence of the multimedia fragments in the multimedia data to be detected. If the arrangement order of the identification characters corresponding to the last multimedia segment in the plurality of multimedia segments in the object identification sequence is the first, the arrangement order of the identification characters corresponding to the last multimedia segment in the plurality of multimedia segments in the object identification sequence is the second, and so on.
For example, referring to fig. 3, a schematic diagram of a correspondence between a segment duration and an identification character is shown. The numbers 0 to 9 may be set to correspond to the segment durations 1 to 10, respectively. As shown in fig. 3, the multimedia data 301 has a total of 9 seconds, including multimedia segments 302 to 305; wherein the white segments represent that the segments do not contain watermarks, i.e., the multimedia segments 302 and 304 do not contain watermarks; the black segments represent the watermark contained within the segments, i.e., the multimedia segment 303 and the multimedia segment 305.
The segment duration of the multimedia segment 302 is 1 second, and the corresponding identification character is 0; the segment duration of the multimedia segments 303 and 304 is 2 seconds, and the corresponding identification characters are 1; the segment duration of the multimedia segment 305 is 4 seconds and the corresponding identification character is 4. The object identification sequence may be determined to be "0113" in accordance with the play order of the multimedia fragments 302 to 305 in the multimedia data 301.
In one embodiment, when the number of the plurality of multimedia fragments is greater than the number of the identification characters contained in the object identification sequence, a fragment duration in which a part of the multimedia fragments exist in the plurality of multimedia fragments corresponds to the plurality of the identification characters contained in the object identification sequence.
Optionally, the generating process of the object identification sequence specifically may include: selecting a target multimedia segment from a plurality of multimedia segments; the target multimedia segment meets at least one of preset conditions, wherein the preset conditions comprise that the segment duration of the target multimedia segment is in a preset duration interval, and the watermark contained in the target multimedia segment is of a preset watermark type; and combining the segment duration of the target multimedia segment according to the play sequence of the target multimedia segment in the multimedia data to be detected to obtain an object identification sequence.
The preset duration interval may be set manually, or may be set by a terminal device or a server in the object management system based on multimedia data, which is not limited herein. Specifically, when the identification character in the object identification sequence is a number, the number of bits is 9 at the maximum; meanwhile, 0 cannot be represented by a multimedia segment with segment duration of 0; then the numbers 0 to 9 may be set to correspond to the segment durations 1 to 10, respectively, so that the preset duration interval may be set to 1 to 10.
For example, if the segment duration of each multimedia segment in the example shown in fig. 3 is between 1 and 10, it may be determined that each multimedia segment in the example shown in fig. 3 is a target multimedia segment.
The predetermined watermark type may be set manually, or may be set by a terminal device or a server in the object management system based on multimedia data, which is not limited herein. The number of preset watermark types may include one or more, and is not limited herein.
For example, referring to fig. 4, a schematic diagram of a correspondence between a segment duration and an identification character is shown. The numbers 0 to 9 may be set to correspond to the segment durations 1 to 10 seconds, respectively, and the preset watermark type may be set as watermark a. As shown in fig. 4, multimedia data 401 includes multimedia segments 402 to 408; wherein the white segment represents that the segment does not contain a watermark, and the black segment represents that the segment contains a watermark A.
Then, the target multimedia segment in the multimedia data 401 may be determined as multimedia segment 403, multimedia segment 405, and multimedia segment 407. Since the segment durations of the multimedia segment 403, the multimedia segment 405, and the multimedia segment 407 are 3 seconds, and 8 seconds, respectively, it can be determined that the object identification sequence is "237".
For example, referring to fig. 5, a schematic diagram of a correspondence between a segment duration and an identification character is shown. The numbers a to z may be set to correspond to segment durations of 1 to 26 seconds, respectively, the preset duration intervals of 1 to 26, and the preset watermark types including watermark a and watermark B. As shown in fig. 5, the multimedia data 501 includes multimedia fragments 502 to 509; wherein the white segment representation segment does not contain a watermark, the black segment representation segment contains a watermark A, and the gray segment representation segment contains a watermark B.
Then, the target multimedia segment in the multimedia data 501 may be determined as a multimedia segment 503, a multimedia segment 504, a multimedia segment 506, and a multimedia segment 508. Since the segment durations of the multimedia segment 503, the multimedia segment 504, the multimedia segment 506, and the multimedia segment 508 are 2 seconds, 5 seconds, and 8 seconds, respectively, it can be determined that the object identification sequence is "bbeh".
S204, identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
In this embodiment of the present application, the object identification sequence may be client identification information of an object, where the client identification information of the object is used to uniquely identify a client on which the corresponding object logs in, and the client identification information may be an account number, a proprietary number, a unique code, and the like of the object, which is not limited herein.
Then, the specific way of identifying the object propagating the multimedia data to be detected based on the object identification sequence may comprise: and determining the object with the same client identification information as the object identification sequence as an object for propagating the multimedia data to be detected.
Alternatively, the object identification sequence may be a sequence obtained by encrypting the client identification information of the object. Then, the specific way of identifying the object propagating the multimedia data to be detected based on the object identification sequence may comprise: decrypting the object identification sequence to obtain a decrypted identification sequence; and determining the object with the same client identification information as the decrypted identification sequence as an object for propagating the multimedia data to be detected.
Any way of tracing back the object identification sequence may be an encryption way, such as adding a random number to the original information. In particular, the copyright and security of digital content may be protected by DRM (Digital Rights Management, a digital rights management technique). DRM technologies may perform encryption, license management, digital signing, etc. on digital content to control the use and dissemination of the digital content. Since the processes of encrypting and decrypting the sequence are well known to those skilled in the art, they are not described in detail herein.
In one embodiment, if the client side identification information or the encrypted identification information of the object is directly used as the object identification sequence, the corresponding relationship between the fragment duration of the illegal object and the client side identification information of the illegal object is easily found by the illegal object, so that the original multimedia data obtained by downloading or recording is deeply tampered; and each multimedia data stored in a server of an application or platform such as a video application, a music application, etc. will typically have corresponding data identification information. The data identification information is used for uniquely identifying the multimedia data; the data identification information of the multimedia data may be a unique number, a unique code, etc. of the multimedia data, which is not limited herein.
Therefore, the data identification information of each multimedia data can be acquired, and then the object identification sequence of each object for each multimedia data can be obtained based on the data identification information of each multimedia data and the client identification information of each object. By the method, no rule exists among the segment durations in a plurality of different multimedia data obtained by downloading or recording the same object, so that the object is not easy to find out that the object can be positioned through the segment durations in the multimedia data, and certain concealment and safety are realized. Furthermore, the object can not deeply tamper the original multimedia data obtained by downloading or recording, which is beneficial to the follow-up accurate positioning of the object for transmitting the multimedia data.
It should be noted that, since the server does not directly store the data identification information corresponding to the multimedia data to be detected from the illegal transmission platform, the specific method for obtaining the data identification information of the multimedia data to be detected may include: and determining multimedia data with playing contents matched with the playing contents of the multimedia data to be detected in the multimedia database, and taking the data identification information of the determined multimedia data as the data identification information of the multimedia data to be detected. The multimedia data whose play content matches the play content of the multimedia data to be detected refers to multimedia data whose play content is the same as or similar to the play content of the multimedia data to be detected.
Further, based on the data identification information of any multimedia data and the client identification information of any object, a specific manner of obtaining an object identification sequence of any object for any multimedia data may include: splicing the data identification information of any multimedia data with the client identification information of any object to obtain splicing identification information; and taking the spliced identification information as an object identification sequence of any object aiming at any multimedia data. Or, the splicing identification information can be encrypted to obtain an object identification sequence of any object aiming at any multimedia data.
Then, the specific way of identifying the object propagating the multimedia data to be detected based on the object identification sequence may comprise: identifying information except the identifying information matched with the data identifying information is determined from the object identifying sequence, and the determined identifying information is taken as the client identifying information of the object.
When the object identification sequence is obtained by encrypting the spliced identification information, a specific manner of identifying the object for propagating the multimedia data to be detected based on the object identification sequence may include: decrypting the object identification sequence to obtain decrypted identification information; acquiring data identification information of multimedia data to be detected; and determining identification information except the identification information matched with the data identification information from the decrypted identification information, and taking the determined identification information as client identification information of the object.
In the embodiment of the application, the corresponding relationship between the segment duration of the multiple multimedia segments in the multimedia data to be detected and the object identification sequence of the object is established at the stage of transmitting the multimedia data to be detected to the client of the object, so that the multiple multimedia segments of the multimedia data to be detected can be identified and divided through the watermark. Therefore, the method and the device can further obtain the corresponding object identification sequence according to the segment duration by identifying the segment duration of each multimedia segment in the multimedia data to be detected, so that the aim of accurately identifying the object spreading the multimedia data to be detected is fulfilled.
In an embodiment of the present application, another object management method based on multimedia data is provided, which may be applied to the object management system based on multimedia data shown in fig. 1, and the method may be performed by a terminal device or a server, or may be performed by both the terminal device and the server, and in this embodiment of the present application, the method is described by taking the server as an example, as shown in fig. 6, a flowchart of another object management method based on multimedia data is shown, and the object management method based on multimedia data is extended on the basis of the method shown in fig. 2.
Wherein, S601 to S608 are described in detail as follows:
s601, if an acquisition request of a client of an object for the multimedia data to be pushed is detected, an object identification sequence of the object is acquired.
In the embodiment of the application, the acquisition request is sent to the server by the client of the object. The acquisition request may carry one or more of the following information: client identification information of the object, data identification information of the multimedia data to be pushed.
In particular, the client may display data content information of a plurality of multimedia data; then, when the object browses a plurality of multimedia data in the client, any multimedia data displayed by the client may be selected, and at this time, the client may use any multimedia data as the multimedia data to be pushed, and generate an acquisition request for the multimedia data to be pushed.
The data content information may be a cover of the multimedia data, a brief introduction of the multimedia data, etc., which is not limited herein. The selection operation may be a click, a sound selection, a gesture selection, etc., and is not limited herein.
In one embodiment, the specific manner of obtaining the object identification sequence of the object may include: acquiring client identification information of an object; and taking the client identification information of the object as an object identification sequence.
In one embodiment, in order to avoid the relationship between the client identification information found by the object and the segment duration of the multimedia segment in the multimedia data acquired by the object, the object identification sequence may be obtained by mapping or encrypting the client identification information.
Then, the specific way of acquiring the object identification sequence of the object may further include: acquiring client identification information of an object; encrypting the client identification information to obtain encrypted identification information; and taking the encrypted identification information as an object identification sequence.
In the specific implementation, the number can directly establish a corresponding relation with the segment duration, and the client identification information such as the object name is rarely purely digital; therefore, a redis cache (an open-source application program interface), a hash function, or the like may be used to generate a corresponding unique identification ID for each object, and the unique identification ID may be used as an object identification sequence of the corresponding object.
In one embodiment, the specific manner of obtaining the object identification sequence of the object may further include: acquiring client identification information of an object and data identification information of multimedia data to be pushed; and splicing the acquired client identification information and the data identification information to obtain spliced identification information. Then, the spliced identification information can be directly used as an object identification sequence of the object; alternatively, the splice identification information may be encrypted to obtain the object identification sequence of the object.
In practical application, the Chaochao20 algorithm (a novel encryption algorithm with strong performance is particularly remarkable on an ARM platform with a CPU as a simplified instruction set), so that the data volume generated by encryption and decryption can be reduced, the use experience can be improved, the waiting time can be reduced, the service life of a battery can be saved, and the like) can be adopted for encryption and decryption.
Referring to fig. 7, a schematic diagram of an encryption interface is shown. As shown in fig. 7, the server may output splice identification information 1231 to an input box 702 in the encryption interface 701; after the server selects "Chaochao encryption" in the encryption interface 701, in an output block 703, an object identification sequence "2377d8fd" obtained by Chaochao encrypting the splice identification information 1231 is output. In order to facilitate the subsequent establishment of the corresponding relation with the segment duration, the object identification sequence '2377 d8 fd' can be converted from hexadecimal system to decimal system, and the converted object identification sequence is '595056893'.
S602, dividing the total playing duration of the multimedia data to be pushed into a plurality of segment durations based on a plurality of identification characters contained in the object identification sequence.
In the embodiment of the application, the divided time lengths of the plurality of fragments are in one-to-one correspondence with a plurality of identification characters contained in the object identification sequence; or, the partial segment duration exists in the divided segment durations and corresponds to a plurality of identification characters contained in the object identification sequence.
In one embodiment, since the correspondence between the identification characters and the segment durations is mentioned in step S203, the specific process of dividing the segment durations may include: determining the segment duration corresponding to each identification character contained in the object identification sequence; dividing the segment duration which is the same as the segment duration corresponding to each identification character from the total play duration of the multimedia data to be pushed, and obtaining the divided segment duration; if the total playing time length has the remaining segment time length except the divided segment time length, obtaining a plurality of segment time lengths according to the divided segment time length and the remaining segment time length; if the total playing time length does not have the remaining segment time length except the divided segment time length, obtaining a plurality of segment time lengths according to the divided segment time length.
It should be noted that, the multiple segment durations divided by the total play duration may be arranged according to the play order of the multimedia segment corresponding to each segment duration in the multimedia data to be pushed.
For example, the numbers 0 to 9 may be set to correspond to the segment durations 1 to 10 seconds, respectively, and if the object identification sequence is 012, the total playing duration of the multimedia data M is 40 seconds; then, the total play time length of the multimedia data M can be divided into five segment time lengths of 20 seconds, 1 second, 2 seconds, 3 seconds, and 14 seconds.
It should be noted that, because the aforementioned identification characters have a corresponding relationship with the segment durations, the corresponding relationship limits the segment durations corresponding to the identification characters to fall into the preset duration interval. Accordingly, when dividing a plurality of segment durations, it is necessary to set that the segment durations that do not correspond to the identification characters do not fall into a preset duration interval.
In one possible implementation, for multimedia data having a relatively long total playing duration, a plurality of segment durations may be divided to correspond to one identification character contained in the object identification sequence.
Referring to the above example, if the total play time length of the multimedia data M is 120 seconds, which is relatively long with respect to the 6 second time length required for the object identification sequence 012, the total play time length of the multimedia data M may be divided into nine segment time lengths of 20 seconds, 1 second, 2 seconds, 3 seconds, 44 seconds.
It follows that the object identification sequence can be characterized several times by the divided segment durations. Because some objects cut the multimedia data first and then spread the cut multimedia data, the multimedia fragments with the fragment duration corresponding to the identifier in the object identifier sequence may be cut; in this case, the object identification sequence cannot be determined by the segment duration of the multimedia segment contained in the cut multimedia data. The method of characterizing the object identification sequence for a plurality of times by dividing a plurality of segment durations can effectively enhance the robustness of the multimedia data, and is beneficial to accurately identifying the object for transmitting the multimedia data.
In one embodiment, long videos like television shows, movies, or long broadcast audio, titles, trailers, forefront reviews, etc. are easily cropped out during the dissemination process; therefore, when the total playing duration is divided, the segment duration of the multimedia segment corresponding to the specified content such as the head, the tail, the forefront review and the like can be avoided.
Then, in the process of dividing the plurality of segment durations, the divided playing sequence may be set to be longer than or equal to the first duration at the first segment duration and/or longer than or equal to the second duration at the last segment duration; the first duration and the second duration are set based on the data content of the multimedia data to be pushed. In particular, the first time period may be set based on a time period required for a head and/or a pre-condition review of the multimedia data to be pushed, and the second time period may be set based on a time period required for a tail of the multimedia data to be pushed.
In a specific implementation, for a video with a total playing duration of 45 minutes, the head 5 minutes, the tail 5 minutes and the front review 5 minutes are removed, so that the multimedia segments of 30 minutes can be left for de-segmentation. Assuming that the client identifying information of the object includes a 14-bit number, encrypting the client identifying information results in an object identifying sequence including a 34-bit number, and the total time required is between 34 seconds and 340 seconds, which is about 5 minutes. Then, the correspondence with the above-mentioned object identification sequence 1 to 5 times may be completed in the remaining 30 minutes of multimedia data, i.e., in the remaining 30 minutes of multimedia data, each identification character contained in the object identification sequence has a segment duration of 1 to 5 multimedia segments corresponding thereto.
S603, acquiring a plurality of multimedia fragments of the multimedia data to be pushed, which are respectively matched with the duration of the plurality of fragments.
In the embodiment of the application, at least one multimedia segment of two adjacent multimedia segments among the acquired multimedia segments of the multimedia data to be pushed contains the watermark.
Wherein the multimedia clip matching any one of the plurality of clip durations may comprise: the multimedia fragments with the same fragment duration as any fragment duration, and the playing sequence in the corresponding multimedia data to be pushed is matched with the playing sequence of any fragment duration in the plurality of fragment durations.
Further, a plurality of multimedia data to be pushed may be preset in the server. The method comprises the steps that playing contents of a plurality of pieces of multimedia data to be pushed are the same, one piece of multimedia data to be pushed does not contain a watermark, and the other pieces of multimedia data to be pushed contain watermarks while the watermarks contained in different pieces of multimedia data to be pushed are different; or the playing contents of the plurality of multimedia data to be pushed are the same, and the plurality of multimedia data to be pushed all contain watermarks but have different watermarks.
It should be noted that if one piece of data to be pushed contains a watermark, the data to be pushed contains only one watermark. Specifically, when the number of other multimedia data to be pushed is 1, that is, the other multimedia data to be pushed contains a watermark; when the number of other multimedia data to be pushed is 2 or more, that is, different data to be pushed in the other multimedia data to be pushed contains different watermarks.
In one embodiment, at least one multimedia segment of two adjacent multimedia segments among the acquired multimedia segments of the multimedia data to be pushed contains a watermark; and a plurality of media data to be pushed in different categories are preset in the server. Wherein the category of media data to be pushed comprises that the media data to be pushed contains some type of watermark or does not contain a watermark.
Then, in order to ensure that at least one of the two adjacent multimedia fragments contains the watermark, the category of the data to be pushed corresponding to each fragment duration can be determined when the plurality of fragment durations are divided.
Thus, a multimedia clip that matches any of a plurality of clip durations may further comprise: and the multimedia fragments with the same fragment duration as any fragment duration, the categories of the multimedia data to be pushed which belong to the multimedia fragments with the same category as the data to be pushed corresponding to any fragment duration, and the playing sequence in the corresponding multimedia data to be pushed is matched with the playing sequence of any fragment duration in a plurality of fragment durations.
In a specific implementation, the process of obtaining the plurality of multimedia fragments of the multimedia data to be pushed may include: according to the playing sequence among the segment durations, a plurality of multimedia segments matched with the segment durations are obtained from the preset multimedia data to be pushed at intervals, and the two adjacent multimedia segments obtained by interception come from different multimedia data to be pushed.
Referring to fig. 8, a schematic diagram of a multimedia segment acquisition process is shown. As shown in fig. 8, two multimedia data 801 to be pushed and multimedia data 802 to be pushed with the same playing content are preset in the server; wherein the multimedia data to be pushed 802 contains a watermark, and the multimedia data to be pushed 801 does not contain a watermark.
The total playing duration of the multimedia data to be pushed is divided into five segment durations, and the five segment durations are respectively 12 seconds, 1 second, 2 seconds, 3 seconds and 11 seconds according to the playing sequence. Wherein three segment durations of 1 second, 2 seconds, and 3 seconds correspond to the object identification sequence "012".
The category of the data to be pushed corresponding to the first segment duration in the five segment durations can be set as no watermark, so that the category of the data to be pushed corresponding to the second segment duration can be set as watermark, and the following three segment durations respectively correspond to no watermark, watermark and no watermark. Conversely, if the category of the data to be pushed corresponding to the first segment duration is set to be watermarked, the following four segment durations respectively correspond to no watermark, no watermark and watermark.
Then, as shown in fig. 8, a multimedia clip of total 12 seconds from 0 to 12 seconds in the multimedia data 801 to be pushed may be first intercepted as a multimedia clip 803 matching the first clip duration "12 seconds"; then, the 12 th to 13 th second multimedia segment in the multimedia data 802 to be pushed is intercepted as a multimedia segment 804 matching the second segment duration of "1 second"; then, intercepting the 13 th to 15 th second multimedia segment in the multimedia data 801 to be pushed as a multimedia segment 805 matching the third segment duration of 2 seconds; and, intercepting the 15 th to 18 th second multimedia segment in the multimedia data 802 to be pushed as a multimedia segment 806 matching the fourth segment duration of "3 seconds"; finally, the multimedia segment from 18 th to 29 th seconds in the multimedia data 802 to be pushed is intercepted as a multimedia segment 807 matching the fifth segment duration of "11 seconds", so as to obtain five multimedia segments matching the above-mentioned five segment durations.
In one embodiment, according to the playing sequence among the segment durations, the specific way of intercepting the preset multimedia data to be pushed to obtain the multimedia segments matched with the segment durations at intervals may include: generating a plurality of download addresses arranged according to the playing sequence according to the duration of the plurality of fragments; and downloading the plurality of multimedia fragments from the plurality of download addresses according to the playing sequence.
The multimedia fragments corresponding to the downloading addresses come from the data to be pushed, and the fragment duration of the multimedia fragments corresponding to the downloading addresses corresponds to the fragment duration one by one.
In practical applications, the server may generate a corresponding M3U8 file (a video playlist file format for describing a plurality of media clips) according to a plurality of clip durations, where the M3U8 file may include a plurality of download addresses arranged according to a playing order, and each download address corresponds to a clip length of a downloaded multimedia clip. For example, the content of the M3U8 file may be as follows:
#EXTINF:11,
http://abcd.mm.com/index=18&start=0&end=12000&brs=0&bre=1349463;
#EXTINF:8,
http://abcf.mm.com/index=19&start=12000&end=24000&brs=1349464&bre=3332111
the EXTINF is used for representing the segment duration (unit is seconds) of the multimedia segment corresponding to the network address; for example, "EXTINF:11 "is used to indicate that the segment duration of the multimedia segment is" 11 seconds ". In addition, start and end are used to indicate the start address and end address of the multimedia segment, respectively; the brs and bre are used to indicate the start bit position and the end bit position, respectively, of the multimedia fragment in the multimedia data to be pushed to which it belongs.
Further, the server may send the M3U8 file to the client of the object, so that the client of the object obtains a plurality of download addresses by parsing the M3U8 file, and downloads the corresponding multimedia clip through the plurality of download addresses.
In practical applications, the server may split each preset multimedia data to be pushed into a corresponding plurality of transport stream files (i.e. TS files, which may also be understood as data segments of unit duration) through mp4TS protocol (a media stream encapsulation protocol).
When downloading the corresponding multimedia fragments through the download address in the M3U8 file, the client actually downloads a plurality of corresponding transport stream files through the download address to be combined into the corresponding multimedia fragments.
In a specific implementation, when transcoding multimedia data, the transcoding can be performed with a relatively small TS granularity, for example, the duration of 1 TS file can be set to be 1 second or 2 seconds, etc., and then 45 x 60 TS files can be generated from multimedia data with a duration of 45 minutes.
The TS files can be combined, for example, 2 TS files can be combined into one file piece, so that smooth playing of the client is not affected. Meanwhile, for decoding performance, in general, a TS file includes an entire gop (Group of pictures), as its name implies, a sequence of a Group of frames, and the first frame is an I-frame (i.e., a key frame, which is a complete frame in a video stream, and can be independently decoded and displayed independent of other frames).
In addition, a sequence of a set of frames includes forward predicted frames (i.e., P frames) and bi-predicted frames (i.e., B frames). Wherein, the P frame is a frame which is predicted and encoded based on the previous I frame or P frame, and only includes the difference information between the current frame and the previous frame. P frames are typically used for continuous scenes in video, such as person walking, object movement, etc. Meanwhile, a B frame is a frame predicted and encoded based on previous and following I frames or P frames, and includes difference information between a current frame and previous and following frames. B frames are commonly used for complex scenes in video, such as fast motion, shot cuts, etc.
In addition, the multimedia data may further add corresponding SEI data (Supplemental Enhancement Information, which is an auxiliary information in the h.264/AVC video coding standard, for transmitting some additional information in the video stream, such as time stamps, scene information, color space information, etc.) during the encoding process. SEI data may be encoded into any one of the video streams NALU (Network Abstraction Layer Unit), typically placed either before or after the video frames.
S604, pushing a plurality of multimedia fragments of the multimedia data to be pushed to the object.
In the embodiment of the present application, a specific manner of pushing the plurality of multimedia fragments of the multimedia data to be pushed to the object may include: and playing the corresponding multiple multimedia fragments of the multimedia data to be pushed at the client of the object according to the playing sequence of the multiple multimedia fragments of the multimedia data to be pushed.
S605, acquiring the multimedia data to be detected.
In the embodiment of the application, the multimedia data to be detected is multimedia data acquired from an illegal distribution platform. The multimedia data to be detected may be any object of the multimedia data with the same playing content as the multimedia data, and the multimedia data is obtained by downloading or recording the multimedia data and then uploaded to the illegal distribution platform.
In addition, the specific implementation of step S605 may be referred to the specific implementation of step S201 in the above embodiments, which is not described herein.
S606, based on the multimedia fragments containing watermarks in two adjacent multimedia fragments in the multimedia data to be detected, performing time length identification processing on each multimedia fragment in the multimedia data to be detected to obtain the fragment time length of each multimedia fragment in the multimedia data to be detected.
In this embodiment of the present application, the specific implementation of step S606 may be referred to the specific implementation of step S202 in the above embodiment, which is not described herein.
In one possible implementation, see the division of nine segment durations like "20 seconds, 1 second, 2 seconds, 3 seconds, 44 seconds" in the example of step S602, since the first object identified sequence characterized by the segment duration is not followed by a flag indicating that the sequence has ended; then, the object identification sequence combined at the time of passing the combined segment duration is likely to become "012012", not the correct "012".
Therefore, in view of the above, step S602 may further divide a segment duration when dividing the segment duration to mark that the correspondence between the segment duration and the object identification sequence has ended.
Specifically, a segment duration corresponding to a sequence end segment for marking the end of the sequence may be set as a specified duration; or, the segment duration corresponding to the sequence end segment may be set as a specified duration, and the category of the multimedia data to be pushed to which the sequence end segment belongs is set as a specified category.
In practical application, please refer to fig. 9, which shows a schematic diagram of multimedia data containing end-of-sequence segments. A TS file may be set to have a duration of 1 second, an end-of-sequence segment of 11 seconds and a class of watermark. In addition, it may be set that the gray segment contains a watermark, the white segment does not contain a watermark, and the acquired object identification sequence is "123".
As shown in fig. 9, the total play duration of the multimedia data to be pushed may be divided into 11 segment durations of 12 seconds, 2 seconds, 3 seconds, 4 seconds, 11 seconds, 180 seconds, 2 seconds, 3 seconds, 4 seconds, 11 seconds, 60 seconds based on the object identification sequence "123". Then, a corresponding M3U8 file may be generated according to the foregoing 11 segment durations, and corresponding 11 multimedia segments, that is, multimedia segments 901 to 912, may be downloaded according to the M3U8 file, so as to obtain the multimedia data 901 to be pushed. When downloading each multimedia fragment according to the M3U8 file, each multimedia fragment can be obtained by downloading a plurality of TS files and combining the TS files.
Meanwhile, since the segment duration of the multimedia segment 906 and the multimedia segment 911 is the specified duration (i.e., 11 seconds), and the category of the multimedia data to be pushed is the specified category (i.e., watermark is present); thus, multimedia segment 906 and multimedia segment 911 are end-of-sequence segments. Accordingly, the segment durations of the multimedia segments 903 to 905 correspond to "123" in the object identification sequence, respectively, and the segment durations of the multimedia segments 908 to 909 correspond to "123" in the object identification sequence, respectively.
Further, for the above situation, when the duration identification processing is performed on the multimedia data to be detected, if the segment length of the multimedia segment of the specified category is identified to be greater than the preset duration interval, the multimedia segment may be divided into two multimedia segments, where the segment duration of the multimedia segment of the second one of the two multimedia segments in the playing order is the specified duration.
Referring to the example shown in fig. 9, when the object downloads the multimedia data 901 to be pushed and uploads the multimedia data 901 to be pushed to the illegal distribution platform, the multimedia data 901 to be pushed becomes multimedia data to be detected. At this time, referring to fig. 10, a schematic diagram of a slicing process of multimedia data is shown. As shown in fig. 10, after the server performs the duration recognition processing on the multimedia data to be detected, as shown in the multimedia data 1001, the initially obtained multimedia segments are 9 in total, and the segment durations respectively correspond to 12 seconds, 2 seconds, 3 seconds, 15 seconds, 180 seconds, 2 seconds, 3 seconds, 15 seconds and 60 seconds.
Because the segment duration 15 seconds is longer than the maximum duration 10 seconds in the preset duration interval in the multimedia segments of the appointed category (with watermarks), the multimedia segments with the segment duration 15 seconds can be segmented into two multimedia segments, wherein the segment duration of the multimedia segments with the back playing sequence is 11 seconds of the appointed duration. Finally, as shown in the multimedia data 1002, 11 multimedia clips can be finally identified, and the corresponding clip durations are 12 seconds, 2 seconds, 3 seconds, 4 seconds, 11 seconds, 180 seconds, 2 seconds, 3 seconds, 4 seconds, 11 seconds, and 60 seconds, respectively.
S607, combining the segment durations of the multimedia segments in the multimedia data to be detected to generate an object identification sequence of the multimedia data to be detected.
In this embodiment, the specific implementation of step S607 may be referred to the specific implementation of step S203 in the above embodiment, which is not described herein.
And S608, identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
In this embodiment, the specific implementation of step S608 may be referred to the specific implementation of step S204 in the above embodiment, which is not described herein.
In a specific implementation, referring to fig. 11, a schematic diagram of a process for identifying a propagation object is shown. As shown in fig. 11, a manufacturer of multimedia data generates multimedia data to be pushed by means of shooting, clipping, etc., and obtains a watermarked version and a watermarked version of the multimedia data to be pushed by means of adding a watermark to the multimedia data to be pushed. The multimedia data to be pushed with the watermark version is obtained by adding the watermark to the multimedia data to be pushed, and the multimedia data to be pushed without the watermark version is the multimedia data to be pushed. Then, the manufacturer can upload the two versions of the multimedia data to be pushed to the server, and the server stores the two versions of the multimedia data to be pushed.
Then, as shown in fig. 11, any object may initiate an acquisition request for the multimedia data to be pushed through a corresponding client, and after the server receives the acquisition request, an M3U8 file may be generated according to the client identification information and the data identification information of the multimedia data to be pushed, which are carried in the acquisition request (the generation process may refer to steps S601 to S603, which are not described herein). And then, the server can send the M3U8 file to the client, and the client downloads a plurality of multimedia fragments from the stored two versions of multimedia data to be pushed through the M3U8 file, and finally, the multimedia data pushed to the client can be obtained according to the plurality of multimedia fragments.
Wherein, because the client identification information of different objects is different, the multimedia data pushed to the clients of different objects is also different. Some objects may upload the multimedia data to the illegal distribution platform after downloading or recording the multimedia data pushed to their clients.
Meanwhile, as shown in the part of the anti-theft chain in fig. 11, the server can detect the illegal transmission platform regularly, and takes the newly uploaded multimedia data in the illegal transmission platform as the multimedia data to be detected. Then, the server may detect the multimedia data to be detected to obtain a corresponding object identification sequence (the detection process may refer to steps S605 to S607, which are not described herein).
Then, the server can identify the object for spreading the multimedia data to be detected through the obtained object identification sequence, and further supervise the client of the identified object.
According to the method and the device, the corresponding multiple segment durations are divided on the basis of the multiple identification characters contained in the object identification sequence, so that the multiple segment durations divided by different object identification sequences are different for the same multimedia data, and the corresponding relationship between the object identification sequence and the segment durations is established. Further, in the following, by means of obtaining a plurality of multimedia fragments of the multimedia data to be pushed, which are matched with the time lengths of the plurality of fragments, the plurality of multimedia fragments of the same multimedia data to be pushed, which are pushed to different objects, are different, so that the object to which each multimedia data is pushed can be identified through the fragment time length of the plurality of multimedia fragments contained in each multimedia data, and the purpose of accurately identifying the object for transmitting the multimedia data is achieved.
In addition, in the embodiment of the application, a plurality of multimedia data to be pushed are preset, and the preset multimedia data to be pushed can be ensured to be suitable for various terminal devices in a debugging mode and the like, and the terminal devices do not need to be added with watermarks in real time, so that the embodiment of the application can realize full coverage of the terminal devices, realize positioning and identifying each object, and have wide application prospects. Meanwhile, as the preset multimedia data to be pushed is compared with a scene of adding the watermark in real time, the transmission delay can be reduced to a certain extent, and thus the audiovisual experience of the object is improved.
The device embodiments of the present application are described herein as being used to perform the multimedia data-based object management system method of the above embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the object management system based on multimedia data described in the present application.
The embodiment of the application provides an object management device based on multimedia data, as shown in fig. 12, the device includes an acquisition unit 1201, an identification unit 1202 and a processing unit 1203:
an obtaining unit 1201, configured to obtain multimedia data to be detected, where the multimedia data to be detected includes a plurality of multimedia segments, and at least one of two adjacent multimedia segments contains a watermark;
an identifying unit 1202, configured to perform a duration identifying process on each multimedia segment based on the multimedia segments containing watermarks in the two adjacent multimedia segments, so as to obtain a segment duration of each multimedia segment;
a processing unit 1203, configured to combine segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected;
the processing unit 1203 is further configured to identify an object propagating the multimedia data to be detected based on the object identification sequence.
In one embodiment of the present application, based on the foregoing solution, the processing unit 1203 performs a duration identification process on each multimedia segment based on the multimedia segments containing watermarks in two adjacent multimedia segments, so as to obtain a segment duration of each multimedia segment, which may be specifically used; sequentially carrying out watermark identification processing on each data segment with unit duration in the multimedia data to be detected to obtain watermark identification results of each data segment; if the watermark identification results corresponding to the adjacent data segments are matched, identifying the adjacent data segments as the same multimedia segment; and carrying out summation operation on the unit time length of the adjacent data fragments to obtain the fragment time length of the multimedia fragments corresponding to the adjacent data fragments.
In one embodiment of the present application, based on the foregoing scheme, when the processing unit 1203 performs watermark identification processing on each data segment of unit duration in turn in the multimedia data to be detected, to obtain a watermark identification result of each data segment, the processing unit may be specifically configured to: for each unit duration data segment in the multimedia data to be detected, if the data segment is identified to have no watermark, a watermark identification result used for representing that the data segment has no watermark is obtained, and if the data segment is identified to have watermark, a watermark identification result used for representing that the data segment has watermark is obtained.
In one embodiment of the present application, each of two adjacent multimedia segments contains a watermark; based on the foregoing scheme, when the processing unit 1203 performs watermark identification processing on each unit duration data segment in the multimedia data to be detected in turn, it may be further configured to: identifying the watermark in each data segment according to each unit time length of the data segments in the multimedia data to be detected, and acquiring watermark identification information of the watermark in each data segment; and generating a watermark identification result containing corresponding watermark identification information based on the watermark identification information of each data segment.
In one embodiment of the present application, based on the foregoing solution, when the processing unit 1203 combines segment durations of a plurality of multimedia segments to generate an object identification sequence of multimedia data to be detected, the processing unit may be specifically configured to: selecting a target multimedia segment from a plurality of multimedia segments; the target multimedia segment meets at least one of preset conditions, wherein the preset conditions comprise that the segment duration of the target multimedia segment is in a preset duration interval, and the watermark contained in the target multimedia segment is of a preset watermark type; and combining the segment duration of the target multimedia segment according to the play sequence of the target multimedia segment in the multimedia data to be detected, so as to generate an object identification sequence.
In one embodiment of the present application, based on the foregoing solution, the processing unit 1203 may be specifically configured to, when identifying, based on the object identification sequence, an object that propagates the multimedia data to be detected: decrypting the object identification sequence to obtain decrypted identification information; acquiring data identification information of multimedia data to be detected; and determining identification information except the identification information matched with the data identification information from the decrypted identification information, and taking the determined identification information as client identification information of the object.
In an embodiment of the present application, based on the foregoing solution, before acquiring the multimedia data to be detected, if an acquisition request of the client of the object for the multimedia data to be pushed is detected, the processing unit 1203 may further acquire an object identifier sequence of the object; dividing the total playing duration of the multimedia data to be pushed into a plurality of segment durations based on a plurality of identification characters contained in the object identification sequence; acquiring a plurality of multimedia fragments of multimedia data to be pushed, which are respectively matched with the duration of the plurality of fragments; wherein, at least one multimedia segment of two adjacent multimedia segments in a plurality of multimedia segments of the multimedia data to be pushed contains a watermark; and pushing the plurality of multimedia fragments of the multimedia data to be pushed to the object.
In one embodiment of the present application, based on the foregoing solution, when the processing unit 1203 obtains a plurality of multimedia segments of the multimedia data to be pushed, which are respectively matched with the lengths of the plurality of segments, the processing unit may be specifically configured to: according to the playing sequence among the segment durations, intercepting a plurality of multimedia segments matched with the segment durations from a plurality of preset multimedia data to be pushed at intervals, wherein two adjacent intercepted multimedia segments come from different multimedia data to be pushed; the method comprises the steps that playing contents of a plurality of pieces of multimedia data to be pushed are the same, one piece of multimedia data to be pushed does not contain a watermark, and the other pieces of multimedia data to be pushed contain watermarks while the watermarks contained in different pieces of multimedia data to be pushed are different; or the playing contents of the plurality of multimedia data to be pushed are the same, and the plurality of multimedia data to be pushed all contain watermarks but have different watermarks.
In one embodiment of the present application, based on the foregoing solution, when the processing unit 1203 intercepts, at intervals, a plurality of multimedia segments matching with a plurality of segment durations from a preset plurality of multimedia data to be pushed according to a play order among the plurality of segment durations, the processing unit may be specifically configured to: generating a plurality of download addresses arranged according to the playing sequence according to the duration of the plurality of fragments; the method comprises the steps that a plurality of download addresses correspond to the downloaded multimedia fragments from a plurality of data to be pushed, and the fragment duration of the downloaded multimedia fragments corresponding to the download addresses corresponds to the fragment duration one by one; and downloading the plurality of multimedia fragments from the plurality of download addresses according to the playing sequence.
In one embodiment of the present application, based on the foregoing solution, the processing unit 1203 may be further configured to, when acquiring the object identification sequence of the object: acquiring client identification information of an object and data identification information of multimedia data to be pushed; splicing the data identification information and the client identification information to obtain splicing identification information; and encrypting the spliced identification information to obtain an object identification sequence.
According to one embodiment of the present application, the steps involved in the methods shown in fig. 2 and 6 may be performed by the respective units in the multimedia data based object management apparatus shown in fig. 12. For example, step S201 shown in fig. 2 may be performed by the acquisition unit 1201 in the multimedia data-based object management apparatus shown in fig. 12; step S202 may be performed by the identification unit 1202 in the multimedia data based object management apparatus shown in fig. 12, and steps S203 to S204 may be performed by the processing unit 1203 in the multimedia data based object management apparatus shown in fig. 12. As another example, steps S601 to S604, and steps S607 to S608 shown in fig. 6 may be performed by the processing unit 1203 in the multimedia data-based object management apparatus shown in fig. 12; step S605 may be performed by the acquisition unit 1201 in the multimedia data based object management apparatus shown in fig. 12, and step S606 may be performed by the identification unit 1202 in the multimedia data based object management apparatus shown in fig. 12.
According to another embodiment of the present application, each unit in the object management apparatus based on multimedia data shown in fig. 12 is divided based on a logic function, and each unit may be separately or completely combined into one or several additional units, or some unit(s) thereof may be further split into a plurality of units with smaller functions to form the same operation, which may not affect the implementation of the technical effects of the embodiments of the present application. In other embodiments of the present application, the object management apparatus based on multimedia data may also include other units, and in practical applications, these functions may also be implemented with assistance of other units, and may be implemented by cooperation of multiple units.
According to another embodiment of the present application, the object management apparatus based on multimedia data as shown in fig. 12 may be constructed by running a computer program (including program code) capable of executing the steps involved in the method as shown in fig. 2 or fig. 6 on a general-purpose computing device such as a computer device including a Central Processing Unit (CPU), a random access storage medium (RAM), a read only storage medium (ROM), etc., processing elements and storage elements, and the object management method based on multimedia data of the embodiment of the present application may be implemented. The computer program may be recorded on, for example, a computer storage medium, and loaded into and run in the above-described computer apparatus through the computer storage medium.
It should be noted that, the apparatus provided in the foregoing embodiments and the method provided in the foregoing embodiments belong to the same concept, and the specific manner in which each module and unit perform the operation has been described in detail in the method embodiments, which is not repeated herein.
The device provided by the embodiment of the invention can be arranged in the terminal equipment or the server, and the device provided by the embodiment of the invention can obtain the corresponding object identification sequence according to the segment duration by identifying the segment duration of each multimedia segment in the multimedia data to be detected, thereby achieving the purpose of accurately identifying the object for transmitting the multimedia data to be detected.
Embodiments of the present application also provide an electronic device including one or more processors, and a storage device, where the storage device is configured to store one or more computer programs, and when the one or more computer programs are executed by the one or more processors, cause the electronic device to implement the object management method based on multimedia data as above.
Fig. 13 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application.
It should be noted that, the computer system 1300 of the electronic device shown in fig. 13 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.
As shown in fig. 13, the computer system 1300 includes a processor (Central Processing Unit, CPU) 1301 that can perform various appropriate actions and processes, such as performing the methods in the above-described embodiments, according to a program stored in a Read-Only Memory (ROM) 1302 or a program loaded from a storage portion 1308 into a random access Memory (Random Access Memory, RAM) 1303. In the RAM 1303, various programs and data required for the system operation are also stored. The CPU 1301, ROM 1302, and RAM 1303 are connected to each other through a bus 1304. An Input/Output (I/O) interface 1305 is also connected to bus 1304.
In some embodiments, the following components are connected to the I/O interface 1305: an input section 1306 including a keyboard, a mouse, and the like; an output portion 1307 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and the like, a speaker, and the like; a storage portion 1308 including a hard disk or the like; and a communication section 1309 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 1309 performs a communication process via a network such as the internet. The drive 1310 is also connected to the I/O interface 1305 as needed. Removable media 1311, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memory, and the like, is installed as needed on drive 1310 so that a computer program read therefrom is installed as needed into storage portion 1308.
In particular, according to embodiments of the present application, the processes described above with reference to flowcharts may be implemented as computer programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 1309 and/or installed from the removable medium 1311. When executed by a processor (CPU) 1301, performs the various functions defined in the system of the present application.
It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory), a flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. The data acquisition method signal medium provided in the various embodiments described above may also be any computer readable medium other than a computer readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer programs.
The units or modules described in the embodiments of the present application may be implemented by software, or may be implemented by hardware, where the described units or modules may also be provided in a processor. Where the names of the units or modules do not in some way constitute a limitation of the units or modules themselves.
Another aspect of the present application also provides a computer readable medium having stored thereon a computer program which, when executed by a processor, implements a method of object management based on multimedia data as before. The computer-readable medium may be included in the electronic device described in the above embodiment or may exist alone without being incorporated in the electronic device.
Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the electronic device reads the computer instructions from the computer readable storage medium and executes the computer instructions to cause the electronic device to perform the method embodiments described above and illustrated in fig. 2 and 6. The computer readable storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.
It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit, in accordance with embodiments of the present application. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains.
The foregoing is merely a preferred exemplary embodiment of the present application and is not intended to limit the embodiments of the present application, and those skilled in the art may make various changes and modifications with great convenience according to the main concept and spirit of the present application, so that the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (13)

1. An object management method based on multimedia data, comprising:
acquiring multimedia data to be detected, wherein the multimedia data to be detected comprises a plurality of multimedia fragments, and at least one multimedia fragment of two adjacent multimedia fragments contains a watermark;
based on the multimedia fragments containing watermarks in the two adjacent multimedia fragments, performing time length identification processing on each multimedia fragment to obtain the fragment time length of each multimedia fragment;
Combining segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected;
and identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
2. The method according to claim 1, wherein the step of performing a duration identification process on each multimedia segment based on the multimedia segments containing watermarks in two adjacent multimedia segments to obtain a segment duration of each multimedia segment includes:
sequentially carrying out watermark identification processing on each data segment with unit time length in the multimedia data to be detected to obtain a watermark identification result of each data segment;
if the watermark identification results corresponding to the adjacent data segments are matched, identifying the adjacent data segments as the same multimedia segment;
and carrying out summation operation on the unit time length of the adjacent data fragments to obtain the fragment time length of the multimedia fragments corresponding to the adjacent data fragments.
3. The method of claim 2, wherein one of the two adjacent multimedia segments contains a watermark;
the watermark identification processing is sequentially performed on each data segment with unit duration in the multimedia data to be detected, so as to obtain a watermark identification result of each data segment, which comprises the following steps:
And aiming at the data segment of each unit duration in the multimedia data to be detected, if the data segment is identified to have no watermark, obtaining a watermark identification result used for representing that the data segment has no watermark, and if the data segment is identified to have the watermark, obtaining the watermark identification result used for representing that the data segment has the watermark.
4. The method of claim 2, wherein each of the two adjacent multimedia segments contains a watermark;
the watermark identification processing is sequentially performed on each data segment with unit duration in the multimedia data to be detected, so as to obtain a watermark identification result of each data segment, which comprises the following steps:
identifying the watermark in each data segment according to the data segment of each unit duration in the multimedia data to be detected, and acquiring watermark identification information of the watermark in each data segment;
and generating a watermark identification result containing corresponding watermark identification information based on the watermark identification information of each data segment.
5. The method of claim 1, wherein the combining segment durations of the plurality of multimedia segments to generate the object identification sequence of the multimedia data to be detected comprises:
Selecting a target multimedia segment from the plurality of multimedia segments; the target multimedia segment meets at least one of preset conditions, wherein the preset conditions comprise that the segment duration of the target multimedia segment is in a preset duration interval and the watermark contained in the target multimedia segment is of a preset watermark type;
and combining the segment duration of the target multimedia segment according to the play sequence of the target multimedia segment in the multimedia data to be detected, so as to generate the object identification sequence.
6. The method according to claim 1, wherein said identifying an object that propagates the multimedia data to be detected based on the object identification sequence comprises:
decrypting the object identification sequence to obtain decrypted identification information;
acquiring data identification information of the multimedia data to be detected;
and determining identification information except the identification information matched with the data identification information from the decrypted identification information, and taking the determined identification information as the client identification information of the object.
7. The method according to any one of claims 1 to 6, wherein prior to said acquiring multimedia data to be detected, the method further comprises:
If the acquisition request of the client of the object for the multimedia data to be pushed is detected, acquiring an object identification sequence of the object;
dividing the total playing duration of the multimedia data to be pushed into a plurality of segment durations based on a plurality of identification characters contained in the object identification sequence;
acquiring a plurality of multimedia fragments of the multimedia data to be pushed, which are respectively matched with the duration of the fragments; wherein, at least one multimedia fragment of two adjacent multimedia fragments in the plurality of multimedia fragments of the multimedia data to be pushed contains a watermark;
and pushing the multimedia fragments of the multimedia data to be pushed to the object.
8. The method of claim 7, wherein the obtaining a plurality of multimedia segments of the multimedia data to be pushed that respectively match the plurality of segment durations comprises:
intercepting a plurality of multimedia fragments matched with the time lengths of the fragments from a plurality of preset multimedia data to be pushed at intervals according to the play sequence among the time lengths of the fragments, wherein two adjacent intercepted multimedia fragments come from different multimedia data to be pushed;
The multimedia data to be pushed are the same in play content, one multimedia data to be pushed does not contain a watermark, and the other multimedia data to be pushed contains watermarks while the watermarks contained in the different multimedia data to be pushed are different; or the playing contents of the plurality of multimedia data to be pushed are the same, and the plurality of multimedia data to be pushed all contain watermarks but have different watermarks.
9. The method of claim 8, wherein intercepting, at intervals, a plurality of multimedia segments matching the time lengths of the segments from a preset plurality of multimedia data to be pushed according to the play order among the time lengths of the segments, includes:
generating a plurality of download addresses arranged according to the playing sequence according to the segment duration; the method comprises the steps that a plurality of download addresses correspond to the downloaded multimedia fragments from a plurality of data to be pushed, and the fragment duration of the downloaded multimedia fragments corresponding to the download addresses corresponds to the fragment duration one by one;
and downloading a plurality of multimedia fragments from the plurality of download addresses according to the playing sequence.
10. The method of claim 7, wherein the obtaining the object identification sequence of the object comprises:
acquiring client identification information of the object and data identification information of the multimedia data to be pushed;
splicing the data identification information and the client identification information to obtain splicing identification information;
and encrypting the spliced identification information to obtain the object identification sequence.
11. An object management device based on multimedia data, comprising an acquisition unit, an identification unit and a processing unit, wherein:
the acquisition unit is used for acquiring multimedia data to be detected, wherein the multimedia data to be detected comprises a plurality of multimedia fragments, and at least one of two adjacent multimedia fragments contains a watermark;
the identification unit is used for carrying out time length identification processing on each multimedia fragment based on the multimedia fragments containing watermarks in the two adjacent multimedia fragments to obtain the fragment time length of each multimedia fragment;
the processing unit is used for combining the segment durations of the plurality of multimedia segments to generate an object identification sequence of the multimedia data to be detected;
The processing unit is further used for identifying the object for spreading the multimedia data to be detected based on the object identification sequence.
12. A computer readable medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the object management method based on multimedia data according to any one of claims 1 to 10.
13. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs which when executed by the one or more processors cause the one or more processors to implement the multimedia data based object management method of any of claims 1 to 10.
CN202311418595.8A 2023-10-26 2023-10-26 Object management method based on multimedia data and related equipment Pending CN117579905A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311418595.8A CN117579905A (en) 2023-10-26 2023-10-26 Object management method based on multimedia data and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311418595.8A CN117579905A (en) 2023-10-26 2023-10-26 Object management method based on multimedia data and related equipment

Publications (1)

Publication Number Publication Date
CN117579905A true CN117579905A (en) 2024-02-20

Family

ID=89888969

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311418595.8A Pending CN117579905A (en) 2023-10-26 2023-10-26 Object management method based on multimedia data and related equipment

Country Status (1)

Country Link
CN (1) CN117579905A (en)

Similar Documents

Publication Publication Date Title
US9065683B2 (en) Content interactivity gateway
CN109417544B (en) System for providing streaming content and method thereof
US8688991B1 (en) Media player embodiments and secure playlist packaging
US8387150B2 (en) Segmented media content rights management
CN101884195B (en) Cryptographic processing of content
EP1579686B1 (en) Personalized marking for protecting digital audiovisual streams
US20170118537A1 (en) Adaptive watermarking for streaming data
US20080240490A1 (en) Source authentication and usage tracking of video
US9936229B1 (en) Delivery of edited or inserted media streaming content
US20040199771A1 (en) Method for tracing a security breach in highly distributed content
US8417966B1 (en) System and method for measuring and reporting consumption of rights-protected media content
US20050193205A1 (en) Method and system for session based watermarking of encrypted content
US20080319862A1 (en) Method and system for preventing ad stripping from ad-supported digital content
US20130042100A1 (en) Method and apparatus for forced playback in http streaming
US20120030041A1 (en) Content interactivity gateway and method of use therewith
US8812852B2 (en) Method and system for marking digital content
US20230325473A1 (en) Media authentication
US20220284130A1 (en) Content Playlist Integrity
US20120210447A1 (en) Secure video download method
US20160050074A1 (en) Content traceability using segmented watermark encoding
US11588889B1 (en) Validating media content retrieved from untrusted networks
US20230328300A1 (en) Protecting media content integrity across untrusted networks
CN113810780B (en) Video transmission method, device and storage medium
CN117579905A (en) Object management method based on multimedia data and related equipment
JP5350021B2 (en) File generation device, file reproduction device, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication