WO2018121780A1 - 多媒体内容的关联、播放方法及装置、终端 - Google Patents

多媒体内容的关联、播放方法及装置、终端 Download PDF

Info

Publication number
WO2018121780A1
WO2018121780A1 PCT/CN2017/120338 CN2017120338W WO2018121780A1 WO 2018121780 A1 WO2018121780 A1 WO 2018121780A1 CN 2017120338 W CN2017120338 W CN 2017120338W WO 2018121780 A1 WO2018121780 A1 WO 2018121780A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
multimedia content
terminal
multimedia
value
Prior art date
Application number
PCT/CN2017/120338
Other languages
English (en)
French (fr)
Inventor
刘秀萍
黄胜鲁
李锐
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018121780A1 publication Critical patent/WO2018121780A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/435—Filtering based on additional data, e.g. user or group profiles

Definitions

  • the present disclosure relates to the field of communications, for example, to a method, an apparatus, and a terminal for associating and playing multimedia content.
  • Multi-screen interactive technology refers to the shared display of multimedia (video, audio, picture, etc.) content between different intelligent terminal devices on different operating systems, enriching the multimedia life of users.
  • the Internet Protocol Television (IPTV) platform and the mobile phone platform are two independent platforms that are isolated from each other.
  • the content injected by the two platforms comes from different content providers and is independent of each other.
  • a method for associating content between the two platforms includes: a manual intervention method and a secondary processing method.
  • the manual intervention method the operator manually configures according to the content name to generate a content correspondence relationship between the two platforms, which increases labor cost and is prone to error.
  • the secondary processing method a system is deployed, the system performs secondary processing on the content, generates program content suitable for the two platform formats, and saves the content correspondence relationship, and the method has a complicated processing flow and content Complex issues such as copyright.
  • the embodiments of the present invention provide a method, a device, and a terminal for associating and playing multimedia content, which can solve the problems of high cost, error, and complicated process in the related art.
  • a method for associating multimedia content including:
  • the plurality of content feature values are matched to each other to obtain a matching result, and the multimedia content corresponding to the matching value greater than the first threshold in the matching result is associated.
  • matching the plurality of content feature values to obtain matching results includes:
  • a matching value is determined according to the plurality of content feature values and weights corresponding to the plurality of content feature values.
  • determining the matching value according to the plurality of content feature values and the weights corresponding to the plurality of content feature values including:
  • the matching value C is determined according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • the method further includes:
  • the content feature value comprises at least one of the following: an audio feature value, a video feature value, a video playing duration, and a video content name.
  • acquiring audio feature values corresponding to the plurality of content information includes:
  • the value corresponding to the feature is taken as the audio feature value.
  • acquiring video feature values corresponding to the plurality of content information includes:
  • a value corresponding to the image feature is used as the video feature value.
  • the method further includes:
  • the play information required to play the second multimedia content is sent to the second terminal, where the play information includes: The content identifier of the second terminal and the playback time point.
  • the content information of each multimedia content includes at least one of: a content identifier that uniquely identifies the each multimedia content, a platform identifier that uniquely identifies a service platform corresponding to each multimedia content, and each of the The storage address of the multimedia content and the content name of each of the multimedia content.
  • a method for playing multimedia content comprising:
  • the second terminal receives the playback information triggered by the screen switching request sent by the first terminal, where the playback information is used. Instructing the second terminal to play the second multimedia content, where the second multimedia content is determined by: acquiring content information and multiple content of multiple multimedia content of multiple service platforms by using the content association device Content feature values corresponding to the content information, matching the plurality of content feature values to obtain a matching result, and associating the multimedia content corresponding to the matching value of the matching result that is greater than the first threshold, wherein each content feature value is used for unique Identifying corresponding multimedia content, the content association device being capable of receiving a request sent by the first terminal to query the second multimedia content;
  • the second terminal plays the second multimedia content according to the play information.
  • a device for associating multimedia content comprising:
  • a first obtaining module configured to acquire content information of multiple multimedia content of multiple service platforms
  • a second acquiring module configured to acquire content feature values corresponding to the plurality of content information, where each content feature value is used to uniquely identify the corresponding multimedia content
  • a first determining module configured to match the plurality of content feature values by two to obtain a matching result
  • the first association module is configured to associate the multimedia content corresponding to the matching value that is greater than the first threshold in the matching result.
  • the first determining module is configured to determine a matching value according to the plurality of content feature values and the weights corresponding to the plurality of content feature values.
  • the first determining module is further configured to determine the matching value C according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • the apparatus further includes:
  • a second association module configured to associate a plurality of multimedia content corresponding to the matching value that is smaller than the first threshold and greater than the second threshold
  • the second determining module is configured to determine that the multimedia content association fails when the matching value is less than the second threshold.
  • the apparatus further includes:
  • a receiving module configured to receive a query request sent by the first terminal, where the query request is used to query whether the first multimedia content currently being played by the first terminal is associated with the second multimedia content;
  • a second determining module configured to determine that the first terminal does not support screen switching when the first multimedia content is not associated with the second multimedia content
  • a sending module configured to send, when the first multimedia content is associated with the second multimedia content, play information required to play the second multimedia content to the second terminal, where
  • the play information includes: a content identifier of the second terminal and a play time point.
  • a multimedia content playing device is applied to a terminal, including:
  • the receiving module is configured to: when the first multimedia content that is currently played by the first terminal is associated with the second multimedia content, receive the playing information, where the playing information is triggered by the screen switching request sent by the first terminal, where the playing The information is used to indicate that the terminal plays the second multimedia content, and the second multimedia content is determined by: acquiring content information and multiple content of multiple multimedia content of multiple service platforms by using the content association device Content feature values corresponding to the content information, matching the plurality of content feature values to obtain a matching result, and associating the multimedia content corresponding to the matching value of the matching result that is greater than the first threshold, wherein each content feature value is used for unique Identifying corresponding multimedia content, the content association device being capable of receiving a request sent by the first terminal to query the second multimedia content;
  • a playing module configured to play the second multimedia content according to the playing information.
  • a device for associating multimedia content comprising:
  • a memory configured to store instructions executable by the processor
  • the processor is configured to perform the following operations in accordance with instructions stored in the memory:
  • the plurality of content feature values are matched to each other to obtain a matching result, and the multimedia content corresponding to the matching value greater than the first threshold in the matching result is associated.
  • the processor is further configured to perform an operation of determining a matching value according to the plurality of content feature values and weights corresponding to the plurality of content feature values.
  • the processor is further configured to determine the matching value C according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • the processor is further configured to: associate a plurality of multimedia content corresponding to the matching value smaller than the first threshold and greater than the second threshold; and the matching value is less than the first When the threshold is two, it is determined that the multimedia content association fails.
  • a terminal includes: the above-mentioned multimedia content playing device.
  • a computer readable storage medium storing computer executable instructions arranged to perform the above method.
  • a terminal comprising:
  • At least one processor At least one processor
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform an association method of any of the multimedia content described above.
  • a terminal comprising:
  • At least one processor At least one processor
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform a method of playing any of the multimedia content described above.
  • FIG. 1 is a block diagram showing the hardware structure of a computer terminal according to an embodiment
  • FIG. 2 is a flowchart of a method of associating multimedia content, according to an embodiment
  • FIG. 3 is a flowchart of a method for playing multimedia content according to an embodiment
  • FIG. 4 is a structural block diagram of an apparatus for associating multimedia content according to an embodiment
  • FIG. 5 is a structural block diagram of an apparatus for associating multimedia content according to another embodiment
  • FIG. 6 is a structural block diagram of a playback apparatus for multimedia content according to an embodiment
  • FIG. 7 is a structural block diagram of an apparatus for associating multimedia content according to another embodiment
  • FIG. 8 is a structural block diagram of an apparatus for intelligent association of content under multi-screen interaction according to an embodiment
  • FIG. 9 is a structural block diagram of a content intelligent association apparatus according to an embodiment.
  • FIG. 10 is a flowchart of a multi-screen interaction method for automatically associating to a content according to an embodiment
  • FIG. 11 is a flowchart of a multi-screen interaction method automatically associated with multiple content according to an embodiment
  • FIG. 12 is a flowchart of a multi-screen interaction method not associated with content provided according to an embodiment
  • FIG. 13 is a flowchart of a method for automatically matching unrelated content according to an embodiment
  • FIG. 14 is a flowchart of a processing method performed by the apparatus when content is deleted according to an embodiment.
  • FIG. 15 is a structural diagram of an apparatus for intelligent association of content under multi-screen interaction according to an embodiment.
  • FIG. 1 is a block diagram showing the hardware structure of a computer terminal according to an embodiment.
  • computer terminal 10 may include one or more (only one shown) processor 102 (processor 102 may include a Microcontroller Unit (MCU) or a programmable logic device (Field-Programmable).
  • MCU Microcontroller Unit
  • FPGA Gate Array
  • memory 104 configured to store data
  • transmission device 106 having a communication function.
  • FIG. 1 is merely illustrative and does not limit the structure of the above electronic device.
  • computer terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 104 may be configured as a software program and a module for storing application software, such as program instructions or modules corresponding to the associated method of the multimedia content in the following embodiments, and the processor 102 executes by executing the software program and the module stored in the memory 104.
  • application software such as program instructions or modules corresponding to the associated method of the multimedia content in the following embodiments
  • the processor 102 executes by executing the software program and the module stored in the memory 104.
  • Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 104 may include memory remotely located relative to processor 102, which may be coupled to computer terminal 10 via a network. Examples of such networks include the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 106 is arranged to receive or transmit data via a network.
  • the network specific examples described above may include a wireless network provided by a communication provider of the computer terminal 10.
  • the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 106 can be a radio frequency (RF) module that is configured to communicate with the Internet wirelessly.
  • NIC Network Interface Controller
  • RF radio frequency
  • FIG. 2 is a flowchart of a method for associating multimedia content according to the embodiment. As shown in FIG. 2, the process includes the following steps.
  • step 202 content information of multiple multimedia content of multiple service platforms is acquired.
  • step 204 content feature values corresponding to the plurality of content information are obtained, wherein each content feature value is used to uniquely identify the multimedia content.
  • step 206 a plurality of content feature values are matched to obtain a matching result, and the multimedia content whose matching value is greater than the first threshold is associated.
  • the multimedia content of different platforms can be associated according to the content feature value of the multimedia content, which solves the problems of high cost, error, and complicated process of the technical solutions in which the content of multiple platforms in the related art is related to each other.
  • the foregoing step 206 may have multiple implementation manners.
  • the step 206 includes: determining a matching value according to the weight corresponding to the plurality of content feature values and the plurality of content feature values.
  • determining the matching value according to the weight corresponding to the plurality of content feature values and the plurality of content feature values comprises: determining the matching value C according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • a k may represent a matching degree corresponding to the plurality of multimedia contents for the same content feature value (eg, an audio feature value), and the matching degree may be an audio feature value in the multimedia content of the first terminal (this
  • the audio feature value at the location may also be a similarity between the video feature value included in the content feature value, the video play duration or the video content name, and the audio feature value in the multimedia content of the second terminal.
  • the multimedia content whose matching value is greater than the first threshold is associated, and when the multimedia content whose matching value is greater than the first threshold is not found, the matching value smaller than the first threshold and greater than the second threshold may also be used.
  • Corresponding multiple multimedia content are associated that is, multiple associated multimedia content can be uniformly associated and sent to the user terminal for use at a time.
  • the matching value is less than the second threshold, it is determined that the multimedia content association fails.
  • the content feature value comprises at least one of the following: an audio feature value, a video feature value, a video playing duration, and a video content name.
  • the acquiring, according to the content feature value, the audio feature value corresponding to the plurality of content information, when the content feature value is an audio feature value includes:
  • acquiring the video feature value corresponding to the plurality of content information may include: extracting a key frame from the video, and extracting an image feature from the key frame; And using a value corresponding to the image feature as the video feature value.
  • the key frame may be an intra-prediction (I) frame.
  • the method may further include: receiving a query request sent by the first terminal, where the query request is used to query whether the first multimedia content currently played by the first terminal is associated with the second largest Media content; when the first multimedia content is not associated with the second multimedia content, the first terminal does not support screen switching; when the first multimedia content is associated with the second And the playing information required to play the second multimedia content is sent to the second terminal, where the playing information includes: a content identifier of the multimedia content and a playing time point (ie, the second The playback time of multimedia content). among them
  • the content information of each multimedia content includes at least one of: a content identifier that uniquely identifies the each multimedia content, a platform identifier that uniquely identifies a service platform corresponding to each of the multimedia content, and each of the The storage address of the multimedia content and the content name of each of the multimedia content.
  • FIG. 3 is a flowchart of a method for playing multimedia content according to the embodiment, as shown in FIG.
  • the method for playing multimedia content includes the following steps.
  • step 302 when the first multimedia content that is currently played by the first terminal has been associated with the second multimedia content, the second terminal receives the playback information under the trigger of the screen switching request sent by the first terminal, where The information is used to indicate that the second terminal plays the second multimedia content, and the second multimedia content is determined by: acquiring, by the content association device, the content information of the plurality of multimedia content of the plurality of service platforms and the plurality of content information And the content feature value is matched by the plurality of content feature values to obtain a matching result, and the multimedia content whose matching value is greater than the first threshold is associated, wherein each content feature value is used to uniquely identify the corresponding multimedia content.
  • the content association device is capable of receiving a request sent by the first terminal to query the second multimedia content.
  • step 304 the second terminal plays the second multimedia content according to the play information.
  • the second terminal is capable of receiving, by the second terminal, the triggering of the screen switching request sent by the first terminal, when the second multimedia content that is currently played by the first terminal is associated with the second multimedia content. Playing the information, the second multimedia content is determined by the content association device associating the multimedia content of the different platforms according to the content feature value of the multimedia content.
  • the method of the foregoing embodiment may be implemented by means of software plus a general hardware platform, or may be implemented by hardware.
  • the above technical solution may be embodied in the form of a software product stored in a storage medium (such as a read-only memory (ROM), a random access memory (RAM), a magnetic disk or
  • a storage medium such as a read-only memory (ROM), a random access memory (RAM), a magnetic disk or
  • the optical disc includes one or more instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods of the various embodiments.
  • An embodiment provides an apparatus for associating multimedia content, and the apparatus can implement the method in the above embodiments.
  • the term "module" can implement a combination of software and hardware, software, or hardware for a predetermined function.
  • the apparatus described in the following embodiments may be implemented in software, hardware, or a combination of software and hardware.
  • FIG. 4 is a structural block diagram of an apparatus for associating multimedia content, according to an embodiment. As shown in FIG. 4, the apparatus includes: a first obtaining module 40, a second obtaining module 42, a first determining module 44, and a first associating module 46.
  • the first obtaining module 40 is configured to acquire content information of multiple multimedia content of multiple service platforms.
  • the second acquisition module 42 is connected to the first acquisition module 40, and the second acquisition module 42 is configured to acquire content feature values corresponding to the plurality of content information, wherein each content feature value is used to uniquely identify the corresponding multimedia content.
  • the first determining module 44 is coupled to the second obtaining module 42.
  • the first determining module 44 is configured to match the plurality of content feature values to obtain a matching result.
  • the first association module 46 is connected to the first determining module 44, and the first association module 46 is configured to associate the multimedia content whose matching value indicated by the matching result is greater than the first threshold.
  • the foregoing multiple modules can associate multimedia content of different platforms according to content feature values of the multimedia content, and solve the problems that the technical solutions of the inter-related content between the multiple platforms in the related technology are high in cost, error-prone, and complicated in process. Realizing the content association between different platforms is not restricted by manual intervention, which provides the possibility of switching multimedia content between multi-screen terminals of different platforms.
  • the first determining module 44 is configured to determine a matching value according to a weight corresponding to the content feature value and the content feature value, and is further configured to determine the matching value C according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • the apparatus may further include: a second association module 48 and a second determination module. 50.
  • the second association module 48 is coupled to the first determination module 44, and the second association module 48 is configured to associate a plurality of multimedia content corresponding to the matching value that is less than the first threshold and greater than the second threshold.
  • the second determining module 50 is connected to the first determining module 44, and the second determining module 50 is configured to determine that the multimedia content association fails when the matching value is less than the second threshold.
  • the foregoing apparatus further includes: a first receiving module 52, a third determining module 54, and a sending module 56.
  • the first receiving module 52 is connected to the first associated module 46 or the second associated module 48.
  • the first receiving module 52 is configured to receive a query request sent by the first terminal, where the query request is used to query the first broadcast currently played by the first terminal. Whether the multimedia content has been associated with the second multimedia content.
  • the third determining module 54 is connected to the first receiving module 52.
  • the third determining module 54 is configured to determine that the first terminal does not support screen switching when the first multimedia content is not associated with the second multimedia content.
  • the sending module 56 is configured to send the play information required to play the second multimedia content to the second terminal when the first multimedia content has been associated with the second multimedia content, where
  • the play information includes: a content identifier of the second terminal and a play time point.
  • FIG. 6 is a structural block diagram of a playback device for multimedia content according to the embodiment. As shown in FIG. The second receiving module 60 and the playing module 62 are included.
  • the second receiving module 60 is configured to receive the playing information, where the first multimedia content currently played by the first terminal has been associated with the second multimedia content, and trigger the screen switching request sent by the first terminal, where The information is used to indicate that the second terminal plays the second multimedia content, and the second multimedia content is determined by: acquiring, by the content association device, the content information of the plurality of multimedia content of the plurality of service platforms and the plurality of content information a content feature value, the plurality of content feature values are matched to each other to obtain a matching result, and the multimedia content whose matching value is greater than the first threshold is associated, wherein the content feature value is used to uniquely identify the corresponding multimedia content.
  • the content association device is capable of receiving a request sent by the first terminal to query the second multimedia content.
  • the play module 62 is configured to play the second multimedia content according to the play information.
  • the second terminal is configured to receive the broadcast information, triggered by the screen switching request sent by the first terminal, when the first multimedia content currently played by the first terminal is associated with the second multimedia content, by using the foregoing playing module,
  • the two multimedia content is determined by the content association device associating the multimedia content of the different platforms according to the content feature value of the multimedia content.
  • a terminal comprising the playback device of the multimedia content described above.
  • FIG. 7 is a structural block diagram of an apparatus for associating multimedia content according to the embodiment. As shown in FIG. 7, the apparatus for associating multimedia content includes:
  • processor 70 configured to store instructions executable by the processor;
  • the processor 70 is configured to: perform, according to the instructions stored in the memory, acquiring content information of the plurality of multimedia content of the plurality of service platforms; acquiring content feature values corresponding to the plurality of content information, wherein each content feature value is used for unique Identifying the corresponding multimedia content; and matching the plurality of content feature values to obtain a matching result, and associating the multimedia content whose matching value is greater than the first threshold.
  • the processor 70 is further configured to perform the operation of determining a match value based on the plurality of content feature values and the weights corresponding to the plurality of content feature values.
  • processor 70 is further configured to determine a match value C according to the following formula:
  • n is the number of content feature values extracted from the multimedia content
  • a k is the matching degree of the content feature values of the multimedia content
  • b k is the weight corresponding to the content feature values.
  • the processor 70 is further configured to: associate a plurality of multimedia content corresponding to the matching value that is less than the first threshold and greater than the second threshold; and determine the multimedia content when the matching value is less than the second threshold The association failed.
  • This example provides a device for intelligent association of multimedia content under multi-screen interaction, which can realize content intelligent association between different platforms, without secondary processing of content and reducing manual intervention.
  • the device for intelligent association of content under multi-screen interaction in this example includes:
  • An access module configured to receive request messages of different service platforms
  • a feature value extraction module (corresponding to the second acquisition module 42 of the above embodiment) configured to extract content feature values
  • a data storage module configured to store information such as content feature values
  • a data processing module (corresponding to the first determining module 44 of the above embodiment) configured to match the content feature value to generate a content correspondence relationship.
  • a method for intelligent association of content that can be implemented by the device is provided, and the method includes the following six steps.
  • step 1 when the content is released, the first platform and the second platform send the published content related information to the access module of the device, where the content related information includes information such as a content identifier, a platform identifier, and a storage address.
  • the access module receives content related information sent by the two platforms, and the content related information is saved to a data storage module of the device, and the access module triggers a feature value extraction module of the device. Extracting content feature values for the content of the two platforms, wherein the content feature values include information such as audio feature values, video feature values, play durations, and content names.
  • the content of the two platforms may be sent by the two platforms to the access module before the access module receives the content related information.
  • feature extraction is to transform a group of measured values of a pattern to highlight a representative feature of the pattern and symbolize it to form a feature vector or symbol string, a relationship graph, thereby generating a pattern representing the object.
  • the video feature value extraction adopts a method of extracting key frames and extracting image features of the key frames.
  • the audio feature value extraction employs a method of decomposing audio into audio frames, extracting at least one of a time domain feature and a frequency domain feature of the audio frame.
  • the group measurement value of a mode may be a set of measurement data of a plurality of features in a mode.
  • the data processing module of the device uses the big data technology to extract corresponding feature values from the content injected by the first platform and the second platform, and match the feature values to generate a corresponding relationship of the content.
  • the correspondence relationship includes a one-to-one mapping relationship, that is, the correspondence relationship may be that one multimedia content corresponds to multiple multimedia content, and the corresponding relationship is saved in a data storage module of the device.
  • step 4 when the first platform terminal (corresponding to the first terminal in the foregoing embodiment) displays the content details, the request module for querying the content association relationship is sent to the access module of the device, and the content of the query is associated with the corresponding In the content, the first platform terminal displays a multi-screen interactive icon, and the user can initiate a screen switching request; and when the content of the query is not associated, the content of the first platform terminal does not support screen switching.
  • step 5 the first platform terminal initiates a screen switching request, and the content identifier, the playing time point, and the second platform terminal identifier information of the second terminal content associated with the content are forwarded to the second platform terminal through the multi-screen interaction module.
  • step 6 the second platform terminal (corresponding to the second terminal in the foregoing embodiment) receives the screen switching request of the first platform terminal forwarded by the multi-screen interaction module, and generates a new play request according to the carried content identifier, The playback time point that is carried starts to play.
  • a content feature value matching model is provided: a matching value
  • a k identifies a degree of matching of the content feature values (eg, the content feature value may include at least one of: a video feature value, an audio feature value, and a content name); and b k identifies a weight value of the matching degree of the content feature value ( For example, it can take 0.4, 0.5, 0.1).
  • the matching value C reaches a certain condition, it can be determined that the two contents are related; that is, multiple thresholds can be set.
  • the C value is the highest.
  • multiple content associations may be taken.
  • the terminal may display multiple related contents, which are freely selected by the user, when C is less than the second threshold. , regarded as a match failure.
  • the content intelligent association between at least two platforms is realized, and is not restricted by manual intervention, so that the video freely switching between different platform multi-screen terminals is faster, Flexible and user experience.
  • the method for processing the multimedia content includes: when the content is published, the access module of the device receives the content information notification message from the first platform and the second platform;
  • the feature value extraction module that triggers the device performs content feature value extraction processing on the content published by the two platforms, wherein the content feature value includes at least one of the following: an audio feature value, a video feature value, a play duration, and a content name, which are to be extracted.
  • the content feature value and the content related information are stored in the data storage module; the data processing module of the device matches the content feature values of the two platforms based on the big data technology, and when the matching degree reaches a certain condition, the two contents are determined to be related.
  • the correspondence between the two platform contents is saved to the data storage module; when the screen is switched, the first platform terminal sends the content information and the playing time of the associated second platform to the second platform terminal, the second platform The terminal generates a new play request according to the content information, according to the playing Start playing.
  • the foregoing embodiment implements content intelligent association between at least two platforms under the premise of keeping at least two platforms isolated, and is not restricted by manual intervention, so that video freely switching between different platform multi-screen terminals is faster and more flexible. To improve the user experience.
  • FIG. 8 is a structural block diagram of an apparatus for intelligent association of content under multi-screen interaction according to an embodiment. As shown in FIG. 8 , based on the structure of FIG. 8 , the method and method for playing multimedia content may include the following steps:
  • CPs Two Content Providers
  • CP1 and CP2 respectively inject content into two service platforms (first platform and second platform);
  • the access module triggering feature value extraction module extracts the content feature value from the content of the two service platforms, and saves the content feature value to the data storage module;
  • the data processing module matches the content feature values of the two platforms, generates a content correspondence relationship, and saves the correspondence relationship to the data storage module;
  • the first service platform terminal When displaying the content details, the first service platform terminal sends a query content correspondence request message to the access module to display a multi-screen interactive icon; the first service platform (first platform) terminal carries the second platform service content related information and plays Time point information, initiating a screen switching request;
  • the second service platform terminal receives the screen switching request, generates a new play request according to the information about the second platform service content carried, and starts playing from the carried play time point.
  • the above steps can complete multi-screen interaction between different platforms, reduce manual intervention, and make multi-screen activities fast, free and flexible.
  • FIG. 9 is a structural block diagram of a content intelligent association apparatus. As shown in FIG. 9, the content intelligent association apparatus includes: an access module 90, a feature value extraction module 92, a data storage module 94, and a data processing module 96.
  • the access module 90 is configured to receive the notification request message sent by the service platform, and trigger the feature value extraction module 92 to extract the content feature value; receive the query content correspondence relationship request message sent by the service platform, and return the associated content related information.
  • the feature value extraction module 92 is configured to extract feature values from the content injected by the service platform, wherein the content feature values include information such as audio feature values, video feature values, play durations, and content names; and the video feature value extraction uses extracted key frames to extract The method of image feature of a key frame; the audio feature value extraction adopts a method of decomposing audio into frames and extracting time domain and frequency domain features of the audio frame.
  • the data storage module 94 is configured to store extracted content feature values and content related information and the like; and store platform-to-content correspondence data.
  • the data processing module 96 is configured to use the big data technology to perform comparative analysis on the material information such as the content feature value according to the content matching model, and generate corresponding relationship data between the platform contents, and store the data in the data storage module.
  • FIG. 10 is a flowchart of a multi-screen interaction method automatically associated with a content according to an embodiment. As shown in FIG. 10, the method in this embodiment includes the following steps.
  • step 1001 content provider A injects content into the first service platform.
  • the first service platform sends a notification request message to the access module, and the notification request message carries content related information, where the content related information includes a content name, a content identifier, a content address, a play duration, and the like.
  • step 1003 the access module receives the notification request message sent by the first service platform, and saves the content related information carried in the request message to the data storage module, and the trigger feature value extraction module performs step 1004.
  • step 1004 the feature value extraction module analyzes the content file, extracts the content feature value, and saves the content feature value to the data storage module, wherein the content feature value includes the video feature value and the audio feature value, and the trigger data processing module performs step 1005.
  • the content file may be sent by the first service platform.
  • step 1005 the data processing module uses the big data technology to match the content feature value with the content feature value of the second service platform (second platform) already existing in the material library, and matches one content to generate a pair.
  • the content correspondence of one is saved, and the correspondence is saved to the data storage module.
  • step 1006 the first service platform terminal initiates a request for querying the corresponding content of the displayed content to the access module when displaying the content details.
  • step 1007 the access module receives the request message in step 1006, and returns information about the content of the second service platform associated with the displayed content.
  • step 1008 the first service platform terminal displays a multi-screen interactive identifier (icon) on the page of the content details displayed, and the user initiates a screen switching request when the content is played, and the request carries related information of the associated second service platform content. And playing time points and other parameters; performing step 1009.
  • a multi-screen interactive identifier icon
  • the second service platform terminal receives the screen switching request, generates a new play request according to the content related information of the second service platform that is carried, and plays the on-demand content from the playing time point, where the playing time point The point in time at which the content is currently played.
  • FIG. 11 is a flowchart of a multi-screen interaction method automatically associated with multiple content according to an embodiment. As shown in FIG. 11, the method in this embodiment includes the following steps.
  • step 401 content provider A injects content into the first service platform.
  • the first service platform sends a notification request message to the access module, and carries content related information, where the content related information includes a content name, a content identifier, a content address, a play duration, and the like.
  • step 403 the access module receives the notification request message sent by the first service platform, and saves the content related information carried in the request to the data storage module, and the trigger feature value extraction module performs step 404.
  • step 404 the feature value extraction module analyzes the content file, extracts the content feature value, and saves the content feature value to the data storage module, wherein the content feature value includes a video feature value or an audio feature value, and the trigger data processing module performs step 405.
  • step 405 the data processing module uses the big data technology to match the content feature value with the content feature value of the second service platform existing in the material library, and matches multiple content to generate one-to-many content correspondence. Relationships are saved to the data storage module.
  • step 406 the first service platform terminal initiates a correspondence request of the query content to the access module when displaying the content details.
  • step 407 the access module receives the request message in step 406, and returns information about the content of the second service platform associated with the content. At this time, the returned multiple pieces of related content.
  • step 408 the first service platform terminal displays a multi-screen interactive identifier on the content detail page, and the user initiates a screen switch when playing the content, and carries related information of the multiple second service platform contents and the playing time point, etc. For the parameter, go to step 409.
  • the second service platform terminal receives the screen switching request, displays a plurality of associated content information on the terminal page, and the terminal user freely selects the program to be viewed, and generates a new play request according to the content information selected by the terminal user.
  • the content selected by the user is played from the playing time point; wherein the playing time point is the time point at which the on-demand content is currently played.
  • FIG. 12 is a flowchart of a multi-screen interaction method not associated with content according to an embodiment. As shown in FIG. 12, the method in this embodiment includes the following steps.
  • step 501 content provider A injects content into the first service platform.
  • the first service platform sends a notification request message to the access module, and carries content related information, where the content related information includes a content name, a content identifier, a content address, a play duration, and the like.
  • step 503 the access module receives the notification request message sent by the first service platform, and saves the content related information carried in the request to the data storage module, and the trigger feature value extraction module performs step 504.
  • step 504 the feature value extraction module analyzes the content file, extracts the content feature value, and saves the content feature value to the data storage module, wherein the content feature value includes the video feature value or the audio feature value, triggers the data processing module, and executes step 505.
  • step 505 the data processing module uses the big data technology to compare the content feature values with the content feature values of the second service platform already in the material library, and does not match any content.
  • step 506 the first service platform terminal initiates a query for the corresponding relationship request of the content to the access module when displaying the content details.
  • step 507 the access module receives the request message in step 506 and returns information that "the associated content does not exist.”
  • step 508 the first service platform terminal does not display the multi-screen interactive identifier on the page of the content detail, and when the user initiates the screen switch when the content is played, the user is prompted to play the content without the screen switching.
  • FIG. 13 is a flowchart of a method for automatically matching unrelated content according to an embodiment. As shown in FIG. 13, the method in this embodiment includes the following steps.
  • step 602 the timing device transmits an event number, and the trigger data processing module performs step 602.
  • step 604 the data processing module matches the unassociated content in the data storage module again according to a certain policy.
  • step 606 a content correspondence is generated for the matched content and saved to the data storage module.
  • the timing device triggering condition may be set in advance by the user or the device, and the policy includes the following situations: increasing the priority of the associated operation, reducing the priority of the associated operation for the content that is not matched multiple times, and extending the timing interval.
  • the above steps can avoid content matching failure caused by content injection time difference provided by multiple content providers, and improve processing performance and reduce manual intervention.
  • FIG. 14 is a flowchart of a processing method performed by the apparatus when content is deleted according to an embodiment. As shown in FIG. 14, the method in this embodiment includes the following steps.
  • step 701 content provider A deletes the content from the first service platform.
  • the first service platform sends a notification request message to the access module, and carries related information of the deleted content, including the content name and the content identifier.
  • step 703 the access module receives the notification request message sent by the first service platform, and the trigger data processing module performs step 704.
  • step 704 the data processing module deletes the content feature value of the content corresponding to the content identifier and the association relationship of the content according to the content identifier.
  • FIG. 15 is a structural diagram of an apparatus for intelligent association of content under multi-screen interaction according to an embodiment. As shown in FIG. 15, based on the apparatus provided in FIG. 15, the content intelligent association method includes the following steps.
  • step 1501 three independent service platforms, one of which is the IPTV platform of the first manufacturer, one is the IPTV platform of other vendors (second vendors), one is the mobile phone platform, and the three service platforms are respectively accessed differently.
  • the content provider, the three content providers respectively inject content into the corresponding business platform.
  • step 1502 after the content injection is successful, the three service platforms respectively interact with the content intelligent association device.
  • step 1503 the device analyzes the content injected by the three service platforms, extracts the content feature values, uses the big data technology to match the content feature values, generates the correspondence between the content of different platforms, and saves the corresponding relationship.
  • step 1504 when the mobile platform terminal displays the content details, the mobile platform terminal queries the device for content information on the IPTV platform associated with the content, and displays the multi-screen interactive identifier.
  • step 1505 the mobile platform terminal initiates a multi-screen interaction request, and carries content related information and playback time point information of the IPTV platform.
  • step 1506 the IPTV platform terminal receives the multi-screen interaction request, generates a new play request according to the content related information of the carried IPTV platform, and starts playing from the carried play time point.
  • An embodiment provides a storage medium.
  • the storage medium may be used to save the program code executed by the method in the above embodiment.
  • the storage medium may be located in any one of the computer terminal groups in the computer network, or in any one of the mobile terminal groups.
  • the storage medium is arranged to store program code for performing the following steps:
  • the plurality of content feature values are matched to each other to obtain a matching result, and the multimedia content whose matching value is greater than the first threshold is associated.
  • the storage medium is arranged to store program code for performing the following steps:
  • the playback information is received under the trigger of the screen switching request sent by the first terminal, where the playback information is used to indicate the second terminal.
  • Playing the second multimedia content the second multimedia content is determined by: acquiring, by the content association device, content information of the plurality of multimedia content of the plurality of service platforms and content feature values corresponding to the plurality of content information, The content feature values are matched to obtain a matching result, and the multimedia content whose matching value is greater than the first threshold is used to associate, wherein the content feature value is used to uniquely identify the corresponding multimedia content, and the content association device can Receiving, by the first terminal, a request for querying the second multimedia content; and playing the second multimedia content according to the play information.
  • the division of the unit is only a logical function division, and the module implementation may adopt other division manners, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling or direct coupling or communication connection between the modules may be through some interfaces, indirect coupling or communication connections of the modules, and may be electrical or other forms.
  • the units (modules) described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple networks. On the unit.
  • the functional units in the various embodiments may be integrated into one processing unit, or a plurality of units may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. All or part of the above technical solutions may be embodied in the form of a software product stored in a storage medium, including one or more instructions for causing a computer device (which may be a personal computer, a server or a network device) Etc.) Perform all or part of the steps of the method described in the various embodiments above.
  • the foregoing storage medium includes a plurality of media that can store program codes, such as a USB flash drive, a ROM, a RAM, a mobile hard disk, a magnetic disk, or an optical disk.
  • the association, playback method, device and terminal of the multimedia content solve the problems of high cost, error, and complicated process of the technical solutions in which the content of the multiple platforms in the related art are related to each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种多媒体内容的关联方法包括：获取多个业务平台的多个多媒体内容的内容信息（202）；获取所述多个内容信息对应的内容特征值，其中，所述内容特征值用于唯一标识所述多媒体内容（204）；将所述内容特征值两两进行匹配得到匹配结果，并将匹配结果所指示的匹配值大于第一阈值的多媒体内容进行关联（206）。

Description

多媒体内容的关联、播放方法及装置、终端 技术领域
本公开涉及通信领域，例如，涉及一种多媒体内容的关联、播放方法及装置、终端。
背景技术
随着移动互联网的迅猛发展，互联网电视迅速的崛起，通过手机、平板电脑(PAD)、个人电脑(Personal Computer，PC)、机顶盒等视频终端在线看视频，成为越来越普遍的视频观看方式。随着这一趋势的发展，多屏互动技术应运而生，为广大用户所青睐。多屏互动是指在不同的操作系统上的不同智能终端设备之间进行多媒体(视频、音频、图片等)内容的共享展示，丰富用户的多媒体生活。
网络协议电视(Internet Protocol Television，IPTV)平台和手机平台是相互隔离开的两个独立平台，两个平台注入的内容来自不同的内容提供商且相互独立。根据这一现状要实现机顶盒和移动终端的互联互动，需要关联所述两个平台间的内容。相关技术中，关联所述两个平台间内容的方法包括：手工干预方法和二次加工处理方法。其中，在手工干预方法中，由操作员根据内容名称来手工配置，生成所述两个平台间的内容对应关系，该方法增加了人力成本，且容易出错。在二次加工处理方法中，部署一个系统，该系统对内容进行二次加工处理，生成适用于所述两个平台格式的节目内容，并保存内容对应关系，该方法存在着处理流程复杂并内容版权复杂等问题。
发明内容
本发明实施例提供了一种多媒体内容的关联、播放方法及装置、终端，能够解决相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错以及流程复杂等问题。
一种多媒体内容的关联方法，包括：
获取多个业务平台的多个多媒体内容的内容信息；
获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容；以及
将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
一实施例中，将多个内容特征值两两匹配得到匹配结果包括：
根据所述多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
一实施例中，根据所述多个内容特征值和与所述多个内容特征值对应的权重确定匹配值，包括：
根据以下公式确定所述匹配值C：
Figure PCTCN2017120338-appb-000001
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
一实施例中，所述方法还包括：
将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及
在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
一实施例中，所述内容特征值包括以下至少之一：音频特征值、视频特征值、视频播放时长以及视频内容名称。
一实施例中，当所述内容特征值包括音频特征值时，获取多个内容信息对应的音频特征值，包括：
将音频分解为多个音频帧，从所述多个音频帧中获取每个音频帧的以下特征中的至少之一：时域特征以及频域特征；以及
将所述特征对应的值作为所述音频特征值。
一实施例中，当所述内容特征值包括视频特征值时，获取多个内容信息对应的视频特征值，包括：
从视频中抽取关键帧，并从所述关键帧中提取图像特征；以及
将所述图像特征对应的值作为所述视频特征值。
一实施例中，所述的方法还包括：
接收第一终端发送的查询请求，其中，所述查询请求用于查询所述第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容；
当所述第一多媒体内容未关联所述第二多媒体内容时，确定所述第一终端不支持屏幕切换；以及
当所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至第二终端，其中，所述播放信息包括：所述第二终端的内容标识以及播放时间点。
一实施例中，每个多媒体内容的内容信息包括以下至少之一：唯一标识所述每个多媒体内容的内容标识、唯一标识所述每个多媒体内容对应的业务平台的平台标识、所述每个多媒体内容的存储地址以及所述每个多媒体内容的内容名称。
一种多媒体内容的播放方法，包括：
在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，第二终端在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，所述播放信息用于指示所述第二终端播放所述第二多媒体内容，所述第二多媒体内容通过以下步骤确定：通过内容关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联，其中，每个内容特征值用于唯一标识对应的多媒体内容，所述内容关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求；以及
所述第二终端根据所述播放信息播放所述第二多媒体内容。
一种多媒体内容的关联装置，包括：
第一获取模块，设置为获取多个业务平台的多个多媒体内容的内容信息；
第二获取模块，设置为获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容；
第一确定模块，设置为将多个内容特征值两两匹配得到匹配结果；以及
第一关联模块，设置为将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
一实施例中，所述第一确定模块，设置为根据多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
一实施例中，所述第一确定模块，还设置为根据以下公式确定所述匹配值C：
Figure PCTCN2017120338-appb-000002
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所 述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
一实施例中，所述的装置还包括：
第二关联模块，设置为将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及
第二确定模块，设置为在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
一实施例中，所述的装置还包括：
接收模块，设置为接收第一终端发送的查询请求，其中，所述查询请求用于查询所述第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容；
第二确定模块，设置为在所述第一多媒体内容未关联所述第二多媒体内容时，确定所述第一终端不支持屏幕切换；以及
发送模块，设置为在所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至所述第二终端，其中，所述播放信息包括：所述第二终端的内容标识和播放时间点。
一种多媒体内容的播放装置，应用于终端，包括：
接收模块，设置为在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，所述播放信息用于指示所述终端播放所述第二多媒体内容，所述第二多媒体内容通过以下步骤确定：通过内容关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联，其中，每个内容特征值用于唯一标识对应的多媒体内容，所述内容关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求；以及
播放模块，设置为根据所述播放信息播放所述第二多媒体内容。
一种多媒体内容的关联装置，包括：
处理器；
存储器，设置为存储所述处理器可执行的指令；其中
所述处理器设置为根据所述存储器中存储的指令执行以下操作：
获取多个业务平台的多个多媒体内容的内容信息；
获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标 识对应的多媒体内容；以及
将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
一实施例中，所述处理器还设置为执行以下操作：根据所述多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
一实施例中，所述处理器还设置为根据以下公式确定所述匹配值C：
Figure PCTCN2017120338-appb-000003
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
一实施例中，所述处理器还设置为执行以下操作：将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
一种终端，包括：上述的多媒体内容的播放装置。
一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行上述方法。
一种终端，包括：
至少一个处理器；以及
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器执行上述任一多媒体内容的关联方法。
一种终端，包括：
至少一个处理器；以及
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器执行上述任一多媒体内容的播放方法。
附图说明
图1是根据一实施例的计算机终端的硬件结构框图；
图2是根据一实施例的多媒体内容的关联方法的流程图；
图3为根据一实施例的多媒体内容的播放方法的流程图；
图4是根据一实施例的多媒体内容的关联装置的结构框图；
图5是根据另一实施例的多媒体内容的关联装置的结构框图；
图6为根据一实施例的多媒体内容的播放装置的结构框图；
图7为根据另一实施例的多媒体内容的关联装置的结构框图；
图8为根据一实施例提供的一种多屏互动下内容智能关联的装置的结构框图；
图9为根据一实施例的内容智能关联装置的结构框图；
图10为根据一实施例提供的自动关联到一个内容的多屏互动方法的流程图；
图11为根据一实施例提供的自动关联到多个内容的多屏互动方法的流程图；
图12为根据一实施例提供的未关联到内容的多屏互动方法的流程图；
图13为根据一实施例提供的未关联内容的自动匹配的方法流程图；
图14为根据一实施例提供的内容删除时所述装置执行的处理方法的流程图；以及
图15为一实施例提供的多屏互动下内容智能关联的装置的结构图。
具体实施方式
说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
以下实施例提供的方法可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在计算机终端上为例，图1是根据一实施例的计算机终端的硬件结构框图。如图1所示，计算机终端10可以包括一个或多个(图中仅示出一个)处理器102(处理器102可以包括微处理器(Microcontroller Unit，MCU)或可编程逻辑器件(Field-Programmable Gate Array，FPGA)等的处理装置)、设置为存储数据的存储器104以及具有通信功能的传输装置106。图1所示的结构仅为示意，并不对上述电子装置的结构造成限定。例如，计算机终端10还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。
存储器104可设置为存储应用软件的软件程序以及模块，如以下实施例中 的多媒体内容的关联方法对应的程序指令或模块，处理器102通过运行存储在存储器104内的软件程序以及模块，从而执行多种功能应用以及数据处理，即实现以下方法。存储器104可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中，存储器104可包括相对于处理器102远程设置的存储器，这些远程存储器可以通过网络连接至计算机终端10。上述网络的实例包括互联网、企业内部网、局域网、移动通信网及其组合。
传输装置106设置为经由一个网络接收或者发送数据。上述的网络具体实例可包括计算机终端10的通信供应商提供的无线网络。在一个实例中，传输装置106包括一个网络适配器(Network Interface Controller，NIC)，NIC可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中，传输装置106可以为射频(Radio Frequency，RF)模块，RF模块设置为通过无线方式与互联网进行通讯。
一实施例提供了一种运行于上述计算机终端的方法，图2是根据本实施例的多媒体内容的关联方法的流程图，如图2所示，该流程包括如下步骤。
步骤202中，获取多个业务平台的多个多媒体内容的内容信息。
步骤204中，获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识多媒体内容。
步骤206中，将多个内容特征值两两匹配得到匹配结果，并将匹配结果所指示的匹配值大于第一阈值的多媒体内容进行关联。
上述多个步骤中，能够根据多媒体内容的内容特征值来对不同平台的多媒体内容进行关联，解决了相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错以及流程复杂等问题，实现不同平台之间的内容关联，不受人工干预的限制，为后续不同平台的多屏终端之间的多媒体内容的切换提供了方便。
上述步骤206可以有多种实现方式，在一实施例中，步骤206包括：根据所述多个内容特征值与所述多个内容特征值对应的权重确定匹配值。
一实施例中，根据所述多个内容特征值与所述多个内容特征值对应的权重确定匹配值包括：根据以下公式确定所述匹配值C：
Figure PCTCN2017120338-appb-000004
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所 述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
在一实施例中，a k可以表示对于同一内容特征值(如，音频特征值)，多个多媒体内容所对应的匹配度，匹配度可以是第一终端的多媒体内容中的音频特征值(此处的音频特征值还可以是内容特征值中包括的视频特征值、视频播放时长或者视频内容名称)与第二终端的多媒体内容中的音频特征值的相似度。
在一实施例中，将匹配值大于第一阈值的多媒体内容进行关联，当没有找到匹配值大于第一阈值的多媒体内容时，也可以将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联，也就是说，可以将多个关联的多媒体内容统一进行关联，在一时刻发送给用户终端使用。在匹配值小于所述第二阈值时，确定多媒体内容关联失败。一实施例中，所述内容特征值包括以下至少之一：音频特征值、视频特征值、视频播放时长以及视频内容名称。
一实施例中，基于上述内容特征值，在内容特征值为音频特征值时，获取所述多个内容信息所对应的音频特征值，包括：
将音频分解为多个音频帧，从所述多个音频帧中获取音频帧的以下特征中的至少之一：时域特征和频域特征；以及将所述特征对应的值作为所述音频特征值。
一实施例中，在内容特征值为视频特征值时，获取所述多个内容信息所对应的视频特征值，可以包括：从视频中抽取关键帧，并从所述关键帧中提取图像特征；以及将所述图像特征对应的值作为所述视频特征值。其中，关键帧可以是内部预测(Intra-Prediction，I)帧。
在一实施例中，上述方法还可以包括：接收第一终端发送的查询请求，其中，所述查询请求用于查询所述第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容；当所述第一多媒体内容未关联所述第二多媒体内容时，所述第一终端不支持屏幕切换；当所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至所述第二终端，其中，所述播放信息包括：多媒体内容的内容标识和播放时间点(即第二多媒体内容的播放时间点)。其中
在一实施例中，每个多媒体内容的内容信息包括以下至少之一：唯一标识所述每个多媒体内容的内容标识、唯一标识所述每个多媒体内容对应的业务平台的平台标识、所述每个多媒体内容的存储地址以及所述每个多媒体内容的内 容名称。
基于上述多媒体内容的关联方法，一实施例提供了一种多媒体内容的播放方法，如图3所示，图3为根据本实施例的多媒体内容的播放方法的流程图，如图3所示，多媒体内容的播放方法包括以下步骤。
步骤302中，在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，第二终端在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，播放信息用于指示第二终端播放第二多媒体内容，第二多媒体内容通过以下步骤确定：通过内容关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果指示的匹配值大于第一阈值的多媒体内容进行关联，其中，每个内容特征值用于唯一标识对应的多媒体内容，所述内容关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求。
步骤304中，第二终端根据所述播放信息播放所述第二多媒体内容。
通过上述多个步骤，第二终端能够在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，第二终端在第一终端发送的屏幕切换请求的触发下，接收播放信息，第二多媒体内容是上述内容关联装置根据多媒体内容的内容特征值来对不同平台的多媒体内容进行关联进而确定的。采用上述技术方案，解决了相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错，以及流程复杂等问题，实现不同平台之间的内容关联，不受人工干预的限制，能够实现不同平台的多屏终端之间的多媒体内容的切换。
上述实施例的方法可借助软件加通用硬件平台的方式来实现，也可以通过硬件实现。上述技术方案可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或光盘)中，包括一个或多个指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行多个实施例的方法。
一实施例提供了一种多媒体内容的关联装置，该装置可以实现上述实施例中的方法。如以下所使用的，术语“模块”可以实现预定功能的软件和硬件的组合、软件、或硬件。以下实施例所描述的装置可以以软件，硬件，或者软件和硬件的组合的方式实现。
图4是根据一实施例的多媒体内容的关联装置的结构框图。如图4所示，所述装置包括：第一获取模块40、第二获取模块42、第一确定模块44以及第一关联模块46。
第一获取模块40设置为获取多个业务平台的多个多媒体内容的内容信息。第二获取模块42与第一获取模块40连接，第二获取模块42设置为获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容。第一确定模块44与第二获取模块42连接，第一确定模块44设置为将多个内容特征值两两匹配得到匹配结果。第一关联模块46与第一确定模块44连接，第一关联模块46设置为将匹配结果指示的匹配值大于第一阈值的多媒体内容进行关联。
上述多个模块能够根据多媒体内容的内容特征值来对不同平台的多媒体内容进行关联，解决了相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错，以及流程复杂等问题，实现不同平台之间的内容关联，不受人工干预的限制，为后续不同平台的多屏终端之间的多媒体内容的切换提供了可能。
在一实施例中，第一确定模块44设置为根据多个内容特征值与内容特征值对应的权重确定匹配值，还设置为根据以下公式确定匹配值C：
Figure PCTCN2017120338-appb-000005
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
一实施例中，为了更好地关联多媒体内容，在一实施例中，如图5所示，在上述实施例的基础上，所述装置还可以包括：第二关联模块48和第二确定模块50。第二关联模块48与第一确定模块44连接，第二关联模块48设置为将小于第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联。第二确定模块50与第一确定模块44连接，第二确定模块50设置为在匹配值小于第二阈值时，确定多媒体内容关联失败。
一实施例中，如图5所示，上述装置还包括：第一接收模块52、第三确定模块54以及发送模块56。第一接收模块52与第一关联模块46或第二关联模块48连接，第一接收模块52设置为接收第一终端发送的查询请求，其中，查询请求用于查询第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容。
第三确定模块54与第一接收模块52连接，第三确定模块54设置为在第一多媒体内容未关联第二多媒体内容时，确定第一终端不支持屏幕切换。
发送模块56设置为在所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至所述第二终端，其中，所述播放信息包括：所述第二终端的内容标识以及播放时间点。
一实施例提供了一种多媒体内容的播放装置，该播放装置可应用于第二终端，图6为根据本实施例的多媒体内容的播放装置的结构框图，如图6所示，所述播放装置包括：第二接收模块60和播放模块62。
第二接收模块60设置为在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，播放信息用于指示第二终端播放第二多媒体内容，第二多媒体内容通过以下步骤确定：通过内容关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果指示的匹配值大于第一阈值的多媒体内容进行关联，其中，内容特征值用于唯一标识对应的多媒体内容，所述内容关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求。
播放模块62设置为根据播放信息播放所述第二多媒体内容。
通过上述播放模块，第二终端能够在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，在第一终端发送的屏幕切换请求的触发下，接收播放信息，第二多媒体内容是上述内容关联装置根据多媒体内容的内容特征值来对不同平台的多媒体内容进行关联进而确定的。采用上述技术方案，解决了相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错，以及流程复杂等问题，实现不同平台之间的内容关联，不受人工干预的限制，进而能够实现不同平台的多屏终端之间的多媒体内容的切换。
在一实施例中，提供了一种终端，包括以上所述的多媒体内容的播放装置。
在一实施例中，提供了一种多媒体内容的关联装置，图7为根据本实施例的多媒体内容的关联装置的结构框图，如图7所示，多媒体内容的关联装置的包括：
处理器70；以及，存储器72，设置为存储处理器可执行的指令；其中，
处理器70设置为根据存储器中存储的指令执行以下操作：获取多个业务平台的多个多媒体内容的内容信息；获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容；以及将多个内容特征值两两 匹配得到匹配结果，并将匹配结果所指示的匹配值大于第一阈值的多媒体内容进行关联。
在一实施例中，处理器70还设置为执行以下操作：根据多个内容特征值和与多个内容特征值对应的权重确定匹配值。
一实施例中，处理器70还设置为根据以下公式确定匹配值C：
Figure PCTCN2017120338-appb-000006
其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
一实施例中，处理器70还设置为执行以下操作：将小于第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及在匹配值小于第二阈值时，确定多媒体内容关联失败。
以下结合一示例对上述多媒体内容的关联和播放方法进行说明。
本示例提供了一种多屏互动下多媒体内容智能关联的装置，能够实现不同平台间的内容智能关联，无需对内容进行二次加工处理，减少人工干预。
本示例中的多屏互动下内容智能关联的装置包括：
设置为接收不同业务平台请求消息的接入模块；
设置为提取内容特征值的特征值提取模块(相当于上述实施例的第二获取模块42)；
设置为存储内容特征值等信息的数据存储模块；以及
设置为匹配内容特征值生成内容对应关系的数据处理模块(相当于上述实施例的第一确定模块44)。
基于上述内容智能关联的装置，在一实施例中，提供了所述装置能够实现的内容智能关联的方法，该方法包括以下6个步骤。
在步骤1中，内容发布时，第一平台及第二平台将发布的内容相关信息发送到所述装置的接入模块，其中，内容相关信息包含内容标识、平台标识以及存储地址等信息。
在步骤2中，所述接入模块接收所述两个平台发送的内容相关信息，内容相关信息被保存到所述装置的数据存储模块，所述接入模块触发所述装置的特征值提取模块对所述两个平台的内容提取内容特征值，其中，内容特征值包含音频特征值、视频特征值、播放时长以及内容名称等信息。两个平台的内容可以是在接入模块接收内容相关信息之前，由两平台发送至接入模块的。
一实施例中，特征提取是对一模式的组测量值进行变换，以突出该模式具有代表性特征，并对其符号化，形成特征矢量或符号串、关系图，从而产生代表对象的模式。一实施例中，视频特征值提取采用抽取关键帧，提取关键帧的图像特征的方式。一实施例中，音频特征值提取采用将音频分解为音频帧，提取音频帧的时域特征和频域特征中的至少之一的方式。其中，一模式的组测量值可以是一模式下的多个特征的一组测量数据。
在步骤3中，所述装置的数据处理模块采用大数据技术，从第一平台及第二平台注入的内容中提取相应的特征值，对特征值进行匹配并生成内容的对应关系。所述对应关系包含一对一的映射关系，即对应关系可以是一个多媒体内容对应多个多媒体内容，将所述对应关系保存在所述装置的数据存储模块中。例如：根据从第一平台的视频1提取的内容特征生成唯一标识视频1的特征值A，根据从第二平台的视频2提取的内容特征生成唯一标识视频2的特征值B，对特征值A与特征值B进行匹配，当匹配结果满足一定条件，则认定视频1与视频2是相关联的。
在步骤4中，第一平台终端(相当于上述实施例的第一终端)展示内容详情时，向所述装置的接入模块发送查询内容关联关系的请求消息，当查询的内容已关联相应的内容时，第一平台终端显示支持多屏互动图标，用户可发起屏幕切换请求；以及当查询的内容未关联时，则第一平台终端所述内容不支持屏幕切换。
在步骤5中，第一平台终端发起屏幕切换请求，将此内容关联的第二终端内容的内容标识、播放时间点和第二平台终端标识信息通过多屏互动模块转发给第二平台终端。
在步骤6中，第二平台终端(相当于上述实施例的第二终端)接收多屏互动模块转发的第一平台终端的屏幕切换请求，根据携带的所述内容标识生成新的播放请求，从携带的所述播放时间点开始播放。
在一实施例中，提供了一种内容特征值匹配模型：匹配值
Figure PCTCN2017120338-appb-000007
其中：a k标识内容特征值的匹配度(例如，内容特征值可以包括以下至少之一：视频特征值、音频特征值以及内容名称)；以及b k标识内容特征值的匹配度的权重值(例如可以取0.4，0.5，0.1)。
设置播放时长完全一致，当匹配值C达到满足一定条件时，即可认定两个内容是相关联的；即可以设定多个阀值，当C满足第一阀值时，优先取C值最高的，当匹配度落在第二阀值与第一阀值区间时，可取多个内容关联，在屏幕切换时，终端可展示多个关联内容，由用户自由选择，当C小于第二阀值，视为匹配失败。
上述示例中，在保持至少两个平台隔离的前提下，实现了至少两个平台间的内容智能关联，且不受人工干预的限制，使不同平台多屏终端间的视频自由切换更为快速、灵活，提高用户体验。
基于上述实施例提供的多屏互动下的内容智能关联的装置，多媒体内容的关联处理方法包括：在内容发布时，该装置的接入模块接收来自第一平台及第二平台内容信息通知消息；触发该装置的特征值提取模块对两个平台发布的内容进行内容特征值提取处理，其中，内容特征值包含以下至少之一：音频特征值、视频特征值、播放时长以及内容名称，将提取的内容特征值及内容相关信息保存在数据存储模块中；该装置的数据处理模块基于大数据技术对两个平台的内容特征值进行匹配，当匹配度达到一定条件时，则认定两个内容是相关联的，将两个平台内容的对应关系保存到数据存储模块中；在屏幕切换时，第一平台终端将已关联的第二平台的内容信息及播放时长发送至第二平台终端，第二平台终端根据所述内容信息生成新的播放请求，根据所述播放时长开始播放。
上述实施例在保持至少两个平台隔离的前提下，实现了至少两个平台间的内容智能关联，且不受人工干预的限制，使不同平台多屏终端间的视频自由切换更为快速、灵活，提高用户体验。
以下结合多个实施例对上述多媒体内容的关联方法和播放方法进行说明。
图8为一实施例提供的一种多屏互动下内容智能关联的装置的结构框图，如图8所示，基于图8的结构，多媒体内容的关联方法和播放方法可以包括以下步骤：
两个内容提供商(Content Provider，CP)CP1和CP2分别将内容注入到两个业务平台(第一平台和第二平台)；
所述两个业务平台发送通知请求消息给接入模块；
接入模块触发特征值提取模块从所述两个业务平台的内容中提取内容特征值，保存内容特征值到数据存储模块；
数据处理模块对所述两个平台的内容特征值进行匹配，生成内容对应关系，并将对应关系保存到数据存储模块；
第一业务平台终端在展示内容详情时，发送查询内容对应关系请求消息到接入模块，显示支持多屏互动图标；第一业务平台(第一平台)终端携带第二平台业务内容相关信息及播放时间点信息，发起屏幕切换请求；以及
第二业务平台终端收到屏幕切换请求，根据携带的第二平台业务内容相关信息生成新的播放请求，从携带的播放时间点开始播放。
上述步骤能够完成不同平台间多屏互动操作，减少人工干预，使得多屏活动快速、自由灵活。
图9为根据一实施例的内容智能关联装置的结构框图，如图9所示，内容智能关联装置包括：接入模块90、特征值提取模块92、数据存储模块94和数据处理模块96。
接入模块90设置为接收业务平台发送的通知请求消息，并触发特征值提取模块92提取内容特征值；接收业务平台发送的查询内容对应关系请求消息，返回所关联的内容相关信息。
特征值提取模块92设置为从业务平台注入的内容中提取特征值，其中，内容特征值包含音频特征值、视频特征值、播放时长以及内容名称等信息；视频特征值提取采用抽取关键帧，提取关键帧的图像特征的方式；音频特征值提取采用将音频分解为帧，提取音频帧的时域、频域特征的方式。
数据存储模块94设置为存储提取的内容特征值及内容相关信息等素材；存储平台内容间对应关系数据。
数据处理模块96设置为采用大数据技术，根据内容匹配模型对内容特征值等素材信息进行比对分析，生成平台内容间的对应关系数据，并存储在数据存储模块。
图10为一实施例提供的自动关联到一个内容的多屏互动方法的流程图，如图10所示，本实施例的所述方法包括以下步骤。
步骤1001中，内容提供商A将内容注入到第一业务平台。
步骤1002中，第一业务平台发送通知请求消息给接入模块，通知请求消息携带内容相关信息，内容相关信息包含内容名称、内容标识、内容地址以及播放时长等。
步骤1003中，接入模块接收第一业务平台发送的通知请求消息，将请求消息携带的内容相关信息保存到数据存储模块，触发特征值提取模块执行步骤1004。
在步骤1004中，特征值提取模块对内容文件进行分析，提取内容特征值，并保存到数据存储模块，其中，内容特征值包含视频特征值以及音频特征值等，触发数据处理模块执行步骤1005。其中，所述内容文件可以是第一业务平台发送的。
在步骤1005中，数据处理模块采用大数据技术，根据所述内容特征值与素材库中已有的第二业务平台(第二平台)的内容特征值比对，匹配到一个内容，生成一对一的内容对应关系，并将对应关系保存到数据存储模块。
在步骤1006中，第一业务平台终端在展示内容详情时，发起查询展示的内容的对应关系请求到接入模块。
在步骤1007中，接入模块接收步骤1006中的请求消息，返回展示的内容关联的第二业务平台内容的相关信息。
在步骤1008中，第一业务平台终端在展示的内容详情的页面显示多屏互动标识(图标)，用户在播放内容时发起屏幕切换请求，该请求携带所关联的第二业务平台内容的相关信息及播放时间点等参数；执行步骤1009。
在步骤1009中，第二业务平台终端接收到屏幕切换请求，根据携带的所述第二业务平台内容相关信息生成新的播放请求，并从播放时间点播放点播内容，其中，所述播放时间点为点播内容当前播放的时间点。
图11为一实施例提供的自动关联到多个内容的多屏互动方法的流程图，如图11所示，本实施例的所述方法包括以下步骤。
在步骤401中，内容提供商A将内容注入到第一业务平台。
在步骤402中，第一业务平台发送通知请求消息给接入模块，携带内容相关信息，内容相关信息包含内容名称、内容标识、内容地址以及播放时长等。
在步骤403中，接入模块接收第一业务平台发送的通知请求消息，将请求携带的内容相关信息保存到数据存储模块，触发特征值提取模块执行步骤404。
在步骤404中，特征值提取模块对内容文件进行分析，提取内容特征值，并保存到数据存储模块，其中，内容特征值包含视频特征值或音频特征值，触发数据处理模块执行步骤405。
在步骤405中，数据处理模块采用大数据技术，根据所述内容特征值与素材库中已有的第二业务平台的内容特征值比对，匹配到多个内容，生成一对多的内容对应关系，并保存到数据存储模块。
在步骤406中，第一业务平台终端在展示内容详情时，发起查询内容的对应关系请求到接入模块。
在步骤407中，接入模块接收步骤406中的所述请求消息，返回所述内容关联的第二业务平台内容的相关信息，此时，返回的是多个关联内容。
在步骤408中，第一业务平台终端在所述内容详情页面显示多屏互动标识，用户在播放内容时发起屏幕切换，携带所关联的多个第二业务平台内容的相关信息及播放时间点等参数，执行步骤409。
在步骤409中，第二业务平台终端接收到屏幕切换请求，在终端页面展示多个所关联的内容信息，由终端用户自由选择要观看的节目，根据终端用户选择的内容信息生成新的播放请求，从播放时间点开始播放用户选择的内容(点播内容)；其中，所述播放时间点为点播内容当前播放的时间点。
图12为一实施例提供的未关联到内容的多屏互动方法的流程图，如图12所示，本实施例的所述方法包括以下步骤。
在步骤501中，内容提供商A将内容注入到第一业务平台。
在步骤502中，第一业务平台发送通知请求消息给接入模块，携带内容相关信息，内容相关信息包含内容名称、内容标识、内容地址以及播放时长等。
在步骤503中，接入模块接收第一业务平台发送的通知请求消息，将请求携带的内容相关信息保存到数据存储模块，触发特征值提取模块执行步骤504。
在步骤504中，特征值提取模块对内容文件进行分析，提取内容特征值，并保存到数据存储模块，其中，内容特征值包含视频特征值或音频特征值，触发数据处理模块，执行步骤505。
在步骤505中，数据处理模块采用大数据技术，根据所述内容特征值与素材库中已有的第二业务平台的内容特征值比对，未匹配到任何内容。
在步骤506中，第一业务平台终端在展示内容详情时，发起查询所述内容的对应关系请求到接入模块。
在步骤507中，接入模块接收步骤506中的请求消息，返回“关联内容不存在”的信息。
在步骤508中，第一业务平台终端在内容详情的页面不显示多屏互动标识，用户在播放内容时发起屏幕切换时，提示用户当前播放内容不支持屏幕切换。
图13为一实施例提供的未关联内容的自动匹配的方法流程图，如图13所示，本实施例的所述方法包括以下步骤。
在步骤602中，定时装置发送事件号，触发数据处理模块执行步骤602。
在步骤604中，数据处理模块按照一定的策略对数据存储模块中未关联的内容再次匹配。
在步骤606中，对匹配到的内容生成内容对应关系，保存到数据存储模块。
其中，定时装置触发条件可以由用户或设备提前设定，所述策略包含如下情况：增加关联操作优先级，对于多次未匹配到的内容，降低其关联操作优先级，以及延长定时间隔时间。
上述步骤可以避免因多内容提供商提供的内容注入时差导致内容匹配失败的情况，同时提高处理性能，减少人工干预。
图14为一实施例提供的内容删除时所述装置执行的处理方法的流程图，如图14所示，本实施例的所述方法包括以下步骤。
在步骤701中，内容提供商A将内容从第一业务平台删除。
在步骤702中，第一业务平台发送通知请求消息给接入模块，携带所删除内容的相关信息，包含内容名称以及内容标识等。
在步骤703中，接入模块接收第一业务平台发送的通知请求消息，触发数据处理模块执行步骤704。
在步骤704中，数据处理模块根据所述内容标识，删除与内容标识对应的内容的内容特征值及该内容的关联关系。
图15为一实施例提供的一种多屏互动下内容智能关联的装置的结构图，如图15所示，基于图15所提供的装置，内容智能关联方法包括以下步骤。
在步骤1501中，三个相互独立的业务平台，其中一个是第一厂商的IPTV平台，一个是其他厂商(第二厂商)的IPTV平台，一个是手机平台，三个业务平台分别接入不同的内容提供商，三个内容提供商分别将内容注入到对应的业务平台。
在步骤1502中，三个业务平台在内容注入成功后，分别与内容智能关联装置交互。
在步骤1503中，所述装置对三个业务平台注入的内容进行分析，提取内容特征值，使用大数据技术对内容特征值进行匹配，生成不同平台间的内容的对应关系，并保存该对应关系。
在步骤1504中，手机平台终端在展示内容详情时，手机平台终端向所述装置查询该内容关联的IPTV平台上的内容信息，并显示多屏互动标识。
在步骤1505中，手机平台终端发起多屏互动请求，并携带IPTV平台内容相关信息和播放时间点信息。
在步骤1506中，IPTV平台终端收到多屏互动请求，根据携带的IPTV平台内容相关信息生成新的播放请求，从携带的播放时间点开始播放。
一实施例提供了一种存储介质。在本实施例中，上述存储介质可以用于保存上述实施例中的方法所执行的程序代码。在一实施例中，上述存储介质可以位于计算机网络中计算机终端群中的任意一个计算机终端中，或者位于移动终端群中的任意一个移动终端中。
在一实施例中，存储介质被设置为存储用于执行以下步骤的程序代码：
获取多个业务平台的多个多媒体内容的内容信息；
获取多个内容信息所对应的内容特征值，其中，内容特征值用于唯一标识对应的多媒体内容；以及
将多个内容特征值两两匹配得到匹配结果，并将匹配结果所指示的匹配值大于第一阈值的多媒体内容进行关联。
在一实施例中，存储介质被设置为存储用于执行以下步骤的程序代码：
在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，播放信息用于指示第二终端播放第二多媒体内容，第二多媒体内容通过以下步骤确定：通过内容关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息所对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果所指示的匹配值大于第一阈值的多媒体内容进行关联，其中，内容特征值用于唯一标识对应的多媒体内容，所述内容关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求；以及根据播放信息播放所述第二多媒体内容。
以上所描述的装置实施例仅仅是示意性的，例如所述单元(模块)的划分，仅仅为一种逻辑功能划分，模块实现时可以采用其他的划分方式，例如多个单 元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。模块之间的耦合或直接耦合或通信连接可以是通过一些接口，模块的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元(模块)可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。多个实施例中的功能单元可以集成在一个处理单元中，也可以是多个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。上述技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括一个或多个指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行上述多个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、ROM、RAM、移动硬盘、磁碟或者光盘等多种可以存储程序代码的介质。
工业实用性
多媒体内容的关联、播放方法及装置、终端，解决了相关技术中多平台之间内容相互关联的技术方案存在成本高，易出错，以及流程复杂等问题。

Claims (22)

  1. 一种多媒体内容的关联方法，包括：
    获取多个业务平台的多个多媒体内容的内容信息；
    获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容；以及
    将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
  2. 根据权利要求1所述的方法，其中，将多个内容特征值两两匹配得到匹配结果包括：
    根据所述多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
  3. 根据权利要求2所述的方法，其中，根据所述多个内容特征值和与所述多个内容特征值对应的权重确定匹配值，包括：
    根据以下公式确定所述匹配值C：
    Figure PCTCN2017120338-appb-100001
    其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
  4. 根据权利要求1所述的方法，还包括：
    将小于所述第一阈值，且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及
    在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
  5. 根据权利要求1所述的方法，其中，所述内容特征值包括以下至少之一：音频特征值、视频特征值、视频播放时长以及视频内容名称。
  6. 根据权利要求5所述的方法，其中，当所述内容特征值包括音频特征值时，获取多个内容信息对应的音频特征值，包括：
    将音频分解为多个音频帧，从所述多个音频帧中获取每个音频帧的以下特征中的至少之一：时域特征以及频域特征；以及
    将所述特征对应的值作为所述音频特征值。
  7. 根据权利要求5所述的方法，其中，当所述内容特征值包括视频特征值时，获取多个内容信息对应的视频特征值，包括：
    从视频中抽取关键帧，并从所述关键帧中提取图像特征；以及
    将所述图像特征对应的值作为所述视频特征值。
  8. 根据权利要求1所述的方法，还包括：
    接收第一终端发送的查询请求，其中，所述查询请求用于查询所述第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容；
    当所述第一多媒体内容未关联所述第二多媒体内容时，所述第一终端不支持屏幕切换；以及
    当所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至第二终端，其中，所述播放信息包括：所述第二终端的内容标识以及播放时间点。
  9. 根据权利要求1-8任一项所述的方法，其中，每个多媒体内容的内容信息包括以下至少之一：唯一标识所述每个多媒体内容的内容标识、唯一标识所述每个多媒体内容对应的业务平台的平台标识、所述每个多媒体内容的存储地址以及所述每个多媒体内容的内容名称。
  10. 一种多媒体内容的播放方法，包括：
    在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，第二终端在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，所述播放信息用于指示所述第二终端播放所述第二多媒体内容，所述第二多媒体内容通过以下步骤确定：多媒体内容的关联装置获取多个业务平台的多个多媒体内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联，其中，所述第二多媒体内容为关联的多个多媒体内容中的至少之一，每个内容特征值用于唯一标识对应的多媒体内容，以及所述多媒体内容的关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求；以及
    所述第二终端根据所述播放信息播放所述第二多媒体内容。
  11. 一种多媒体内容的关联装置，包括：
    第一获取模块，设置为获取多个业务平台的多个多媒体内容的内容信息；
    第二获取模块，设置为获取多个内容信息对应的内容特征值，其中，每个 内容特征值用于唯一标识对应的多媒体内容；
    第一确定模块，设置为将多个内容特征值两两匹配得到匹配结果；以及
    第一关联模块，设置为将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
  12. 根据权利要求11所述的装置，其中，所述第一确定模块，设置为根据多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
  13. 根据权利要求12所述的装置，其中，所述第一确定模块，还设置为根据以下公式确定所述匹配值C：
    Figure PCTCN2017120338-appb-100002
    其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
  14. 根据权利要求11所述的装置，还包括：
    第二关联模块，设置为将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及
    第二确定模块，设置为在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
  15. 根据权利要求11所述的装置，还包括：
    接收模块，设置为接收第一终端发送的查询请求，其中，所述查询请求用于查询所述第一终端当前播放的第一多媒体内容是否已关联第二多媒体内容；
    第二确定模块，设置为在所述第一多媒体内容未关联所述第二多媒体内容时，确定所述第一终端不支持屏幕切换；以及
    发送模块，设置为在所述第一多媒体内容已关联所述第二多媒体内容时，将播放所述第二多媒体内容所需的播放信息发送至所述第二终端，其中，所述播放信息包括：所述第二终端的内容标识和播放时间点。
  16. 一种多媒体内容的播放装置，应用于终端，包括：
    接收模块，设置为在第一终端当前播放的第一多媒体内容已关联第二多媒体内容时，在第一终端发送的屏幕切换请求的触发下，接收播放信息，其中，所述播放信息用于指示所述终端播放所述第二多媒体内容，所述第二多媒体内容通过以下步骤确定：多媒体内容的关联装置获取多个业务平台的多个多媒体 内容的内容信息和多个内容信息对应的内容特征值，将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联，其中，所述第二多媒体内容为关联的多个多媒体内容中的至少之一，每个内容特征值用于唯一标识对应的多媒体内容，所述多媒体内容的关联装置能够接收所述第一终端发送的查询所述第二多媒体内容的请求；以及
    播放模块，设置为根据所述播放信息播放所述第二多媒体内容。
  17. 一种多媒体内容的关联装置，包括：
    处理器；
    存储器，设置为存储所述处理器可执行的指令；其中
    所述处理器设置为根据所述存储器中存储的指令执行以下操作：
    获取多个业务平台的多个多媒体内容的内容信息；
    获取多个内容信息对应的内容特征值，其中，每个内容特征值用于唯一标识对应的多媒体内容；以及
    将多个内容特征值两两匹配得到匹配结果，并将匹配结果中大于第一阈值的匹配值对应的多媒体内容进行关联。
  18. 根据权利要求17所述的装置，其中，所述处理器还设置为执行以下操作：根据所述多个内容特征值和与所述多个内容特征值对应的权重，确定匹配值。
  19. 根据权利要求18所述的装置，其中，所述处理器还设置为根据以下公式确定所述匹配值C：
    Figure PCTCN2017120338-appb-100003
    其中，n为从多媒体内容中提取的内容特征值的个数，a k为所述多媒体内容的内容特征值的匹配度，b k为所述内容特征值对应的权重。
  20. 根据权利要求17所述的装置，其中，所述处理器还设置为执行以下操作：将小于所述第一阈值且大于第二阈值的匹配值对应的多个多媒体内容进行关联；以及在所述匹配值小于所述第二阈值时，确定多媒体内容关联失败。
  21. 一种终端，包括：权利要求16所述的多媒体内容的播放装置。
  22. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行权利要求1-10中任一方法。
PCT/CN2017/120338 2016-12-30 2017-12-29 多媒体内容的关联、播放方法及装置、终端 WO2018121780A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611259223.5A CN108268486B (zh) 2016-12-30 2016-12-30 多媒体内容的关联、播放方法及装置、终端
CN201611259223.5 2016-12-30

Publications (1)

Publication Number Publication Date
WO2018121780A1 true WO2018121780A1 (zh) 2018-07-05

Family

ID=62710901

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/120338 WO2018121780A1 (zh) 2016-12-30 2017-12-29 多媒体内容的关联、播放方法及装置、终端

Country Status (2)

Country Link
CN (1) CN108268486B (zh)
WO (1) WO2018121780A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109408668A (zh) * 2018-09-26 2019-03-01 传线网络科技（上海）有限公司 多媒体内容的关联方法及装置
CN110737783B (zh) * 2019-10-08 2023-01-17 腾讯科技（深圳）有限公司 一种推荐多媒体内容的方法、装置及计算设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101299690A (zh) * 2008-06-26 2008-11-05 蓝汛网络科技（北京）有限公司 一种多媒体内容的监测方法、系统及装置
CN103607380A (zh) * 2013-11-07 2014-02-26 深圳创维数字技术股份有限公司 一种多屏互动的方法、装置及系统
CN105120447A (zh) * 2015-07-10 2015-12-02 百度在线网络技术（北京）有限公司 一种终端连接方法及装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184182A (zh) * 2011-03-24 2011-09-14 中国华录集团有限公司 面向视频的基于时间点和关键词的增值信息系统
CN103106208B (zh) * 2011-11-11 2017-09-15 中国移动通信集团公司 一种移动互联网中的流媒体内容推荐方法和系统
US8620917B2 (en) * 2011-12-22 2013-12-31 Telefonaktiebolaget L M Ericsson (Publ) Symantic framework for dynamically creating a program guide
CN102543136B (zh) * 2012-02-17 2015-05-20 广州盈可视电子科技有限公司 一种视频剪辑的方法及装置
CN102855298B (zh) * 2012-08-16 2016-08-03 熊兵 图像检索方法及系统
CN104065980A (zh) * 2013-03-21 2014-09-24 北京中传数广技术有限公司 一种播放内容关联数据的统计方法、装置及系统
CN103761232B (zh) * 2013-10-17 2017-07-11 北京奇虎科技有限公司 一种提供网页媒体内容信息的方法和装置
CN104376121B (zh) * 2014-12-04 2018-03-27 深圳大数点科技有限公司 一种图片自适应匹配组合呈现的系统、方法及用户终端
CN104504059B (zh) * 2014-12-22 2018-03-27 合一网络技术(北京)有限公司 多媒体资源推荐方法
CN106156270B (zh) * 2016-06-17 2020-09-11 北京小米移动软件有限公司 多媒体数据推送方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101299690A (zh) * 2008-06-26 2008-11-05 蓝汛网络科技（北京）有限公司 一种多媒体内容的监测方法、系统及装置
CN103607380A (zh) * 2013-11-07 2014-02-26 深圳创维数字技术股份有限公司 一种多屏互动的方法、装置及系统
CN105120447A (zh) * 2015-07-10 2015-12-02 百度在线网络技术（北京）有限公司 一种终端连接方法及装置

Also Published As

Publication number Publication date
CN108268486A (zh) 2018-07-10
CN108268486B (zh) 2022-04-19

Similar Documents

Publication Publication Date Title
US10182193B2 (en) Automatic identification and mapping of consumer electronic devices to ports on an HDMI switch
US20180014043A1 (en) Method, apparatus, and system for switching from video live stream to video-on-demand data
US20140317242A1 (en) Electronic device and method of registering personal cloud apparatus in user portal server thereof
US20180167689A1 (en) Video Studio Creating Method and Service Device
US20160295269A1 (en) Information pushing method, device and system
WO2018145594A1 (zh) 视频直播的方法、装置和直播接流服务器
US20140310741A1 (en) System for sharing data via cloud server and method thereof
WO2015101101A1 (zh) 频道接入方法和系统
US10972804B2 (en) Network-based control of a media device
WO2015027717A1 (zh) 网络视频的播放方法、装置及终端设备
US20140036098A1 (en) Terminal Apparatus And Video-Data Distribution Method
WO2019052460A1 (zh) 信息推送方法、存储介质、终端设备及服务器
CN111901695B (zh) 视频内容截取方法、装置和设备及计算机存储介质
US11523146B2 (en) Live broadcast method and apparatus, electronic device, and storage medium
WO2015180688A1 (zh) 媒体处理方法及设备
WO2018120967A1 (zh) 一种网络视频批量转推的方法及系统
US20160029053A1 (en) Method for transmitting media data and virtual desktop server
WO2016150273A1 (zh) 一种视频播放方法、移动终端及系统
CN106470146A (zh) 即时通信应用中文本转换为语音的方法和装置
WO2018121780A1 (zh) 多媒体内容的关联、播放方法及装置、终端
CN106330681B (zh) 一种共享观影信息的方法、系统及相关设备
US20170171339A1 (en) Advertisement data transmission method, electrnoic device and system
JP2021530905A (ja) ビデオ処理方法、装置、端末及び記憶媒体
WO2023011021A1 (zh) 直播画面显示方法、装置和存储介质及电子设备
CN108076381B (zh) 视频显示方法、视频转发设备及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17888738

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17888738

Country of ref document: EP

Kind code of ref document: A1