CN108268486B

CN108268486B - Multimedia content association and playing method and device, and terminal

Info

Publication number: CN108268486B
Application number: CN201611259223.5A
Authority: CN
Inventors: 刘秀萍; 黄胜鲁; 李锐
Original assignee: ZTE Corp
Current assignee: ZTE Corp
Priority date: 2016-12-30
Filing date: 2016-12-30
Publication date: 2022-04-19
Anticipated expiration: 2036-12-30
Also published as: WO2018121780A1; CN108268486A

Abstract

The invention provides a method, a device and a terminal for associating and playing multimedia contents, wherein the method comprises the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms; acquiring content characteristic values corresponding to the plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content; the content characteristic values are matched pairwise to obtain matching results, and the multimedia content with the matching value indicated by the matching results larger than the first threshold value is correlated.

Description

Multimedia content association and playing method and device, and terminal

Technical Field

The invention relates to the field of communication, in particular to a method, a device and a terminal for associating and playing multimedia content.

Background

With the rapid development of the mobile internet and the rapid rise of the internet television, online video watching through video terminals such as mobile phones, PADs, PCs, set-top boxes and the like becomes an increasingly common video watching mode, and with the development of the trend, a multi-screen interaction technology is produced and favored by the majority of users. The multi-screen interaction refers to sharing and displaying of multimedia (video, audio, pictures and the like) contents among different intelligent terminal devices on different operating systems, and multimedia life of users is enriched.

For the current IPTV platform and the mobile phone platform, the two platforms are two independent platforms separated from each other, and the content injected by the two platforms comes from different content providers and is independent from each other. According to the current situation, to realize the interconnection and interaction between the set top box and the mobile terminal, the content between the two platforms needs to be associated. Existing methods for associating content between the two platforms are: one is manual intervention, and an operator manually configures the two platforms according to the content name to generate the content corresponding relation between the two platforms, so that the method increases the labor cost and is easy to make mistakes; one is to deploy a system to process the content for the second time, generate the program content suitable for the two platform formats, and store the corresponding relationship of the content.

Aiming at the problems of high cost, high error tendency, complex flow and the like of the technical scheme of content correlation among multiple platforms in the related technology, an effective solution is not provided.

Disclosure of Invention

The embodiment of the invention provides a method, a device and a terminal for associating and playing multimedia contents, and at least solves the problems of high cost, high error tendency, complex flow and the like of the technical scheme of content correlation among multiple platforms in the related technology.

According to an embodiment of the present invention, there is provided a method for associating multimedia content, including:

acquiring content information of a plurality of multimedia contents of a plurality of service platforms; acquiring content characteristic values corresponding to the plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content; and matching every two content characteristic values to obtain a matching result, and associating the multimedia content of which the matching value indicated by the matching result is greater than a first threshold value.

Further, matching the content feature values pairwise to obtain a matching result comprises:

and determining a matching value according to the content characteristic value and the weight corresponding to the content characteristic value.

Further, determining a matching value according to the weight corresponding to the content feature value and the content feature value includes:

determining the match value C according to the following formula:

wherein n is the number of content characteristic values extracted from the multimedia content, a_kAs a degree of matching of content characteristic values of the multimedia content, b_kAnd the weight is corresponding to the content characteristic value.

Further, the method further comprises:

associating one or more multimedia contents having a matching value less than the first threshold and greater than a second threshold;

and when the matching value is smaller than the second threshold value, determining that the multimedia content association fails.

Further, the content feature value includes at least one of: audio characteristic value, video playing time length and video content name.

Further, acquiring the audio feature values corresponding to the plurality of content information includes:

decomposing audio into a plurality of audio frames, and acquiring at least one of the following characteristics of the audio frames from the plurality of audio frames: time domain features, frequency domain features;

and taking the value corresponding to the characteristic as the audio characteristic value.

Further, acquiring the video feature values corresponding to the plurality of content information includes:

extracting key frames from a video, and extracting image features from the key frames;

and taking the value corresponding to the image characteristic as the video characteristic value.

Further, the method further comprises:

receiving an inquiry request sent by a first terminal, wherein the inquiry request is used for inquiring whether a first multimedia content currently played by the first terminal is associated with a second multimedia content;

if the first multimedia content is not associated with the second multimedia content, the first terminal does not support screen switching;

if the first multimedia content is associated with the second multimedia content, sending playing information required for playing the second multimedia content to the second terminal, wherein the playing information comprises: and the content identification and the playing time point content of the second terminal.

Further, the content information of the multimedia content includes at least one of: the system comprises a content identifier for uniquely identifying the multimedia content, a platform identifier for uniquely identifying the service platform, a storage address of the multimedia content and a content name of the multimedia content.

According to another embodiment of the present invention, there is also provided a method for playing multimedia content, including:

when a first multimedia content currently played by a first terminal is associated with a second multimedia content, a second terminal receives playing information under the trigger of a screen switching request sent by the first terminal, wherein the playing information is used for indicating the second terminal to play the second multimedia content, and the second multimedia content is determined through the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain matching results, and associating the multimedia contents of which the matching values indicated by the matching results are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

and the second terminal plays the second multimedia content according to the information carried in the playing information.

According to another embodiment of the present invention, there is also provided an apparatus for associating multimedia content, including:

the first acquisition module is used for acquiring content information of a plurality of multimedia contents of a plurality of service platforms;

a second obtaining module, configured to obtain content feature values corresponding to the plurality of content information, where the content feature values are used to uniquely identify the multimedia content;

the first determining module is used for matching every two content characteristic values to obtain a matching result;

and the first association module is used for associating the multimedia content of which the matching value indicated by the matching result is greater than the first threshold value.

Further, the first determining module is configured to determine a matching value according to the content feature value and a weight corresponding to the content feature value.

Further, the first determining module is further configured to determine the matching value C according to the following formula:

Further, the apparatus further comprises:

the second correlation module is used for correlating one or more multimedia contents of which the matching values are smaller than the first threshold and larger than a second threshold;

and the second determining module is used for determining that the multimedia content association fails when the matching value is smaller than the second threshold value.

Further, the apparatus further comprises:

a first receiving module, configured to receive an inquiry request sent by a first terminal, where the inquiry request is used to inquire whether a first multimedia content currently played by the first terminal is associated with a second multimedia content;

a third determining module, configured to determine that the first terminal does not support screen switching when the first multimedia content is not associated with the second multimedia content;

a sending module, configured to send, to the second terminal, playing information required for playing the second multimedia content when the first multimedia content is associated with the second multimedia content, where the playing information includes: and the content identification and the playing time point of the second terminal.

According to another embodiment of the present invention, there is also provided a multimedia content playing apparatus applied to a second terminal, including:

a second receiving module, configured to receive play information under the trigger of a screen switching request sent by a first terminal when a first multimedia content currently played by the first terminal is associated with a second multimedia content, where the play information is used to instruct the second terminal to play the second multimedia content, and the second multimedia content is determined in the following manner: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain matching results, and associating the multimedia contents of which the matching values indicated by the matching results are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

and the playing module is used for playing the second multimedia content according to the information carried in the playing information.

a processor; a memory for storing instructions executable by the processor; the processor is configured to perform the following operations in accordance with instructions stored in the memory: acquiring content information of a plurality of multimedia contents of a plurality of service platforms; acquiring content characteristic values corresponding to the plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content; and matching every two content characteristic values to obtain a matching result, and associating the multimedia content of which the matching value indicated by the matching result is greater than a first threshold value.

Further, the processor is further configured to: and determining a matching value according to the content characteristic value and the weight corresponding to the content characteristic value.

Further, the processor is further configured to determine the match value C according to the following formula:

wherein n is the number of content characteristic values extracted from the multimedia content, a_kFor the multimedia contentDegree of matching of content characteristic values, b_kAnd the weight is corresponding to the content characteristic value.

Further, the processor is further configured to: associating one or more multimedia contents having a matching value less than the first threshold and greater than a second threshold; and when the matching value is smaller than the second threshold value, determining that the multimedia content association fails.

In an embodiment of the present invention, a computer storage medium is further provided, where the computer storage medium may store an execution instruction for executing the implementation of the method for associating multimedia content in the foregoing embodiment.

According to another embodiment of the present invention, there is also provided a terminal including the above-mentioned playing apparatus for multimedia content.

According to the invention, the multimedia contents of different platforms can be associated according to the content characteristic values of the multimedia contents. The method solves the problems of high cost, high error tendency, complex flow and the like of the technical scheme of content correlation among multiple platforms in the related technology, realizes content correlation among different platforms, is not limited by manual intervention, and provides possibility for the follow-up switching of multimedia content among the multi-screen terminals of different platforms.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

fig. 1 is a block diagram of a hardware configuration of a computer terminal of an association method of multimedia contents according to an embodiment of the present invention;

FIG. 2 is a flow chart of an association method of multimedia content according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating a method for playing multimedia content according to an embodiment of the present invention;

fig. 4 is a block diagram (one) of the structure of an apparatus for associating multimedia content according to embodiment 2 of the present invention;

fig. 5 is a block diagram (ii) of the structure of an apparatus for associating multimedia content according to embodiment 2 of the present invention;

fig. 6 is a block diagram illustrating a playing apparatus of multimedia contents according to an embodiment of the present invention;

fig. 7 is another block diagram of an apparatus for associating multimedia content according to an embodiment of the present invention;

FIG. 8 is a block diagram illustrating an apparatus for intelligently associating content under multi-screen interaction according to a preferred embodiment of the present invention;

FIG. 9 is a block diagram of a content intelligent association apparatus according to a preferred embodiment of the present invention;

FIG. 10 is a flowchart of a multi-screen interaction with automatic association to a content provided in accordance with preferred embodiment 3 of the present invention;

FIG. 11 is a flow chart of a multi-screen interaction with automatic association to multiple content provided by the preferred embodiment of the present invention;

FIG. 12 is a flow diagram of a multi-screen interaction not associated with content provided by a preferred embodiment of the present invention;

FIG. 13 is a flow chart of the automatic matching of unassociated content provided by the preferred embodiment of the present invention;

fig. 14 is a flowchart of the processing of the apparatus when content is deleted according to the preferred embodiment of the present invention;

fig. 15 is a block diagram of an apparatus for intelligently associating content under multi-screen interaction according to another preferred embodiment of the present invention.

Detailed Description

The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the example of running on a computer terminal, fig. 1 is a hardware structure block diagram of a computer terminal of an association method of multimedia content according to an embodiment of the present invention. As shown in fig. 1, the computer terminal 10 may include one or more (only one shown) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

The memory 104 may be used to store software programs and modules of application software, such as program instructions/modules corresponding to the method for associating multimedia content in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.

An embodiment of the present invention provides a method operating in the computer terminal, and fig. 2 is a flowchart of a method for associating multimedia content according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:

step S202: acquiring content information of a plurality of multimedia contents of a plurality of service platforms;

step S204: acquiring content characteristic values corresponding to the plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content;

step S206: and matching every two content characteristic values to obtain a matching result, and associating the multimedia content of which the matching value indicated by the matching result is greater than a first threshold value.

Through the steps, the multimedia contents of different platforms can be associated according to the content characteristic values of the multimedia contents. The method solves the problems of high cost, high error tendency, complex flow and the like of the technical scheme of content correlation among multiple platforms in the related technology, realizes content correlation among different platforms, is not limited by manual intervention, and provides possibility for the follow-up switching of multimedia content among the multi-screen terminals of different platforms.

The step S206 may have various implementation manners, and in the embodiment of the present invention, an implementation manner is provided: determining a matching value according to the weight corresponding to the content characteristic value and the content characteristic value, and further determining the matching value C according to the following formula:

wherein n is the number of content characteristic values extracted from the multimedia content, a_kDegree of matching of content characteristic values for multimedia content, b_kFor the weight corresponding to the content characteristic value, e.g. in the embodiment of the present invention, a_kIt may indicate the matching degree corresponding to a plurality of multimedia contents for the same content feature value (audio feature value), and the matching degree may be understood as the similarity between the audio feature value in the multimedia content of the first terminal (in actual operation, the audio feature value here may also be other information included in the content feature value) and the audio feature value in the multimedia content of the second terminal.

In a specific implementation process, the multimedia contents with the matching value larger than the first threshold are correlated, if the multimedia contents with the matching value larger than the first threshold are not found, one or more multimedia contents with the matching value smaller than the first threshold and larger than the second threshold may also be correlated, that is, the multiple correlated multimedia contents may be correlated in a unified manner and sent to the user terminal for use when needed, and certainly, when the matching value is smaller than the second threshold, it is determined that the multimedia content correlation fails.

Based on the content feature value, when the content feature value is an audio feature value, the audio feature values corresponding to the plurality of pieces of content information are acquired, which can be implemented by the following technical scheme:

decomposing audio into a plurality of audio frames, and acquiring at least one of the following characteristics of the audio frames from the plurality of audio frames: time domain features, frequency domain features; and taking the value corresponding to the characteristic as the audio characteristic value.

When the content characteristic value is a video characteristic value, acquiring video characteristic values corresponding to the plurality of content information, including: extracting key frames from a video, and extracting image features from the key frames; and taking the value corresponding to the image characteristic as the video characteristic value.

In a further technical solution of the embodiment of the present invention, there may also be the following technical solution: receiving an inquiry request sent by a first terminal, wherein the inquiry request is used for inquiring whether a first multimedia content currently played by the first terminal is associated with a second multimedia content; if the first multimedia content is not associated with the second multimedia content, the first terminal does not support screen switching; if the first multimedia content is associated with the second multimedia content, sending playing information required for playing the second multimedia content to the second terminal, wherein the playing information comprises: and the content identification and the playing time point of the second terminal.

In an embodiment of the present invention, the content information of the multimedia content includes at least one of: the system comprises a content identifier for uniquely identifying the multimedia content, a platform identifier for uniquely identifying the service platform, a storage address of the multimedia content and a content name of the multimedia content.

Based on the above-mentioned multimedia content association method, an embodiment of the present invention further provides a multimedia content playing method, as shown in fig. 3, where fig. 3 is a flowchart of the multimedia content playing method according to the embodiment of the present invention, as shown in fig. 3, including the following steps:

step S302, when a first multimedia content currently played by a first terminal is associated with a second multimedia content, a second terminal receives playing information under the trigger of a screen switching request sent by the first terminal, wherein the playing information is used for indicating the second terminal to play the second multimedia content, and the second multimedia content is determined through the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain a matching result, and associating the multimedia contents of which the matching values indicated by the matching result are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

step S304, the second terminal plays the second multimedia content according to the playing information.

Through the steps, the second terminal can receive the playing information under the trigger of the screen switching request sent by the first terminal when the first multimedia content currently played by the first terminal is associated with the second multimedia content, and the second multimedia content is determined by the content association device associating the multimedia contents of different platforms according to the content characteristic value of the multimedia content. By adopting the technical scheme, the problems of high cost, high error tendency, complex flow and the like existing in the technical scheme of content correlation among multiple platforms in the related technology are solved, the content correlation among different platforms is realized, the limitation of manual intervention is avoided, and the switching of multimedia content among the multi-screen terminals of different platforms can be further realized.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 2

In this embodiment, a device for associating multimedia content is also provided, where the device is used to implement the foregoing embodiments and preferred examples, and the description that has been already made is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.

Fig. 4 is a block diagram (one) of the structure of an apparatus for associating multimedia content according to embodiment 2 of the present invention. As shown in fig. 4, includes:

a first obtaining module 40, configured to obtain content information of multiple multimedia contents of multiple service platforms;

the second obtaining module 42 is connected to the first obtaining module 40, and is configured to obtain content feature values corresponding to a plurality of pieces of content information, where the content feature values are used to uniquely identify multimedia content;

the first determining module 44 is connected to the second obtaining module 42, and is configured to match every two content feature values to obtain a matching result;

and a first associating module 46, connected to the first determining module 44, for associating the multimedia content whose matching value indicated by the matching result is greater than the first threshold.

Through the comprehensive action of the modules, the multimedia contents of different platforms can be associated according to the content characteristic values of the multimedia contents. The method solves the problems of high cost, high error tendency, complex flow and the like of the technical scheme of content correlation among multiple platforms in the related technology, realizes content correlation among different platforms, is not limited by manual intervention, and provides possibility for the follow-up switching of multimedia content among the multi-screen terminals of different platforms.

In this embodiment of the present invention, the first determining module 44 is configured to determine the matching value according to the weight corresponding to the content feature value and the content feature value, and is further configured to determine the matching value C according to the following formula:

wherein n is the number of content characteristic values extracted from the multimedia content, a_kDegree of matching of content characteristic values for multimedia content, b_kThe weight is corresponding to the content characteristic value.

Further, in order to better adapt to the association situation of the multimedia content, in the embodiment of the present invention, as shown in fig. 5, the apparatus may further include:

a second association module 48, connected to the first determination module 44, for associating one or more multimedia contents whose matching value is smaller than the first threshold and larger than the second threshold;

and the second determining module 50 is connected with the first determining module 44 and is used for determining that the multimedia content association fails when the matching value is smaller than the second threshold value.

Further, as shown in fig. 5, the apparatus further includes:

the first receiving module 52, the first associating module 46 or the second associating module 48 are connected to receive an inquiry request sent by the first terminal, where the inquiry request is used to inquire whether the first multimedia content currently played by the first terminal is associated with the second multimedia content;

a third determining module 54, connected to the first receiving module 52, for determining that the first terminal does not support screen switching when the first multimedia content is not associated with the second multimedia content;

a sending module 56, configured to send, to the second terminal, playing information required for playing the second multimedia content when the first multimedia content is associated with the second multimedia content, where the playing information includes: and the content identification and the playing time point of the second terminal.

In an embodiment of the present invention, there is further provided a playing apparatus of multimedia content, which is applied to a second terminal, and fig. 6 is a block diagram of a structure of the playing apparatus of multimedia content according to an embodiment of the present invention, as shown in fig. 6, including:

a second receiving module 60, configured to receive play information under the trigger of a screen switching request sent by a first terminal when a first multimedia content currently played by the first terminal is associated with a second multimedia content, where the play information is used to instruct the second terminal to play the second multimedia content, and the second multimedia content is determined through the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain a matching result, and associating the multimedia contents of which the matching values indicated by the matching result are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

and the playing module 62 is configured to play the second multimedia content according to the playing information.

Through the function of the modules, the second terminal can receive the playing information under the trigger of the screen switching request sent by the first terminal when the first multimedia content currently played by the first terminal is associated with the second multimedia content, and the second multimedia content is determined by the content association device associating the multimedia contents of different platforms according to the content characteristic values of the multimedia contents. By adopting the technical scheme, the problems of high cost, high error tendency, complex flow and the like existing in the technical scheme of content correlation among multiple platforms in the related technology are solved, the content correlation among different platforms is realized, the limitation of manual intervention is avoided, and the switching of multimedia content among the multi-screen terminals of different platforms can be further realized.

In an embodiment of the present invention, a terminal is further provided, which includes the above-mentioned playing apparatus for multimedia content.

Example 3

In order to better understand the technical solution of the foregoing embodiment, in the embodiment of the present invention, an apparatus for associating multimedia content is further provided, and fig. 7 is another structural block diagram of the apparatus for associating multimedia content according to the embodiment of the present invention, as shown in fig. 7, including:

a processor 70;

a memory 72 for storing processor-executable instructions;

the processor 70 is configured to perform the following operations according to instructions stored in the memory: acquiring content information of a plurality of multimedia contents of a plurality of service platforms; acquiring content characteristic values corresponding to a plurality of content information, wherein the content characteristic values are used for uniquely identifying multimedia content; and matching the content characteristic values pairwise to obtain a matching result, and associating the multimedia content of which the matching value indicated by the matching result is greater than the first threshold value.

Further, the processor 70 is further configured to perform the following operations: and determining a matching value according to the weight corresponding to the content characteristic value and the content characteristic value.

Further, processor 70 is also configured to determine a match value C according to the following equation:

Further, the processor 70 is further configured to perform the following operations: associating one or more multimedia contents with matching values smaller than a first threshold and larger than a second threshold; and when the matching value is smaller than the second threshold value, determining that the multimedia content association fails.

The association and playing method of the multimedia content is explained with an example, but the embodiment of the present invention is not limited thereto.

The embodiment of the invention provides a technical scheme for intelligent association of multimedia contents under multi-screen interaction, which realizes intelligent association of contents among different platforms, does not need secondary processing treatment on the contents and reduces manual intervention.

The technical scheme adopted by the invention is as follows: an apparatus for intelligently associating content under multi-screen interaction, the apparatus for intelligently associating content comprising:

the access module is used for receiving request messages of different service platforms;

a feature value extraction module (equivalent to the second acquisition module 42 of the above-described embodiment) for extracting a content feature value;

the data storage module is used for storing information such as content characteristic values and the like;

a data processing module (corresponding to the first determining module 44 of the above embodiment) for generating a content correspondence relationship by matching the content feature values;

based on the device for intelligently associating content, in the embodiment of the present invention, a method for intelligently associating content based on the device is further provided, including:

step 1) when content is released, the first platform and the second platform send the released content-related information to an access module of the device, wherein the content-related information comprises information such as content identification, platform identification, storage address and the like;

step 2) the device access module receives content related information sent by the two platforms, stores the content related information in a data storage module of the device, and triggers a characteristic value extraction module of the device to extract content characteristic values from the content of the two platforms, wherein the content characteristic values comprise information such as audio characteristic values, video characteristic values, playing time lengths and content names;

the characteristic extraction is to transform the group measurement value of a certain mode to highlight that the mode has representative characteristics, symbolize the mode, and form a characteristic vector or a symbol string and a relation graph, thereby generating the mode representing the object. Extracting the video characteristic value by extracting key frames and extracting the image characteristics of the key frames; the audio characteristic value extraction adopts a mode of decomposing audio into frames and extracting time domain and frequency domain characteristics of the audio frames.

And 3) extracting corresponding characteristic values of the contents injected by the first platform and the second platform by a data processing module of the device by adopting a big data technology, and then matching the characteristic values to generate a corresponding relation of the contents. The corresponding relationship includes, but is not limited to, a one-to-one mapping relationship, that is, the corresponding relationship may be that one multimedia content corresponds to a plurality of multimedia contents, and the corresponding relationship is stored in a data storage module of the device. For example: extracting content features from a video 1 of a first platform to generate a feature value A which uniquely identifies the video, extracting content features from a video 2 of a second platform to generate a feature value B which uniquely identifies the video, matching the feature value A with the feature value B, and determining that the video 1 is associated with the video 2 when a matching result meets a certain condition.

Step 4) when the first platform terminal (equivalent to the first terminal of the above embodiment) displays the content details, sending a query content association relationship to the device access module, if the content is associated, displaying a multi-screen interaction supporting icon by the first platform terminal, and enabling a user to initiate a screen switching request; and if the content is not associated, the first platform terminal does not support screen switching.

And step 5) the first platform terminal initiates a screen switching request, and forwards the content identification of the second terminal, the playing time point and the identification information of the second platform terminal related to the content to the second platform terminal through the multi-screen interaction module.

And step 6) the second platform terminal (equivalent to the second terminal in the above embodiment) receives the screen switching request of the first platform terminal forwarded by the multi-screen interaction module, generates a new playing request according to the carried content identifier, and starts playing from the carried playing time point.

In an embodiment of the present invention, a content feature value matching model is provided:

wherein:

a_kidentifying content feature value matches (e.g., may include video feature values, audio feature values, content names);

b_kand identifying the weight value of the matching degree of the content characteristic value (for example, 0.4,0.5,0.1 can be taken).

Firstly, the playing time lengths are required to be completely consistent, and secondly, when c meets a certain condition, the two contents can be determined to be related; the multiple thresholds can be set, when c meets the first threshold, the value of c is the highest, when the matching degree falls in the interval between the second threshold and the first threshold, the multiple content can be associated, when the screen is switched, the terminal can display the multiple associated content, the user can freely select the content, and when c falls below the second threshold, the matching is regarded as failed.

According to the embodiment of the invention, on the premise of keeping platform isolation, the intelligent association of contents among platforms is realized, and the limitation of manual intervention is avoided, so that the free switching of videos among multi-screen terminals of different platforms is faster and more flexible, and the user experience is improved.

In summary, the device for intelligently associating content under multi-screen interaction according to the embodiment of the present invention, based on the above device, includes the following steps: when the content is released, an access module of the device receives content information notification messages from a first platform and a second platform; triggering a characteristic value extraction module of the device to extract content characteristic values of contents issued by two platforms, wherein the content characteristic values comprise information such as audio characteristic values, video characteristic values, playing time lengths, content names and the like, and storing the extracted content characteristic values and content related information in a data storage module; the data processing module of the device matches the content characteristic values of the two platforms based on a big data technology, when the matching degree reaches a certain condition, the two contents are determined to be related, and the corresponding relation of the two platform contents is stored in the data storage module; on the other hand, when the screen is switched, the first platform terminal sends the content information and the playing time length of the associated second platform to the second platform terminal, and the second platform terminal generates a new playing request according to the content information and starts playing according to the playing time length. Compared with the prior art, the embodiment of the invention realizes the intelligent association of the contents between the platforms on the premise of keeping the platform isolation, is not limited by manual intervention, enables the free switching of the videos between the multi-screen terminals of different platforms to be faster and more flexible, and improves the user experience.

The following describes technical solutions of the association and playing methods of the multimedia content in conjunction with a plurality of preferred embodiments.

Fig. 8 is a block diagram of a structure of an apparatus for intelligently associating content under multi-screen interaction according to a preferred embodiment of the present invention, as shown in fig. 8, based on the structure of fig. 8, the following process may be specifically included:

step S802, two content providers respectively inject contents into two service platforms;

step S804, the two service platforms send notification request messages to the access module;

step S806, the access module triggers the characteristic value extraction module to extract the content characteristic value of the contents of the two service platforms, and stores the content characteristic value to the data storage module;

step S808, the data processing module matches the content characteristic values of the two platforms to generate a content corresponding relation, and stores the content corresponding relation in the data storage module;

step S810, when the first service platform terminal displays the content details, sending a request message for inquiring the corresponding relation of the content to an access module, and displaying a multi-screen interaction identifier; a first service platform terminal carries second platform service content related information and playing time point information and initiates a screen switching request;

step S812, the second service platform terminal receives the screen switching request, generates a new playing request according to the carried related information of the second platform service content, and starts playing from the carried playing time point;

and multi-screen interaction operation among different platforms is completed according to the description, so that manual intervention is reduced, and multi-screen activities are rapid, free and flexible.

Preferred embodiment 2

Fig. 9 is a block diagram of a content intelligent association apparatus according to a preferred embodiment of the present invention, as shown in fig. 9, including:

the access module 90: on one hand, the system is used for receiving a notification request message sent by a service platform and triggering the characteristic value extraction module 92 to extract a content characteristic value; on one hand, the method is used for receiving a query content corresponding relation request message sent by a service platform and returning the related content related information;

the feature value extraction module 92: extracting a characteristic value of the content of the service platform, wherein the content characteristic value comprises information such as an audio characteristic value, a video characteristic value, playing time, a content name and the like; extracting the video characteristic value by extracting key frames and extracting the image characteristics of the key frames; the audio characteristic value extraction adopts a mode of decomposing audio into frames and extracting time domain and frequency domain characteristics of the audio frames.

Data storage module 94: storing the extracted content characteristic value, content related information and other materials; storing corresponding relation data among the platform contents;

the data processing module 96: and comparing and analyzing the material information such as the content characteristic values and the like according to the content matching model by adopting a big data technology to generate corresponding relation data among the platform contents, and storing the corresponding relation data in a data storage module.

Preferred embodiment 3

Fig. 10 is a flowchart of multi-screen interaction automatically associated with a content according to a preferred embodiment 3 of the present invention, and as shown in fig. 10, the method according to the embodiment of the present invention includes the following steps:

step S1001, a content provider A injects content into a first service platform;

step S1002, the first service platform sends a notification request message to the access module, and the notification request message carries content-related information including a content name, a content identifier, a content address, a playing time and the like;

step S1003, the access module receives a notification request message sent by the first service platform, stores content related information carried by the request to the data storage module, then triggers the characteristic value extraction module, and enters step S1004;

step S1004, the characteristic value extraction module analyzes the content file, extracts a content characteristic value, stores the content characteristic value in the data storage module, triggers the data processing module, and enters step 1005;

step S1005, the data processing module matches a content according to the comparison of the content characteristic value and the content characteristic value of the existing second service platform in the material library by adopting a big data technology, generates a one-to-one content corresponding relation and stores the content in the data storage module;

step S1006, when the first service platform terminal displays the content details, it initiates a request for inquiring the corresponding relation of the content to an access module;

step S1007, the access module receives the request message in step S1006, and returns the related information of the content of the second service platform associated with the content;

step S1008, the first service platform terminal displays a multi-screen interaction identifier on the content detail page, and a user initiates screen switching when playing content, and the multi-screen interaction identifier carries parameters such as related information of the content of the second service platform and playing time points; then proceeds to step S1009;

step S1009, the second service platform terminal receives the screen switching request, generates a new playing request according to the carried content related information of the second service platform, and starts playing from the playing time point; and the playing time point is the current playing time point of the on-demand content.

Preferred embodiment 4

Fig. 11 is a flowchart of a multi-screen interaction automatically associated with a plurality of contents according to a preferred embodiment of the present invention, and as shown in fig. 11, the method according to the embodiment of the present invention includes the following steps:

step S401, a content provider A injects content into a first service platform;

step S402, the first service platform sends a notification request message to the access module, and the notification request message carries content-related information, including a content name, a content identifier, a content address, a playing time length and the like;

step S403, the access module receives a notification request message sent by the first service platform, stores content related information carried by the request to the data storage module, then triggers the characteristic value extraction module, and enters step S404;

step S404, the characteristic value extraction module analyzes the content file, extracts a content characteristic value, stores the content characteristic value in the data storage module, triggers the data processing module and enters step 405, wherein the content characteristic value comprises a video characteristic value, an audio characteristic value and the like;

step S405, the data processing module matches a plurality of contents according to the comparison of the content characteristic value and the content characteristic value of the existing second service platform in the material library by adopting a big data technology, generates a one-to-many content corresponding relation and stores the corresponding relation in the data storage module;

step S406, when the first service platform terminal displays the content details, a request for inquiring the corresponding relation of the content is initiated to an access module;

step S407, the access module receives the request message in step S406, and returns the related information of the content of the second service platform associated with the content, at this time, a plurality of associated contents are returned;

step S408, the first service platform terminal displays a multi-screen interaction identifier on the content detail page, and the user initiates screen switching when playing the content, and carries the related information of the associated plurality of second service platform contents and parameters such as playing time points; then, the process proceeds to step S409;

step S409, the second service platform terminal receives the screen switching request, displays a plurality of associated content information on the terminal page, freely selects the program to be watched by the terminal user, generates a new playing request according to the content information selected by the terminal user, and starts playing from the playing time point; and the playing time point is the current playing time point of the on-demand content.

Preferred embodiment 5

Fig. 12 is a flowchart of multi-screen interaction not associated with content according to a preferred embodiment of the present invention, and as shown in fig. 12, the method according to the embodiment of the present invention includes the following steps:

step S501, a content provider A injects content into a first service platform;

step S502, the first service platform sends a notification request message to the access module, and the notification request message carries content-related information, including a content name, a content identifier, a content address, a playing time length and the like;

step S503, the access module receives the notification request message sent by the first service platform, stores the content related information carried by the request to the data storage module, then triggers the characteristic value extraction module, and enters step S504;

step S504, the characteristic value extraction module analyzes the content file, extracts a content characteristic value, stores the content characteristic value in the data storage module, triggers the data processing module and enters step 505, wherein the content characteristic value comprises a video characteristic value, an audio characteristic value and the like;

step S505, the data processing module adopts big data technology, and the content characteristic value is compared with the content characteristic value of the existing second service platform in the material library according to the content characteristic value, and any content is not matched;

step S506, when the first service platform terminal displays the content details, the first service platform terminal initiates a request for inquiring the corresponding relation of the content to an access module;

step S507, the access module receives the request message of step S506 and returns that the associated content does not exist;

step S508, the first service platform terminal does not display the multi-screen interaction identifier on the content detail page, and the user initiates screen switching when playing the content, and prompts that the currently played content does not support screen switching.

Preferred embodiment 6

Fig. 13 is a flowchart of automatic matching of unassociated content according to a preferred embodiment of the present invention, and as shown in fig. 13, the method according to an embodiment of the present invention includes the following steps:

step S602, the timing device sends an event number, then triggers the data processing module, and enters step 602;

step S604, the data processing module matches the unassociated content in the data storage module again according to a certain strategy;

step S606, generating a content corresponding relation for the matched content, and storing the content corresponding relation in a data storage module;

wherein the timing device triggers the condition support setting; additionally, the policy includes, but is not limited to, the following: and increasing the priority of the associated operation, and reducing the priority of the associated operation of the content which is not matched for many times, thereby prolonging the time interval.

Through the steps, the situation that content matching fails due to the content injection time difference of multiple content providers can be avoided, the processing performance is improved, and manual intervention is reduced;

preferred embodiment 7

Fig. 14 is a flowchart of a processing of the apparatus when deleting content according to a preferred embodiment of the present invention, and as shown in fig. 14, the method according to the embodiment of the present invention includes the following steps:

step S701, a content provider A deletes content from a first service platform;

step S702, the first service platform sends a notification request message to the access module, and the notification request message carries the relevant information of the deleted content, including the content name, the content identifier and the like;

step S703, the access module receives the notification request message sent by the first service platform, then triggers the data processing module, and enters step S704;

step S704, the data processing module deletes the content related characteristic value and the association relation of the content according to the content identification;

preferred embodiment 8

Fig. 15 is a block diagram of another apparatus for intelligently associating content under multi-screen interaction according to a preferred embodiment of the present invention, and as shown in fig. 15, based on the apparatus provided in fig. 15, the method for intelligently associating content includes the following processes:

step S1501, three mutually independent service platforms, wherein one is an IPTV platform, one is an IPTV platform of other manufacturers, and the other is a mobile phone platform, the three service platforms are respectively accessed to different content providers, and the three content providers respectively inject contents into the corresponding service platforms;

step S1502, after the content injection is successful, the three service platforms interact with the content intelligent association device respectively;

step S1503, the device analyzes the content injected by the three service platforms, extracts the content characteristic value, matches the content characteristic value by using big data technology, generates the corresponding relation of the content among different platforms and stores the corresponding relation;

step S1504, when the mobile phone platform terminal displays the content details, the device inquires the content information on the IPTV platform related to the content, and displays a multi-screen interactive identifier;

step S1505, a mobile phone platform terminal initiates a multi-screen interaction request, and carries IPTV platform content related information and playing time point information;

step S1506, the IPTV platform terminal receives the multi-screen interaction request, generates a new play request according to the carried IPTV platform content related information, and starts playing from the carried play time point.

Example 4

The embodiment of the invention also provides a storage medium. Optionally, in this embodiment, the storage medium may be configured to store a program code executed by the method for releasing context information provided in the first embodiment.

Optionally, in this embodiment, the storage medium may be located in any one of computer terminals in a computer terminal group in a computer network, or in any one of mobile terminals in a mobile terminal group.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps:

s1, obtaining content information of a plurality of multimedia contents of a plurality of service platforms;

s2, obtaining content characteristic values corresponding to the content information, wherein the content characteristic values are used for uniquely identifying the multimedia content;

and S3, matching the content characteristic values pairwise to obtain matching results, and associating the multimedia content with the matching value indicated by the matching results larger than the first threshold value.

s1, when a first multimedia content currently played by a first terminal is associated with a second multimedia content, and is triggered by a screen switching request sent by the first terminal, receiving play information, where the play information is used to instruct the second terminal to play the second multimedia content, and the second multimedia content is determined through the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain a matching result, and associating the multimedia contents of which the matching values indicated by the matching result are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

and S2, playing the second multimedia content according to the playing information.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for associating multimedia content, comprising:

acquiring content information of a plurality of multimedia contents of a plurality of service platforms;

acquiring content characteristic values corresponding to a plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content;

matching every two content characteristic values to obtain a matching result, and associating the multimedia content of which the matching value indicated by the matching result is greater than a first threshold value;

the method further comprises the following steps: receiving an inquiry request sent by a first terminal, wherein the inquiry request is used for inquiring whether a first multimedia content currently played by the first terminal is associated with a second multimedia content; if the first multimedia content is not associated with the second multimedia content, the first terminal does not support screen switching; if the first multimedia content is associated with the second multimedia content, sending playing information required for playing the second multimedia content to a second terminal, wherein the playing information comprises: and the content identification and the playing time point of the second terminal.

2. The method of claim 1, wherein matching the content feature values pairwise to obtain a matching result comprises:

3. The method of claim 2, wherein determining a matching value according to the weight of the content feature value corresponding to the content feature value comprises:

determining the match value C according to the following formula:

4. The method of claim 1, further comprising:

5. The method of claim 1, wherein the content feature value comprises at least one of: audio characteristic value, video playing time length and video content name.

6. The method according to claim 5, wherein obtaining the audio feature values corresponding to the plurality of content information comprises:

7. The method according to claim 6, wherein obtaining the video feature values corresponding to the content information comprises:

8. The method according to any one of claims 1 to 7, wherein the content information of the multimedia content comprises at least one of: the system comprises a content identifier for uniquely identifying the multimedia content, a platform identifier for uniquely identifying the service platform, a storage address of the multimedia content and a content name of the multimedia content.

9. A method for playing multimedia content, comprising:

and the second terminal plays the second multimedia content according to the playing information.

10. An apparatus for associating multimedia content, comprising:

the second acquisition module is used for acquiring content characteristic values corresponding to a plurality of content information, wherein the content characteristic values are used for uniquely identifying the multimedia content;

the first correlation module is used for correlating the multimedia content of which the matching value indicated by the matching result is greater than a first threshold value;

the device further comprises: a first receiving module, configured to receive an inquiry request sent by a first terminal, where the inquiry request is used to inquire whether a first multimedia content currently played by the first terminal is associated with a second multimedia content; a third determining module, configured to determine that the first terminal does not support screen switching when the first multimedia content is not associated with the second multimedia content; a sending module, configured to send, to a second terminal, playing information required to play the second multimedia content when the first multimedia content is associated with the second multimedia content, where the playing information includes: and the content identification and the playing time point of the second terminal.

11. The apparatus of claim 10, wherein the first determining module is further configured to determine the match value C according to the following formula:

12. The apparatus of claim 10, further comprising:

13. A multimedia content playing apparatus, applied to a second terminal, comprising:

a second receiving module, configured to receive play information under the trigger of a screen switching request sent by a first terminal when a first multimedia content currently played by the first terminal is associated with a second multimedia content, where the play information is used to instruct the second terminal to play the second multimedia content, and the second multimedia content is determined through the following steps: acquiring content information of a plurality of multimedia contents of a plurality of service platforms and content characteristic values corresponding to the plurality of content information through a content association device, matching the content characteristic values pairwise to obtain matching results, and associating the multimedia contents of which the matching values indicated by the matching results are greater than a first threshold value, wherein the content characteristic values are used for uniquely identifying the multimedia contents, and the content association device can receive a request for inquiring the second multimedia contents sent by a first terminal;

and the playing module is used for playing the second multimedia content according to the playing information.

14. An apparatus for associating multimedia content, comprising:

a processor;

a memory for storing instructions executable by the processor;

the processor is configured to perform the following operations in accordance with instructions stored in the memory:

the processor is further configured to receive an inquiry request sent by a first terminal, where the inquiry request is used to inquire whether a first multimedia content currently played by the first terminal is associated with a second multimedia content; if the first multimedia content is not associated with the second multimedia content, the first terminal does not support screen switching; if the first multimedia content is associated with the second multimedia content, sending playing information required for playing the second multimedia content to a second terminal, wherein the playing information comprises: and the content identification and the playing time point of the second terminal.

15. The apparatus of claim 14, wherein the processor is further configured to determine the match value C according to the following equation:

16. The apparatus of claim 14, wherein the processor is further configured to: associating one or more multimedia contents having a matching value less than the first threshold and greater than a second threshold; and when the matching value is smaller than the second threshold value, determining that the multimedia content association fails.

17. A terminal, comprising: the device of claim 13.