WO2016197471A1

WO2016197471A1 - Multimedia content sending, generating, transmitting and playing method, and corresponding device

Info

Publication number: WO2016197471A1
Application number: PCT/CN2015/089518
Authority: WO
Inventors: 田彪; 李素慧; 雷蕾; 刘璐; 李广
Original assignee: 北京音之邦文化科技有限公司
Priority date: 2015-06-08
Filing date: 2015-09-14
Publication date: 2016-12-15
Also published as: CN104954369A

Abstract

A multimedia content sending, generating, transmitting and playing method, and a corresponding device. The multimedia content sending method comprises: receiving first multimedia content uploaded by a first client; combining the first multimedia content and pre-determined multimedia content to generate second multimedia content; determining a playing range of the second multimedia content; and sending the second multimedia content to a second client within the playing range for playing. The second client within the playing range is enabled to receive the multimedia content uploaded by the first client.

Description

Transmission, generation and transmission of multimedia content, playback method and corresponding device

Cross-reference to related applications

The application requires the priority of the Chinese patent application entitled "Multimedia content transmission, generation and transmission, playback method and corresponding device" as of June 8, 2015, application number 201510309512.0, the entire content of which is the whole Incorporated into this application.

Technical field

The present disclosure generally relates to network technologies, and in particular, to receiving, producing, and delivering multimedia content, and more particularly to a method for transmitting, generating, and transmitting multimedia content, and a corresponding device.

Background technique

In the prior art, multimedia content created by users themselves can usually only be played locally.

For example, merchant A creates a piece of advertising audio that can only be played by copying or sending the advertising audio to a client that they want to play the advertising audio.

When the playback range is large and there are many clients that need to be played, the workload of sending and/or copying the advertisement audio will be very large.

Summary of the invention

In view of the above-mentioned defects or deficiencies in the prior art, it is desirable to provide a method for transmitting, generating, and transmitting multimedia content, a corresponding device, and a corresponding device, so that a client within a predetermined playback range can be uploaded to another client to receive The multimedia content of the server.

In a first aspect, the application provides a method for sending multimedia content, including: receiving a first multimedia content uploaded by a first client; and combining the first multimedia content with predetermined multimedia content to generate a second multimedia Body content; determining a play range of the second multimedia content; and transmitting the second multimedia content to a second client within the play range for playback.

In a second aspect, the present application provides a method for generating and transmitting multimedia content, the package Comprising: acquiring first multimedia content; receiving predetermined multimedia content sent by the multimedia server that matches the first multimedia content; combining the first multimedia content with the predetermined multimedia content to generate the second multimedia content; Uploading the second multimedia content and the play range information corresponding to the second multimedia content to the multimedia server.

In a third aspect, the present application provides a method for playing multimedia content on a client, including: receiving a second multimedia content from a multimedia server; and playing a second multimedia content; wherein the second multimedia content is The first multimedia content is combined with the predetermined multimedia content, and the second multimedia content is limited to be played within a play range that matches the client.

In a fourth aspect, the present disclosure provides a device for transmitting multimedia content, including: a receiving module, configured to receive first multimedia content uploaded by a first client; and a generating module configured to use the first multimedia The content is merged with the predetermined multimedia content to generate a second multimedia content; the determining module is configured to determine a playing range of the second multimedia content; and a sending module configured to send the second multimedia content to the playing range The second client inside is for playback.

In a fifth aspect, the application provides an apparatus for generating and transmitting multimedia content, including: an obtaining module configured to acquire a first multimedia content, and a receiving module configured to receive a first multimedia that is sent by the multimedia server a predetermined multimedia content that matches the volume content; a merging module configured to merge the first multimedia content with the predetermined multimedia content to generate the second multimedia content; and an uploading module configured to upload the second multimedia to the multimedia server Body content and playback range information corresponding to the second multimedia content.

In a sixth aspect, the application provides an apparatus for playing multimedia content on a client, comprising: a receiving module configured to receive second multimedia content from a multimedia server; and a playing module configured to play the second multimedia Body content; wherein the second multimedia content is generated by combining the first multimedia content with the predetermined multimedia content, and the second multimedia content is limited to be played within a play range that matches the client.

The method for transmitting, generating, transmitting, and playing multimedia content provided by the present application can deliver user-made multimedia content within a certain playing range. In some application scenarios, automatic and accurate advertising can be achieved.

In addition, in some implementations, during the production or generation of the multimedia content, the background sound matching the multimedia content may be recommended, and the user-generated multimedia content may be The combination of background sounds to produce high quality multimedia content.

DRAWINGS

Other features, objects, and advantages of the present application will become more apparent from the detailed description of the accompanying drawings.

FIG. 1 illustrates an exemplary system architecture to which embodiments of the present application may be applied;

FIG. 2 shows an example of a multimedia content interaction process of an embodiment of the present application;

FIG. 3 is a schematic flowchart of a method for transmitting a multimedia content according to an embodiment of the present application;

FIG. 4 is a schematic flowchart of a method for generating and transmitting multimedia content according to an embodiment of the present application;

FIG. 5 is a schematic flowchart of a method for playing multimedia content on a client according to an embodiment of the present application; FIG.

FIG. 6 is a schematic structural diagram of a multimedia content transmitting apparatus according to an embodiment of the present application;

FIG. 7 shows a schematic structural diagram of an apparatus for generating and transmitting multimedia content according to an embodiment of the present application;

FIG. 8 shows a schematic structural diagram of an apparatus for playing multimedia content on a client according to an embodiment of the present application.

detailed description

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention, rather than the invention. It is also to be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings.

In the following description, numerous specific details are set forth However, those skilled in the art should understand that the embodiment of the present application is not In the case of these specific details, it can also be implemented.

Referring to Figure 1, an exemplary system architecture 100 in which embodiments of the present application may be applied.

As shown in FIG. 1, system architecture 100 can include a multimedia server 104, a first client 110, and a second client 120.

The first client 110 may include various terminal devices such as a desktop computer terminal 111, a portable computer terminal 112, and a tablet computer 113.

Similarly, the second client 120 may also include various terminal devices such as a desktop computer terminal 121, a portable computer terminal 122, and a tablet computer 123.

The multimedia server 104 can communicate with each of the terminal devices 111-113 of the first client 110 and the terminal devices 121-123 of the second client 120 to implement data interaction.

Referring to FIG. 2, an example of a multimedia content interaction process 200 is an embodiment of the present application.

One or more specific technical details are depicted and described in the following description for purposes of example and ease of understanding, but embodiments of the present application may also be practiced without these features. . In the embodiment shown in FIG. 2, the interaction between a first client, a second client, and a multimedia server is taken as an example.

As shown in FIG. 2, in step 201, the first client sends the first multimedia content to the multimedia server. The first multimedia content can include audio content, and the first client can obtain the audio content through any feasible channel.

For example, in some implementations, the first client can receive and record audio content input by the user. Alternatively, the first client may also receive audio content directly or indirectly from other terminal devices with which data exchange is possible. For example, the user can record the audio content through the recorder and send the audio content stored in the recorder to the first client. Alternatively, the user can input text information to the first client, and then convert the text information into audio content by Text to Speech (TTS) software.

Next, in step 202, the multimedia server merges the first multimedia content and the predetermined multimedia content to generate the second multimedia content.

In some implementations, the first multimedia content and the predetermined multimedia content can be combined, for example, by mixing.

Audio Mixing is a step in music production that combines sound from multiple sources into a single stereo (Stereo) or mono track (Mono). These raw sound signals may come from different sources, for example, from different instruments or vocals. In the process of mixing, the parameters of each original signal are adjusted by adjusting the frequency, dynamics, sound quality, positioning, reverberation and/or sound field, and then the tracks are optimized and then superimposed on the final product.

In some application scenarios, the first multimedia content and the background sound may be mixed, so that the first multimedia content may be organically integrated with the background sound, and the multimedia content after the mixing processing is played. Can give listeners a better listening experience.

Alternatively, in other implementations, the first multimedia content and the predetermined multimedia content may be combined by the first client to generate the second multimedia content.

Next, in step 203, the multimedia server determines a play range of the second multimedia content.

The second multimedia content includes the first multimedia content uploaded by the first client. For example, in some application scenarios, the second multimedia content may include the personalized content created by the first client. Content. In these application scenarios, the first client may desire that the audience receiving the second multimedia content has certain characteristics, for example, the geographic location in which it is located is within a certain range.

Based on the foregoing application scenario, in some implementations, the playing range of the second multimedia content may be determined by the multimedia server. Alternatively, in other implementations, as shown in step 204, the first client may send the play range information to the multimedia server, where the play range information may include the first client that desires to receive the second multimedia content. Two common features of the client.

Next, in step 205, the multimedia server sends the second multimedia content to the second client. Here, the second client is located within the playback range.

After the multimedia server determines the play range, the second multimedia content can be sent to the second client that is in the play range. After receiving the second multimedia content, the second client may play the multimedia content to be played by means of media playing software or the like. In some application scenarios, for example, the second multimedia content may be "inserted" into the multimedia data stream being played on the second client to play the second multimedia content.

The above describes the process of multimedia content interaction. Next, the multimedia server and each client will be described in detail.

As shown in FIG. 3, it is a schematic flowchart 300 of a method for transmitting multimedia content according to an embodiment of the present application. In some implementations, the multimedia content sending method of this embodiment may be implemented on a multimedia server.

In step 310, the first multimedia content uploaded by the first client is received.

Next, in step 320, the first multimedia content is merged with the predetermined multimedia content to generate a second multimedia content. Here, the predetermined multimedia content may be multimedia content that is associated with the first multimedia content. For example, the predetermined multimedia content may be a background sound and/or a sound effect or the like.

Next, in step 330, a play range of the second multimedia content is determined.

As mentioned before, the playback range can be determined by the multimedia server or by the first client.

In some implementations in which the playback range is determined by the multimedia server, for example, the multimedia server may acquire location information and/or industry category information of the first client, and determine playback based on location information and/or industry category information of the first client. The range is, for example, a circular range having a radius of a predetermined distance centered on the first client as a playback range. Alternatively, the cell in which the first client is located may also be used as the play range.

For example, in some implementations, the multimedia server can obtain Internet Protocol (IP) address information or Media Access Control (MAC) address information of the first client. Alternatively, the multimedia server may further obtain industry category information of the first client based on the a priori database. For example, the a priori database may store a correspondence between location information (for example, an IP address or a MAC address) of the first client and its industry category information. The multimedia server may find and obtain the industry category information corresponding to the location information of the first client in the a priori database based on the acquired location information.

After obtaining the location information and/or the industry category information of the first client, the multimedia server may determine the play range based on the information, for example, the distance from the first client may be selected within a predetermined range as the play range.

In some implementations in which the first client enters a predetermined play range, for example, the first client may send to the multimedia server a desired multimedia to be played within the first multimedia including its upload. The constraints of the multimedia content to be played. The multimedia server is caused to send the second multimedia content only to the object that satisfies the constraint.

Next, in step 340, the second multimedia content is sent to the second client within the playback range for playback.

In some application scenarios, a client (such as a second client) requests a multimedia server to play multimedia content. If the client is in the play range, the second multimedia content may also be sent to the client when the multimedia content requested to be played is sent.

Alternatively, in other application scenarios, even if the second client does not request the multimedia server to play the multimedia content, the multimedia server may directly send the second multimedia content to the second client.

In some implementations, combining the first multimedia content with the predetermined multimedia content of step 320, the generating the second multimedia content can be implemented in the following manner.

Specifically, in step 321, a predetermined multimedia content that matches the first multimedia content is selected. And in step 322, the first multimedia content is merged with the predetermined multimedia content to generate a second multimedia content.

Here, the meaning of the word "match" may include that the predetermined multimedia content (eg, background sound, sound effect, etc.) and the first multimedia content may be harmoniously merged with each other. After the combination of the two, the first multimedia content can be better highlighted and the user's hearing and/or visual impression can be deepened.

By adding a predetermined multimedia content matching the first multimedia content, the generated second multimedia content can be made richer, more expressive, and made to be viewed or listened to than the content of the first multimedia content. The user of the second multimedia content gets a better experience.

In some implementations, the audio features of the first multimedia content can be extracted and the predetermined multimedia content having the same or similar audio characteristics as the first multimedia content can be selected. For example, a background sound, a sound effect, or the like having the same or similar audio characteristics as the first multimedia content may be selected as the predetermined multimedia content.

Here, the audio features may include, for example, at least one of pitch, overtone, rhythm, zero-crossing rate, Mel-Frequency Cepstral Coefficients (MFCC), energy information, spectral distribution, and pitch.

The general sound is a series of vibrations of different frequencies and amplitudes emitted by the sounding body. Dynamic compounding. Among these vibrations is a vibration with the lowest frequency, the sound emitted by it is the fundamental tone, and the rest is overtone. The zero-crossing rate can refer to the short-term zero-crossing rate of the audio signal, that is, the number of times the audio signal of one frame passes through the zero level. The Mel frequency is based on the auditory characteristics of the human ear and has a nonlinear relationship with the Hertz (Hz) frequency. The MFCC uses this nonlinear correspondence to calculate the Hz spectral features. The energy information can refer to the signal strength of the audio signal. The spectral distribution can refer to the distribution of the frequency of the audio signal. The rhythm can be a factor related to the forward progress of the audio signal, such as accent, beat and speed. The tone is the tone of the audio signal, which is the position of the pitch. In some implementations, the tempo and pitch can be calculated from the zero crossing rate, the Mel frequency cepstral coefficient, the energy information, and the spectral distribution.

In the following, how to extract the audio features of the first multimedia content will be schematically illustrated by taking a pitch as an example.

The pitch can be quantitatively described by the pitch period. The gene cycle can be obtained by obtaining a short-time autocorrelation function or a method of obtaining a short-term average magnitude difference function (AMDF).

When the pitch period is determined by the method of obtaining the short-time autocorrelation function, the waveform of the period (square window) may be first intercepted on the acoustic waveform of the audio. In general, the longest pitch period in speech is about 20 ms, so the window length of the square window can be greater than 40 ms.

Next, the pitch period is determined. In some implementations, in order to remove the interference of the channel formant on the acoustic waveform, the acoustic waveform may be first filtered, and then the autocorrelation function of the filtered signal may be obtained. For example, the sound wave may be filtered by a band pass filter having a bandwidth of 60 to 900 Hz, and then the filtered signal may be used for autocorrelation. Alternatively, the audio signal may be first passed through a linear predictive coding (LPC) inverse filter, and the pitch period is estimated by finding an autocorrelation function of the residual signal.

When the method of obtaining the AMDF is used to determine the pitch period, the position of the deepest valley point on the acoustic waveform can be first searched, and the formant and center clipping are removed before the AMDF is performed to improve the calculation effect. The pitch period is determined by the method of obtaining the AMDF, which has the advantage of a small amount of calculation.

In some alternatives, the predetermined multimedia content may also be selected based on industry category information and/or location information of the first client and/or the second client.

Specifically, first, the industry category information and/or location information of the first client and/or the second client is obtained. For example, the multimedia server may obtain location information of the second client, such as Internet Protocol (IP) address information or Media Access Control (MAC) address, when receiving the request information of the second client sent to play the multimedia content. information. Alternatively, the multimedia server may further obtain industry category information of the second client based on the a priori database. For example, the correspondence between the location information (eg, an IP address or a MAC address) of the second client and its industry category information may be stored in the a priori database. The multimedia server may find and obtain the industry category information corresponding to the location information of the second client in the a priori database based on the acquired location information.

Then, based on the industry category information and/or the location information of the first client and/or the second client, the guest group characteristics corresponding to the second client are acquired, and the predetermined multimedia content is selected according to the characteristics of the guest group.

In some implementations, the industry category and/or location of the first client has some association with the industry category and/or location of the second client, for example, the location of the first client is similar to that of the second client, or, first The client is similar to the industry category of the second client (eg, the first client can be a hairdresser and the second client can be a restaurant). Therefore, in these application scenarios, the first client and the second client may have similar guest group characteristics, so that the industry class information and/or location information of the first client may be used to approximate the second client. The characteristics of the passenger flow group.

In other implementations, for example, the multimedia server may store a correspondence including industry category information and/or location information and a passenger flow group feature, and a passenger flow group characteristic and a favorite music type (eg, a singer, a song category, or Correspondence of song name, etc.). In this way, under the premise that the industry category information and/or location information of the second client is known, the multimedia server can correspondingly find the music type corresponding to the industry category information and/or the location information.

In some alternatives, the transmitting the second multimedia content to the second client in the play range in step 340 may include the step 341 of selecting the second multimedia content that matches the audio feature of the target multimedia content. And in step 342, the selected second multimedia content is sent to the second client. Here, the target multimedia content may be multimedia content that satisfies predetermined conditions according to user feedback.

In some application scenarios, there may be multiple second multimedia content on the multimedia server. When transmitting to the second client, the multimedia server may filter the second multimedia content according to some predetermined conditions, and send the second multimedia content that meets the predetermined condition to the second client.

For example, in some implementations, the second multimedia content that matches the audio characteristics of the target multimedia content can be selected and sent to the second client.

In these implementations, the target multimedia content may be multimedia content that satisfies predetermined conditions based on user feedback. For example, user feedback may include a turn-off rate and/or a click rate when the user plays the target multimedia content. The predetermined condition may include, for example, a shutdown rate that is lower than a first threshold and/or a click rate that is higher than a second threshold. Selecting such second multimedia content to send to the second client may enable the user who views and/or listens to the second multimedia content to have higher acceptance of the second multimedia content.

As an alternative, the method in this embodiment may further include: step 350: acquiring playback information of the second multimedia content played by the second client, and step 360, calculating a fee based on the playback information. The play information may include, for example, at least one of a play count of the second multimedia content, a play duration, and a play period.

In some application scenarios, the first client may be a merchant (such as a hairdresser), and the merchant desires to broadcast the advertisement content (ie, the first multimedia content) that he or she has made within a certain range.

In the application scenario, the multimedia server may add a background sound to the first multimedia content to form an advertisement content (ie, a second multimedia content) having a background sound effect. The multimedia server may send the second multimedia content to a second client that is compliant with receiving conditions for receiving the second multimedia content (eg, within a playback range).

In some application scenarios, the second client may also be a merchant (such as a restaurant). In these application scenarios, the restaurant can receive the multimedia content (ie, the second multimedia content) that is sent by the multimedia server and includes the hairdresser to upload the advertisement content, so that the consumer within the range of the restaurant can listen to the content. Advertising content. In addition, the hairdressing store may pay a certain advertising fee to the restaurant according to the playing information (at least one of the playing times, the playing time and the playing time) of the advertising content played by the restaurant.

Referring to FIG. 4, a method for generating and transmitting multimedia content according to an embodiment of the present application Schematic flow diagram 400. In some implementations, the method of generating and transmitting multimedia content of the present embodiment can be implemented at a first client.

In step 410, the first multimedia content is obtained.

In step 420, the predetermined multimedia content transmitted by the multimedia server that matches the first multimedia content is received. For example, in some implementations, the first client can upload the first multimedia content to the multimedia server, and the multimedia server creates and/or selects the predetermined multimedia content that matches it, and then receives the predetermined multimedia content.

In step 430, the first multimedia content is merged with the predetermined multimedia content to generate a second multimedia content.

In step 440, the second multimedia content and the play range information corresponding to the second multimedia content are uploaded to the multimedia server.

As an alternative, the method of this embodiment may further include, after step 420, step 450, extracting audio features of the first multimedia content; and step 460, transmitting audio features to the multimedia server.

In these alternatives, the predetermined multimedia content and the first multimedia content may have the same or similar audio characteristics. Here, the audio features may include at least one of a pitch, an overtone, a rhythm, a zero-crossing rate, a Mel frequency cepstral coefficient, energy information, a spectral distribution, and a tone.

FIG. 5 is a schematic flowchart 500 of a method for playing multimedia content on a client according to an embodiment of the present application. In some implementations, the method for playing multimedia content on a client in this embodiment may be implemented in a second client.

In step 510, a second multimedia content is received from a multimedia server.

In step 520, the second multimedia content is played.

Here, the second multimedia content may be generated by combining the first multimedia content with the predetermined multimedia content, and the second multimedia content is limited to be played within a play range that matches the client. That is to say, only the client in the playing range can receive the second multimedia content.

In some implementations, the predetermined multimedia content can have the same or similar audio characteristics as the first multimedia content. Here, the audio features may include, for example, pitch, overtone, rhythm, zero-crossing rate, Mel frequency cepstral coefficient, energy information, spectral distribution, and pitch. At least one. For example, in some application scenarios, the first multimedia content may be advertisement audio uploaded by a certain client, and the predetermined multimedia content may be a background sound having the same or similar audio characteristics as the advertisement audio.

In some alternatives, playing the second multimedia content in step 520 may include: step 521, inserting and playing the second multimedia content in the currently playing multimedia content. Here, the audio format of the second multimedia content is the same as the audio format of the currently played multimedia content.

For example, in some application scenarios, multimedia content (ie, currently playing multimedia content) is being played on the second client. During playback, the second client receives the second multimedia content sent from the multimedia server. Since the second multimedia content has the same format as the currently played multimedia content, the second client may stop playing the currently played multimedia content, and then play the second multimedia content, when the second multimedia content is played. Then, play the currently playing multimedia content. Alternatively, the second client may preset a time point, a time period, a play count of the second multimedia content, and/or a play interval in which the second multimedia content is inserted.

Or, in other application scenarios, the multimedia content (ie, the currently playing multimedia content) is being played on the second client. During playback, the second client receives the second multimedia content sent from the multimedia server. At this time, the second client can play the second multimedia content while playing the currently playing multimedia content.

In some embodiments, the method for playing multimedia content on the client in this embodiment may further include: step 530: acquiring playback information of the second multimedia content, and, in step 540, transmitting the playback information to the multimedia server. Here, the play information may include at least one of a play count, a play duration, and a play period.

FIG. 6 shows a schematic structural diagram of a multimedia content transmitting apparatus 600 according to an embodiment of the present application.

As shown in FIG. 6, the multimedia content transmitting apparatus 600 may include a receiving module 610, a generating module 620, a determining module 630, and a sending module 640.

The receiving module 610 is configured to receive the first multimedia content uploaded by the first client.

The generating module 620 can be configured to merge the first multimedia content with the predetermined multimedia content to generate the second multimedia content. Here, the predetermined multimedia content may include, for example, a back Jingyin.

The determining module 630 is configurable to determine a play range of the second multimedia content.

The sending module 640 is configurable to send the second multimedia content to a second client within the playing range for playback.

In some alternatives, the generation module 620 can include a selection unit 621 and a merging unit 622.

The selection unit 621 can be configured to select a predetermined multimedia content that matches the first multimedia content.

The merging unit 622 can be configured to merge the first multimedia content with the predetermined multimedia content to generate the second multimedia content.

In some alternatives, the selection unit 621 can be further configured to select predetermined multimedia content based on audio features of the first multimedia content and/or based on industry category information of the first client and/or the second client and/or The location information selects the predetermined multimedia content.

In some alternatives, the selection unit 621 can be further configured to extract audio features of the first multimedia content and select predetermined multimedia content having the same or similar audio characteristics as the first multimedia content. Here, the audio features may include at least one of a pitch, an overtone, a rhythm, a zero-crossing rate, a Mel frequency cepstral coefficient, energy information, a spectral distribution, and a tone.

In some alternatives, the selecting unit 621 may further configure the industry category information and/or location information for acquiring the first client and/or the second client, based on the first client and/or the second client industry. The category information and/or the location information acquires a feature of the guest group corresponding to the second client, and selects the predetermined multimedia content according to the characteristics of the guest group.

In some alternatives, the determining module 630 is configurable to determine a play range of the second multimedia content based on any one of: industry category information and/or location information of the first client; and the first client The playback range entered.

In some alternatives, the sending module 640 can be further configured to select a second multimedia content that matches an audio feature of the target multimedia content, and send the selected second multimedia content to the second client. Here, the target multimedia content may be multimedia content that satisfies predetermined conditions according to user feedback. For example, user feedback may include a turn-off rate and/or a click rate when the user plays the target multimedia content. In these application scenarios, the predetermined bar The piece may include the closing rate being lower than the first threshold and/or the click rate being higher than the second threshold.

In some alternatives, the multimedia content sending apparatus 600 of the embodiment may further include an obtaining module 650. The obtaining module 650 is configured to acquire playing information of the second multimedia content played by the second client and calculate a fee based on the playing information. Here, the play information may include at least one of a play count, a play duration, and a play period.

FIG. 7 shows a schematic block diagram of an apparatus 700 for generating and transmitting multimedia content in accordance with an embodiment of the present application.

As shown in FIG. 7, the apparatus 700 for generating and transmitting multimedia content in this embodiment may include an obtaining module 710, a receiving module 720, a merging module 730, and an uploading module 740.

The obtaining module 710 is configured to acquire the first multimedia content.

The receiving module 720 can be configured to receive the predetermined multimedia content that is sent by the multimedia server and matches the first multimedia content.

The merge module 730 can be configured to merge the first multimedia content with the predetermined multimedia content to generate the second multimedia content.

The uploading module 740 can be configured to upload the second multimedia content and the playing range information corresponding to the second multimedia content to the multimedia server.

As an alternative, the apparatus for generating and transmitting multimedia content in this embodiment may further include an extraction module 750 and a sending module 760.

The extraction module 750 can be configured to extract audio features of the first multimedia content. The sending module 760 can be configured to send audio features to the multimedia server. Here, the predetermined multimedia content and the first multimedia content may have the same or similar audio characteristics. The audio features may include at least one of a pitch, an overtone, a rhythm, a zero crossing rate, a Mel frequency cepstral coefficient, energy information, a spectral distribution, and a tone.

FIG. 8 shows a schematic structural diagram of an apparatus 800 for playing multimedia content at a client according to an embodiment of the present application.

As shown in FIG. 8, the apparatus 800 for playing multimedia content on a client in this embodiment may include a receiving module 810 and a playing module 820.

The receiving module 810 is configurable to receive the second multimedia content from the multimedia server. The play module 820 can be configured to play the second multimedia content. The second multimedia content may be generated by combining the first multimedia content with the predetermined multimedia content, and within the second multimedia The content can be limited to play within the playback range that matches the client.

In some alternatives, the play module 820 can be further configured to insert and play the second multimedia content in the currently playing multimedia content. In these alternatives, the audio format of the second multimedia content is the same as the audio format of the currently playing multimedia content.

In some alternatives, the apparatus 800 for generating and transmitting multimedia content of the present embodiment may further include an obtaining module 830 and a sending module 840.

The obtaining module 830 can be configured to acquire playing information of the second multimedia content. The sending module 840 can be configured to send the playing information to the multimedia server. Here, the play information may include at least one of a play count, a play duration, and a play period.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products in accordance with various embodiments of the invention. In this regard, each block of the flowchart or block diagrams can represent a module, a program segment, or a portion of code that includes one or more logic for implementing the specified. Functional executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two successively represented blocks may in fact be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or operation. Or it can be implemented by a combination of dedicated hardware and computer instructions.

The units or modules described in the embodiments of the present application may be implemented by software or by hardware. The described unit or module may also be disposed in a processor, for example, as a processor including a receiving module, a generating module, a determining module, and a transmitting module. The name of these units or modules does not constitute a limitation on the unit or the module itself in some cases. For example, the receiving module may also be described as “for receiving the first multimedia content uploaded by the first client. Module".

In another aspect, the present application further provides a computer readable storage medium, which may be a computer readable storage medium included in an electronic device in the above embodiment; or may exist separately, not assembled A computer readable storage medium incorporated into an electronic device. The computer readable storage medium stores one or more programs, The program is used by one or more processors to perform the object monitoring method described in this application.

The above description is only a preferred embodiment of the present application and a description of the principles of the applied technology. It should be understood by those skilled in the art that the scope of the invention referred to in the present application is not limited to the specific combination of the above technical features, and should also be covered by the above technical features without departing from the inventive concept. Other technical solutions formed by any combination of their equivalent features. For example, the above features are combined with the technical features disclosed in the present application, but are not limited to the technical features having similar functions.

Claims

A method for transmitting multimedia content, characterized in that the method comprises:

Receiving the first multimedia content uploaded by the first client;

Merging the first multimedia content with predetermined multimedia content to generate second multimedia content;

Determining a play range of the second multimedia content;

The second multimedia content is sent to a second client within the play range for playback.
The method according to claim 1, wherein the combining the first multimedia content with the predetermined multimedia content to generate the second multimedia content comprises:

Selecting predetermined multimedia content that matches the first multimedia content;

Merging the first multimedia content with the predetermined multimedia content to generate the second multimedia content;

Wherein the predetermined multimedia content includes a background sound.
The method of claim 2, wherein the selecting the predetermined multimedia content that matches the first multimedia content comprises at least one of the following:

Selecting predetermined multimedia content based on audio features of the first multimedia content;

The predetermined multimedia content is selected based on the industry category information and/or location information of the first client and/or the second client.
The method of claim 3, wherein the selecting the predetermined multimedia content based on the audio feature comprises:

Extracting audio features of the first multimedia content;

Selecting predetermined multimedia content having the same or similar audio characteristics as the first multimedia content;

Wherein, the audio features include at least one of: pitch, overtone, rhythm, zero-crossing rate, Mel frequency cepstral coefficient, energy information, spectral distribution, and pitch.
The method according to claim 3 or 4, wherein the selecting the predetermined multimedia content based on the industry category information and/or the location information of the first client and/or the second client comprises:

Obtaining industry category information and/or location information of the first client and/or the second client;

Obtaining a passenger flow group feature corresponding to the second client based on industry category information and/or location information of the first client and/or the second client;

The predetermined multimedia content is selected according to the characteristics of the passenger flow group.
The method according to any one of claims 1 to 5, wherein the playing range of the second multimedia content is determined based on any one of the following:

Industry category information and/or location information of the first client;

The playing range input by the first client.
The method according to any one of claims 3-5, wherein the transmitting the second multimedia content to the second client in the playing range comprises:

Selecting a second multimedia content that matches an audio feature of the target multimedia content;

Sending the selected second multimedia content to the second client;

The target multimedia content is multimedia content that satisfies predetermined conditions according to user feedback.
The method of claim 7 wherein:

The user feedback includes a closing rate and/or a click rate when the user plays the target multimedia content;

The predetermined condition includes that the shutdown rate is lower than the first threshold and/or the click rate is higher than the second threshold.
The method of any of claims 1-8, wherein the method further comprises:

Obtaining, by the second client, playing information of the second multimedia content;

Calculating a fee based on the playback information;

The play information includes at least one of the following:

Play times, play duration, and play time.
A method for generating and transmitting multimedia content, comprising:

Obtaining the first multimedia content;

Receiving, by the multimedia server, predetermined multimedia content that matches the first multimedia content;

Merging the first multimedia content with the predetermined multimedia content to generate second multimedia content;

Uploading the second multimedia content and the play range information corresponding to the second multimedia content to the multimedia server.
The method according to claim 10, wherein before the receiving the predetermined multimedia content that is sent by the multimedia server and matching the first multimedia content, the method further comprises:

Extracting audio features of the first multimedia content;

Transmitting the audio feature to the multimedia server;

Wherein the predetermined multimedia content has the same or similar audio characteristics as the first multimedia content;

Wherein the audio feature comprises at least one of the following:

Pitch, overtone, rhythm, zero-crossing rate, Mel frequency cepstral coefficient, energy information, spectral distribution and pitch.
A method for playing multimedia content on a client, comprising:

Receiving second multimedia content from a multimedia server;

Playing the second multimedia content;

The second multimedia content is generated by combining the first multimedia content with the predetermined multimedia content, and the second multimedia content is limited to play matching the client. Play within range.
The method of claim 12, wherein the playing the second multimedia content comprises:

Inserting and playing the second multimedia content in the currently playing multimedia content;

The audio format of the second multimedia content is the same as the audio format of the currently played multimedia content.
The method according to claim 12 or 13, wherein the method further comprises:

Obtaining the playing information of the second multimedia content;

Sending the play information to the multimedia server;

The play information includes at least one of the following:

Play times, play duration, and play time.
A device for transmitting multimedia content, characterized in that the device comprises:

a receiving module, configured to receive the first multimedia content uploaded by the first client;

Generating a module, configured to merge the first multimedia content with predetermined multimedia content to generate second multimedia content;

a determining module configured to determine a play range of the second multimedia content;

And a sending module, configured to send the second multimedia content to a second client in the playing range for playing.
The apparatus according to claim 15, wherein the generating module comprises:

a selection unit configured to select predetermined multimedia content that matches the first multimedia content;

a merging unit configured to merge the first multimedia content with the predetermined multimedia content to generate the second multimedia content;

Wherein the predetermined multimedia content includes a background sound.
The device according to claim 15 or 16, wherein the sending module is further configured to:

Selecting a second multimedia content that matches an audio feature of the target multimedia content;

Sending the selected second multimedia content to the second client;

The target multimedia content is multimedia content that satisfies predetermined conditions according to user feedback.
The device of claim 17 wherein:

The user feedback includes a closing rate and/or a click rate when the user plays the target multimedia content;

The predetermined condition includes that the shutdown rate is lower than the first threshold and/or the click rate is higher than the second threshold.
The device according to any one of claims 15-18, wherein the device further comprises:

An obtaining module, configured to acquire playing information of the second multimedia content played by the second client, and calculate a fee based on the playing information;

The play information includes at least one of the following:

Play times, play duration, and play time.
An apparatus for generating and transmitting multimedia content, comprising:

Obtaining a module, configured to acquire the first multimedia content;

a receiving module, configured to receive, by the multimedia server, predetermined multimedia content that matches the first multimedia content;

a merging module configured to merge the first multimedia content with the predetermined multimedia content to generate second multimedia content;

And a uploading module, configured to upload the second multimedia content and the play range information corresponding to the second multimedia content to the multimedia server.
The device of claim 20, wherein the device further comprises:

An extraction module configured to extract audio features of the first multimedia content;

a sending module, configured to send the audio feature to the multimedia server;

Wherein the predetermined multimedia content has the same or similar audio characteristics as the first multimedia content;

The audio feature includes at least one of the following:

Pitch, overtone, rhythm, zero-crossing rate, Mel frequency cepstral coefficient, energy information, spectral distribution and pitch.
An apparatus for playing multimedia content on a client, comprising:

a receiving module configured to receive the second multimedia content from the multimedia server;

a playing module, configured to play the second multimedia content;

The second multimedia content is generated by combining the first multimedia content with the predetermined multimedia content, and the second multimedia content is limited to be played in a playing range that matches the client.
The device according to claim 22, further comprising:

An obtaining module, configured to acquire playing information of the second multimedia content;

a sending module, configured to send the play information to the multimedia server;

The play information includes at least one of the following:

Play times, play duration, and play time.
A computer readable storage medium storing one or more programs for execution by one or more processors:

Receiving the first multimedia content uploaded by the first client;

Merging the first multimedia content with predetermined multimedia content to generate second multimedia content;

Determining a play range of the second multimedia content;

The second multimedia content is sent to a second client within the play range for playback.
A computer readable storage medium storing one or more programs for execution by one or more processors:

Obtaining the first multimedia content;

Receiving, by the multimedia server, predetermined multimedia content that matches the first multimedia content;

Merging the first multimedia content with the predetermined multimedia content to generate second multimedia content;

Uploading the second multimedia content and the play range information corresponding to the second multimedia content to the multimedia server.
A computer readable storage medium storing one or more programs for execution by one or more processors:

Receiving second multimedia content from a multimedia server;

Playing the second multimedia content;

The second multimedia content is generated by combining the first multimedia content with the predetermined multimedia content, and the second multimedia content is limited to be played in a playing range that matches the client.