WO2016155527A1

WO2016155527A1 - Streaming media alignment method, device and storage medium

Info

Publication number: WO2016155527A1
Application number: PCT/CN2016/076853
Authority: WO
Inventors: 孔令城
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2015-04-02
Filing date: 2016-03-21
Publication date: 2016-10-06
Also published as: HK1213082A1; CN104978982A; CN104978982B

Abstract

A streaming media alignment method, device and storage medium. The method comprises: obtaining a first streaming media and a second streaming media, the first streaming media and the second streaming media being different versions of a same streaming media; performing a cross-correlation calculation on the first streaming media and the second streaming media to obtain a first time point of the first streaming media and a second time point of the second streaming media corresponding to a maximum cross-correlation value, and determining a time offset between the first streaming media and the second streaming media according to the first time point and the second time point; and aligning the first streaming media and the second streaming media according to the time offset. The present solution can accurately determine the time offset between different versions of a streaming media, thus aligning versions of the streaming media.

Description

Stream media alignment method, device and storage medium

This application claims priority to Chinese Patent Application No. 201510154259.6, entitled "A Streaming Media Version Alignment Method, and Equipment" filed on April 2, 2015, the entire contents of which are incorporated by reference. In this application.

Technical field

The present invention relates to the field of computer technologies, and in particular, to a streaming media alignment method, device, and storage medium.

Background technique

Streaming media is a stream of data that is played in time order, such as audio songs, video movies, and the like. Taking songs as an example, in the Internet, the same song may be rewritten into many different versions due to the need of transmission and production, resulting in the song's vocal position is not the same, but in fact the lyrics and the main melody of the song are Are the same. In order for certain resources (eg, lyrics, video) to be multiplexed when presented to the user, it may be necessary to find a different version of the vocal point of the same song, or to find a time delay between different versions of the song.

Summary of the invention

Embodiments of the present invention provide a streaming media alignment method, device, and storage medium.

A streaming media alignment method includes:

Acquiring the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media;

Performing cross-correlation calculation on the first streaming media and the second streaming media to obtain a first time point of the first streaming media corresponding to the maximum correlation value of the cross-correlation and a second time point of the corresponding second streaming media, according to the Determining a time offset between the first streaming media and the second streaming media at the first time point and the second time point;

Aligning the first streaming media and the second streaming media according to the time offset.

A streaming media alignment device includes: one or more processors and a storage medium storing operation instructions, when executing an operation instruction in the storage medium, the processor performs the following steps:

A non-transitory computer readable storage medium having stored thereon computer executable instructions for performing the following steps when the executable instructions are executed in a computer:

DRAWINGS

1 is a schematic flowchart of a media stream alignment method according to an embodiment of the present invention;

2 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present disclosure;

4 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a media stream alignment device according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail with reference to the accompanying drawings, in which . All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention provides a streaming media alignment method, which can be applied to a terminal device such as a mobile phone or a computer, and can also be applied to a server or the like. As shown in FIG. 1, the method includes steps 101 to 103.

In step 101, the first streaming media and the second streaming media are obtained, where the first streaming media and the second streaming media are different versions of the same streaming media.

The "first streaming media" and the "second streaming media" in the embodiment of the present invention are used to distinguish two different versions of streaming media. In this embodiment, the streaming media may be various audio media such as audio/video, which is not limited by the embodiment of the present invention.

In step 102, performing cross-correlation calculation on the first streaming media and the second streaming media, and obtaining a first time point of the first streaming media corresponding to the maximum correlation value of the cross-correlation and a second time point of the corresponding second streaming media, according to The first time point and the second time point determine a time offset between the first streaming medium and the second streaming medium.

In this embodiment, the process of performing cross-correlation calculation may be performing cross-correlation calculation on all data of the first streaming media and the second streaming media, or performing cross-correlation calculation on one segment of the data, which is not implemented in the embodiment of the present invention. Uniqueness is limited. For the method of cross-correlation calculation, reference may be made to a mature algorithm, and the embodiment of the present invention does not uniquely define the cross-correlation algorithm.

In step 103, the first streaming media and the second streaming media are aligned according to a time offset between the first streaming media and the second streaming media.

According to the embodiment of the present invention, the first time point of the first streaming media corresponding to the maximum correlation value and the second time point of the corresponding second streaming media are determined by cross-correlation calculation, and then the first time point and the second time pass. The point determines the time offset between the first streaming media and the second streaming media, and the time offset between the different versions of the streaming media can be accurately determined to achieve streaming media version alignment.

In another embodiment of the present invention, before the cross-correlation calculation is performed on the first streaming media and the second streaming media, the method further includes: downsampling the first streaming media and the second streaming media.

The performing cross-correlation calculation on the first streaming media and the second streaming media may include:

Perform cross-correlation calculation on the downsampled first stream and the second stream.

In this embodiment, the sampling rate of the downsampling may determine the sampling rate corresponding thereto according to the data computing capability of the executing device, thereby improving the matching degree.

In another embodiment of the present invention, before the cross-correlation calculation is performed on the first streaming media and the second streaming media, the method further includes: intercepting data in the first streaming media and the second streaming media reference time period.

The cross-correlation calculation of the first streaming media and the second streaming media includes:

Cross-correlation calculation is performed on data in the first streaming media and the second streaming media reference time period.

In the embodiment of the present invention, the intercepted time period may be dynamically adjusted to accommodate possible time offsets between different streaming media versions, for example, data intercepting the first streaming media and the second streaming media reference time period. Previously, the above methods also include:

The reference time period is determined according to a cross-correlation time difference between the first streaming medium and the second streaming medium.

Since the time period of the interception is too long, the amount of data may be too large, which may result in the device not being able to obtain the processing result for a long time, and even the occurrence of a jamming phenomenon. To avoid this, the embodiment of the present invention provides the following solutions: The above methods also include:

If the cross-correlation time difference exceeds a predetermined threshold, the flow of performing streaming media version alignment is suspended.

The embodiment of the present invention further provides a solution for calculating cross-correlation and determining a maximum value of cross-correlation, as follows: performing cross-correlation calculation on the first streaming media and the second streaming media, and obtaining a maximum correlation value includes:

Calculating the cross-correlation of the first streaming media and the second streaming media by using the following formula:

Where x represents data of the first streaming medium, y represents data of the second streaming medium, ω _τ represents a window function, and n is a time sampling point;

The first time point of the first streaming medium corresponding to the maximum value and the second time point of the corresponding second streaming medium are determined according to the calculated maximum value of the τ value.

The following embodiments illustrate the embodiments of the present invention by taking songs in an audio medium as an example. The technical solution of the embodiment of the present invention mainly uses the cross-correlation method to perform the initial singing position of two songs. Positioned.

Step one, downsampling

In the embodiment of the present invention, in order to reduce the amount of calculation without losing the calculation accuracy, it is better to uniformly downsample the song to 8000 Hz through experiments.

Step 2: Selection of cross-correlation time period

In order to further reduce the amount of calculation, the embodiment of the present invention may not calculate the cross-correlation of the whole song. According to experience, different time periods are selected for the cross-correlation calculation for the case where the time difference between the two songs is different. For example, if the time difference between two songs is less than 10s, the cross-correlation time is calculated as the first 15s, and the time difference is within 5s. The cross-correlation time is calculated as the first 10s. As a rule of thumb, this ensures both accuracy and computational effort.

Step 3, seeking cross-correlation

Here we calculate the method of cross-correlation, as follows:

Where x represents the data of the first song, y represents the data of the second song, and ω _τ represents the window function, where the window function is the time period corresponding to the selection of the cross-correlation time period described above.

Step 4: Select the starting position of the song

Through the foregoing cross-correlation calculation, the cross-correlation maximum value can be obtained, and the first time point of the first song corresponding to the maximum cross-correlation value and the second time point of the corresponding second song are determined, according to the first time The point and the second time point determine a time offset between the first song and the second song, and align the two songs according to the time offset.

With the solution of the embodiment of the present invention, the sing position of two different versions of the song can be accurately aligned; at the same time, the cross-correlation time length classification technique used can reduce the calculation amount and improve the calculation speed.

The embodiment of the invention further provides a streaming media alignment device, as shown in FIG. 2, comprising:

The media obtaining unit 201 is configured to acquire the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media.

The calculating unit 202 is configured to perform cross-correlation calculation on the first streaming media and the second streaming media, to obtain a first time point of the first streaming media corresponding to the maximum cross-correlation coefficient and a corresponding second streaming media Two time points;

The offset determining unit 203 is configured to determine a time offset between the first streaming media and the second streaming media according to the first time point and the second time point;

The aligning unit 204 is configured to align the first streaming media and the second streaming media according to a time offset between the first streaming media and the second streaming media.

In this embodiment, the streaming media may be various audio media such as audio/video, which is not limited by the embodiment of the present invention. In this embodiment, the process of performing cross-correlation calculation may be performing cross-correlation calculation on all data of the first streaming media and the second streaming media, or performing cross-correlation calculation on one segment of the data, which is not unique in the embodiment of the present invention. Sexual limitation. For the method of cross-correlation calculation, reference may be made to a mature algorithm, and the embodiment of the present invention does not uniquely define the cross-correlation algorithm.

In another embodiment of the present invention, as shown in FIG. 3, the aligning apparatus may further include:

The sampling unit 301 is configured to downsample the first streaming media and the second streaming media before performing cross-correlation calculation on the first streaming media and the second streaming media.

The calculating unit 202 is configured to perform cross-correlation calculation on the downsampled first streaming media and the second streaming media.

In another embodiment of the present invention, as shown in FIG. 4, the foregoing aligning apparatus may further include:

The intercepting unit 401 is configured to intercept data in the first streaming media and the second streaming media reference time period before performing cross-correlation calculation on the first streaming media and the second streaming media.

The calculating unit 202 is configured to perform cross-correlation calculation on data in the first streaming media and the second streaming media reference time period.

In the embodiment of the present invention, the intercepted time period may be dynamically adjusted to adapt to a time offset that may exist between different streaming media versions. For example, as shown in FIG. 5, the foregoing aligning device may further include:

a time determining unit 501, configured to intercept the first streaming media and the second streaming media reference time period Before the data, the reference time period is determined according to the cross-correlation time difference between the first stream medium and the second stream medium.

Since the time period of the interception is too long, the amount of data may be too large, which may result in the device not being able to obtain the processing result for a long time, and even the occurrence of a jamming phenomenon. To avoid this, the embodiment of the present invention provides the following solutions: Further, as shown in FIG. 6, the foregoing aligning device further includes:

The flow control unit 601 is configured to suspend the process of performing streaming media version alignment if the cross-correlation time difference exceeds a predetermined threshold.

The embodiment of the present invention further provides a solution for calculating the cross-correlation and determining the maximum value of the cross-correlation, as follows: Optionally, the calculating unit 202 is configured to calculate a cross-correlation between the first streaming media and the second streaming media by using the following formula:

Where x represents the data of the first streaming media, y represents the data of the second streaming media, ω _τ represents the window function, n is the time sampling point; the maximum value of the τ value is obtained according to the calculation, and the first stream corresponding to the maximum value is determined The first time point of the media and the second time point of the corresponding second streaming media.

Another embodiment of the present invention further provides a streaming media alignment device, as shown in FIG. 7, comprising: a receiver 701, a transmitter 702, a processor 703, and a memory 704.

The processor 703 is configured to acquire the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media, and performing cross-correlation calculation on the first streaming media and the second streaming media to obtain mutual Determining a first time point of the first streaming media corresponding to the maximum value and a second time point of the corresponding second streaming media, determining, between the first streaming media and the second streaming media, according to the first time point and the second time point Time offset; aligning the first streaming media and the second streaming media according to a time offset between the first streaming media and the second streaming media.

According to the embodiment of the present invention, the cross-correlation calculation is used to determine the first medium corresponding to the maximum value of the cross-correlation The first time point of the body and the second time point of the corresponding second streaming medium, and determining the time offset between the first streaming media and the second streaming media through the first time point and the second time point, which can be accurately Determine the time offset between different versions of streaming media to achieve streaming media version alignment.

In another embodiment of the present invention, the processor 703 is further configured to downsample the first streaming media and the second streaming media before performing cross-correlation calculation on the first streaming media and the second streaming media.

In another embodiment of the present invention, the processor 703 is further configured to intercept data in the first streaming media and the second streaming media reference time period before performing cross-correlation calculation on the first streaming media and the second streaming media.

In the embodiment of the present invention, the intercepted time period may be dynamically adjusted to accommodate a time offset that may exist between different streaming media versions. For example, the processor 703 is further configured to intercept the first streaming media and the second streaming media. Before referring to the data in the time period, the reference time period is determined according to the cross-correlation time difference between the first streaming media and the second streaming media.

Since the time period of the interception is too long, the amount of data may be too large, which may result in the device not being able to obtain the processing result for a long time, and even the occurrence of a jamming phenomenon. To avoid this, the embodiment of the present invention provides the following solutions: The processor 703 is further configured to suspend the process of performing streaming media version alignment if the cross-correlation time difference exceeds a predetermined threshold.

The embodiment of the present invention further provides a solution for calculating cross-correlation and determining a maximum value of cross-correlation, as follows: The processor 703 is configured to calculate cross-correlation between the first streaming media and the second streaming media by using the following formula:

Calculating the maximum value of the τ value according to the calculation, and determining the first of the first streaming media corresponding to the maximum value The time point and the second time point of the corresponding second streaming medium.

The embodiment of the present invention further provides another streaming media aligning device. As shown in FIG. 8 , for the convenience of description, only parts related to the embodiment of the present invention are shown. If the specific technical details are not disclosed, please refer to the implementation of the present invention. Example method section. The aligning device is illustrated in FIG. 8 as a terminal, and the terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, and the like. The terminal is a mobile phone as an example:

FIG. 8 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present invention. Referring to FIG. 8 , the mobile phone includes: a radio frequency (RF) circuit 810 , a memory 820 , an input unit 830 , a display unit 840 , a sensor 850 , an audio circuit 860 , a wireless fidelity (WiFi) module 870 , and a processor 880 . And power supply 890 and other components. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 8 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different component arrangements.

The components of the mobile phone will be specifically described below with reference to FIG.

The RF circuit 810 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 880. In addition, the uplink data is designed to be sent to the base station. Generally, RF circuit 810 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuitry 810 can also communicate with the network and other devices via wireless communication. The above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.

The memory 820 can be used to store software programs and modules, and the processor 880 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 820. The memory 820 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of mobile phones (such as audio data, phone book) and many more. Moreover, memory 820 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 830 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset. Specifically, the input unit 830 may include a touch panel 831 and other input devices 832. The touch panel 831, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 831 or near the touch panel 831. Operation), and drive the corresponding connecting device according to a preset program. Optionally, the touch panel 831 can include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 880 is provided and can receive commands from the processor 880 and execute them. In addition, the touch panel 831 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 831, the input unit 830 may also include other input devices 832. In particular, other input devices 832 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 840 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone. The display unit 840 can include a display panel 841. Alternatively, the display panel 841 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 831 can cover the display panel 841. When the touch panel 831 detects a touch operation thereon or nearby, the touch panel 831 transmits to the processor 880 to determine the type of the touch event, and then the processor 880 according to the touch event. The type provides a corresponding visual output on display panel 841. Although in FIG. 8, the touch panel 831 and the display panel 841 are two independent components to implement the input and input functions of the mobile phone, in some embodiments, the touch panel 831 can be integrated with the display panel 841. Realize the input and output functions of the phone.

The handset can also include at least one type of sensor 850, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 841 according to the brightness of the ambient light, and the proximity sensor may close the display panel 841 and/or when the mobile phone moves to the ear. Or backlight. As a kind of motion sensor, plus The speedometer sensor can detect the acceleration of each direction (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration). Vibration recognition related functions (such as pedometer, tapping), etc.; other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which can be configured on the mobile phone, will not be described here.

An audio circuit 860, a speaker 861, and a microphone 862 can provide an audio interface between the user and the handset. The audio circuit 860 can transmit the converted electrical data of the received audio data to the speaker 861 for conversion to the sound signal output by the speaker 861; on the other hand, the microphone 862 converts the collected sound signal into an electrical signal by the audio circuit 860. After receiving, it is converted into audio data, and then processed by the audio data output processor 880, sent to the other mobile phone via the RF circuit 810, or outputted to the memory 820 for further processing.

WiFi is a short-range wireless transmission technology, and the mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 870, which provides users with wireless broadband Internet access. Although FIG. 8 shows the WiFi module 870, it can be understood that it does not belong to the essential configuration of the mobile phone, and can be omitted as needed within the scope of not changing the essence of the invention.

The processor 880 is the control center of the handset, and connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 820, and invoking data stored in the memory 820, executing The phone's various functions and processing data, so that the overall monitoring of the phone. Optionally, the processor 880 may include one or more processing units; preferably, the processor 880 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 880.

The handset also includes a power source 890 (such as a battery) that supplies power to the various components. Preferably, the power source can be logically coupled to the processor 880 through a power management system to manage functions such as charging, discharging, and power management through the power management system.

Although not shown, the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.

In the embodiment of the present invention, the processor 880 included in the terminal further has the capability of executing the above flow media alignment method flow.

FIG. 9 is another streaming media alignment device according to an embodiment of the present invention. The device is illustrated in FIG. For a server, the server 900 can vary considerably depending on configuration or performance, and can include one or more central processing units (CPU) 922 and memory 932, one or more storage applications 942 or data. Storage medium 930 of 944. Among them, the memory 932 and the storage medium 930 may be short-term storage or persistent storage. The program stored on storage medium 930 may include one or more logic modules (not shown), each of which may include a series of instruction operations in the server. Still further, central processor 922 can be configured to communicate with storage medium 930, executing a series of instruction operations in storage medium 930 on server 900.

Server 900 may also include one or more power supplies 926, one or more wired or wireless network interfaces 950, one or more input and output interfaces 958, and/or one or more operating systems 941, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.

The streaming media alignment method in the above embodiment may be based on the server structure shown in FIG.

The above is exemplified by the physical device structure of the mobile phone and the server. In the implementation of the embodiment of the present invention, any device that needs to be aligned with the streaming media other than the above-mentioned example hardware may not be understood as the uniqueness of the embodiment of the present invention. limited.

It should be noted that, in the foregoing aligning device embodiment, each unit included is only divided according to functional logic, but is not limited to the foregoing division, as long as the corresponding function can be implemented; The names are also for convenience of distinction from each other and are not intended to limit the scope of protection of the present invention.

In addition, those skilled in the art can understand that all or part of the steps in implementing the foregoing method embodiments may be performed by a program to instruct related hardware, and the corresponding program may be stored in a computer readable storage medium. The storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

The above is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the embodiments of the present invention. All should be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A streaming media alignment method includes:

Acquiring the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media;

Performing cross-correlation calculation on the first streaming media and the second streaming media to obtain a first time point of the first streaming media corresponding to the maximum correlation value of the cross-correlation and a second time of the corresponding second streaming media Point, determining, according to the first time point and the second time point, a time offset between the first streaming media and the second streaming media;

Aligning the first streaming media and the second streaming media according to the time offset.
The method of claim 1, before performing cross-correlation calculation on the first streaming media and the second streaming media, further comprising: downsampling the first streaming media and the second streaming media;

Performing cross-correlation calculation on the first streaming media and the second streaming media includes:

Performing cross-correlation calculation on the downsampled first streaming media and the second streaming media.
The method of claim 1, before performing cross-correlation calculation on the first streaming media and the second streaming media, further comprising:

Intercepting data in the first streaming media and the second streaming media reference time period;

Performing cross-correlation calculation on the first streaming media and the second streaming media includes:

Perform cross-correlation calculation on the data in the first streaming media and the second streaming media reference time period.
The method according to claim 3, before the data in the reference time period corresponding to the first streaming media and the second streaming media is intercepted, the method further includes:

Determining the reference time period according to a cross-correlation time difference between the first streaming media and the second streaming media.
The method of claim 4 further comprising:

If the cross-correlation time difference exceeds a predetermined threshold, the flow of performing streaming media alignment is suspended.
The method according to any one of claims 1 to 5, wherein the cross-correlation calculation is performed on the first streaming media and the second streaming media, and the first time point of the first streaming media corresponding to the maximum correlation value is obtained. The second time point of the corresponding second streaming media includes:

Calculating the cross-correlation between the first streaming media and the second streaming media by using the following formula:

Where x represents data of the first streaming medium, y represents data of the second streaming medium, ω τ represents a window function, and n is a time sampling point;

Calculating a maximum value of the τ value according to the calculation, and determining a first time point of the first streaming medium and a second time point of the second streaming medium corresponding to the maximum value.
A streaming media alignment device includes: one or more processors and a storage medium storing operation instructions, when executing an operation instruction in the storage medium, the processor performs the following steps:

Acquiring the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media;

Performing cross-correlation calculation on the first streaming media and the second streaming media to obtain a first time point of the first streaming media corresponding to the maximum correlation value of the cross-correlation and a second time of the corresponding second streaming media Point, determining, according to the first time point and the second time point, a time offset between the first streaming media and the second streaming media;

Aligning the first streaming media and the second streaming media according to the time offset.
The device according to claim 7, before performing cross-correlation calculation on the first streaming media and the second streaming media, the processor further performing: downsampling the first streaming media and the second streaming media;

When performing the cross-correlation calculation on the first streaming media and the second streaming media, the processor performs: performing cross-correlation calculation on the downsampled first streaming media and the second streaming media.
The device according to claim 7, before performing cross-correlation calculation on the first streaming media and the second streaming media, the processor further performing: intercepting the first streaming media and the second streaming media parameter Data during the test period;

When performing the cross-correlation calculation on the first streaming media and the second streaming media, the processor performs: performing cross-correlation calculation on the data in the first streaming media and the second streaming media reference time period.
The apparatus of claim 3, said processor further executing:

The reference time period is determined according to a cross-correlation time difference between the first streaming media and the second streaming media, before the data in the reference time period corresponding to the first streaming media and the second streaming media is intercepted.
The apparatus of claim 10, said processor further executing:

If the cross-correlation time difference exceeds a predetermined threshold, the process of performing streaming media version alignment is suspended.
The apparatus according to any one of claims 7 to 11, wherein the processor calculates a cross-correlation of the first streaming medium and the second streaming medium by:

Where x represents data of the first streaming medium, y represents data of the second streaming medium, ω τ represents a window function, and n is a time sampling point;

Determining a maximum correlation value according to the calculated maximum value of the τ value, and determining a first time point of the first streaming medium and a second time point of the second streaming medium corresponding to the maximum value.
A non-transitory computer readable storage medium having stored thereon computer executable instructions for performing the following steps when the executable instructions are executed in a computer:

Acquiring the first streaming media and the second streaming media, where the first streaming media and the second streaming media are different versions of the same streaming media;

Performing cross-correlation calculation on the first streaming media and the second streaming media to obtain a first time point of the first streaming media corresponding to the maximum correlation value of the cross-correlation and a second time of the corresponding second streaming media Point, determining, according to the first time point and the second time point, a time offset between the first streaming media and the second streaming media;

Aligning the first streaming media and the second streaming media according to the time offset.