CN114339302A - Broadcasting guide method, device, equipment and computer storage medium - Google Patents
Broadcasting guide method, device, equipment and computer storage medium Download PDFInfo
- Publication number
- CN114339302A CN114339302A CN202111669019.1A CN202111669019A CN114339302A CN 114339302 A CN114339302 A CN 114339302A CN 202111669019 A CN202111669019 A CN 202111669019A CN 114339302 A CN114339302 A CN 114339302A
- Authority
- CN
- China
- Prior art keywords
- audio data
- video data
- data
- aligned
- director
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000001360 synchronised effect Effects 0.000 claims abstract description 40
- 238000004891 communication Methods 0.000 claims description 15
- 230000005540 biological transmission Effects 0.000 claims description 13
- 230000000737 periodic effect Effects 0.000 claims description 12
- 238000001914 filtration Methods 0.000 claims description 7
- 238000005070 sampling Methods 0.000 claims description 6
- 239000000126 substance Substances 0.000 claims description 6
- 238000002604 ultrasonography Methods 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims description 3
- 230000002708 enhancing effect Effects 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 13
- 238000004590 computer program Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000003062 neural network model Methods 0.000 description 4
- 239000013598 vector Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009977 dual effect Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention relates to the technical field of computer data processing, and discloses a program directing method, which comprises the following steps: determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. Through the mode, the cloud director user experience is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of computer data processing, in particular to a broadcasting guide method, a broadcasting guide device, broadcasting guide equipment and a computer storage medium.
Background
With the development of scientific technology and mass media, live broadcast by means of internet media has entered into the lives of people, and with the increase of requirements of users on the quality and quality of live broadcast, users often have the requirements of broadcast guiding functions in professional live broadcast such as multi-station switching, special field rest and the like, so that a cloud broadcast guiding technology is promoted.
In the cloud broadcasting technology, a cloud broadcasting server can process a live broadcast code stream acquired by a live broadcast site, wherein a plurality of acquisition devices may exist in the live broadcast site, and data acquired by one acquisition device is used as one path of live broadcast code stream. The cloud director server obtains processed data and sends the processed data to the cloud director terminal and the cloud mixed-flow service, so that video data corresponding to live broadcast code streams are displayed on the cloud director terminal, a cloud director user can conveniently conduct director operation on the video data displayed on the cloud director terminal, the director operation is sent to the cloud mixed-flow service, the cloud mixed-flow service can process according to the director operation input by the cloud director terminal, streaming media data after director processing are obtained, and the streaming media data are displayed for a user watching videos.
The method and the device for the cloud broadcasting have the advantages that in the process of implementing the embodiment of the invention, the problem that the live video watching experience after the cloud broadcasting guide processing is poor due to the fact that the accuracy and/or efficiency of the synchronization of the live audio and video data is low in the existing cloud broadcasting guide method is found.
Disclosure of Invention
In view of the foregoing problems, embodiments of the present invention provide a method, an apparatus, a device and a computer storage medium for directing a program, which are used to solve the problem in the prior art that user experience is poor.
According to an aspect of an embodiment of the present invention, there is provided a method for directing broadcasting, the method including:
determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals;
aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data;
synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
In an optional manner, the method further comprises:
performing audio enhancement on the aligned audio data to obtain enhanced audio data;
transcoding the synchronized video data to obtain high-definition video data and low-definition video data corresponding to each code stream;
sending the enhanced audio data and the low-definition video data corresponding to each code stream to the cloud program directing terminal;
and sending the enhanced audio data and the high-definition video data corresponding to each code stream to a cloud mixed-flow service, so that the cloud mixed-flow service processes the enhanced audio data and the high-definition video data according to the received operation information input by the cloud director terminal to obtain the target streaming media data.
In an optional manner, the method further comprises:
overlapping the aligned audio data corresponding to each code stream to obtain overlapped audio data;
and carrying out noise filtration on the superposed audio data to obtain the enhanced audio data.
In an alternative mode, the high-frequency ultrasonic signals are transmitted according to a plurality of periods, and the transmission time intervals between the high-frequency ultrasonic signals in each period form an arithmetic progression; the tolerance of the series of equal differences is determined according to the periodic sequence of the cycles.
In an alternative form, the arithmetic progression of periods of period order m is represented as
Wherein the content of the first and second substances,
d0＝0，dm＝dm-1+1，dmand for the tolerance of the arithmetic progression, k represents the kth term in the arithmetic progression, m and k are positive integers, and m and k are updated according to the value of the last term of the arithmetic progression and/or the length of the arithmetic progression.
In an optional manner, the method further comprises:
carrying out high-pass filtering on the audio data to obtain filtered audio data;
sampling and screening the filtered audio data to obtain a plurality of adjacent effective mark points on a time axis;
determining the corresponding periodic sequence of the effective marking points according to the time intervals among the effective marking points;
determining an actual transmission time interval of the high frequency signal;
determining the time stamp of the audio data corresponding to each path of code stream according to the actual emission time interval and the periodic sequence corresponding to the effective marking point;
and aligning the audio data according to the time stamp to obtain the aligned audio data.
In an optional manner, the method further comprises:
determining the starting time t of a period of the order m according tom0：
Wherein x is a positive integer, and n is a length threshold of the arithmetic progression; the array length threshold is used for iteratively updating the m and the k;
determining the timestamp t according to the following formula;
wherein the content of the first and second substances,
is the actual transmission time interval; d ═ d1+m*1。
According to another aspect of the embodiments of the present invention, there is provided a director device, including:
the determining module is used for determining audio data and video data corresponding to the multi-path code streams respectively; the audio data carries high-frequency ultrasonic signals;
the alignment module is used for aligning the audio data according to the high-frequency ultrasonic signal to obtain aligned audio data;
the synchronization module is used for synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and the display module is used for generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
According to another aspect of the embodiments of the present invention, there is provided a director device, including:
the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is configured to store at least one executable instruction that causes the processor to perform operations as any of the director method embodiments.
According to yet another aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored therein at least one executable instruction for causing a director device to perform operations as any one of the director method embodiments.
The embodiment of the invention determines the audio data and the video data respectively corresponding to the multi-path code stream; wherein the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. According to the embodiment of the invention, the high-frequency ultrasonic signals are transmitted on the target site, so that the audio data and the video data of each path of code stream are aligned according to the high-frequency signal characteristics carried in the audio data, the synchronization of multiple paths of audio and video data is realized, the accuracy and the efficiency of the synchronization of the audio and video data of the cloud broadcasting guide can be improved, and the watching experience of the streaming media obtained by the broadcasting guide processing is better.
The foregoing description is only an overview of the technical solutions of the embodiments of the present invention, and the embodiments of the present invention can be implemented according to the content of the description in order to make the technical means of the embodiments of the present invention more clearly understood, and the detailed description of the present invention is provided below in order to make the foregoing and other objects, features, and advantages of the embodiments of the present invention more clearly understandable.
Drawings
The drawings are only for purposes of illustrating embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart illustrating a director method according to an embodiment of the present invention;
FIG. 2 is a flow chart of an audio enhancement method provided by an embodiment of the invention;
fig. 3 is a flow chart illustrating a method for directing a program according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of a director provided in an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a director device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein.
Fig. 1 illustrates a flow chart of a director method, as performed by a computer processing device, provided by an embodiment of the present invention. The computer processing device may include a cell phone, a notebook computer, etc. As shown in fig. 1, the method comprises the steps of:
step 10: determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals.
In one embodiment of the invention, the audio data and the video data can be extracted from the audio and video acquisition data respectively. The audio and video acquisition data can be acquired in a target site, and the target site can be a site needing live broadcasting, such as a concert, various games, a teaching and training site and the like. The audio and video acquisition data can be acquired by a plurality of acquisition devices at various positions of a target site, and the video acquisition devices can be of different types, such as cameras, mobile phones, tablet computers and other devices. One path of code stream corresponds to data acquired by one acquisition device. And respectively extracting the audio and video acquisition data according to the data types to obtain audio data and video data.
In still another embodiment of the present invention, the cloud director user may create a cloud live broadcast remotely, generate a series of push stream addresses, and provide the push stream addresses to a live broadcast user performing live broadcast on a target site, or pull a live broadcast stream according to a pull stream address provided by the live broadcast user, and determine audio/video acquisition data according to the pulled live broadcast stream.
Specifically, independent audio and video can be extracted from different code streams, and the source of the audio and video is marked, for example, the audio extracted from the first code stream is marked as a1The video is V1(ii) a By parity of reasoning, the audio data extracted from the ith channel of audio-video data is recorded as AiAnd video data is recorded as Vi。
In a further embodiment of the invention, the high-frequency ultrasonic signal is transmitted by a preset device at the target site, and the preset device can be a preset high-frequency transmitting device which is used for transmitting a high-frequency short-time (such as 50ms) signal with the frequency of 20-22 kHz. The sampling frequency of the sound card of the common mobile phone is 44.1kHz, and a few of the sound cards can reach 48 kHz. According to the sampling theorem, when the sampling frequency is more than 2 times of the highest frequency in the signals, the sampled digital signals completely reserve the information in the original signals, so that the time synchronization of audio and video data can be carried out according to the high-frequency ultrasonic signals superposed in the audio signals collected by a user.
In one embodiment of the invention, the high-frequency ultrasonic signals are transmitted according to a plurality of periods, and the transmission time intervals among the high-frequency ultrasonic signals in each period form an arithmetic progression; the tolerance of the series of equal differences is determined according to the periodic sequence of the cycles.
Where the cycle order refers to the number of cycles that the current cycle is transmitting. If the order of the cycles is 10, then the current cycle is the 10 th transmission cycle. Because the tolerance of the equal difference data corresponding to each period is determined according to the period sequence, the period where the current period is located can be determined according to the acquisition time difference of the actually acquired signals, namely the tolerance of the equal difference number series, the signal duration of all periods before the current period can be calculated according to the summation formula of the equal difference number series, namely the starting time stamp of the current period is obtained, and the time of the audio data can be calibrated according to the starting time stamp.
When updating the tolerance, that is, updating the cycle order, whether the length (that is, the number of included terms) of the arithmetic progression of the current cycle reaches a certain length threshold may be used as a criterion for whether the tolerance needs to be recalculated. Optionally, when determining whether the tolerance calculation and transmission of a new period are required, it may also be determined whether an entry in the arithmetic progression is greater than a preset entry threshold.
Thus, in yet another embodiment of the present invention, the process of determining the tolerance of the arithmetic data column from the periodic sequence may comprise:
the arithmetic progression of periods with a period order m is shown as
Wherein the content of the first and second substances,
d0＝0，dm＝dm-1+1，dmand for the tolerance of the arithmetic progression, k represents the kth term in the arithmetic progression, m and k are positive integers, and m and k are updated according to the value of the last term of the arithmetic progression and/or the length of the arithmetic progression.
In one embodiment of the present invention, the value of the last term of the current arithmetic progression is compared with a preset term threshold, if the value is greater than the term threshold, the tolerance is updated, and a new period of high-frequency ultrasonic signals is restarted with the updated tolerance as the time interval.
Therefore, in a further embodiment of the present invention, the manner of updating m and k according to the value of the last term of the arithmetic progression and/or the length of the arithmetic progression may be as follows:
when k is equal to j, and exists simultaneously
And
when dm +1 is equal to dm +1,
and let k increment again from 1, where u is the time interval threshold.
I.e. when j tolerances d are transmittedmTime difference between the ultrasonic wave of (1) and the ultrasonic wave at the previous time
Exceeding the threshold u, this time order dm+1＝dm+1，
Computing
And k is incremented by 1 again starting with 1, thereby starting a new tolerance interval and continuing to transmit the high frequency ultrasound signal.
For example, assume a tolerance d of the initial transmit time difference11 and
the term threshold u is 60. The time interval between the first signal wave and the second signal wave is 1s, the time interval between the second signal wave and the third signal wave is 2 s, the time interval between the third signal wave and the fourth signal wave is 3 s, and so on, when the time interval is 61s, i.e. greater than the preset item threshold of 60s, the signal is transmitted in the period of a new tolerance, and the updating of the tolerance can be in a mode of increasing 1, i.e. the tolerance d is made22 and
according to the summation formula of the arithmetic progression, the first transmission timestamp of the next period is 1831 s.
In a further embodiment of the present invention, m and k are updated according to the value of the last term of the arithmetic progression and/or the length of the arithmetic progression, which may be as follows:
when k is>When n is, let dm+1＝dm+1，
And making k increase by one from 1 again, wherein n is the length threshold of the arithmetic progression.
That is, if the number of terms in the arithmetic progression of the current cycle exceeds the preset threshold n, the signal is transmitted in the cycle with a new tolerance, and the updating of the tolerance may be in a manner of incrementing by 1.
Step 20: and aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data.
In an embodiment of the present invention, as can be known from the emission rule of the high-frequency ultrasonic signals, the tolerance and the cycle order of the emission cycle of the high-frequency signals can be located according to the variation rule of the time interval between the high-frequency signals extracted from the audio data, and then the position of a specific term in a specific arithmetic difference series corresponding to a specific cycle can be located according to the summation formula of the arithmetic difference series, that is, the position of the high-frequency signal on the time axis, that is, the time point, can be located.
Thus, in a further embodiment of the present invention, step 20 further comprises:
step 201: and carrying out high-pass filtering on the audio data to obtain filtered audio data.
In one embodiment of the invention, a high-pass filter is adopted to filter high-frequency signals within the range of 20-22 kHz from audio data corresponding to each path of code stream, and signals with the duration of about 50ms are obtained from the filtered signals to serve as initial marking signals.
Step 202: and sampling and screening the filtered audio data to obtain a plurality of adjacent effective mark points on a time axis.
In one embodiment of the present invention, a preset number of consecutive initial marker signals are extracted from the time axis of the filtered audio data, wherein the preset number may be 5. Considering that the tolerance of the arithmetic progression of the same period is constant, the difference between the time differences of the initial mark signal points should be close to zero. Therefore, in order to improve the accuracy of synchronizing the audio data according to the distribution characteristics of the high-frequency ultrasonic signals, the difference of the time difference between every two adjacent initial marking signals is judged, if the difference is greater than a certain error threshold value, the initial marking signals are abandoned and continuously sampled again, and if the difference is less than the error threshold value, the initial marking points are determined as effective marking points.
Step 203: and determining the corresponding periodic sequence of the effective marking points according to the time intervals among the effective marking points.
In one embodiment of the present invention, the time interval Δ between the effective mark points is equal to the tolerance d according to the above stepsmAnd according to Δ ═ dm＝d1+ m 1 so that it can be known that it is currently in the m-th cycle, so that it is based on m- Δ -d1And obtaining the tolerance counting process of the current signal in the m-th period.
Step 204: determining an actual transmission time interval of the high frequency signal.
Step 205: and determining the time stamp of the audio data corresponding to each path of code stream according to the actual emission time interval and the periodic sequence corresponding to the effective marking point.
In an embodiment of the present invention, the starting time point of the current cycle of the valid mark point can be determined according to the cycle order, and the elapsed time of the valid mark point in the arithmetic progression of the current cycle can be located according to the association relationship between the cycle order and the tolerance and the equality relationship between the tolerance and the time interval, so as to obtain the correct timestamp corresponding to the valid mark point.
Thus, in yet another embodiment of the present invention, step 205 further comprises:
step 2051: determining the starting time t of a period of the order m according tom0：
Wherein x is a positive integer, and n is a length threshold of the arithmetic progression; the array length threshold is used to iteratively update m and k.
In one embodiment of the present invention, the maximum time of the previous m-1 cycle count, i.e., the start time of the mth cycle tolerance count, is calculated so that the start t of the current cycle is knownm0。
Step 2052: determining the timestamp t according to the following formula;
wherein the content of the first and second substances,
is the actual transmission time interval; d ═ d1+m*1。
Step 206: and aligning the audio data according to the time stamp to obtain the aligned audio data.
Step 30: and synchronizing the video data according to the aligned audio data to obtain synchronized video data.
In one embodiment of the invention, according to the aligned audio, modifying the timestamp of the video in the corresponding code stream; according to a second step for each audio AiCalculate the corresponding
Time stamp in source code stream video Vi is compared with
And overlapping to obtain the synchronized timestamp.
Step 40: and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
In one embodiment of the invention, the operation information may be sent by a cloud director terminal connected with the cloud director server, the operation information is generated by the director user operating on the cloud director terminal, wherein, in order to facilitate the broadcast guide operation of the broadcast guide user, the synchronized video data can be transcoded to obtain high-definition video data and low-definition video data corresponding to each code stream, then sending the low-definition video data and the aligned audio data to a cloud director terminal, and simultaneously sending the high-definition video data and the aligned audio data to a mixed flow service at the cloud end, the high-definition video data and the aligned audio data are processed by the cloud mixed-flow service according to the operation input by the director user on the cloud director terminal, high-definition target streaming media data processed by the director are obtained, and the target streaming media data are returned to the user watching the live broadcast through the streaming media service.
Furthermore, before sending the aligned audio data to the cloud broadcasting guide terminal and the cloud mixed flow service, denoising processing can be performed on the aligned audio data, so that the watching experience of the live broadcast video is improved. The denoising processing can superpose the audio data of all the channel code streams, and the noise distribution in the superposed audio data is closer to white noise, so that the superimposed audio data is easier to screen and remove, and the efficiency and accuracy of noise removal are improved.
Thus, in a further embodiment of the present invention, step 40 further comprises:
step 401: and carrying out audio enhancement on the aligned audio data to obtain enhanced audio data.
In an embodiment of the invention, it is considered that a certain noise exists in a target site and affects the viewing experience of a user, so that audio enhancement is performed on aligned audio data, foreground audio signals of the aligned audio data are taken out, and background noise of the aligned audio data is removed, and in the enhancement process, the noise is considered to be relatively random in a single-channel code stream, but the foreground signals of the aligned audio data corresponding to each channel of code stream are synchronous, and the noise distribution is inconsistent, so that the aligned audio data corresponding to multiple channels of code streams are superposed, the noise distribution can be closer to white noise, and the noise can be removed more easily.
Thus, in one embodiment of the present invention, step 401 further comprises:
step 4011: and overlapping the aligned audio data corresponding to each code stream to obtain the overlapped audio data.
In one embodiment of the invention, the audio is cut and extracted according to time to obtain the feature vector corresponding to the single-channel audio. If the unit is ms, extracting the audio frequency every 20ms to obtain the corresponding n x 2 dimensional vector (a dual channel, for the single channel data, one output is duplicated to obtain the dual channel); then 1s can obtain 8 segments of n x 2 vectors. And the audio data of other paths except the single path are superposed to obtain the audio after mixing of other paths, and the audio after mixing of other paths and the single path audio feature vector are jointly combined into the audio data after superposition.
Step 4012: and carrying out noise filtration on the superposed audio data to obtain the enhanced audio data.
In an embodiment of the present invention, the process of noise filtering the superimposed audio data may refer to fig. 2. As shown in fig. 2, the superimposed audio data is input into a preset neural network model, and the neural network model outputs the enhanced audio. Optionally, the neural network model includes a 1-dimensional convolutional layer, a residual network model 1, a downsampling layer, a residual network model 2, and an RNN network, which are connected in sequence as shown in fig. 2. Alternatively, the loss function of the neural network model may be MSE (Mean Square Error).
Step 402: and transcoding the synchronized video data to obtain high-definition video data and low-definition video data corresponding to each path of code stream.
In one embodiment of the invention, the high-definition video data obtained through transcoding is used for live broadcast output, and the low-definition video data obtained through transcoding is used for sending to a cloud program director terminal for operation.
Step 403: and sending the enhanced audio data and the low-definition video data corresponding to each path of code stream to the cloud directing terminal.
In an embodiment of the present invention, the cloud director terminal ensures that all videos are played synchronously in a cache manner according to the enhanced audio data after the received timestamp synchronization and the low-definition video data corresponding to each path of code stream, so that a user performs a directing operation on the synchronized videos played on the cloud director client. Specifically, the director operation may include operations of pages such as video source switching, picture-in-picture, and the like, such as transmitting operation information such as switching video source 1 to video source 3 to the cloud mixed-flow service. Optionally, the cloud mixed-flow service may be implemented by a cloud director server, or by a third party mixed-flow server.
Step 404: and sending the enhanced audio data and the high-definition video data corresponding to each code stream to a cloud mixed-flow service, so that the cloud mixed-flow service processes the enhanced audio data and the high-definition video data according to the received operation information input by the cloud director terminal to obtain the target streaming media data.
In an embodiment of the present invention, the cloud mixed-flow service receives operation information input on the cloud broadcast guiding terminal, the enhanced audio data input by the cloud broadcast guiding server, and the high-definition video data corresponding to each code stream, and processes the enhanced audio data and the high-definition video data corresponding to each code stream according to the operation information to obtain target streaming media data, where the operation of the cloud mixed-flow service may include operations of switching data sources of the same pts timestamp information, picture-in-picture mixed-flow, and the like, so as to implement frame-level switching, obtain target streaming media data, and transmit the target streaming media data to the streaming media server, and the streaming media server implements external release of live streaming by providing streaming media service to a user viewing video.
In yet another embodiment of the present invention, the process of director may refer to fig. 3.
As shown in fig. 3, in a live broadcast site, a plurality of paths of audio/video code streams are collected by each collection device such as a mobile phone, a camera, a tablet and the like of a user and uploaded to a streaming media service. Wherein, the scene is provided with equipment for transmitting high-frequency ultrasonic signals, thereby including high-frequency ultrasonic signals in the code stream of live broadcast scene collection.
And the streaming media service pulls the corresponding audio and video code stream, and respectively extracts audio data and video data from the pulled data stream. And aligning the audio data according to the high-frequency ultrasound to obtain aligned audio, and synchronizing the video data according to the aligned audio to obtain video data with a synchronization timestamp. And extracting the synchronized video data to obtain a high-definition video and a low-definition video. Meanwhile, the audio superposition enhancement is carried out by utilizing the synchronous multi-channel audio data, the foreground sound is effectively extracted, and the invalid background sound is filtered, so that the enhanced audio data is obtained. And outputting the enhanced audio with the enhanced audio and one path of high-definition video data to a cloud mixed-flow service, and outputting the enhanced audio with the enhanced audio and one path of low-definition video to a cloud broadcasting guide terminal. The cloud mixed-flow service performs frame-level switching on the enhanced audio and one path of high-definition video data according to the operation information sent by the cloud broadcasting guide terminal to obtain a high-definition code stream, and sends the high-definition code stream to the streaming media server, and the streaming media server outputs the streaming media data to a user watching the terminal, so that cloud broadcasting guide is achieved.
Therefore, the embodiment of the invention provides a method for aligning frames of different video sources in a cloud based on comparison of audio characteristics by using audio from a background in the same scene based on audio and video data uploaded by a user. Recoding the aligned code stream, stamping a synchronous timestamp, and issuing the timestamp to the broadcasting guide room to realize the on-line cloud broadcasting guide frame level switching function; in addition, synchronous multi-channel audio data are utilized to perform audio superposition enhancement, foreground sound is effectively extracted, and invalid background sound is filtered, so that the user experience of cloud broadcasting is improved.
The method for directing the broadcast provided by the embodiment of the invention determines the audio data and the video data respectively corresponding to the multi-path code streams; the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. The method for directing the broadcasting, provided by the embodiment of the invention, can align the audio data and the video data of each code stream according to the high-frequency signal characteristics carried in the audio data by transmitting the high-frequency ultrasonic signals at the target site, so that the synchronization of multiple paths of audio and video data is realized, the accuracy and the efficiency of data synchronization of cloud directing can be improved, and the watching experience of streaming media obtained by directing the broadcasting is better.
Fig. 4 is a schematic structural diagram of a director provided in an embodiment of the present invention. As shown in fig. 4, the apparatus 500 includes: a determination module 501, an alignment module 502, a synchronization module 503, and a presentation module 504. The determining module 501 is configured to determine audio data and video data corresponding to multiple code streams respectively; the audio data carries high-frequency ultrasonic signals;
an alignment module 502, configured to align the audio data according to the high-frequency ultrasonic signal to obtain aligned audio data;
a synchronization module 503, configured to synchronize the video data according to the aligned audio data, so as to obtain synchronized video data;
a presentation module 504, configured to generate target streaming media data according to the operation information, the aligned audio data, and the synchronized video data.
The operation performed by the director device provided in the embodiment of the present invention is substantially the same as the operation process of the foregoing director method embodiment, and is not described again.
The method includes the steps that the broadcasting guide device determines audio data and video data corresponding to multiple paths of code streams respectively; the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. The director device provided by the embodiment of the invention aligns the audio data and the video data of each code stream according to the high-frequency signal characteristics carried in the audio data by transmitting the high-frequency ultrasonic signal at the target site, so that the synchronization of multiple paths of audio and video data is realized, the accuracy and efficiency of data synchronization of cloud director can be improved, and the watching experience of streaming media obtained by the director processing is better.
Fig. 5 is a schematic structural diagram of a director device according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the director device.
As shown in fig. 5, the director device may include: a processor (processor)602, a communication Interface 604, a memory 606, and a communication bus 608.
Wherein: the processor 602, communication interface 604, and memory 606 communicate with one another via a communication bus 608. A communication interface 604 for communicating with network elements of other devices, such as clients or other servers. The processor 602 is configured to execute the program 610, and may specifically perform the relevant steps in the above embodiments for the director method.
In particular, program 610 may include program code comprising computer-executable instructions.
The processor 602 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the director device may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.
And a memory 606 for storing a program 610. Memory 606 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
Specifically, program 610 may be invoked by processor 602 to cause the director device to perform the following operations:
determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals;
aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data;
synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
The operation performed by the director equipment provided by the embodiment of the present invention is substantially the same as the operation process of the foregoing director method embodiment, and is not described again.
The method includes the steps that the director equipment determines audio data and video data corresponding to multiple paths of code streams respectively; the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. The director equipment provided by the embodiment of the invention aligns the audio data and the video data of each code stream according to the high-frequency signal characteristics carried in the audio data by transmitting the high-frequency ultrasonic signal at the target site, so that the synchronization of multiple paths of audio and video data is realized, the accuracy and efficiency of data synchronization of cloud director can be improved, and the watching experience of streaming media obtained by the director processing is better.
An embodiment of the present invention provides a computer-readable storage medium, where the storage medium stores at least one executable instruction, and when the executable instruction is executed on a director device, the director device executes a director method in any method embodiment described above.
The executable instructions may be specifically configured to cause the director device to perform the following operations:
determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data comprises high frequency ultrasound signals;
aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data;
synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
The operations executed by the computer storage medium provided in the embodiment of the present invention are substantially the same as the operations executed by the foregoing embodiments of the director method, and are not described again.
The computer storage medium provided by the embodiment of the invention determines audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals; aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data; synchronizing the video data according to the aligned audio data to obtain synchronized video data; and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data. The computer storage medium provided by the embodiment of the invention aligns the audio data and the video data of each code stream according to the high-frequency signal characteristics carried in the audio data by transmitting the high-frequency ultrasonic signal at the target site, so that the synchronization of the multi-channel audio and video data is realized, the accuracy and the efficiency of the data synchronization of the cloud broadcasting guide can be improved, and the watching experience of the streaming media obtained by the broadcasting guide processing is better.
The embodiment of the invention provides a broadcasting guide device, which is used for executing the broadcasting guide method.
Embodiments of the present invention provide a computer program that can be invoked by a processor to cause a director device to perform the director method in any of the above method embodiments.
Embodiments of the present invention provide a computer program product comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions that, when run on a computer, cause the computer to perform the method of director in any of the above-mentioned method embodiments.
The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. In addition, embodiments of the present invention are not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names. The steps in the above embodiments should not be construed as limiting the order of execution unless specified otherwise.
Claims (10)
1. A method for directing, the method comprising:
determining audio data and video data respectively corresponding to multiple paths of code streams; the audio data carries high-frequency ultrasonic signals;
aligning the audio data according to the high-frequency ultrasonic signals to obtain aligned audio data;
synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
2. The method of claim 1, wherein generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data comprises:
performing audio enhancement on the aligned audio data to obtain enhanced audio data;
transcoding the synchronized video data to obtain high-definition video data and low-definition video data corresponding to each code stream;
sending the enhanced audio data and the low-definition video data corresponding to each code stream to the cloud program directing terminal;
and sending the enhanced audio data and the high-definition video data corresponding to each code stream to a cloud mixed-flow service, so that the cloud mixed-flow service processes the enhanced audio data and the high-definition video data according to the received operation information input by the cloud director terminal to obtain the target streaming media data.
3. The method of claim 2, wherein the audio enhancing the aligned audio data to obtain enhanced audio data comprises:
overlapping the aligned audio data corresponding to each code stream to obtain overlapped audio data;
and carrying out noise filtration on the superposed audio data to obtain the enhanced audio data.
4. The method according to claim 1, wherein the high frequency ultrasound signals are transmitted in a plurality of cycles, the transmission time intervals between the high frequency ultrasound signals in each cycle constituting an arithmetic progression; the tolerance of the series of equal differences is determined according to the periodic sequence of the cycles.
5. The method of claim 4, wherein determining the tolerance of the series of arithmetic numbers according to the periodic sequence of cycles comprises:
the arithmetic progression of periods with a period order m is shown as
Wherein the content of the first and second substances,
d0＝0，dm＝dm -1+1，dmand for the tolerance of the arithmetic progression, k represents the kth term in the arithmetic progression, m and k are positive integers, and m and k are updated according to the value of the last term of the arithmetic progression and/or the length of the arithmetic progression.
6. The method according to claim 5, wherein the aligning the audio data corresponding to each of the code streams according to the high-frequency ultrasonic signal to obtain aligned audio data corresponding to each of the code streams comprises:
carrying out high-pass filtering on the audio data to obtain filtered audio data;
sampling and screening the filtered audio data to obtain a plurality of adjacent effective mark points on a time axis;
determining the corresponding periodic sequence of the effective marking points according to the time intervals among the effective marking points;
determining an actual transmission time interval of the high frequency signal;
determining the time stamp of the audio data corresponding to each path of code stream according to the actual emission time interval and the periodic sequence corresponding to the effective marking point;
and aligning the audio data according to the time stamp to obtain the aligned audio data.
7. The method of claim 6, wherein the determining the time stamp of the audio data corresponding to each of the code streams according to the actual transmission time interval and the periodic sequence corresponding to the valid mark point comprises:
determining the starting time t of a period of the order m according tom0：
Wherein x is a positive integer, and n is a length threshold of the arithmetic progression; the array length threshold is used for iteratively updating the m and the k;
determining the timestamp t according to the following formula;
wherein the content of the first and second substances,
is the actual transmission time interval; d ═ d1+m*1。
8. A director apparatus, the apparatus comprising:
the determining module is used for determining audio data and video data corresponding to the multi-path code streams respectively; the audio data carries high-frequency ultrasonic signals;
the alignment module is used for aligning the audio data according to the high-frequency ultrasonic signal to obtain aligned audio data;
the synchronization module is used for synchronizing the video data according to the aligned audio data to obtain synchronized video data;
and the display module is used for generating target streaming media data according to the operation information, the aligned audio data and the synchronized video data.
9. A director device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is configured to store at least one executable instruction that causes the processor to perform the operations of the method of directing as recited in any one of claims 1-7.
10. A computer-readable storage medium having stored therein at least one executable instruction that, when executed on a director device, causes the director device to perform operations of the director method as recited in any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111669019.1A CN114339302B (en) | 2021-12-31 | 2021-12-31 | Method, device, equipment and computer storage medium for guiding broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111669019.1A CN114339302B (en) | 2021-12-31 | 2021-12-31 | Method, device, equipment and computer storage medium for guiding broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114339302A true CN114339302A (en) | 2022-04-12 |
| CN114339302B CN114339302B (en) | 2024-05-07 |
Family
ID=81021438
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111669019.1A Active CN114339302B (en) | 2021-12-31 | 2021-12-31 | Method, device, equipment and computer storage medium for guiding broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339302B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114679618A (en) * | 2022-05-27 | 2022-06-28 | 成都有为财商教育科技有限公司 | Method and system for receiving streaming media data |
| JP7469525B1 (en) | 2023-01-10 | 2024-04-16 | ソフトバンク株式会社 | Time adjustment system, terminal device, and server device |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101040520A (en) * | 2004-10-13 | 2007-09-19 | 皇家飞利浦电子股份有限公司 | Method of and system for synchronizing playback of audio/video signals |
| US20150325269A1 (en) * | 2014-05-08 | 2015-11-12 | Mewt Limited | Synchronisation of Audio and Video Playback |
| US20150326911A1 (en) * | 2014-05-08 | 2015-11-12 | Mewt Limited | Synchronisation of Audio and Video Playback |
| WO2017071670A1 (en) * | 2015-10-30 | 2017-05-04 | 中兴通讯股份有限公司 | Audio and video synchronization method, device and system |
| CN107197317A (en) * | 2017-06-06 | 2017-09-22 | 深圳市米亚印乐科技有限公司 | The live broadcasting method and system of LAN multiple signals |
| CN107613358A (en) * | 2017-10-26 | 2018-01-19 | 成都优购科技有限公司 | Avoid image and the nonsynchronous video system of sound |
| WO2019226760A1 (en) * | 2018-05-24 | 2019-11-28 | Google Llc | Methods, systems, and media for synchronizing audio and video content on multiple media devices |
| US20200084342A1 (en) * | 2018-09-12 | 2020-03-12 | Roku, Inc. | Dynamically adjusting video to improve synchronization with audio |
| US20200169767A1 (en) * | 2018-11-27 | 2020-05-28 | Peter Hackes | Systems, Methods And Computer Program Products For Delivering Audio And Video Data Through Multiplexed Data Streams |
| CN112235597A (en) * | 2020-09-17 | 2021-01-15 | 深圳市捷视飞通科技股份有限公司 | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment |
| CN112351294A (en) * | 2020-10-27 | 2021-02-09 | 广州赞赏信息科技有限公司 | Method and system for frame synchronization among multiple machine positions of cloud director |
| CN112770122A (en) * | 2020-12-31 | 2021-05-07 | 上海网达软件股份有限公司 | Method and system for synchronizing videos on cloud director |
| CN112995708A (en) * | 2021-04-21 | 2021-06-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Multi-video synchronization method and device |
| CN113038220A (en) * | 2019-12-25 | 2021-06-25 | 中国电信股份有限公司 | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium |
| CN113225598A (en) * | 2021-05-07 | 2021-08-06 | 上海一谈网络科技有限公司 | Method, device and equipment for synchronizing audio and video of mobile terminal and storage medium |
| CN113271313A (en) * | 2021-04-20 | 2021-08-17 | 北京国际云转播科技有限公司 | Cloud director system, scheduling method, storage medium and multimedia scheduling server |
| CN113411647A (en) * | 2021-04-20 | 2021-09-17 | 北京国际云转播科技有限公司 | Cloud director method, system, server and computer readable storage medium |
| CN113453086A (en) * | 2021-03-29 | 2021-09-28 | 北京国际云转播科技有限公司 | Multi-machine-position synchronous cloud broadcasting guiding method, system, storage medium and video encoder |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2590889A (en) * | 2019-08-13 | 2021-07-14 | Sounderx Ltd | Media system and method of generating media content |
-
2021
- 2021-12-31 CN CN202111669019.1A patent/CN114339302B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101040520A (en) * | 2004-10-13 | 2007-09-19 | 皇家飞利浦电子股份有限公司 | Method of and system for synchronizing playback of audio/video signals |
| US20150325269A1 (en) * | 2014-05-08 | 2015-11-12 | Mewt Limited | Synchronisation of Audio and Video Playback |
| US20150326911A1 (en) * | 2014-05-08 | 2015-11-12 | Mewt Limited | Synchronisation of Audio and Video Playback |
| WO2017071670A1 (en) * | 2015-10-30 | 2017-05-04 | 中兴通讯股份有限公司 | Audio and video synchronization method, device and system |
| CN107197317A (en) * | 2017-06-06 | 2017-09-22 | 深圳市米亚印乐科技有限公司 | The live broadcasting method and system of LAN multiple signals |
| CN107613358A (en) * | 2017-10-26 | 2018-01-19 | 成都优购科技有限公司 | Avoid image and the nonsynchronous video system of sound |
| WO2019226760A1 (en) * | 2018-05-24 | 2019-11-28 | Google Llc | Methods, systems, and media for synchronizing audio and video content on multiple media devices |
| US20200084342A1 (en) * | 2018-09-12 | 2020-03-12 | Roku, Inc. | Dynamically adjusting video to improve synchronization with audio |
| US20200169767A1 (en) * | 2018-11-27 | 2020-05-28 | Peter Hackes | Systems, Methods And Computer Program Products For Delivering Audio And Video Data Through Multiplexed Data Streams |
| CN113038220A (en) * | 2019-12-25 | 2021-06-25 | 中国电信股份有限公司 | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium |
| CN112235597A (en) * | 2020-09-17 | 2021-01-15 | 深圳市捷视飞通科技股份有限公司 | Method and device for synchronous protection of streaming media live broadcast audio and video and computer equipment |
| CN112351294A (en) * | 2020-10-27 | 2021-02-09 | 广州赞赏信息科技有限公司 | Method and system for frame synchronization among multiple machine positions of cloud director |
| CN112770122A (en) * | 2020-12-31 | 2021-05-07 | 上海网达软件股份有限公司 | Method and system for synchronizing videos on cloud director |
| CN113453086A (en) * | 2021-03-29 | 2021-09-28 | 北京国际云转播科技有限公司 | Multi-machine-position synchronous cloud broadcasting guiding method, system, storage medium and video encoder |
| CN113271313A (en) * | 2021-04-20 | 2021-08-17 | 北京国际云转播科技有限公司 | Cloud director system, scheduling method, storage medium and multimedia scheduling server |
| CN113411647A (en) * | 2021-04-20 | 2021-09-17 | 北京国际云转播科技有限公司 | Cloud director method, system, server and computer readable storage medium |
| CN112995708A (en) * | 2021-04-21 | 2021-06-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Multi-video synchronization method and device |
| CN113225598A (en) * | 2021-05-07 | 2021-08-06 | 上海一谈网络科技有限公司 | Method, device and equipment for synchronizing audio and video of mobile terminal and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114679618A (en) * | 2022-05-27 | 2022-06-28 | 成都有为财商教育科技有限公司 | Method and system for receiving streaming media data |
| CN114679618B (en) * | 2022-05-27 | 2022-08-02 | 成都有为财商教育科技有限公司 | Method and system for receiving streaming media data |
| JP7469525B1 (en) | 2023-01-10 | 2024-04-16 | ソフトバンク株式会社 | Time adjustment system, terminal device, and server device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114339302B (en) | 2024-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6629774B2 (en) | Interactive method and apparatus applied to live distribution | |
| US7839434B2 (en) | Video communication systems and methods | |
| CN114339302B (en) | Method, device, equipment and computer storage medium for guiding broadcast | |
| CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| CN105611481A (en) | Man-machine interaction method and system based on space voices | |
| JP2023519422A (en) | AUDIO PROCESSING METHOD, DEVICE, READABLE MEDIUM AND ELECTRONIC DEVICE | |
| WO2022012231A1 (en) | Video generation method and apparatus, and readable medium and electronic device | |
| JP6471418B2 (en) | Image / sound distribution system, image / sound distribution device, and image / sound distribution program | |
| WO2021213008A1 (en) | Video sound and picture matching method, related device and storage medium | |
| WO2023279793A1 (en) | Video playing method and apparatus | |
| WO2023040749A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN114845004B (en) | Audio and video synchronization implementation method and acoustic imaging method | |
| US11871137B2 (en) | Method and apparatus for converting picture into video, and device and storage medium | |
| CN114095671A (en) | Cloud conference live broadcast system, method, device, equipment and medium | |
| CN113992926B (en) | Interface display method, device, electronic equipment and storage medium | |
| CN108320331B (en) | Method and equipment for generating augmented reality video information of user scene | |
| CN112785669A (en) | Virtual image synthesis method, device, equipment and storage medium | |
| WO2023165390A1 (en) | Zoom special effect generating method and apparatus, device, and storage medium | |
| CN108833825B (en) | Method, device, equipment and storage medium for determining speaker terminal in video conference | |
| CN113271474B (en) | Method, device, equipment and storage medium for testing streaming media server | |
| CN114125358A (en) | Cloud conference subtitle display method, system, device, electronic equipment and storage medium | |
| CN113225488B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN114827647A (en) | Live broadcast data generation method, device, equipment, medium and program product | |
| CN115086686A (en) | Video processing method and related device | |
| CN112887653A (en) | Information processing method and information processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |