CN112601132A - Audio and video file generation and acquisition time determination method and device and electronic equipment - Google Patents
Audio and video file generation and acquisition time determination method and device and electronic equipment Download PDFInfo
- Publication number
- CN112601132A CN112601132A CN202011429847.3A CN202011429847A CN112601132A CN 112601132 A CN112601132 A CN 112601132A CN 202011429847 A CN202011429847 A CN 202011429847A CN 112601132 A CN112601132 A CN 112601132A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- acquisition
- video file
- clock signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000004891 communication Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 10
- 238000005070 sampling Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 abstract description 13
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a method and a device for determining generation and acquisition moments of an audio and video file and electronic equipment, and is applied to the technical field of audio and video processing. The method is applied to audio and video acquisition equipment, and comprises the following steps: receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device; collecting audio and video data; generating an audio and video file carrying audio and video clock information and audio and video data, wherein the audio and video clock information is as follows: and determining clock information based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting audio and video data. By the scheme, a foundation can be provided for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information.
Description
Technical Field
The invention relates to the technical field of audio and video processing, in particular to a method and a device for determining generation and acquisition moments of audio and video files and electronic equipment.
Background
In recent years, large-scale real person show comprehensive art programs are increasingly exploded, and when the real person show comprehensive art programs are recorded, a plurality of audio and video acquisition devices are often required to simultaneously acquire audio and video of a comprehensive scene, for example, in a comprehensive program recording site, a first audio and video acquisition device is responsible for acquiring audio and video of a role A, a second audio and video acquisition device is responsible for acquiring audio and video of a role B, and a third audio and video acquisition device is responsible for acquiring audio and video of a role C.
The inventor finds that the prior art at least has the following problems in the process of implementing the invention:
due to the difference of internal clocks of the audio and video acquisition devices and the difficulty that the audio and video acquisition devices start to acquire audio and video at the same time, the audio and video files acquired by the audio and video acquisition devices are difficult to align when programs are manufactured at the later stage.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a device for generating and determining an audio/video file and an electronic device, so as to align the audio/video files acquired by the audio/video acquisition devices conveniently. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides an audio/video file generation method, which is applied to an audio/video acquisition device, and the method includes:
receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device;
collecting audio and video data;
generating an audio and video file carrying audio and video clock information and the audio and video data, wherein the audio and video clock information is as follows: and clock information determined based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting the audio and video data.
Optionally, the receiving of the unified clock signal that is input from the outside and is sent to each audio/video acquisition device includes:
and receiving a unified clock signal input by a timing device which is connected with the audio and video acquisition device, wherein the timing device connected with each audio and video acquisition device is a timing device calibrated by the same clock.
Optionally, the unified clock signal is a sound wave signal;
the generating of the audio and video file carrying the audio and video clock information and the audio and video data comprises the following steps:
generating a path of audio track based on the sound wave signals received in the target time period;
and constructing an audio and video file carrying the audio track and the audio and video data.
Optionally, the unified clock signal is generated by encoding a timestamp according to a preset time encoding algorithm;
the generating of the audio and video file carrying the audio and video clock information and the audio and video data comprises the following steps:
decoding the initial clock signal according to a preset time decoding algorithm to obtain a timestamp for encoding and generating the initial clock signal as initial clock information of the audio and video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm;
and generating an audio and video file based on the audio and video data, and adding the initial clock information in the metadata of the generated audio and video file.
In a second aspect, an embodiment of the present invention provides a method for determining an audio/video file acquisition time, including:
acquiring an audio and video file, wherein the audio and video file carries audio and video clock information and audio and video data, the audio and video clock information is determined based on a unified clock signal acquired by audio and video acquisition equipment in a target time period, the target time period is a time period for the audio and video acquisition equipment to acquire the audio and video data, and the unified clock signal is a clock signal which is input externally and is sent to each audio and video acquisition equipment;
and determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file.
Optionally, the unified clock signal is a sound wave signal, the audio/video clock information is a track of the audio/video file, and the track of the audio/video file is generated based on the sound wave signal received by the audio/video acquisition device in the target time period;
the determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file comprises the following steps:
and determining a signal with the same playing time as the audio and video frame in the sound wave signals aiming at the audio and video frames contained in the audio and video file, and restoring clock information represented by the signal with the same playing time as the audio and video frame to be used as the acquisition time of the audio and video frame.
Optionally, the audio/video clock information is: the audio and video acquisition equipment comprises audio and video files and a plurality of pieces of audio and video data, wherein the audio and video files are stored in metadata of the audio and video files, the audio and video data are acquired by the audio and video files, the audio and video files are stored in the metadata of the audio and video files, the audio and video data are acquired by the audio and video acquisition equipment, and the audio and video files are stored in the metadata of the audio and video files;
the determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file comprises the following steps:
and aiming at the audio and video frames contained in the audio and video file, calculating the difference value of the acquisition time between the audio and video frames and the initial audio and video frames based on the frame difference between the audio and video frames and the initial audio and video frames of the audio and video file, adding the initial acquisition time represented by the initial clock information and the difference value, and calculating the acquisition time of the audio and video frames.
Optionally, the method further includes: aiming at a plurality of audio and video files which are collected by each audio and video collecting device and have determined sampling time, the audio and video files collected by the same audio and video collecting device are arranged on the same alignment track according to the size of the collecting time determined by each audio and video file, and the audio and video files collected by different audio and video collecting devices are arranged on different alignment tracks so as to align the plurality of audio and video files.
In a third aspect, an embodiment of the present invention provides an audio/video file generating device, which is applied to an audio/video acquisition device, and the device includes:
the signal receiving module is used for receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device;
the audio and video data acquisition module is used for acquiring audio and video data;
the audio and video file generating module is used for generating an audio and video file carrying audio and video clock information and the audio and video data, wherein the audio and video clock information is as follows: and clock information determined based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting the audio and video data.
Optionally, the signal receiving module is specifically configured to receive a unified clock signal input by a timing device that is already connected to the audio/video acquisition device, where the timing device that is connected to each audio/video acquisition device is a timing device calibrated by a same clock.
Optionally, the unified clock signal is a sound wave signal;
the audio/video file generation module is specifically used for generating a path of audio track based on the sound wave signal received in the target time period; and constructing an audio and video file carrying the audio track and the audio and video data.
Optionally, the unified clock signal is generated by encoding a timestamp according to a preset time encoding algorithm;
the audio and video file generation module is specifically used for decoding the initial clock signal according to a preset time decoding algorithm to obtain a timestamp for encoding and generating the initial clock signal, and the timestamp is used as initial clock information of the audio and video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm; and generating an audio and video file based on the audio and video data, and adding the initial clock information in the metadata of the generated audio and video file.
In a fourth aspect, an embodiment of the present invention provides an apparatus for determining an audio/video file acquisition time, including:
the audio and video file acquisition module is used for acquiring an audio and video file, wherein the audio and video file carries audio and video clock information and audio and video data, the audio and video clock information is determined based on a unified clock signal acquired by audio and video acquisition equipment in a target time period, the target time period is a time period for the audio and video acquisition equipment to acquire the audio and video data, and the unified clock signal is a clock signal which is input externally and is sent to each audio and video acquisition equipment;
and the acquisition time determining module is used for determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file.
Optionally, the unified clock signal is a sound wave signal, the audio/video clock information is a track of the audio/video file, and the track of the audio/video file is generated based on the sound wave signal received by the audio/video acquisition device in the target time period;
the acquisition time determining module is specifically configured to determine, for an audio/video frame included in the audio/video file, a signal in the sound wave signal that has the same playing time as the audio/video frame, and restore clock information represented by the signal that has the same playing time as the audio/video frame as the acquisition time of the audio/video frame.
Optionally, the audio/video clock information is: the audio and video acquisition equipment comprises audio and video files and a plurality of pieces of audio and video data, wherein the audio and video files are stored in metadata of the audio and video files, the audio and video data are acquired by the audio and video files, the audio and video files are stored in the metadata of the audio and video files, the audio and video data are acquired by the audio and video acquisition equipment, and the audio and video files are stored in the metadata of the audio and video files;
the acquisition time determining module is specifically configured to calculate, for an audio/video frame included in the audio/video file, a difference between an initial audio/video frame of the audio/video file and an acquisition time of the initial audio/video frame based on a frame difference between the audio/video frame and the initial audio/video frame, add the initial acquisition time indicated by the initial clock information to the difference, and calculate the acquisition time of the audio/video frame.
Optionally, the apparatus further comprises: and the audio and video file alignment module is used for arranging the audio and video files acquired by the same audio and video acquisition equipment in the same alignment track according to the size of the acquisition time determined by each audio and video file for a plurality of audio and video files acquired by each audio and video acquisition equipment and having determined sampling time, and arranging the audio and video files acquired by different audio and video acquisition equipment in different alignment tracks so as to align the plurality of audio and video files.
In a fifth aspect, the present invention further provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing any one of the steps of the audio and video file generation method or the audio and video file acquisition time determination method when executing the program stored in the memory.
In a sixth aspect, the present invention further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on a computer, the computer is enabled to execute any one of the above audio/video file generation method or the above audio/video file acquisition time determination method.
In a seventh aspect, the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute any one of the above audio/video file generation method or the above audio/video file acquisition time determination method.
The audio and video file generation method applied to the audio and video acquisition equipment provided by the embodiment of the invention receives a unified clock signal which is input from the outside and is sent to each audio and video acquisition equipment; collecting audio and video data; generating an audio and video file carrying audio and video clock information and audio and video data, wherein the audio and video clock information is as follows: and determining clock information based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting audio and video data. The audio and video acquisition equipment receives the unified clock signals sent to the audio and video acquisition equipment, so that the audio and video acquisition equipment has the same unified clock signals, and the audio and video clock information carried by the audio and video files acquired by the audio and video acquisition equipment is the same, thereby providing a foundation for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a schematic structural diagram of an audio/video file processing system provided in an embodiment of the present invention;
fig. 2 is a schematic flow chart of an audio/video file generation method provided in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another audio-video file processing system provided in the embodiment of the present invention;
fig. 4 is a schematic flow chart of a method for determining an audio/video file acquisition time provided in an embodiment of the present invention;
fig. 5 is a schematic flow chart of another method for determining an audio/video file acquisition time provided in the embodiment of the present invention;
fig. 6 is a schematic structural diagram of an audio/video file generating apparatus provided in an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an apparatus for determining an audio/video file acquisition time provided in an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device provided in an embodiment of the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to clearly illustrate the technical scheme of the embodiment of the invention, firstly, the embodiment of the invention is simply introduced on the whole, and from the perspective of a data processing flow, firstly, audio and video files of shooting scenes such as activities, programs and the like are collected and generated through a plurality of audio and video collecting devices, secondly, the audio and video files collected and generated by the audio and video collecting devices are clipped to obtain audio and video programs for playing, wherein in the process of clipping the audio and video files, the alignment of the collecting time of the audio and video files is involved.
From the perspective of the device, as shown in fig. 1, a schematic diagram of a structure diagram of an audio/video file processing system provided in an embodiment of the present invention includes an audio/video file acquisition system and an audio/video file processing device, where the audio/video file acquisition system is responsible for acquisition of audio/video files and includes a plurality of audio/video acquisition devices and an external clock, in brief, the external clock provides a unified clock signal for the plurality of audio/video acquisition devices of the audio/video file acquisition system, and the audio/video acquisition devices generate an audio/video file carrying audio/video clock information and audio/video data determined according to the unified clock signal based on acquired audio/video data and a received unified clock signal. After the acquisition is finished, the audio and video files generated by the audio and video acquisition equipment are filed in the audio and video file processing equipment, and the acquisition time of audio and video frames in the audio and video files can be determined based on audio and video clock information carried in the audio and video files. Therefore, the audio and video files can be aligned further according to the acquisition time of the audio and video frames in the audio and video files, namely, through the technical scheme disclosed by the embodiment of the invention, a basis is provided for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information, so that the audio and video files acquired by the audio and video acquisition equipment are aligned.
The following respectively describes the method, apparatus, electronic device and readable storage medium for generating and determining the acquisition time of the audio/video file disclosed in the embodiments of the present invention.
As shown in fig. 2, which is a flowchart of an audio/video file generation method provided in an embodiment of the present invention, the method may be applied to an audio/video acquisition device, and includes the following steps:
s201: and receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device.
S202: and audio and video data are collected.
S203: generating an audio and video file carrying audio and video clock information and audio and video data, wherein the audio and video clock information is as follows: and determining clock information based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting audio and video data.
By adopting the audio and video file generation method shown in fig. 2, because the audio and video acquisition devices receive the unified clock signals sent to the audio and video acquisition devices, the audio and video acquisition devices have the same unified clock signals, and further the audio and video clock information carried by the audio and video files acquired by the audio and video acquisition devices is the same, so that a foundation is provided for aligning the audio and video files acquired by the audio and video acquisition devices according to the audio and video clock information.
Optionally, the audio/video capture device may be a camera.
In combination with the audio/video file acquisition system in the audio/video file processing system shown in fig. 1, the unified clock signal referred to in step S201 may be generated with respect to an external clock other than the audio/video acquisition device. As is well known to those skilled in the art, in the prior art, when the audio/video device collects audio/video, the modes of recording time information of the audio/video device can be divided into two types, including free running timing and moving running timing, wherein the free running timing and the continuous timing by the self-timing device are performed, and the timing device also performs timing all the time when the audio/video collecting device is not powered on. And the movement running timing starts from the audio and video acquisition at each time and starts from 00 point 00 min 00 s. Due to the influences of factors such as configuration, equipment aging and environment, the recording time of the multiple audio and video acquisition devices is difficult to ensure to be the same. Therefore, the audio and video files collected by the audio and video collecting devices are difficult to align in the post-processing process. In the embodiment of the invention, the consistency of the recording time of each audio and video acquisition device can be realized by the unified clock signal sent to each audio and video acquisition device.
The unified clock signal sent to each audio and video acquisition device can be sent by an external clock of the audio and video acquisition device, and the external clock can be an independent timing device or a timing system consisting of a plurality of timing devices. If the external clock is an independent timing device, the external clock can be a clock device which can be communicated with a plurality of audio and video acquisition devices simultaneously. The external clock may also be a timing system consisting of a plurality of timing devices.
As shown in fig. 3, which is a schematic structural diagram of another audio/video file processing system according to an embodiment of the present invention, each audio/video capture device is connected to a timing device. And each timing device is time-synchronized with the parent timing device, so that the clock information of the parent timing device is synchronized to each timing device, and clock calibration is realized. The master timing device is a device for performing clock correction on the timing device. The clock calibration is carried out on each timing device by the mother timing device and the mother timing device. Therefore, the clock signals output by the respective timing devices will be consistent, and at this time, step S201 can be specifically implemented as follows:
and receiving a unified clock signal input by a timing device which is connected with the audio and video acquisition devices, wherein the timing device connected with each audio and video acquisition device is a timing device calibrated by the same clock.
The timing device may be a time code device.
In an embodiment, the received unified clock signal may be different based on an external Interface or a different communication mode of the audio/video acquisition device, and optionally, when the audio/video acquisition device has an SDI (Serial Digital Interface), the unified clock signal may be received through the SDI Interface of the audio/video acquisition device. When the audio/video acquisition device does not have an SDI interface and only has an audio input/output interface, the unified clock signal can be received through the audio input/output interface, and optionally, the format of the unified clock signal is matched with the interface for receiving the signal.
In an embodiment, when the unified clock signal is a sound wave signal, the step S203 may be specifically implemented as follows:
generating a path of audio track based on the sound wave signals received in the target time period; and constructing an audio and video file carrying audio track and audio and video data.
For example, the time period for receiving the unified clock signal by the audio/video acquisition device is 1 point to 10 points, the time period for acquiring the audio/video data is 2 points to 3 points, and the target time period is 2 points to 3 points.
The sound wave signal is a signal which is input to the audio and video acquisition equipment by the time code device through an audio input/output interface of the audio and video acquisition equipment. A simple way for the time code device to output the acoustic wave signal is: the time code device comprises a clock module and a conversion module, wherein the clock module is used for sending a time stamp to the conversion module, and the conversion module outputs different audio currents with different levels based on the numerical values of characters in character strings forming the time stamp, namely, the audio signals are the sound wave signals output by the time code device. Briefly explaining the implementation principle, if the current time is 12, the corresponding timestamp is 0110, and after the 0110 is input to the conversion module, the current with the level varying from low to high to low is output, that is, the output current can carry clock information through the level variation.
The sound wave signal is received through the audio and video input/output interface, so that the sound wave signal received indirectly by the audio and video acquisition equipment is processed as an externally input audio signal, and the audio and video acquisition equipment can take the received sound wave signal as one audio track of an audio and video file, namely the audio and video acquisition equipment converts the received sound wave signal into one audio data of the audio and video file. For example, the audio/video acquisition device includes two audio input/output interfaces, which are an interface a and an interface B, and when acquiring audio/video, the audio/video acquisition device connects to a microphone through the interface a to collect sound information of a shooting scene and stores the sound information as a path of audio data, which is denoted as audio data a.
In one embodiment, the unified clock signal is generated by encoding the timestamp according to a preset time encoding algorithm, and the preset time encoding algorithm may be set according to experience and requirements. For example, when the current time is 12, the corresponding timestamp is 0110, and the clock signals varying according to 0V, 5V, and 0V are obtained through a time coding algorithm.
When the unified clock signal is generated by encoding the timestamp according to a preset time encoding algorithm, the step S203 may be further implemented as follows:
decoding the initial clock signal according to a preset time decoding algorithm to obtain a timestamp for encoding and generating the initial clock signal as initial clock information of the audio and video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm;
and generating an audio and video file based on the audio and video data, and adding initial clock information in metadata of the generated audio and video file.
In the above implementation, the start clock signal is a unified clock signal received at the start time of the target time period. In one implementation, the unified clock signals received in the target time period may be obtained first, and then the most currently received unified clock signal is screened out from the unified clock signals received in the target time period to be used as the start clock signal.
Optionally, the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm, and when the time coding algorithm codes 12 hours into 0110, the time decoding algorithm may restore 0110 to 12 hours. Therefore, the starting clock signal is decoded according to a preset time decoding algorithm, and the timestamp for encoding and generating the starting clock signal can be obtained.
As known to those skilled in the art, metadata is data describing data, so that after an audio/video file is generated based on video data, the obtained start clock information can be written into the metadata of the audio/video file. Alternatively, the metadata may be Meta (metadata) information of the audio-video file.
In one embodiment, the method may be performed when the audio video capture device receives the unified external clock through the SDI interface.
Correspondingly, as shown in fig. 4, a flowchart of the method for determining the audio/video file acquisition time provided by the embodiment of the present invention includes the following steps:
s401: the method comprises the steps of obtaining an audio and video file, wherein the audio and video file carries audio and video clock information and audio and video data, the audio and video clock information is determined based on a unified clock signal collected by audio and video collection equipment in a target time period, the target time period is a time period for the audio and video collection equipment to collect the audio and video data, and the unified clock signal is a clock signal which is input externally and sent to each audio and video collection equipment.
S402: and determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file.
By adopting the method for determining the audio/video file acquisition time as shown in fig. 4, the acquired audio/video files carry audio/video clock information determined based on the unified clock information, and the unified clock signal is an externally input unified clock signal and is sent to each audio/video acquisition device, so that the time references of the audio/video clock information carried in each audio/video file are the same. Therefore, a foundation is provided for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information.
The obtained audio/video file may be an audio/video file generated by the audio/video file generation method provided by the embodiment of the present invention, and specifically, the generation method thereof has been described above, and is not described herein again.
Before the audio and video files are acquired, the audio and video files acquired by each audio and video acquisition device in the same audio and video file generation system need to be filed, that is, the audio and video files are transferred to audio and video processing devices from different memory cards according to the models and memory cards of the audio and video acquisition devices, so that the audio and video processing devices can process the audio and video files.
And aiming at the step S402, determining a mode of acquiring the audio and video frames contained in the audio and video file and a mode of carrying audio and video clock information in the audio and video file.
Optionally, in an embodiment, when the unified clock signal is a sound wave signal, the audio/video clock information is a track of the audio/video file, and the track of the audio/video file is generated based on the sound wave signal received by the audio/video acquisition device in the target time period, the step S402 may be implemented in the following manner:
and determining a signal with the same playing time as the audio and video frame in the sound wave signals aiming at the audio and video frames contained in the audio and video file, and restoring clock information represented by the signal with the same playing time as the audio and video frame to be used as the acquisition time of the audio and video frame.
As known to those skilled in the art, the sound wave signal received by the audio/video acquisition device is a continuous signal, and a frame difference exists between two adjacent audio/video frames in the audio/video file. Therefore, the signal with the same playing time as the audio and video frames in the sound wave signal is the signal corresponding to the audio and video frames in the frame difference in the sound wave signal. And further, the clock information represented by the signal can be restored to be used as the acquisition time of the audio and video frame.
Optionally, in another embodiment, when the audio/video clock information is: the method includes the steps that initial clock information of collected audio and video data recorded in metadata of an audio and video file is obtained by decoding an initial clock signal according to a preset time decoding algorithm, the obtained timestamp is used for encoding and generating the initial clock signal, the initial clock signal is a unified clock signal received by audio and video collection equipment at the initial moment of a target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time encoding algorithm, and the step S402 can be achieved in the following mode:
and aiming at the audio and video frames contained in the audio and video file, calculating the difference value of the acquisition time between the audio and video frames and the initial audio and video frames based on the frame difference between the audio and video frames and the initial audio and video frames of the audio and video file, adding the initial acquisition time represented by the initial clock information and the difference value, and calculating the acquisition time of the audio and video frames.
For each audio-video frame of the audio-video file, a frame difference between the frame and a starting audio-video frame can be determined based on frame information of the audio-video frame, for example, a frame difference between the audio-video frame and a starting audio-video frame time code is determined according to a frame sequence of each audio-video frame, for example, a difference between two adjacent audio-video frames is 1 frame, and a time interval between two adjacent audio-video frames is a fixed time interval, so that the frame difference and the fixed time interval can be multiplied, an obtained product is used as an acquisition time difference value of the audio-video frame, and the starting clock information is determined, so that the initial clock information and the acquisition time difference value can be added to obtain the acquisition time of the audio-video frame.
Further, as shown in fig. 5, a flowchart of a method for determining an audio/video file capture time according to another embodiment of the present invention further includes, after step S402, the following steps:
s403: aiming at a plurality of audio and video files which are collected by each audio and video collecting device and have determined sampling time, the audio and video files collected by the same audio and video collecting device are arranged on the same alignment track according to the size of the collecting time determined by each audio and video file, and the audio and video files collected by different audio and video collecting devices are arranged on different alignment tracks so as to align the plurality of audio and video files.
In this step, when aligning the audio/video files, the audio/video files may be divided according to the audio/video acquisition devices, and the audio/video files acquired by the same audio/video acquisition device are determined as a group.
When the audio and video files need to be aligned, non-editing software can be called to obtain the audio and video files under the folders, the non-editing software arranges the audio and video files under the same folder on the same alignment track, and the audio and video files acquired by the same audio and video acquisition equipment are arranged on the same alignment track according to the size of the acquisition time determined by each audio and video file. Further, the audio and video files under different files are arranged in different alignment tracks.
Illustratively, the audio and video file acquisition device 1 acquires the audio and video file 1a in 10 minutes to 8 minutes, the audio and video file 1b in 8 hours, the audio and video file 1b in 30 minutes to 8 minutes, the audio and video file 1c in 8 hours, the audio and video file acquisition device 2 acquires the audio and video file 2a in 8 hours, the audio and video file 2a in 15 minutes to 8 minutes, and the audio and video file 2b in 8 hours, the audio and video file acquisition device 20 minutes, the audio and video file acquisition device 10 minutes, the audio and video file acquisition device 2 minutes, the audio and. The audio and video file 1a, the audio and video file 1b, and the audio and video file 1c are arranged in the alignment track 1, and the audio and video file 2a and 2b are arranged in the alignment track 2 by the non-programmed software. Meanwhile, according to the acquisition time of the audio and video files, the audio and video file 1a is placed at the position where the alignment track 1 shows that the playing time is 0-10 minutes, the audio and video file 1b is placed at the position where the alignment track 1 shows that the playing time is 20-40 minutes, the audio and video file 1c is placed at the position where the alignment track 1 shows that the playing time is 40-60 minutes, the audio and video file 2a is placed at the position where the alignment track 2 shows that the playing time is 5-15 minutes, and the audio and video file 2b is placed at the position where the alignment track 2 shows that the playing time is 25-45 minutes.
By adopting the method for determining the audio and video file acquisition time as shown in fig. 5, the acquisition time of each audio and video file is aligned based on the acquisition time of the audio and video frames in the audio and video file, so that the acquisition time alignment of the audio and video frames in the audio and video file acquired by each audio and video acquisition device is conveniently realized.
In order to more clearly illustrate the technical solution of the present invention, the embodiment of the present invention further provides a specific embodiment combining service scenarios.
And the audio and video file acquisition equipment 1 and the audio and video file acquisition equipment 2 carry out audio and video acquisition. The time code device 1 is installed on the audio and video file acquisition equipment 1, the time code device 2 is installed on the audio and video file acquisition equipment 2, and the time code device 1 and the time code device 2 are calibrated by the same clock in advance. And the time code device 1 and the time code device 2 continuously send unified clock signals to the audio and video file acquisition equipment 1 and the audio and video file acquisition equipment 2 after installation. The audio and video file acquisition device 1 acquires first section of audio and video data in 10 minutes to 6 minutes and 20 minutes to generate an audio and video file 1, and acquires second section of audio and video data in 6 minutes, 30 minutes to 6 minutes and 40 minutes to generate an audio and video file 2. And the audio and video file acquisition device 2 acquires a third section of audio and video data in 25 minutes from 15 minutes to 6 minutes from 6 hours to generate an audio and video file 3, and acquires a fourth section of audio and video data in 45 minutes from 35 minutes to 6 hours from 6 hours to generate an audio and video file 4.
After the audio and video files are collected, the audio and video files 1 and the audio and video files 2 collected by the audio and video collecting device 1 are stored in the folder 1, and the audio and video files 3 and the audio and video files 4 collected by the audio and video collecting device 2 are stored in the folder 2. The audio and video files 1 and the audio and video files 2 are arranged in the alignment track 1 through non-programmed software, and the audio and video files 3 and the audio and video files 4 are arranged in the alignment track 2. Meanwhile, according to the acquisition time of the audio and video file, the audio and video file 1 is placed at the position where the alignment track 1 shows that the playing time is 0-10 minutes, and the audio and video file 2 is placed at the position where the alignment track 1 shows that the playing time is 20-30 minutes. And placing the audio and video file 3 at a position where the alignment track 2 indicates that the playing time is 5-15 minutes, and placing the audio and video file 4 at a position where the alignment track 2 indicates that the playing time is 25-35 minutes.
Based on the same inventive concept, according to the audio and video file generation method applied to the audio and video acquisition device provided by the embodiment of the present invention, the embodiment of the present invention further provides an audio and video file device applied to the audio and video acquisition device, as shown in fig. 6, the device includes:
the signal receiving module 601 is configured to receive a unified clock signal that is input from the outside and is sent to each audio/video acquisition device;
an audio/video data acquisition module 602, configured to acquire audio/video data;
an audio/video file generating module 603, configured to generate an audio/video file carrying audio/video clock information and audio/video data, where the audio/video clock information is: and determining clock information based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting audio and video data.
Optionally, the signal receiving module 601 is specifically configured to receive a unified clock signal input by a timing device that is already connected to the audio and video acquisition devices, where the timing device that is connected to each audio and video acquisition device is a timing device calibrated by a same clock.
Optionally, the unified clock signal is a sound wave signal;
the audio/video file generating module 603 is specifically configured to generate a path of audio track based on the sound wave signal received in the target time period; and constructing an audio and video file carrying audio track and audio and video data.
Optionally, the unified clock signal is generated by encoding a timestamp according to a preset time encoding algorithm;
the audio/video file generating module 603 is specifically configured to decode the start clock signal according to a preset time decoding algorithm, and obtain a timestamp for encoding to generate the start clock signal, which is used as start clock information of the audio/video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm; and generating an audio and video file based on the audio and video data, and adding initial clock information in metadata of the generated audio and video file.
By adopting the audio/video file generation device shown in fig. 6, because the audio/video acquisition devices receive the uniform clock signals sent to the audio/video acquisition devices, the audio/video acquisition devices have the same uniform clock signals, and the audio/video clock information carried by the audio/video files acquired by the audio/video acquisition devices is the same, thereby providing a foundation for aligning the audio/video files acquired by the audio/video acquisition devices according to the audio/video clock information.
Based on the same inventive concept, according to the method for determining the audio/video file acquisition time provided by the embodiment of the present invention, an embodiment of the present invention further provides a device for determining the audio/video file acquisition time, as shown in fig. 7, the device includes:
the audio/video file acquisition module 701 is configured to acquire an audio/video file, where the audio/video file carries audio/video clock information and audio/video data, the audio/video clock information is clock information determined based on a unified clock signal acquired by an audio/video acquisition device in a target time period, the target time period is a time period in which the audio/video acquisition device acquires the audio/video data, and the unified clock signal is a clock signal that is externally input and is sent to each audio/video acquisition device;
the acquisition time determining module 702 is configured to determine acquisition times of audio and video frames included in the audio and video file based on audio and video clock information carried by the audio and video file.
Optionally, the unified clock signal is a sound wave signal, the audio/video clock information is a path of audio track of the audio/video file, and the path of audio track of the audio/video file is generated based on the sound wave signal received by the audio/video acquisition device in the target time period;
the acquisition time determining module 702 is specifically configured to determine, for an audio/video frame included in an audio/video file, a signal in a sound wave signal that has the same playing time as the audio/video frame, and restore clock information represented by the signal that has the same playing time as the audio/video frame as the acquisition time of the audio/video frame.
Optionally, the audio/video clock information is: the method comprises the steps that initial clock information of collected audio and video data is recorded in metadata of an audio and video file, the initial clock information is a timestamp used for coding and generating an initial clock signal by decoding the initial clock signal according to a preset time decoding algorithm, the initial clock signal is a unified clock signal received by audio and video collection equipment at the initial moment of a target time period, and the time decoding algorithm is a decoding algorithm corresponding to a time coding algorithm;
the acquisition time determining module 702 is specifically configured to calculate, for an audio/video frame included in an audio/video file, a difference between an acquisition time of the audio/video frame and an initial audio/video frame of the audio/video file based on a frame difference between the audio/video frame and the initial audio/video frame, add the initial acquisition time indicated by the initial clock information to the difference, and calculate the acquisition time of the audio/video frame.
Optionally, the apparatus further comprises: the audio/video file alignment module 703 is configured to, for a plurality of audio/video files that are acquired by each audio/video acquisition device and whose sampling time has been determined, arrange the audio/video files acquired by the same audio/video acquisition device in the same alignment track according to the size of the acquisition time determined by each audio/video file, and arrange the audio/video files acquired by different audio/video acquisition devices in different alignment tracks to align the plurality of audio/video files.
With the above apparatus for determining the audio/video file acquisition time as shown in fig. 7, the acquired audio/video file carries audio/video clock information determined based on the unified clock information, and the unified clock signal is an externally input unified clock signal and is sent to each audio/video acquisition device, so that the time references of the audio/video clock information carried in each audio/video file are the same. Therefore, a foundation is provided for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information.
An embodiment of the present invention further provides an electronic device, as shown in fig. 8, which includes a processor 801, a communication interface 802, a memory 803, and a communication bus 804, where the processor 801, the communication interface 802, and the memory 803 complete mutual communication through the communication bus 804,
a memory 803 for storing a computer program;
the processor 801 is configured to implement the audio/video file generation method or the audio/video file acquisition time determination method according to the embodiment of the present invention when executing the program stored in the memory 803.
With the electronic device shown in fig. 8, the acquired audio/video files carry audio/video clock information determined based on the unified clock information, and the unified clock signal is an externally input unified clock signal and is sent to each audio/video acquisition device, so that the time references of the audio/video clock information carried in each audio/video file are the same. Therefore, a foundation is provided for aligning the audio and video files acquired by the audio and video acquisition equipment according to the audio and video clock information.
It should be noted that other embodiments of the electronic device for generating the audio/video file or determining the acquisition time of the audio/video file are the same as the filtering methods mentioned in the foregoing method embodiments, and are not described herein again.
The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the terminal and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In another embodiment of the present invention, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are run on a computer, the computer is enabled to execute any one of the audio/video file generation method and the audio/video file acquisition time determination method in the foregoing embodiments.
In another embodiment of the present invention, a computer program product containing instructions is further provided, which when running on a computer, causes the computer to execute any one of the audio/video file generation method or the audio/video file acquisition time determination method in the foregoing embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the embodiments of the invention are brought about in whole or in part when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, the electronic device, the computer-readable storage medium, and the computer program product embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (18)
1. An audio and video file generation method is applied to audio and video acquisition equipment, and comprises the following steps:
receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device;
collecting audio and video data;
generating an audio and video file carrying audio and video clock information and the audio and video data, wherein the audio and video clock information is as follows: and clock information determined based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting the audio and video data.
2. The method according to claim 1, wherein the receiving of the unified clock signal inputted from the outside and transmitted to each audio/video capture device comprises:
and receiving a unified clock signal input by a timing device which is connected with the audio and video acquisition device, wherein the timing device connected with each audio and video acquisition device is a timing device calibrated by the same clock.
3. The method of claim 1,
the unified clock signal is a sound wave signal;
the generating of the audio and video file carrying the audio and video clock information and the audio and video data comprises the following steps:
generating a path of audio track based on the sound wave signals received in the target time period;
and constructing an audio and video file carrying the audio track and the audio and video data.
4. The method of claim 1, wherein the unified clock signal is generated by encoding timestamps according to a preset time encoding algorithm;
the generating of the audio and video file carrying the audio and video clock information and the audio and video data comprises the following steps:
decoding the initial clock signal according to a preset time decoding algorithm to obtain a timestamp for encoding and generating the initial clock signal as initial clock information of the audio and video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm;
and generating an audio and video file based on the audio and video data, and adding the initial clock information in the metadata of the generated audio and video file.
5. A method for determining the acquisition time of an audio/video file is characterized by comprising the following steps:
acquiring an audio and video file, wherein the audio and video file carries audio and video clock information and audio and video data, the audio and video clock information is determined based on a unified clock signal acquired by audio and video acquisition equipment in a target time period, the target time period is a time period for the audio and video acquisition equipment to acquire the audio and video data, and the unified clock signal is a clock signal which is input externally and is sent to each audio and video acquisition equipment;
and determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file.
6. The method of claim 5,
the unified clock signal is a sound wave signal, the audio and video clock information is one audio track of the audio and video file, and the one audio track of the audio and video file is generated based on the sound wave signal received by the audio and video acquisition equipment in the target time period;
the determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file comprises the following steps:
and determining a signal with the same playing time as the audio and video frame in the sound wave signals aiming at the audio and video frames contained in the audio and video file, and restoring clock information represented by the signal with the same playing time as the audio and video frame to be used as the acquisition time of the audio and video frame.
7. The method of claim 5,
the audio and video clock information is as follows: the audio and video acquisition equipment comprises audio and video files and a plurality of pieces of audio and video data, wherein the audio and video files are stored in metadata of the audio and video files, the audio and video data are acquired by the audio and video files, the audio and video files are stored in the metadata of the audio and video files, the audio and video data are acquired by the audio and video acquisition equipment, and the audio and video files are stored in the metadata of the audio and video files;
the determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file comprises the following steps:
and aiming at the audio and video frames contained in the audio and video file, calculating the difference value of the acquisition time between the audio and video frames and the initial audio and video frames based on the frame difference between the audio and video frames and the initial audio and video frames of the audio and video file, adding the initial acquisition time represented by the initial clock information and the difference value, and calculating the acquisition time of the audio and video frames.
8. The method according to any one of claims 5-7, further comprising:
aiming at a plurality of audio and video files which are collected by each audio and video collecting device and have determined sampling time, the audio and video files collected by the same audio and video collecting device are arranged on the same alignment track according to the size of the collecting time determined by each audio and video file, and the audio and video files collected by different audio and video collecting devices are arranged on different alignment tracks so as to align the plurality of audio and video files.
9. An audio/video file generation device is applied to audio/video acquisition equipment, and comprises:
the signal receiving module is used for receiving a unified clock signal which is input from the outside and is sent to each audio and video acquisition device;
the audio and video data acquisition module is used for acquiring audio and video data;
the audio and video file generating module is used for generating an audio and video file carrying audio and video clock information and the audio and video data, wherein the audio and video clock information is as follows: and clock information determined based on the collected unified clock signal in a target time period, wherein the target time period is a time period for collecting the audio and video data.
10. The apparatus according to claim 9, wherein the signal receiving module is specifically configured to receive a unified clock signal input by a timing device that has established connection with the audio/video acquisition devices, where the timing device that has established connection with each audio/video acquisition device is a timing device calibrated by a same clock.
11. The apparatus of claim 9,
the unified clock signal is a sound wave signal;
the audio/video file generation module is specifically used for generating a path of audio track based on the sound wave signal received in the target time period; and constructing an audio and video file carrying the audio track and the audio and video data.
12. The apparatus of claim 9, wherein the unified clock signal is generated by encoding timestamps according to a preset time encoding algorithm;
the audio and video file generation module is specifically used for decoding the initial clock signal according to a preset time decoding algorithm to obtain a timestamp for encoding and generating the initial clock signal, and the timestamp is used as initial clock information of the audio and video data; the starting clock signal is a unified clock signal received at the starting moment of the target time period, and the time decoding algorithm is a decoding algorithm corresponding to the time coding algorithm; and generating an audio and video file based on the audio and video data, and adding the initial clock information in the metadata of the generated audio and video file.
13. An audio/video file acquisition time determining device is characterized by comprising:
the audio and video file acquisition module is used for acquiring an audio and video file, wherein the audio and video file carries audio and video clock information and audio and video data, the audio and video clock information is determined based on a unified clock signal acquired by audio and video acquisition equipment in a target time period, the target time period is a time period for the audio and video acquisition equipment to acquire the audio and video data, and the unified clock signal is a clock signal which is input externally and is sent to each audio and video acquisition equipment;
and the acquisition time determining module is used for determining the acquisition time of the audio and video frames contained in the audio and video file based on the audio and video clock information carried by the audio and video file.
14. The apparatus of claim 13,
the unified clock signal is a sound wave signal, the audio and video clock information is one audio track of the audio and video file, and the one audio track of the audio and video file is generated based on the sound wave signal received by the audio and video acquisition equipment in the target time period;
the acquisition time determining module is specifically configured to determine, for an audio/video frame included in the audio/video file, a signal in the sound wave signal that has the same playing time as the audio/video frame, and restore clock information represented by the signal that has the same playing time as the audio/video frame as the acquisition time of the audio/video frame.
15. The apparatus of claim 13,
the audio and video clock information is as follows: the audio and video acquisition equipment comprises audio and video files and a plurality of pieces of audio and video data, wherein the audio and video files are stored in metadata of the audio and video files, the audio and video data are acquired by the audio and video files, the audio and video files are stored in the metadata of the audio and video files, the audio and video data are acquired by the audio and video acquisition equipment, and the audio and video files are stored in the metadata of the audio and video files;
the acquisition time determining module is specifically configured to calculate, for an audio/video frame included in the audio/video file, a difference between an initial audio/video frame of the audio/video file and an acquisition time of the initial audio/video frame based on a frame difference between the audio/video frame and the initial audio/video frame, add the initial acquisition time indicated by the initial clock information to the difference, and calculate the acquisition time of the audio/video frame.
16. The apparatus according to any one of claims 13-15, further comprising:
and the audio and video file alignment module is used for arranging the audio and video files acquired by the same audio and video acquisition equipment in the same alignment track according to the size of the acquisition time determined by each audio and video file for a plurality of audio and video files acquired by each audio and video acquisition equipment and having determined sampling time, and arranging the audio and video files acquired by different audio and video acquisition equipment in different alignment tracks so as to align the plurality of audio and video files.
17. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 4 or 5 to 8 when executing a program stored in the memory.
18. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 4 or 5 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011429847.3A CN112601132A (en) | 2020-12-07 | 2020-12-07 | Audio and video file generation and acquisition time determination method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011429847.3A CN112601132A (en) | 2020-12-07 | 2020-12-07 | Audio and video file generation and acquisition time determination method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112601132A true CN112601132A (en) | 2021-04-02 |
Family
ID=75191220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011429847.3A Pending CN112601132A (en) | 2020-12-07 | 2020-12-07 | Audio and video file generation and acquisition time determination method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112601132A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120287341A1 (en) * | 2009-12-04 | 2012-11-15 | Rd-Tek Co., Ltd. | System and method for synchronizing a video signal and a sensor signal |
| US20180176425A1 (en) * | 2016-12-21 | 2018-06-21 | Shanghai Xiaoyi Technology Co., Ltd. | Method and system for configuring cameras to capture images |
| CN110191368A (en) * | 2019-05-31 | 2019-08-30 | 北京奇艺世纪科技有限公司 | Video data acquiring and alignment schemes, device, electronic equipment and system |
| CN110933349A (en) * | 2019-11-19 | 2020-03-27 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN210781101U (en) * | 2019-09-30 | 2020-06-16 | 广州汽车集团股份有限公司 | Data acquisition device and data acquisition system |
| CN111447461A (en) * | 2020-05-20 | 2020-07-24 | 上海科技大学 | Synchronous switching method, device, equipment and medium for multi-view live video |
-
2020
- 2020-12-07 CN CN202011429847.3A patent/CN112601132A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120287341A1 (en) * | 2009-12-04 | 2012-11-15 | Rd-Tek Co., Ltd. | System and method for synchronizing a video signal and a sensor signal |
| US20180176425A1 (en) * | 2016-12-21 | 2018-06-21 | Shanghai Xiaoyi Technology Co., Ltd. | Method and system for configuring cameras to capture images |
| CN110191368A (en) * | 2019-05-31 | 2019-08-30 | 北京奇艺世纪科技有限公司 | Video data acquiring and alignment schemes, device, electronic equipment and system |
| CN210781101U (en) * | 2019-09-30 | 2020-06-16 | 广州汽车集团股份有限公司 | Data acquisition device and data acquisition system |
| CN110933349A (en) * | 2019-11-19 | 2020-03-27 | 北京奇艺世纪科技有限公司 | Audio data generation method, device and system and controller |
| CN111447461A (en) * | 2020-05-20 | 2020-07-24 | 上海科技大学 | Synchronous switching method, device, equipment and medium for multi-view live video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210058360A1 (en) | Watermarking and signal recognition for managing and sharing captured content, metadata discovery and related arrangements | |
| CN110674146B (en) | Data synchronization method, synchronization end, end to be synchronized, equipment and storage medium | |
| EP3171593B1 (en) | Testing system and method | |
| CN105009118A (en) | Customized content consumption interface | |
| CN110267083B (en) | Audio and video synchronization detection method, device, equipment and storage medium | |
| CN110830823B (en) | Play progress correction method and device, electronic equipment and readable storage medium | |
| US9300997B2 (en) | Consumption likelihood of linear content streams | |
| CN109600665B (en) | Method and apparatus for processing data | |
| CN106713011A (en) | Method and system for obtaining test data | |
| CN107371053B (en) | Audio and video stream contrast analysis method and device | |
| CN104506661B (en) | A kind of mobile telephone power consumption automatic production generation method based on usage scenario of Remote configuration | |
| CN112004133A (en) | Sound and picture synchronization method and device, projection equipment and readable storage medium | |
| CN103442270A (en) | Method and device for acquiring viewing data of user | |
| CN113824987B (en) | Method, medium, device and computing equipment for determining time consumption of first frame of live broadcasting room | |
| CN106507172B (en) | Information coding method, coding/decoding method and device | |
| CN110933349B (en) | Audio data generation method, device and system and controller | |
| CN111698529B (en) | Live broadcast monitoring method, device, equipment and computer readable storage medium | |
| CN110896464B (en) | Audio data generation method, device and system and controller | |
| CN113992926A (en) | Interface display method and device, electronic equipment and storage medium | |
| CN109147821A (en) | Intelligent terminal audio-frequency detection, electronic device and computer readable storage medium | |
| CN112601132A (en) | Audio and video file generation and acquisition time determination method and device and electronic equipment | |
| CN111198853A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN112995699B (en) | Online live broadcast method, live broadcast equipment, live broadcast system and electronic equipment | |
| JP2016092772A (en) | Signal processor and signal processing method and program thereof | |
| CN111797060B (en) | Offline video recording method, device and equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210402 |