CN114222083A - Method and device for multi-channel audio, video and radar mixed synchronous playback - Google Patents
Method and device for multi-channel audio, video and radar mixed synchronous playback Download PDFInfo
- Publication number
- CN114222083A CN114222083A CN202111418731.4A CN202111418731A CN114222083A CN 114222083 A CN114222083 A CN 114222083A CN 202111418731 A CN202111418731 A CN 202111418731A CN 114222083 A CN114222083 A CN 114222083A
- Authority
- CN
- China
- Prior art keywords
- data
- time
- time axis
- module
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/93—Regeneration of the television signal or of selected parts thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The application provides a method and a device for multi-channel audio, video and radar mixed synchronous playback, which relate to the field of scene monitoring and comprise the following steps: acquiring data to be processed, and storing the data according to a preset format to obtain first data; establishing a time array of data of each path according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis; and performing difference adjustment on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis. The application can realize the synchronous playback of multi-class data, and the whole process automation is carried out, so that the operation difficulty is reduced, the smoothness of the system is improved, the user-defined setting of the playback standard time is realized, the setting can be carried out according to the actual scene, and the practicability is improved.
Description
Technical Field
The application relates to the field of scene monitoring, in particular to a method and a device for multi-channel audio, video and radar mixed synchronous playback.
Background
The operation scene data source of each seat person comprises a plurality of different audio data sources and a plurality of different video data sources, including but not limited to the working scene (generally referred to as camera recording), one or more computer screen operations (generally referred to as screen recording), wire call, wireless call, radar data and other categories of the seat person; at present, data playback or multi-path synchronous playback in a general sense is to perform playback or multi-path synchronous playback on the same type of data, including operations such as play, pause, shift, jump and the like.
For some specific scenes, such as accident investigation, operation specification demonstration and the like, the mixed synchronous playback of the multiple paths of monitoring data of different types of the current scene is required to achieve the purpose of accurately restoring the current situation in the whole scene. Different types of data need respective playback systems to perform playback or multi-path synchronous playback on respective types of monitoring data, and multiple playback systems need to be opened for multi-type data playback, so that the operation is complicated; to achieve the time synchronization of the playback of the multi-class data, a plurality of playback systems need to be frequently operated for many times to control the playback progress of each system, and the operation difficulty is high; in the prior art, most of the multiple paths of video data are based on the playback time of one path of video data, and the other paths of video data are adjusted based on the playback time, so that the multiple paths of video data can be played back synchronously.
Disclosure of Invention
The application provides a method and a device for multi-channel audio, video and radar mixed synchronous playback, and aims to solve the problems that multi-class mixed synchronous playback cannot be realized, the operation is complex, the operation difficulty is high, and the playback standard time cannot be set by self definition.
In order to achieve the above object, the present application adopts the following technical solutions, including:
acquiring data to be processed, and storing the data according to a preset format to obtain first data, wherein the data to be processed comprises audio data, video data and radar data;
establishing a time array of data of each path according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
and performing difference adjustment on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis.
Preferably, the acquiring the data to be processed and storing the data according to a pre-format to obtain the first data includes:
generating a first file from the data to be processed according to the pre-format, and performing association setting on the first file and the information data to obtain second data, wherein the information data comprises a data source, scene description, data type, start time, duration and a data format;
and transmitting the second data to a database for storage to obtain the first data.
Preferably, the establishing of the time array of each path of data according to the first data and the preset information data to obtain a first time axis, and the establishing of the standard time array according to the time range of the preset information data to obtain a second time axis includes:
detecting the first data according to the preset information data to obtain a second file, and establishing a time array for the second file according to the starting time and the duration time associated with the second file according to the time sequence to obtain the first time axis;
and calculating according to the preset starting time and the preset duration time to obtain the time range, and establishing the standard time array according to the time range to obtain the second time axis.
Preferably, the performing difference adjustment on the first time axis according to a contrast analysis method with the second time axis as a reference so that each path of data is played back synchronously according to the second time axis includes:
judging whether the first time axis is matched or not according to the second time axis;
if not, time pause or time acceleration operation is carried out on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
An apparatus for multi-channel audio, video, and radar hybrid synchronous playback, comprising:
a data storage module: the device comprises a data processing module, a data processing module and a data processing module, wherein the data processing module is used for acquiring data to be processed, storing the data according to a preset format and obtaining first data, and the data to be processed comprises audio data, video data and radar data;
a time axis establishing module: the time domain setting module is used for establishing each path of data time array according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
a synchronous playback module: and the difference adjustment is carried out on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis.
Preferably, the data storage module includes:
a first data processing module: the system comprises a data processing module, a data storage module, a format conversion module and a format conversion module, wherein the data processing module is used for generating a first file from the data to be processed according to the pre-format and carrying out association setting on the first file and the information data to obtain second data;
the second data processing module: and the second data is transmitted to a database for storage to obtain the first data.
Preferably, the time axis establishing module includes:
a first time axis establishing module: the time array is used for detecting the first data according to the preset information data to obtain a second file, and establishing a time array for the second file according to the starting time and the duration time associated with the second file according to the time sequence to obtain the first time axis;
a second timeline establishing module: and the time range is calculated according to the preset starting time and the preset duration time, and the standard time array is established according to the time range to obtain the second time axis.
Preferably, the synchronized playback module includes:
a time matching judgment module: the judgment module is used for judging whether the first time axis is matched or not according to the second time axis;
a time adjustment module: and if not, performing time pause or time acceleration operation on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
An apparatus for multiple audio, video and radar mixed synchronous playback, comprising a memory and a processor, wherein the memory is used for storing one or more computer instructions, and the one or more computer instructions are executed by the processor to realize the multiple audio, video and radar mixed synchronous playback method.
A computer readable storage medium storing a computer program which, when executed by a computer, implements a method of multiple audio, video, radar mixed synchronous playback as described in any one of the above.
The invention has the following beneficial effects:
the technical scheme adopted by the application is that multi-channel audio data, multi-channel video data and multi-channel radar data are stored into different formats, data sources, scene description, data category, starting time, duration, data format and other information are associated with the respective corresponding data and then are jointly used as a unique record to be input into a database for storage, time axes corresponding to the respective data are constructed, then a standard time axis and other conditions such as data category and data sources are set according to the requirements of specific scenes, the corresponding data of different categories are searched from the database according to the set conditions, the time axes of the respective data are adjusted according to the set standard time axis, and finally the respective data can be played back according to the standard time axis, and the application can realize the synchronous playback of the multi-category data through the technical scheme, the whole process is carried out automatically, the operation can be finished automatically only by manually setting conditions according to actual needs, the operation is simple, the operation difficulty is reduced, the smoothness of the system is improved, the time axis of the playback is set according to actual scenes and is set in a self-defined mode, the problem that in the prior art, the standard time axis cannot be defined independently by taking the time axis of one path of data as standard time and adjusting other paths is solved, and the practicability of the playback of audio data, video data or radar data is improved; according to the technical scheme, when the time axes of all paths of data are constructed, information such as data categories and the like are correspondingly stored when the data are stored in the database, so that the same type of data can be integrated into a unified time axis according to the sequence of time when searching is carried out according to set conditions, data category errors can be avoided when synchronous playback is carried out, and the process is simpler, the efficiency is higher and the playback accuracy is higher when synchronous playback adjustment is carried out according to the standard time axis by constructing the time axes of all types.
Drawings
FIG. 1 is a flowchart of a method for implementing a multi-channel audio, video, and radar hybrid synchronous playback according to an embodiment of the present invention
FIG. 2 is a flowchart of a method for implementing a differential adjustment of a first time axis to enable synchronous playback according to an embodiment of the present invention
FIG. 3 is a schematic structural diagram of an apparatus for implementing multi-channel audio, video, and radar hybrid synchronous playback according to an embodiment of the present invention
FIG. 4 is a schematic structural diagram of a data storage module 10 in an apparatus for implementing multi-channel audio, video, and radar hybrid synchronous playback according to an embodiment of the present invention
FIG. 5 is a schematic structural diagram of a time axis establishing module 20 in an apparatus for implementing multi-channel audio, video, and radar mixed synchronous playback according to an embodiment of the present invention
FIG. 6 is a schematic structural diagram of a synchronous playback module 30 in an apparatus for implementing multi-channel audio, video, and radar mixed synchronous playback according to an embodiment of the present invention
FIG. 7 is a schematic diagram of an electronic device implementing an apparatus for multi-channel audio, video, and radar hybrid synchronous playback according to an embodiment of the present invention
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, rather than all embodiments, and all other embodiments obtained by those skilled in the art without any inventive work based on the embodiments of the present invention belong to the protection scope of the present invention.
The terms "first," "second," and the like in the claims and in the description of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order, it being understood that the terms so used are interchangeable under appropriate circumstances and are merely used to describe a distinguishing manner between similar elements in the embodiments of the present application and that the terms "comprising" and "having" and any variations thereof are intended to cover a non-exclusive inclusion such that a process, method, system, article, or apparatus that comprises a list of elements is not necessarily limited to those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs, and the terms used herein in the specification of the present application are for the purpose of describing particular embodiments only and are not intended to limit the present application.
Example 1
As shown in fig. 1, a method for multi-channel audio, video and radar mixed synchronous playback includes the following steps:
s11, acquiring data to be processed, and storing the data according to a preset format to obtain first data, wherein the data to be processed comprises audio data, video data and radar data;
s12, establishing a time array of each path of data according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
and S13, taking the second time axis as a reference, and performing difference adjustment on the first time axis according to a contrast analysis method to enable each path of data to be played back synchronously according to the second time axis.
In this embodiment, first, audio data and video data are obtained according to different devices, wherein camera video data is stored in a ts file in a common video packaging format, a computer screen operates videos to be stored in a pcf file in an EIZO (EIZO) video acquisition device private coding format, radar data adds a timestamp before each frame of radar data and exists in a rdd file in a radar data storage format of three sinks, voice data is stored in a general wav format or in an encryption manner of adding three sinks and then in a wav format, each of the files is collectively called a "first file" and is stored in a database as a record, and simultaneously "information data" such as a corresponding data source, a scene description, a data category, a start time, a duration, a data format and the like of the file are also written into corresponding fields of the record, i.e., "second data", the files and the information are associated and corresponded together to be stored in the database so as to facilitate data retrieval of subsequent application, after storage, "first data" is obtained, then information data such as data source, scene description, data category, starting time, duration, data format and the like are set according to actual scene requirements, the set data is "preset information data", then the first data stored in the database is detected and screened according to the preset information data, data meeting conditions are screened out, the screened data file is "second file", and one playback task in practice relates to playback of multiple paths of data, system software in the technical scheme of the application establishes an independent thread for playback of each path of data as a playback subtask thread, and each data file retrieved by a subtask relates to multiple data, the subtask establishes a time array, namely a subtask time axis, according to the associated starting time, namely a starting time and a duration recorded in a database by each file from the morning to the evening, the subtask time axis is a 'first time axis', then calculates a time range according to two condition data of the starting time and the duration in preset information data, then establishes a standard time array by taking the time range required by an actual scene as a reference to obtain all task time axes, namely a 'second time axis', then plays back by taking the time of the second time axis as a reference, contrasts and analyzes whether the time of the first time axis of each path of data is consistent with the playback time of the second time axis, if so, synchronous playback can be realized without adjustment, and if not, the time of the first time axis is adjusted, the synchronous playback of a plurality of different types of data can be realized after synchronizing with the standard time of the playback.
The beneficial effect of this embodiment is: the technical scheme adopted by the application is that information such as multi-channel audio data, multi-channel video data and multi-channel radar data is stored into different formats, data sources, scene description, data types, starting time, duration, data formats and the like are associated with the corresponding data and then are jointly used as a unique record to be input into a database for storage, time axes corresponding to the data are constructed, then a standard time axis, other data types, data sources and other conditions are set according to the requirements of specific scenes, the corresponding data of different types are searched from the database according to the set conditions, the time axes of the data are adjusted according to the set standard time axis, finally the data of all channels can be played back according to the standard time axis, and the application can realize the synchronous playback of the data of multiple classes through the technical scheme, the whole process is carried out automatically, the operation can be finished automatically only by manually setting conditions according to actual needs, the operation is simple, the operation difficulty is reduced, the smoothness of the system is improved, the time axis of the playback is set according to actual scenes and is set in a self-defined mode, the problem that in the prior art, the standard time axis cannot be defined independently by taking the time axis of one path of data as standard time and adjusting other paths is solved, and the practicability of the playback of audio data, video data or radar data is improved; according to the technical scheme, when the time axes of all paths of data are constructed, information such as data categories and the like are correspondingly stored when the data are stored in the database, so that the same type of data can be integrated into a unified time axis according to the sequence of time when searching is carried out according to set conditions, data category errors can be avoided when synchronous playback is carried out, and the process is simpler, the efficiency is higher and the playback accuracy is higher when synchronous playback adjustment is carried out according to the standard time axis by constructing the time axes of all types.
Example 2
As shown in fig. 2, a method for adjusting the difference of a first time axis to enable synchronous playback includes:
s21, judging whether the first time axis is matched or not according to the second time axis;
and S22, if not, performing time pause or time acceleration operation on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
In this embodiment, after the first time axis and the second time axis are obtained by construction, in order to implement synchronous playback of multiple different types of data, firstly, playback is performed according to a standard time axis, that is, the time of the second time axis, and it is determined whether the playback time at this time matches the time at this time in the first time axis of each data path, if matching, then synchronous playback can be implemented without adjustment, if not matching, then the subtask time axes corresponding to each data path are adjusted, and the adjustment process is as follows: the method comprises the steps that a standard time shaft advances according to the normal speed of system time and a set playback multiple, a program can acquire the current time of each subtask time shaft in real time, if the subtask time is deviated from the standard time, the program can correspondingly adjust the current time of the subtask, namely, when the subtask time lags behind the standard time shaft, the playing speed of the subtask can be increased until the subtask catches up with the standard time shaft, when the subtask time is higher than the standard time shaft, the subtask can be paused until the standard time reaches the subtask time, if a time interval exists between files corresponding to the subtasks, blank data can be automatically played in the time period to ensure the smooth advance of the subtask time shaft, a video can play black screen data frames, and a voice can play mute data; after the adjustment processing is carried out, each path of data can be synchronously played back according to the time of the second time shaft, and the synchronous playback of multiple paths of different types of data is realized. And a unified interface is arranged in the playback operation, so that one-key control can be realized on actions of playing, pausing, changing speed, jumping and the like of all data, namely the actions of playing, pausing, changing speed, jumping and the like of the task can be controlled by calling the task once.
The beneficial effect of this embodiment does: the time axes corresponding to the data in each path are subjected to difference adjustment, synchronous playback of the data in multiple paths can be realized, and when time intervals occur in the time axes, the data can be classified for processing, as in the above, when the time intervals occur, the video can play black screen data frames, and the voice can play mute data, so that in the synchronous playback, interruption of the data can not occur, the smoothness of video or audio playback is improved, and in the scheme, a unified interface is arranged, one-key control of actions such as playing, pausing, speed changing, jumping and the like of all the data can be realized, namely, the actions such as playing, pausing, speed changing, jumping and the like of the task can achieve the control of all subtasks only by calling the task once, so that the process of playback operation is simple, and the operation difficulty is reduced.
Example 3
As shown in fig. 3, an apparatus for multi-channel audio, video and radar mixed synchronous playback includes:
the data storage module 10: the device comprises a data processing module, a data processing module and a data processing module, wherein the data processing module is used for acquiring data to be processed, storing the data according to a preset format and obtaining first data, and the data to be processed comprises audio data, video data and radar data;
the time axis establishing module 20: the time domain setting module is used for establishing each path of data time array according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
the synchronized playback module 30: and the difference adjustment is carried out on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis.
One embodiment of the above apparatus is that, in the data storage module 10, to-be-processed data is obtained and stored according to a preset format to obtain first data, where the to-be-processed data includes audio data, video data and radar data, in the time axis establishing module 20, a time array of each path of data is established according to the first data and preset information data to obtain a first time axis, and a time array of a standard time is established according to a time range of the preset information data to obtain a second time axis, in the synchronous playback module 30, with the second time axis as a reference, the first time axis is subjected to difference adjustment according to a contrastive analysis method, so that each path of data is synchronously played back according to the second time axis.
Example 4
As shown in fig. 4, a data storage module 10 in a device for multi-channel audio, video and radar mixed synchronous playback includes:
the data first processing module 11: the system comprises a data processing module, a data storage module, a format conversion module and a format conversion module, wherein the data processing module is used for generating a first file from the data to be processed according to the pre-format and carrying out association setting on the first file and the information data to obtain second data;
the data second processing module 12: and the second data is transmitted to a database for storage to obtain the first data.
One implementation manner of the apparatus is that, in the first data processing module 11, a first file is generated from the data to be processed according to the pre-format, and the first file and the information data are set in an associated manner to obtain second data, where the information data includes a data source, a scene description, a data type, a start time, a duration, and a data format, and in the second data processing module 12, the second data is transferred to a database to be stored to obtain the first data.
Example 5
As shown in fig. 5, a time axis establishing module 20 in a device for multi-channel audio, video and radar mixed synchronous playback includes:
first time axis establishing module 21: the time array is used for detecting the first data according to the preset information data to obtain a second file, and establishing a time array for the second file according to the starting time and the duration time associated with the second file according to the time sequence to obtain the first time axis;
the second timeline establishing module 22: and the time range is calculated according to the preset starting time and the preset duration time, and the standard time array is established according to the time range to obtain the second time axis.
One embodiment of the foregoing apparatus is that, in the first time axis establishing module 21, the first data is detected according to the preset information data to obtain a second file, and a time array is established according to the start time and the duration time associated with the second file in time sequence to obtain the first time axis, and in the second time axis establishing module 22, the time range is obtained by calculating according to the preset start time and the duration time, and the standard time array is established according to the time range to obtain the second time axis.
Example 6
As shown in fig. 6, a synchronous playback module 30 in a device for multi-channel audio, video and radar mixed synchronous playback includes:
the time matching judgment module 31: the judgment module is used for judging whether the first time axis is matched or not according to the second time axis;
the time adjustment module 32: and if not, performing time pause or time acceleration operation on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
In an embodiment of the foregoing apparatus, in the time matching determining module 31, whether the first time axis is matched according to the second time axis is determined, and in the time adjusting module 32, if not, a time pause or a time acceleration operation is performed on the first time axis until the time of the first time axis matches the time of the second time axis, so that the data of each channel are synchronously played back according to the second time axis.
Example 7
As shown in fig. 7, an electronic device comprises a memory 701 and a processor 702, wherein the memory 701 is used for storing one or more computer instructions, and the one or more computer instructions are executed by the processor 702 to implement any one of the methods described above.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the electronic device described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
A computer readable storage medium storing a computer program which, when executed, causes a computer to implement any of the methods as described above.
Illustratively, a computer program may be divided into one or more modules/units, one or more modules/units are stored in the memory 701 and executed by the processor 702, and the I/O interface transmission of data is performed by the input interface 705 and the output interface 706 to accomplish the present invention, and one or more of the modules/units may be a series of computer program instruction segments describing the execution of the computer program in a computer device.
The computer device may be a desktop computer, a notebook, a palm computer, a cloud server, or other computing devices. The computer device may include, but is not limited to, the memory 701 and the processor 702, and those skilled in the art will appreciate that the present embodiment is merely an example of a computer device and is not a limitation of computer devices, and may include more or less components, or combine certain components, or different components, for example, the computer device may further include an input 707, a network access device, a bus, etc.
The processor 702 may be a Central Processing Unit (CPU), other general-purpose processor 702, a digital signal processor 802 (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc. The general purpose processor 702 may be a microprocessor 702 or the processor 702 may be any conventional processor 702 or the like.
The storage 701 may be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. The memory 701 may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Memory Card (SMC), a Secure Digital (SD) card, a flash memory card (FlashCard) or the like provided on the computer device, further, the memory 701 may also include both an internal storage unit and an external storage device of the computer device, the memory 701 is used for storing a computer program and other programs and data required by the computer device, the memory 701 may also be used for temporarily storing the program code in the output unit 708, and the aforementioned storage media include various media capable of storing program codes, such as a usb disk, a removable hard disk, a ROM703, a RAM704, a disk, or an optical disk.
The above description is only an embodiment of the present invention, but the technical features of the present invention are not limited thereto, and any changes or modifications within the technical field of the present invention by those skilled in the art are covered by the claims of the present invention.
Claims (10)
1. A method for multi-channel audio, video and radar hybrid synchronous playback, comprising:
acquiring data to be processed, and storing the data according to a preset format to obtain first data, wherein the data to be processed comprises audio data, video data and radar data;
establishing a time array of data of each path according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
and performing difference adjustment on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis.
2. The method of claim 1, wherein the obtaining the data to be processed and storing the data according to the pre-format to obtain the first data comprises:
generating a first file from the data to be processed according to the pre-format, and performing association setting on the first file and the information data to obtain second data, wherein the information data comprises a data source, scene description, data type, start time, duration and a data format;
and transmitting the second data to a database for storage to obtain the first data.
3. The method of claim 2, wherein the establishing of time arrays of data of each channel according to the first data and the preset information data to obtain a first time axis, and establishing of time arrays of standard times according to the time range of the preset information data to obtain a second time axis comprises:
detecting the first data according to the preset information data to obtain a second file, and establishing a time array for the second file according to the starting time and the duration time associated with the second file according to the time sequence to obtain the first time axis;
and calculating according to the preset starting time and the preset duration time to obtain the time range, and establishing the standard time array according to the time range to obtain the second time axis.
4. The method of claim 3, wherein the performing a differential adjustment on the first time axis according to a contrast analysis method with respect to the second time axis to enable the channels of data to be played back synchronously according to the second time axis comprises:
judging whether the first time axis is matched or not according to the second time axis;
if not, time pause or time acceleration operation is carried out on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
5. A multi-channel audio, video and radar hybrid synchronous playback device, for implementing the multi-channel audio, video and radar hybrid synchronous playback method of claim 1, comprising:
a data storage module: the device comprises a data processing module, a data processing module and a data processing module, wherein the data processing module is used for acquiring data to be processed, storing the data according to a preset format and obtaining first data, and the data to be processed comprises audio data, video data and radar data;
a time axis establishing module: the time domain setting module is used for establishing each path of data time array according to the first data and preset information data to obtain a first time axis, and establishing a standard time array according to the time range of the preset information data to obtain a second time axis;
a synchronous playback module: and the difference adjustment is carried out on the first time axis by taking the second time axis as a reference according to a contrast analysis method, so that each path of data is synchronously played back according to the second time axis.
6. The device for multi-channel audio, video and radar hybrid synchronous playback according to claim 5, wherein the data storage module comprises:
a first data processing module: the system comprises a data processing module, a data storage module, a format conversion module and a format conversion module, wherein the data processing module is used for generating a first file from the data to be processed according to the pre-format and carrying out association setting on the first file and the information data to obtain second data;
the second data processing module: and the second data is transmitted to a database for storage to obtain the first data.
7. The device for multi-channel audio, video and radar hybrid synchronous playback according to claim 6, wherein the time axis establishing module comprises:
a first time axis establishing module: the time array is used for detecting the first data according to the preset information data to obtain a second file, and establishing a time array for the second file according to the starting time and the duration time associated with the second file according to the time sequence to obtain the first time axis;
a second timeline establishing module: and the time range is calculated according to the preset starting time and the preset duration time, and the standard time array is established according to the time range to obtain the second time axis.
8. The device for multi-channel audio, video and radar hybrid synchronous playback according to claim 6, wherein the synchronous playback module comprises:
a time matching judgment module: the judgment module is used for judging whether the first time axis is matched or not according to the second time axis;
a time adjustment module: and if not, performing time pause or time acceleration operation on the first time axis until the time of the first time axis is matched with the time of the second time axis, so that the data of each path are synchronously played back according to the second time axis.
9. An apparatus for multiple audio, video and radar hybrid synchronous playback, comprising a memory and a processor, wherein the memory is configured to store one or more computer instructions, and wherein the one or more computer instructions are executed by the processor to implement the method for multiple audio, video and radar hybrid synchronous playback as claimed in any one of claims 1 to 4.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a computer, implements a method for multiple audio, video, and radar mixed synchronous playback as claimed in any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111418731.4A CN114222083A (en) | 2021-11-26 | 2021-11-26 | Method and device for multi-channel audio, video and radar mixed synchronous playback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111418731.4A CN114222083A (en) | 2021-11-26 | 2021-11-26 | Method and device for multi-channel audio, video and radar mixed synchronous playback |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114222083A true CN114222083A (en) | 2022-03-22 |
Family
ID=80698444
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111418731.4A Pending CN114222083A (en) | 2021-11-26 | 2021-11-26 | Method and device for multi-channel audio, video and radar mixed synchronous playback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114222083A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114827680A (en) * | 2022-04-21 | 2022-07-29 | 上海艺赛旗软件股份有限公司 | Multi-channel video synchronous playing method, system, equipment and storage medium |
| CN116630866A (en) * | 2023-07-24 | 2023-08-22 | 中电信数字城市科技有限公司 | Abnormal event monitoring method, device, equipment and medium for audio-video radar fusion |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100077306A1 (en) * | 2008-08-26 | 2010-03-25 | Optek Music Systems, Inc. | System and Methods for Synchronizing Audio and/or Visual Playback with a Fingering Display for Musical Instrument |
| CN103065503A (en) * | 2012-12-27 | 2013-04-24 | 重庆大学 | Reappearing method and system controlling river reach ship traveling dynamic and signal revealing process |
| CN108614853A (en) * | 2018-03-15 | 2018-10-02 | 中国人民解放军63895部队 | A kind of multi-data source synchronizing information mixing storage and playback system and method |
| CN111935533A (en) * | 2020-07-06 | 2020-11-13 | 南京熊猫电子股份有限公司 | Multi-source measurement and control data playback method for unmanned aerial vehicle |
-
2021
- 2021-11-26 CN CN202111418731.4A patent/CN114222083A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100077306A1 (en) * | 2008-08-26 | 2010-03-25 | Optek Music Systems, Inc. | System and Methods for Synchronizing Audio and/or Visual Playback with a Fingering Display for Musical Instrument |
| CN103065503A (en) * | 2012-12-27 | 2013-04-24 | 重庆大学 | Reappearing method and system controlling river reach ship traveling dynamic and signal revealing process |
| CN108614853A (en) * | 2018-03-15 | 2018-10-02 | 中国人民解放军63895部队 | A kind of multi-data source synchronizing information mixing storage and playback system and method |
| CN111935533A (en) * | 2020-07-06 | 2020-11-13 | 南京熊猫电子股份有限公司 | Multi-source measurement and control data playback method for unmanned aerial vehicle |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114827680A (en) * | 2022-04-21 | 2022-07-29 | 上海艺赛旗软件股份有限公司 | Multi-channel video synchronous playing method, system, equipment and storage medium |
| CN116630866A (en) * | 2023-07-24 | 2023-08-22 | 中电信数字城市科技有限公司 | Abnormal event monitoring method, device, equipment and medium for audio-video radar fusion |
| CN116630866B (en) * | 2023-07-24 | 2023-10-13 | 中电信数字城市科技有限公司 | Abnormal event monitoring method, device, equipment and medium for audio-video radar fusion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11323407B2 (en) | Methods, systems, apparatuses, and devices for facilitating managing digital content captured using multiple content capturing devices | |
| CN114222083A (en) | Method and device for multi-channel audio, video and radar mixed synchronous playback | |
| US10541003B2 (en) | Performance content synchronization based on audio | |
| US9661361B2 (en) | Systems and methods for live media content matching | |
| CN109842795B (en) | Audio and video synchronization performance testing method and device, electronic equipment and storage medium | |
| WO2015048693A1 (en) | Multiple data source aggregation for efficient synchronous multi-device media consumption | |
| CN109144858B (en) | Fluency detection method and device, computing equipment and storage medium | |
| JP7442211B2 (en) | Synchronizing auxiliary data for content that includes audio | |
| WO2014188231A1 (en) | A shared audio scene apparatus | |
| CN111988647A (en) | Sound and picture synchronous adjusting method, device, equipment and medium | |
| US20200374422A1 (en) | System and method of synchronizing video and audio clips with audio data | |
| CN108460120A (en) | Data save method, device, terminal device and storage medium | |
| US10945047B1 (en) | Selective playback of audio at normal speed during trick play operations | |
| US9426403B2 (en) | Video playback system and method | |
| CN109600571B (en) | Multimedia resource transmission test system and multimedia resource transmission test method | |
| TWI790669B (en) | Method and device for viewing meeting | |
| CN116132630A (en) | Video processing method, device, equipment and storage medium | |
| CN113691799A (en) | Live stream interaction control method and corresponding device, equipment and medium | |
| CN113691803A (en) | Method, device, equipment and medium for testing audio and video interface function | |
| DE112019001037T5 (en) | AUTHENTICATION FOR DIGITAL RECORDINGS | |
| US11627373B2 (en) | Systems and methods for providing survey data from a mobile device | |
| CN114286179B (en) | Video editing method, apparatus, and computer-readable storage medium | |
| KR102240602B1 (en) | Method And Apparatus for Providing Time-Shifting based on Real Time Stamp | |
| GB2483250A (en) | Producing edit decision list by comparing edited video with source video | |
| CN115529548A (en) | Speaker channel generation method and device, electronic device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |