CN115426508B - Audio and video signal synchronization method, device, system and medium of medical workstation - Google Patents
Audio and video signal synchronization method, device, system and medium of medical workstation Download PDFInfo
- Publication number
- CN115426508B CN115426508B CN202211046842.1A CN202211046842A CN115426508B CN 115426508 B CN115426508 B CN 115426508B CN 202211046842 A CN202211046842 A CN 202211046842A CN 115426508 B CN115426508 B CN 115426508B
- Authority
- CN
- China
- Prior art keywords
- medical
- audio
- video
- signal
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000005236 sound signal Effects 0.000 claims abstract description 208
- 239000000872 buffer Substances 0.000 claims abstract description 86
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 25
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 25
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 17
- 230000017531 blood circulation Effects 0.000 claims description 18
- 238000001914 filtration Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 7
- 230000010349 pulsation Effects 0.000 claims description 6
- 238000005070 sampling Methods 0.000 claims description 6
- 239000002131 composite material Substances 0.000 claims description 4
- 239000000758 substrate Substances 0.000 claims 1
- 238000003745 diagnosis Methods 0.000 abstract description 15
- 230000001360 synchronised effect Effects 0.000 abstract description 12
- 230000003902 lesion Effects 0.000 description 3
- 239000000523 sample Substances 0.000 description 3
- 208000031481 Pathologic Constriction Diseases 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000002608 intravascular ultrasound Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 208000037804 stenosis Diseases 0.000 description 2
- 230000036262 stenosis Effects 0.000 description 2
- 208000019553 vascular disease Diseases 0.000 description 2
- 206010003210 Arteriosclerosis Diseases 0.000 description 1
- 208000011775 arteriosclerosis disease Diseases 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000001839 endoscopy Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23602—Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5018—Thread allocation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention provides an audio and video signal synchronization method, device and system of a medical workstation, wherein the method comprises the following steps: an audio signal acquisition step: acquiring medical audio signals and loading the medical audio signals into a first buffer area; a video signal acquisition step: acquiring a medical video signal and loading the medical video signal into a second buffer area; and an audio and video synthesis step: reading medical audio signals in the first buffer area and medical video signals in the second buffer area every preset period; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal. Therefore, the medical audio signal and the medical video signal are stored in different buffer areas, so that crosstalk between data can be avoided, and subsequent data reading logic is simplified; and through synchronous processing of medical audio and video signals, a doctor can be assisted in diagnosis, and the diagnosis efficiency of the doctor is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of medical instruments, in particular to an audio and video signal synchronous processing method, device and system of a medical workstation.
Background
The medical workstation system is mainly applied to clinical hospitals, and has a wide application range, such as: field of endoscopy. The existing medical workstation system generally collects video image signals and correspondingly processes video images, but does not support audio recording, cannot collect audio signals, and cannot synchronize audio and video. However, with the development of medical technology, it is required in the art to collect audio signals in a cavity to provide more medical diagnostic data, and how to accurately synchronize the collected medical audio signals with medical video signals is also a technical problem that needs to be solved urgently.
Disclosure of Invention
The embodiment of the invention provides an audio and video signal synchronous processing method, device and system of a medical workstation, which are used for solving the technical problems that a medical workstation system in the prior art can only collect video signals, cannot collect audio signals and cannot perform audio and video synchronization.
In order to solve the technical problems, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a method for synchronizing audio and video signals of a medical workstation, where the method includes:
an audio signal acquisition step: acquiring medical audio signals and loading the medical audio signals into a first buffer area
A video signal acquisition step: acquiring a medical video signal and loading the medical video signal into a second buffer area;
and an audio and video synthesis step: reading the medical audio signals in the first buffer area and the medical video signals in the second buffer area every preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the audio signal acquisition step, the video signal acquisition step and the audio-video synthesis step are started simultaneously; the medical audio signal is a blood flow audio signal or a tube wall pulsating audio signal.
Preferably, the audio signal acquisition step includes:
starting a first thread, acquiring medical audio signals by adopting the first thread and loading the medical audio signals into a first buffer area;
the video signal acquisition step includes:
starting a second thread, acquiring a medical video signal by adopting the second thread and loading the medical video signal into a second buffer area;
the audio and video synthesis step comprises the following steps:
starting a third thread, and reading medical audio signals in the first buffer area and medical video signals in the second buffer area by adopting the third thread Cheng Meige for a preset period; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal.
Preferably, the synchronizing processing of the read medical audio signal and medical video signal comprises:
acquiring a reference clock;
time stamping each frame of the read medical audio signal and the read medical video signal with the reference clock as a reference;
and synchronizing the medical audio signal and the medical video signal according to the time stamp.
Preferably, the time stamp is determined by the following formula:
N×(1÷A)
n is a positive integer, A is the sampling rate of the medical audio signal or the medical video signal; the time stamp represents the time required for N samples.
Preferably, after obtaining the audio-video composite signal, the method further comprises: and playing the audio and video synthesized signal.
Preferably, after acquiring the medical audio signal, the method further comprises:
filtering the acquired medical audio signals;
after acquiring the medical video signal, the method further comprises:
and filtering the acquired medical video signals.
Preferably, acquiring the medical audio signal and loading the medical audio signal into the first buffer comprises:
after analyzing the acquired medical audio signals, loading the medical audio signals into the first buffer memory area;
acquiring the medical video signal and loading the medical video signal into the second buffer area comprises:
and after analyzing the acquired medical video signals, loading the medical video signals into the second buffer memory area.
In a second aspect, an embodiment of the present invention provides an audio/video signal synchronization device of a medical workstation, where the device includes:
the audio signal acquisition module is used for acquiring medical audio signals and loading the medical audio signals into the first buffer area;
the video signal acquisition module is used for acquiring medical video signals and loading the medical video signals into the second buffer area;
the audio and video synthesis module is used for reading the medical audio signals in the first buffer area and the medical video signals in the second buffer area every other preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the audio signal acquisition module, the video signal acquisition module and the audio-video synthesis module are started at the same time; the medical audio signal is a blood flow audio signal or a tube wall pulsating audio signal.
Preferably, the audio signal acquisition module is used for starting a first thread, acquiring medical audio signals by adopting the first thread and loading the medical audio signals into the first cache area;
the video signal acquisition module is used for starting a second thread, acquiring medical video signals by adopting the second thread and loading the medical video signals into a second cache area;
the audio and video synthesis module is used for starting a third thread, and reading medical audio signals in the first buffer area and medical video signals in the second buffer area by adopting a preset period of the third thread Cheng Meige; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal.
Preferably, the audio and video synthesis module is used for acquiring a reference clock;
time stamping each frame of the read medical audio signal and the read medical video signal with the reference clock as a reference;
and synchronizing the medical audio signal and the medical video signal according to the time stamp.
Preferably, the time stamp is determined by the following formula:
N×(1÷A)
n is a positive integer, A is the sampling rate of the medical audio signal or the medical video signal; the time stamp represents the time required for N samples.
Preferably, the apparatus further comprises:
and the playing module is used for playing the audio and video synthesized signal.
Preferably, the audio signal acquisition module is further configured to perform filtering processing on the acquired medical audio signal after acquiring the medical video signal;
the video signal acquisition module is further used for performing filtering processing on the acquired medical video signal after acquiring the medical video signal.
Preferably, the audio signal obtaining module is further configured to parse the obtained medical audio signal and then load the parsed medical audio signal into the first buffer area;
the video signal acquisition module is further used for loading the acquired medical video signal into the second buffer area after analyzing the acquired medical video signal.
In a third aspect, an embodiment of the present invention provides an audio/video signal synchronization system of a medical workstation, where the system includes: a processor, a memory and a program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the audio video signal synchronization method of a medical workstation as described in the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, on which a computer program is stored, the computer program implementing the steps of the audio-video signal synchronization method of the medical workstation according to the first aspect when being executed by a processor.
In the embodiment of the invention, firstly, the medical audio signal and the medical video signal are cached in different cache areas, so that crosstalk between data can be avoided, and when the audio and video signal and the synchronous audio and video signal are read later, the read-write logic can be simplified, the read-write efficiency can be improved, secondly, the audio signal acquisition step, the video signal acquisition step and the audio and video synthesis step are started simultaneously, the accuracy of audio and video signal synchronization can be ensured, and in addition, the medical audio signal and the medical video signal are synchronously processed, so that a doctor can further know the condition in a patient cavity, and the doctor is assisted in diagnosis, and the diagnosis efficiency and the diagnosis accuracy are improved.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
fig. 1 is a flowchart of a method for processing audio and video signals synchronously in a medical workstation according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for processing audio and video signals synchronously in a medical workstation according to an embodiment of the present invention;
fig. 3 is a flowchart of a method for processing audio and video signals synchronously in a medical workstation according to an embodiment of the present invention;
fig. 4 is a block diagram of a device for processing audio and video signals synchronously in a medical workstation according to an embodiment of the present invention;
fig. 5 is a block diagram of a medical workstation audio/video signal synchronization processing system according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The embodiment of the invention provides an audio and video signal synchronization method of a medical workstation, as shown in fig. 1, comprising the following steps:
step S101, acquiring medical audio signals and loading the medical audio signals into a first buffer area;
step S102, acquiring a medical video signal and loading the medical video signal into a second buffer area;
step S103, reading medical audio signals in the first buffer area and medical video signals in the second buffer area every preset period; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal.
In step S101 and step S102, taking a specific application scenario as an example, when the medical workstation system is used in the field of ultrasonic endoscopes, a medical audio signal may be collected by a micro high-frequency ultrasonic probe of the ultrasonic endoscope and sent to the medical workstation system, the medical workstation system loads the medical audio signal into a first buffer area for standby, a medical video signal may be collected by an electronic endoscope and/or an ultrasonic probe and sent to the medical workstation system, and the medical workstation system loads the medical video signal into a second buffer area for standby. Therefore, the medical audio signal and the medical video signal are cached in different cache areas, so that crosstalk between data can be avoided; and is convenient for the reading, synchronization and synthesis of subsequent audio and video signals.
In a preferred implementation, step S101, acquiring the medical audio signal and loading the medical audio signal into the first buffer area includes: after analyzing the acquired medical audio signals, loading the medical audio signals into a first buffer area; step S102, acquiring the medical video signal and loading the medical video signal into the second buffer area includes: and after analyzing the acquired medical video signals, loading the medical video signals into a second buffer memory area.
It will be appreciated that after the medical audio signal or the medical video signal is acquired, certain processing needs to be performed on the signal, for example: encoding, compression, noise reduction, etc., to store the data. Therefore, the acquired medical audio signal needs to be analyzed and then loaded into the first buffer area, and the acquired medical video signal needs to be analyzed and then loaded into the second buffer area. The noise reduction may be achieved by filtering, i.e. after the medical audio signal is acquired, the acquired medical audio signal is also subjected to a filtering process. After the medical video signal is acquired, the medical video signal is also subjected to a filtering process. Taking filtering processing of medical audio signals as an example, the acquired medical audio signals are blood flow audio signals or tube wall pulsating audio signals, wherein the blood flow audio signals have important significance for diagnosis of diseases. In the case of many vascular diseases, such as stenosis, arteriosclerosis, etc., the movement of blood flow near the vessel wall is markedly altered, such as reverse blood flow, turbulence and eddies, spectral broadening, etc. Thus, the features contained in the low-velocity blood flow signal are very sensitive to detecting and diagnosing vascular disease. The blood flow audio signal is generally 0-150M, and when the blood flow audio signal is required to be acquired, the audio signal acquired by the ultrasonic Doppler medical instrument is filtered to remove the pipe wall pulsating audio signal through filtering treatment. When the wall pulsation audio signal is needed, the blood flow audio signal is filtered out or not filtered out by the audio signal collected by the ultrasonic Doppler medical instrument through the filtering treatment, and the wall pulsation audio signal is stronger because the blood flow audio signal is weaker and the obtaining of the wall pulsation audio signal is not filtered out, so that the obtaining of the wall pulsation audio signal is not influenced generally. The medical video signal in this embodiment is an intravascular ultrasound video signal, and the intravascular ultrasound imaging technology is to send a miniaturized ultrasound probe into a blood vessel cavity through a catheter technology, so that a cross-sectional image including a lumen and a tube wall can be provided, the shape of the lumen can be observed, the shape of the tube wall can be observed, the nature of a lesion can be judged according to the echo characteristics of the lesion, the size of the lumen and the blood vessel and the stenosis degree of the lesion can be accurately measured, and the method can be used for guiding coronary intervention treatment.
In a preferred implementation, as shown in fig. 2, the method includes:
step S201; starting a first thread, acquiring medical audio signals by adopting the first thread and loading the medical audio signals into a first cache area;
step S202, starting a second thread, acquiring medical video signals by adopting the second thread and loading the medical video signals into a second buffer area;
step S203, a third thread is started, and a medical audio signal in the first buffer area and a medical video signal in the second buffer area are read by adopting a preset period of the third thread Cheng Meige; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal.
In the implementation mode, three independent threads can be adopted respectively for acquiring medical audio signals, acquiring medical video signals and reading, synchronizing and synthesizing the medical audio signals and the medical video signals, and the three threads are not mutually interfered with each other and are not mutually influenced so as to ensure the smoothness and the integrity of signal acquisition.
In step S103, a timer may be set to read the medical audio signal in the first buffer and the medical video signal in the second buffer every preset period, so that the frame rates of the read medical audio signal and the medical video signal remain synchronized, and the frame rate is assumed to be 60 frames, and is read every 1000/60≡17 milliseconds. Alternatively, the medical audio signal in the first buffer and the medical video signal in the second buffer may be read in real time. After reading, the read medical audio signal and medical video signal are processed synchronously. Wherein the synchronizing processing of the read medical audio signal and medical video signal comprises: acquiring a reference clock, and marking a time stamp for each frame of the read medical audio signal and the read medical video signal by taking the reference clock as a reference; the synchronization of the medical audio signal and the medical video signal is performed at time stamps. The time stamp is determined by the following formula:
N×(1÷A)
n is a positive integer, a is the sampling rate of the medical audio signal or the medical video signal, and the time stamp represents the time required for N sampling times. Therefore, synchronization of audio and video signals can be accurately realized.
And then synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal, and playing the audio-video synthesized signal. It will be appreciated that the medical audio signal may be synchronized to the medical video signal, the medical audio signal may be synchronized with respect to the playing speed of the medical video signal, or the medical video signal and the medical audio signal may be synchronized with respect to a reference clock, i.e. the playing speeds of the medical video signal and the medical audio signal are both standard with respect to the reference clock.
It should be noted that, steps S101, S102, and S103 are started simultaneously, so that the audio and video signals are collected and synthesized at the same time, thereby avoiding signal delay and further ensuring the accuracy of audio and video signal synchronization.
In the embodiment of the invention, firstly, the medical audio signal and the medical video signal are cached in different cache areas, so that the crosstalk between data can be avoided; when the audio and video signals and the synchronous audio and video signals are read subsequently, the read-write logic can be simplified, and the read-write efficiency is improved; in addition, the medical audio signal and the medical video signal are synchronously processed, so that a doctor can further know the condition in the cavity of a patient, the doctor is assisted in diagnosis, and the diagnosis efficiency and the diagnosis accuracy are improved; the synthesized audio and video signals can be exported, so that the subsequent research or teaching is convenient.
Fig. 3 is a flowchart of a method for processing audio and video signals synchronously in a medical workstation according to an embodiment of the present invention, where, as shown in fig. 3, the method includes:
step S301, starting a data acquisition system of a medical workstation;
step S302, starting an audio data acquisition thread; starting a video data acquisition thread; starting an audio and video data synthesis thread;
step S303, analyzing the audio data;
step S304, analyzing the video data;
step S305, caching the parsed audio data to an audio data cache area;
step S306, caching the analyzed video data into a video data cache area;
step S307, starting a timer to perform data synchronization processing;
step S308, calculating time stamps of the audio data and the video data;
step S309, synchronizing and synthesizing the audio and video data according to the time stamp;
it should be noted that, after executing step S309, step S308 may be executed circularly until synchronization is completed;
and step S310, ending the acquisition, and stopping the logic of the audio data acquisition thread, the video data acquisition thread and the audio and video data synthesis thread.
The steps are briefly described, a data acquisition system of a medical workstation is started, an audio data acquisition thread, a video data acquisition thread and an audio and video data synthesis thread are started, and an audio data buffer area and a video data buffer area are opened in advance. The audio data acquisition thread is responsible for the acquisition of audio data and buffers the acquired audio data into a pre-opened audio data buffer area in real time, and the video data acquisition thread is responsible for the acquisition of video data and buffers the acquired video data into a pre-opened video data buffer area in real time. The audio and video synthesis thread is responsible for synthesizing audio and video data, after the thread is started, a timer is started, an audio data buffer area and a video data buffer area are read at fixed time, audio and video coding is started, data synchronization is carried out according to an audio data time stamp and a video data time stamp, and a data segment which confirms synchronization is written into a coding stream. And the data in the buffer area can be circularly read every preset period according to the timer, data synchronization is performed, and the data segment confirmed to be synchronized is written into the code stream. And stopping the coding stream after the writing is completed, and stopping the audio data acquisition thread, the video data acquisition thread and the audio and video data synthesis thread.
Thus, the method shown in fig. 3 has the following technical effects:
three independent threads are adopted respectively to acquire medical audio signals, acquire medical video signals and read, synchronize and synthesize the medical audio signals and the medical video signals, and the three threads are mutually noninterfere and are mutually noninterfere so as to ensure the smoothness and the integrity of signal acquisition;
the medical audio signal and the medical video signal are cached in different cache areas, so that crosstalk between data can be avoided, read-write logic can be simplified when the audio and video signal and the synchronous audio and video signal are read subsequently, and read-write efficiency is improved;
the medical audio signal and the medical video signal are synchronously processed, so that a doctor can further know the condition in the cavity of a patient, the doctor is assisted in diagnosis, and the diagnosis efficiency and the diagnosis accuracy are improved;
the synthesized audio and video signals can be exported, so that the subsequent research or teaching is convenient.
The embodiment of the present invention further provides an audio/video signal synchronization device 40 of a medical workstation, as shown in fig. 4, where the device 40 includes:
an audio signal acquisition module 401, configured to acquire a medical audio signal and load the medical audio signal into the first buffer;
a video signal acquisition module 402, configured to acquire a medical video signal and load the medical video signal into the second buffer;
the audio-video synthesis module 403 is configured to read the medical audio signal in the first buffer area and the medical video signal in the second buffer area every a preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
wherein, the audio signal acquisition module 401, the video signal acquisition module 402 and the audio-video synthesis module 403 are started simultaneously; the medical audio signal is a blood flow audio signal or a tube wall pulsating audio signal.
In a preferred implementation, the audio signal obtaining module 401 is configured to start a first thread, obtain a medical audio signal using the first thread, and load the medical audio signal into the first buffer;
the video signal acquisition module 402 is configured to start a second thread, acquire a medical video signal by using the second thread, and load the medical video signal into a second buffer;
the audio and video synthesis module 403 is configured to start a third thread, and read the medical audio signal in the first buffer and the medical video signal in the second buffer with a preset period of the third thread Cheng Meige; synchronously processing the read medical audio signal and medical video signal; and synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal.
In a preferred implementation, the audio-video synthesis module 403 is further configured to obtain a reference clock; each frame of the read medical audio signal and the read medical video signal is time stamped based on a reference clock; the synchronization of the medical audio signal and the medical video signal is performed at time stamps.
In a preferred implementation, the time stamp is determined by the following formula:
N×(1÷A)
n is a positive integer, A is the sampling rate of the medical audio signal or the medical video signal; the time stamp represents the time required for N samples.
In a preferred implementation, the apparatus 40 further comprises: and the playing module is used for playing the audio and video composite signal after the audio and video composite signal is obtained.
In one possible time manner, the audio signal acquisition module 401 is further configured to perform a filtering process on the acquired medical audio signal; the video signal acquisition module 402 is further configured to perform filtering processing on the acquired medical video signal.
In a possible implementation manner, the audio signal obtaining module 401 is further configured to parse the obtained medical audio signal and then load the parsed medical audio signal into the first buffer; the video signal obtaining module 402 is further configured to parse the obtained medical video signal and load the parsed medical video signal into the second buffer.
Therefore, three independent threads can be adopted to acquire medical audio signals, acquire medical video signals and read, synchronize and synthesize the medical audio signals and the medical video signals respectively, and the three threads are mutually noninterfere and mutually noninterfere so as to ensure the smoothness and the integrity of signal acquisition; the medical audio signal and the medical video signal are cached in different cache areas, so that crosstalk between data can be avoided, read-write logic can be simplified when the audio and video signal and the synchronous audio and video signal are read subsequently, and read-write efficiency is improved; the medical audio signal and the medical video signal are synchronously processed, so that a doctor can further know the condition in the cavity of a patient, the doctor is assisted in diagnosis, and the diagnosis efficiency and the diagnosis accuracy are improved; the synthesized audio and video signals can be exported, so that the subsequent research or teaching is convenient.
The embodiment of the invention also provides an audio/video signal synchronization system 50 of the medical workstation, as shown in fig. 5, the system 50 comprises: the processor 501, the memory 502, and the program stored in the memory 502 and executable on the processor 501, when executed by the processor 501, implement the steps of the audio/video signal synchronization method of the medical workstation as described in fig. 1, 2, and 3.
In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where a computer program is stored, where the computer program, when executed by a processor, implements the steps of the audio/video signal synchronization method of a medical workstation as described in fig. 1, 2 and 3.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each process of the foregoing … … method embodiment, and the same technical effects can be achieved, so that repetition is avoided, and no further description is provided herein. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.
Claims (8)
1. A method for synchronizing audio and video signals of a medical workstation, the method comprising:
an audio signal acquisition step: acquiring medical audio signals and loading the medical audio signals into a first buffer area;
a video signal acquisition step: acquiring a medical video signal and loading the medical video signal into a second buffer area;
and an audio and video synthesis step: reading the medical audio signals in the first buffer area and the medical video signals in the second buffer area every preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the audio signal acquisition step, the video signal acquisition step and the audio-video synthesis step are started simultaneously; the medical audio signal is a blood flow audio signal or a tube wall pulsation audio signal;
when a blood flow audio signal is required to be acquired, filtering the acquired audio signal to remove a tube wall pulsating audio signal through filtering; when the tube wall pulsating audio signals are required to be acquired, the acquired audio signals are filtered to remove blood flow audio signals through filtering treatment or are not filtered;
the audio signal acquisition step includes:
starting a first thread, acquiring medical audio signals by adopting the first thread and loading the medical audio signals into a first buffer area;
the video signal acquisition step includes:
starting a second thread, acquiring a medical video signal by adopting the second thread and loading the medical video signal into a second buffer area;
the audio and video synthesis step comprises the following steps:
starting a third thread, and reading medical audio signals in the first buffer area and medical video signals in the second buffer area by adopting the third thread Cheng Meige for a preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the medical audio signals in the first buffer area and the medical video signals in the second buffer area are circularly read every preset period, synchronization of the medical audio signals and the medical video signals is carried out, and the medical audio signals and the medical video signals which confirm synchronization are written into a coding stream; after the writing is completed, the encoding flow is stopped, and the first thread, the second thread and the third thread are stopped.
2. The method of claim 1, wherein synchronizing the read medical audio signal and medical video signal comprises:
acquiring a reference clock;
time stamping each frame of the read medical audio signal and the read medical video signal with the reference clock as a reference;
and synchronizing the medical audio signal and the medical video signal according to the time stamp.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
the time stamp is determined by the following formula:
N×(1÷A)
n is a positive integer, A is the sampling rate of the medical audio signal or the medical video signal; the time stamp represents the time required for N samples.
4. The method of claim 1, wherein after obtaining the audio-video composite signal, the method further comprises:
and playing the audio and video synthesized signal.
5. The method of claim 1, wherein acquiring the medical audio signal and loading the medical audio signal into the first buffer comprises:
after analyzing the acquired medical audio signals, loading the medical audio signals into the first buffer memory area;
acquiring the medical video signal and loading the medical video signal into the second buffer area comprises:
and after analyzing the acquired medical video signals, loading the medical video signals into the second buffer memory area.
6. An audio and video signal synchronizing device for a medical workstation, said device comprising:
the audio signal acquisition module is used for acquiring medical audio signals and loading the medical audio signals into the first buffer area;
the video signal acquisition module is used for acquiring medical video signals and loading the medical video signals into the second buffer area;
the audio and video synthesis module is used for reading the medical audio signals in the first buffer area and the medical video signals in the second buffer area every other preset period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the audio signal acquisition module, the video signal acquisition module and the audio-video synthesis module are started at the same time; the medical audio signal is a blood flow audio signal or a tube wall pulsation audio signal;
when a blood flow audio signal is required to be acquired, filtering the acquired audio signal to remove a tube wall pulsating audio signal through filtering; when the tube wall pulsating audio signals are required to be acquired, the acquired audio signals are filtered to remove blood flow audio signals through filtering treatment or are not filtered;
the audio signal acquisition module is used for starting a first thread, acquiring medical audio signals by adopting the first thread and loading the medical audio signals into the first cache area;
the video signal acquisition module is used for starting a second thread, acquiring medical video signals by adopting the second thread and loading the medical video signals into a second buffer area;
the audio and video synthesis module is configured to start a third thread, and read the medical audio signal in the first buffer area and the medical video signal in the second buffer area by adopting the third thread Cheng Meige to preset a period; synchronously processing the read medical audio signal and medical video signal; synthesizing the medical audio signal and the medical video signal which are synchronously processed to obtain an audio-video synthesized signal;
the medical audio signals in the first buffer area and the medical video signals in the second buffer area are circularly read every preset period, synchronization of the medical audio signals and the medical video signals is carried out, and the medical audio signals and the medical video signals which confirm synchronization are written into a coding stream; after the writing is completed, the encoding flow is stopped, and the first thread, the second thread and the third thread are stopped.
7. An audio video signal synchronization system for a medical workstation, the system comprising: a processor, a memory and a program stored on the memory and executable on the processor, which when executed by the processor, performs the steps of the audio video signal synchronization method of a medical workstation as claimed in any one of claims 1-5.
8. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the audio-visual signal synchronization method of a medical workstation according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211046842.1A CN115426508B (en) | 2022-08-30 | 2022-08-30 | Audio and video signal synchronization method, device, system and medium of medical workstation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211046842.1A CN115426508B (en) | 2022-08-30 | 2022-08-30 | Audio and video signal synchronization method, device, system and medium of medical workstation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115426508A CN115426508A (en) | 2022-12-02 |
| CN115426508B true CN115426508B (en) | 2023-05-30 |
Family
ID=84199926
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211046842.1A Active CN115426508B (en) | 2022-08-30 | 2022-08-30 | Audio and video signal synchronization method, device, system and medium of medical workstation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115426508B (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101797042B1 (en) * | 2015-05-15 | 2017-11-13 | 삼성전자주식회사 | Method and apparatus for synthesizing medical images |
| CN107277614A (en) * | 2017-06-27 | 2017-10-20 | 深圳市爱培科技术股份有限公司 | Audio and video remote player method, storage device and the mobile terminal of drive recorder |
| CN110113551A (en) * | 2019-06-19 | 2019-08-09 | 江苏医药职业学院 | A kind of intellectual medical image audio-video recording system and method |
| CN114173208A (en) * | 2021-11-30 | 2022-03-11 | 广州番禺巨大汽车音响设备有限公司 | Audio and video playing control method and device of sound box system based on HDMI (high-definition multimedia interface) |
| CN114845004B (en) * | 2022-07-04 | 2022-10-25 | 杭州兆华电子股份有限公司 | Audio and video synchronization implementation method and acoustic imaging method |
-
2022
- 2022-08-30 CN CN202211046842.1A patent/CN115426508B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115426508A (en) | 2022-12-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3167367B2 (en) | Cardiovascular diagnostic device | |
| CN107708571B (en) | Ultrasonic imaging system and method | |
| JP4509027B2 (en) | Ultrasonic diagnostic equipment | |
| EP1840594A3 (en) | Ultrasonic diagnostic apparatus and data analysis and measurement apparatus | |
| Bonilha et al. | Vocal fold phase asymmetries in patients with voice disorders: a study across visualization techniques | |
| JP2005065904A (en) | Sleep apnea syndrome diagnosing apparatus, signal analyzing apparatus, and method thereof | |
| Li et al. | Ultrafast optical-ultrasonic system and miniaturized catheter for imaging and characterizing atherosclerotic plaques in vivo | |
| JPH08280604A (en) | Device for endoscope inspection or gastrodiaphany | |
| RU2014110007A (en) | CURVED MULTI-PLAN RECONSTRUCTION USING FORM OF FIBER FORM FORM DATA | |
| Echternach et al. | Dynamic real-time magnetic resonance imaging for the analysis of voice physiology | |
| JP2006006528A (en) | Ultrasonic diagnostic apparatus and ultrasonic signal processing method | |
| CN110786842B (en) | Method, device, system and storage medium for measuring diastolic blood flow velocity | |
| JP2014128661A (en) | Method for eliminating background noises in shear waves and related ultrasonic imaging system | |
| EP2046204A2 (en) | System and method for organizing, recording and displaying images in ultrasound imaging systems | |
| US20170014100A1 (en) | Control device, operation method thereof and diagnosis system | |
| CN115426508B (en) | Audio and video signal synchronization method, device, system and medium of medical workstation | |
| IL178316A (en) | Cerebrum evaluation device | |
| JP2009148395A (en) | Image processor, image processing program, storage medium and ultrasonic diagnostic apparatus | |
| Knollmann et al. | Quantification of atherosclerotic coronary plaque components by submillimeter computed tomography | |
| US6540680B1 (en) | Ultrasonic diagnostic apparatus | |
| CN115736989A (en) | Bidirectional guided wave measuring device, method and storage medium | |
| JP6100910B2 (en) | Information processing apparatus, photographing system, information processing method, and program | |
| Jensen et al. | Low variation and high reproducibility in plaque volume with intravascular ultrasound | |
| JP2005027941A (en) | Ultrasonic diagnostic apparatus | |
| CN101711672B (en) | Method for acquiring detailed physiological information of testee in magnetic resonance imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |