CN114079753A - Image synchronous cache display method, system, device and storage medium - Google Patents
Image synchronous cache display method, system, device and storage medium Download PDFInfo
- Publication number
- CN114079753A CN114079753A CN202111327559.1A CN202111327559A CN114079753A CN 114079753 A CN114079753 A CN 114079753A CN 202111327559 A CN202111327559 A CN 202111327559A CN 114079753 A CN114079753 A CN 114079753A
- Authority
- CN
- China
- Prior art keywords
- image
- buffer area
- images
- frame
- synchronous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention provides a method, a system, a device and a storage medium for displaying an image synchronous cache, wherein the method comprises the following steps: displaying the images of all the devices in real time; respectively and asynchronously acquiring images of each device by using each acquisition sub-thread, and respectively opening up a single-frame buffer area and a queue buffer area in each acquisition sub-thread, wherein the single-frame buffer area stores the latest image data; after each acquisition sub-thread finishes single acquisition, each device triggers interface refreshing of a corresponding image; one device finishes a single acquisition action to serve as a synchronous signal source, the latest images stored in the single frame buffer areas of the images of the devices are transferred to the respective queue buffer areas, the content of each queue buffer area keeps frame synchronization, and synchronous image buffering is achieved. By adopting the technical scheme of the invention, the images of each device can be respectively refreshed and displayed in real time at the maximum frame rate under the condition of different sampling frame rates, and can be synchronously played back and displayed.
Description
Technical Field
The invention belongs to the technical field of image processing, and particularly relates to a method, a system, a device and a storage medium for synchronous cache display of images.
Background
In the ultrasonic endoscope examination, the space is limited, and the ultrasonic endoscope and the electronic endoscope need to share one set of display device. Generally, video data of the electronic endoscope are accessed into an ultrasonic endoscope system through a video acquisition card and then are connected into a display from the ultrasonic endoscope system, so that the ultrasonic image and the electronic endoscope image are displayed simultaneously.
In the existing ultrasonic endoscope inspection scene, the ultrasonic endoscope image and the electronic endoscope image can be synchronously displayed during real-time scanning. But the two can not be played back synchronously, so that doctors need to analyze and store the lesion area under the electronic endoscope; then, the lesion area is scanned under the ultrasonic endoscope, and the images are played back, analyzed and stored again; and finally, in the editing report, doctors need to respectively select the electronic endoscope image and the ultrasonic endoscope image to carry out medical record report. Because the electronic endoscope and the ultrasonic image are obtained by two operations successively, the corresponding data is difficult to search, and the two images have the problem of image deviation.
Disclosure of Invention
Aiming at the technical problems, the invention discloses a method, a system, a device and a storage medium for synchronous image cache display, wherein the method comprises the steps of asynchronous acquisition and real-time refreshing, so that images of all devices can be respectively refreshed and displayed in real time at the maximum frame rate under the condition of different sampling frame rates, and synchronous playback and display can be realized.
In contrast, the technical scheme adopted by the invention is as follows:
an image synchronous cache display method comprises the following steps:
displaying the images of all the devices in real time;
each device corresponds to one acquisition sub-thread, each acquisition sub-thread is used for asynchronously acquiring images of each device, a single-frame buffer area and a queue buffer area are respectively opened up in each acquisition sub-thread to store image data, and the single-frame buffer area stores the latest image data;
after each acquisition sub-thread finishes single acquisition, each device triggers interface refreshing of a corresponding image;
one device finishes a single acquisition action to serve as a synchronous signal source, the latest images stored in the single frame buffer areas of the images of the devices are transferred to the queue buffer areas of the devices, and the content of each queue buffer area keeps frame synchronization, so that synchronous image caching is realized;
and when the image is frozen and played back, acquiring the image of the frame corresponding to each queue buffer area according to the current playing frame, and synchronously displaying the image of each device on the interface.
Wherein, each device may be two devices, or may be three, four or more devices.
By adopting the technical scheme, a plurality of devices with different image refreshing frame rates are asynchronously collected, and synchronous images can be obtained for display during freezing playback, so that synchronous cache and real-time display are realized. In addition, when images are stored, reports are edited and data are exported, the images of all synchronous devices can be directly used, the problem that data corresponding to all devices are difficult to search in the prior art is solved, the problem that the number of frames does not correspond due to different acquisition frame rates, asynchronous acquisition and the like is avoided, and the data synchronism is ensured. And each acquisition sub-thread respectively acquires data without influencing the main thread.
Further preferably, the image refresh rates of the respective devices are different. Of course, the above method can be used if the image refresh rate of each device is the same, but if the image refresh rate of each device is the same, other methods can be implemented in the prior art.
As a further improvement of the present invention, the queue buffer is a first-in first-out queue buffer. Furthermore, the queue buffer area sets a maximum buffer frame number, when the buffer frame number exceeds the set maximum buffer frame number, the image data which is most firstly input into the buffer area is removed, and then the new image data is input into the first-in first-out buffer area. Further, the maximum buffer frame number is 300 frames.
As a further improvement of the present invention, the image synchronous cache display method further comprises: and storing the matched images of the devices as image files. By adopting the technical scheme, the images of the synchronous devices can be directly used when the report is edited and the data is exported. As a further improvement of the invention, the devices are an ultrasonic endoscope and an electronic endoscope, and the action of acquiring the image of the ultrasonic endoscope is taken as a synchronous signal source.
The invention also discloses an image synchronous cache display system, which comprises:
the display module displays the images of all the devices in real time; the image refresh rate of each device is different;
the device comprises an acquisition module, a storage module and a display module, wherein each device corresponds to an acquisition sub-thread, each acquisition sub-thread is used for asynchronously acquiring images of each device, a single-frame buffer area and a queue buffer area are respectively opened up in each acquisition sub-thread to store image data, and the single-frame buffer area stores the latest image data;
the interface refreshing module is used for triggering the interface refreshing of the corresponding image by each device after each acquisition sub-thread finishes single acquisition;
the unloading module takes one device to finish a single acquisition action as a synchronous signal source, unloads the latest image stored in each single-frame buffer area of the image of each device to each queue buffer area, and keeps the frame synchronization of the content of each queue buffer area, thereby realizing the synchronous image caching;
and the synchronous display module acquires images corresponding to each queue buffer area according to the current playing frame when the device is frozen and replayed, and the interface synchronously displays the images of each device.
As a further improvement of the present invention, the queue buffer is a first-in first-out queue buffer; the queue buffer area sets a maximum buffer frame number, when the buffer frame number exceeds the set maximum buffer frame number, the image data which is most firstly input into the buffer area is removed, and then the new image data is input into the first-in first-out buffer area.
As a further improvement of the present invention, the image synchronization cache display system further comprises:
and the matching storage module is used for storing the matched images of the devices into image files.
As a further improvement of the invention, the devices are an ultrasonic endoscope and an electronic endoscope, and the action of acquiring the image of the ultrasonic endoscope is taken as a synchronous signal source.
The invention also discloses an image synchronous cache display device, which comprises a processor and a memory which are connected, wherein the processor is used for executing the computer program stored in the memory so as to execute the image synchronous cache display method.
The invention also discloses a computer readable storage medium, which comprises a computer program for executing the image synchronous cache display method when the computer program runs on a computer.
Compared with the prior art, the invention has the beneficial effects that:
by adopting the technical scheme of the invention, the images of each device can be respectively refreshed and displayed in real time at the maximum frame rate under the condition of different sampling frame rates; the multi-thread asynchronous acquisition does not influence other operations of a user; in the frozen playback state, images of the matched devices can be played back and displayed synchronously; the matched images are stored as image files, synchronous images of all devices can be loaded quickly, time required for browsing data is reduced, and efficiency is improved.
Drawings
Fig. 1 is a basic flowchart of image data processing of an image synchronous cache display method according to embodiment 1 of the present invention.
Fig. 2 is a basic flow in the frozen playback of the image synchronization buffer display method according to embodiment 1 of the present invention.
Fig. 3 is a basic flowchart of image data processing of an image synchronous cache display method according to embodiment 2 of the present invention.
Detailed Description
Preferred embodiments of the present invention are described in further detail below.
Example 1
In this embodiment, image processing of an ultrasonic endoscope and an electronic endoscope is described as an example.
The ultrasonic endoscope transmits and receives returned ultrasonic signals through an ultrasonic transducer, and then performs a series of algorithm processing on data to realize ultrasonic imaging, wherein the image refreshing frame rate of the ultrasonic endoscope is about 10 frames per second. The electronic endoscope image is collected by the video collecting card, and secondary cutting is carried out on the collected electronic endoscope image according to the user requirement so as to achieve the best display effect, and the refreshing frame number of the electronic endoscope image can reach 60 frames per second. Therefore, the ultrasonic endoscope image and the electronic endoscope image have great difference in frame rate and data amount. The method of the following embodiment performs asynchronous acquisition on the two images with different frame rates and data volumes, and realizes synchronous cache and real-time display. As shown in fig. 1 and 2, the method specifically includes the following steps:
(1) and displaying the ultrasonic endoscope image and the electronic endoscope image with different frame rates in real time.
(2) And using an acquisition mode of two sub-threads to asynchronously acquire an ultrasonic endoscope image and an electronic endoscope image.
(3) The ultrasonic endoscope image and the electronic endoscope image respectively trigger refresh response without mutual interference and have no waiting logic among threads, so that the ultrasonic endoscope image can reach a refresh frame rate of 10 frames at most, and the electronic endoscope image can reach a refresh frame rate of 60 frames at most.
(4) And a single frame buffer area and a first-in first-out queue buffer area are opened up to buffer the data.
(5) The acquired ultrasonic endoscope image is used as a synchronous signal source to complete the action, the asynchronously acquired ultrasonic endoscope image and the electronic endoscope image are synchronously cached, and the asynchronously acquired ultrasonic endoscope image and the electronic endoscope image are transferred from the single-frame cache region to the first-in first-out cache region.
(6) Open up FIFO buffer respectively, carry out the buffer to gathering ultrasonic endoscope image and electron endoscope image, set for the maximum buffer frame number, when the buffer frame number surpassed the maximum buffer frame number of setting for, remove the image data of the most advanced buffer area, put into FIFO buffer with new image data again, guarantee data can not overflow.
(7) And acquiring and displaying the synchronous ultrasonic endoscope image and the electronic endoscope image from the first-in first-out buffer area during freeze playback.
(8) And storing the matched ultrasonic endoscope image and the matched electronic endoscope image as an image file.
In the steps, when the ultrasonic endoscope image and the electronic endoscope image are acquired, the refreshing frame rates of the ultrasonic endoscope image and the electronic endoscope image are different, so that a sub-thread is respectively developed, and an asynchronous acquisition mode is used; respective double buffer areas are opened up, so that real-time display and frozen playback are not influenced mutually, the single-frame buffer area is used for storing the latest images, and the queue buffer area is used for storing the synchronous images. When the number of the queue buffer is larger than a threshold (for example, 300), a first-in first-out mechanism is adopted to remove the image data of the most advanced buffer, and then new image data is put into the first-in first-out buffer, so that the images in the queue buffer are all the newest, and the data cannot overflow.
In an independent acquisition thread, a single-frame buffer area is opened up to store the latest image data, the image data is written into an asynchronous single-frame image buffer area, two acquisition sub-threads respectively trigger interface refreshing of corresponding images after completing single acquisition without mutual interference, and waiting logic does not exist between the threads, so that the ultrasonic endoscope image can reach a refreshing frame rate of 10 frames at most, and the electronic endoscope image can reach a refreshing frame rate of 60 frames at most. Meanwhile, the action of acquiring the ultrasonic endoscope image is taken as a synchronous signal source, the latest images stored in a single-frame buffer area of the ultrasonic image and the electronic endoscope image are transferred to respective queue buffer areas, 300 frames of images can be cached in the queue buffer areas to the maximum, the queue buffer areas are designed to be of a first-in first-out type, the actual contents of the two queue buffer areas keep frame synchronization, the problem that the frame number does not correspond due to different acquisition frame rates, asynchronous acquisition and the like is avoided, and the data synchronism is ensured.
When the frozen playback is started, the system calculates the current playing frame, then the current playing frame is respectively sent to two first-in first-out cache regions to obtain corresponding images, and the interface synchronously displays the two images. The system ensures the synchronism of the queue buffer area in the real-time acquisition process, so that the ultrasonic endoscope images and the electronic endoscope images are matched one by one in the freeze playback process. And will match ultrasonic endoscope image and electron scope image storage that well be the image file, when picture, edit report, data export, all can directly use synchronous ultrasonic endoscope image and electron scope image, but synchronous ultrasonic endoscope image and electron scope image of fast loading have reduced the required time of browsing data, have improved efficiency.
The embodiment also discloses an image synchronization cache display system, which includes:
the display module is used for displaying images of the ultrasonic endoscope and the electronic endoscope in real time;
the system comprises an acquisition module, an ultrasonic endoscope and an electronic endoscope, wherein the ultrasonic endoscope and the electronic endoscope respectively correspond to an acquisition sub-thread, the two acquisition sub-threads are used for respectively and asynchronously acquiring images of the ultrasonic endoscope and the electronic endoscope, a single-frame buffer area and a queue buffer area are respectively opened up for storing image data in the two acquisition sub-threads, and the single-frame buffer area stores the latest image data; the queue buffer area is a first-in first-out queue buffer area; the queue buffer area sets a maximum buffer frame number, when the buffer frame number exceeds the set maximum buffer frame number, the image data which is most firstly input into the buffer area is removed, and then the new image data is input into the first-in first-out buffer area.
And the interface refreshing module is used for triggering the interface refreshing of the corresponding image by each device after each acquisition sub-thread finishes single acquisition.
And the unloading module takes one acquisition action of one device as a synchronous signal source, unloads the latest image stored in the single frame buffer area of each device to the respective queue buffer area, and keeps the frame synchronization of the content of each queue buffer area, thereby realizing the synchronous image caching.
And the synchronous display module acquires images corresponding to each queue buffer area according to the current playing frame when the device is frozen and replayed, and the interface synchronously displays the images of each device.
And the matching storage module is used for storing the matched images of the devices into image files.
The equipment is an ultrasonic endoscope and an electronic endoscope, and the action of collecting the image of the ultrasonic endoscope is completed as a synchronous signal source.
The embodiment of the invention also discloses an image synchronous cache display device, which comprises a processor and a memory which are connected, wherein the processor is used for executing the computer program stored in the memory so as to execute the image synchronous cache display method.
The invention also discloses a computer readable storage medium, which comprises a computer program, when the computer program runs on a computer, the computer program executes the image synchronous cache display method.
Example 2
On the basis of embodiment 1, the device can be expanded to 3 or more devices for image synchronous cache display. For example, the method can be used for performing asynchronous acquisition on one ultrasonic endoscope and two electronic endoscopes, so as to realize synchronous caching and real-time display of images, and the processing flow chart is shown in fig. 3, and specifically comprises the following steps:
(1) and displaying the ultrasonic endoscope image and the images of the two electronic endoscopes in real time.
(2) And using the acquisition modes of three sub-threads to asynchronously acquire the images of the ultrasonic endoscope and the images of the two electronic endoscopes respectively.
(3) The ultrasonic endoscope image and the two electronic endoscope images respectively trigger refresh response without mutual interference and have no waiting logic between threads, so that the ultrasonic endoscope image can reach a refresh frame rate of 10 frames at most, and the electronic endoscope image can reach a refresh frame rate of 60 frames at most.
(4) And a single frame buffer area and a first-in first-out queue buffer area are opened up to buffer the data.
(5) The acquired ultrasonic endoscope image is used as a synchronous signal source to complete the action, the asynchronously acquired ultrasonic endoscope image and the electronic endoscope image are synchronously cached, and the asynchronously acquired ultrasonic endoscope image and the electronic endoscope image are transferred from the single-frame cache region to the first-in first-out cache region.
(6) Open up FIFO buffer respectively, carry out the buffer to gathering ultrasonic endoscope image and electron endoscope image, set for the maximum buffer frame number, when the buffer frame number surpassed the maximum buffer frame number of setting for, remove the image data of the most advanced buffer area, put into FIFO buffer with new image data again, guarantee data can not overflow.
(7) And acquiring and displaying the synchronous ultrasonic endoscope image and the electronic endoscope image from the first-in first-out buffer area during freeze playback.
(8) And storing the matched ultrasonic endoscope image and the matched electronic endoscope image as an image file.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (10)
1. An image synchronous cache display method is characterized by comprising the following steps:
displaying the images of all the devices in real time;
each device corresponds to one acquisition sub-thread, each acquisition sub-thread is used for asynchronously acquiring images of each device, a single-frame buffer area and a queue buffer area are respectively opened up in each acquisition sub-thread to store image data, and the single-frame buffer area stores the latest image data;
after each acquisition sub-thread finishes single acquisition, each device triggers interface refreshing of a corresponding image;
one device finishes a single acquisition action to serve as a synchronous signal source, the latest images stored in the single frame buffer areas of the images of the devices are transferred to the queue buffer areas of the devices, and the content of each queue buffer area keeps frame synchronization, so that synchronous image caching is realized;
and when the image is frozen and played back, acquiring the image of the frame corresponding to each queue buffer area according to the current playing frame, and synchronously displaying the image of each device on the interface.
2. The image synchronous cache display method according to claim 1, characterized in that: the queue buffer area is a first-in first-out queue buffer area; the queue buffer area sets a maximum buffer frame number, when the buffer frame number exceeds the set maximum buffer frame number, the image data which is most firstly input into the buffer area is removed, and then the new image data is input into the first-in first-out buffer area.
3. The image synchronous cache display method according to claim 1, further comprising: and storing the matched images of the devices as image files.
4. The image synchronous cache display method according to claims 1-3, characterized in that: the equipment is an ultrasonic endoscope and an electronic endoscope, and the action of collecting the image of the ultrasonic endoscope is completed as a synchronous signal source.
5. An image synchronization cache display system, characterized in that: it includes:
the display module displays the images of all the devices in real time;
the device comprises an acquisition module, a storage module and a display module, wherein each device corresponds to an acquisition sub-thread, each acquisition sub-thread is used for asynchronously acquiring images of each device, a single-frame buffer area and a queue buffer area are respectively opened up in each acquisition sub-thread to store image data, and the single-frame buffer area stores the latest image data;
the interface refreshing module is used for triggering the interface refreshing of the corresponding image by each device after each acquisition sub-thread finishes single acquisition;
the unloading module takes one device to finish a single acquisition action as a synchronous signal source, unloads the latest image stored in each single-frame buffer area of the image of each device to each queue buffer area, and keeps the frame synchronization of the content of each queue buffer area, thereby realizing the synchronous image caching;
and the synchronous display module acquires images corresponding to each queue buffer area according to the current playing frame when the device is frozen and replayed, and the interface synchronously displays the images of each device.
6. The image synchronization cache display system according to claim 5, wherein: the queue buffer area is a first-in first-out queue buffer area; the queue buffer area sets a maximum buffer frame number, when the buffer frame number exceeds the set maximum buffer frame number, the image data which is most firstly input into the buffer area is removed, and then the new image data is input into the first-in first-out buffer area.
7. The image synchronization cache display system according to claim 5, further comprising:
and the matching storage module is used for storing the matched equipment images as image files.
8. The image synchronization cache display system according to claims 5-7, wherein: the equipment is an ultrasonic endoscope and an electronic endoscope, and the action of collecting the image of the ultrasonic endoscope is completed as a synchronous signal source.
9. An image synchronization buffer display device, which comprises a processor and a memory which are connected, is characterized in that: the processor is used for executing the computer program stored in the memory to execute the image synchronous cache display method according to any one of claims 1-4.
10. A computer-readable storage medium, comprising a computer program which, when run on a computer, performs the image synchronized cache display method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111327559.1A CN114079753A (en) | 2021-11-10 | 2021-11-10 | Image synchronous cache display method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111327559.1A CN114079753A (en) | 2021-11-10 | 2021-11-10 | Image synchronous cache display method, system, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114079753A true CN114079753A (en) | 2022-02-22 |
Family
ID=80284097
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111327559.1A Pending CN114079753A (en) | 2021-11-10 | 2021-11-10 | Image synchronous cache display method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114079753A (en) |
-
2021
- 2021-11-10 CN CN202111327559.1A patent/CN114079753A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8600134B2 (en) | Method and system for processing images acquired in real time through a medical device | |
| US7119814B2 (en) | System and method for annotation on a moving image | |
| US9186041B2 (en) | Medical information recording apparatus that determines medical scene or changing of medical scene, synthesizes images obtained by medical equipment, and records synthesized image | |
| EP2014219A2 (en) | Endoscopic image processing apparatus | |
| US20050251037A1 (en) | Ultrasound diagnostic apparatus | |
| WO2006100808A1 (en) | Capsule endoscope image display controller | |
| US20080249402A1 (en) | System or Synchronised Playback of Video Image Clips | |
| CN101257838A (en) | Image display apparatus | |
| CN112818959A (en) | Operation flow identification method, device, system and computer readable storage medium | |
| CN115082448A (en) | Method and device for scoring cleanliness of intestinal tract and computer equipment | |
| CN101155543A (en) | Image display apparatus | |
| CN114079753A (en) | Image synchronous cache display method, system, device and storage medium | |
| JP6172990B2 (en) | Image recording apparatus, image recording processing control method, and program thereof | |
| JPH09116872A (en) | Image recorder | |
| KR20110068863A (en) | Image processing system, image processing apparatus, image pickup apparatus, method, and computer-readable medium | |
| JP2000020630A (en) | Medical image file system | |
| WO2018230074A1 (en) | System for assisting observation of endoscope image | |
| WO2018043585A1 (en) | Endoscope device, information processing device, and program | |
| JPH01189772A (en) | Image filing device | |
| CN109887578B (en) | Synchronous processing method of dual-mode data | |
| US7497829B2 (en) | Data recording system | |
| CN111835957B (en) | Video processing method, video processing device and video processing equipment | |
| JP2003329490A (en) | Picture/measuring data synchronous display device | |
| CN110600108A (en) | Redundant image processing method of capsule endoscope | |
| CN113506608B (en) | Ultrasonic film processing method and ultrasonic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |