CN117978948A - Multimedia ultrasonic conference system - Google Patents

Multimedia ultrasonic conference system Download PDF

Info

Publication number
CN117978948A
CN117978948A CN202410148342.1A CN202410148342A CN117978948A CN 117978948 A CN117978948 A CN 117978948A CN 202410148342 A CN202410148342 A CN 202410148342A CN 117978948 A CN117978948 A CN 117978948A
Authority
CN
China
Prior art keywords
multimedia
data stream
video data
ultrasonic
conference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410148342.1A
Other languages
Chinese (zh)
Inventor
何泽飞
翟健爽
蓝菊芳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanyang Clear Technology Co Ltd
Original Assignee
Nanyang Clear Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanyang Clear Technology Co Ltd filed Critical Nanyang Clear Technology Co Ltd
Priority to CN202410148342.1A priority Critical patent/CN117978948A/en
Publication of CN117978948A publication Critical patent/CN117978948A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application provides a multimedia ultrasonic conference system, which comprises: the data acquisition terminal is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream; the multimedia input terminal is used for collecting audio data and/or video data and outputting an audio/video data stream; the server is connected with the data acquisition terminal and the multimedia input terminal and is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream; and the conference terminal is connected with the server, and receives and plays the multimedia conference video data stream. Through the mode, the requirements of remote video consultation, monitoring, cloud control, voice intercom and the like are met through the multimedia equipment of the integrated ultrasonic room, so that the basic ultrasonic examination service level is improved, the patient treatment experience is improved, and the medical cost is reduced.

Description

Multimedia ultrasonic conference system
Technical Field
The application relates to the technical field of video conferences, in particular to a multimedia ultrasonic conference system.
Background
A video conference system mainly relates to conference systems among participants at different sites, so that the participants far away from each other participate in collaborative activities in real time. With the widespread use of video conferences, remote video conferences can be used in medical diagnosis, monitoring, consultation, and other scenarios. The ultrasonic doctor gap is extremely large and the ultrasonic doctor gap is distributed in a market-level hospital, and the video conference system can improve the basic ultrasonic examination service level, improve the patient's experience of seeing a doctor and reduce the medical cost.
Most of audio and video conference systems in the current market are directly accessed to a conference, the conference recording is only carried out by aiming at the access equipment, and the access and the distinguishing recording scenes of certain specific equipment are not satisfied in the remote consultation scenes of medical institutions.
Disclosure of Invention
In order to solve the problems, the application provides a multimedia ultrasonic conference system which can integrate multimedia equipment of an ultrasonic room, and meet the requirements of remote video consultation, monitoring, cloud control, voice intercom and the like so as to improve the basic ultrasonic examination service level, improve the patient treatment experience and reduce the medical cost.
The application adopts a technical scheme that: there is provided a multimedia ultrasonic conference system comprising: the data acquisition terminal is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream; the multimedia input terminal is used for collecting audio data and/or video data and outputting an audio/video data stream; the server is connected with the data acquisition terminal and the multimedia input terminal and is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream; and the conference terminal is connected with the server, and receives and plays the multimedia conference video data stream.
In one embodiment, a data acquisition terminal includes: the acquisition module is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment; the conversion module is connected with the acquisition module and the server and is used for converting the ultrasonic image data into an ultrasonic video data stream.
In an embodiment, the multimedia input terminal includes a panoramic camera, and the conversion module is connected to the panoramic camera, and the conversion module is further configured to convert video data collected by the panoramic camera into an audio/video data stream for sending to the server.
In one embodiment, the conversion module sends the ultrasound video data stream and the audio video data stream to the server based on an RTMP protocol.
In an embodiment, the multimedia input terminal includes at least one of a general camera, a panoramic camera, and a pan-tilt camera.
In an embodiment, the normal camera, the panoramic camera, and the pan-tilt camera transmit the audio-video data stream to the server based on at least one of an RTMP protocol, an RTSP protocol, and a GB28181 protocol.
In an embodiment, the server transmits the multimedia conference video data stream to the conference terminal based on one of WebRTC protocol, RTMP protocol, RTSP protocol, and HTTP-FLV protocol.
In an embodiment, the conference terminal is further configured to record a screen of the conference display interface to obtain a screen recording data stream, and send the screen recording data stream to the server, where the server is configured to receive and store the screen recording data stream.
In one embodiment, the conference terminal sends a screen recording data stream to the server based on WebRTC protocol.
In an embodiment, the conference terminal is further configured to read the screen recording data stream stored by the server based on the IO stream.
The application provides a multimedia ultrasonic conference system, which comprises: the data acquisition terminal is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream; the multimedia input terminal is used for collecting audio data and/or video data and outputting an audio/video data stream; the server is connected with the data acquisition terminal and the multimedia input terminal and is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream; and the conference terminal is connected with the server, and receives and plays the multimedia conference video data stream. Through the mode, the requirements of remote video consultation, monitoring, cloud control, voice intercom and the like are met through the multimedia equipment of the integrated ultrasonic room, so that the basic ultrasonic examination service level is improved, the patient treatment experience is improved, and the medical cost is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
fig. 1 is a schematic structural diagram of a first embodiment of a multimedia ultrasound conference system provided by the present application;
fig. 2 is a schematic structural diagram of a second embodiment of the multimedia ultrasound conference system provided by the present application;
Fig. 3 is a schematic structural diagram of a third embodiment of the multimedia ultrasound conference system provided by the present application;
Fig. 4 is a schematic diagram of a display interface of the conference terminal 40 in the first embodiment;
fig. 5 is a schematic view of a display interface of the conference terminal 40 in the first embodiment;
Fig. 6 is a schematic diagram of a display interface of the data acquisition terminal 10 in the first embodiment;
Fig. 7 is a schematic diagram of a display interface of the multimedia input terminal 20 according to the first embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terms "first," "second," and the like in this disclosure are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a first embodiment of a multimedia ultrasound conference system provided by the present application, and the multimedia ultrasound conference system 100 includes a data acquisition terminal 10, a multimedia input terminal 20, a server 30, and a conference terminal 40.
The data acquisition terminal 10 is connected with the ultrasonic equipment, and the data acquisition terminal 10 is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream; the multimedia input terminal 20 is used for collecting audio data and/or video data and outputting an audio/video data stream; the server 30 is connected with the data acquisition terminal 10 and the multimedia input terminal 20, and the server 30 is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream; the conference terminal 40 is connected to the server 30, and the conference terminal 40 receives and plays the multimedia conference video data stream.
Alternatively, the data acquisition terminal 10 and the multimedia input terminal 20 are located in a hospital, which may be, for example, a cardiac functional department, an ultrasound room, typically operated by a doctor or a nurse; the server 30 is located in a hospital or third party data center and is typically operated and maintained by a system administrator or related technician; the conference terminal 40 is located in a remote hospital ward or consultation room, and is generally operated by a doctor, a nurse, or the like. In an application scenario, the conference terminal 40 is located in a previous level of hospital, the conference terminal 40 is operated by an expert doctor, the data acquisition terminal 10 and the multimedia input terminal 20 are located in a next level of hospital (e.g., community hospital), operated by an ordinary doctor or nurse, and the server 30 is located in the next level of hospital, operated by a related technician.
The data acquisition terminal 10 may be connected to a plurality of conference terminals 40 at the same time, and simultaneously perform a remote video conference with the plurality of conference terminals 40. It will be appreciated that the ultrasound conferencing system 100 may be applied to departments where specialists are relatively scarce, for example departments associated with ultrasound, such as cardiology.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a second embodiment of a multimedia ultrasound conference system provided by the present application, and the multimedia ultrasound conference system 100 includes a data acquisition terminal 10, a multimedia input terminal 20, a server 30, and a conference terminal 40.
The data acquisition terminal 10 is connected with the ultrasonic equipment, and the data acquisition terminal 10 is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream; the multimedia input terminal 20 is used for collecting audio data and/or video data and outputting an audio/video data stream; the server 30 is connected with the data acquisition terminal 10 and the multimedia input terminal 20, and the server 30 is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream; the conference terminal 40 is connected to the server 30, and the conference terminal 40 receives and plays the multimedia conference video data stream.
Optionally, the data acquisition terminal 10 includes: the acquisition module 11 is connected with the ultrasonic equipment, and the acquisition module 11 is used for acquiring ultrasonic image data output by the ultrasonic equipment; the conversion module 12 is connected with the acquisition module 11 and the server 30, and the conversion module 12 is used for converting the ultrasonic image data into an ultrasonic video data stream.
The acquisition module 11 is intelligent hardware for providing safe, stable and efficient remote control service, and synchronizes the ultrasound image plug-flow to the server 30.
Optionally, the multimedia input terminal 20 includes a panoramic camera, and is connected to the conversion module 12, where the conversion module 12 is further configured to convert video data collected by the panoramic camera into an audio/video data stream, so as to send the audio/video data stream to the server 30.
The conversion module 12 is configured to convert an image into a video stream, and may also perform Protocol conversion so as to collect a video stream or an audio/video stream, for example, the conversion module 12 may be FFmpeg, which is a multimedia processing tool and development suite, support multiple audio and video codecs, and multiple input and output formats, and may be used to implement conversion between different protocols, including RTSP (REAL TIME STREAMING Protocol), RTMP (REAL TIME MESSAGING Protocol), and so on.
The panoramic camera is a camera capable of shooting 360-degree panoramic pictures, and when panoramic cameras of different brands are accessed, FFmpeg is called to carry out protocol conversion, and the protocol conversion is converted into a universal RTMP protocol. The panoramic camera plug switch is a switch for controlling the video stream transmission of the panoramic camera, and when the switch is turned on, the panoramic camera can push the shot video stream to a designated platform or equipment for other people to watch or store in real time; when the switch is closed, video streaming will stop. Through the plug-flow switch, the switch and parameter adjustment of the camera can be remotely controlled, and a user can send instructions on the remote equipment to control the rotation, zooming, exposure and other operations of the camera so as to acquire the optimal shooting effect when needed. In an application scenario, the next-level hospital performs remote video consultation with the previous-level hospital, and the medical staff of the previous-level hospital performs parameter adjustment of the panoramic camera on the display interface of the conference terminal 40.
Optionally, the conversion module 12 sends the ultrasound video data stream and the audio video data stream to the server 30 based on the RTMP protocol.
Optionally, the multimedia input terminal 20 includes at least one of a general camera, a panoramic camera, and a pan-tilt camera (only the panoramic camera is shown in the figure).
Optionally, the common camera, the panoramic camera, and the pan-tilt camera transmit the audio and video data stream to the server 30 based on at least one of RTMP protocol, RTSP protocol, and GB28181 protocol.
In another embodiment, as shown in fig. 3, the multimedia input terminal 20 includes a common camera, a panoramic camera and a pan-tilt camera, wherein the common camera performs audio and video data acquisition and transmission based on RTSP protocol, the panoramic camera performs audio and video data acquisition and transmission based on RTMP protocol, RTSP protocol or other audio and video protocols, and is converted into an audio and video data stream according with RTMP protocol by the conversion module 12, and the pan-tilt camera performs audio and video data acquisition and transmission based on GB28181 protocol.
Wherein the RTMP protocol is a real-time protocol for transmitting audio, video and data, and the conversion module 12 transmits the video stream to the conference terminal 40 through the RTMP protocol; the RTSP is a network streaming media protocol for controlling network transmission of multimedia data such as audio and video; the GB28181 protocol is a national standard in the field of video monitoring, and can realize the pan-tilt control and acquisition output of a pan-tilt camera by accessing SDKs or GB28181 of different brands into the conference terminal 40.
In an application scenario, the common camera is used in some simple monitoring environments, for example, the common camera can be used for aiming at a computer screen to monitor the picture of the computer screen; panoramic cameras are used to capture the entire examination area, such as doctors, patients, and ultrasound equipment; the cradle head camera automatically tracks a target object, for example, photographs a body part of a patient, such as a heart, an abdomen, etc., and simultaneously automatically tracks an operation of a doctor or a nurse, and at the same time, the conference terminal 40 can be adjusted by remote control so as to obtain a better picture effect.
Alternatively, the server 30 transmits the multimedia conference video data stream to the conference terminal 40 based on one of WebRTC protocol, RTMP protocol, RTSP protocol, and HTTP-FLV protocol.
The server 30 is used for integrating multimedia protocols, storing data, and uniformly outputting video data streams and/or audio/video data streams, for example, the server can be a multimedia server, and the multimedia server is a simple and efficient real-time video server and supports RTMP, webRTC, HLS, HTTP-FLV and other various real-time streaming media protocols.
Optionally, the conference terminal 40 is further configured to record a screen of the conference display interface to obtain a screen recording data stream, and send the screen recording data stream to the server 30, where the server 30 is configured to receive and store the screen recording data stream.
Optionally, the conference terminal 40 sends the screen data stream to the server 30 based on WebRTC protocol.
Optionally, the conference terminal 40 is further configured to read the screen data stream stored by the server 30 based on the IO stream.
As shown in fig. 4, fig. 4 is a schematic view of a conference display interface of the conference terminal 40 in the first embodiment.
The conference display interface of the conference terminal 40 includes a connection button, and the medical staff can select the connection button to send a connection instruction or disconnect, and connect or disconnect with the data acquisition terminal 10 or the multimedia input terminal 20.
The conference display interface of the conference terminal 40 may display a plurality of patient ultrasound images and a plurality of patient images simultaneously, where taking 4 patient ultrasound images and 4 patient images as an example, the 4 patient ultrasound images may be arranged according to a preset layout, and the 4 patient image layouts are in one-to-one correspondence with the 4 patient ultrasound image layouts. For example, image 1 corresponds to an ultrasound image of patient a.
The plurality of patient ultrasound images and the plurality of patient views may all be in a non-selected state or any one of the plurality of patient images may be in a selected state.
Optionally, the conference display interface may be specifically operated by a mouse, a keyboard, touch control, or the like to select the data acquisition terminal 10 or the multimedia input terminal 20, and a specific expression form may be that an ultrasound image of the patient or a picture of the patient is selected. Taking a mouse and touch as an example, the user of the conference terminal 40 may directly click to select a patient ultrasound image or a patient screen, taking a keyboard as an example, the user of the conference terminal 40 may click a direction key of the keyboard to switch the patient ultrasound image or the patient screen, thereby selecting one patient ultrasound image or patient screen.
Alternatively, the patient ultrasound image or patient view in the selected state may be marked with special indicia, for example, the patient video view in the selected state may be marked with a frame effect that is distinguishable from other patient video views.
When the ultrasound image of the patient or the patient screen is in the selected state, the conference terminal 40 may select an audio connection, send an audio connection instruction to the multimedia input terminal 20, acquire audio data of the multimedia input terminal 20, and play the audio data of the multimedia input terminal 20. It can be understood that when the conference terminal 40 performs diagnostic communication with the multimedia input terminals 20, only one multimedia input terminal 20 needs to communicate at the same time, and the other multimedia input terminals 20 are in a monitored state (i.e. in a video frame), so that audio information is transmitted between the conference terminal 40 in the selected state and the multimedia input terminal 20, so as to implement voice conversation.
The conference terminal 40 may also send a camera control instruction to the multimedia input terminal 20 or send an ultrasound device operation instruction to the data acquisition terminal 10 to adjust the camera or ultrasound device settings. It will be appreciated that during the video call between the conference terminal 40 and the multimedia input terminal 20, in order to more fully understand the condition of the patient, the doctor may need to view the patient in all directions, the doctor may view the wearing of the ultrasound device or the body part of the patient, the camera of the multimedia input terminal 20 needs to be adjusted, and when the doctor needs to operate the ultrasound device, the operation interface of the data acquisition terminal 10 needs to be adjusted, which is more direct and convenient than guiding the patient through voice or manually adjusting by the medical staff of the data acquisition terminal 10.
Optionally, the camera control instruction includes at least one of a displacement adjustment instruction, a rotation adjustment instruction, a focus adjustment instruction, and a focus adjustment control instruction. The ultrasound device operating instructions include at least one of image resolution adjustment, image size adjustment, image switching.
With continued reference to fig. 4, the display interface of the conference terminal 40 further includes a camera adjustment interface for implementing the above-mentioned displacement adjustment, rotation adjustment, focal length adjustment, focal point adjustment, and the like, where the displacement adjustment may include up, down, left, right, up left, down left, up right, down right, rotation adjustment may include left and right rotations, the focal length adjustment may include focal length increase and focal length decrease, and the focal point adjustment may include focal point forward and focal point backward.
The display interface of the conference terminal 40 further includes an ultrasound device setting interface for implementing the above-mentioned image resolution adjustment, image size adjustment, image switching, etc., where the image resolution adjustment includes increasing and decreasing, the image size adjustment includes zooming in and zooming out, and the image switching includes previous and next.
The conference display interface of the conference terminal 40 may also display a plurality of screen recording pictures at the same time, where taking 3 screen recording pictures as an example, the 3 screen recording pictures may be arranged according to a preset layout. The conference terminal 40 may select a start pause button to start recording or stop recording, and when stopping recording, a recording screen is generated on the display interface, where the recording screen is arranged on the first of the preset layouts of the 3 recording screens, and a frame special effect different from other recording screens is adopted.
When the screen recording picture is played, the screen recording picture is adjusted through the adjusting button.
Alternatively, the conference terminal 40 may select at least one of a screen adjustment button, a double speed adjustment button, and a progress adjustment button to implement the above-described screen adjustment, double speed adjustment, progress adjustment, and the like, wherein the screen adjustment may include enlargement and reduction, the double speed adjustment may include left 1-time speed, 2-time speed, and 3-time speed, and the progress adjustment may include forward and backward.
Specifically, the user of the conference terminal 40 may select one of the screen shots by directly clicking a mouse or switch the screen shots by clicking a direction key of a keyboard.
Optionally, in an embodiment, the display interface of the conference terminal 40 further includes a healthcare staff display area, and the video image of the portion is mainly collected by the front camera of the conference terminal 40, and at the same time, the portion of the image may be synchronously sent to the multimedia input terminal 20 and displayed on the display interface of the multimedia input terminal 20.
Comparing fig. 4 and fig. 5, fig. 5 is a schematic diagram of a display interface of the conference terminal 40 in the first embodiment, where the conference display interface of the conference terminal 40 may display a plurality of patient ultrasound images and a plurality of patient images simultaneously, and here, taking 4 patient ultrasound images and 4 patient images as an example, the 4 patient ultrasound images may be arranged according to a preset layout, and the 4 patient image layouts correspond to the 4 patient ultrasound image layouts one by one.
When the patient ultrasound image of the data acquisition terminal 10 is in the selected state, a second display window is popped up, the second display window covers the first display window, and when the patient image of the multimedia input terminal 20 is in the selected state, a third display window is popped up, and the third display window covers the first display window and is in a parallel position with the second display window.
The second display window is used for displaying the ultrasonic image of the patient, the picture of the patient and the patient information, and the third display window is used for displaying the picture of the patient and the patient information. Wherein the patient view includes the whole body or body part of the patient, the patient information may include gender, age, medical history, and ultrasound data. It will be appreciated that the data acquisition terminal 10 may be connected to an ultrasound device to acquire ultrasound image data and transmit to the conference terminal 40, and the multimedia input terminal 20 may be connected to a camera to acquire patient images and transmit to the conference terminal 40.
It will be appreciated that since the original first display window displays multiple patient ultrasound images and multiple patient views, it may not be clear to the healthcare worker as it is smaller for a single multiple patient ultrasound image and multiple patient view. When the data acquisition terminal 10 is selected, the patient ultrasound image of the data acquisition terminal 10 will be enlarged in the second display window, and when the multimedia input terminal 20 is selected, the patient view of the multimedia input terminal 20 will be seen more clearly by the enlarged healthcare worker in the second display window.
In an application scenario, as shown in fig. 4, the conference terminal 40 clicks an ultrasound image corresponding to the image 2 in the first display window, automatically pops up a second display window as shown in fig. 5, and displays an ultrasound image corresponding to the enlarged image 2 in the second display window; the conference terminal 40 clicks the patient picture of the patient B corresponding to the image 2 in the first display window, automatically pops up a third display window as shown in fig. 4, displays the enlarged patient picture corresponding to the patient B in the third display window, establishes voice interaction with the patient B, clicks a close button in the upper right corner of the second display window or the third display window after the medical staff is communicated with the patient B, closes the second display window or the third display window, cuts off the voice interaction with the patient B, and enables all the data acquisition terminals 10 or the multimedia input terminals 20 to be in an unselected state.
As shown in fig. 6, fig. 6 is a schematic view of a display interface of the data acquisition terminal 10 in the first embodiment, which may include an ultrasonic image, a menu button, an image adjustment button, a measurement tool button, a setup button, an ultrasonic device number, a connection button, and an archive button.
Wherein, medical personnel presses the connection button, connects conference terminal 40, and data acquisition terminal 10 transmits ultrasonic video data stream to conference terminal 40, and medical personnel can carry out the adjustment of ultrasonic image through menu button, image adjustment button, measuring tool button, setting button, and medical personnel presses the archives button, will save current ultrasonic image. The saved images will be arranged in the form of thumbnails according to a preset layout.
The conference display interface of the data acquisition terminal 10 may display a plurality of ultrasound images simultaneously, where, taking 6 ultrasound images as an example, the 6 ultrasound images are arranged according to a preset layout.
The medical staff of the conference terminal 40 can select via a mouse, a keyboard, or the like, and the selected ultrasound image is displayed in the center of the screen and is subjected to enlargement processing. Meanwhile, the previous ultrasonic image or the next ultrasonic image can be selected by the ultrasonic device control instruction, and the selected ultrasonic image is sent to the conference terminal 40 by the data acquisition terminal 10.
As shown in fig. 7, fig. 7 is a schematic view of a display interface of the multimedia input terminal 20 in the first embodiment, which may include a patient video screen, a medical staff video screen, an ultrasound device screen, a camera switch button, a remote call button, and a local call button.
The camera switch button is clicked, an audio and video picture transmitted by the camera is received, a patient video picture, a medical staff video picture and an ultrasonic equipment picture are acquired by the camera of the multimedia input terminal 20, a video conference picture is acquired by the built-in camera of the conference terminal 40, a remote call is used for calling the medical staff of the conference terminal 40, and a local call is used for calling a doctor or a nurse of the hospital.
In an application scenario, a medical staff clicks "remote call" on the display interface of the corresponding multimedia input terminal 20, and the conference terminal 40 is in a blinking state on the video screen of the first display window and has a reminding sound. The medical staff of the conference terminal 40 selects the patient picture of the patient B, suggests a voice connection, and pops up a third display window to display the enlarged video picture of the patient B, the medical staff video picture, etc., as shown in fig. 5, and then the conference terminal 40 and the multimedia input terminal 20 can perform a remote inquiry.
The multimedia ultrasonic conference system provided by the application is applied to video conferences. Through the multimedia device of integrated ultrasonic room, satisfy the demand such as long-range video consultation, control, cloud accuse and pronunciation intercom to improve basic unit's ultrasonic examination service level, improve patient's experience of seeing a doctor and reduce medical cost.
The foregoing description is only of embodiments of the present application, and is not intended to limit the scope of the application, and all equivalent structures or equivalent processes using the descriptions and the drawings of the present application or directly or indirectly applied to other related technical fields are included in the scope of the present application.

Claims (10)

1. A multimedia ultrasound conferencing system, the multimedia ultrasound conferencing system comprising:
the data acquisition terminal is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment and converting the ultrasonic image data into an ultrasonic video data stream;
The multimedia input terminal is used for collecting audio data and/or video data and outputting an audio/video data stream;
the server is connected with the data acquisition terminal and the multimedia input terminal and is used for carrying out integrated processing on the ultrasonic video data stream and the audio video data stream to obtain a multimedia conference video data stream;
And the conference terminal is connected with the server, and receives and plays the multimedia conference video data stream.
2. The multimedia ultrasound conferencing system of claim 1, wherein the data acquisition terminal comprises:
the acquisition module is connected with the ultrasonic equipment and is used for acquiring ultrasonic image data output by the ultrasonic equipment;
The conversion module is connected with the acquisition module and the server and is used for converting the ultrasonic image data into an ultrasonic video data stream.
3. The multimedia ultrasound conferencing system of claim 2, wherein the multimedia input terminal comprises a panoramic camera coupled to the conversion module, the conversion module further configured to convert video data collected by the panoramic camera into an audio-video data stream for transmission to the server.
4. The multimedia ultrasound conferencing system of claim 2, wherein the conversion module sends the ultrasound video data stream and the audio video data stream to the server based on an RTMP protocol.
5. The multimedia ultrasound conferencing system of claim 1, wherein the multimedia input terminal comprises at least one of a regular camera, a panoramic camera, and a pan-tilt camera.
6. The multimedia ultrasound conferencing system of claim 5, wherein the normal camera, panoramic camera, and pan-tilt camera transmit the audio-video data stream to the server based on at least one of RTMP protocol, RTSP protocol, and GB28181 protocol.
7. The multimedia ultrasound conferencing system of claim 1, wherein the server transmits the multimedia conference video data stream to the conference terminal based on one of WebRTC protocol, RTMP protocol, RTSP protocol, and HTTP-FLV protocol.
8. The multimedia ultrasound conference system of claim 1, wherein the conference terminal is further configured to record a screen of a conference display interface to obtain a recorded screen data stream, and send the recorded screen data stream to the server, and the server is configured to receive and store the recorded screen data stream.
9. The multimedia ultrasound conferencing system of claim 8, wherein the conferencing terminal sends the screen recording data stream to the server based on WebRTC protocol.
10. The multimedia ultrasound conferencing system of claim 8, wherein the conferencing terminal is further configured to read the server-saved video data stream based on an IO stream.
CN202410148342.1A 2024-02-01 2024-02-01 Multimedia ultrasonic conference system Pending CN117978948A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410148342.1A CN117978948A (en) 2024-02-01 2024-02-01 Multimedia ultrasonic conference system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410148342.1A CN117978948A (en) 2024-02-01 2024-02-01 Multimedia ultrasonic conference system

Publications (1)

Publication Number Publication Date
CN117978948A true CN117978948A (en) 2024-05-03

Family

ID=90850835

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410148342.1A Pending CN117978948A (en) 2024-02-01 2024-02-01 Multimedia ultrasonic conference system

Country Status (1)

Country Link
CN (1) CN117978948A (en)

Similar Documents

Publication Publication Date Title
US11787060B2 (en) Remote presence system mounted to operating room hardware
US5482043A (en) Method and apparatus for telefluoroscopy
US20060122482A1 (en) Medical image acquisition system for receiving and transmitting medical images instantaneously and method of using the same
US7580054B2 (en) Automated online broadcasting system and method using an omni-directional camera system for viewing meetings over a computer network
US20060259193A1 (en) Telerobotic system with a dual application screen presentation
US20230386659A1 (en) System and method for controlling and selecting sources in a room on a network
US20120072024A1 (en) Telerobotic system with dual application screen presentation
CN102831305A (en) Auxiliary workstation for remote medical diagnosis
CN110890161A (en) Ultrasonic remote real-time consultation system
CN111667902A (en) Clinical operation management system
US11589003B2 (en) Single point devices that connect to a display device
US20120281970A1 (en) Medical video production and distribution system
US20050177312A1 (en) Real-time medical data recording system and method
Stahl et al. Teleconferencing with dynamic medical images
Albrecht et al. A portable, unobtrusive device for videorecording clinical interactions
CN117978948A (en) Multimedia ultrasonic conference system
CN111653343A (en) Medical real-time image remote consultation system and method
CN115514918B (en) Remote video method, cloud platform, communication mobile platform and storage medium
EP2446851A2 (en) One touch button for operating room support
US20110275924A1 (en) Method and System for Assimilating and Transmitting Medical Imaging and Associated Data to a Remote User
JP2001175784A (en) Electronic medical record device and introduction letter transmission device
CN111383778A (en) Film reading audio-video interaction system for operating room
EP4316410A1 (en) Surgical operation room system, image recording method, program, and medical information processing system
CN117896497A (en) Remote monitoring method, terminal and computer readable storage medium
CN113965682B (en) Remote catheter room control system and remote catheter room control method

Legal Events

Date Code Title Description
PB01 Publication