CN111899849A - Information sharing method, device, system, equipment and storage medium - Google Patents

Information sharing method, device, system, equipment and storage medium Download PDF

Info

Publication number
CN111899849A
CN111899849A CN202010601580.5A CN202010601580A CN111899849A CN 111899849 A CN111899849 A CN 111899849A CN 202010601580 A CN202010601580 A CN 202010601580A CN 111899849 A CN111899849 A CN 111899849A
Authority
CN
China
Prior art keywords
information
terminal
image information
sharing
shared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010601580.5A
Other languages
Chinese (zh)
Inventor
付明旺
杨金钰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tangqiao Technology Hangzhou Co ltd
TechBridge Inc
Original Assignee
Tangqiao Technology Hangzhou Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tangqiao Technology Hangzhou Co ltd filed Critical Tangqiao Technology Hangzhou Co ltd
Priority to CN202010601580.5A priority Critical patent/CN111899849A/en
Publication of CN111899849A publication Critical patent/CN111899849A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Landscapes

  • Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Engineering & Computer Science (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides an information sharing method, an information sharing device, an information sharing system, information sharing equipment and a storage medium, wherein the method comprises the following steps: receiving ultrasonic image information and first scene image information of a detection object acquired by a first terminal, and receiving a subscription request of a second terminal to the first terminal; according to the subscription request, selecting a shared information stream from the ultrasonic image information and the first scene image information; and sending the shared information stream to the second terminal. The method and the device realize information sharing between the first terminal and the second terminal by respectively receiving the ultrasonic image information and the first scene image information of the first terminal, receiving a subscription request of the second terminal for the first terminal, then selecting a shared information stream which needs to be subscribed by the second terminal from the information sent by the first terminal based on the subscription request, and finally sending the selected shared information stream to the second terminal.

Description

Information sharing method, device, system, equipment and storage medium
Technical Field
The present application relates to the field of information processing technologies, and in particular, to an information sharing method, apparatus, system, device, and storage medium.
Background
A medical ultrasonic device is a medical apparatus which is developed according to the ultrasonic principle and can be applied to the field of medical health. The signals received back from the probe may be processed and displayed. The ultrasonic probe can transmit and receive ultrasonic waves, convert electric signals sent by the host machine into ultrasonic signals with high-frequency oscillation, convert the ultrasonic signals reflected from the organs of the tissue into electric signals to form ultrasonic images and display the ultrasonic images on the display of the host machine. Ultrasound imaging has become one of the essential aids in diagnostic and therapeutic procedures. The ultrasonic equipment is called a visual stethoscope, and has the advantages of no radiation, convenience and real time compared with other image examination equipment.
However, in clinical practice, only a few professionals can correctly interpret the ultrasound image, limiting the application of ultrasound devices.
Disclosure of Invention
An object of the embodiments of the present application is to provide an information sharing method, apparatus, system, device and storage medium, which are used to implement information sharing between a first terminal and a second terminal.
A first aspect of an embodiment of the present application provides an information sharing method, including: receiving ultrasonic image information and first scene image information of a detection object acquired by a first terminal, and receiving a subscription request of a second terminal to the first terminal; according to the subscription request, selecting a shared information stream from the ultrasonic image information and the first scene image information; and sending the shared information stream to the second terminal.
In an embodiment, before the receiving the ultrasound image information and the first scene image information of the detection object acquired by the first terminal and receiving the subscription request of the second terminal to the first terminal, the method further includes: receiving a first sharing request of the first terminal and a second sharing request of the second terminal; and establishing information link with the first terminal according to the first sharing request, and establishing information link with the second terminal according to the second sharing request.
In an embodiment, the first sharing request includes: sharing authority information; before the selecting a shared information stream from the ultrasound image information and the first scene image information according to the subscription request, the method further includes: judging whether the sharing authority information has the authority of the second terminal or not; and if the authority of the second terminal exists in the sharing authority information, selecting a sharing information stream from the ultrasonic image information and the first scene image information according to the subscription request.
In an embodiment, the sending the shared information stream to the second terminal includes: analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow; and according to the initial transmission channel, independently sending each information flow in the shared information flow to the second terminal.
In one embodiment, the method further comprises: receiving a feedback information stream sent by the second terminal; and sending the feedback information stream to the first terminal.
A second aspect of the embodiments of the present application provides an information sharing method, including: acquiring ultrasonic image information of a detection object, and acquiring first scene image information in a first preset area away from the detection object; sending the ultrasonic image information and the first scene image information to a server; receiving a feedback information stream sent by the server; and analyzing the feedback information flow to generate feedback image information.
In one embodiment, the method further comprises: collecting first mark information aiming at the feedback image information; and sending the first mark information to the server.
A third aspect of the embodiments of the present application provides an information sharing method, including: receiving a shared information stream sent by a server; analyzing the shared information stream to generate shared image information; acquiring second mark information of the shared image information and second scene image information in a second preset area; generating a feedback information stream according to the second mark information and the second scene image information; and sending the feedback information stream to the server.
A fourth aspect of the embodiments of the present application provides an information sharing apparatus, including: the first receiving module is used for receiving ultrasonic image information and first scene image information of a detection object acquired by a first terminal and receiving a subscription request of a second terminal to the first terminal; the selecting module is used for selecting a shared information stream from the ultrasonic image information and the first scene image information according to the subscription request; and the first sending module is used for sending the shared information stream to the second terminal.
In one embodiment, the method further comprises: the second receiving module is used for receiving a first sharing request of the first terminal and a second sharing request of the second terminal before receiving ultrasonic image information and first scene image information of a detection object acquired by the first terminal and receiving a subscription request of the second terminal to the first terminal; and the establishing module establishes information link with the first terminal according to the first sharing request and establishes information link with the second terminal according to the second sharing request.
In an embodiment, the first sharing request includes: sharing authority information; the device further comprises: the judging module is used for judging whether the authority of the second terminal exists in the sharing authority information before selecting a sharing information stream from the ultrasonic image information and the first scene image information according to the subscription request; the selecting module is further configured to select a shared information stream from the ultrasound image information and the first scene image information according to the subscription request if the permission of the second terminal exists in the shared permission information.
In one embodiment, the sending module is configured to: analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow; and according to the initial transmission channel, independently sending each information flow in the shared information flow to the second terminal.
In one embodiment, the method further comprises: a third receiving module, configured to receive a feedback information stream sent by the second terminal; and the second sending module is used for sending the feedback information stream to the first terminal.
A fifth aspect of the embodiments of the present application provides an information sharing apparatus, including: the acquisition module is used for acquiring ultrasonic image information of a detection object and acquiring first scene image information in a first preset area away from the detection object; the third sending module is used for sending the ultrasonic image information and the first scene image information to a server; a fourth receiving module, configured to receive a feedback information stream sent by the server; and the first analysis module is used for analyzing the feedback information flow to generate feedback image information.
In one embodiment, the method further comprises: the first acquisition module is used for acquiring first mark information aiming at the feedback image information; and the fourth sending module is used for sending the first marking information to the server.
A sixth aspect of the present embodiment provides an information sharing apparatus, including: the fourth receiving module is used for receiving the shared information stream sent by the server; the second analysis module is used for analyzing the shared information stream to generate shared image information; the second acquisition module is used for acquiring second mark information of the shared image information and second scene image information in a second preset area; a generating module, configured to generate a feedback information stream according to the second mark information and the second scene image information; and a fifth sending module, configured to send the feedback information stream to the server.
A seventh aspect of the present embodiment provides an information sharing system, including: a first terminal configured to perform the method of the second aspect of the embodiments of the present application and any embodiment thereof; a server for performing the method of the first aspect of the embodiments of the present application and any of the embodiments thereof; a second terminal configured to perform the method of the third aspect of the embodiments of the present application and any embodiment thereof.
An eighth aspect of the embodiments of the present application provides an electronic device, including: a memory to store a computer program; the processor is configured to execute the method of the first aspect and any embodiment thereof in the embodiments of the present application, so that the first terminal and the second terminal perform information sharing.
A ninth aspect of an embodiment of the present application provides an electronic device, including: the ultrasonic detector is used for acquiring ultrasonic image information of a detection object; a memory to store a computer program; a processor configured to execute the method of the second aspect of the embodiments of the present application and any embodiment thereof, so as to share an information stream including the ultrasound image information to a server.
A tenth aspect of an embodiment of the present application provides an electronic device, including: a memory to store a computer program; a processor configured to execute the third aspect of the embodiments of the present application and the method of any embodiment thereof to share an information stream to a server.
An eleventh aspect of embodiments of the present application provides a non-transitory electronic device-readable storage medium, including: a program which, when run by an electronic device, causes the electronic device to perform the method of the first aspect of an embodiment of the present application and any embodiment thereof.
According to the information sharing method, the device, the system, the equipment and the storage medium, the ultrasonic image information and the first scene image information of the first terminal are respectively received, the subscription request of the second terminal for the first terminal is received, then the shared information flow which needs to be subscribed by the second terminal is selected from the information sent by the first terminal based on the subscription request, and finally the selected shared information flow is sent to the second terminal, so that the information sharing between the first terminal and the second terminal is realized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an information sharing system according to an embodiment of the present application;
fig. 4 is a flowchart illustrating an information sharing method according to an embodiment of the present application;
fig. 5 is a flowchart illustrating an information sharing method according to an embodiment of the present application;
fig. 6 is a flowchart illustrating an information sharing method according to an embodiment of the present application;
fig. 7 is a flowchart illustrating an information sharing method according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an information sharing apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of an information sharing apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an information sharing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the present application, the terms "first," "second," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
As shown in fig. 1, the present embodiment provides an electronic apparatus 1 including: at least one processor 11 and a memory 12, one processor being exemplified in fig. 1. The processor 11 and the memory 12 are connected by the bus 10, and the memory 12 stores instructions executable by the processor 11, and the instructions are executed by the processor 11, so that the electronic device 1 can execute all or part of the flow of the method in the embodiments described below, so as to enable the first terminal and the second terminal to share information.
In an embodiment, the electronic device 1 may be a mobile phone, a notebook computer, a desktop computer, or the like.
As shown in fig. 2, the present embodiment provides an electronic device 2, including: at least one processor 21, a memory 22 and an ultrasound detector 23, one processor being exemplified in fig. 1. The processor 21, the memory 22 and the ultrasound detector 23 are connected by the bus 20, and the memory 22 stores instructions executable by the processor 21, and the instructions are executed by the processor 21, so that the electronic device 2 can execute all or part of the procedures of the method in the embodiments described below, so as to share the information stream including the ultrasound image information to the server.
In an embodiment, the electronic device 2 may be an ultrasonic testing device or a system formed by an ultrasonic testing device and a computer, a mobile phone, or the like.
Please refer to fig. 3, which is an embodiment of an information sharing system 30 applied to a remote ultrasound detection scenario, comprising: a server 31, a first terminal 32 and a second terminal 33, wherein:
the first terminal 32 may be an ultrasonic testing device (ultrasonic terminal) of a hospital, and may be configured to detect ultrasonic image information of a patient (testing object) in real time, and when a medical expert is not beside the ultrasonic testing device and needs to view the ultrasonic image information, the medical expert may perform information sharing with the remote second terminal 33, and the medical expert may view the ultrasonic image information through the second terminal 33. The first terminal 32 first performs authentication login in the server 31, establishes a network conference, and performs real-time sharing in the form of the network conference. The first terminal 32 may be implemented by the electronic device 2 shown in fig. 2.
The server 31 is used for information transfer between the first terminal 32 and the second terminal 33. By receiving the ultrasound image information and the first scene image information of the detection object acquired by the first terminal 32 in real time, a subscription request of the second terminal 33 to the first terminal 32 is received. And selecting a shared information stream from the ultrasonic image information and the first scene image information according to the subscription request. The shared information stream is sent to the second terminal 33. The server 31 may be implemented by the electronic device 1 shown in fig. 1.
The second terminal 33, which may be a mobile phone or a computer used by a medical expert user, also needs to perform authentication login in the server 31, and join in the network conference established by the first terminal 32, and then, based on the subscription request, requests the server 31 for a corresponding shared information stream, where the shared information stream includes ultrasound image information to be viewed. The feedback information stream can be sent to the server 31 and forwarded to the ultrasonic detection device through the server 31, so that the process of remote real-time ultrasonic detection is realized. The second terminal 33 may also be implemented by the electronic device 1 shown in fig. 1.
In one embodiment, there may be a plurality of expert users participating in the network conference, and the second terminal 33 may include a plurality of users. Multiple parties agree on relevant basic information of meeting time, place, participants and patients (detection objects) in the form of network meeting.
In an embodiment, the second terminal 33 may also be used to create a network conference, and the first terminal 32 joins the network conference created by the second terminal 33 through the sharing authority.
In an embodiment, the first terminal 32 and the second terminal 33 establish an encrypted transmission channel with the cloud server 31, so that participants can perform audio/video, whiteboard and annotation communication in real time.
In an embodiment, assuming that the medical expert user Alice uses the second terminal 33 to create a web conference, the ultrasound detection user Bob joins the web conference through the first terminal 32, and the server 31 may be divided into the signaling server 311 and the media server 312, the signaling process in the information sharing based on the ultrasound detection scenario may be as follows:
alice logs on to the application/signaling server 31 for authentication.
Alice creates or joins a meeting (providing information such as the name of the meeting/attendees/duration of the meeting/password for the meeting).
c. The application/signaling server 31 allocates necessary resources for the newly created conference, and saves and returns conference resource information (such as media server 31 information) to Alice.
And d, according to the information returned by the signaling server 31, alice establishes an audio/video transmission channel with the media server 31, and negotiates encryption information through a DTLS (data packet Transport Layer Security) key exchange protocol.
Alice publishes information such as local audio and video streams.
Bob logs in the application/signaling server 31 for authentication.
Bob queries and joins the conference associated with him.
h. The application/signaling server 31 returns conference resource information (such as media server 31 information) to Bob.
And i, building an audio and video transmission channel with the media server 31 by the Bob according to the information returned by the signaling server 31, and negotiating encryption information through a DTLS key exchange protocol.
And j, Bob publishes information such as local audio and video streams and subscribes audio and video streams of Alice, and Alice subscribes Bob audio and video streams.
The media stream transmission process may be as follows:
k. if someone subscribes to Alice's audio/video in the conference, Alice collects the audio/video locally, encodes, encrypts, and transmits to the media server 31
The media server 31 routes the corresponding media stream to the corresponding subscriber (such as Bob) according to the subscription information of the media stream in the conference
And m, receiving the media stream by Bob, decrypting, separating audio and video, decoding and rendering in real time.
Bob's audio-video media stream may be transmitted to its terminal through a process similar to a/b/c above.
In an embodiment, the audio and video data streams, the white board, the video labels and other information of each party during the network conference are recorded in the cloud server 31 for later retrieval.
Please refer to fig. 4, which is an information sharing method according to an embodiment of the present application, and the method may be executed by the electronic device 1 shown in fig. 1 as the server 31, and may be applied to the remote ultrasound detection scenario shown in fig. 3 to implement remote sharing of the ultrasound image information and the first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The method comprises the following steps:
step 401: the ultrasound image information and the first scene image information of the detection object acquired by the first terminal 32 are received, and the subscription request of the second terminal 33 to the first terminal 32 is received.
In this step, the ultrasound image information and the first scene image information of the detection object acquired by the first terminal 32 may be received in real time through the established encrypted channel, and the subscription request of the second terminal 33 to the first terminal 32 may be received in real time. The ultrasonic image information and the first scene image information can be received in real time by adopting different channels respectively. The first scene image information is image data within a certain range from the detection object, for example, around the ultrasonic detection device, an operation doctor may generate operation video data and/or audio data for the detection object or the ultrasonic detection device, and the first scene image information is media stream information composed of the operation video data and/or audio data.
Step 402: and selecting a shared information stream from the ultrasonic image information and the first scene image information according to the subscription request.
In this step, the subscription request may carry an identifier of an information stream to which the second terminal 33 wants to subscribe, and the server 31 selects the subscribed media stream from the information stream sent from the first terminal 32 as the shared information stream according to the identifier in the subscription information.
Step 403: the shared information stream is sent to the second terminal 33.
In this step, the selected shared information stream is sent to the second terminal 33 through the established channel in real time, so that the first terminal 32 and the second terminal 33 share the ultrasound image information and the scene image information.
The information sharing method receives the ultrasonic image information and the first scene image information of the first terminal 32, respectively, receives the subscription request of the second terminal 33 for the first terminal 32, then selects the shared information stream to be subscribed of the second terminal 33 from the information sent by the first terminal 32 based on the subscription request, and finally sends the selected shared information stream to the second terminal 33, so that information sharing between the first terminal 32 and the second terminal 33 is realized.
Please refer to fig. 5, which is an information sharing method according to an embodiment of the present application, and the method may be executed by the electronic device 1 shown in fig. 1 and may be applied to a remote ultrasound detection scenario shown in fig. 3 to implement remote sharing of ultrasound image information and first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The method comprises the following steps:
step 501: a first sharing request of the first terminal 32 and a second sharing request of the second terminal 33 are received.
In this step, before information sharing is performed, in order to ensure the security of the information flow, first, authentication login is performed on the first terminal 32 and the second terminal 33, and the first sharing request and the second sharing request sent from the first terminal 32 and the second terminal are received respectively.
Step 502: an information link is established with the first terminal 32 according to the first sharing request, and an information link is established with the second terminal 33 according to the second sharing request.
In this step, information links are established with the corresponding terminals according to the corresponding sharing requests, respectively.
The content of step 501 and step 502 can be referred to the detailed description of signaling procedures a to j in the above embodiments.
Step 503: the ultrasound image information and the first scene image information of the detection object acquired by the first terminal 32 are received, and the subscription request of the second terminal 33 to the first terminal 32 is received. See the description of step 401 in the above embodiments for details.
Step 504: it is determined whether or not the authority of the second terminal 33 exists in the sharing authority information. The first sharing request comprises: and sharing the authority information.
In this step, in order to further ensure the security of information sharing, before selecting the shared information stream, subscription authentication may be performed on the second terminal 33, whether the authority of the second terminal 33 exists is determined by querying in the sharing authority information sent by the first terminal 32, if yes, step 505 is entered, otherwise, it indicates that the second terminal 33 does not have the information subscription authority, a prompt message may be sent to the second terminal 33, and information sharing is ended.
Step 505: if the authority of the second terminal 33 exists in the sharing authority information, the sharing information stream is selected from the ultrasonic image information and the first scene image information according to the subscription request. See the description of step 402 in the above embodiments for details.
Step 506: and analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow.
In this step, the server 31 may parse the shared information stream to obtain a transmission channel corresponding to each information stream, such as a video transmission channel or an audio transmission channel, a signaling channel, and so on.
Step 507: each of the shared information streams is independently transmitted to the second terminal 33 according to the initial transport channel.
In this step, when the ultrasound detection device (the first terminal 32) performs an examination on a patient, the generated ultrasound image information and the scene image information generated by the operation technique of the doctor are relayed by the real-time communication server 31 to be transmitted to the second terminal 33 in real time, and the delay generated in the transmission process is required to be lower than a predetermined time threshold, for example, lower than 100 ms. Each of the shared information streams may be independently transmitted to the second terminal 33 according to the initial transport channel.
In an embodiment, by reducing unnecessary buffering and data redundancy in the whole information stream transmission path, an extremely low delay is achieved, and the following technical means can be flexibly adopted according to the quality of network transmission: the server 31 does not cache video and routes in time. UDP (User Datagram Protocol) transmission is preferably used. Closed channel encryption may be considered within an intranet or a private network.
Step 508: the feedback information stream sent by the second terminal 33 is received.
In this step, after the shared information stream is sent to the second terminal 33 of the expert user, the expert user may feed back some information through the second terminal 33, and the feedback information stream at least includes: second scene image information acquired by the second terminal 33, mark information entered by the expert user for the ultrasound image information, and the like. And receiving the feedback information stream in real time.
Step 59: the feedback information stream is sent to the first terminal 32.
In this step, the feedback information stream is sent to the first terminal 32 in real time, and the original transmission channel of the feedback information stream may be first analyzed, and then each information stream in the feedback information stream is independently sent to the first terminal 32 according to the original transmission channel.
In an embodiment, the feedback information stream may further include a remote control instruction of the second terminal 33 to the first terminal 32, for example, a remote control instruction to the ultrasonic detection device.
Please refer to fig. 6, which is an information sharing method according to an embodiment of the present application, the method may be executed by the electronic device 2 shown in fig. 1 as the first terminal 32, and may be applied to the remote ultrasound detection scenario shown in fig. 3, so as to implement remote sharing of the ultrasound image information and the first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The method comprises the following steps:
step 601: the method comprises the steps of obtaining ultrasonic image information of a detection object, and obtaining first scene image information in a first preset area away from the detection object.
In this step, it is assumed that the medical expert user Alice creates a web conference using the second terminal 33, and the ultrasonic testing user Bob joins the web conference through the first terminal 32, and completes the authentication login in the server 31 through the signaling processes a to j in the above embodiment. For the first terminal 32, the ultrasonic image information of the detection object is acquired in real time, and the first scene image information in a first preset area from the detection object is acquired. The first terminal 32 may be an ultrasonic detection device in a hospital room, and may acquire the ultrasonic image information of the detection object in real time through an ultrasonic probe. The method can be used for acquiring audio and video of the operation method of a doctor on a detection object in a ward in real time through an external camera to generate first scene image information.
Step 602: the ultrasound image information and the first scene image information are sent to the server 31.
In this step, the ultrasound image information and the first scene image information generated by the doctor's manipulation are transferred in real time by the server 31 and transmitted to the second terminal 33 where the medical specialist is located, and the delay generated in the middle is required to be less than 100 ms.
In one embodiment, the ultrasound terminal (the first terminal 32) side as a party participating in the network conference needs to transmit at least three video images to the server 31: ultrasonic image information, an exchange conversation video and a doctor operation video. Because two or more parties in a conference need to communicate and direct in real time, the delay requirement is controlled to within 100 ms. By reducing unnecessary cache and data redundancy in the whole transmission path, extremely low delay is achieved, and the following technical means can be flexibly adopted according to the quality of network transmission: the first terminal 32 employs a higher frame rate acquisition device. The first terminal 32 turns off the error Correction functions such as FEC (forward error Correction), does not buffer any video, and receives the collected video frame and then sends out the first time encoded packet. Preferably, UDP transmission is used, and channel encryption may be considered to be turned off in an intranet or a private network.
Step 603: the feedback information stream sent by the server 31 is received.
In this step, the feedback information stream at least includes opinion feedback information of the second terminal 33 with respect to the ultrasound image information, such as tag information of the ultrasound image information. The second scene image information of the medical expert of the second terminal 33 is also included, for example, the audio/video information of the medical expert at the second terminal 33 side, and the like.
Step 604: and analyzing the feedback information flow to generate feedback image information.
In the step, the received feedback information stream is analyzed in real time, if the feedback information stream is encrypted, decryption is needed, then audio and video information is separated, decoded and rendered, and finally feedback image information is generated and can be displayed on a display in real time, so that a doctor at an ultrasonic detection end can see feedback opinions of medical experts in real time.
In an embodiment, the method may further include:
step 605: first marking information aiming at the feedback image information is collected.
In this step, if the doctor at the ultrasound terminal side has feedback on the feedback opinion of the medical expert at the second terminal 33 side, for example, the doctor at the ultrasound terminal may mark the feedback image information by a function such as an electronic whiteboard of the ultrasound terminal to generate the first mark information.
Step 606: the first flag information is sent to the server 31.
In this step, the first mark information acquired by the ultrasound terminal is sent to the server 31 in real time, and meanwhile, the ultrasound terminal records and updates the first recorded scene image information in real time and sends the updated first recorded scene image information to the server 31 in real time.
Please refer to fig. 7, which is an information sharing method according to an embodiment of the present application, the method may be executed by the electronic device 1 shown in fig. 1 as the second terminal 33, and may be applied to the remote ultrasound detection scenario shown in fig. 3, so as to implement remote sharing of the ultrasound image information and the first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The method comprises the following steps:
step 701: the shared information stream transmitted by the server 31 is received.
In this step, the second terminal 33 may be a terminal used by a medical expert participating in the web conference, and assuming that the medical expert user Alice uses the second terminal 33 to create the web conference, the ultrasonic testing user Bob joins the web conference through the first terminal 32, and completes the authentication login in the server 31 through the signaling processes a to j in the above embodiment. Then, the second terminal 33 may receive the shared information stream sent by the server 31 in real time, where the shared information stream at least includes the ultrasound image information and the first scene image information acquired by the first terminal 32 subscribed by the second terminal 33. In order to reduce the information transmission delay, the second terminal 33 as the receiving end may do only the necessary packet buffering and jitter buffering, and control the delay of the jitter buffering or cancel the jitter buffering.
Step 702: and analyzing the shared information stream to generate shared image information.
In this step, the shared information stream can be decrypted, the audio and video information can be separated, decoded and rendered in real time, shared image information can be generated, and the shared image information can be displayed on a display for medical experts to observe.
Step 703: and collecting second mark information of the shared image information and second scene image information in a second preset area.
In this step, the expert doctor at the second terminal 33 may share the image information in real time and perform video communication with the doctor at the first terminal 32 (ultrasound terminal), and send information such as feedback advice or ultrasound operation guidance advice to the ultrasound terminal by means of real-time video annotation or voice. Therefore, the second terminal 33 may collect, in real time, the second mark information of the expert doctor on the shared image information and the second scene image information in the second preset area by using an electronic whiteboard, an audio/video collector, and the like. The second preset area may be a spatial area where the second terminal 33 is located, such as a room where an expert doctor is located, and the second scene image information may be audio/video information in the room.
In one embodiment, the second marking information may be suspicious lesion information marked on the local image window by an expert physician side (Alice) using an electronic drawing pen, and the suspicious lesion information is forwarded by the signaling server 31 to a clinician ultrasound terminal side (Bob) through a signaling channel, and the ultrasound terminal side superimposes and renders the suspicious lesion information on the image video. The expert doctor can give guidance suggestion information by watching the operation method and the remote image of the doctor at the ultrasonic terminal side. The real-time ultrasonic image is marked and circled, so that the instruction is more expressive and the communication is smoother.
Step 704: and generating a feedback information stream according to the second mark information and the second scene image information.
In this step, the second label information and the second scene image information may be packaged according to the actual information transmission requirement, so as to generate a feedback information stream.
Step 705: the feedback information stream is sent to the server 31.
In this step, Alice at the second terminal 33 of the specialist can mark or erase the mark, mark or clear the information of the command, and the second scene image information of the specialist can be synchronized to the first terminal 32 (ultrasound terminal) via the server 31 and be rendered.
In an embodiment, the feedback information stream may further include a remote control signal from the second terminal 33 to the ultrasound terminal. The expert doctor at the side of the second terminal 33 can control various settings of the ultrasound terminal software, such as moving, amplifying, locking, filtering and the like, in real time by means of the terminal software.
In one embodiment, due to the complexity of the ultrasound device, the specialist physician sometimes needs to operate the ultrasound device in his or her own remote control, sending instructions or parameters to the ultrasound device such as zoom-in, lock-in, and other image processing, while guiding the clinician through speech and annotation. The implementation process can be as follows:
1. the specialist (Alice) calls up a remote operation page through the second terminal 33, which page simulates an operation console of the ultrasound device.
2. The second terminal 33Alice forms a remote operation instruction (denoted by cmd _0001) through the operation of the remote operation page.
3. The remote operation command is forwarded to the remote ultrasound device by the signaling server 31 through the signaling channel, and the ultrasound device receives the remote operation command and sends a response (ack _ 0001).
4. The second terminal 33Alice freezes the operation before ack _0001 is not received and can proceed to the next operation after receiving the response.
5. After the second terminal 33Alice waits ack _0001 for a certain time (for example, 50ms), the operation page reminds Alice that the operation is invalid, and returns to the state before the operation.
6. The communication between the second terminal 33Alice and the ultrasound terminal Bob and the server 31 may be transmitted by using a TCP (Transmission Control Protocol), and a long connection may be maintained by using a heartbeat packet, and the second terminal 33Alice or the ultrasound terminal Bob side monitors the validity of the connection in real time, and immediately tries to reestablish the connection if the connection fails.
In an embodiment, the specialist may send a command through the second terminal 33 to trigger the ultrasound terminal to upload the acquired ultrasound image information to a PACS (Picture Archiving and Communication System) System.
Please refer to fig. 8, which is an information sharing apparatus 80 according to an embodiment of the present application, and the apparatus can be applied to the electronic device 1 shown in fig. 1 and can be applied to the remote ultrasound detection scenario shown in fig. 3 to implement remote sharing of the ultrasound image information and the first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The device includes: the first receiving module 801, the selecting module 802 and the first sending module 803, the principle relationship of each module is as follows:
the first receiving module 801 is configured to receive ultrasound image information and first scene image information of a detection object acquired by the first terminal 32, and receive a subscription request of the second terminal 33 to the first terminal 32. See the description of step 401 in the above embodiments for details.
The selecting module 802 is configured to select a shared information stream from the ultrasound image information and the first scene image information according to the subscription request. See the description of step 402 in the above embodiments for details.
A first sending module 803, configured to send the shared information stream to the second terminal 33. See the description of step 403 in the above embodiments for details.
In one embodiment, the method further comprises: the second receiving module 804 is configured to receive the first sharing request of the first terminal 32 and the second sharing request of the second terminal 33 before receiving the ultrasound image information and the first scene image information of the detection object acquired by the first terminal 32 and receiving the subscription request of the second terminal 33 to the first terminal 32. The establishing module 805 establishes an information link with the first terminal 32 according to the first sharing request, and establishes an information link with the second terminal 33 according to the second sharing request. Refer to the description of step 501 to step 502 in the above embodiments in detail.
In one embodiment, the first sharing request includes: and sharing the authority information. The device still includes: the determining module 806 is configured to determine whether the authority of the second terminal 33 exists in the sharing authority information before selecting the sharing information stream from the ultrasound image information and the first scene image information according to the subscription request. The selecting module 802 is further configured to select a shared information stream from the ultrasound image information and the first scene image information according to the subscription request if the permission of the second terminal 33 exists in the shared permission information. See the description of step 504 to step 505 in the above embodiments in detail.
In one embodiment, the sending module is configured to: and analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow. Each of the shared information streams is independently transmitted to the second terminal 33 according to the initial transport channel. Refer to the description of steps 506 to 507 in the above embodiments in detail.
In one embodiment, the method further comprises: a third receiving module 807, configured to receive the feedback information stream sent by the second terminal 33. A second sending module 808, configured to send the feedback information stream to the first terminal 32. See the description of steps 508 to 509 in the above embodiments for details.
For a detailed description of the information sharing apparatus 80, please refer to the description of the related method steps in the above embodiments.
Please refer to fig. 9, which is an information sharing apparatus 90 according to an embodiment of the present application, and the apparatus can be applied to the electronic device 2 shown in fig. 1 and can be applied to the remote ultrasound detection scenario shown in fig. 3 to implement remote sharing of the ultrasound image information and the first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The device includes: an obtaining module 901, a third sending module 902, a fourth receiving module 903 and a first analyzing module 904, wherein the principle relationship of each module is as follows:
the acquiring module 901 is configured to acquire ultrasonic image information of a detection object, and acquire first scene image information in a first preset area from the detection object. See the description of step 601 in the above embodiments for details.
A third sending module 902, configured to send the ultrasound image information and the first scene image information to the server 31. See the description of step 602 in the above embodiments for details.
A fourth receiving module 903, configured to receive the feedback information stream sent by the server 31. See the description of step 603 in the above embodiments for details.
The first parsing module 904 is configured to parse the feedback information stream to generate feedback image information. See the above description of step 604 in the above embodiments for details.
In one embodiment, the method further comprises: the first collecting module 905 is configured to collect first mark information for the feedback image information. A fourth sending module 906, configured to send the first tag information to the server 31. See the above embodiments for details of steps 605 to 606.
For a detailed description of the information sharing apparatus 90, please refer to the description of the related method steps in the above embodiments.
Please refer to fig. 10, which is an information sharing apparatus 100 according to an embodiment of the present application, and the apparatus can be applied to the electronic device 1 shown in fig. 1 and can be applied to a remote ultrasound detection scenario shown in fig. 3 to implement remote sharing of ultrasound image information and first scene image information acquired by the first terminal 32 with the second terminal 33 in real time. The device includes: the fourth receiving module 101, the second analyzing module 102, the second acquiring module 103, the generating module 104 and the fifth sending module 105 are in the following principle relationship:
a fourth receiving module 101, configured to receive the shared information stream sent by the server 31. See the description of step 701 in the above embodiments for details.
The second parsing module 102 is configured to parse the shared information stream to generate shared image information. See the description of step 702 in the above embodiments for details.
The second collecting module 103 is configured to collect second mark information of the shared image information and second scene image information in a second preset area. See the description of step 703 in the above embodiments for details.
And a generating module 104, configured to generate a feedback information stream according to the second mark information and the second scene image information. See the description of step 704 in the above embodiments for details.
A fifth sending module 105, configured to send the feedback information stream to the server 31. See the description of step 705 in the above embodiments for details.
For a detailed description of the information sharing apparatus 100, please refer to the description of the related method steps in the above embodiments.
An embodiment of the present invention further provides a non-transitory electronic device readable storage medium, including: a program that, when run on an electronic device, causes the electronic device to perform all or part of the procedures of the methods in the above-described embodiments. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD), a Solid State Drive (SSD), or the like. The storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.

Claims (21)

1. An information sharing method, comprising:
receiving ultrasonic image information and first scene image information of a detection object acquired by a first terminal, and receiving a subscription request of a second terminal to the first terminal;
according to the subscription request, selecting a shared information stream from the ultrasonic image information and the first scene image information;
and sending the shared information stream to the second terminal.
2. The method according to claim 1, before receiving the ultrasound image information and the first scene image information of the detected object acquired by the first terminal and receiving the subscription request of the second terminal to the first terminal, further comprising:
receiving a first sharing request of the first terminal and a second sharing request of the second terminal;
and establishing information link with the first terminal according to the first sharing request, and establishing information link with the second terminal according to the second sharing request.
3. The method of claim 2, wherein the first share request comprises: sharing authority information; before the selecting a shared information stream from the ultrasound image information and the first scene image information according to the subscription request, the method further includes:
judging whether the sharing authority information has the authority of the second terminal or not;
and if the authority of the second terminal exists in the sharing authority information, selecting a sharing information stream from the ultrasonic image information and the first scene image information according to the subscription request.
4. The method of claim 1, wherein the sending the shared information stream to the second terminal comprises:
analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow;
and according to the initial transmission channel, independently sending each information flow in the shared information flow to the second terminal.
5. The method of claim 1, further comprising:
receiving a feedback information stream sent by the second terminal;
and sending the feedback information stream to the first terminal.
6. An information sharing method, comprising:
acquiring ultrasonic image information of a detection object, and acquiring first scene image information in a first preset area away from the detection object;
sending the ultrasonic image information and the first scene image information to a server;
receiving a feedback information stream sent by the server;
and analyzing the feedback information flow to generate feedback image information.
7. The method of claim 6, further comprising:
collecting first mark information aiming at the feedback image information;
and sending the first mark information to the server.
8. An information sharing method, comprising:
receiving a shared information stream sent by a server;
analyzing the shared information stream to generate shared image information;
acquiring second mark information of the shared image information and second scene image information in a second preset area;
generating a feedback information stream according to the second mark information and the second scene image information;
and sending the feedback information stream to the server.
9. An information sharing apparatus, comprising:
the first receiving module is used for receiving ultrasonic image information and first scene image information of a detection object acquired by a first terminal and receiving a subscription request of a second terminal to the first terminal;
the selecting module is used for selecting a shared information stream from the ultrasonic image information and the first scene image information according to the subscription request;
and the first sending module is used for sending the shared information stream to the second terminal.
10. The apparatus of claim 9, further comprising:
the second receiving module is used for receiving a first sharing request of the first terminal and a second sharing request of the second terminal before receiving ultrasonic image information and first scene image information of a detection object acquired by the first terminal and receiving a subscription request of the second terminal to the first terminal;
and the establishing module establishes information link with the first terminal according to the first sharing request and establishes information link with the second terminal according to the second sharing request.
11. The apparatus of claim 10, wherein the first share request comprises: sharing authority information; the device further comprises:
the judging module is used for judging whether the authority of the second terminal exists in the sharing authority information before selecting a sharing information stream from the ultrasonic image information and the first scene image information according to the subscription request;
the selecting module is further configured to select a shared information stream from the ultrasound image information and the first scene image information according to the subscription request if the permission of the second terminal exists in the shared permission information.
12. The apparatus of claim 9, wherein the sending module is configured to:
analyzing the shared information flow to obtain an initial transmission channel of each information flow in the shared information flow;
and according to the initial transmission channel, independently sending each information flow in the shared information flow to the second terminal.
13. The apparatus of claim 9, further comprising:
a third receiving module, configured to receive a feedback information stream sent by the second terminal;
and the second sending module is used for sending the feedback information stream to the first terminal.
14. An information sharing apparatus, comprising:
the acquisition module is used for acquiring ultrasonic image information of a detection object and acquiring first scene image information in a first preset area away from the detection object;
the third sending module is used for sending the ultrasonic image information and the first scene image information to a server;
a fourth receiving module, configured to receive a feedback information stream sent by the server;
and the first analysis module is used for analyzing the feedback information flow to generate feedback image information.
15. The apparatus of claim 14, further comprising:
the first acquisition module is used for acquiring first mark information aiming at the feedback image information;
and the fourth sending module is used for sending the first marking information to the server.
16. An information sharing apparatus, comprising:
the fourth receiving module is used for receiving the shared information stream sent by the server;
the second analysis module is used for analyzing the shared information stream to generate shared image information;
the second acquisition module is used for acquiring second mark information of the shared image information and second scene image information in a second preset area;
a generating module, configured to generate a feedback information stream according to the second mark information and the second scene image information;
and a fifth sending module, configured to send the feedback information stream to the server.
17. An information sharing system, comprising:
a first terminal for performing the method of any one of claims 6 to 7;
a server for performing the method of any one of claims 1 to 5;
a second terminal for performing the method as claimed in claim 8.
18. An electronic device, comprising:
a memory to store a computer program;
a processor configured to perform the method according to any one of claims 1 to 5, so that the first terminal and the second terminal perform information sharing.
19. An electronic device, comprising:
the ultrasonic detector is used for acquiring ultrasonic image information of a detection object;
a memory to store a computer program;
a processor to perform the method of any of claims 6 to 7 to share an information stream comprising the ultrasound image information to a server.
20. An electronic device, comprising:
a memory to store a computer program;
a processor configured to perform the method of claim 8 to share an information stream to a server.
21. A non-transitory electronic device readable storage medium, comprising: program which, when run by an electronic device, causes the electronic device to perform the method of any one of claims 1 to 5.
CN202010601580.5A 2020-06-28 2020-06-28 Information sharing method, device, system, equipment and storage medium Pending CN111899849A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010601580.5A CN111899849A (en) 2020-06-28 2020-06-28 Information sharing method, device, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010601580.5A CN111899849A (en) 2020-06-28 2020-06-28 Information sharing method, device, system, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111899849A true CN111899849A (en) 2020-11-06

Family

ID=73206476

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010601580.5A Pending CN111899849A (en) 2020-06-28 2020-06-28 Information sharing method, device, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111899849A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243692A (en) * 2010-05-12 2011-11-16 通用电气公司 Medical conferencing systems and methods
CN102572218A (en) * 2012-01-16 2012-07-11 唐桥科技(杭州)有限公司 Video label method based on network video meeting system
CN106295107A (en) * 2015-06-08 2017-01-04 浙江格林蓝德信息技术有限公司 A kind of medical image that realizes synchronizes the method and system of the consultation of doctors
CN106507054A (en) * 2016-11-28 2017-03-15 武汉联影医疗科技有限公司 The device of the method and information transfer of information transfer
CN106886680A (en) * 2017-02-09 2017-06-23 无锡科美达医疗科技有限公司 A kind of ultrasonic remote real-time consultation system
CN109102864A (en) * 2013-07-01 2018-12-28 三星电子株式会社 The method of shared information in ultrasonic imaging
CN109300532A (en) * 2018-09-04 2019-02-01 广州广康医疗科技股份有限公司 A kind of ultrasonic image Tele-consultation System and method
CN109920555A (en) * 2019-02-21 2019-06-21 中国科学院苏州生物医学工程技术研究所 A kind of remote medical consultation with specialists method and system based on C/S framework
CN110890161A (en) * 2019-09-25 2020-03-17 嘉兴市第一医院 Ultrasonic remote real-time consultation system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243692A (en) * 2010-05-12 2011-11-16 通用电气公司 Medical conferencing systems and methods
CN102572218A (en) * 2012-01-16 2012-07-11 唐桥科技(杭州)有限公司 Video label method based on network video meeting system
CN109102864A (en) * 2013-07-01 2018-12-28 三星电子株式会社 The method of shared information in ultrasonic imaging
CN106295107A (en) * 2015-06-08 2017-01-04 浙江格林蓝德信息技术有限公司 A kind of medical image that realizes synchronizes the method and system of the consultation of doctors
CN106507054A (en) * 2016-11-28 2017-03-15 武汉联影医疗科技有限公司 The device of the method and information transfer of information transfer
CN106886680A (en) * 2017-02-09 2017-06-23 无锡科美达医疗科技有限公司 A kind of ultrasonic remote real-time consultation system
CN109300532A (en) * 2018-09-04 2019-02-01 广州广康医疗科技股份有限公司 A kind of ultrasonic image Tele-consultation System and method
CN109920555A (en) * 2019-02-21 2019-06-21 中国科学院苏州生物医学工程技术研究所 A kind of remote medical consultation with specialists method and system based on C/S framework
CN110890161A (en) * 2019-09-25 2020-03-17 嘉兴市第一医院 Ultrasonic remote real-time consultation system

Similar Documents

Publication Publication Date Title
US8924234B2 (en) Streaming video network system
Jang-Jaccard et al. WebRTC-based video conferencing service for telehealth
US9485475B2 (en) Surgical imaging system and method for processing surgical images
US11157842B2 (en) System, equipment and method for performing and documenting in real-time a remotely assisted professional procedure
JP6071297B2 (en) Medical image control system
US20060122482A1 (en) Medical image acquisition system for receiving and transmitting medical images instantaneously and method of using the same
Suciu et al. WebRTC role in real-time communication and video conferencing
US20180122518A1 (en) Method for monitoring and controlling patient parameters and transmitting medical information and a system for carrying out the method
CN111629220A (en) Rapid playback comparison system and method for telemedicine
TARIM et al. Performance evaluation of WebRTC-based online consultation platform
US10182204B1 (en) Generating images of video chat sessions
CN111653343A (en) Medical real-time image remote consultation system and method
CN111899849A (en) Information sharing method, device, system, equipment and storage medium
TW200844849A (en) A collaborative telemedicine system
El Jaouhari et al. Streaming dicom real-time video and metadata flows outside the operating room
US11837368B1 (en) Multi-channel communication sessions between patient and clinician
JP3211786U (en) Interactive device using live video
CN115174625B (en) Remote medical data transmission method and device
JP2014042654A (en) Server device, client device, medical image processing system, medical image processing method and program
EP3993426A1 (en) Methods and systems for hybrid and concurrent video distribution for healthcare campuses
Hadjinicolaou et al. Emergency TeleOrthoPaedics m-health system for wireless communication links
US20240179132A1 (en) Systems and methods for remote control monitoring of an electronic device
Yu et al. A tele-ophthalmology system based on secure video-conferencing and white-board
CN217547994U (en) Endoscope image synchronization system
Zhang et al. A mobile network-based multimedia teleconference system for homecare services

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination