CN110557623A - Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system - Google Patents
Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system Download PDFInfo
- Publication number
- CN110557623A CN110557623A CN201910717626.7A CN201910717626A CN110557623A CN 110557623 A CN110557623 A CN 110557623A CN 201910717626 A CN201910717626 A CN 201910717626A CN 110557623 A CN110557623 A CN 110557623A
- Authority
- CN
- China
- Prior art keywords
- mixed reality
- video data
- video
- transmission connection
- data transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
Abstract
The invention provides a mixed reality operation auxiliary device, an auxiliary method and a mixed reality operation system, wherein the mixed reality operation auxiliary device comprises: the video acquisition module is used for acquiring video data in at least one piece of medical equipment; the video service module is connected with the video acquisition module and used for establishing video data transmission connection with the mixed reality equipment according to the verification information, transmitting the video data to the mixed reality equipment through the video data transmission connection and performing projection display on the video data through the mixed reality equipment. The invention can quickly and intensively project the video information of each medical device in the operating room to the mixed reality screen, realizes the information integration in the operation and greatly improves the convenience of the operation.
Description
Technical Field
the invention relates to the technical field of mixed reality, in particular to mixed reality operation auxiliary equipment, a mixed reality operation system and a mixed reality operation auxiliary method.
Background
In recent years, with the rapid development of digital bone science and holographic digital technology, the mixed reality technology has been widely applied to the medical field. The mixed reality technology is a digital holographic image technology, and a user can observe a three-dimensional image without limitation in all directions by projecting the three-dimensional image in a three-dimensional space. In the medical field, doctors can observe focuses in all directions, so that the operation scheme is more detailed, the operation is more accurate, and the communication between doctors and patients is simpler.
At present, in a mixed reality operation scene, a doctor observes an operation 3D model prepared before an operation through mixed reality glasses so as to achieve a certain operation guiding function. However, doctors rely on some other medical devices in operation, such as B-ultrasonic machines, endoscopes, image workstations, etc., during operation, which makes it inconvenient for doctors to frequently turn their heads to observe the devices after wearing the mixed reality glasses.
disclosure of Invention
The invention aims to solve the technical problems and provides a mixed reality operation auxiliary device, an auxiliary method and a mixed reality operation system, which can quickly and intensively project video information of each medical device in an operating room to a mixed reality screen, realize information integration in the operation and greatly improve the convenience of the operation.
The technical scheme adopted by the invention is as follows:
A mixed reality surgical assistance apparatus comprising: the video acquisition module is used for acquiring video data in at least one medical device; the video service module is connected with the video acquisition module and used for establishing video data transmission connection with mixed reality equipment according to verification information and transmitting the video data to the mixed reality equipment through the video data transmission connection so as to perform projection display on the video data through the mixed reality equipment.
The video acquisition module comprises an SGI, HDMI or VGA video interface.
Wherein the mixed reality device scans the two-dimensional code of the auxiliary device to acquire authentication information for connecting to the video service module.
The video data transmission connection is a wireless connection.
A mixed reality surgical system, comprising: the above mixed reality surgical aid; and the mixed reality equipment is used for receiving the video data and performing projection display on the video data.
A mixed reality surgical assistance method, comprising: acquiring video data in at least one medical device; and establishing video data transmission connection with mixed reality equipment according to verification information, and transmitting the video data to the mixed reality equipment through the video data transmission connection so as to perform projection display on the video data through the mixed reality equipment.
The mixed reality device scans the two-dimensional code to obtain verification information for establishing a video data transmission connection.
the video data transmission connection is a wireless connection.
the invention has the beneficial effects that:
according to the embodiment of the invention, the video data in at least one medical device can be collected, the video data transmission connection can be established with the mixed reality device according to the verification information, the video data can be transmitted to the mixed reality device through the video data transmission connection, and the video data can be projected and displayed through the mixed reality device, so that the video information of each medical device in an operating room can be rapidly and intensively projected to the mixed reality screen, the integration of information in the operation is realized, and the convenience of the operation is greatly improved.
Drawings
FIG. 1 is a block schematic diagram of a mixed reality surgical aid according to an embodiment of the present invention;
FIG. 2 is a block schematic diagram of a mixed reality surgical system according to an embodiment of the present invention;
Fig. 3 is a flowchart of a mixed reality surgical assistant method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a mixed reality surgical assistance apparatus of an embodiment of the present invention includes: a video capture module 10 and a video service module 20. The video acquisition module 10 is used for acquiring video data in at least one medical device; the video service module 20 is connected to the video capture module 10, and the video service module 20 is configured to establish a video data transmission connection with the mixed reality device according to the verification information, and transmit the video data to the mixed reality device through the video data transmission connection, so as to perform projection display on the video data through the mixed reality device.
In an embodiment of the present invention, the video capture module 10 may include, but is not limited to, an SGI, HDMI, or VGA video interface, and the video capture module 10 may capture real-time video data on a medical device such as a B-mode ultrasound machine, an endoscope, an image workstation, or the like through the video interface.
in one embodiment of the invention, the mixed reality device may scan the two-dimensional code of the auxiliary device to obtain the authentication information for connecting to the video service module 20, and the video data transmission connection may be a wireless connection. Specifically, the two-dimensional code may be attached to the mixed reality surgery auxiliary device, and the two-dimensional code includes identification information of the mixed reality surgery auxiliary device, that is, identification information of the video service module 20 in the mixed reality surgery auxiliary device. After the mixed reality device is identified by scanning the two-dimensional code and is automatically connected with the video service module 20, the video service module 20 can transmit video data to the mixed reality device in a wireless mode, for example, WIFI. When the mixed reality device receives video data of a plurality of medical devices in an operating room, the video data can be projected and displayed to the mixed reality screen in a centralized mode.
according to the mixed reality operation auxiliary equipment provided by the embodiment of the invention, the video acquisition module can acquire video data in at least one medical equipment, the video service module can establish video data transmission connection with the mixed reality equipment according to the verification information and transmit the video data to the mixed reality equipment through the video data transmission connection so as to perform projection display on the video data through the mixed reality equipment, therefore, the video information of each medical equipment in an operating room can be rapidly and intensively projected into a mixed reality screen, the information integration in the operation is realized, and the convenience of the operation is greatly improved.
Corresponding to the mixed reality surgery auxiliary equipment of the embodiment, the invention further provides a mixed reality surgery system.
As shown in fig. 2, the mixed reality surgical system according to the embodiment of the present invention includes the mixed reality surgical assistance apparatus 100 and the mixed reality apparatus 200 according to any one of the above embodiments. The mixed reality surgical assistant 100 according to any of the embodiments above may collect video data in at least one medical device, establish a video data transmission connection with the mixed reality device 200 according to the verification information, and transmit the video data to the mixed reality device 200 through the video data transmission connection; the mixed reality device 200 may receive video data and perform a projection display of the video data.
For more detailed implementation, reference may be made to the above embodiments, which are not described herein again.
According to the mixed reality operation system provided by the embodiment of the invention, the video information of each medical device in the operating room can be rapidly and intensively projected to the mixed reality screen, so that information integration in the operation is realized, and the convenience of the operation is greatly improved.
Corresponding to the embodiment, the invention further provides a mixed reality surgery assisting method.
As shown in fig. 3, the mixed reality surgical assistance method according to the embodiment of the present invention includes the following steps:
S1, video data in at least one medical device is acquired.
In one embodiment of the invention, real-time video data on medical equipment such as a B-ultrasonic machine, an endoscope and an image workstation can be acquired through video interfaces such as SGI, HDMI or VGA.
And S2, establishing video data transmission connection with the mixed reality device according to the verification information, and transmitting the video data to the mixed reality device through the video data transmission connection so as to perform projection display on the video data through the mixed reality device.
in one embodiment of the invention, the mixed reality device may scan the two-dimensional code to obtain verification information for establishing the video data transmission connection, which may be a wireless connection. After mixed reality equipment has discerned and has established the video data transmission connection automatically through scanning the two-dimensional code, accessible wireless mode, for example WIFI transmits video data to mixed reality equipment. When the mixed reality device receives video data of a plurality of medical devices in an operating room, the video data can be projected and displayed to the mixed reality screen in a centralized mode.
According to the mixed reality operation assisting method provided by the embodiment of the invention, the video data in at least one medical device can be collected, the video data transmission connection is established with the mixed reality device according to the verification information, the video data is transmitted to the mixed reality device through the video data transmission connection, and the video data is projected and displayed through the mixed reality device, so that the video information of each medical device in the operating room can be rapidly and intensively projected into the mixed reality screen, the information integration in the operation is realized, and the convenience of the operation is greatly improved.
In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. A mixed reality surgical assistance apparatus, comprising:
The video acquisition module is used for acquiring video data in at least one medical device;
The video service module is connected with the video acquisition module and used for establishing video data transmission connection with mixed reality equipment according to verification information and transmitting the video data to the mixed reality equipment through the video data transmission connection so as to perform projection display on the video data through the mixed reality equipment.
2. The mixed reality surgical assistance device of claim 1, wherein the video acquisition module comprises an SGI, HDMI, or VGA video interface.
3. The mixed reality surgical assistance device of claim 2, wherein the mixed reality device scans a two-dimensional code of the assistance device to obtain verification information to connect to the video service module.
4. the mixed reality surgical assistance apparatus of claim 3, wherein the video data transmission connection is a wireless connection.
5. A mixed reality surgical system, comprising:
The mixed reality surgical assistance apparatus of any one of claims 1-4;
And the mixed reality equipment is used for receiving the video data and performing projection display on the video data.
6. a mixed reality surgical assistance method, comprising:
Acquiring video data in at least one medical device;
And establishing video data transmission connection with mixed reality equipment according to verification information, and transmitting the video data to the mixed reality equipment through the video data transmission connection so as to perform projection display on the video data through the mixed reality equipment.
7. The mixed reality surgical assistant method of claim 6, wherein the mixed reality device scans a two-dimensional code to obtain verification information for establishing a video data transmission connection.
8. The mixed reality surgical assistant method of claim 7, wherein the video data transmission connection is a wireless connection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910717626.7A CN110557623A (en) | 2019-08-05 | 2019-08-05 | Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910717626.7A CN110557623A (en) | 2019-08-05 | 2019-08-05 | Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110557623A true CN110557623A (en) | 2019-12-10 |
Family
ID=68737146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910717626.7A Pending CN110557623A (en) | 2019-08-05 | 2019-08-05 | Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110557623A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111403022A (en) * | 2020-03-13 | 2020-07-10 | 北京维卓致远医疗科技发展有限责任公司 | Medical movable split type control system and use method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1935086A (en) * | 2005-09-21 | 2007-03-28 | 西门子公司 | Integrated electrophysiology lab |
| CN103371870A (en) * | 2013-07-16 | 2013-10-30 | 深圳先进技术研究院 | Multimode image based surgical operation navigation system |
| CN103948432A (en) * | 2014-04-30 | 2014-07-30 | 深圳先进技术研究院 | Algorithm for augmented reality of three-dimensional endoscopic video and ultrasound image during operation |
| CN106060815A (en) * | 2016-05-18 | 2016-10-26 | 广东欧珀移动通信有限公司 | Data transmission method, mobile terminal and data transmission system |
| CN108900815A (en) * | 2018-08-04 | 2018-11-27 | 广州高通影像技术有限公司 | A kind of intelligent endoscope image system based on AR application technology |
| CN109674532A (en) * | 2019-01-25 | 2019-04-26 | 上海交通大学医学院附属第九人民医院 | Operation guiding system and its equipment, method and storage medium based on MR |
-
2019
- 2019-08-05 CN CN201910717626.7A patent/CN110557623A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1935086A (en) * | 2005-09-21 | 2007-03-28 | 西门子公司 | Integrated electrophysiology lab |
| CN103371870A (en) * | 2013-07-16 | 2013-10-30 | 深圳先进技术研究院 | Multimode image based surgical operation navigation system |
| CN103948432A (en) * | 2014-04-30 | 2014-07-30 | 深圳先进技术研究院 | Algorithm for augmented reality of three-dimensional endoscopic video and ultrasound image during operation |
| CN106060815A (en) * | 2016-05-18 | 2016-10-26 | 广东欧珀移动通信有限公司 | Data transmission method, mobile terminal and data transmission system |
| CN108900815A (en) * | 2018-08-04 | 2018-11-27 | 广州高通影像技术有限公司 | A kind of intelligent endoscope image system based on AR application technology |
| CN109674532A (en) * | 2019-01-25 | 2019-04-26 | 上海交通大学医学院附属第九人民医院 | Operation guiding system and its equipment, method and storage medium based on MR |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111403022A (en) * | 2020-03-13 | 2020-07-10 | 北京维卓致远医疗科技发展有限责任公司 | Medical movable split type control system and use method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9232934B2 (en) | Systems and methods for communicating ultrasound probe location and image information | |
| US9030544B2 (en) | Wireless video transmission system and transmission device | |
| CA2283364C (en) | Method and apparatus for capturing and automatically transferring an x-ray image to a remote location | |
| US9372960B2 (en) | Medical support system and method thereof | |
| US7905834B2 (en) | Remote ultrasonic diagnostic subject-side apparatus, remote ultrasonic diagnostic examiner-side apparatus and remote ultrasonic diagnostic system | |
| US20170000462A1 (en) | Ultrasound imaging system and method for associating a photographic image with an ultrasound image | |
| CN104173020A (en) | System and method for performing real-time remote control on colposcopy period | |
| US20160174937A1 (en) | Wireless ultrasound probe | |
| EP3138500B1 (en) | Ultrasonic system and method applicable to wireless communication terminal having various resolution levels | |
| Boman et al. | Remote-controlled robotic arm for real-time echocardiography: the diagnostic future for patients in rural areas? | |
| CN107742532A (en) | A kind of medical image shared system based on medical cloud platform | |
| EP2943913A1 (en) | System and method for reducing data transmission volume in tomosynthesis | |
| CN110557623A (en) | Mixed reality operation auxiliary equipment, auxiliary method and mixed reality operation system | |
| US20160034031A1 (en) | Ultrasonic apparatus and method of controlling the same | |
| US10855980B2 (en) | Medical-image display control device, medical image display device, medical-information processing system, and medical-image display control method | |
| CN111937377B (en) | Endoscope service support system, endoscope service support method, and recording medium | |
| CN206867302U (en) | The long-distance video apparatus and system of dental multipurpose therapy unit | |
| KR20160125780A (en) | System and method for setting up ultrasonic diagnostic based on position | |
| JP2010250457A (en) | Medical image management device and method | |
| CN207708009U (en) | A kind of orthopaedics operation navigation system based on image registration techniques | |
| KR970071316A (en) | Remote medical diagnostic system and remote medical image transmission and reception method | |
| CN212782732U (en) | Medical equipment information interaction system | |
| JP4861364B2 (en) | Remote diagnostic device | |
| JP6239216B1 (en) | Medical communication system and medical device | |
| CN113965682A (en) | Remote catheter room control system and remote catheter room control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191210 |
|
| RJ01 | Rejection of invention patent application after publication |