CN113744893A - Augmented reality system for remote consultation - Google Patents

Augmented reality system for remote consultation Download PDF

Info

Publication number
CN113744893A
CN113744893A CN202110698667.3A CN202110698667A CN113744893A CN 113744893 A CN113744893 A CN 113744893A CN 202110698667 A CN202110698667 A CN 202110698667A CN 113744893 A CN113744893 A CN 113744893A
Authority
CN
China
Prior art keywords
equipment
remote
processing module
real
resource sharing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110698667.3A
Other languages
Chinese (zh)
Inventor
韩翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Original Assignee
FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FIFTH PEOPLE'S HOSPITAL OF SHANGHAI filed Critical FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Priority to CN202110698667.3A priority Critical patent/CN113744893A/en
Publication of CN113744893A publication Critical patent/CN113744893A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Abstract

The invention relates to an augmented reality system for remote consultation, and belongs to the technical field of medical auxiliary equipment. The system comprises equipment for capturing real-time pictures at the front end, a central processing unit, remote communication equipment, multi-resource sharing scene receiving equipment and input equipment; the equipment for capturing the real-time picture at the front end is connected with the remote communication equipment through the central processing unit; the remote communication equipment is connected with the multi-resource sharing scene receiving equipment through wireless data; the multi-resource sharing scene receiving device is provided with an input device. Medical experts can remotely know the illness state of a patient in real time through the system, and can carry out accurate consultation anytime and anywhere without arriving at the site. The system provided by the invention can simultaneously display a plurality of examination image results, medical history data and the like of the patient in real time, and a remote consultation specialist can simultaneously know the contents in a real-simulated scene, comprehensively grasp the illness state of the patient and carry out accurate diagnosis.

Description

Augmented reality system for remote consultation
Technical Field
The invention relates to an augmented reality system for remote consultation, and belongs to the technical field of medical auxiliary equipment.
Background
The development of network and information technology enables the working mode to be expanded to remote operation, and experts can carry out remote communication through various intelligent devices to realize supervision and guidance on remote work. In the prior art, remote clinical medical consultation work is generally realized by utilizing transmission of various text and picture files, and telephone or video calls. The video communication system is used for presenting the on-site picture through the camera, so that medical experts, on-site medical personnel and patients can communicate with each other by 'watching', 'listening' and 'speaking', and remote work (such as video conference) is realized. However, the prior art has the following defects: the current video communication system has too single function and can only 'watch and listen'; the system can not express and command work accurately in time, so that the communication efficiency of remote work is low, and the communication process is complex to operate. Particularly in clinical consultation work, due to the multiple symptoms involved in patients, as well as the multiple examination reports; in the prior art, the disease condition of a patient is known only by a video mode and other auxiliary communication means, and the communication efficiency is low due to the communication of a treatment scheme.
Disclosure of Invention
The invention aims to solve the technical problems that the prior clinical remote consultation work only knows the disease condition of a patient in a video mode and other auxiliary communication means, and the communication efficiency is low when a treatment scheme is communicated.
In order to solve the above problems, the present invention provides an augmented reality system for remote consultation, which includes a device for capturing real-time images at a front end, a central processing unit, a remote communication device, a multi-resource sharing scene receiving device, and an input device; the equipment for capturing the real-time picture at the front end is connected with the remote communication equipment through the central processing unit; the remote communication equipment is connected with the multi-resource sharing scene receiving equipment through wireless data; the multi-resource sharing scene receiving device is provided with an input device.
Preferably, the central processing unit comprises an image processing module, a sound processing module, a control module, a data processing module and a data storage module; the image processing module, the sound processing module and the data processing module are connected with the control module, and the image processing module, the sound processing module and the data processing module are connected with the data storage module.
Preferably, the control module is respectively connected with the device for capturing the real-time picture at the front end and the remote communication device.
Preferably, the multiple resource sharing scene receiving device includes a display screen, and the multiple resource sharing scene receiving device is set as a virtual reality head-mounted display device, that is, VC head-mounted glasses.
Preferably, the input device includes a data transfer interface for transferring patient examination reports and a mouse for the expert to select for viewing the multi-resource profile. .
Compared with the prior art, the invention has the following beneficial effects:
by the invention, medical experts of various departments can know the illness state of the patient in real time in a long distance through the remote augmented reality system, and can carry out accurate consultation anytime and anywhere without arriving at the site. The system provided by the invention can simultaneously display a plurality of examination image results, medical history data and the like of the patient in real time, and a remote consultation specialist can simultaneously know the contents in a real-simulated scene, comprehensively grasp the illness state of the patient and carry out accurate diagnosis.
Drawings
FIG. 1 is a schematic structural view of the constituent elements of the present invention;
FIG. 2 is a schematic diagram of a CPU according to the present invention;
Detailed Description
In order to make the invention more comprehensible, preferred embodiments are described in detail below with reference to the accompanying drawings:
as shown in fig. 1 and fig. 2, the present invention provides an augmented reality system for remote consultation, including a device for capturing real-time images at a front end, a central processing unit, a remote communication device, a multi-resource sharing scene receiving device, and an input device; the equipment for capturing the real-time picture at the front end is connected with the remote communication equipment through the central processing unit; the remote communication equipment is connected with the multi-resource sharing scene receiving equipment through wireless data; the multi-resource sharing scene receiving device is provided with an input device. The central processing unit comprises an image processing module, a sound processing module, a control module, a data processing module and a data storage module; the image processing module, the sound processing module and the data processing module are connected with the control module, and the image processing module, the sound processing module and the data processing module are connected with the data storage module. The control module is respectively connected with the equipment for capturing the real-time images at the front end and the remote communication equipment. The multi-resource sharing scene receiving device comprises a display screen, and is set as a virtual reality head-mounted display device, namely VC head-mounted display glasses. The input device includes a data transfer interface for transferring patient examination reports and a mouse for the expert to select for viewing the multi-resource material.
The use of the invention:
on-site clinical medical staff can capture real-time pictures in a patient ward through the equipment for capturing the real-time pictures at the front end of the invention, and upload images of the patient to the central processing unit, and the central processing unit transmits the images of the patient to the multi-resource sharing scene receiving equipment through the remote communication equipment, such as virtual reality head-mounted display equipment, namely VC head-mounted display glasses; the experts observe the illness state of the patient through respective multi-resource sharing scene receiving equipment, namely VC head glasses, and discuss the illness state in a virtual sharing scene; the on-site clinical medical staff uploads various examination reports, examination image pictures and the like of the patient to the central processing unit, and the central processing unit presents various types of patient data on a display screen of the multi-resource sharing scene receiving equipment of each expert through the remote communication equipment; the experts of each department can directly use a mouse and the like to directly call required data and display the data on a display screen of the multi-resource sharing scene receiving equipment; the treatment is studied by sharing, displaying, discussing the disease condition. The experts in each department can directly display own opinions and treatment schemes on the display screen of the multi-resource sharing scene receiving equipment through respective input equipment, so that the experts in each department can share and discuss the treatment schemes.
In the prior art, the real-time scene picture is presented in a flat way, even if guidance information can be sent, the guidance information is only superposed on the picture, and the three-dimensional dynamic fit with a real scene object cannot be realized. Therefore, the traditional video communication system cannot really perform remote assistance guidance in a plurality of professional fields requiring high precision.
The invention can realize the remote guidance from the plane to the three-dimensional working mode by the characteristic of virtual and real combination with the Augmented Reality (AR). The AR remote assistance platform can provide more visual, accurate and efficient guidance modes and contents than the existing remote platform, stereoscopic extension of a remote communication mode is realized, remote work which cannot be carried out by using a video communication system before can be realized, and the working modes of multiple industries can be subversively changed.
In the prior art, remote audio and video are difficult to simulate a real scene, and the symptoms of a patient on site cannot be accurately evaluated in real time and an image picture of the patient for examination (such as examination of skull CT, skull MRI, head and neck MRA/CTA and the like) can not be displayed at the same time. The remote consultation augmented reality system greatly improves the efficiency and the precision of remote consultation work, improves the treatment rate of patients, reduces the disability rate and the death rate of critical illness and critical illness, and improves the professional treatment capacity of medical staff.
By the invention, medical experts of various departments can know the illness state of the patient in real time in a long distance through the remote augmented reality system, and can carry out accurate consultation anytime and anywhere without arriving at the site. The system provided by the invention can simultaneously display a plurality of examination image results, medical history data and the like of the patient in real time, and a remote consultation specialist can simultaneously know the contents in a real-simulated scene, comprehensively grasp the illness state of the patient and carry out accurate diagnosis.
While the invention has been described with respect to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention. Those skilled in the art can make various changes, modifications and equivalent arrangements, which are equivalent to the embodiments of the present invention, without departing from the spirit and scope of the present invention, and which may be made by utilizing the techniques disclosed above; meanwhile, any changes, modifications and variations of the above-described embodiments, which are equivalent to those of the technical spirit of the present invention, are within the scope of the technical solution of the present invention.

Claims (5)

1. An augmented reality system for remote consultation, characterized by: the system comprises equipment for capturing real-time pictures at the front end, a central processing unit, remote communication equipment, multi-resource sharing scene receiving equipment and input equipment; the equipment for capturing the real-time picture at the front end is connected with the remote communication equipment through the central processing unit; the remote communication equipment is connected with the multi-resource sharing scene receiving equipment through wireless data; the multi-resource sharing scene receiving device is provided with an input device.
2. An augmented reality system for remote consultation according to claim 1; the method is characterized in that: the central processing unit comprises an image processing module, a sound processing module, a control module, a data processing module and a data storage module; the image processing module, the sound processing module and the data processing module are connected with the control module, and the image processing module, the sound processing module and the data processing module are connected with the data storage module.
3. An augmented reality system for remote consultation according to claim 2; the method is characterized in that: the control module is respectively connected with the equipment for capturing the real-time images at the front end and the remote communication equipment.
4. An augmented reality system for remote consultation according to claim 3; the method is characterized in that: the multi-resource sharing scene receiving device comprises a display screen, and the multi-resource sharing scene receiving device is set as a virtual reality head-mounted display device, namely VC head-mounted display glasses.
5. An augmented reality system for remote consultation according to claim 4; the method is characterized in that: the input device includes a data transfer interface for transferring patient examination reports and a mouse for the expert to select for viewing the multi-resource material.
CN202110698667.3A 2021-06-23 2021-06-23 Augmented reality system for remote consultation Pending CN113744893A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110698667.3A CN113744893A (en) 2021-06-23 2021-06-23 Augmented reality system for remote consultation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110698667.3A CN113744893A (en) 2021-06-23 2021-06-23 Augmented reality system for remote consultation

Publications (1)

Publication Number Publication Date
CN113744893A true CN113744893A (en) 2021-12-03

Family

ID=78728467

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110698667.3A Pending CN113744893A (en) 2021-06-23 2021-06-23 Augmented reality system for remote consultation

Country Status (1)

Country Link
CN (1) CN113744893A (en)

Similar Documents

Publication Publication Date Title
CN104583982B (en) Medical assistance system and method for same
US9641799B2 (en) Multimodal cognitive communications and collaborative knowledge exchange with visual neural networking and packetized augmented intelligence
US20150049163A1 (en) Network system apparatus and method of use adapted for visual neural networking with multi-channel multiplexed streaming medical imagery and packetized clinical informatics
Andersen et al. Virtual annotations of the surgical field through an augmented reality transparent display
CN110471804B (en) Equipment debugging method and device and electronic equipment
US10755748B2 (en) Systems and methods for producing annotated class discussion videos including responsive post-production content
US20230033576A1 (en) Systems and methods of establishing a communication session for live review of ultrasound scanning
CN108694995B (en) Medical diagnosis system and method
CN107566793A (en) Method, apparatus, system and electronic equipment for remote assistance
CN108133758A (en) A kind of first aid Tele-consultation System
Widmer et al. Using Google Glass to enhance pre-hospital care
CN112887651A (en) AR-based remote command method and system
CN215770538U (en) Augmented reality system for remote consultation
CN113744893A (en) Augmented reality system for remote consultation
CN111175958A (en) Remote consultation method and system for pathological section under microscope
CN202103784U (en) Dual stream video meeting system
CN206867302U (en) The long-distance video apparatus and system of dental multipurpose therapy unit
CN113972013A (en) Remote multidisciplinary consultation system and remote multidisciplinary consultation method
CN210052537U (en) Remote consultation system
CN113284597A (en) Critical MDT system and method based on scene fusion and MR
WO2022036484A1 (en) Hospital department ar guidance system based on digital twin
Roesler et al. MIR: A low cost digital operating room
CN111294568B (en) Method for realizing video fusion by medical remote control
CN109842786A (en) A kind of monitoring system based on Internet of Things
CN111414084B (en) Space availability test laboratory and method and apparatus for using same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination