CN110060771A - A kind of remote operation air navigation aid and device based on in-situ projection technology - Google Patents

A kind of remote operation air navigation aid and device based on in-situ projection technology Download PDF

Info

Publication number
CN110060771A
CN110060771A CN201910302779.5A CN201910302779A CN110060771A CN 110060771 A CN110060771 A CN 110060771A CN 201910302779 A CN201910302779 A CN 201910302779A CN 110060771 A CN110060771 A CN 110060771A
Authority
CN
China
Prior art keywords
remote
processor
camera
remote port
operation end
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910302779.5A
Other languages
Chinese (zh)
Inventor
马建民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Letter Medical Engineering Technology Co Ltd
Original Assignee
Jiangsu Letter Medical Engineering Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Letter Medical Engineering Technology Co Ltd filed Critical Jiangsu Letter Medical Engineering Technology Co Ltd
Priority to CN201910302779.5A priority Critical patent/CN110060771A/en
Publication of CN110060771A publication Critical patent/CN110060771A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Multimedia (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Urology & Nephrology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computing Systems (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Surgery (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A kind of remote operation navigation device based on in-situ projection technology includes: operating bed, device for image, connecting rod, operation end processor, internet and remote port processor, the camera is placed in above the operating bed, the camera is connected by connecting rod with operation end processor, and the operation end processor is connected by internet with the remote port processor;A kind of remote operation air navigation aid based on in-situ projection technology, it is characterised in that include the following steps: camera collection site color video data;End processor of performing the operation carries out signal processing to color video data;Operation end processor transmits a signal to remote port processor by internet;Guidance is labeled on the screen of remote port processor according to the real-time image information at operation end in the doctor of remote port;The operation instruction of remote port doctor will be projected to the corresponding surgery location of patient by operation end processor by in-situ projection device after the signal processing received.

Description

A kind of remote operation air navigation aid and device based on in-situ projection technology
Technical field
The present invention relates to medical instruments field, specifically a kind of remote operation navigation side based on in-situ projection technology Method and device.
Background technique
At present since China human mortality is more, economic development and medical resource are extremely uneven, and the medical resource in flourishing city is rich Richness, and the Medical resources in cities scarcity that more remote, economic level is relatively backward.Furthermore, it is necessary to which the patient for carrying out major surgery wants It just can be carried out, seen a doctor as caused by region difficult, patient often misses optimal operation period into big city.
In recent years, it with the development and innovation of the technologies such as computer technology, Medical Imaging Technology, satellite communication, relies on The remote operation navigation device of these newest science and technology is towards fine, accurately and rapidly direction is developed.Traditional first is long-range Surgical guidance device is based on tele-conferencing system, and remote doctor carries out hand according to the surgical scene picture that live camera is shot Art label, tele-conferencing system are instructed guided operation flag transmission to the monitor of operating room, and by voice, due to The visual angle of operator must be toggled in monitor and operative region, and operative doctor can not accurately perform the operation, together When also bring great inconvenience to surgical procedure.With the development of augmented reality in recent years, it is based on augmented reality equipment Remote operation navigation device also fast development is got up, such as Google glass, the Hololens portable wearable device of Microsoft, hand Art operator puts on these equipment, can observe directly what the virtual surgical guidance of remote doctor was merged with actual surgery region Picture, so that the doctor at guided operation scene carries out correct surgical procedure, but these all rely on virtual image and reality essence True registration leads to the inaccuracy of surgical guidance due to the defect of image registration algorithm, cannot accurately complete surgical procedure.
Summary of the invention
In order to solve the above technical problems, having invented a kind of remote operation air navigation aid and dress based on in-situ projection technology It sets, a kind of remote operation navigation device based on in-situ projection technology includes: operating bed, device for image, connecting rod, operation Processor, internet and remote port processor are held, the camera is placed in above the operating bed, and the camera passes through connection Bar is connected with operation end processor, and the operation end processor is connected by internet with the remote port processor.
Preferably, the device for image includes camera and in-situ projection device, the camera and the in-situ projection Device is coaxially connected.
Preferably, the camera further includes light splitting piece, band resistance optical filter, camera lens and color camera, the light splitting Piece is located at the top of the operating bed, and the light splitting piece tilts 45 degree of placements;The band resistance optical filter is horizontally placed on described point Above mating plate, the camera lens are set to the top of the band resistance optical filter, and the color camera is set to the camera mirror The top of head.
Preferably, the in-situ projection device further includes bandpass filter, projector lens and projector, the band logical filter Mating plate is vertically arranged at the right side of the light splitting piece, and the projector lens are set to the right side of the bandpass filter, described Projector is set to the right side of the projector lens.Projector is exactly phase by the light of the wavelength come out after bandpass filter The wavelength for the cut-off that optical filter acquires before machine, so camera can't collect projection when camera, projector work at the same time The picture of instrument projection.
Preferably, the connecting rod further includes multistage straight-bar and conducting wire, is connected between the straight-bar by Damping rotation shaft, institute It states connecting rod and is built-in with conducting wire.
Preferably, the operation end processor and teleprocessing unit are mounted on display synchronization system.
Preferably, microphone and sound equipment are respectively arranged on the operation end processor and remote port processor, for receive and Make a sound signal.
A kind of remote operation air navigation aid based on in-situ projection technology includes the following steps:
1, camera collection site color video data;
2, operation end processor carries out signal processing to color video data;
3, operation end processor transmits a signal to remote port processor by internet;
4, finger is labeled on the screen of remote port processor according to the real-time image information at operation end in the doctor of remote port It leads, the instruction information of remote port doctor is passed through internet real-time Transmission to operation end processor by remote port processor;
5, operation end processor will pass through in-situ projection device for the operation instruction of remote port doctor after the signal processing received Project to the corresponding surgery location of patient;
6, operation end doctor performs the operation according to guidance.
7, preferred, remote port doctor is remotely explained by voice signal, meanwhile, the display for end processor of performing the operation The instruction information of upper simultaneous display remote port.
The invention has the benefit that making live operative doctor that can accurately identify operation route, and according to optimal road Line is performed the operation, and solves the problems, such as that doctor needs the frequent switching visual angle between display and diseased region repeatedly in the prior art, Location of operation precision can be improved, reduce surgical injury, optimization operation pathway and improve success rate of operation;Remote operation is improved to refer to The accuracy led improves the speed of remote operation without additional cumbersome registration Algorithm.
Detailed description of the invention
In order that the present invention can be more clearly and readily understood, right below according to specific embodiment and in conjunction with attached drawing The present invention is described in further detail.
Fig. 1 is a kind of based on the remote operation air navigation aid of in-situ projection technology and the schematic diagram of device
Fig. 2 is device for image operation principle schematic diagram
Perform the operation end processor, 2- remote port processor, 3- operating bed, 4- device for image, 41- light splitting piece, 42- band resistance optical filter, 43- camera lens, 44- color camera, 45- camera shooting optical path, 46- projecting light path, 47- bandpass filter, 48- projector lens, 49- projector, the internet 5-, 6- remote port doctor, 7- operative site, 8- operation end doctor, 9- connecting rod.
Specific embodiment
As shown in Figure 1, a kind of remote operation navigation device based on in-situ projection technology includes: operating bed 3, image Device 4, connecting rod 9, operation end processor 1, internet 5 and remote port processor 2, the camera 4 are placed in the operating bed 3 Top, the camera 4 are connected by connecting rod 9 with operation end processor 1, and operation end processor 1 passes through interconnection Net 5 is connected with the remote port processor 2.
Preferably, the device for image 4 includes camera and in-situ projection device, the camera and the in-situ projection Device is coaxially connected.
Preferably, the connecting rod 9 further includes multistage straight-bar and conducting wire, is connected between the straight-bar by Damping rotation shaft, The connecting rod is built-in with conducting wire.
Preferably, the camera further includes light splitting piece 41, band resistance optical filter 42, camera lens 43 and color camera 44, The light splitting piece 41 is located at the top of the operating bed 7, and the light splitting piece 41 tilts 45 degree of placements;The band hinders 42 water of optical filter Flat to be set to 41 top of light splitting piece, the camera lens 43 are set to the top of the band resistance optical filter 42, the colour Camera 44 is set to the top of the camera lens 43.
Preferably, the in-situ projection device further includes bandpass filter 47, projector lens 48 and projector 49, described Bandpass filter 47 is vertically arranged at the right side of the light splitting piece 41, and the projector lens 48 are set to the bandpass filter 47 right side, the projector set 49 right sides for being placed in the projector lens 48.
Preferably, operation end processor 1 and teleprocessing unit 2 are mounted on display synchronization system.
Preferably, microphone and sound equipment are respectively arranged on the operation end processor and remote port processor, for receive and Make a sound signal.
A kind of remote operation air navigation aid based on in-situ projection technology includes the following steps:
1, camera collection site color video data;
2, operation end processor carries out signal processing to color video data;
3, operation end processor transmits a signal to remote port processor by internet;
4, finger is labeled on the screen of remote port processor according to the real-time image information at operation end in the doctor of remote port It leads while being explained, remote port processor is extremely performed the operation the instruction information of remote port doctor by internet real-time Transmission at end Manage device;
5, operation end processor will pass through in-situ projection device for the operation instruction of remote port doctor after the signal processing received Project to the corresponding surgery location of patient;
6, operation end doctor performs the operation according to guidance.
The foregoing is merely preferred embodiments of the invention, are not intended as limitation of the invention further, all to utilize this Various equivalence changes made by description of the invention and accompanying drawing content are within the scope of the present invention.

Claims (9)

1. a kind of remote operation navigation device based on in-situ projection technology, characterized by comprising: operating bed, device for image, Connecting rod, operation end processor, internet and remote port processor, the camera are placed in above the operating bed, the shadow It is connected as head passes through connecting rod with operation end processor, the operation end processor passes through at internet and the remote port Device is managed to be connected.
2. a kind of remote operation navigation device based on in-situ projection technology according to claim 1, the device for image Including camera and in-situ projection device, the camera and the in-situ projection device are coaxially connected.
3. a kind of remote operation navigation device based on in-situ projection technology according to claim 2, it is characterised in that institute Stating camera further includes that light splitting piece, band resistance optical filter, camera lens and color camera, the light splitting piece are located at the operating bed Top, the light splitting piece tilt 45 degree of placements;The band resistance optical filter is horizontally placed on above the light splitting piece, the camera mirror Head is set to the top of the band resistance optical filter, and the color camera is set to the top of the camera lens.
4. a kind of remote operation navigation device based on in-situ projection technology according to claim 2, it is characterised in that institute Stating in-situ projection device further includes bandpass filter, projector lens and projector, and the bandpass filter is vertically arranged at institute The right side of light splitting piece is stated, the projector lens are set to the right side of the bandpass filter, and the projector is set to described The right side of projector lens.
5. a kind of remote operation navigation device based on in-situ projection technology according to claim 1, the connecting rod is also Including multistage straight-bar and conducting wire, it is connected between the straight-bar by Damping rotation shaft, the connecting rod is built-in with conducting wire.
6. a kind of remote operation navigation device based on in-situ projection technology according to claim 1, at the operation end Reason device and teleprocessing unit are mounted on display synchronization system.
7. a kind of remote operation navigation device based on in-situ projection technology according to claim 1, at the operation end It is respectively arranged with microphone and sound equipment on reason device and remote port processor, for receiving and sending voice signal.
8. a kind of remote operation air navigation aid based on in-situ projection technology, it is characterised in that include the following steps:
Step 1, camera collection site color video data;
Step 2, operation end processor carry out signal processing to color video data;
Step 3, operation end processor transmit a signal to remote port processor by internet;
Step 4, remote port doctor according to operation end real-time image information remote port processor the enterprising rower of screen The instruction information of remote port doctor is passed through internet real-time Transmission to operation end processor by note guidance, remote port processor;
Step 5, operation end processor will pass through in-situ projection device for the operation of remote port doctor after the signal processing received Instruction projects to the corresponding surgery location of patient;
Step 6, operation end doctor perform the operation according to guidance.
9. a kind of remote operation air navigation aid based on in-situ projection technology according to claim 8, the remote port doctor Life is remotely explained by voice signal, meanwhile, the instruction letter of simultaneous display remote port on the display of end processor of performing the operation Breath.
CN201910302779.5A 2019-04-16 2019-04-16 A kind of remote operation air navigation aid and device based on in-situ projection technology Pending CN110060771A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910302779.5A CN110060771A (en) 2019-04-16 2019-04-16 A kind of remote operation air navigation aid and device based on in-situ projection technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910302779.5A CN110060771A (en) 2019-04-16 2019-04-16 A kind of remote operation air navigation aid and device based on in-situ projection technology

Publications (1)

Publication Number Publication Date
CN110060771A true CN110060771A (en) 2019-07-26

Family

ID=67319161

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910302779.5A Pending CN110060771A (en) 2019-04-16 2019-04-16 A kind of remote operation air navigation aid and device based on in-situ projection technology

Country Status (1)

Country Link
CN (1) CN110060771A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110718286A (en) * 2019-09-11 2020-01-21 宁波江丰生物信息技术有限公司 Remote material drawing guiding device
WO2022067608A1 (en) * 2020-09-30 2022-04-07 中国科学技术大学 Remote surgical guidance and teaching apparatus and method, and medical device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120057174A1 (en) * 2010-01-20 2012-03-08 Faro Technologies, Inc. Laser scanner or laser tracker having a projector
CN106510846A (en) * 2016-11-24 2017-03-22 南方医科大学 Multi-probe compatible in-situ projection imaging processing system
CN107049491A (en) * 2017-05-16 2017-08-18 江苏信美医学工程科技有限公司 A kind of common optical axis formula diseased region imaging projection guider and method
CN108420532A (en) * 2018-04-04 2018-08-21 中国科学技术大学 A kind of hand-held fluorescence image navigation positioning device
CN108601630A (en) * 2015-12-22 2018-09-28 斯栢迈股份公司 The figure control navigation device in the art during spine regions and the surgical operation of neighbouring thorax, pelvis or the region on head

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120057174A1 (en) * 2010-01-20 2012-03-08 Faro Technologies, Inc. Laser scanner or laser tracker having a projector
CN108601630A (en) * 2015-12-22 2018-09-28 斯栢迈股份公司 The figure control navigation device in the art during spine regions and the surgical operation of neighbouring thorax, pelvis or the region on head
CN106510846A (en) * 2016-11-24 2017-03-22 南方医科大学 Multi-probe compatible in-situ projection imaging processing system
CN107049491A (en) * 2017-05-16 2017-08-18 江苏信美医学工程科技有限公司 A kind of common optical axis formula diseased region imaging projection guider and method
CN108420532A (en) * 2018-04-04 2018-08-21 中国科学技术大学 A kind of hand-held fluorescence image navigation positioning device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110718286A (en) * 2019-09-11 2020-01-21 宁波江丰生物信息技术有限公司 Remote material drawing guiding device
WO2022067608A1 (en) * 2020-09-30 2022-04-07 中国科学技术大学 Remote surgical guidance and teaching apparatus and method, and medical device

Similar Documents

Publication Publication Date Title
RU2740259C2 (en) Ultrasonic imaging sensor positioning
US7774044B2 (en) System and method for augmented reality navigation in a medical intervention procedure
CN106308946B (en) A kind of augmented reality devices and methods therefor applied to stereotactic surgery robot
JP6336929B2 (en) Virtual object display device, method, program, and system
US8933965B2 (en) Method for calculating light source information and generating images combining real and virtual images
JP4298407B2 (en) Video composition apparatus and video composition method
EP3753507A1 (en) Surgical navigation method and system
WO2016132817A1 (en) Virtual-object display device, method, program, and system
JP2019502414A (en) Method and apparatus for observing a 3D surface image of a patient during surgery
WO2014037953A2 (en) Digital system for surgical video capturing and display
KR20160033721A (en) Information processing apparatus, information processing method, and information processing system
CN110060771A (en) A kind of remote operation air navigation aid and device based on in-situ projection technology
CN207164367U (en) AR glasses and its tracing system
JP2015019679A (en) Information processing device, information processing method, and information processing system
CN111035458A (en) Intelligent auxiliary system for operation comprehensive vision and image processing method
CN106096301A (en) A kind of remote audio-video operation assistance system
JP2007034628A (en) Method and system for image processing
TWI741196B (en) Surgical navigation method and system integrating augmented reality
CN110687669A (en) Tracking type naked eye 3D display system and method based on body type microscope
CN109620408A (en) A kind of augmented reality operation guiding system scaling method based on electromagnetic location
CN105938665A (en) Remote audio and video operation demonstration system
CN109730771A (en) A kind of operation guiding system based on AR technology
US20030120155A1 (en) Video-assistance for ultrasound guided needle biopsy
CN108446011A (en) A kind of medical householder method and equipment based on augmented reality
CN117918955B (en) Augmented reality surgical navigation device, method, system equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190726