CN109427103A - A kind of VR system for demonstrating therapeutic scheme and check affected part in real time - Google Patents

Abstract

Therapeutic scheme can be demonstrated the invention discloses one kind and checks the VR system in affected part in real time, it include: terminal and server-side, the server-side includes: image unit, reconstruction unit, volume drawing unit, surface model unit and Pseudo-color technology unit, and the terminal includes: reality environment unit and virtual reality display output unit.The present invention can show to three-dimensional 3D model while can obtain the planing surface structure on arbitrary section, so as to help doctor preferably to judge the complicated state of an illness, while avoid mistaken diagnosis.Furthermore, the present invention demonstrates therapeutic scheme according to the color colouring scheme of puppet that different demands provide various ways, the surface model is drawn into pseudo- color colouring, affected part can be checked in real time, preferably meet the needs of different scenes such as diagnosis and treatment, medical educational and scientific research.

Description

A kind of VR system for demonstrating therapeutic scheme and check affected part in real time

Technical field

The present invention relates to VR field of virtual reality, intelligent medical field, in particular to one kind can demonstrate therapeutic scheme and in real time Check the VR system in affected part.

Background technique

VR is a meta-synthetic engineering, is related to computer graphics, human-computer interaction technology, sensing technology, artificial intelligence Equal fields, it with computer generate three-dimensional view true to nature, listen, smell etc. is felt, make one as participant by appropriate device, certainly Experience and reciprocation so are carried out to virtual world.When user carries out position movement, computer can carry out complicated immediately Operation passes the accurate world 3D image back generation telepresenc.Integration ofTechnology computer graphical (CG) technology, computer are imitative The later development of the technologies such as true technology, artificial intelligence, sensing technology, display technology, network parallel processing is one kind by counting The high-tech simulation system that calculation machine technology auxiliary generates.The feature of virtual reality system: Multi-Sensory refers in addition to generally calculating Except visual perception possessed by machine technology, there are also Auditory Perception, power to feel perception, tactilely-perceptible, motion perception, or even including taste Feel perception, detected by scent etc..Ideal virtual reality technology should have perceptional function possessed by all people.Due to related skill The limitation of art, especially sensing technology, perceptional function possessed by virtual reality technology are only limitted to vision, the sense of hearing, and power is felt, touching Feel, movement etc. is several.Submergence sense, refers to that user feels the really degree being present in simulated environment as leading role.Ideal mould Near-ring border should make user be difficult to distinguish truth from false, and put into user whole-heartedly in the three-dimensional virtual environment of computer creation, All in the environment appear to be really, sound being genuine, and it is genuine for moving up, or even smell, taste etc. all Feeling is all really, as in feeling in the real world.Interactivity refers to that user grasps object in simulated environment The natural degree (including real-time) making degree and being fed back from environment.For example, user can be gone directly to grab simulation with hand Virtual object in environment, at this moment hand has the feeling that hold thing, and can feel the weight of object, the object grabbed in the visual field Also it can be moved at once with the movement set about.Imagination, be emphasize virtual reality technology should have it is wide imagine space, can Widen mankind's cognitive range, not only reproduce necessary being environment, can also arbitrarily conceive it is objective be not present even not The environment that may occur.

VR technology is a kind of trial of the mankind to the wonderful dream for breaking through itself limitation.Its maximum value is exactly to allow soon It is consolidation at being soon empty.Currently, the application that VR and treatment combine has very much, it is psychotherapy first, the feature of VR maximum is Environment reproduces, and environment effect maximum to people is exactly psychological application.Many psychotherapists and the common mode of spiritual expert It is to be recalled or imagination scene by over the course for the treatment of going guidance patient, treatment is achieved the purpose that with this.This mode The disadvantage is that the imagination and memory of patient are difficult to control, so effect is difficult to assess.VR is advantageous in that it can allow this environment Scene becomes to visualize and standardize.Therefore in psychotherapy field, for example, it is wound emergency, disfunction, neurosis, self-closing Disease, acrophobia, claustrophobia, public speech neurosis, intensive neurosis etc. can be reproduced by the environment of VR technology to reach The purpose for the treatment of.It says for another example, anxiety disorder, attention deficit and schizophrenia can also be by VR come virtual specific people Or special efficacy improves relevant some symptoms.

Intelligent medical is by making health account area medical information platform, using state-of-the-art technology of Internet of things, in fact Show patient and interacting between medical worker, medical institutions, Medical Devices, progressively reaches informationization.It is medical in the near future Industry will incorporate the high-tech such as more artificial intelligences, sensing technology, and medical services is made to move towards the intelligence of real meaning, push doctor The prosperity and development for the treatment of cause.Particularly in China under the overall background of new medical reform, intelligent medical is coming into the life of common people. For example, Chinese patent application in the prior art, application number: 201610304125.2 is a kind of based on virtual reality interaction technique Machine interrogation system, contain data acquisition module, virtual reality interactive module (VR interactive module), data simultaneous module and Data processing and control module.Data acquisition module is responsible for acquiring the interaction feedback data and physiology sign data of measurand； VR interactive module is responsible for the standardized designs content with special characteristic of user's presentation；The purpose of data simultaneous module is The data of VR interactive module are reached synchronous with the data of data acquisition module；Data processing and control module are responsible for handling data And control the work of each module.It can be based on the interrogation of the machine of virtual reality interaction technique.For another example, Chinese patent application, Application number: 201610948082.1 remote emergency control systems and method based on virtual reality open camera acquisition medical treatment The first aid scene image of the emergency situations and patient clinical symptom at first aid scene in cabin；First aid scene image is passed through into signal transmitting and receiving Device is sent to remote monitoring center platform；The vital sign information of career in medicine sign monitoring device acquisition patient simultaneously passes through signal transmitting and receiving Device is sent to remote monitoring center platform；The first-aid guide video that remote monitoring center platform is sent is received by signal transceiver Picture, and first-aid guide video pictures are sent to projection unit；Control projection unit projects to first-aid guide video pictures To instruct the medical staff at first aid scene as First Aid on annular projection's curtain.Tele-medicine guidance may be implemented.

But have the defects that in the prior art as follows:

1) the case where can not demonstrating therapeutic scheme for patient, the complicated state of an illness can not be showed in real time, to be easy to cause mistaken diagnosis；

It 2) can not be by checking the affected part of patient under virtual reality scenario, and since image is mostly black white image, Wu Faqing Identified or recognized clearly affected part.

Summary of the invention

The technical problem to be solved by the present invention is to, provide it is a kind of can real time demonstration treatment method, check the VR system in affected part System.

Above-mentioned technical problem is solved, therapeutic scheme can be demonstrated the present invention provides one kind and checks the VR system in affected part in real time System, comprising: terminal and server-side,

The server-side includes: image unit, reconstruction unit, volume drawing unit, surface model unit and Pseudo-color technology Unit,

The image unit is stored to obtain medical image file, and according to unified DICOM format,

The reconstruction unit, to go out image space according to medical image file reconstruction,

The volume drawing unit, to draw out image data according to volume rendering algorithm,

The surface model unit, to simulate surface model according to image data,

The Pseudo-color technology unit, the surface model is drawn pseudo- color colouring,

The terminal includes: reality environment unit and virtual reality display output unit,

The reality environment unit, to receive from the image after the Pseudo-color technology cell processing and import virtual Actual environment,

The virtual reality display output unit, to real-time rendering and display virtual real image.

Further, the terminal includes: remote control unit, data transmission unit,

The remote control unit is referred to execute remote control commands by sending long-range control to the server-side It enables, and obtains the authorization for being directed to different objects,

The data transmission unit, to transmit/receive information, associated medical image file and the unique mark of patient Know ID.

Further, the terminal further include: 3D printing api interface,

To export the 3D printing result of stl formatted file according to the output result of the Pseudo-color technology unit.

Further, the server-side includes: the first GPU processing unit, to handle/export the image of DICOM format File.

Further, the terminal includes: the 2nd GPU processing unit, to handle/export the 3D rendering of surface model.

Further, it is scanned in the way of the scanning device of MRI, CT in the image unit and obtains CT/MR Data.

Further, the terminal includes: 3D model cutting unit, to cut internal organs unit and generate affected part section knot Structure.

Further, system further includes local network element, cloud network unit and local data library unit,

The local network element accesses local to establish local area network, and by the terminal and/or server-side Net,

The cloud network unit accesses wide area to establish cloud wide area network, and by the terminal and/or server-side Net,

The local data library unit, the medical image received to save and synchronize the terminal.

Further, the terminal includes: medical projector, mobile phone or PAD.

Further, the terminal and server-side are communicated by SOCKET socket protocol.

Beneficial effects of the present invention:

1) use system of the invention, due to the server-side include: image unit, reconstruction unit, volume drawing unit, Surface model unit and Pseudo-color technology unit can show to three-dimensional 3D model while can obtain the planing surface knot on arbitrary section Structure so as to help doctor preferably to judge the complicated state of an illness, while avoiding mistaken diagnosis.Further, according to different demands The color colouring scheme of puppet of various ways is provided, the surface model is drawn into pseudo- color colouring, can preferably meet diagnosis and treatment, medical treatment The demand of the different scenes such as teaching and scientific research.So that the performance of the state of an illness is more intuitive, convenient for doctor preferably to patient and family Belong to and explains the state of an illness.

2) system of the invention is used, the diagosis mode of medical imaging is changed at the terminal, allows patient, doctor can Clearly, the state of an illness and affected part are expressly understood that.Due to further including local network element, cloud network unit and local data base list Member, can be by network share in different areas data, thus fast construction medical imaging data platform.

3) further, due to the terminal further include: 3D printing api interface, so that three-dimensional data supports 3 D-printing, Realize the seamless interfacing of medical imaging and real medical scene.

4) present invention in system can also be applied to VR plastic operation direction, due to the present invention can technology 3D scanning, Model Reconstruction process, and patient facial region's Model Reconstruction based on 3D scanning technique；Finally using three dimensional graphics to model into Edlin, deformation, show postoperative effect at cutting on model.So system of the invention carries out mask reconstruction process Very simple can be right with 100% reduction patient facial region's feature and skin texture from scanning is started to model forming less than 1 minute It freely edits at each position of model.In addition, can be associated with based on bone, muscle with skin information；Facial plasty is carried out based on 3D model Operation (cutting bone, pad nose) whole simulation of operation.

5) this system application range is wider, for example can be cosmetic surgery hospital is the preview of customization surgical effect, Ke Huke To select different operation plans from shaping big data, tested in virtual face.

Detailed description of the invention

Fig. 1 is the structural representation of the VR system demonstrated therapeutic scheme and check affected part in real time in one embodiment of the invention Figure；

Fig. 2 is the system preferred structure schematic diagram in one embodiment of the invention；

Fig. 3 is the system preferred structure schematic diagram in further embodiment of this invention；

Fig. 4 is the system preferred structure schematic diagram in another embodiment of the present invention；

Fig. 5 is the system preferred structure schematic diagram in yet another embodiment of the invention；

Fig. 6 is the system preferred structure schematic diagram in further embodiment of this invention.

Specific embodiment

The principle of the disclosure is described referring now to some example embodiments.It is appreciated that these embodiments are merely for saying It is bright and help it will be understood by those skilled in the art that with the purpose of the embodiment disclosure and describe, rather than suggest the model to the disclosure Any restrictions enclosed.Content of this disclosure described herein can be implemented in the various modes except mode described below.

As described herein, term " includes " and its various variants are construed as open-ended term, it means that " packet It includes but is not limited to ".Term "based" is construed as " being based at least partially on ".Term " one embodiment " it is understood that For " at least one embodiment ".Term " another embodiment " is construed as " at least one other embodiment ".

Fig. 1 is the structural representation of the VR system demonstrated therapeutic scheme and check affected part in real time in one embodiment of the invention Scheme, the VR system in the present embodiment, comprising: terminal 1 and server-side 2,

The server-side 2 include: image unit 21, reconstruction unit 22, volume drawing unit 23, surface model unit 24 and Pseudo-color technology unit 25,

The image unit 21 is stored to obtain medical image file, and according to unified DICOM format,

The reconstruction unit 22, to go out image space according to medical image file reconstruction,

The volume drawing unit 23, to draw out image data according to volume rendering algorithm,

The surface model unit 24, to simulate surface model according to image data,

The Pseudo-color technology unit 25, the surface model is drawn pseudo- color colouring,

The terminal 1 includes: reality environment unit 11 and virtual reality display output unit 12,

The reality environment unit 11, to receive from the image after the Pseudo-color technology cell processing and import void Quasi- actual environment,

The virtual reality display output unit 12, to real-time rendering and display can demonstrate therapeutic scheme and/or affected part Real-time virtual real world images.

Above-mentioned 21 traditional Chinese medicine image file of image unit includes but is not limited to: CT, MRI image file inside hospital.DICOM (Digital Imaging and Communications in Medicine) i.e. digital imaging and communications in medicine, is medicine figure The international standard (ISO 12052) of picture and relevant information, the data that can be used for that clinical needs are able to satisfy to define quality are handed over The Medical Image Format changed.Preferably, it is scanned simultaneously in the way of the scanning device of MRI, CT in the image unit 21 Obtain CT/MR data.

Above-mentioned reconstruction unit 22 is the data externally measured by object, and the shape of three-dimension object is obtained through digital processing The technology of information.Image Reconstruction Technology is initially to apply in Medical Equipment for Radiotherapy, the image of display partes corporis humani point calculates Machine tomography, abbreviation CT technology, after gradually applied in many fields.Mainly there are backprojection reconstruction, light and shade to restore shape Shape, stereoscopic vision are rebuild and laser ranging is rebuild.

Above-mentioned volume drawing unit 23 is based on scientific visualization technology, mainly uses computer graphics, image procossing, meter The methods of calculation machine vision, the symbol in the calculating such as science, engineering science, medicine, measurement process, digital information are converted to intuitively Graph image, and theory, the technology and methods shown on the screen.

Specifically, the target in volume drawing unit 23 is the spacial flex body details on a secondary picture, volume drawing is realized Effect to be achieved.Volume Rendering Techniques using object to the principle of absorption of light as theoretical basis, on implementation, be finally based on Transparency composite calulation model.Pass through classical illumination model, such as phong model, cook- in volume drawing unit 23 Torrance model all as the supplement of Volume Rendering Techniques, improves volume drawing effect, enhances the sense of reality.It is swept in volume drawing unit 23 The source mode for retouching data is apparatus measures data, including but not limited to: CT or MRI.Volume textures in volume drawing unit 23 are It is three-D grain, is the extension of traditional 2D texture logically.Three-dimensional data is stored in XY pixel planes according to certain rule Obtained texture, referred to as volume textures volume texture.In general, 2 d texture is a simple bitmap Piece, for providing the color value of surface point for threedimensional model；And a three-D grain, it may be considered that by much opening 2D texture group At, for describing the picture of three-dimensional space data.Three-D grain is accessed by three-D grain coordinate.Above-mentioned volume drawing list Volume data is usually to be scanned by CT instrument in member 23, is then stored on the pixel of picture.It is more common Volume textures format includes but is not limited to .dds format and .raw format based on DirectX.

The volume rendering algorithm used in above-mentioned volume drawing unit 23, including but not limited to: light projecting algorithm (Ray- Casting), mistake cuts-shape algorithm (Shear-warp), frequency domain volume rendering algorithm (Frequency Domain) or the calculation of snow throwing ball Method (Splatting).

Preferably, light projecting algorithm can be used, which is based on ray scanning process in solution, meets the mankind Existence general knowledge, it is readily appreciated that；Secondly, the algorithm can achieve preferable drafting effect；Finally the algorithm can more easily It is transplanted on GPU and is realized, can achieve the requirement of real-time rendering at the terminal.

Surface model in above-mentioned surface model unit 24 is to the calculating that describes to be made of body surface point, line, curved surface Machine model.In one of above-mentioned surface model unit 24 embodiment, need to rely on the axis in each region of image data 3d space is divided into several regions according to the plane where all section lines currently entered, calculates each area by planar set The axial plane collection in domain projects to the section line on each face in region on the axial plane collection in the region, by section line with Projection on axial plane collection is connected, and constitutes a solid, then extracts the surface of all solids and be stitched together, shape At the subsurface in the region, the subsurface of all areas is connected, constitutes final surface model.

DICOM medical image is converted to DIB bitmap by above-mentioned Pseudo-color technology unit 25, by the related data of DICOM file Element completes data structure and image data conversion.Data structure include: bitmap file head, message bit pattern head, color table, Image data etc..Bitmap file head illustrates the composition information of file, and message bit pattern head illustrates the essential information of image data, Color table then describes the color information that image is shown.The Pseudo-color technology is secondary colored a secondary gray level image is mapped as one The enhancement method of image.Above-mentioned 25 Pseudo Col ored Image of Pseudo-color technology unit refers to greyscale image transitions into chromatic image.Because Human eye is much higher than colored resolution capability the resolution capability to gray level image, so can be at colour by greyscale image transitions Human eye is improved to the resolving ability of image detail.

In some embodiments, therapeutic scheme is in terminal 1 to be demonstrated, and operation includes but is not limited to, model rotation, Model cutting, model recombination.

In some embodiments, affected part is checked in real time to be operated in terminal 1, by real-time rendering as a result, inspection Find affected part.

In some embodiments, Pseudo-color technology unit 25 uses intensity top and bottom process, is most simple in pseudo color processing techniqus One kind.One cutting planes for being parallel to x-y plane is set on some gray level Li, below cutting planes, i.e. gray scale Pixel of the grade less than Li distributes to a kind of color, and the pixel that gray level Li is greater than on corresponding cutting planes distributes to another face Color.Cutting result is segmented into two layers of pseudo-colours in this way.M plane can be used to go to cut, M different gray scale will be obtained The region of grade is thus that have M kind color be color image.

In some embodiments, Pseudo-color technology unit 25 can be become gray level image using gray-scale-color transform method Continuous multicolor image with multiple color gradual change.By 3 converters of red, green, blue by image by different conversion characteristics, Then the output of three Color Channels is synthesized into certain color.Due to the difference of three kinds of colour switchings, so that different size gray scale Grade can synthesize different colors.

In some embodiments, Pseudo-color technology unit 25 uses color mapping method, is done using the method needs of color mapping One color mapping table, different grey-scale can all have corresponding color.This is similar with intensity top and bottom process, is segmented into different Level, corresponding color can be done according to the actual situation to be mapped.In practical applications, infrared caused by thermal imaging temp measuring system Image is black and white grayscale image, and gray value dynamic range is little, and human eye is difficult to obtain information abundant from these gray levels. In order to more intuitively enhance the level of display image, human eye resolution capability is improved, the image absorbed to system carries out pseudo-colours Processing keeps image information more abundant to achieve the effect that image enhancement.Such as heated object imaging is carried out pseudo- color When color, the low region of gray scale is arranged near blue (or bluish grey, black etc.), and the high region of gray level is arranged near red (or reddish brown, white etc.), to facilitate the observation of doctor or patient to object.

In above-mentioned reality environment unit 11, by processing unit by terminal 1 and the external VR glasses carried or VR projector can be realized the effect of the virtual reality of the surface model after Pseudo-color technology.For example, in some embodiments, by In the deviceorientation event that most of virtual reality projects based on browser in terminal are all using browser. The direction of browser equipment is told by the event, and browser is allowed to be acted when equipment rotates or tilts.Creation The JavaScript frame three.js of 3D shape and scene, using DeviceOrientationControls.js to conduct Three.js plug-in unit helps through supervision equipment direction, can separately camera be adjusted according to the movement of equipment. OrbitControls.js-to the controller spare as one, can when no equipment is towards event mouse Adjust camera.StereoEffect.js to the effect plug-in unit as three.js, can for each eye to picture into The subtle angle adjustment of row, the stereoscopic effect having just as virtual reality obtain patient or doctor by reality environment unit 11 The work of raw it goes without doing any complexity, so that it may create real virtual reality split screen effect.

In above-mentioned virtual reality display output unit 12, renders and show the image that can demonstrate therapeutic scheme and/or affected part. Rendering mode includes but is not limited to VRay, it is possible to provide individual rendering program, convenient for users to rendering various pictures.

Above-mentioned virtual reality display output unit 12 preferably uses, the SDK of AMD Liquid VR.

Above-mentioned virtual reality display output unit 12 preferably uses, the API of Nvidia GameWorks VR.

Using system of the invention, due to the server-side 2 include: image unit, reconstruction unit, volume drawing unit, Surface model unit and Pseudo-color technology unit can show to three-dimensional 3D model while can obtain the planing surface knot on arbitrary section Structure so as to help doctor preferably to judge the complicated state of an illness, while avoiding mistaken diagnosis.Further, according to different demands The color colouring scheme of puppet of various ways is provided, the surface model is drawn into pseudo- color colouring, can preferably meet diagnosis and treatment, medical treatment The demand of the different scenes such as teaching and scientific research.So that the performance of the state of an illness is more intuitive, convenient for doctor preferably to patient and family Belong to and explains the state of an illness.In addition, changing the diagosis mode of medical imaging at the terminal, allow patient, doctor can clearly, clearly Understand the state of an illness and affected part.Due to further including local network element, cloud network unit and local data library unit, can pass through Network share in different areas data, thus fast construction medical imaging data platform.

It is the system preferred structure schematic diagram in one embodiment of the invention as shown in Figure 2 as preferred in the present embodiment, The terminal 1 includes: remote control unit 14, data transmission unit 13,

The remote control unit 14, to execute remote control commands, by sending long-range control to the server-side Instruction, and the authorization for being directed to different objects is obtained, the remote control commands include but is not limited to: splitting, combine, put Greatly, the remote control operations such as diminution, focusing or rotation.The authorization includes but is not limited to: authorized doctor, authorization are suffered from Person.

The data transmission unit 13, to transmit/receive the information of patient, associated medical image file and unique Identify ID.The unique ID includes but is not limited to DICOM medical files.The information of the patient includes but is not limited to suffer from Person's name, identity card, case and associated medical image.

By the remote control unit 14, realize long-range to the long-range control of server-side or terminal time in terminal Control is shown.

By the data transmission unit 13, the common, shared of data is realized.

It is the system preferred structure signal in further embodiment of this invention as shown in Figure 3 as preferred in the present embodiment Figure, the terminal 1 further include: 3D printing api interface 15, to export stl according to the output result of the Pseudo-color technology unit The 3D printing result of formatted file.By supporting the three-dimensional data of printing, the 3 D-printing that can quickly publish books as a result, to just In quick analysing patient's condition and therapeutic scheme.

It is the system preferred structure signal in another embodiment of the present invention as shown in Figure 4 as preferred in the present embodiment Figure, includes: the first GPU processing unit 17 in the server-side 2, to handle/export the image file of DICOM format.It is described Terminal 1 includes: the 2nd GPU processing unit 16, to handle/export the 3D rendering of surface model.

In some embodiments, each frame image can be rendered by alternateing between two or more video cards.

In some embodiments, it is divided and comes when show in the VR helmet when image, the first GPU processing unit 17 Distribute task for every piece of video card: a GPU is responsible for left eye, and a GPU is responsible for right eye.

It is the system preferred structure signal in yet another embodiment of the invention as shown in Figure 5 as preferred in the present embodiment Figure, in the system of the present embodiment, the terminal 1 includes: 3D model cutting unit 18, to cut internal organs unit and generate trouble Locate cross-section structure.Above-mentioned 3D model cutting unit 18 is based on movable contour model.It is more commonly used medical image segmentation side Method can be divided into parametric active contour model and two kinds of geometric active contour model by the expression-form of its differently contoured curve.

Wherein, parametric active contour model expresses curve or curved surface in deformation process in the form of display parameters, allows It is directly interacted with model, is conducive to model in this way and quickly realizes in real time, but the model can not cope with complicated topological structure and become Change.It is exactly to pass through one that geometric active contour model, which is based on the characteristics of curve evolvement theory and Level Set Method Level Set Method, A high-dimension function curved surface expresses the contour curve of low-dimensional, i.e., contour curve is expressed as to the zero level collection of high-dimension function curved surface, And convert the equation of motion of contour curve to the partial differential equation of higher-dimension level set function.Geometric active contour model mainly divides For the model based on region and based on the model at edge, the former only considers the area information of image, the preferable detection image of energy Weak edge, and the latter can automatically handle the topologies change of contour line.

It is the system preferred structure signal in further embodiment of this invention as shown in Figure 6 as preferred in the present embodiment Figure, further includes local network element 19, cloud network unit 26 and local data library unit 20 in this system,

The local network element 19 accesses local to establish local area network, and by the terminal and/or server-side Net,

The cloud network unit 26 accesses wide area to establish cloud wide area network, and by the terminal and/or server-side Net,

The local data library unit 20, the medical image received to save and synchronize the terminal.

Above-mentioned local area network, including but not limited to, wireless aps, WI-FI, bluetooth, radio frequency, NFC etc. near-field communication.

Above-mentioned cloud wide area network, including but not limited to, GPRS, 2G/3G/4G etc. near-field communication.

Above-mentioned server-side, including but not limited to, medical CT server, hospital background service device.

Above-mentioned terminal, including but be not limited to, medical projector, mobile phone or PAD.

Above-mentioned terminal and server-side are communicated by SOCKET socket protocol, realize the process pipe of terminal and server-side Reason.When application layer carries out data communication by transport layer, TCP and UDP can be encountered while be provided simultaneously for multiple program process The problem of hair service.Multiple TCP connections or multiple program process may be needed through the same Transmission Control Protocol port transmission number According to.In order to distinguish different program process and connection, many computer operating systems are application program and ICP/IP protocol Interaction provides the interface of referred to as socket (Socket), distinguishes network communication and connection between different application process.It is raw At socket, mainly there are 3 parameters: the purpose IP address of communication, the end transport layer protocol used (TCP or UDP) and used Slogan.According to the mode of connection starting and the local socket target to be connected, the connection procedure between socket can divide For three steps: server is monitored, client request, connection confirmation.

Server is monitored: it is server side socket and the specific client socket of delocalization, but in the company of waiting The state connect monitors network state in real time.

Client request: refer to and connection request is proposed by the socket of client, the target to be connected is server end Socket.For this purpose, the socket of client must describe the socket for the server that it to be connected first, it is indicated that server end cap Address and the port numbers of word are connect, then just propose connection request to server side socket.

Connection confirmation: refer to and receive the connection of client socket in other words when server side socket listens to and ask It asks, it establishes a new thread with regard to the request of customer in response end socket, and client is issued in the description of server side socket End, once client confirmed that this description, connection just establish.And server side socket keeps listening state, after The connection request of other client sockets is received in continued access.

As preferred in the present embodiment, one of the present embodiment can demonstrate therapeutic scheme and check the VR in affected part in real time System, comprising: terminal 1 and server-side 2,

The server-side 2 include: image unit 21, reconstruction unit 22, volume drawing unit 23,24 yuan of surface model list and Pseudo-color technology unit 25,

The image unit 21 is stored to obtain medical image file, and according to unified DICOM format,

The reconstruction unit 22, to go out image space according to medical image file reconstruction,

The volume drawing unit 23, to draw out image data according to volume rendering algorithm,

The surface model unit 24, to simulate surface model according to image data,

The Pseudo-color technology unit 25, the surface model is drawn pseudo- color colouring,

The terminal 1 includes: reality environment unit and virtual reality display output unit,

The reality environment unit 11, to receive from the image after the Pseudo-color technology cell processing and import void Quasi- actual environment,

The virtual reality display output unit 12, to real-time rendering and display can demonstrate therapeutic scheme and/or affected part Real-time virtual real world images.

Above-mentioned terminal 1 and server-side 2 are communicated by SOCKET socket protocol.

Above-mentioned terminal 1 includes: medical projector, mobile phone or PAD.

Above system includes: local network element 19, cloud network unit 26 and local data library unit 20,

The local network element 19 accesses local to establish local area network, and by the terminal and/or server-side Net,

The cloud network unit 26 accesses wide area to establish cloud wide area network, and by the terminal and/or server-side Net,

The local data library unit 20, the medical image received to save and synchronize the terminal.

Above-mentioned terminal 1 includes: remote control unit 14, data transmission unit 13,

The remote control unit 14, to execute remote control commands, by sending long-range control to the server-side Instruction, and the authorization for being directed to different objects is obtained,

The data transmission unit 13, to transmit/receive the information of patient, associated medical image file and unique Identify ID.

Above-mentioned terminal further include: 3D printing api interface 15, to be exported according to the output result of the Pseudo-color technology unit The 3D printing result of stl formatted file.

It is scanned in the way of the scanning device of MRI, CT in above-mentioned image unit and obtains CT/MR data.

Above-mentioned server-side includes: the first GPU processing unit 16, to handle/export the image file of DICOM format.

Above-mentioned terminal includes: the 2nd GPU processing unit 17, to handle/export the 3D rendering of surface model.

Above-mentioned terminal 1 includes: 3D model cutting unit 18, to cut internal organs unit and generate affected part cross-section structure.

Using the system in the present embodiment, due to including: image unit 21, reconstruction unit 22, body in the server-side 1 23 yuan single, surface model unit 24 and Pseudo-color technology unit 25 are drawn, can show to three-dimensional 3D model while can obtain and appoint The planing surface structure anticipated on section so as to help doctor preferably to judge the complicated state of an illness, while avoiding mistaken diagnosis.More into one The surface model is drawn pseudo- color colouring by step, the color colouring scheme of puppet for providing various ways according to different demands, can be more preferable Ground meets the needs of different scenes such as diagnosis and treatment, medical educational and scientific research.So that the performance of the state of an illness is more intuitive, more convenient for doctor The state of an illness is explained to patient and family members well.Meanwhile the diagosis mode of medical imaging is changed on the terminal 1, allow patient, Yi Shengdou Can it is clear, be expressly understood that the state of an illness and affected part.Due to further including local network element 19, cloud network unit 26 and local Database Unit 20, can be by network share in different areas data, thus fast construction medical imaging data platform.

VR can also allow patient to be easier to receive with therapeutive combination, have the crowd of mental disease or obstacle to be reluctant The experience of reality faced.Virtual reality then can build a bridge in psychotherapy for shrink and patient, make psychology Treatment can preferably carry out with the help of virtual reality.Therapeutic scheme and in real time inspection are demonstrated using in the present embodiment The VR system in affected part will be brought to one equipped with virtual reality after patient is diagnosed the illness with anxiety In the room of equipment, patient is allowed to be sitting on a very comfortable chair, open equipment, patient is allowed to enter a brand-new, peace In detailed environment, such as forest or seashore.If patient anxiety degree is deep, light is dissolved into scenery and can't be released Bosom, it is necessary to which the guidance of shrink is conducted to patient's voice by virtual reality device with the professional knowledge of shrink Information, with environment on the spot in person, enable anxiety to have a better therapeutic effect.

In some embodiments, patient is placed in the source of anxiety, enables them in later real world Fear.Such as fear height, flight, animal (such as spider), drives, puts under house arrest, public speech neurosis.

In some embodiments, for pressure excessive caused psychological unbalance, depression, people is special in daily life and work It is not easy pressure, especially after wound or after major disaster.Patient is helped to solve the problems, such as psychological pressure by VR.Such as fear Public speech, job interview, the feared states of mind such as take the entrance examinations, and can also be trained by VR.By the environment of VR, utilize The method of " exposed property treatment " allows them to understand, be familiar with, how to cope with these scene bring pressure.

It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..

In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any One or more embodiment or examples in can be combined in any suitable manner.

In general, the various embodiments of the disclosure can be with hardware or special circuit, software, logic or any combination thereof Implement.Some aspects can be implemented with hardware, and some other aspect can be implemented with firmware or software, which can By controller, microprocessor or the execution of other calculating equipment.Although the various aspects of the disclosure be shown and described as block diagram, Flow chart is indicated using some other drawing, but it is understood that frame described herein, equipment, system, techniques or methods can In a non limiting manner with hardware, software, firmware, special circuit or logic, common hardware or controller or other calculating Equipment or some combinations are implemented.

Although this is understood not to require this generic operation suitable shown in addition, operation is described with particular order Sequence is executed or is executed with generic sequence, or require it is all shown in operate and be performed to realize expected result.In some feelings Under shape, multitask or parallel processing can be advantageous.Similarly, although the details of several specific implementations is begged in above By comprising but these are not necessarily to be construed as any restrictions to the scope of the present disclosure, but the description of feature is only needle in To specific embodiment.Certain features described in some embodiments of separation can also be held in combination in a single embodiment Row.Mutually oppose, various features described in single embodiment can also be implemented separately in various embodiments or to appoint The mode of what suitable sub-portfolio is implemented.

Claims (10)

1. one kind can demonstrate therapeutic scheme and check the VR system in affected part in real time characterized by comprising terminal and server-side,

The server-side includes: image unit, reconstruction unit, volume drawing unit, surface model unit and Pseudo-color technology unit,

The image unit is stored to obtain medical image file, and according to unified DICOM format,

The reconstruction unit, to go out image space according to medical image file reconstruction,

The volume drawing unit, to draw out image data according to volume rendering algorithm,

The surface model unit, to simulate surface model according to image data,

The Pseudo-color technology unit, the surface model is drawn pseudo- color colouring,

The terminal includes: reality environment unit and virtual reality display output unit,

The reality environment unit, to receive from the image after the Pseudo-color technology cell processing and import virtual reality Environment,

The virtual reality display output unit to real-time rendering and shows and can demonstrate the real-time of therapeutic scheme and/or affected part Virtual reality image.

2. VR system according to claim 1, which is characterized in that the terminal includes: remote control unit, data transmission Unit,

The remote control unit, to execute remote control commands, by sending remote control commands to the server-side, and The authorization for being directed to different objects is obtained,

The data transmission unit, to transmit/receive information, associated medical image file and the unique identification of patient ID。

3. VR system according to claim 1, which is characterized in that the terminal further include: 3D printing api interface,

To export the 3D printing result of stl formatted file according to the output result of the Pseudo-color technology unit.

4. VR system according to claim 1, which is characterized in that the server-side includes: the first GPU processing unit, is used With processing/output DICOM format image file.

5. VR system according to claim 1, which is characterized in that the terminal includes: the 2nd GPU processing unit, to Processing/output surface model 3D rendering.

6. VR system according to claim 1, which is characterized in that according to the scanning device of MRI, CT in the image unit Mode be scanned and obtain CT/MR data.

7. VR system according to claim 1, which is characterized in that the terminal includes: 3D model cutting unit, to cut It cuts internal organs unit and generates affected part cross-section structure.

8. VR system according to claim 1, which is characterized in that further include local network element, cloud network unit with And local data library unit,

The local network element, to establish local area network, and by the terminal and/or server-side access to LAN,

The cloud network unit accesses wide area network to establish cloud wide area network, and by the terminal and/or server-side,

The local data library unit, the medical image received to save and synchronize the terminal.

9. VR system according to claim 1-8, which is characterized in that the terminal includes: medical projector, hand Machine or PAD.

10. VR system according to claim 1-8, which is characterized in that the terminal and server-side pass through SOCKET socket protocol is communicated.