CN110223787A - A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user - Google Patents
A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user Download PDFInfo
- Publication number
- CN110223787A CN110223787A CN201910382639.3A CN201910382639A CN110223787A CN 110223787 A CN110223787 A CN 110223787A CN 201910382639 A CN201910382639 A CN 201910382639A CN 110223787 A CN110223787 A CN 110223787A
- Authority
- CN
- China
- Prior art keywords
- user
- server
- remote
- visualization
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000003814 drug Substances 0.000 title claims abstract description 18
- 238000012800 visualization Methods 0.000 title claims abstract description 14
- 230000003993 interaction Effects 0.000 claims abstract description 12
- 238000009877 rendering Methods 0.000 claims abstract description 11
- 230000006835 compression Effects 0.000 claims abstract description 9
- 238000007906 compression Methods 0.000 claims abstract description 9
- 230000009471 action Effects 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 230000033001 locomotion Effects 0.000 claims description 4
- 239000000463 material Substances 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000003745 diagnosis Methods 0.000 abstract description 10
- 241001269238 Data Species 0.000 abstract description 2
- 230000003902 lesion Effects 0.000 abstract description 2
- 238000004088 simulation Methods 0.000 abstract description 2
- 230000006399 behavior Effects 0.000 description 10
- 238000000034 method Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000006837 decompression Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 235000009470 Theobroma cacao Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 244000240602 cacao Species 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000004171 remote diagnosis Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Abstract
The present invention discloses a kind of visualization medicine remote assistant diagnostic platform to cooperate online based on multi-user, realizes step are as follows: 1) user terminal and service end data Screen sharing；2) remote multi-subscriber interaction is shared；3) operating right remote user switches online；In step 1), user terminal and service end data Screen sharing are as follows: 101) server completes two dimension or 3 D medical data render；102) server is completed to rendering video in window screenshotss；103) JPEG compression is carried out to screenshotss image；104) Terminal Server Client is sent images to the interval 100ms.Platform of the present invention supports the visualized datas such as the CT of doctor's displaying live view patient, makes diagnosis；Support that concrete analysis is held a consultation and can carried out to patient's lesion on multidigit expert's line to be discussed and the operation of some surgical simulations simultaneously, the rehabilitation programme of patient is instructed to the full extent, the doctor for being in different regions in all parts of the country can be allowed to participate in jointly, realize the shared of optimal medical resource.
Description
Technical field
The present invention relates to a kind of medicine remote diagnosis platform, specially a kind of visualization doctor to be cooperated online based on multi-user
Learn remote assistant diagnostic platform.
Background technique
The medical level for promoting poverty-stricken area or low developed area is always one of focus of work of Party and government.Money
The factor that gold, traffic, resource match a series of unequal numerous complicateds, which causes, to be in people's the difficulty of getting medical service in these areas, cures the disease
Difficulty has seriously affected the quality of life of the local common people.Meanwhile with the continuous improvement of people's living standards, to Health Services
It is required that it is also higher and higher, and veteran professor medical expert is also limited, and focuses mostly in big city.Poverty-stricken area or
The common people of low developed area can not often leave work position and go meet the needs of patient to all parts of the country.Especially many diseases
People needs treatment in time, if the rehabilitation of patient can be seriously affected even by devoting a tremendous amount of time traffic in other respects etc.
Threaten their life.These problems not only save patient just in this way there is an urgent need to doctor or the remote assistance of hospital
Doctor's spending, it is often more important that won the time for their life security, therefore the means such as tele-medicine auxiliary diagnosis gradually by
It is well known.
The status of China's tele-medicine is concentrated be deployed between hospital and hospital at present, and often hospital, junior is to medical centre
It is proposed consultation of doctors application, medical centre determines the time, carries out remote medical consultation with specialists by modes such as phone or mails, and to the feelings of patient
Condition establishes electronic health record.Although the mode of this tele-medicine auxiliary diagnosis solves the problems, such as, but with developed country
Tele-medicine auxiliary diagnosis development level is compared, poor in terms of real-time, the availability of medical data, the accuracy for the treatment of.
It is total to improve remote medical specialist that traditional Remote medical diagnosis platform only supports multi-user voice and visual straightforward procedure
With work quality of diagnosis, often it is difficult to realize strange land multi-user and cooperates jointly to same data, such as hand is passed through to three-dimensional data
Gesture or mouse interact.
Summary of the invention
For poverty-stricken area in the prior art or low developed area medical treatment real-time, the availability of medical data,
The deficiencies of poor in terms of the accuracy for the treatment of, the problem to be solved in the present invention is to provide one kind can very good solution remotely cure at present
Treatment system there are the problem of, realize the visualization medicine remote assistant diagnostic platform that visually cooperates online based on multi-user.
In order to solve the above technical problems, the technical solution adopted by the present invention is that:
A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user of the present invention, passes through following steps
It realizes:
1) user terminal and service end data Screen sharing；
2) remote multi-subscriber interaction is shared；
3) operating right remote user switches online.
In step 1), user terminal and service end data Screen sharing are as follows:
101) server completes two dimension or 3 D medical data render；
102) server is completed to rendering video in window screenshotss；
103) JPEG compression is carried out to screenshotss image；
104) Terminal Server Client is sent images to the interval 100ms.
In step 2), remote multi-subscriber interaction is shared are as follows:
201) terminal monitoring has the mouse or gesture motion of current control authority user；
202) consensus standard behavior description is converted by interactive action；
203) server-side will be sent to by the interbehavior of consensus standard behavior description；
204) server-side renders picture material according to user mutual behavior again；
205) it executes step 1 and realizes that the long-range multi-terminal user of picture is shared.
In step 3), operating right remote user switches online are as follows:
301) first to automatically become control authority user into a discussion user in group；
302) other users FTP client FTP stops acquisition user behavior action message, it is prevented to upload to server-side completion
Remote rendering；
303) other users application operating right, after current control authority user agrees to, terminal acquires its action behavior
Information；
304) step 1) and step 2) are repeated.
The invention has the following beneficial effects and advantage:
1. platform of the present invention supports doctor to browse the visualized datas such as the CT of patient in real time, diagnosis is made；It supports simultaneously
It holds a consultation on multidigit expert's line and concrete analysis discussion and the operation of some surgical simulations can be carried out to patient's lesion, utmostly
On instruct the rehabilitation programme of patient；The platform is the system platform tool under wide area network, can allow and be in all parts of the country differently
The doctor in area participates in jointly, realizes the shared of optimal medical resource.
2. the present invention realizes different location different terminals to the collaborative interactive technology of same data, development support is local high
The data center of performance rendering is responsible for different terminals telemedicine data two dimension or multiple terminals is supported in three-dimensional rendering work, design
Synchronous collaboration algorithm realizes the discussion of multi-expert online interaction formula, realizes visualization medicine remote collaboration in conjunction with other multimedia means
Auxiliary diagnosis platform, compared with conventional method or platform, it is horizontal that the present invention is obviously improved online multi-expert Cooperative diagnosis.
3. the present invention is different from traditional tele-medicine auxiliary diagnosis platform, the innovative remote multi-subscriber that provides exists
The function of line synchronisation greatly facilitates discussion of the expert to medicine two dimension or three-dimensional data, improves remote medical consultation with specialists
Quality has highly important application value.
Detailed description of the invention
Fig. 1 is that servers' data of the present invention renders schematic diagram；
Fig. 2 is finger gesture treatment process figure of the present invention；
Fig. 3 is tele-conferencing system treatment process figure of the present invention；
Fig. 4 is remote collaboration synchronous effect figure (one) of the present invention；
Fig. 5 is remote collaboration synchronous effect figure (two) of the present invention.
Specific embodiment
The present invention is further elaborated with reference to the accompanying drawings of the specification.
A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user of the present invention, passes through following steps
It realizes:
1) user terminal and service end data Screen sharing；
2) remote multi-subscriber interaction is shared；
3) operating right remote user switches online.
In step 1), user terminal and service end data Screen sharing are as follows:
101) server completes two dimension or 3 D medical data render；
102) server is completed to rendering video in window screenshotss；
103) JPEG compression is carried out to screenshotss image；
104) Terminal Server Client is sent images to the interval 100ms.
In step 2), remote multi-subscriber interaction is shared are as follows:
201) terminal monitoring has the mouse or gesture motion of current control authority user；
202) consensus standard behavior description is converted by interactive action；
203) server-side will be sent to by the interbehavior of consensus standard behavior description；
204) server-side renders picture material according to user mutual behavior again；
205) it executes step 1 and realizes that the long-range multi-terminal user of picture is shared.
In step 3), operating right remote user switches online are as follows:
301) first to automatically become control authority user into a discussion user in group；
302) other users FTP client FTP stops acquisition user behavior action message, can not upload to server-side and complete far
Journey rendering；
303) other users application operating right, after current control authority user agrees to, terminal acquires its action behavior
Information；
304) step 1) and step 2) are repeated.
Data render used in the tele-conferencing system that the present invention designs all is completed in server end, only after final rendering
Screenshot be sent to all user terminals, thus can realize more light-weighted movement in the case where not distinguishes data type
End.
As shown in Figure 1, all data renders are completed in server end in order to reach Real-Time Sharing, server is by screenshot
It is compressed, is transmitted after compression, prove that the transmission frequency at the interval 100ms can achieve best experience effect into a series of experiments is crossed
Fruit.
Picture compression uses vtkZLibDataCompressor.Zlib is general compression library, provides a set of in-
Memory compression and decompression function, and the integrality (integrity) for the data that solution presses out can be detected,
VtkZLibDataCompressor be vtkDataCompressor a specific implementation class use zlib carry out compression and
Decompression.
One powerful visualization system not only needs powerful data-handling capacity, also to there is easy-to-use interaction function
Energy.Traditional vtk can be monitored from mouse, the message of the external equipments such as outside such as keyboard, and the present invention is become by the end iPad
At interactive component, for acquiring user gesture, the parameter of control visualization process is obtained, and by the parameter instruction service of passing back to
Device end achievees the purpose that real-time, interactive.
Gesture design is divided into two parts altogether, and first part is the end iPad (illustration), in Cocoa, the touching of representative
The class of object is UITouch, will produce corresponding event after user touches screen, all relevant UITouch objects all can
It is packaged in event UIEvent, is distributed by UIResponse and specific object is transferred to handle.
When one or more fingers touch screen, touching message is sent.
When one or more fingers move on the screen, sends and refer to touching message more.
When one or more fingers frame out, sliding message is sent.
When touching the cancellation of sequence system event as such as phone incoming call, sends interaction and cancel message.
Another part is the interaction device in server-side, they are packaged by window again after remotely obtaining event argument from iOS
Instruction set, is sent to the interaction device processing of server end, and specific control process flow chart is as shown in Figure 2.
Server-side by maintaining an array to refer to touch event to handle more, and 8 parameters are respectively intended to indicate that x-axis is sat altogether
Cursor position, y-axis coordinate position, if pin ctrl, if pin shift, key value, number of repetition, symbolic code, pointer draws
Rope.
Tele-conferencing system is critical function of the invention, and the thought totally realized is that all data renders are all servicing
Device end is completed, and only the screenshot after final rendering is sent to the end of iPad, thus can be the not distinguishes data type the case where
Under, realize more light-weighted mobile terminal.All gestures and partial function all pass through instruction set and are sent to server end, service
Device is made accordingly.Flow chart is as shown in Figure 3
In receiving thread, preceding 30 byte is first received first, is parsed instruction name, and the data length that parsing comes, is led to
It crosses data length and has received remaining data.If instruction name is SCREENSHOTSEND, data packet is divided to two sections, first part
It is the size after decompression, second is truthful data.It is decompressed using vtk, updates UI in main thread later, be worth noting
Be that autorelease object cannot be guaranteed when discharge, so not necessarily just being released immediately in the place that reference count is 0
It puts, so automatic release pond, which is added, solves Memory Leaks.Remote collaboration synchronous effect figure is as shown in Figure 4,5.
Claims (4)
1. a kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user, it is characterised in that pass through following step
It is rapid to realize:
1) user terminal and service end data Screen sharing；
2) remote multi-subscriber interaction is shared；
3) operating right remote user switches online.
2. the visualization medicine remote assistant diagnostic platform according to claim 1 to be cooperated online based on multi-user, special
It levies and is in step 1), user terminal and service end data Screen sharing are as follows:
101) server completes two dimension or 3 D medical data render；
102) server is completed to rendering video in window screenshotss；
103) JPEG compression is carried out to screenshotss image；
104) Terminal Server Client is sent images to the interval 100ms.
3. the visualization medicine remote assistant diagnostic platform according to claim 1 to be cooperated online based on multi-user, special
Sign is in step 2) that remote multi-subscriber interaction is shared are as follows:
201) terminal monitoring has the mouse or gesture motion of current control authority user；
202) consensus standard behavior description is converted by interactive action；
203) server-side will be sent to by the interbehavior of consensus standard behavior description；
204) server-side renders picture material according to user mutual behavior again；
205) it executes step 1 and realizes that the long-range multi-terminal user of picture is shared.
4. the visualization medicine remote assistant diagnostic platform according to claim 1 to be cooperated online based on multi-user, special
Sign is in step 3) that operating right remote user switches online are as follows:
301) first to automatically become control authority user into a discussion user in group；
302) other users FTP client FTP stops acquisition user behavior action message, prevents it from uploading to server-side and completes remotely
Rendering；
303) other users application operating right, after current control authority user agrees to, terminal acquires its action behavior information；
304) step 1) and step 2) are repeated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910382639.3A CN110223787A (en) | 2019-05-09 | 2019-05-09 | A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910382639.3A CN110223787A (en) | 2019-05-09 | 2019-05-09 | A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110223787A true CN110223787A (en) | 2019-09-10 |
Family
ID=67820734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910382639.3A Pending CN110223787A (en) | 2019-05-09 | 2019-05-09 | A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110223787A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202306552U (en) * | 2011-06-24 | 2012-07-04 | 海纳医信（北京）软件科技有限责任公司 | Remote real-time consultation system |
| CN103095828A (en) * | 2013-01-14 | 2013-05-08 | 上海电力学院 | Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization |
| CN106295107A (en) * | 2015-06-08 | 2017-01-04 | 浙江格林蓝德信息技术有限公司 | A kind of medical image that realizes synchronizes the method and system of the consultation of doctors |
-
2019
- 2019-05-09 CN CN201910382639.3A patent/CN110223787A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202306552U (en) * | 2011-06-24 | 2012-07-04 | 海纳医信（北京）软件科技有限责任公司 | Remote real-time consultation system |
| CN103095828A (en) * | 2013-01-14 | 2013-05-08 | 上海电力学院 | Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization |
| CN106295107A (en) * | 2015-06-08 | 2017-01-04 | 浙江格林蓝德信息技术有限公司 | A kind of medical image that realizes synchronizes the method and system of the consultation of doctors |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6325756B1 (en) | Concepts to implement medconnect | |
| Zhang et al. | Real-time teleconsultation with high-resolution and large-volume medical images for collaborative healthcare | |
| CN105678073B (en) | Medical image inspection method, apparatus and system | |
| CN106295107A (en) | A kind of medical image that realizes synchronizes the method and system of the consultation of doctors | |
| CN103577673A (en) | Real-time interactive remote medicine system and real-time interactive remote medicine method | |
| CN106126917A (en) | A kind of remote diagnosis system based on virtual reality technology | |
| CN103402071A (en) | Television-based doctor and patient information interaction method, system and equipment | |
| CN106454203A (en) | Mobile medical remote video consultation platform and method based on the internet | |
| Sharma et al. | Mobile technology: A tool for healthcare and a boon in pandemic | |
| CN105787266B (en) | Telemedicine System framework based on immediate communication tool and method | |
| Ye et al. | A telemedicine wound care model using 4G with smart phones or smart glasses: a pilot study | |
| CN107943282A (en) | A kind of man-machine interactive system and method based on augmented reality and wearable device | |
| CN103927452A (en) | Remote health monitoring system, method and device | |
| CN111629178A (en) | Image auxiliary marking system and method for telemedicine | |
| CN202004805U (en) | Point-to-point medical information service system | |
| CN110223787A (en) | A kind of visualization medicine remote assistant diagnostic platform to be cooperated online based on multi-user | |
| CN111653343A (en) | Medical real-time image remote consultation system and method | |
| CN111326263A (en) | Method, device and equipment for displaying labeling track and computer readable storage medium | |
| CN107610768A (en) | A kind of acquisition terminal and remote medical diagnosis system for distance medical diagnosis | |
| Zhang et al. | Adhd intelligent auxiliary diagnosis system based on multimodal information fusion | |
| CN114420262A (en) | Websocket-based DICOM image remote rendering method | |
| CN106326670B (en) | Consultation system | |
| Lu et al. | Mobile medical service system based on portable devices | |
| CN113284597A (en) | Critical MDT system and method based on scene fusion and MR | |
| CN206193785U (en) | Consultation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190910 |
|
| RJ01 | Rejection of invention patent application after publication |