CN112599235A - Remote medical control system and method - Google Patents

Remote medical control system and method Download PDF

Info

Publication number
CN112599235A
CN112599235A CN202011607478.2A CN202011607478A CN112599235A CN 112599235 A CN112599235 A CN 112599235A CN 202011607478 A CN202011607478 A CN 202011607478A CN 112599235 A CN112599235 A CN 112599235A
Authority
CN
China
Prior art keywords
medical
remote
local
medical procedure
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011607478.2A
Other languages
Chinese (zh)
Inventor
尚雷敏
符雯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai United Imaging Healthcare Co Ltd
Original Assignee
Shanghai United Imaging Healthcare Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai United Imaging Healthcare Co Ltd filed Critical Shanghai United Imaging Healthcare Co Ltd
Priority to CN202011607478.2A priority Critical patent/CN112599235A/en
Publication of CN112599235A publication Critical patent/CN112599235A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Abstract

The embodiment of the application provides a remote medical control system and a remote medical control method, and relates to the technical field of medical computer control. The telemedicine control system includes: at least one local end, each of which includes a medical device for executing a medical procedure; a remote peer including a first processing device in communication with at least one of the local peers, providing support operations for the medical devices to perform the medical procedure, the support operations including: pre-processing prior to execution of the medical procedure, the pre-processing comprising: pre-heating preparation and/or auto-calibration of the medical device. The remote medical control scheme which is more convenient and efficient is realized.

Description

Remote medical control system and method
Technical Field
The specification relates to the technical field of medical computer control, in particular to a remote medical control system and a remote medical control method.
Background
With the continuous progress of social and economic transformation processes such as aging, urbanization and the like, medical infrastructures of rural hospitals and related regional hospitals are greatly improved, such as the purchase of medical imaging equipment (CT, MR, XR, PET-CT and the like), but the problem of shortage of professional medical resources also exists. For example, many medical devices have strict qualification requirements for operators and users, and in many cases, the setting of a certain scanning parameter or the detailed observation of a certain image directly affect the diagnosis of a patient, but doctors and technicians in these hospitals may have low qualification levels and need more experienced technicians for medical support and guidance; and by observing the third-level hospital, technicians are abundant and have rich experience, and powerful support can be provided for the lower-level hospital. Particularly, aiming at the practical problems of shortage of medical resources in epidemic areas, insufficient medical operation and diagnosis experience of local technicians and the like, a more convenient and efficient remote medical control scheme capable of realizing integrated implementation of medical examination or scanning, medical operation guidance, medical diagnosis analysis and the like is urgently needed, so that the resources of doctors and technicians in different places with high quality are effectively grafted.
Disclosure of Invention
In one aspect, an embodiment of the present application provides a remote medical control system, including:
at least one local end, each of which includes a medical device for executing a medical procedure; a remote peer including a first processing device in communication with at least one of the local peers, providing support operations for the medical devices to perform the medical procedure, the support operations including: pre-processing prior to execution of the medical procedure, the pre-processing comprising: pre-heating preparation and/or auto-calibration of the medical device.
In some embodiments, each of the local ends further includes a second processing device communicatively connected to the medical device for remote interaction with the first processing device.
In some embodiments, the remote end and the local end are configured to perform remote interaction, the remote interaction including at least one of the following interactive operations: text interaction, voice call, or video session.
In some embodiments, the local end comprises at least one image acquisition device and/or at least one audio device, the image acquisition device is used for acquiring image data, the audio device is used for acquiring audio data, and preheating preparation and/or automatic correction are carried out on the medical equipment, and the method comprises the following steps: determining whether a target exists in the environment where the local end is located based on the remote interaction and/or the image data and/or the audio data; and in response to determining that the target is not present in the local end environment, controlling the medical device to perform the pre-heat preparation and/or the auto-correction.
In some embodiments, the supporting operations further comprise: the positioning of the executed object of the medical procedure specifically includes: guiding a positioning operation of an executed object of the medical procedure based on at least one of the remote interaction, the image data, the audio data, the image data including positioning state information of the executed object, and the audio data including voice feedback information and/or sound condition information of the executed object.
In some embodiments, the support operations further comprise providing an execution plan for the medical procedure, the medical procedure comprising at least one of a medical imaging scan and radiation therapy, the providing an execution plan for the medical procedure comprising: determining at least one of imaging parameters of the medical imaging scan and a radiotherapy plan for the radiation therapy.
In some embodiments, the support operation further includes execution control of the medical procedure, specifically including: connecting the local end in a remote interaction mode; and based on the remote interactive mode, controlling the medical equipment to execute medical imaging scanning to generate scanning data or execute radiotherapy.
In some embodiments, the support operation further includes processing the medical procedure-related data, specifically including: receiving the scanning data from the local end; and processing the scan data to generate a processing result.
In some embodiments, the supporting operations further comprise the transmission and display of the medical procedure related data comprises: and remotely transmitting at least one of the scanning data and the processing result to the remote end.
In some embodiments, the first processing device stores a trained deep neural network model for determining the processing result based on the scan data.
In some embodiments, the number of the local terminals is at least two, the remote terminal performs interactive switching between at least two local terminals, and at least two local terminals are both remotely connected with the remote terminal.
In some embodiments, the interactive switching sequence of the remote end between at least two local ends is determined according to a preset switching level rule between at least two local ends.
Another aspect of the embodiments of the present application provides a remote medical control method, including: establishing a remote connection between a local end and a remote end, wherein the local end comprises medical equipment used for executing a medical procedure; providing, by the remote end, a support operation for the medical procedure performed on the medical device, wherein the support operation comprises: pre-processing prior to execution of the medical procedure, the pre-processing comprising: pre-heating preparation and/or auto-calibration of the medical device.
The remote medical control system and the method provided by the embodiment of the application carry out pretreatment before execution of a medical procedure; positioning of the subject of the medical procedure; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; and the remote control integrated operation of the transmission and display of the data related to the medical procedure, realizes the remote medical control of automatically implementing intelligent pretreatment, positioning, scanning execution, automatic post-treatment, automatic reporting, data remote transmission, online diagnosis and the like by a local end, meets various real-time medical operation requirements including medical operation preparation and real-time medical operation guide interaction, and implements a more convenient and efficient remote medical control scheme for integrated implementation of medical examination or scanning, medical operation guidance, medical diagnosis analysis and the like, thereby effectively grafting superior doctor and technician resources in different places, solving the actual medical problems of shortage of medical resources in epidemic areas, insufficient medical operation and diagnosis experience of local technicians and the like, and being suitable for various medical remote control scenes.
Drawings
The present description will be further explained by way of exemplary embodiments, which will be described in detail by way of the accompanying drawings. These embodiments are not intended to be limiting, and in these embodiments like numerals are used to indicate like structures, wherein:
FIG. 1 is a schematic diagram of an application scenario of a telemedicine control system 100 according to some embodiments herein;
FIG. 2 is a schematic diagram of an application scenario of a telemedicine control system 200 according to further embodiments of the present disclosure;
FIG. 3 is a diagram illustrating an application scenario of a telemedicine control system 300 according to further embodiments of the present disclosure;
FIG. 4 is an exemplary flow chart of a telemedicine control method 400 shown in accordance with some embodiments of the present description;
FIG. 5 is an exemplary flow chart of a telemedicine control method 500 shown in accordance with some embodiments of the present description;
FIG. 6 is an exemplary block diagram of components of a remote medical control device 600, according to some embodiments of the present description;
FIG. 7 is an exemplary block diagram of a support operation execution module 620 in the remote medical control device 600 according to some embodiments of the present description.
Detailed Description
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only examples or embodiments of the present description, and that for a person skilled in the art, the present description can also be applied to other similar scenarios on the basis of these drawings without inventive effort. Unless otherwise apparent from the context, or otherwise indicated, like reference numbers in the figures refer to the same structure or operation.
It should be understood that "system", "apparatus", "unit" and/or "module" as used herein is a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, other words may be substituted by other expressions if they accomplish the same purpose.
As used in this specification and the appended claims, the terms "a," "an," "the," and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements.
Flow charts are used in this description to illustrate operations performed by a system according to embodiments of the present description. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, the various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or several steps of operations may be removed from the processes.
Fig. 1 is a schematic diagram of an application scenario of a telemedicine control system 100 according to some embodiments of the present description. By way of example only, as shown in FIG. 1, the telemedicine control system 100 may include one or more of a local end 110, a remote end 120, a user end 130, a storage device 140, and a network 150. The components in the telemedicine control system 100 may be connected in various ways. For example only, the remote end 120 may be connected to the storage device 140 directly or through the network 150. As another example, the remote peer 120 may be connected to the local peer 110 directly or through the network 150. As another example, the user terminal 130 may be connected to another component of the telemedicine control system 100 (e.g., the remote terminal 120) via the network 150.
Each of the one or more local ends 110 (e.g., local end 220-1, local end 110-2, …, 110-N) may include a medical device. The medical device may perform a medical procedure (e.g., medical diagnosis and/or medical treatment) and for acquiring and/or processing data related to the performance of the medical procedure. For example, the medical device may comprise an imaging device for acquiring image data relating to at least a portion of the subject. The medical device may also perform image reconstruction based on image data acquired by the imaging device. For another example, the medical device may include an interventional medical device operable to perform a treatment (e.g., radiation therapy) on at least a portion of the subject. For another example, the medical device may include an image-guided radiation therapy device for acquiring image data relating to at least a portion of the subject and performing radiation therapy based on the acquired image data. Exemplary imaging devices may include PET scanners, CT scanners, DR scanners, MRI scanners, and the like, or combinations thereof. Exemplary interventional medical devices may include Radiation Therapy (RT) devices, ultrasound therapy devices, thermal therapy devices, surgical interventional devices, and the like, or combinations thereof.
In some embodiments, each of the one or more local ends 110 (e.g., local end 220-1, local ends 110-2, …, 110-N) may further include a second processing device communicatively coupled to the medical device, the second processing device operable to remotely interact with the first processing device.
In some embodiments, the second processing device may be used to directly or indirectly control the medical device to perform the medical procedure, as well as undertake all or part of the following: data relating to the performance of a medical procedure is acquired and/or processed, and may be used, for example, to acquire image data relating to at least a portion of a subject, as well as for image reconstruction based on image data acquired by an imaging device.
The remote end 120 may include at least one processing device (also referred to as a first processing device). In some embodiments, the first processing device may be a computer, a user console, a single server or group of servers, or the like. The server groups may be centralized or distributed. In some embodiments, the remote end 120 may access information and/or data stored in the local end 110, the client 130, and/or the storage device 140 via the network 150. As another example, remote end 120 may be directly connected to local end 110, client 130, and/or storage device 140 to access stored information and/or data. In some embodiments, the remote end 120 may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a cloudy cloud, and the like, or any combination thereof. In some embodiments, the remote end 120 may include a medical device. Further description of the medical devices may refer to the related description of the medical devices of the local end 110.
The remote end 120 may communicate or connect with the local end 110 through the network 150. For example, the remote peer 120 may communicate with at least two of the local peers 110-1, 110-2, …, 110-N simultaneously. In some embodiments, the remote end 120 may communicate data to and from the local end 110, including remote communication of at least one of scan data and processing results to the remote end.
For example, the remote end 120 may provide the local end 110 with an execution plan (e.g., a scanning or treatment plan) of a medical procedure. As another example, the local end 110 may transmit data related to the execution of a medical procedure (e.g., scan data) to the remote end 120. The remote end 120 may perform post-processing of the data. In some embodiments, a user (e.g., a doctor or technician) associated with the remote end 120 may communicate with the local end 110 through the client 130. For example, the remote end 120 may browse information and data related to medical procedures in the local end 110. As another example, a user associated with the remote peer 120 may communicate with a user associated with the local peer 110. In some embodiments, the remote end 120 may control the medical devices in the local end 110 to perform medical procedures. For example, the remote end 120 may control a medical device (e.g., an imaging device) in the local end 110 to perform a preparation (e.g., warm-up preparation and/or auto-calibration) before performing a medical procedure. For another example, the remote end 120 may control the local end 110 to perform positioning of the object to be performed before the medical procedure is performed.
The client 130 may include a mobile device 130-1, a tablet computer 130-2, a laptop computer 130-3, the like, or any combination thereof. In some embodiments, the mobile device 130-1 may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home devices may include smart lighting devices, smart appliance control devices, smart monitoring devices, smart televisions, smart cameras, interphones, and the like, or any combination thereof. In some embodiments, the mobile device may comprise a mobile phone, a Personal Digital Assistant (PDA), a gaming device, a navigation device, a point of sale (POS) device, a laptop computer, a tablet computer, a desktop computer, or any combination thereof. In some embodiments, the virtual reality device and/or augmented reality device may include a virtual reality helmet, virtual reality glasses, virtual reality eyecups, augmented reality helmets, augmented reality glasses, augmented reality eyecups, and the like, or any combination thereof. For example, the virtual reality device and/or augmented reality device may include GoogleGlassTM, OculusReftTM, Hololens, GearVRTM, or the like. In some embodiments, client 130 may include input and/or output devices (e.g., a microphone and/or a speaker).
In some embodiments, the client 130 may be connected to the local end 110. The client 130 may receive information and/or instructions input by an associated user of the local end 110 and transmit the received information and/or instructions to a medical device and/or processing device in the local end 110. For example, the client 130 may send scan instructions to the medical device to scan the subject. In some embodiments, the second processing device in the local end 110 may be integrated with the client 130.
In some embodiments, the client 130 may interface with the remote end 120. The client 130 may receive information and/or instructions entered by a user associated with the remote peer 120 and/or a user associated with the local peer 110 and transmit the received information and/or instructions to a processing device in the remote peer 120 or the local peer 110. For example, the client 130 may send transmission instructions to the remote end 120 to transmit data related to a medical procedure to the local end 110. In some embodiments, the first processing device in the remote end 120 may be integrated with the client 130.
In some embodiments, the client 130 may be part of the remote end 120 and/or the local end 110.
In some embodiments, the client 130 may be a computer and perform some of the functions of the remote end 120 and/or the local end 110. For example, the client 130 may process data related to the subject (e.g., basic information of the subject, medical information, etc.). The processing of data related to objects may include adding, deleting, sorting, filtering, analyzing, and the like, or any combination thereof. As another example, the client 130 may process image data (e.g., images) and/or scan data (e.g., projection data). The processing of the image data and/or scan data may include image reconstruction, image segmentation, image magnification, image reduction, image noise enhancement, image super resolution processing, image artifact removal, image diagnosis, image recognition, or any combination thereof. For example only, the client 130 may reconstruct an image of the object based on the scan data.
Storage device 140 may store data, instructions, and/or any other information. In some embodiments, the storage device 140 may store data or information obtained from the local end 110, the client 130, and/or the remote end 120. For example, the storage device 140 may store scan data generated by the local end 110. As another example, storage device 140 may store processed images received from client 130 and/or remote 120. As another example, the storage device 140 may store an execution plan of a medical procedure, medical procedure related data (e.g., processing results, processing algorithms or models, etc.), and/or the like, provided by the remote end 120. In some embodiments, the storage device 140 may store data and/or instructions that may be executed or used by the local end 110 and/or the remote end 120 to perform the exemplary methods, systems described herein. In some embodiments, storage 140 may include mass storage, removable storage, volatile read-write memory, read-only memory (ROM), etc., or any combination thereof. Exemplary mass storage may include magnetic disks, optical disks, solid state disks, and the like. Exemplary removable memory may include flash drives, floppy disks, optical disks, memory cards, compact disks, magnetic tape, and the like. Exemplary volatile read-write memory can include Random Access Memory (RAM). Exemplary RAM may include Dynamic Random Access Memory (DRAM), double Rate synchronous dynamic random Access memory (DDRSDRAM), Static Random Access Memory (SRAM), thyristor random Access memory (T-RAM), zero capacitance random Access memory (Z-RAM), and the like. Exemplary read-only memories may include mask read-only memory (MROM), programmable read-only memory (PROM), erasable programmable read-only memory (PEROM), electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM), digital versatile disk read-only memory, and the like. In some embodiments, the storage device 130 may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a cloudy cloud, and the like, or any combination thereof.
In some embodiments, the storage device 140 may be connected to the network 150 to communicate with one or more other components in the telemedicine control system 100 (e.g., the local end 110, the remote end 120, the client 130, etc.). One or more components in the telemedicine control system 100 may access data or instructions stored in the storage device 140 via the network 150. In some embodiments, the storage device 140 may be directly connected to or in communication with one or more other components in the telemedicine control system 100 (e.g., the local end 110, the remote end 120, the client 130, etc.). In some embodiments, the storage device 140 may be part of the remote end 120.
The network 150 may facilitate the exchange of information and/or data for the telemedicine control system 100. In some embodiments, one or more components of the telemedicine control system 100 (e.g., the local end 110, the client 130, the remote end 120, or the storage device 140) may communicate information and/or data with one or more other components of the telemedicine control system 100 over the network 150. For example, the client 130 and/or the remote peer 120 may obtain scan data from the local peer 110 via the network 150. As another example, the remote end 120 may obtain user instructions from the client 130 via the network 150.
In some embodiments, the network 150 may have a distributed network architecture. In some embodiments, the telemedicine control system 100 may include at least two server devices that are distributively connected to the network 150. In some embodiments, the network 150 may be any form of wired or wireless network, or any combination thereof. The network 150 may be and/or include a public network (e.g., the internet), a private network (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), etc.), a wired network (e.g., an ethernet network), a wireless network (e.g., an 802.11 network, a Wi-Fi network, etc.), a cellular network (e.g., a Long Term Evolution (LTE) network), a frame relay network, a virtual private network ("VPN"), a satellite network, a telephone network, a router, a hub, a switch, a server computer, and/or any combination thereof. By way of example only, network 150 may include a cable network, a wireline network, a fiber optic network, a telecommunications network, an intranet, a Wireless Local Area Network (WLAN), a Metropolitan Area Network (MAN), a Public Switched Telephone Network (PSTN), a bluetooth network, a ZigBee (ZigBee) network, a Near Field Communication (NFC) network, the like, or any combination thereof. In some embodiments, network 150 may include one or more network switching points. For example, the network 150 may include wired and/or wireless network switching points, such as base stations and/or internet switching points, through which one or more components of the telemedicine control system 100 may connect to the network 150 to exchange data and/or information.
It should be noted that the above description of the telemedicine control system 100 is provided for illustrative purposes only and is not intended to limit the scope of the present application. Various modifications and changes may occur to those skilled in the art in light of the description herein. For example, the assembly and/or functionality of the telemedicine control system 100 may be modified or changed according to the specific embodiment. By way of example only, some other components may be added to the telemedicine control system 100, such as a power module that may provide power to one or more components of the telemedicine control system 100 as well as other devices or modules.
FIG. 2 is a diagram illustrating an application scenario of a telemedicine control system 200 according to further embodiments of the present disclosure.
Referring to FIG. 2, a telemedicine control system 200 includes one or more local ends 210 (e.g., local end 210-1, local ends 210-2, …, local end 210-N) and one or more remote ends 220 (e.g., remote end 220-1, remote ends 220-2, …, remote end 220-M). The number N of the local ends 210 and/or the number M of the remote ends may be set to be multiple according to actual needs. In some embodiments, each remote peer may connect or communicate with multiple local peers simultaneously. In some embodiments, multiple remote ends may be simultaneously connected or communicating with at least one local end.
Each local end may include a second processing device and a medical device for performing a medical procedure. For example, the local end 210-1 includes a second processing device 211 and a medical device 212; the local end 210-2 may include a second processing device 221 and a medical device 222; the local end 210-N may include a second processing device N and a medical device m.
The local end 210 may be any remotely controlled end having the need for remote medical control that needs to be remotely assisted in performing a medical procedure. In some embodiments, the local end 210 may be implemented in a low-grade hospital, a rural hospital, a remote or emergency medical care-requiring epidemic or other small medical clinics, and so forth.
The medical device is used to perform operations associated with a medical procedure. In some embodiments, the medical procedure may include at least one of a medical imaging scan and radiation therapy.
In some embodiments, the medical device may be at least one of a medical imaging scanning device and a radiation therapy device. In some embodiments, the medical Imaging scanning device may include at least one of a Computed Tomography (CT) device, a Magnetic Resonance Imaging (MRI) device, an X-ray device, a Positron Emission Tomography (PET) device, and an ultrasound detection device. In some embodiments, the radiotherapy apparatus comprises at least one of an external-irradiation treatment machine, an internal-irradiation treatment machine, and a stereotactic radiotherapy device. In some embodiments, the external-irradiation treatment machine may include at least one of an isotope teletherapy machine, an X-ray treatment machine, a medical electron accelerator, a medical proton accelerator, a medical neutron generator, a medical heavy ion accelerator, and a medical pi-mediator generator, the internal-irradiation treatment machine may include at least one of a gamma-ray afterloader and a neutron afterloader, and the stereotactic radiotherapy device may include at least one of a gamma-knife, an X-knife, a proton knife, and a neutron stereotactic radiotherapy device.
In some embodiments, the first processing device, the second processing device may be implemented using a central processor, a server, a terminal device, or any other possible processing device. By way of example only, the central processing unit, cloud server, or other processing device described above includes a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), an application specific instruction set processor (ASIP), a Graphics Processing Unit (GPU), a Physical Processing Unit (PPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a microcontroller unit, a Reduced Instruction Set Computer (RISC), a microprocessor, or the like, or any combination thereof. In some embodiments, the central processor, server, terminal device, or other processing device described above may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-tiered cloud, and the like, or any combination thereof. In some embodiments, the central processor, server, or other processing device may be interconnected with various end devices (e.g., client 130), which may perform information processing tasks or portions thereof, and may contribute to cost sharing.
In some embodiments, a local communication connection is made between a second processing device (e.g., second processing device 211) in the local side and a medical device (e.g., medical device 212), and a remote communication connection is made between a second processing device (e.g., second processing device 211) in the local side and a first processing device in the remote side (e.g., remote side 220-1). In some embodiments, a second processing device (e.g., second processing device 211) in the local side is in remote communication with a first processing device in the remote side (e.g., remote side 220-1), the first processing device in the remote side (e.g., remote side 220-1) is in remote communication with a medical device (e.g., medical device 212), respectively, and the second processing device (e.g., second processing device 211) is in local communication with the medical device (e.g., medical device 212).
In some embodiments, the communication may be through at least one of the following communication networks: the ethernet, wifi network, bluetooth network, 5G network, telecommunication network implements a telecommunication connection between the remote end 220 and the local end 210. In some embodiments, the remote communication connection between the second processing device and the first processing device may be made through one or a combination of ethernet, wifi network, bluetooth network, 5G network, and telecommunication network.
In some embodiments, the remote connection between the remote end 220 and the local end 210 may be implemented with remote control software. In some embodiments, the remote control software is divided into local side (controlled side) software and remote side (control side) software, the local side software may be integrated on a local side console (e.g., a computer or workstation with a first processing device installed), and the remote side software may be integrated on a remote side console (e.g., a computer or workstation with a second processing device installed) or other separate computing device. In some embodiments, the remote-end software may be installed when the use of remote assistance functionality is required.
The remote peer 220 may include a first processing device in communication with the at least one local peer for performing a medical procedure providing support operation on a medical device (e.g., the medical device 212) of the at least one local peer (e.g., the local peer 210-1) in response to receiving a request transmitted by a second processing device (e.g., the second processing device 211) of the at least one local peer (e.g., the local peer 210-1). In some embodiments, the request may include a type of support operation, the support operation including pre-processing prior to execution of the medical procedure, the pre-processing including pre-heat preparation and/or auto-calibration of the medical device. In some embodiments, the request may include a type of supported operation, the type of supported operation further including at least one of: placement of the subject of the medical procedure, e.g., smart placement, etc.; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; transmission and display of medical procedure related data, and the like or combinations thereof.
A communication connection for implementing remote control may be established between the remote end 220 and the local end 210. In some embodiments, the second processing device may be configured to send an active telecommunication connection request (i.e., requested by remote control) to the remote end 220. The first processing device may receive an active telecommunication connection request from the second processing device and determine whether to accept the active telecommunication connection request. If the first processing device confirms acceptance of the active telecommunication connection request, a communication connection between the remote end 220 and the local end 210 (e.g., the first processing device, the second processing device, and/or the medical device) may be established.
In some embodiments, a first processing device may send an active remote communication connection request (i.e., a remote control request) to a second processing device. The second processing device confirms whether to accept the active remote communication connection request or not in response to receiving the active remote control request sent by the first processing device. If the second processing device confirms acceptance of the active telecommunication connection request, a communication connection between the remote end 220 and the local end 210 (e.g., the first processing device, the second processing device, and/or the medical device) may be established.
After the remote end 220 establishes a communication connection with the local end 210 for implementing remote control, the local end 210 may generate one or more operation requests, and the remote end may perform a medical procedure providing support operation on a medical device (e.g., the medical device 212) of at least one local end (e.g., the local end 210-1) in response to receiving an operation request transmitted by a second processing device (e.g., the second processing device 211) of at least one local end (e.g., the local end 210-1). In some embodiments, the support operations include pre-processing prior to execution of the medical procedure, the pre-processing including pre-heating preparation and/or automatic calibration of the medical device. In some embodiments, the operation request may include a type of supported operation. The remote end 220 may provide support operations for the medical devices of the local end 210 to perform medical procedures, the type of support operations further including at least one of: placement of the subject of the medical procedure, e.g., smart placement, etc.; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; transmission and display of medical procedure related data, and the like or combinations thereof. In some embodiments, the above-described support operations may be implemented by the first processing device of the remote end 220, the second processing device of the local end 210, and the medical device. As described herein, the remote end 220 providing support for the medical devices of the local end 210 to perform medical procedures may refer to the remote end 220 may assist and/or control the medical devices of the local end 210 to perform medical procedures. For example, the remote end 220 can directly control the medical devices of the local end 210 to execute the medical procedures, e.g., control the medical devices of the local end 210 to operate. For another example, the second processing device in the local end 210 is controlled to perform data processing, displaying, and/or transmitting. As another example, the remote end 220 may perform a medical procedure by assisting or guiding a worker at the local end 210 to operate a medical device.
In some embodiments, the remote end and the local end are configured to perform remote interaction, and the remote interaction comprises at least one of the following interaction operations: text interaction, voice call, or video session. In some embodiments, the remote end and the local end are configured to perform real-time remote interaction, and the remote interaction comprises at least one of the following interaction operations: real-time text interaction, real-time voice calls, or real-time video sessions.
In some embodiments, the local end (e.g., the local end 210-1) may include at least one image capture device for acquiring image data and/or at least one audio device for acquiring audio data. For example, the image capturing device may be a camera or the like, and the audio device may be a microphone or other recording and playing equipment or the like. In some embodiments, the at least one image capture device and/or the at least one audio device may be located in an environment in which the medical equipment is located, for example, may be mounted on local-end medical equipment (e.g., medical equipment 212).
In some embodiments, the pre-processing may include: preheating and/or auto-calibration of a medical device (e.g., medical device 212) may include: determining whether there is a target in an environment where a local end (e.g., the local end 210-1) is located based on the remote interaction and/or the image data and/or the audio data; and in response to determining that the local end is not in an environment where the target is not present, controlling the medical device (e.g., medical device 212) to perform pre-heat preparation and/or auto-calibration. For example, similar information of whether a person is in the scanning room or whether a person other than the person to be scanned is in the scanning room can be automatically broadcasted, and if a similar answer of yes is received, it can be determined that preprocessing is not needed at present, and the operation can be automatically set to an execution program, and can also be remotely set and manually triggered. The pretreatment process of the medical equipment is remotely controlled, so that the preparation work before the medical operation can be carried out by the local end according to a professional accurate mode, and the medical operation efficiency of the local end is improved.
In some embodiments, the remote end (e.g., remote end 220-1) and the local end (e.g., local end 210-1) are configured for real-time remote interaction, the real-time remote interaction including at least one of the following interaction operations: real-time text interaction, real-time voice calls, or real-time video sessions. The remote end executes preprocessing, including: judging whether a target exists in the environment where the medical equipment (e.g., the medical equipment 212) of the local end (e.g., the local end 210-1) is located through real-time remote interaction; and in response to determining that the environment in which the medical device is located presents a target, terminating pre-processing (e.g., stopping pre-heat preparation or automatic correction (e.g., stopping an operation of exposure to an unwinding line)) prior to execution of the medical procedure on the medical device; or in response to determining that no target is present in the environment in which the medical device is located, control the medical device to perform pre-processing (e.g., pre-heat preparation and auto-calibration) prior to execution of the medical procedure. Through the operation, the flexibility of remote control is further improved, adjustment can be carried out according to specific remote control scenes, and good and orderly operation of preparation work before medical operation is guaranteed.
In some embodiments, the target may be an organism (e.g., a human). In some embodiments, pre-heat preparation may include bulb pre-heat, machine maintenance, etc. pre-scan preparation, and automatic calibration may include air calibration, bulb calibration, etc.
The positioning of the executed object of the medical procedure specifically comprises:
guiding the positioning operation of the executed object of the medical procedure based on at least one of remote interaction, image data and audio data, wherein the image data comprises the positioning state information of the executed object, and the audio data comprises voice feedback information and/or sound condition information of the executed object. For example, the positioning accuracy can be controlled by monitoring the positioning state of the patient to determine whether the positioning is problematic or needs to be adjusted; but also to guide the patient how to breathe better during abdominal and cardiac scans such as MR, CT, etc. Powerful support for scanning or diagnosis is better provided with remote control by a more experienced doctor or technician at the remote end observing the status of the patient.
In some embodiments, the local end (e.g., local end 210-1) includes an intelligent positioning system, and the remote end in controlling the intelligent positioning of the executed object of the medical procedure includes, by the intelligent positioning system: acquiring a scout image of an executed object; determining a target range of the executed object based on a deep learning technology according to the positioning image; and guiding the executed object to perform positioning based on the target range of the executed object.
In some embodiments, a scout image of the subject being performed may be acquired by a medical device (e.g., an imaging device).
In some embodiments, the local end may include an intelligent positioning system including a plurality of image capture devices. The positioning image of the executed object can be acquired based on the image acquisition device at the local end. For example, an image of an executed object (e.g., a patient), depth information of the executed object (e.g., a patient), position information of the executed object (e.g., a patient), a height of a scanning bed, and the like may be acquired by using a depth camera. In some embodiments, infrared light can be used for supplementing light when the light is insufficient, so that the identification accuracy is not influenced, and standardized positioning image scanning can be formed.
In some embodiments, the second processing device on the local side and/or the first processing device on the remote side can identify an executed object in the positioning image based on a depth learning technology, complete three-dimensional modeling of the executed object (such as a patient) by utilizing depth camera software, determine the body thickness of an examination part of the executed object (such as the patient), determine a scanning target range (such as a scanning starting line) according to the examination part and the body thickness, and assist the executed object (such as the patient) in positioning based on the scanning target range and the examination part. For example, the remote end may determine a reference pose (e.g., pose and position in a scanning region of the medical device) corresponding to the object being performed (e.g., patient) based on the examination site and the target range of the scan. The remote end can transmit the reference posture corresponding to the executed object (such as a patient) to the local end and display the reference posture, so that the executed corresponding can be positioned according to the reference posture. For another example, an operator at the remote end may interact with the executed object in real time to assist the executed object in positioning.
In some embodiments, the positioning frame can be automatically sketched according to the positioning image based on an intelligent positioning technology, and the target range of the scanning can be accurately identified, for example, during head scanning, the intelligent positioning technology can identify the canthus line of the patient, adaptively adjust the inclination angle of the positioning frame, and perform an intelligent one-click patient scanning. The intelligent positioning technology comprises a technology for image recognition and positioning by adopting a machine learning technology.
The intelligent positioning operation of the local medical equipment is controlled through remote guidance, so that the positioning effect required by the professional can be achieved when the executed object is subjected to medical operation, and a foundation is laid for acquiring accurate medical operation data.
In some embodiments, the medical procedure includes at least one of a medical imaging scan and radiation therapy, and the performing of the medical procedure at the remote end provides for including: at least one of imaging parameters of the medical imaging scan and a radiotherapy plan of the radiation therapy is determined. Different requirements of local end medical operation are met through the execution scheme of the selectable medical procedure.
In some embodiments, the execution control of the medical procedure by the remote end (e.g., remote end 220-1) includes: the remote end is connected with the local end (for example, the local end 210-1) in a remote interactive mode; and based on the remote interactive mode, the remote end controls the medical equipment (such as the medical equipment 212) to execute medical imaging scanning so as to generate scanning data or execute radiotherapy, and the execution process of the medical procedure professionally implemented by the local end is realized.
In some embodiments, the remote end (e.g., remote end 220-1) performing medical procedure-related data processing includes: the remote end receives scan data from the local end (e.g., local end 210-1); and processing the scan data to generate a processed result for use in medical analysis or medical diagnosis. In some embodiments, the scan data may include reconstructed images and the processing results may include report data. In some embodiments, at least one of the scan data and the processing results may also be transmitted to a PACS (Picture Archiving and Communication Systems).
In some embodiments, diagnosis is performed according to the scanning data, the processing result comprises a diagnosis result determined based on the scanning data, remote calling and viewing of the scanning data and/or the processing result are supported, for example, a scanning image is viewed at a remote end, and the local end online diagnosis is realized and effectively implemented through remote control. In some embodiments, a first processing device of a remote peer (e.g., remote peer 220-1) stores a trained deep neural network model, which is used to determine a processing result based on scan data. In some embodiments, the second processing device of the local end (e.g., the local end 210-1) stores a trained deep neural network model, which is used to determine processing results based on the scan data. For example, the scanning data can be input into a deep neural network model for processing, and the processing result is output, and the existence of the deep neural network model enables the effect reliability and adaptability of online diagnosis to be stronger.
In some embodiments, when the number of local ends is multiple, the remote end (e.g., the remote end 220-1) can perform real-time interactive switching among multiple local ends (e.g., the local end 210-1, the local end 210-2, and the local end 210-3), and each of the multiple local ends (e.g., the local end 210-1, the local end 210-2, and the local end 210-3) is remotely connected to the remote end (e.g., the remote end 220-1). Illustratively, as shown in fig. 2, the remote peer 220-1 performs real-time interactive switching between the two local peers 210-1 and 210-2, for example, switching from a remote video exchange with one of the local peers 210-1 to a remote video exchange with the other local peer 210-2, and both the local peers 210-1 and 210-2 are remotely connected to the remote peer 220-1, which improves convenience and high performance of remote control.
In some embodiments, the interactive switching order of the remote end (e.g., the remote end 220-1) between at least two local ends (e.g., the local end 210-1, the local end 210-2, the local end 210-3) is determined according to a preset switching level rule between at least two local ends (e.g., the local end 210-1, the local end 210-2, the local end 210-3). For example, when the remote peer 220-1 is interacting with the local peer 210-1, the local peer 210-2 or the local peer 210-3 with higher urgency can be switched according to the preset urgency level switching rule).
Fig. 3 is a schematic diagram of an application scenario of a telemedicine control system 300 according to further embodiments of the present disclosure. As shown in FIG. 3, the remote end 310 of the telemedicine control system 300 is remotely connected to two local ends 320, 330, and may also be communicatively connected to a hospital end 340 and an expert end 350 located at the local ends. The remote end 310 may receive patient information collected by the hospital end 340 (e.g., hospital registry or self-service terminal) and/or patient information entered by the patient's mobile terminal via the network after establishing a connection with the local end 320 and/or 330. The patient information may include patient basic information (e.g., credential information with identifying patient identity information, gender, age, etc.), patient historical medical information, patient health information, medical procedure execution related data, and the like. For example, the local end 320 and/or 330 may send an access request with patient information to the remote end 310. The remote peer 310, upon accepting the access request, may determine which local peer 320 and/or 330 the access request was sent by. Also, the remote end 310 may determine a medical procedure execution protocol (e.g., a scanning protocol, etc.) based on the patient information. In some embodiments, the remote end 310 may acquire medical procedure execution-related data (e.g., scan data) and process the medical procedure execution-related data (e.g., scan data) to obtain a processing result.
When necessary, the expert 350 may perform further analysis and diagnosis according to at least one of the patient information, the medical procedure execution related data, and the processing result, so as to provide a more targeted diagnosis and treatment solution. In some embodiments, the remote end 310 receives the access request of the patient medical condition information from the expert end 350, or acquires the patient information (e.g., the patient historical medical information data), the medical procedure execution related data and/or the processing result in a conventionally configured data transmission manner, and sends the patient information, the medical procedure execution related data and/or the processing result to the expert end 350 for transmission, so as to facilitate the analysis and diagnosis at the expert end.
In some embodiments, the telemedicine control system 300 also includes memory for storing data generated during the business process, which may be a volatile or non-volatile, magnetic, semiconductor, tape, optical, removable, non-removable, or other type of storage device or tangible (i.e., non-transitory) computer-readable medium including, but not limited to, ROM, flash memory, dynamic RAM, static RAM.
The remote medical control system provided by the embodiment of the application performs pretreatment before a medical procedure is executed; positioning of the subject of the medical procedure; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; and the remote control integrated operation of the transmission and display of the data related to the medical procedure, realizes the remote medical control of automatically implementing intelligent pretreatment, positioning, scanning execution, automatic post-treatment, automatic reporting, data remote transmission, online diagnosis and the like by a local end, meets various real-time medical operation requirements including medical operation preparation and real-time medical operation guide interaction, and implements a more convenient and efficient remote medical control scheme for integrated implementation of medical examination or scanning, medical operation guidance, medical diagnosis analysis and the like, thereby effectively grafting superior doctor and technician resources in different places, solving the actual medical problems of shortage of medical resources in epidemic areas, insufficient medical operation and diagnosis experience of local technicians and the like, and being suitable for various medical remote control scenes.
Fig. 4 is an exemplary flow chart of a telemedicine control method 400 shown in accordance with some embodiments of the present description.
The telemedicine control method 400 includes the steps of:
step 410, a remote connection is established between a local side and a remote side, the local side including a medical device for performing a medical procedure. In some embodiments, the local side comprises a first processing device and the remote side comprises a second processing device. In some embodiments, the first processing device may be integrated in a terminal (e.g., a computer, a cell phone, etc.) in communication or connection with the medical device. In some embodiments, the first treatment device may be integrated in the medical device. In some embodiments, the first processing device may include an input and/or output device (e.g., a microphone, a display device, a camera, etc.). In some embodiments, the second processing device may be integrated in a terminal (e.g., a computer, a cell phone, etc.). In some embodiments, the second processing device may be integrated into the medical device at the remote end. In some embodiments, the second processing device may include an input and/or output device (e.g., a microphone, a display device, a camera, etc.).
In some embodiments, a remote connection between a local peer and a remote peer may be established by the local peer (e.g., a first processing device) sending an active telecommunication connection request to the remote peer, which then determines and accepts the active telecommunication connection request.
In some embodiments, a remote communication connection request (i.e., a remote control request) may be sent by a remote peer (e.g., a second processing device) to a local peer, which determines and accepts the remote communication connection request, and a remote connection between the local peer and the remote peer is established.
Providing, by the remote end, a support operation for a medical procedure performed on the medical device, wherein the support operation includes: pre-processing prior to performance of a medical procedure, the pre-processing comprising: the medical device is pre-heated and/or automatically calibrated. With respect to the operation of the remote end to provide support for a medical procedure performed on a medical device, reference is made to fig. 5 and the corresponding description.
Fig. 5 is an exemplary flow chart of a medical procedure execution method 500 shown in accordance with some embodiments of the present description.
Step 501, judging whether a target exists in the environment where the local medical equipment is located, if yes, entering step 502: stopping executing the preprocessing, if not, entering step 503. In some embodiments, step 501 may be performed by a first processing device on the local side. The second processing device may send the determination result to the first processing device of the remote end. In some embodiments, step 501 may be performed by a first processing device at a remote end.
In some embodiments, an operator at the local end (e.g., a physician) may use the input and/or output device to learn whether a target is present in the environment of the medical device by interacting with an operator at the remote end in real time (e.g., text, voice, or video). The first processing device of the remote end may acquire the determination result based on an input of an operator of the remote end and/or an operator of the local end. The input may include the presence of a target in the environment of the medical device or the absence of a target in the environment of the medical device. The target may comprise an organism.
In some embodiments, the first processing device of the remote end may communicate with the camera of the local end. The camera at the local end can acquire image data (e.g., images or videos) in the environment where the medical equipment is located and display the image data on the display device at the local end. The operator at the remote end can judge whether the medical equipment is located in the environment or not by observing the image data displayed on the display device at the local end. The first processing device of the remote end may acquire the determination result based on an input of an operator of the remote end.
In some embodiments, the first processing device on the remote side and/or the second processing device on the local side may acquire image data (e.g., images or videos) of the environment in which the medical device is located, which is acquired by the camera, via the network. The first processing device of the remote end and/or the second processing device of the local end may determine whether a target exists in the image data based on a target detection technique to obtain a determination result. In some embodiments, target detection can be performed by using a neural network model for target detection, such as Faster R-CNN, SSD, and YOLO, so as to obtain a target detection result with higher accuracy and reliability.
Step 503, controlling the medical equipment to perform pretreatment before the medical procedure is executed. In some embodiments, step 503 may be performed by a second processing device on the local side. For example, the second processing device may control the medical device to perform pre-processing prior to execution of the medical procedure in accordance with the procedure provided by the first processing device. In some embodiments, step 503 may be performed by a first processing device at the remote end. As described herein, pre-processing prior to performance of a medical procedure refers to preparatory work of the medical device prior to performance of the medical procedure.
The pre-processing may include pre-heat preparation, calibration, fault detection, etc. of the medical device. In some embodiments, the correction may include an air correction, a normalization correction, a bulb correction, and the like. In some embodiments, the air correction may be used to remove the dose error actually detected and transmitted by each detector unit of the medical apparatus (e.g., CT apparatus) under the same dose of X-ray irradiation, and the correction method may include that the data acquired by each detector unit under the condition of no X-ray irradiation of the scanning member is air data, and the air data is averaged to obtain the dose value of the irradiated X-ray; comparing the air data value acquired by each detection unit with the dosage value to obtain a correction factor; the ratio of the data collected by the corresponding detector and the correction factor when the X-ray irradiates the scanning piece is the data value after air correction; when dark field air correction is carried out, dark field correction is carried out on the acquired air data. In some embodiments, the normalization correction may be used in a PET, CT or PET/CT system, specifically taking into account the correction factors for the individual components, and then performing the normalization calculation. Bulb correction may include correction of bulb parameters of the medical device, such as tube current, tube voltage, focus, and the like. Fault detection includes detecting whether various components (e.g., probes, bulbs, etc.) in the medical device are faulty. If there is a fault, a corresponding solution may be provided.
In some embodiments, the remote end (e.g., the first processing device) may directly control the local end's medical devices for pre-processing. In some embodiments, the operator at the remote end may instruct the operator at the local end to perform the pre-processing of the medical device by real-time interaction (e.g., text, voice, or video).
At step 504, an execution plan for the medical procedure is provided.
In some embodiments, the medical procedure may include a medical imaging scan. The protocol for performing the medical procedure may include imaging parameters, scan sequences, scan protocols, etc. associated with the imaging scan. The imaging parameters may be different for different medical devices.
In some embodiments, the medical procedure may include radiation therapy. The protocol for performing the medical procedure may include a radiotherapy plan.
In some embodiments, the first processing device on the remote side and/or the second processing device on the local side may determine the execution scheme of the medical procedure based on information of the object to be performed of the medical procedure (e.g., patient information as described in fig. 3). For example, the information of the executed object may include basic information (e.g., height, weight, age, sex, etc.), historical medical information data, and the like. The patient historical medical information data may include patient historical medical records as well as medical examination data such as scout images, electrocardiograms, scanograms, and the like.
And 505, intelligently positioning the executed object for assisting the medical procedure. In some embodiments, step 505 may be performed by a second processing device on the local side and/or a first processing device on the remote side.
In some embodiments, the process of repositioning an object of a medical procedure may include: guiding the positioning operation of the executed object of the medical procedure based on at least one of remote interaction, image data and audio data, wherein the image data comprises the positioning state information of the executed object, and the audio data comprises voice feedback information and/or sound condition information of the executed object.
In some embodiments, the process of repositioning an object of a medical procedure may include: acquiring a scout image of an executed object; determining a target range of the executed object based on a deep learning technology according to the positioning image; and guiding the executed object to perform positioning based on the target range of the executed object.
In some embodiments, a scout image of the subject being performed may be acquired by a medical device (e.g., an imaging device).
In some embodiments, the local end may include an intelligent positioning system including a plurality of image capturing devices, such as cameras. The positioning image of the executed object can be acquired based on the image acquisition device at the local end. For example, an image of an executed object (e.g., a patient), depth information of the executed object (e.g., a patient), position information of the executed object (e.g., a patient), a height of a scanning bed, and the like may be acquired by using a depth camera. In some embodiments, infrared light can be used for supplementing light when the light is insufficient, so that the identification accuracy is not influenced, and standardized positioning image scanning can be formed.
In some embodiments, the second processing device on the local side and/or the first processing device on the remote side can identify an executed object in the positioning image based on a depth learning technology, complete three-dimensional modeling of the executed object (such as a patient) by utilizing depth camera software, determine the body thickness of an examination part of the executed object (such as the patient), determine a scanning target range (such as a scanning starting line) according to the examination part and the body thickness, and assist the executed object (such as the patient) in positioning based on the scanning target range and the examination part. For example, the remote end may determine a reference pose (e.g., pose and position in a scanning region of the medical device) corresponding to the object being performed (e.g., patient) based on the examination site and the target range of the scan. The remote end can transmit the reference posture corresponding to the executed object (such as a patient) to the local end and display the reference posture, so that the executed corresponding can be positioned according to the reference posture. For another example, an operator at the remote end may interact with the executed object in real time to assist the executed object in positioning.
In some embodiments, the positioning frame can be automatically sketched according to the positioning image based on an intelligent positioning technology, and the target range of the scanning can be accurately identified, for example, during head scanning, the intelligent positioning technology can identify the canthus line of the patient, adaptively adjust the inclination angle of the positioning frame, and perform an intelligent one-click patient scanning. The intelligent positioning technology comprises a technology for image recognition and positioning by adopting a machine learning technology.
Step 506, the medical device is controlled to perform the medical procedure.
In some embodiments, the remote end may control the medical device to perform a medical imaging scan to generate scan data and/or control the medical device to perform radiation therapy.
In some embodiments, the remote end may directly control the medical device to perform the medical procedure. For example, a first processing device on the remote side may communicate with a medical device on the local side. The first device may turn on and/or stop the medical device from performing the medical procedure. As another example, the first device may adjust operating parameters of the medical device (e.g., tube voltage of the bulb, tube current, exposure time, gantry rotation angle, radiation source height, etc.) while performing the medical procedure.
In some embodiments, the operator at the remote end may instruct the operator at the local end to operate the medical device to perform the medical procedure in a real-time interactive manner.
At step 507, data related to the medical procedure is acquired and processed to obtain a processing result. In some embodiments, step 507 may be performed by a second processing device on the local side and/or a first processing device on the remote side. The medical procedure-related data may refer to data acquired by the medical device during or after the medical procedure is performed. For example, if the medical procedure includes an imaging scan, the medical imaging-related data may include scan data (e.g., projection data, k-space data, and/or reconstructed images, etc.). For another example, if the medical procedure includes image-guided radiation therapy, the medical imaging-related data may include images acquired prior to the performance of radiation therapy (e.g., radiation therapy-guided images).
In some embodiments, processing medical procedure related data may include post-processing the scan data. For example, the scan data may include a two-dimensional image. The post-processing may include multi-planar reconstruction, curved reconstruction of the two-dimensional image.
In some embodiments, processing the medical-procedure-related data may include performing a diagnostic analysis based on the scan data to generate a processing result. The processing result may include a diagnosis report including whether the executed object has an abnormality, an abnormal portion, an abnormality type, and the like.
In some embodiments, the remote end may obtain relevant data (e.g., scan data) after the medical procedure is performed directly from the medical device at the local end. The remote end (e.g., the first processing device) may process the medical procedure-related data (e.g., the scan data) to generate a processed result for use in medical analysis or medical diagnosis.
In some embodiments, the local end (e.g., the second processing device) may obtain data (e.g., scan data) related to the medical procedure from the medical device of the local end and transmit the data related to the medical procedure to the remote end. The remote end (e.g., the first processing device) may process the medical procedure-related data (e.g., the scan data) to generate a processed result for use in medical analysis or medical diagnosis.
At step 508, medical procedure related data and/or processing results are transmitted.
In some embodiments, the remote end may transmit the data related to the medical procedure and/or the processing result to the local end (e.g., the second processing device) and/or the terminal device of the local end. The local end can display the data related to the medical procedure and/or the processing result.
FIG. 6 is an exemplary block diagram of components of a remote medical control device 600, shown in accordance with some embodiments of the present description.
The telemedical control device 600 may include a connection establishment module 610 and a supporting operation execution module 620.
A connection establishing module 610, which may be configured to: a remote connection is established between a local side and a remote side, the local side comprising medical equipment for performing a medical procedure. For an embodiment in which the connection establishing module 610 specifically establishes a remote connection between a local end and a remote end, refer to fig. 4 and the related description thereof, which are not described herein again.
A support operation execution module 620 may be configured to: providing, by a remote end, a support operation for a medical procedure performed on a medical device, wherein the support operation comprises: pre-processing prior to performance of a medical procedure, the pre-processing comprising: the medical device is pre-heated and/or automatically calibrated.
In some embodiments, the supporting operations further comprise at least one of: positioning of the subject of the medical procedure; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; and transmission and display of medical procedure related data. For an embodiment in which the support operation execution module 620 provides a support operation for a medical procedure performed on a medical device by a remote end, reference may be made to fig. 4 and 5 and corresponding description, which are not repeated herein.
FIG. 7 is an exemplary block diagram of a support operation execution module 620 in the remote medical control device 600 according to some embodiments of the present description.
An object detection unit 621, operable to: and judging whether the local medical equipment is in the environment or not. A preprocessing unit 622, which can be used to: and controlling the medical equipment to perform pretreatment before the execution of the medical procedure. The intelligent positioning unit 623 may be configured to: an object to be performed for assisting a medical procedure is intelligently positioned. A data processing unit 624, operable to: medical procedure related data is acquired and processed to obtain a processing result. A transmission unit 625, which may be configured to: medical procedure related data and/or treatment results are transmitted. For a more detailed embodiment of the target detection unit 621, the preprocessing unit 622, the intelligent positioning unit 623, the data processing unit 624, and the transmission unit 625, reference may be made to fig. 5 and related descriptions, which are not repeated herein.
It should be noted that the above description of the telemedicine control method with respect to the flow is for illustration and explanation only, and does not limit the applicable scope of the present specification. Various modifications and changes to the telemedicine control method flow may be made by those skilled in the art, guided by the present description. However, such modifications and variations are intended to be within the scope of the present description.
It can be clearly understood by those skilled in the art that the remote medical control method and the remote medical control system provided in the embodiments of the present application belong to the same inventive concept, and for convenience and brevity of description, the specific working processes of the above-described apparatus, device and computer-readable storage medium may refer to the corresponding detailed description in the system embodiments, and are not repeated in the present application. In the several embodiments provided in the present application, it should be understood that the disclosed system and method may be implemented in other ways. The above-described system embodiments are merely illustrative, and for example, the division of the functional blocks is merely a logical division, and other divisions may be realized in practice, and for example, a plurality of blocks or components may be combined or integrated with another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or modules through some communication interfaces, and may be in an electrical, mechanical or other form.
The remote medical control method provided by the embodiment of the application performs pretreatment before a medical procedure is executed; intelligent positioning of the subject of the medical procedure; providing a medical procedure execution scheme; execution control of a medical procedure; processing medical procedure related data; and the remote control integrated operation of the transmission and display of the data related to the medical procedure, realize the remote medical control of automatically implementing intelligent pretreatment, intelligent positioning, executing scanning, automatic post-treatment, automatic reporting, data remote transmission, online diagnosis and the like by a local end, meet various real-time medical operation requirements including medical operation preparation and real-time medical operation guide interaction, and implement a more convenient and efficient remote medical control scheme of integrated implementation of medical examination or scanning, medical operation guidance, medical diagnosis analysis and the like, thereby effectively grafting superior doctor and technician resources in different places, solving the actual medical problems of shortage of medical resources in epidemic areas, insufficient medical operation and diagnosis experience of local technicians and the like, and being suitable for various medical remote control scenes.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
Having thus described the basic concept, it will be apparent to those skilled in the art that the foregoing detailed disclosure is to be considered merely illustrative and not restrictive of the broad application. Various modifications, improvements and adaptations to the present application may occur to those skilled in the art, although not explicitly described herein. Such modifications, improvements and adaptations are proposed in the present application and thus fall within the spirit and scope of the exemplary embodiments of the present application.
Also, this application uses specific language to describe embodiments of the application. Reference throughout this specification to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic described in connection with at least one embodiment of the present application is included in at least one embodiment of the present application. Therefore, it is emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, some features, structures, or characteristics of one or more embodiments of the present application may be combined as appropriate.
Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereon. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software. The above hardware or software may be referred to as "data block," module, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.
The computer storage medium may comprise a propagated data signal with the computer program code embodied therewith, for example, on baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.
Computer program code required for the operation of various portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C + +, C #, VB.NET, Python, and the like, a conventional programming language such as C, Visualbasic, Fortran2003, Perl, COBOL2002, PHP, ABAP, a dynamic programming language such as Python, Ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or processing device. In the latter scenario, the remote computer may be connected to the user's computer through any network format, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, such as a software as a service (SaaS).
Additionally, the order in which elements and sequences of the processes described herein are processed, the use of alphanumeric characters, or the use of other designations, is not intended to limit the order of the processes and methods described herein, unless explicitly claimed. While various presently contemplated embodiments of the invention have been discussed in the foregoing disclosure by way of example, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments herein. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing processing device or mobile device.
Similarly, it should be noted that in the preceding description of embodiments of the application, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to require more features than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.
The entire contents of each patent, patent application publication, and other material cited in this application, such as articles, books, specifications, publications, documents, and the like, are hereby incorporated by reference into this application. Except where the application is filed in a manner inconsistent or contrary to the present disclosure, and except where the claim is filed in its broadest scope (whether present or later appended to the application) as well. It is noted that the descriptions, definitions and/or use of terms in this application shall control if they are inconsistent or contrary to the statements and/or uses of the present application in the material attached to this application.
Finally, it should be understood that the embodiments described herein are merely illustrative of the principles of the embodiments of the present application. Other variations are also possible within the scope of the present application. Thus, by way of example, and not limitation, alternative configurations of the embodiments of the present application can be viewed as being consistent with the teachings of the present application. Accordingly, the embodiments of the present application are not limited to only those embodiments explicitly described and depicted herein.

Claims (13)

1. A telemedicine control system, comprising:
at least one local end, each of which includes a medical device for executing a medical procedure;
a remote peer including a first processing device in communication with at least one of the local peers, providing support operations for the medical devices to perform the medical procedure, the support operations including:
pre-processing prior to execution of the medical procedure, the pre-processing comprising: pre-heating preparation and/or auto-calibration of the medical device.
2. The telemedicine control system of claim 1, wherein each of the local ends further comprises a second processing device communicatively coupled to the medical device, the second processing device configured to remotely interact with the first processing device.
3. The telemedicine control system of claim 1, wherein the remote end and the local end are configured for remote interaction, the remote interaction comprising at least one of: text interaction, voice call, or video session.
4. The telemedicine control system of claim 3, wherein the local end comprises at least one image capture device for capturing image data and/or at least one audio device for capturing audio data,
preparing and/or automatically calibrating the medical device for preheating, comprising:
determining whether a target exists in the environment where the local end is located based on the remote interaction and/or the image data and/or the audio data; and
in response to determining that the target is not present in the local end environment, controlling the medical device to perform the pre-heat preparation and/or the auto-correction.
5. The telemedicine control system of claim 4, wherein the supporting operations further comprise: the positioning of the executed object of the medical procedure specifically includes:
guiding a positioning operation of an executed object of the medical procedure based on at least one of the remote interaction, the image data, the audio data, the image data including positioning state information of the executed object, and the audio data including voice feedback information and/or sound condition information of the executed object.
6. The telemedicine control system of any one of claims 1-5, wherein the support operations further comprise an execution scenario provision of the medical procedure,
the medical procedure includes at least one of a medical imaging scan and radiation therapy,
the performing of the medical procedure provides comprising:
determining at least one of imaging parameters of the medical imaging scan and a radiotherapy plan for the radiation therapy.
7. The telemedicine control system of any one of claims 1 to 5, wherein the support operations further comprise control of execution of the medical procedure, in particular comprising:
connecting the local end in a remote interaction mode; and
based on the remote interactive mode, the medical device is controlled to execute a medical imaging scan to generate scan data or to execute radiation therapy.
8. The telemedicine control system of claim 7, wherein the support operations further comprise the medical procedure related data processing, in particular comprising:
receiving the scanning data from the local end; and
processing the scan data to generate a processing result.
9. The telemedicine control system of claim 8, wherein the supporting operations further comprise transmission and display of the medical procedure-related data comprises:
and remotely transmitting at least one of the scanning data and the processing result to the remote end.
10. The telemedicine control system of claim 8, wherein the first processing device stores a trained deep neural network model, the trained deep neural network model being used to determine the processing result based on the scan data.
11. The telemedicine control system of any one of claims 1 to 5, wherein the number of the local ends is at least two, the remote end performs interactive switching between at least two of the local ends, and at least two of the local ends are each remotely connected to the remote end.
12. The telemedicine control system of claim 11,
and determining the interactive switching sequence of the remote end between the at least two local ends according to a preset switching grade rule between the at least two local ends.
13. A telemedicine control method, comprising:
establishing a remote connection between a local end and a remote end, wherein the local end comprises medical equipment used for executing a medical procedure;
providing a support operation for the medical procedure performed by the medical device through the remote end,
wherein the supporting operation comprises: pre-processing prior to execution of the medical procedure, the pre-processing comprising: pre-heating preparation and/or auto-calibration of the medical device.
CN202011607478.2A 2020-12-29 2020-12-29 Remote medical control system and method Pending CN112599235A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011607478.2A CN112599235A (en) 2020-12-29 2020-12-29 Remote medical control system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011607478.2A CN112599235A (en) 2020-12-29 2020-12-29 Remote medical control system and method

Publications (1)

Publication Number Publication Date
CN112599235A true CN112599235A (en) 2021-04-02

Family

ID=75206193

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011607478.2A Pending CN112599235A (en) 2020-12-29 2020-12-29 Remote medical control system and method

Country Status (1)

Country Link
CN (1) CN112599235A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113808697A (en) * 2021-09-24 2021-12-17 广州高通影像技术有限公司 Remote report management method and system based on ultrasonic examination process

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101087554A (en) * 2004-04-06 2007-12-12 安科锐公司 Patient positioning assembly
CN101384300A (en) * 2005-07-22 2009-03-11 断层放疗公司 System and method of remotely analyzing operation of a radiation therapy system
CN103717127A (en) * 2011-02-17 2014-04-09 宜扬医疗有限公司 System and method for performing an automatic and remote trained personnel guided medical examination
CN106456084A (en) * 2014-06-18 2017-02-22 皇家飞利浦有限公司 Ultrasound imaging apparatus
CN107457786A (en) * 2016-06-02 2017-12-12 东北大学 A kind of bionic nurse's system of operable PET/CT machines
CN108095761A (en) * 2012-03-07 2018-06-01 齐特奥股份有限公司 Spacial alignment equipment, spacial alignment system and the method for instructing medical procedure
CN110711031A (en) * 2019-10-31 2020-01-21 武汉联影智融医疗科技有限公司 Surgical navigation system, coordinate system registration system, method, device, and medium
CN111312385A (en) * 2020-03-06 2020-06-19 西门子医疗系统有限公司 Processing device, method and system for controlling medical equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101087554A (en) * 2004-04-06 2007-12-12 安科锐公司 Patient positioning assembly
CN101384300A (en) * 2005-07-22 2009-03-11 断层放疗公司 System and method of remotely analyzing operation of a radiation therapy system
CN103717127A (en) * 2011-02-17 2014-04-09 宜扬医疗有限公司 System and method for performing an automatic and remote trained personnel guided medical examination
CN108095761A (en) * 2012-03-07 2018-06-01 齐特奥股份有限公司 Spacial alignment equipment, spacial alignment system and the method for instructing medical procedure
CN106456084A (en) * 2014-06-18 2017-02-22 皇家飞利浦有限公司 Ultrasound imaging apparatus
CN107457786A (en) * 2016-06-02 2017-12-12 东北大学 A kind of bionic nurse's system of operable PET/CT machines
CN110711031A (en) * 2019-10-31 2020-01-21 武汉联影智融医疗科技有限公司 Surgical navigation system, coordinate system registration system, method, device, and medium
CN111312385A (en) * 2020-03-06 2020-06-19 西门子医疗系统有限公司 Processing device, method and system for controlling medical equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113808697A (en) * 2021-09-24 2021-12-17 广州高通影像技术有限公司 Remote report management method and system based on ultrasonic examination process

Similar Documents

Publication Publication Date Title
US11000254B2 (en) Methods and systems for patient scan setup
US10361002B2 (en) Method and apparatus for setting imaging environment by using signals transmitted by plurality of clients
US7639782B2 (en) Methods and systems for automatic patient table positioning
US10945681B2 (en) Control device for controlling tomosynthesis imaging, imaging apparatus, imaging system, control method, and program for causing computer to execute the control method
US10102620B2 (en) Control device for controlling tomosynthesis imaging, imaging apparatus, imaging system, control method, and program for causing computer to execute the control method
CN106388851A (en) Arranging position control method and device
EP3110333B1 (en) Diagnostic imaging method and apparatus, and recording medium thereof
US10383582B2 (en) Control device for controlling tomosynthesis imaging, imaging apparatus,imaging system, control method, and program for causing computer to execute the control method
CN109480882A (en) Medical Devices imaging method and device, computer equipment and readable storage medium storing program for executing
CN109637630A (en) Self-service medical imaging system and control method
TW201843647A (en) System and method for facilitating autonomous control of an imaging system
CN112401919B (en) Auxiliary positioning method and system based on positioning model
US20210183055A1 (en) Methods and systems for analyzing diagnostic images
EP3346297A1 (en) Image analysis approach for assessing image data
CN111528879A (en) Method and system for acquiring medical image
CN111631742A (en) X-ray imaging method and system based on surface light source
CN112450956A (en) Automatic positioning method, device, readable storage medium, electronic equipment and system
US11020065B2 (en) Control device for controlling tomosynthesis imaging, imaging apparatus, imaging system, control method, and program for causing computer to execute the control method
CN112599235A (en) Remote medical control system and method
CN107610754B (en) Medical image center system, remote end and local end
KR20200069308A (en) Systems and methods for digital radiography
CN111528890B (en) Medical image acquisition method and system
US11684334B2 (en) Methods and systems for protocol management
CN110811662A (en) Method, device and equipment for modulating scanning dose and storage medium
US11759158B2 (en) Systems and methods for controlling imaging device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination