CN110247976B

CN110247976B - Medical image interaction method and device

Info

Publication number: CN110247976B
Application number: CN201910537493.5A
Authority: CN
Inventors: 秦晓红; 焦文; 张晓军
Original assignee: Qingdao Hisense Medical Equipment Co Ltd
Current assignee: Qingdao Hisense Medical Equipment Co Ltd
Priority date: 2019-06-20
Filing date: 2019-06-20
Publication date: 2022-09-23
Anticipated expiration: 2039-06-20
Also published as: CN110247976A

Abstract

The embodiment of the invention provides a medical image interaction method and a device, wherein the method comprises the following steps: acquiring a room identifier of a room into which a first client enters, wherein a plurality of clients can be accommodated in the same room; acquiring current image information of the room according to the room identifier of the room, wherein the current image information comprises a first medical image and a first identifier of the first medical image, and the first medical image is an image which is currently controlled and displayed by other clients in the room; and synchronizing the first medical image to the first client according to the first identifier. The medical image interaction method and the medical image interaction device provided by the embodiment of the invention can save system resources, improve the cooperation speed and simultaneously ensure the authenticity of medical image display.

Description

Medical image interaction method and device

Technical Field

The embodiment of the invention relates to the technical field of medical images, in particular to a medical image interaction method and device.

Background

The remote medical treatment uses the remote communication technology, the imaging technology, the new electronic technology, the computer multimedia technology and other technologies, exerts the advantages of the medical technology and equipment in the center of a large hospital and provides remote medical information service for areas with weak medical conditions and special environments. By transmitting the image files according to the Dicom3.0 standard, the image data collected by the imaging devices (such as CT, MR, etc.) of a plurality of local hospitals at different places are transmitted to a diagnosis center (such as Hospital) through a network, and the experts in the diagnosis center diagnose and give results, thereby realizing the synchronous sharing of a plurality of medical images.

Through the remote image consultation system, the subordinate hospitals can transmit the image data of the patients to the consultation center of the superior hospitals, the image experts of the superior hospitals read the images, and the image experts interact with each other, so that the accuracy and the efficiency of diagnosis are improved. The existing medical image interaction methods mainly comprise two methods, wherein the first scheme is a remote desktop and application program sharing mode, and equipment parties realize interaction through an image transmission mode. The method adopts a teleconferencing mode, when each party of a client needs to exchange and transmit medical image data, a screenshot mode is adopted, and the transmission data is interface data, so that the image is distorted to a certain extent, and the authenticity of DICOM image display cannot be ensured. And the cooperation module of the user terminal and the cooperation information of the cloud server in the second scheme are communicated through WebSocket protocol communication, all operations of the image processing module in the second scheme need to pass through the image processing server, image display is hardly distorted, but when a new picture needs to be generated, all cooperation parties need to regenerate the image display, more resources are consumed, and the cooperation speed is reduced.

In the prior art, either medical image display is distorted or images need to be generated repeatedly, which results in large resource consumption, so a medical image interaction method is urgently needed to solve the above problems.

Disclosure of Invention

The embodiment of the invention provides a medical image interaction method and device, and aims to solve the problem of high resource consumption caused by repeated image generation in the prior art.

In a first aspect, an embodiment of the present invention provides a medical image interaction method, including:

acquiring a room identifier of a room into which a first client enters, wherein a plurality of clients can be accommodated in the same room;

acquiring current image information of the room according to the room identifier of the room, wherein the current image information comprises a first medical image and a first identifier of the first medical image, and the first medical image is an image which is currently controlled and displayed by other clients in the room;

and synchronizing the first medical image to the first client according to the first identifier.

In one possible design, the method further includes:

acquiring a collaborative instruction of the first medical image according to the first identifier; the collaborative class instruction of the first medical image comprises a plurality of operation instructions arranged according to a time sequence and the first identifier;

synchronizing the collaborative class instructions of the first medical image to the first client.

In one possible design, before the obtaining the room identification of the room entered by the first client, the method further includes:

receiving access information sent by a management server, wherein the access information comprises an identifier of a first client and login information of the first client;

sending room entering information to a first client according to the identification of the first client and the login information of the first client, so that the first client can confirm the room entering information;

receiving confirmation information sent by the first client, wherein the confirmation information comprises room identification of a first room entered by the first client and login room success information.

In a second aspect, an embodiment of the present invention provides a medical image interaction method, including:

acquiring an image display application instruction sent by a second client in a room, wherein the image display application instruction comprises a second identifier of a second medical image, the room contains a plurality of first clients, the second client is one of the first clients, the current image information of the room comprises a first medical image and a first identifier of the first medical image, and the first medical image is an image which is currently controlled and displayed by other clients in the room;

synchronizing the second medical image to all clients of the room according to the second identification.

In a possible design, the synchronizing the second medical image to all clients of the room according to the second identifier specifically includes:

if the second medical image is judged to be located in the history cache image according to the second identifier, synchronizing the second medical image to all the clients of the room;

otherwise, generating the second medical image according to the image display application instruction, and synchronizing the second medical image to all clients of the room.

In a possible design, if a collaborative class instruction for a third medical image sent by a third client of the room is obtained, the method further includes:

acquiring a third identifier of the corresponding third medical image according to the collaborative instruction of the third medical image;

and synchronizing the collaborative instructions of the third medical image to a first target client according to the third identifier, wherein the first target client is a client currently controlling the display of the third medical image in the room.

In one possible design, after the acquiring the third identifier of the corresponding third medical image according to the collaborative class instruction of the third medical image, the method further includes:

acquiring an identifier of a current control display image of a second target client according to a preset time interval, wherein the second target client is other clients except the first target client in the room;

when the identifier of the current control display image of the second target client is different from the third identifier, acquiring the synchronization unsuccessful information of the collaborative instruction sent by the second target client;

and when the identifier of the current control display image of the second target client is the same as the third identifier, synchronizing the cooperation instruction of the third medical image to the second target client.

In a third aspect, an embodiment of the present invention provides a medical image interaction apparatus, including:

the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring a room identifier of a room into which a first client enters, and a plurality of clients can be accommodated in the same room;

the first processing module is used for acquiring current image information of the room according to the room identifier of the room, wherein the current image information comprises a first medical image and a first identifier of the first medical image, and the first medical image is an image which is currently controlled and displayed by other clients in the room;

and the second processing module is used for synchronizing the first medical image to the first client according to the first identifier.

In one possible design, the second processing module is further configured to:

In one possible design, the system further includes a third processing module, the third processing module is configured to:

according to the identification of a first client and the login information of the first client, room entering information is sent to the first client for the first client to confirm;

and receiving confirmation information sent by the first client, wherein the confirmation information comprises room identification of a first room entered by the first client and successful login room information.

In a fourth aspect, an embodiment of the present invention provides a medical image interaction apparatus, including:

an obtaining module, configured to obtain an image display application instruction sent by a second client in a room, where the image display application instruction includes a second identifier of a second medical image, the room accommodates multiple first clients, the second client is one of the multiple first clients, current image information of the room includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room;

a synchronization module for synchronizing the second medical image to all clients of the room according to the second identification.

In one possible design, the synchronization module is specifically configured to:

In one possible design, the synchronization module is further specifically configured to:

and synchronizing the collaborative class instruction of the third medical image to a first target client according to the third identification, wherein the first target client is a client currently controlling the display of the third medical image in the room.

In a possible design, after the acquiring the third identifier of the corresponding third medical image according to the collaborative class instruction of the third medical image, the synchronization module is further specifically configured to:

In a fifth aspect, an embodiment of the present invention provides a medical image interaction apparatus, including: at least one processor and memory;

the memory stores computer-executable instructions;

the at least one processor executes computer-executable instructions stored in the memory to cause the at least one processor to perform the medical image interaction method according to any one of the first aspect, or to cause the at least one processor to perform the medical image interaction method according to any one of the second aspect.

In a sixth aspect, the present invention provides a computer-readable storage medium, in which computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the method for medical image interaction according to any one of the first aspect or the method for medical image interaction according to any one of the second aspect is implemented.

According to the medical image interaction method and device provided by the embodiment of the invention, the image server acquires the current image information of the room through the room identifier of the room into which the client enters, the medical images currently controlled and displayed by other clients are synchronized to the client through the identifier of the medical image in the current image information, each medical image only needs to be generated during first display, and after the client newly joins the room, the corresponding medical image only needs to be synchronized to the newly joined client and is directly read by the client without being regenerated, so that resources can be saved, and the cooperation speed is improved. Meanwhile, the image server system generates and manages the images, and then the images are directly synchronized to the client side, so that the embodiment of the invention does not need to process interface data and can also ensure the authenticity of image display.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario of a medical image interaction method according to an embodiment of the present invention;

fig. 2 is a first flowchart illustrating a medical image interaction method according to an embodiment of the present invention;

fig. 3 is a flowchart illustrating a second medical image interaction method according to an embodiment of the present invention;

fig. 4 is a third schematic flowchart of a medical image interaction method according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a medical image interaction apparatus according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a medical image interaction apparatus according to another embodiment of the present invention;

fig. 7 is a schematic hardware structure diagram of a medical image interaction apparatus according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

First, some proper nouns appearing in the present application will be explained to better understand the aspects of the present application.

DICOM: digital Imaging and Communications in Medicine (Digital Imaging and Communications in Medicine), an international standard for medical images and related information, defines a format for medical images that can be used for data exchange at a quality that meets clinical needs. DICOM is not only a storage format for medical images, but also a modality for conversion between different forms of data for different imaging systems.

Websocket: a protocol for full duplex communication over a single transmission control protocol connection enables easier data exchange between a client and a server while allowing the server to actively push data to the client.

BS: a Browser and a Server framework centralize a core part for realizing system functions on a Server, only one Browser needs to be installed on a client, various databases are installed on the Server, and the Browser can perform data interaction with the Server through the framework. The architecture can simplify the load of the client and reduce the overall cost of the client.

Fig. 1 is a schematic view of an application scenario of a medical image interaction method provided by an embodiment of the present invention, and as shown in fig. 1, a system architecture design of the embodiment of the present invention includes a management server 11, a picture server 12, a command server 13, and a client 14, where the management server 11 is responsible for organizing architecture management (including management of hospitals and departments), user management (including client registration, login, and logout), room management (including creation, joining, logout, and current state management of rooms, generation of room identifiers, and the like), and resource right management (including DICOM data right management);

the picture server 12 is responsible for storage of DICOM raw imaging data, conversion processing of the DICOM raw imaging data and history cache management, and is responsible for synchronous management of the converted image data at each client, so as to complete an image type coordination function, and in addition, an algorithm and the DICOM data can be called to generate a second medical image.

The command server 13 is responsible for the historical cache management of the operation instructions and the synchronous management of the operation instruction data at each client, and completes the function of a command system;

the client 14 is responsible for user collaborative interaction, collaborative categorization, and image and information display functions. All the above collaborative management is managed by taking a room as a unit, the room is an organization structure created for mutual data collaboration among a plurality of clients, when the room is created, a corresponding room identifier is generated, the room identifier corresponding to each room is unique, and the client 14 can enter the corresponding room according to the room identifier. Within the same room, there may be multiple clients 14, as shown in FIG. 1, including client A and client B. Except for special conditions such as network lag, the medical images displayed by the clients in the room are the same, and the coordination instructions for each medical image are also consistent, that is, the clients in the same room can perform interactive operation on the same medical image, so that the medical images are interactively communicated.

The management server 11, the picture server 12 and the command server 13 may be three independent servers, and when the servers have sufficient processing capacity, one server may also implement the functions of the other servers. For example, there may be an integrated server integrating the functions of the management server 11, the picture server 12, and the command server 13, and the integrated server may perform organization management, user management, room management, and resource authority management, and may perform image cooperation management and command cooperation management. For another example, two of the management server 11, the picture server 12, and the command server 13 may be integrated into one server, and the remaining one may be an independent server.

Since the pictures always consume the most system resources, in a possible scheme, the picture server 12 is separately set up and configured with high-performance hardware to meet the requirements of image processing and the requirements of picture storage and transmission, and common hardware can be configured for the management server 11 and the command server 13 to reduce the cost of the whole system cluster. For example, the system cluster needs 8 servers, if the picture server 12 and the command server 13 are not separated, 8 servers must all process image data, and each server must be configured high, and if the picture server 12 and the command server 13 are separated, 5 high configuration servers can be used as the picture server 12, and 3 low configuration servers can be used as the command server 13, so as to reduce the hardware cost of the system cluster.

The technical solution of the present invention and how to solve the above technical problems will be described in detail with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.

Fig. 2 is a first schematic flow chart of a medical image interaction method according to an embodiment of the present invention, as shown in fig. 2, including:

and S21, acquiring a room identifier of a room entered by the first client, wherein a plurality of clients can be accommodated in the same room.

The room is an image interaction unit, and clients in the same room perform interactive communication on the same medical images. The room identifiers are used for distinguishing different rooms, when a client applies for generating a room, the management server creates a room and allocates a room identifier to the created room, and when other clients want to enter the room, the clients can enter the room through the corresponding room identifiers.

The room identifier may be in various forms, for example, one possible room identifier is in the form of a number, and the management server may number the rooms, and the order of numbering may be according to the order of creating the rooms, or may be randomly numbered, but the number of each room is unique. When a client wants to enter a room, the client first needs to know the room identifier, i.e. the room number, of the room.

For another example, the room identifier may be divided according to different departments, when the client applies for creating a room, the client applies for the department to which the medical image to be communicated and interacted belongs, and the management server allocates a room identifier including the department corresponding to the room to the created room according to the application of the client. If a plurality of rooms correspond to the same department, the plurality of rooms are respectively numbered in the department. For example, in a department of medicine, a department of medicine 1 room, a department of medicine 2 room and a department of medicine 3 room exist, a client requests to create a new room for the communication of relevant medical images of the department of medicine, the management server creates a new room in the department of medicine according to the request of the client, and creates a corresponding room identifier for the room, namely a department of medicine 4 room, and the like. The specific form of the room identifier can be set according to actual needs, and the two ways are only two possible implementations, and the specific form is not particularly limited herein.

When a first client needs to interact with other clients for medical images, the first client logs in a room first, the first client stores the room identification at the moment, the management server synchronizes the room identification to the image server, and the first client is added into the corresponding room according to the room identification. The process of entering a room by a first client entering the room is described here: the first client entering the room connects to the management server, and after registration and login, the client displays the previously created task list. The task list comprises a plurality of tasks, and each task displays the task name of the task on the display interface. The task refers to a group of DICOM raw imaging data stored in the picture manager. The task name in the task sheet is a set of characters that uniquely identifies the task, and in some embodiments may be a set of characters consisting of a storage time, an image name, and a patient name. For example, "2019, 1, 7, 10:12 min, chest CT tomogram, patient name XXX". If a user of a certain client wants to see pictures stored under the task, double clicking the task name can enter a room under the task, and the management server can automatically generate a unique room identifier for each room, wherein the room identifier can uniquely identify the room.

S22, according to the room identifier of the room, obtaining current image information of the room, where the current image information includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room.

The first medical image is an image which is displayed and interacted by each other client side in a room where the first client side enters, and the image server can acquire current image information in the room in real time and comprises the first medical image which is displayed by each client side in a current control mode and a first identifier of the first medical image. For each image, the image server assigns a separate image identifier to each image to distinguish each image. The first identification of the first medical image refers to an image identification of an image currently controlled for display by other clients in the room. For example, an image of one image is identified as 123a, and when a first client enters a room, and an image that each other client is displaying and interacting at this time is an image having the image identifier 123a, that is, a first medical image, then the first identifier of the current first medical image is 123 a.

S23, synchronizing the first medical image to the first client according to the first identification.

After the first client enters the room, the image server synchronizes the first medical image to the first client newly joining the room according to the acquired first identifier of the first medical image. In the embodiment of the invention, each image is generated at the image server only once when being displayed for the first time, when a new client is added into a room, the currently displayed image in the image server is synchronized to the newly added client only according to the current image information, the client directly reads the corresponding medical image, and the image display is not required to be generated again between the clients.

The embodiment of the invention can be based on the HTML5 standard of the browser, does not depend on any specific browser and system platform, does not need to install client software and download browser plug-ins, can enable a clinician to browse DICOM standard image data on a workstation computer, a tablet computer and a mobile phone anytime and anywhere, saves deployment time and cost to the maximum extent, and flexibly and quickly responds to image browsing and coordination requirements of users.

According to the medical image interaction method provided by the embodiment of the invention, the image server acquires the current image information of the room through the room identifier of the room into which the first client enters, the first medical images currently controlled and displayed by other clients are synchronized to the first client through the first identifier of the first medical image in the current image information, each medical image only needs to be generated during first display, and after the first client newly joins the room, the corresponding first medical image only needs to be synchronized to the newly joined first client and is directly read by the first client without being generated again, so that resources can be saved, and the cooperation speed is improved. Meanwhile, the image server system generates and manages the images, and then the images are directly synchronized to the client side, so that the embodiment of the invention does not need to process interface data and can also ensure the authenticity of image display.

Fig. 3 is a second flowchart of a medical image interaction method according to an embodiment of the present invention, as shown in fig. 3, including:

s31, acquiring an image display application instruction sent by a second client in a room, where the image display application instruction includes a second identifier of a second medical image, the room accommodates a plurality of first clients, the second client is one of the plurality of first clients, current image information of the room includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room;

the room is a unit of medical image interaction, and the meaning of the room in the embodiment of the present invention is the same as that of the room in the embodiment of fig. 2, which is not described herein again.

In the room, a plurality of first clients are included, wherein the time for each first client to enter the room may be the same or different. When a first client enters a room, a room identifier of the room is acquired, current image information of the room is acquired according to the room identifier, wherein the current image information of the room comprises a first medical image and a first identifier of the first medical image, the first medical image is an image which is currently controlled and displayed by other clients in the room, and then an image server synchronizes the first medical image to the first client according to the first identifier. Since the time each first client enters the room may be different, the images currently controlled to be displayed by the other clients in the room may also be different.

The second client is one of the plurality of first clients, i.e. the second client is one of the clients within the room. When the second client applies for displaying other medical images or transforms images currently controlled and displayed by other clients in the room, the second client sends an image display application instruction to the image server, wherein the image display application instruction comprises a second identifier of the second medical image, the second medical image can be other medical images or images obtained by transforming images currently controlled and displayed by other clients in the room, and the second identifier can uniquely determine the second medical image.

S32, synchronizing the second medical image to all clients of the room according to the second identification.

After the image server acquires the image display application instruction sent by the second client in the room, the second medical image is synchronized to all the clients in the room according to the second identifier in the image display application instruction. For example, the first medical image currently being controlled and displayed by the client in the room is a gastroscope image of a patient A, which corresponds to a first reference numeral 123. The user of the second client now wishes to display the gastroscope map of patient b, which is now the second medical image, corresponding to the second identifier 124. The user of the second client sends an image display application instruction to the image server through the second client, wherein the image display application instruction comprises a second identifier 124 corresponding to the gastroscope map of the patient B, and the image server acquires a second medical image, namely the gastroscope map of the patient B according to the second identifier 124 and then synchronizes the second medical image to all the clients in the room.

The scheme in the example of fig. 3 may be implemented as a separate embodiment, or may be implemented on the basis of the scheme in the example of fig. 2.

The technical solution shown in the present application will be described in detail with reference to fig. 4 and specific examples. It should be noted that the following embodiments may be combined with each other, and the description of the same or similar contents is not repeated in different embodiments.

Fig. 4 is a third flowchart of the medical image interaction method according to the embodiment of the present invention, as shown in fig. 4, including:

s401, the client is connected with the management server, and registers and logs in the management server.

When a user needs to perform medical image interaction, the user firstly needs to connect a management server through a corresponding client to register, and registration information is filled in, wherein the registration information generally comprises a login name and a login password of the user, and the user belongs to a hospital and a department.

The management server has organizational architecture management capabilities including the management of regions, hospitals, departments, and the like. When the client registers, a corresponding organization architecture needs to be selected, for example, the client corresponds to doctors of which department of which hospital the user is, and the like, the information forms user attributes, and the management server determines the authority of the DICOM data which can be applied and viewed by the client according to the user attributes.

Meanwhile, the management server has DICOM data resource authority management capability, each piece of uploaded DICOM image data has a unique number (namely an image identifier), and it needs to determine which organization has the viewing authority, such as which hospital, which department or which doctor.

For example, the user a is a doctor in the gastrointestinal department of the hospital C in B, and after the user a is registered in the management server through the client, the user a has the right to view and operate the related medical images of the gastrointestinal department, but does not have the right to view and operate the related medical images of other departments. If other authorities need to be opened, an application needs to be sent to the management server, and corresponding operation can be performed through the rear part to be approved.

After the successful registration, the management server sends the information of successful registration to the client, and the client can log in the management server when required after receiving the information. When the client logs in the management server, the client needs to log in according to the relevant information registered on the management server by the client, and after the login is successful, the connection between the client and the management server can be established. Because the management server, the image server and the command server are connected, after the client logs in the management server, the management server can acquire the access information of the image server and the command server, so that the client can be connected with the image server and the command server through the management server. The method can enable the client side and the image server, and the client side and the command server to establish persistent connection only by one-time handshaking, and carry out bidirectional data transmission.

S402, the management server sends access information to the image server and the command server.

After login is successful, the image server and the command server receive access information sent by the management server, wherein the access information comprises a first client identifier and first client login information, the first client identifier can be generated when the first client registers in the management server, each client identifier registered at the management server side is unique, the client identifier can be specifically a client number, and the client number can be obtained according to the registration sequence or in other manners. According to the first client identifier, the management server can acquire the registration information of the first client and the current state of the first client, including whether the first client establishes a connection with the image server and the command server, whether the first client enters a certain room, whether the first client displays a certain medical image, and the like. According to the first client identification and the first client login information, the management server establishes connection between the first client and the image server and between the first client and the command server.

It can be understood that, in the embodiment of the present invention, all operations of the management server, the image server, and the command server may be performed by the same server, or may be performed by two or three independent servers. Preferably, the image server is separately arranged, and the management server and the command server are separately arranged or arranged as a single server, so that the image server can be configured in high hardware to meet the requirements of image processing, storage and transmission, and the management server and the command server can be configured in general, thereby reducing the hardware cost of the system cluster.

The first client in the embodiment of the invention refers to a client which needs to interact with other clients for medical images and logs in a room, and if the client does not need to interact with other clients and only wants to check and operate the medical images by the client, the client can select to create a new room and apply for permission to the management server, and other clients are not allowed to enter. The user may specify a variety of access rights, such as allowing access only to users meeting certain conditions, etc.

And S403, the first client logs in the room according to the access information and stores the room identifier.

After the image server and the command server acquire the access information, room entering information is sent to the first client according to the first client identifier and first client login information, wherein the login information comprises a room identifier of a room to be entered by the first client and time information of entering the room. After the first client logs in the room according to the access information, the room identification is stored, after each room is created, the management server sets a room identification different from other rooms for the room, and meanwhile, the management server can also acquire all client information for logging in the room according to the room identification.

S404, the first client synchronizes the room identification to the image server and the command server.

After the first client successfully logs in the room, a confirmation message is sent to the image server and the command server, wherein the confirmation message comprises the room identifier of the room entered by the first client and successful room logging information.

S405, the image server and the command server judge whether the room identifier already exists, if not, S406 is executed, and if so, S408 is executed.

The image server and the command server judge whether the room is created according to the room identifier, if not, S406 is executed, and if so, S408 is executed.

S406, the management server establishes a room and synchronizes to the image server and the command server.

And if the room to be logged in by the first client is not created, the management server creates a corresponding room and synchronizes the room identifier of the corresponding room to the image server and the command server, and after the image server and the command server acquire the room identifier, the first client is added into the room.

S407, the image server and the command server join the first client in the room, and S411 is executed.

The first client enters the room just created.

S408, the image server and the command server join the first client to the room.

The room in which the first client is to log on is created, and the image server and the command server directly join the first client to the room.

S409, the image server synchronizes the current image information to the first client.

When medical images are exchanged among clients in a created room, images currently controlled and displayed by the clients in the same room are consistent, an image server can acquire current image information, the current image information comprises a first medical image and a first identifier of the first medical image, the first medical image is an image currently controlled and displayed by other clients in the room, and the first identifier refers to an identifier of the image currently controlled and displayed by other clients in the room.

The image server caches a plurality of medical images, the image server allocates an image identifier different from other medical images for each medical image, and the image server can find out a corresponding unique medical image according to one image identifier.

When the first client enters a room, the images controlled and displayed by other clients are the first medical images, which indicates that the first medical images are cached, at this time, the image server synchronizes the current image information to the first client according to the first identification of the first medical images, and the first client acquires the first medical images and the first identification of the first medical images.

S410, the server is instructed to synchronize the collaborative class instruction of the first medical image to the first client.

After the first client side obtains the first medical image and the first identifier of the first medical image, if other client sides in the room perform corresponding cooperation instruction operation on the first medical image, the server is instructed to obtain the cooperation instruction of the first medical image according to the first identifier, wherein the cooperation instruction comprises a plurality of operation instructions arranged according to a time sequence and the first identifier. The operating instructions may include measuring a line, reversing color, rotating, zooming, translating, paging, and the like. The user in the room can designate one party as the speaker through the client, the speaker can operate through the corresponding client, and at the moment, other clients can not operate but can see the same picture as the speaker. Other users can apply for the speaker through the client, and the speaker can be switched to be the speaker after the speaker agrees.

And then, the command server synchronizes the collaborative instruction to the first client, a plurality of operation instructions in the collaborative instruction operate the first medical image according to the time sequence, and finally, the effect of the image currently controlled and displayed by the first client is completely consistent with the effect of the image controlled and displayed by other clients in the room.

S411, the image server waits for an image display application instruction of a second client in the room.

The method includes the steps that an image display application instruction sent by a second client side in a room is obtained, the second client side in the embodiment of the invention refers to the client side which is to apply for displaying a medical image when a new medical image different from a currently displayed medical image is required to be applied or the client side does not display any medical image, for example, the second client side enters a newly created room, the client side does not display any medical image after entering the room, and at the moment, the second client side can initiate the image display application instruction to an image server to display a certain medical image. For another example, the medical image a is currently displayed in the room, the second client wants to display the medical image B and communicates with other clients, and at this time, the second client may also initiate an image display application instruction to the image server. And the image server waits for image display application instructions of all the clients in the room. The image display application instruction includes displaying a new image and performing a transformation operation on the image, wherein the transformation operation includes enlarging, reducing, adding a label or changing the image observation visual field range (image window width and level adjustment) and the like.

S412, the image server acquires an image display application instruction.

The image server acquires an image display application instruction sent by the second client, wherein the image display application instruction comprises a second identifier of the second medical image, and the second identifier is used for the image server to find the second medical image. If the image display application instruction is to perform conversion operation on the image, the image display application instruction comprises a conversion operation instruction. The second medical image is a medical image that the second client wants to apply for display.

N medical images are cached in the image server in sequence according to time sequence, and each medical image is designed with a unique image identifier. The image server records the image identifications of the medical images cooperatively used by all the clients in the current room, synchronizes the medical images to all the clients connected to the room, and if a certain client fails to synchronize successfully due to network and other reasons, the image server records and continues to synchronize the clients in the follow-up process until the clients succeed, so that the image server ensures the ordering of image display of all the clients. When the medical images needed by the client are not in the N caches, the image server calls an algorithm and corresponding DICOM data to generate the medical images, and replaces the earliest image in the N caches according to the time sequence. N is the best number of pictures that the server can store, and is different according to the size of the server memory and the size of the pictures. For example, after the DICOM image is analyzed, image identifiers are designed according to the analyzing sequence and stored in an image server, and the images can be sequentially displayed according to the image identifiers when page turning is performed. The image identification can be designed according to the time stamp or according to the DICOM image parsing sequence, and then the images can be displayed in order according to the time sequence of image caching or the parsing sequence of the DICOM images when the pages are turned.

S413, the image server determines whether the second medical image is cached, if so, executes S415, and if not, executes S414.

The image server determines whether the second medical image is in a history cached image. In the embodiment of the invention, when the medical image is transmitted to the image server, the image file according to the DICOM standard is used for transmission, and for example, the general DICOM3.0 standard can be adopted. When the client displays images, because the formats of different types of medical images are different, some medical images cannot be directly called to the client for displaying. For example, medical images such as electroencephalogram, magnetic resonance imaging, gastroscope, etc., the corresponding medical image formats may include Analyze format, NIfTI format, MINC format, etc., and if the formats do not correspond, it indicates that the second medical image is not cached in the history image.

And S414, the image server calls an algorithm and DICOM data to generate a second medical image.

If the second medical image is not in the historical cache data, the image server calls an algorithm and DICOM data to generate the second medical image.

S415, the image server synchronizes the second medical image to all clients of the room.

And after the second medical image is acquired according to the second identifier of the second medical image, synchronizing the second medical image to all the clients of the room so as to ensure that the images currently controlled and displayed by all the clients in the same room are consistent. If a certain client side is not successfully synchronized due to network and other reasons, the image server records and continues to synchronize the client side in the subsequent process until the client side is successfully synchronized, so that the image display orderliness of each client side is ensured.

For example, a certain room includes a client a and a client B, the client a initiates an image display application instruction to the image server if it wants to change the image observation visual field range, and after the image server receives the image display application instruction, if it is determined that the image of the image display application instruction exists in the image cached in the history, the image identifier of the cached image is directly set as the current image identifier, and the medical image corresponding to the image identifier is synchronized to the client a and the client B, which is extremely high in efficiency; if the image of the image display application instruction does not exist in the historical cache image, the image server calls an algorithm and DICOM data to regenerate the image, adds the newly generated image into the cache, sets an image identifier of the newly generated image as a current image identifier, and simultaneously synchronizes the image corresponding to the image identifier to the client A and the client B; the image also only needs to be generated once.

And S416, instructing the server to acquire the cooperation instruction of the third medical image sent by the client.

The interaction of the medical image includes the operation of an operation instruction, which is called command operation for short, besides the operation of the image. The operation instruction may include measuring a line, a reverse color, a rotation, a zoom, a translation, a page turn, and the like, where the embodiment of the present invention obtains a third identifier of the third medical image included in the collaborative instruction for the third medical image sent by the third client. The third client is any client in the room which wants to perform command operation on the image, and the third medical image is the medical image aimed at in the collaborative instruction of the third client.

And all the operation instructions for the command operation of each room in the command server are sequentially cached according to the time sequence, and each operation instruction is provided with an operation instruction ID number. The command server always synchronizes the operation instructions to each user client connected to the room according to the sequence, and records to which operation instruction the user of each client finishes pushing, if a certain operation instruction is not synchronized successfully by a certain user client due to network and the like, the command server can continuously synchronize the operation instruction for the user client until the operation instruction is successful. The command server also ensures the ordered coordination of command operation instructions. The command server can design an operation instruction ID number according to the timestamp, sequentially puts the received operation instructions into a queue according to the timestamp in the operation instruction ID, and sequentially takes out the operation instructions and synchronizes the operation instructions to the client so as to ensure the ordering of command processing.

And S417, the command server judges whether the image identifier currently controlled and displayed by the client is the same as the image identifier of the third medical image, if so, S421 is executed, and if not, S418 is executed.

The embodiment of the invention can not only ensure the orderliness between the interior of the image and the interior of the command operation instruction, but also ensure the orderliness between the image and the command operation instruction. The ordering between the image and the command operation instruction is realized by utilizing the image identifier which is included in the command operation instruction and is aimed at by the operation instruction, each user client side records the image identifier of the current display image, when a user client receives an operation instruction synchronized by the command server, the image identifier contained in the operation instruction is inconsistent with the image identifier currently displayed by the user client, the operation instruction is abandoned, and feeds back the operation instruction to the command server, wherein the operation instruction is not successfully synchronized, and the medical image displayed by the client is indicated to be not the medical image currently displayed in the room, the image server can continue to synchronize the currently displayed medical image to the client, and simultaneously, commanding the server to synchronize the operation instruction to the user client again in the subsequent process until the image identifier currently displayed by the client is consistent with the image identifier contained in the operation instruction.

For example, a coordination instruction sent by a third client wants to operate on a third medical image, and a medical image currently controlled and displayed by a certain client is not the third medical image due to a network and the like, and if a command operation is directly performed on the coordination instruction, an error occurs.

And S418, instructing the server to acquire the image identifier of the current control display image of the client according to the preset time interval.

And for a second target client with the image identifier of the currently controlled display image different from the image identifier of the third medical image, the image identifier of the currently controlled display image of the second target client is acquired according to a preset time interval instead of synchronizing the collaborative instruction with the second target client. In the embodiment of the present invention, the preset time interval may be set according to actual needs, and is not specifically limited herein.

For example, in the image page turning process, when a certain interactive client does not update an image due to a network problem, the image identifier of the interactive client is Img _ ID and is inconsistent with the image identifier Img _ ID2 of the active client, and at this time, when the active client performs operations such as line drawing and the like, the active client synchronizes a line drawing command with an operation instruction ID of a1 to the command server, the command server synchronizes the line drawing command with an operation instruction ID of a1 to the interactive client, when the interactive client processes the line drawing operation, the interactive client compares the image identifier of the self image with Img _ ID and the image identifier Img _ ID2 of the designated image in the received line drawing command with the operation instruction ID of a1, discards the operation instruction and returns to the command server, the command server receives return information to judge, and continues to synchronize the operation instruction with the operation instruction ID of a1 to the interactive client, until the image of the interactive client is identified as the image of Img _ ID2 ready, the operation instruction with the number of the operation instruction ID of A1 is correctly executed by the interactive client.

And S419, instructing the server to judge whether the image identifier of the image currently controlled and displayed by the client is the same as the image identifier of the third medical image, if so, executing S421, and if not, executing S420.

The second target client may lag the currently displayed image behind the other clients for some reason or otherwise not display the third medical image, so the command server continuously obtains the image identifier of the currently controlled displayed image of the second target client and compares the image identifier with the image identifier of the third medical image.

S420, the client sends the synchronization unsuccessful information of the like instructions to the command server.

If the image identifier of the current control display image of the second target client is different from the image identifier of the third medical image all the time within a period of time, the coordination class instruction cannot be synchronized with the client, and at the moment, the synchronization unsuccessful information of the coordination class instruction is sent to the command server, and the command server records the synchronization unsuccessful information.

S421, the server is instructed to synchronize the collaborative class instruction of the third medical image to the client in the room.

And synchronizing the coordination class instruction aiming at the third medical image by aiming at a first target client side with the image identifier of the current control display image being the same as the image identifier of the third medical image and a second target client side with the image identifier of the current control display image being the same as the image identifier of the third medical image after a plurality of preset time intervals. It should be noted that the coordination-type instruction includes one or more command operations for the third medical image, and each command operation has a strict sequence. When the synchronization is carried out, one or more command operations aiming at the third medical image are synchronized according to the strict sequence, so that the ordered coordination of the command operations is ensured.

For example, after a plurality of client users enter the same room according to the above-mentioned flow, for example, the client a and the client B, when the client a user operates the client, if the operation belongs to the command operation, the operation instruction of the command operation is sent to the command server, the command server receives the operation instruction and adds the operation instruction into the queue, and synchronizes the instruction of the command operation to the client B user, the client B receives the command operation instruction and then automatically executes the same operation as the client a, the client a and the client B see the completely same content, the efficiency is extremely high, and the delay is extremely small; also the command operation of client B will be synchronized to client a.

S422, the client sends an instruction of exiting the room to the server.

And after the interaction of a certain client to the medical image is finished, sending a room quitting instruction to the management server, the image server and the command server to apply for room quitting.

S423, the server deletes the client-related data.

After the management server, the image server and the command server receive the instruction, the relevant data of the client is deleted, and the client is allowed to exit the room.

S424, after all the clients in the room quit, the server deletes the room and the room identifier.

If all the clients in the room exit, the management server deletes and recycles the room to save space resources. When the client needs to create the room again, the application can be initiated to the management server again.

The medical image interaction method provided by the embodiment of the invention adopts a mode of coexistence of images and commands to classify the image modes and the command modes, the image server uniformly generates and manages the images, the consistency and the authenticity of the images are ensured, the client is only responsible for displaying and operating the images, the command server is adopted to realize ordering of the commands, and the interaction platform is uniformly managed. The ordering among the images, the command operation instructions and the images and the command operation instructions is realized through the coordination operation of the image server and the command server.

Fig. 5 is a schematic structural diagram of a medical image interaction apparatus 50 according to an embodiment of the present invention, as shown in fig. 5, including an obtaining module 51, a first processing module 52, and a second processing module 53, where:

the obtaining module 51 is configured to obtain a room identifier of a room into which a first client enters, where a plurality of clients may be accommodated in the same room;

the first processing module 52 is configured to obtain current image information of the room according to a room identifier of the room, where the current image information includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room;

the second processing module 53 is configured to synchronize the first medical image to the first client according to the first identifier.

In one possible design, the second processing module 53 is further configured to:

Fig. 6 is a schematic structural diagram of a medical image interaction apparatus 60 according to another embodiment of the present invention, as shown in fig. 6, including an acquisition module 61 and a synchronization module 62, wherein:

the obtaining module 61 is configured to obtain an image display application instruction sent by a second client in a room, where the image display application instruction includes a second identifier of a second medical image, the room accommodates multiple first clients, the second client is one of the multiple first clients, current image information of the room includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room;

the synchronization module 62 is configured to synchronize the second medical image to all clients of the room according to the second identification.

In one possible design, the synchronization module 62 is specifically configured to:

In one possible design, the synchronization module 62 is further configured to:

In a possible design, after the acquiring the third identifier of the corresponding third medical image according to the collaborative class instruction of the third medical image, the synchronization module 62 is further specifically configured to:

The apparatus provided in the embodiment of the present invention may be used to implement the technical solution of the above method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 7 is a schematic hardware structure diagram of a medical image interaction device according to an embodiment of the present invention, and as shown in fig. 7, the medical image interaction device includes: at least one processor 71 and a memory 72. The processor 71 and the memory 72 are connected by a bus 73.

Optionally, the model determination further comprises a communication component. For example, the communication component may include a receiver and/or a transmitter.

In a specific implementation, the at least one processor 71 executes the computer-executable instructions stored in the memory 72, so that the at least one processor 71 executes the medical image interaction method as described above.

For the specific implementation process of the processor 71, reference may be made to the above method embodiments, which implement principles and technical effects similar to each other, and details of this embodiment are not described herein again.

In the embodiment shown in fig. 5, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

The memory may comprise high speed RAM memory, and may also include non-volatile storage NVM, such as at least one disk memory.

The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.

The present application further provides a computer-readable storage medium, in which computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the medical image interaction method as described above is implemented.

The computer-readable storage medium may be any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.

An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the readable storage medium may also reside as discrete components in the apparatus.

The division of the units is only a logical division, and in actual implementation, there may be other divisions, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may also be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part thereof which substantially contributes to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a portable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A medical image interaction method is characterized by comprising the following steps:

synchronizing the first medical image to the first client according to the first identifier;

acquiring a collaborative instruction of the first medical image according to the first identifier; the collaborative instruction of the first medical image comprises a plurality of operation instructions arranged according to a time sequence and the first identifier;

synchronizing the collaborative class instructions of the first medical image to the first client;

before the obtaining the room identification of the room entered by the first client, the method further includes:

2. A medical image interaction method is characterized by comprising the following steps:

acquiring an image display application instruction sent by a second client in a room, wherein the image display application instruction comprises a second identifier of a second medical image, the room contains a plurality of first clients, the second client is one of the first clients, the current image information of the room comprises a first medical image and a first identifier of the first medical image, and the first medical image is an image which is currently controlled and displayed by other clients in the room; the other clients are clients except the second client;

synchronizing the second medical image to all clients of the room according to the second identification;

if a collaborative class instruction for a third medical image sent by a third client of the room is obtained, the method further includes:

synchronizing the collaborative class instruction of the third medical image to a first target client according to the third identifier, wherein the first target client is a client currently controlling the display of the third medical image in the room;

after the third identifier of the corresponding third medical image is acquired according to the collaborative class instruction of the third medical image,

3. The method according to claim 2, wherein the synchronizing the second medical image to all clients of the room according to the second identifier specifically comprises:

4. A medical image interaction device, comprising:

the second processing module is used for synchronizing the first medical image to the first client according to the first identifier;

the second processing module is further configured to:

the third processing module is used for receiving access information sent by the management server, wherein the access information comprises an identifier of the first client and login information of the first client;

5. A medical image interaction device, comprising:

an obtaining module, configured to obtain an image display application instruction sent by a second client in a room, where the image display application instruction includes a second identifier of a second medical image, the room accommodates multiple first clients, the second client is one of the multiple first clients, current image information of the room includes a first medical image and a first identifier of the first medical image, and the first medical image is an image currently controlled and displayed by other clients in the room; the other clients are clients except the second client;

a synchronization module for synchronizing the second medical image to all clients of the room according to the second identification;

if a collaborative instruction for a third medical image sent by a third client of the room is obtained, the synchronization module is further specifically configured to:

the synchronization module is further specifically configured to:

6. A medical image interaction apparatus, comprising: at least one processor and a memory;

the memory stores computer-executable instructions;

the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the medical image interaction method of claim 1 or causes the at least one processor to perform the medical image interaction method of claim 2 or 3.

7. A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, which when executed by a processor, implement the medical image interaction method according to claim 1, or implement the medical image interaction method according to claim 2 or 3.