JP2008220654A - Modality remote simulator system and modality remote simulation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a modality remote simulator system and a modality remote simulation method which enable the photographing of images and processing of photographed images not only by a possessing modality but also by an unpossessing modality by means of a remote terminal. <P>SOLUTION: The modality remote simulator system 10 includes a server 13 connected with a client terminal 11 via a network 12. The server 13 includes an image storage 14 for storing photographed images while corresponding the images to modalities and their photography conditions, a pseudo-photography module 19 which receives a photographed image that matches the designated modality and photography conditions from the image storage in response to a modality and a photography condition designated by a user via the client terminal 11, and an image processing and analysis module 20 which analyzes and processes the photographed image acquired by the pseudo-photography module 19 on the basis of a condition and outputs the processed image to the client terminal. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a modality remote simulator system and a modality remote simulation method, and more particularly, to a simulation technique that can use a modality in a pseudo manner for education or the like.

  Conventionally, in order to conduct education on modality operation methods and education using diagnostic images using modalities in remote locations, participants participating in the education are Education was performed by performing operations using modalities, and simulating using operation images and photographic images of the modalities. That is, in modality education and the like, conventionally, an image photographed by a modality has been processed and displayed by operating a display screen and an operation screen of the same kind of modality as the photographed modality. Therefore, in order to process or display an image shot with a modality at a remote location or an image shot with a modality stored in an image storage means at a remote location, the modality used for the shooting is used. It needed the same kind of modality.

As a conventional system for teaching modality operation methods and diagnostic methods in a remote place as described above, there is a surgery support system disclosed in Patent Document 1. In this patent document 1, when it is necessary for an operator in an operating room to perform an operation with little experience in the past, the operator who is familiar with the operation is connected with a public line, and during the operation, Perform appropriate surgery for patients in the operating room by allowing the operator in the operating room to perform the operation under the remote support so that the remote support operator can receive instructions on the part to be excised. A system that supports this is being considered. In this system, the state of the surgical operation is recorded by the image storage means, and the surgeon can see the surgical image according to the stage of the operation. Further, as a conventional technique for sending an image shot by the above modality to a remote place, a system for video communication between the remote place and a central station is disclosed in Patent Document 2. Yes. Furthermore, Patent Document 3 discloses a system for accessing and displaying a diagnostic image from a remote location.
JP 2005-131044 A JP 2001-339704 A JP 2003-244174 A

  In order to process or display an image shot with a modality at a remote location or an image shot with a modality stored in an image storage means at a remote location, either the modality itself used for the shooting, A similar modality was needed. For this reason, in order to conduct education on modality operation methods and education such as diagnosis using images taken by the modality at a remote location, participants participating in the education must have the same type of modality as that at the remote location. For example, there is a problem that it is impossible to receive education and training using the operation method of the modality and the photographed image.

  In view of the above problems, an object of the present invention is to provide a modality remote simulator system and a modality remote simulation method capable of simulating shooting of a desired modality and processing of the shot image on a terminal regardless of the existence of a modality as an actual machine. Is to provide.

  In order to achieve the above object, the invention described in claim 1 is a modality remote simulator system comprising a client terminal and a server connected to the client terminal via a network. Image storage means that holds a captured image corresponding to the modality and the shooting conditions based on the modality and a user designation of the modality and shooting conditions from the client terminal, and shooting that matches the specified modality and the shooting conditions The pseudo photographing means for obtaining an image from the image storage means, and the photographed image obtained by the pseudo photographing means are sent to the client terminal, and the pseudo photographing means receives the designation of the conditions that can be processed with the modality designated from the client terminal. Analyzes the acquired captured images Processes based on the conditions, to a processing means for outputting an image of the process to the client terminal, comprising: a.

  The invention described in claim 5 is a modality remote simulation method, wherein the client terminal performs a first display for guiding a plurality of modalities so that a user can designate a modality to be simulated, and a client. The step of designating a desired modality by the terminal, the step of causing the client terminal to perform a second display for guiding the photographing condition for the designated modality, and sending the designated modality and the photographing condition to the server Acquiring a captured image that matches the modality and imaging conditions from the image storage means and sending the captured image to the client terminal and displaying the captured image on the client terminal; and causing the client terminal to display the image acquired from the image storage means on the server. The third to guide you to specify the conditions to be processed A step of displaying, a step of specifying a desired processing condition by the client terminal, a step of sending the specified processing condition to the server, and a processing condition for the captured image acquired from the image storage means by the server And a step of sending an image processed based on the condition from the server to the client terminal and displaying the image on the client terminal.

  According to the present invention, imaging of a desired modality and processing of the captured image can be simulated in a terminal regardless of the existence of a modality as an actual machine. As a result, it is possible to train various modality operating methods and image diagnosis. In addition, as a condition for obtaining an image, a shooting condition that is a condition for acquiring an image from the image storage unit and a condition for processing the image are provided, and the image storage unit stores only an image corresponding to the shooting condition. As a result, the number of images to be stored is not so large, and the image can be quickly acquired from the image storage means.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 is a configuration diagram of a modality remote simulator system according to the first embodiment of the present invention. A modality remote simulator system 10 according to the present invention is a system including a client terminal (virtual modality client) 11 and a server (virtual modality server) 13 connected via a network 12. An image storage (image storage means) 14 is connected to the server 13.

  This modality remote simulator system 10 is used using a client terminal 11. For example, when a distance education such as a modality operation method is performed, each participant uses a modality or a personal computer provided in a hospital where the employee works. At this time, if the modality specified in the distance learning is different, or if the specified modality is in use and cannot be used, the function as the client terminal 11 is provided on the modality used by each person or the personal computer. In addition, the software having the function as the client terminal 11 is installed.

  The central part of the modality remote simulator system 10 in which the server 13 exists is called a modality simulator area 15, and the modality simulator area 15 includes the server 13 and the image storage 14. This modality simulator area 15 is installed in an education center for educating the method of operating the modality and the diagnosis of the photographed image. Communication between the client terminal 11 and the server 13 is performed using SSL (Secure Socket Layer) or the like. In SSL, by encrypting communication performed between the server 13 and the client terminal 11, even if the communication is eavesdropped, the content is protected from being disclosed to a third party.

  The client terminal 11, the server 13, and the image storage 14 may be connected via the Internet. Further, the server 13 and the client terminal 11 may be systems connected by the same local area network, or may be systems connected by different local area networks and these local area networks are connected to each other.

  The client terminal 11 is a modality such as an X-ray imaging apparatus, an X-ray CT apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnostic apparatus, an ultrasonic diagnostic apparatus, or a personal computer. The client terminal 11 can provide a virtual function equivalent to a plurality of modalities with a single client terminal 11. For example, a virtual function equivalent to any of an X-ray imaging apparatus, an X-ray CT apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnostic apparatus, and an ultrasonic diagnostic apparatus can be selected using a single client terminal 11. it can.

  The client terminal 11 includes a user interface including an input device (operation means) 16 and a display monitor (display means) 17 and a screen control module (simulated display control means) 18. The screen control module 18 causes the display monitor 17 to perform a first display for guiding a plurality of modalities so that the user can specify a modality to be simulated. For example, an X-ray imaging apparatus, an X-ray CT apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnostic apparatus, and an ultrasonic diagnostic apparatus are displayed on the display monitor 17 and corresponding selection buttons are displayed.

  In addition, when the desired modality is designated by the first display and operation means 16, the screen control module 18 displays a second display for guiding the photographing condition for the designated modality so as to be designated. The specified modality and shooting conditions are sent to the server 13. For example, when the X-ray CT apparatus is designated as a modality by the operating means 16, a selection button for designating an imaging region and a selection button for designating a radiation dose are displayed as the second display. The user designates imaging conditions such as an imaging region and a radiation dose by a selection button, and the specified imaging conditions are sent to the server 13.

  Further, the screen control module 18 causes the display monitor 17 to perform a third display that guides the server 13 so that the conditions for processing the image acquired by the pseudo-imaging module 19 described later can be specified. The displayed image of the processing process is displayed on the display monitor 17. For example, a button for designating a tomographic image, a blood vessel image, a structure image, or the like as a processing condition is displayed on the display monitor 17. When any one of these buttons is designated, the server 13 responds accordingly. The image is processed, and an image in the process is displayed on the display monitor 17.

  The server 13 is connected to at least one client terminal 11 via the network 12, and includes a pseudo photographing module (pseudo photographing means) 19 that provides an image that has already been photographed without performing actual photographing, and image processing and analysis. An image processing / analysis module (processing means) 20 is provided. In response to the input from each client terminal 11, the server 13 acquires an image from the image storage 14, performs image processing and image analysis, and outputs the result to the client terminal 11.

  The pseudo photographing module 19 receives a modality and photographing condition designation from the client terminal 11 by the user, and acquires a photographed image that matches the designated modality and photographing condition from the image storage 14. At this time, the shooting conditions designated from the client terminal 11 are referred to as main shooting conditions. This main shooting condition corresponds to the “shooting condition” described in claims 1 to 5.

  The image processing / analysis module 20 receives a specification of conditions that can be processed by the specified modality from the client terminal 11, analyzes the captured image acquired by the pseudo-imaging module 19, processes based on the conditions, The image in the process is output to the client terminal 11. At this time, a condition designated from the client terminal 11 is referred to as a sub photographing condition. The sub imaging conditions are, for example, analysis / processing conditions for generating images such as tomographic images, blood vessel images, and structure images. This sub photographing condition corresponds to the “condition that can be processed with the specified modality” or “the condition that processes the image”.

  The image storage 14 exists in the modality simulator area 15 and holds a captured image corresponding to the modality and the shooting conditions (main shooting conditions) by the modality in advance. The main imaging conditions are conditions for controlling imaging units such as an X-ray irradiation unit and an ultrasonic transmission / reception unit, and are, for example, individual conditions such as an imaging region, radiation dose, magnetic field strength, or a combination thereof. . The image storage 14 stores images taken under the main shooting conditions for each modality.

  The server 13 receives the designation of the modality and the shooting conditions from the client terminal 11 by the user. The pseudo imaging module 19 acquires a captured image that matches the specified modality and imaging conditions from the image storage 14. The image processing / analysis module 20 sends the captured image acquired by the pseudo-imaging module 19 to the client terminal 11. The image processing / analysis module 20 receives a specification of conditions that can be processed by the specified modality from the client terminal 11, analyzes the captured image acquired by the pseudo-imaging module 19, processes based on the conditions, The image in the process is output to the client terminal 11.

Next, a series of operation flows will be described using the flowcharts of FIGS.
First, the user activates the modality remote simulator system 10 by using the client terminal 11 (step S11 in FIG. 2). Thereby, the screen control module 18 performs a first display for guiding a plurality of modalities on the display monitor 17 so that a modality to be simulated can be designated (step S12 in FIG. 2). Next, the user designates a desired modality through the client terminal 11 (step S13 in FIG. 2). The client terminal 11 starts communication with the server 13 and activates the pseudo imaging module 19 and the image processing / analysis module 20 of the server 13 (step S14 in FIG. 2). After confirming the activation of the pseudo imaging module 15 and the image processing / analysis module 20, the server 13 notifies the client terminal 11 of the activation completion (step S15 in FIG. 2). Upon receiving this notification, the screen control module 18 of the client terminal 11 displays a second display that guides the photographing conditions for the modality designated by the client terminal 11 so that the photographing conditions can be designated (step S16 in FIG. 2). Wait for the next input.

  The user inputs shooting conditions via the input device 16 on the screen of the display monitor 17 of the client terminal 11 and requests the start of shooting (step S17 in FIG. 2). The screen control module 18 of the client terminal 11 sends imaging conditions to the pseudo imaging module 19 of the server 13 (step S18 in FIG. 2).

  The pseudo image capturing module 19 of the server 13 acquires a captured image that matches the modality and the image capturing conditions from the image storage 14 (step S19 in FIG. 2 and transmits it to the screen control module 18 of the client terminal 11 (step S20 in FIG. 2). The screen control module 18 of the client terminal 11 arranges and displays the acquired image and data at an appropriate place on the screen of the display monitor 17 (step S21 in FIG. 2).

  Next, the user inputs image processing using the input device 16 of the client terminal 11 (step S22 in FIG. 3). The screen control module 18 of the client terminal 11 performs a third display for guiding the client terminal 11 to specify the conditions for processing the image acquired from the image storage 14 to the server 13 (step S23 in FIG. 3).

  When the user designates desired processing conditions using the client terminal 11 (step S24 in FIG. 3), the screen control module 18 of the client terminal 11 sends the input processing conditions to the image processing / analysis module 20 of the server 13 ( Step S25 in FIG.

  The image processing / analysis module 20 of the server 13 processes the captured image acquired from the image storage 14 based on the processing conditions sent (step S26 in FIG. 3). The image processing / analysis module 20 transmits the processed image to the screen control module 18 of the client terminal 11 (step S27 in FIG. 3). The screen control module 18 of the client terminal 11 arranges and displays the processed image and data at an appropriate place on the screen (step S28 in FIG. 3).

  When the user inputs the end of the system from the client terminal 11, the end of the module activated by the client terminal 11 is requested. After confirming that the necessary modules have been stopped, the server 13 notifies the client terminal 11 of completion. The client terminal 11 ends the communication with the server 13 and stops the screen control module 18.

  As described above, by using the modality remote simulator system according to the present invention, an experience as if the actual machine was operated and operated can be obtained.

[Second Embodiment]
FIG. 4 is a configuration diagram of a modality remote simulator system according to the second embodiment of the present invention. The modality remote simulator system 30 includes at least one client terminal 31 and a server 32 connected to the client terminal 31 via the network 12. The server 32 is connected to the image storage 14.

  The modality remote simulator system 30 according to the second embodiment uses the functions of the screen control module 18 provided in the client terminal 11 in the modality remote simulator system 10 according to the first embodiment as the screen control module of the server 32. 33. Accordingly, an input device information transmission module 34 and a reception screen display module 35 are provided in the client terminal 31, and an input device information reception module 36 and a screen information transmission module 37 are provided in the server 32.

  The functions of other constituent requirements, that is, the function of the pseudo-imaging module 19 of the server 32, the function of the image processing / analysis module 20, the function of the image storage 14, the function of the display monitor 17, and the function of the input device 16 are as follows. 1 is the same as that in the first embodiment, the same reference numerals as those in FIG. 1 are attached, description thereof is omitted, and the input device information in the client terminal 31 newly provided in the second embodiment. The transmission module 34, the reception screen display module 35, the input device information reception module 36 in the server 32, the screen information transmission module 37, and the screen control module 33 will be described.

  The input device information transmission module 34 transmits an input operation performed by the user (user) via the input device 16 to the input device information reception module 36 in the server 32. The reception screen display module 35 displays the screen received from the screen information transmission module 37 of the server 32 on the display monitor 17.

  The input device information receiving module 36 acquires user input device information from the input device information transmitting module 34 in the client terminal 31 and sends the information to the screen control module 33 in the server 32. The screen information transmission module 37 transmits the screen information transmitted from the screen control module 33 to the reception screen display module 35 of the client terminal 31.

  The screen control module 33 acquires information input from the input device 16 by the user from the input device information receiving module 36, and sends the input information to the pseudo imaging module 19 and the image processing / analysis module 20. Further, the screen control module 33 sends the screen information sent from the pseudo photographing module 19 and the screen information sent from the image processing / analysis module 20 to the screen information transmission module 37.

  Next, a series of operation flows will be described using the flowcharts of FIGS. First, the user activates the modality remote simulator system 30 by using the client terminal 31 (step S31 in FIG. 5). Thereby, the client terminal 31 starts communication with the server 32, and the screen control module 33, the input device information reception module 36, the screen information transmission module 37, the pseudo photographing module 19, and the image processing / analysis module 20 of the server 32 are connected. Start (step S32 in FIG. 5).

  The screen control module 33 sends information for causing the display monitor 17 of the client terminal 31 to perform a first display for guiding a plurality of modalities so that the user can specify a modality to be simulated, to the screen information transmission module 37 ( Step S33 in FIG. The screen information transmission module 34 sends the above information sent from the screen control module 33 to the reception screen display module 35 of the client terminal 31 (step S34 in FIG. 5). The reception screen display module 35 displays the information transmitted from the screen information transmission module 37 on the display monitor 17 (step S35 in FIG. 5).

  Next, the user designates a desired modality by using the input device 16 of the client terminal 31 (step S36 in FIG. 5). Information on the designated modality input from the input device 16 is sent to the input device information receiving module 36 of the server 32 by the input device information transmitting module 34 (step S37 in FIG. 5). The input device information receiving module 36 sends information on the sent modality designation to the screen control module 33 (step S38 in FIG. 5).

  Upon receiving this notification, the screen control module 33 sends to the screen information transmission module 37 information on the second display that guides the photographing conditions for the modality designated in the client terminal 31 (step S39 in FIG. 5). ). The screen information transmission module 37 sends the second display information to the reception screen display module 35 (step S40 in FIG. 6). The reception screen display module 35 performs the second display on the display monitor (step S41 in FIG. 6).

  The user inputs shooting conditions on the screen of the display monitor 17 of the client terminal 31 via the input device 16 and requests the start of shooting (step S42 in FIG. 6). The input device information transmission module 34 sends the imaging conditions to the input device information reception module 36 (step S43 in FIG. 6). The input device information receiving module 36 sends the sent shooting conditions to the screen control module 33 (step S44 in FIG. 6). The screen control module 33 sends imaging conditions to the pseudo imaging module 19 (step S45 in FIG. 6).

  The pseudo image capturing module 19 acquires a captured image that matches the modality and the image capturing conditions from the image storage 14 (step S46 in FIG. 6), and sends it to the screen control module 33 (step S47 in FIG. 6). The screen control module 33 sends the acquired image and data to the screen information transmission module 43 (step S48 in FIG. 6). The screen information transmission module 43 transmits the transmitted image and data to the reception screen display module 35 of the client terminal 31 (step S49 in FIG. 7). The reception screen display module 35 displays the transmitted image and data on the display monitor 17 (step S50 in FIG. 7).

  Next, the user inputs image processing using the input device 16 of the client terminal 31 (step S51 in FIG. 7). The input information for image processing is sent to the input device information transmission module 34 (step S52 in FIG. 7). The input device information transmitting module 34 sends information for performing the image processing to the input device information receiving module 36 of the server 32 (step S53 in FIG. 7). The input device information receiving module 36 sends the sent information for image processing to the screen control module 33 (step S54 in FIG. 7). The screen control module 33 sends to the screen information transmission module 37 third display information that guides the server 32 so that the conditions for processing the image acquired from the image storage 14 can be specified (step S55 in FIG. 7). The screen information transmission module 37 transmits the transmitted third display information to the reception screen display module 35 (step S56 in FIG. 7). The reception screen display module 35 displays the sent third display information on the display monitor 17 (step S57 in FIG. 7).

  When the user designates a desired processing condition by the client terminal 31 (step S58 in FIG. 8), the input device information transmission module 34 sends the processing condition to the input device information reception module 36 of the server 32 (step in FIG. 8). S59). The input device information receiving module 36 sends the processing conditions sent to the image processing / analysis module 20 (step S60 in FIG. 8).

  The image processing / analysis module 20 of the server 32 processes the captured image acquired from the image storage 14 based on the processing conditions sent (step S61 in FIG. 8). The image processing / analysis module 20 transmits the processed image to the screen control module 33 (step S62 in FIG. 8). The screen control module 33 sends the processed image to the screen information transmission module 37 (step S63 in FIG. 8). The screen information transmission module 37 sends the processed image to the reception screen display module 35 of the client terminal 31 (step S64 in FIG. 8). The reception screen display module 35 displays the sent processed image on the display monitor 17 (step S65 in FIG. 8).

  When the user inputs the end of the system from the client terminal 31, the end of the module activated by the client terminal 31 is requested. After confirming that the necessary modules have been stopped, the server 32 notifies the client terminal 31 of completion. The client terminal terminates communication with the server and stops the screen control module 41.

  As described above, in the modality remote simulator system according to the present invention, the user can simulate shooting of a desired modality and processing of the shot image on the terminal regardless of the existence of the modality as an actual machine. Thereby, distance education of various modalities can be performed.

It is a block diagram of the modality remote simulator system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 1st Embodiment of this invention. It is a block diagram of the modality remote simulator system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows a series of operation in the modality remote simulator system which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

10 Modality remote simulator system 11 Client terminal 12 Network 13 Server 14 Image storage (image storage means)
15 Modality simulator area 16 Input device (operation means)
17 Display monitor (display means)
18 Screen control module (simulated display control means)
19 Pseudo shooting module (pseudo shooting means)
20 Image processing / analysis module (processing means)

Claims (5)

In a simulator system comprising a client terminal and a server connected to the client terminal via a network,
The server
Image storage means for holding a photographed image corresponding to the modality and the photographing condition thereby;
In response to user designation of modality and shooting conditions from the client terminal,
Pseudo-imaging means for acquiring a captured image that matches the specified modality and the imaging condition;
While sending the captured image acquired by the pseudo imaging means to the client terminal,
In response to specification of conditions that can be processed with the specified modality from the client terminal, the captured image acquired by the pseudo imaging unit is analyzed, processed based on the conditions, and an image of the processing process is obtained. A modality remote simulator system comprising: processing means for outputting to the client terminal.   The client terminal has a user interface including an operation unit and a display unit, and causes the display unit to perform a first display for guiding a plurality of modalities so that a user can specify a modality to be simulated. When the desired modality is designated by the means, the second display for guiding the photographing condition for the designated modality is specified, and the designated modality and the photographing condition are sent to the server. And a third display for guiding the conditions for processing the image acquired by the pseudo photographing means to the server so that the conditions can be specified, and a simulated display control means for displaying the image of the processing process sent from the server. The modality remote simulator system according to claim 1, further comprising: The client terminal includes a user interface including an operation unit and a display unit,
The server causes the user interface of the client terminal to perform a first display for guiding a plurality of modalities so that a user can specify a modality to be simulated, and based on the first display by an operation unit. When a desired modality is designated, a second display that guides the photographing conditions for the designated modality is performed, and further, the conditions for processing the image acquired by the pseudo photographing means can be designated. The modality remote simulator system according to claim 1, further comprising a simulated display control unit that performs a third display for guidance and displays an image of a processing process. The modality is any one of an X-ray imaging apparatus, an X-ray CT apparatus, a magnetic resonance imaging apparatus, a nuclear medicine diagnostic apparatus, and an ultrasonic diagnostic apparatus,
The modality remote simulator system according to any one of claims 1 to 3, wherein the image storage means holds captured images of any one or all of the modalities. Causing the client terminal to perform a first display for guiding a plurality of modalities so that the user can specify a modality to be simulated;
A desired modality is specified by the client terminal;
Causing the client terminal to perform a second display for guiding the photographing conditions for the designated modality so as to be designated;
Sending the specified modality and the shooting conditions to a server;
Acquiring a photographed image that matches the modality and the photographing conditions from an image storage means and sending the photographed image to the client terminal, and displaying the photographed image on the client terminal;
Performing a third display on the client terminal for guiding the server to specify a condition for processing an image acquired from the image storage means;
A desired processing condition is designated by the client terminal;
Sending the specified processing conditions specified to the server;
Processing the captured image acquired from the image storage means by the server based on the processing conditions;
Sending an image processed based on the condition from the server to the client terminal and displaying the image on the client terminal;
A modality remote simulation method comprising:

Images