JP6448176B2 - Medical image sharing system, medical image sharing method, and medical image sharing program - Google Patents

Description

  The present invention provides a medical image sharing system, a medical image sharing method, and a medical image sharing system suitable for sharing a composite image among a plurality of client terminals, or sharing medical image information between an image collection device and the client terminal, and It relates to a medical image sharing program.

Conventionally, when a maintenance explanation or a device explanation is given to a device such as a medical device or a measurement device, the user side and the maker side are limited to using a telephone or FAX. For this reason, the quality of information sharing between the two was low and it was difficult to understand each other.
The reason for this is that there has been a restriction on an interface for extracting or acquiring information from a conventional medical device or measuring device.

  In Patent Document 1, as an ultrasonic diagnostic apparatus, an information display image for displaying an ultrasonic image and setting information and an input operation image for performing an input operation can be displayed on a display unit. In this case, an image of a setting button imitating a button for setting is displayed to prompt the user to input. When an external monitor is connected to the ultrasonic diagnostic apparatus, the same image as the display unit is displayed on the external monitor, the information display image is displayed on the external monitor, and the input operation image is displayed on the display unit. A technique is disclosed that can be switched between display and display.

  In Patent Document 2, as a medical image system and a first server, only a part of an image is extracted from a medical image, a JPEG image obtained by synthesizing an annotation image with a medical image subjected to image processing is generated, A technique is disclosed in which a data set associated with interpretation report information is transmitted to a distribution server.

JP 2010-142487 A JP 2010-055130 A

However, in the technique disclosed in Patent Document 1, an image of a setting button imitating a button is displayed to prompt the user to input. Since the position of the setting button in the image is not clearly shown, the user is forced to search for the setting button on the display screen, and in some cases, it takes time to search.
In the technique disclosed in Patent Document 2, each terminal shares a JPEG image unilaterally supplied from the server, and each terminal individually requests and acquires necessary information. There was a problem that I couldn't.

Therefore, it is anxious to provide a medical image sharing system in which setting buttons on the display screen can be easily searched and each terminal can individually request and acquire necessary information.
The present invention has been made in view of the above, and as its purpose, a composite image can be shared among a plurality of client terminals, or medical image information can be shared between an image collection device and a client terminal. The present invention provides a medical image sharing system, a medical image sharing method, and a medical image sharing program.

In order to solve the above problems, the invention according to claim 1 is an image data obtained by taking an image displayed on a display device of a medical device using a camera and A / D converting an image signal output from the camera. An image collecting device that generates image data obtained by generating A / D conversion of RGB signals output from the medical device or collecting medical image information that is image stream data based on the image data; A medical image sharing system for connecting a server connected to a collection device, the server and a plurality of client terminals via a network, and sharing information between the plurality of client terminals via the server; wherein the image acquisition device, the operation setting image information related to the operation and setting output from the medical device, the medical image information is image stream data Image processing and medical image information acquiring unit, on the basis of the client terminal information for performing image processing received via the server, to the medical image information is image stream data obtained from the medical device Tokusuru image processing means for performing, and transmitting means for transmitting the image stream data in which the medical image information and the image processing and the image processing result image information is image stream data obtained by the means to the server, the The server includes: transmission means for transmitting the image processing means of the image collection device received from the client terminal for image processing to the image collection device; and image stream data received from the image collection device. rolling is the medical image information, and the image processing result image information to the plurality of client terminals Comprising a transfer means, said client terminal, transmitting means for transmitting information for causing subjected to image processing in the image processing means of the image acquisition device to the server, the medical image is an image stream data from the server to Receiving means for receiving information and the image processing result image information, image synthesizing means for synthesizing the image processing result image with the medical image information which is image stream data received by the receiving means, and the image synthesizing means Display means for displaying a synthesized image synthesized by the above.

The present invention captures an image displayed on a display device of a medical device using a camera, generates image data obtained by A / D conversion of an image signal output from the camera, or RGB output from a medical device An image collection device that generates image data obtained by A / D converting a signal and collects medical image information that is image stream data based on the image data, a server connected to the image collection device , a server, and a plurality of client terminals Is a medical image sharing system in which information is shared between a plurality of client terminals via a server, and the image collection device is an operation related to operations and settings output from medical devices setting image information to obtain a medical image information is image stream data, the information for performing image processing received via the server from the client terminal Zui and performs image processing on the medical image information is image stream data obtained from the medical device, and transmits the medical image information and the image processing result image information obtained by image processing is image stream data to the server The server transmits information for causing the image processing unit of the image collection apparatus to perform image processing received from the client terminal to the image collection apparatus, and medical image information that is image stream data received from the image collection apparatus, and an image The processing result image information is transferred to a plurality of client terminals, and the client terminal transmits information for causing the image processing means of the image collection device to perform image processing to the server, and the medical image information which is image stream data from the server receives the image processing result image information, the image processing to the medical image information is received image stream data has been Results were synthesized image and displaying the combined composite image, it is possible to share a composite image among the plurality of client terminals.

1 is a block diagram showing a medical image sharing system 1 according to a first embodiment of the present invention. 2 is a diagram showing a main sequence performed via a network N. FIG. 4 is a diagram showing a display screen of a client terminal 30. FIG. It is a figure which shows an example of the medical image information containing the operation setting image information relevant to operation and a setting, and waveform image information displayed on the stream data area | region 68 shown in FIG. 4 is a flowchart showing an operation of medical image sharing application software in the client terminal 30. 4 is a flowchart showing an operation of medical image sharing software in the server 40. (A) (b) is a figure which shows a screen drawing sequence and a message transmission / reception sequence. It is a figure which shows an example of the image stream data displayed in the display image 36c. It is a figure which shows a waveform detection sequence. 4 is a flowchart for executing waveform detection processing in the image collection device 20. It is a figure which shows the example of drawing of a virtual line. It is a figure which shows an area measurement sequence. It is a flowchart for performing an area measurement process. It is a figure which shows an example of the closed loop 81 which shows an area. (A) is a figure which shows the mode before a process, (b) is a figure which shows the closed loop 68a which shows a desired area. It is a figure which shows a character search sequence. It is a flowchart for performing a character search process. It is a figure which shows that the image area | regions 85 and 86 which show the operation button and operation screen of a medical device were drawn. (A) is a figure which shows the image area | region 87 containing a character image, (b) is a figure which shows that frame image data was synthesize | combined and displayed in the stream data area | region 68. FIG. It is a figure which shows a pattern search sequence. It is a figure which shows an example of the image for a search. It is a flowchart for performing a pattern search process. It is a figure which shows that the frame image data 92 was drawn.

Embodiments of the present invention will be described with reference to the drawings.
<First Embodiment>
FIG. 1 is a block diagram showing a medical image sharing system 1 according to the first embodiment of the present invention.
As illustrated in FIG. 1, the medical image sharing system 1 of the first embodiment includes a medical device 10, an image collection device 20, client terminals 30 </ b> A and 30 </ b> B, a server 40, and a network N.
First, the configuration of the medical device 10 will be described with reference to FIG.
The medical device 10 can display operation information, waveform information, and image information on the internal monitor 11a, and an analog signal or a digital signal is output to an external output terminal such as a monitor terminal or an HDMI (registered trademark) terminal. Any device capable of outputting such as a blood purification device, an ultrasonic diagnostic device, an endoscope device, an RO device, etc. may be used. The medical device 10 outputs medical image information including operation setting image information and waveform image information related to operation and setting.

Next, the configuration of the image collection device 20 will be described with reference to FIG.
An image signal (analog signal) output from the medical device 10 is input to an A / D converter 21 provided in the image acquisition device 20.
In addition, a camera (medical image information acquisition unit) that captures an image displayed on the display device of the medical device 10 is provided, and an image signal of a display screen output from the camera is input to the A / D conversion unit 21. May be.

The A / D conversion unit 21 has three A / D converters, samples an image signal (RGB signal) output from the medical device 10 with a sampling clock and performs A / D conversion, thereby converting the digital signal. Convert to image data.
As described above, the operation setting image information and the medical image information displayed on the medical device can be acquired by photographing the image displayed on the display device of the medical device with the camera.

The image capturing unit 22 includes a frame memory, and sequentially captures image data into the frame memory in accordance with the frame rate of the image signal output from the medical device 10 and outputs the image data to the image encoder unit 23. If the image signal output from the medical device 10 is a digital signal, the image signal may be directly connected to the image capturing unit 22 via an HDMI (registered trademark) cable.
As described above, by directly acquiring the medical image information output from the medical device to the external output terminal, the operation setting image information and the medical image information can be acquired from the medical device.

The image encoder unit 23 includes a frame memory 23a that temporarily stores image data. The image data is encoded in accordance with H.264 / AVC to create moving image stream data, which is output to the stream transmission unit 24. The image encoder unit 23 outputs the image data temporarily stored in the frame memory 23a to the image processing unit 26.
The stream transmission unit 24 outputs the stream data output from the image encoder unit 23 to the communication processing unit 27.

The image processing unit 26 includes a CPU or DSP, a ROM that stores a plurality of types of image processing programs, and a memory 26a that temporarily stores image data. The image processing unit 26 executes image processing on the image data by causing the CPU or DSP to execute the image processing program designated from the client terminal 30 and outputs the processing result data to the communication processing unit 27.
The communication processing unit 27 adds a header to the image data output from the stream transmission unit 24 and the processing result data output from the image processing unit 26 to packetize them, and transmits them to the server 40 via the network N.

Next, the configuration of the client terminal 30 will be described with reference to FIG.
The control unit 31 includes an HDD, a ROM, a RAM, and a CPU. The control unit 31 reads an operating system OS from the HDD, expands the operating system on the RAM, starts the OS, and manages medical image sharing application software from the HDD under the OS management. (Medical image sharing program) is read and various processes are executed.
The communication processing unit 32 is connected to the image collection device 20 and the server 40 via the network N, and performs packet communication with these devices according to a communication protocol. The communication processing unit 32 outputs the image stream received from the server 40 to the image decoder unit 33. Further, the communication processing unit 32 outputs the image processing result data received from the image collection device 20 via the server 40 to the image composition unit 35a.

The image decoder unit 33 includes a frame memory 33a for temporarily storing image data, and an image stream output from the communication processing unit 32 is encoded with an H.264 format. H.264 / AVC is combined to generate image data and store it in the frame memory 33a. The image data is read out from the frame memory 33a every frame and output to the image composition unit 35a.
The image composition unit 35 a has a plurality of frame memories, synthesizes the image data and the image processing result data, and outputs the composite image data to the operation display control unit 35.
The operation display control unit 35 has a VRAM, writes the composite image data input from the image composition unit 35a to the VRAM, reads the composite image data from the VRAM at a video rate, and displays the display image 36c on the display unit 36a. The operation display control unit 35 is connected to the touch pad unit 36b, and outputs the coordinates (x, y) of the contact position of the fingertip when, for example, the fingertip contacts the touch pad unit 36b.

The operation display unit 36 includes a display unit 36a and a touch pad unit 36b.
A touch pad unit 36b having the same shape as the display screen is attached to the display screen of the display unit 36a. Specifically, in the touch pad portion 36b, a cover glass is disposed on the uppermost layer, and a film with a conductive film or a film with a pressure-sensitive resistance film is disposed on the lower surface. In the display unit 36a, a polarizing plate, a glass substrate, a color filter, a liquid crystal alignment film, a glass substrate, and a polarizing plate are arranged from the uppermost layer downward. In addition, below the display part 36a, it arrange | positions in order of the diffusion sheet, the light-guide plate which guides LED light to the whole plane, and a reflective film.
In the present embodiment, the position is expressed using (x, y) coordinates with respect to the plane on the touch pad unit 36b, while (X, Y) is displayed on the display screen on the display unit 36a. ) The position is expressed using coordinates, and x = X and y = Y for simplification of description.

Next, the configuration of the server 40 will be described with reference to FIG.
The control unit 41 includes a ROM (Read Only Memory), a RAM (Random Access Memory), a CPU (Central Processing Unit), and an HDD (Hard Disk Drive). The control unit 41 reads the operating system OS from the HDD and develops it on the RAM. And start the OS. Then, the control unit 41 reads application software (medical image sharing program) from the HDD under OS management, executes various processes, and controls each unit in the server 40.
The communication processing unit 42 communicates packet data with the image collection device 20 and the client terminal 30 via the network N.

The streaming monitoring processing unit 43 monitors the stream packet received by the communication processing unit 42 and monitors stream interruptions by monitoring time stamps and frames.
The shared object management unit 44 manages shared objects used in medical images. The shared object refers to information used in the medical image (for example, positioning image, shooting position, shooting range, shooting condition, image generation condition, client operation information (image position, text, quoted image), report information, etc.). In order to use it effectively, it is composed of image information and incidental (character or numerical value) information, and is generated and managed as an image according to the DICOM standard for each inspection or each series, for example.
Note that the shared object management unit 44 transfers medical image information and image processing result image information only to client terminals that are permitted to share information.
The message management unit 45 stores a message or comment received from the client terminal via the communication processing unit 42 in a message DB (not shown).

The user management processing unit 46 is connected to the user management DB 46a and has a function of performing an authentication process for a user who provides a data distribution service. In this user authentication process, the user information (for example, user ID and password) sent together with the login request from the client terminal 30 is compared with the user information of each user stored in the user management DB 46a in advance. Then, it is determined whether it is possible to provide a data distribution service to the user.
The history management processing unit 47 is connected to the history management DB 47a and updates the distribution history accumulated in the history management DB 47a every time the medical image stream data is distributed, or deletes unnecessary distribution history. I do.

Next, the main sequence performed via the network N will be described with reference to FIG.
First, in the client terminal 30, the medical image sharing application software icon is displayed on the display unit 36a. When the user's finger is touched with respect to the icon position displayed on the display screen, the touch pad unit 36b detects the touch and detects the touch position and outputs it to the operation display control unit 35. . The operation display control unit 35 outputs the touch position to the control unit 31. Further, the control unit 31 detects that this touch has clicked on the icon of the medical image sharing application software from the relationship between the touch position and the icon position. Thereby, the medical image sharing application software is expanded from the HDD to the RAM, and the medical image sharing application software is activated.

When the medical image sharing application software is activated, the browser software is also activated, and an activation instruction from the browser software is passed to the communication processing unit 32. The communication processing unit 32 generates a packet by adding a header to the activation command, and transmits the activation command to the server 40 indicated by the URL code.
The server 40 that has received the activation command from the client terminal 30 transmits the activation command to the image collection device 20.
The image collection device 20 that has received the activation command from the server 40 inputs operation setting image information related to the operation and setting output from the medical device 10 and medical image information including waveform image information.

The image acquisition apparatus 20 that has received medical image information from the medical device 10 converts the image signal into digital image data by sampling the image signal with a sampling clock and performing A / D conversion in the A / D conversion unit 21. Next, the image capturing unit 22 sequentially captures the image data in the frame memory in accordance with the frame rate of the image data, and outputs the image data to the image encoder unit 23.
Next, the image encoder unit 23 receives the encoding method H.264. The image data is encoded in accordance with H.264 / AVC to create moving image stream data, which is output to the stream transmission unit 24. Next, the stream transmission unit 24 outputs the image stream data output from the image encoder unit 23 to the communication processing unit 27.
Next, the communication processing unit 27 adds a header to the image stream data output from the stream transmission unit 24 and packetizes it, and transmits it to the server 40 via the network N.

The server 40 that has received the image stream data from the image collection device 20 transmits the image stream data to the client terminal 30.
As a result, the display image 36 c as shown in FIG. 3 is displayed on the display unit 36 a of the client terminal 30, and the image stream data is displayed in the stream data area 68.
Here, a display screen of the client terminal 30 will be described with reference to FIG.
The display image 36c includes a pen icon 61, an image search icon 62, a search icon 63, an area calculation tab 64, a message list area 65, a participant list area 66, a non-participating user list area 67, a stream data area 68, and an input room person. A display area 69 and a close icon 70 are displayed.
In the stream data area 68, medical image information including operation setting image information and waveform image information related to operation and setting as shown in FIG. 4 is displayed in real time.

Next, with reference to FIG. 5, a flowchart showing the operation of the medical image sharing application software in the client terminal 30 will be described.
In step S1, the control unit 31 operates the operation display control unit 35 to display a login screen on the display unit 36a. When an ID code and a password are input to the login screen, the process proceeds to step S55, and the input ID code And an inquiry request signal including a password is transmitted from the communication processing unit 32 to the server 40 via the network N.
When the server 40 authenticates the ID code and password, an authentication signal is returned from the server 40 to the client terminal 30, and the process proceeds to step S5.

Next, in step S5, the control unit 31 ends if there is a logout state (S5, Y). On the other hand, if there is no logout state (S5, N), the control unit 31 proceeds to steps S10 to S40.
Here, ID management is performed for the entrance monitoring (S10) for monitoring the presence or absence of a person entering the input room display area 69, the user selection monitoring (S15) for monitoring the user selection in the participant list area 66, and streaming. Tag monitoring for monitoring the tag information (S20), drawing monitoring for monitoring the drawing operation after touching the pen icon 61 (S25), search monitoring for monitoring the search processing after touching the search icon 63 (S30) In addition, measurement monitoring (S35) for monitoring the measurement state after touching the area calculation tab 64 and logout monitoring (S40) for monitoring the touch on the close icon 70 are simultaneously monitored.
Next, when there is a process that matches each monitoring result in steps S10 to S35, the process proceeds to step S45.

In step S45, when the operation information is input, the control unit 31 proceeds to step S55, and transmits a function inquiry request signal including the operation information from the communication processing unit 32 to the server 40 via the network N.
When the server 40 generates a response signal corresponding to the function inquiry request signal, the server 40 returns a response signal to the client terminal 30, and the process proceeds to step S50.
In step S50, when the operation information related to the operation by the user is input, the process proceeds to step S55, and the shared object operation information is transmitted from the communication processing unit 32 to the server 40 via the network N.
When the shared object operation information is confirmed in the server 40, an object operation confirmation signal is returned from the server 40 to the client terminal 30, and the process returns to step S5.

Next, with reference to FIG. 6, a flowchart showing the operation of the medical image sharing software in the server 40 will be described.
In step S101, the control unit 41 causes the streaming monitoring processing unit 43 to perform streaming monitoring processing. Here, the streaming monitoring processing unit 43 monitors the stream packet received by the communication processing unit 42 and monitors stream interruptions by monitoring time stamps and frames.
Next, in step S105, the control unit 41 causes the history management processing unit 47 to perform history management processing. Here, the history management processing unit 47 refers to the history management DB 47a, and updates the distribution history stored in the history management DB 47a every time the medical image stream data is distributed, and deletes unnecessary distribution history. Perform processing to do.

Next, in step S <b> 110, the control unit 41 acquires information received from the client terminal 30 from the communication processing unit 42.
Next, in step S115, the control unit 40 determines whether client operation information has been received. If there is no client operation information, the process proceeds to step S105. On the other hand, if the client operation information is login information, the process proceeds to step S120. When the client operation information is an information sharing operation, the process proceeds to step S125.
Next, in step S120, the control unit 40 causes the user management processing unit 46 to perform user management processing. Here, the user management processing unit 46 refers to the user management DB 46a to search whether the user ID and password of the logged-in user are registered in the user management DB 46a, and the user ID and / or password is inappropriate. In this case, an error message is returned to the client terminal. On the other hand, if appropriate, the process returns to step S101 to repeat the above processing. Note that a description of the new registration of the user is omitted.
Next, in step S125, the control unit 40 causes the shared object management unit 44 to perform shared object management. Here, the shared object management unit 44 manages the shared object used in the medical image.

Next, the screen drawing sequence will be described with reference to FIG.
Here, although not shown in the screen drawing sequence shown in FIG. 7A, the image stream data transmitted from the image collection device 20 is transmitted to the client terminals 30A and 30B via the server 40. And As a result, the display image 36c as shown in FIG. 8 is displayed on the display unit 36a of the client terminals 30A and 30B, and the image stream data is displayed in the stream data area 68.

First, in the client terminal 30A, when the user's finger is touched with respect to the position of the pen icon 61 displayed on the display screen, the process proceeds to drawing monitoring (S25) shown in FIG. When the operation information related to drawing is input (S45), the control unit 31 transmits a function inquiry request signal including the drawing operation information from the communication processing unit 32 to the server 40 via the network N (S50).
Here, in the client terminal 30A, when the user touches the touch pad unit 36b and draws a desired handwritten character or figure, the touch position of the touch panel unit 36b is tracked and detected, and the operation display control unit 35 receives the touch position data group. Is output. The operation display control unit 35 outputs the touch position data group to the image composition unit 35a, and the image composition unit 35a draws the touch position data group on the VRAM. Thereby, as shown in FIG. 8, for example, a rectangular figure 81a, an arrow 81b, and a handwritten character “coco” 81c are drawn and displayed on the display unit 36a.
On the other hand, the operation display control unit 35 outputs the touch position data group to the control unit 31. Then, the control unit 31 passes the touch position data group to the communication processing unit 32. The communication processing unit 32 generates a packet by adding a header to the touch position data group, and transmits the touch position data group as drawing coordinate information to the server 40 indicated by the URL code.

In the server 40 that has received the drawing coordinate information from the client terminal 30, the control unit 41 is currently connected, and the shared object management unit 44 checks the client terminal on the image sharing partner side. If it is confirmed by processing that the client terminal 30B is currently connected as a sharing partner, the drawing coordinate information is transmitted to the client terminal 30B.
As described above, the server transfers the medical image information and the image processing result image information only to the client terminals permitted to share the information, thereby combining the plurality of client terminals permitted to share the information. You can share images.

In the client terminal 30 </ b> B that has received the drawing coordinate information from the server 40, the control unit 31 outputs the drawing coordinate information to the operation display control unit 35. The operation display control unit 35 outputs the drawing coordinate information to the image synthesis unit 35a, and the image synthesis unit 35a draws the drawing coordinate information on the VRAM.
Thereby, as shown in FIG. 8, for example, a rectangular figure 81a, an arrow 81b, and a handwritten character “coco” 81c are drawn and displayed on the display unit 36a.
As a result, on the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, the drawn image handwritten by the client terminal 30A is also displayed on the client terminal 30B. For this reason, for example, handwritten characters and the like can be drawn at a desired location on a medical image and shared between terminals.

Next, a message transmission / reception sequence will be described with reference to FIG.
The screen drawing sequence shown in FIG. 7A shows a sequence in which the drawing coordinates are shared between the client terminals 30A and 30B when handwritten drawing is performed, but FIG. 7B shows a message transmission / reception sequence. Show. That is, in the client terminal 30 </ b> A, when a user's finger is touched with respect to the position of the dialogue icon 71 displayed on the display screen, a text message created using a keyboard (not shown) is displayed in the message list area 65. Once saved. Then, the client terminal 30A transmits a text message to the server 40, and the server 40 transmits the text message to the client terminal 30B.

  As a result, on the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, the text data input by the client terminal 30A is also displayed on the client terminal 30B. For this reason, for example, a text message sent from a user to a medical image can be shared between terminals.

In this way, an image collection device that collects medical image information output from a medical device, a server, and a plurality of client terminals are connected via a network, and information is transmitted between the plurality of client terminals via the server. A medical image sharing system for sharing, wherein an image collection device acquires operation setting image information and medical image information related to operations and settings output from a medical device (medical image information acquisition unit), and stores the medical image information as medical image information. The image processing is performed (image processing means), the medical image information and the image processing result image information obtained by the image processing are transmitted to the server, and the server receives the medical image information received from the image collection device and the image processing. The result image information is transferred to a plurality of client terminals (transfer means), and the client terminal receives the medical image information and the image processing result image information from the server. Receiving means), combined (image synthesizing means the image processing result image on the received medical image information), and displays the synthesized composite image (display means). Thereby, a composite image can be shared among a plurality of client terminals.
As a result, it is possible to perform maintenance explanations and equipment explanations by referring to composite images shared among multiple client terminals, and the quality of information sharing between them is extremely high, making it easy to understand each other Can be provided.

Second Embodiment
A medical image sharing system according to a second embodiment of the present invention will be described. The medical image sharing system according to the second embodiment is applied to the medical image sharing system 1 according to the first embodiment shown in FIG.
First, the waveform detection sequence will be described with reference to FIG.
Here, although not shown in the waveform detection sequence shown in FIG. 9, it is assumed that the image stream data transmitted from the image collection device 20 is transmitted to the client terminals 30 </ b> A and 30 </ b> B via the server 40. Accordingly, it is assumed that the display image 36c is displayed on the display unit 36a of the client terminals 30A and 30B, and the image stream data is displayed in the stream data area 68.

9, in the client terminal 30A, when the user's finger is touched with respect to the position of the pen icon 61 displayed on the display screen, the process proceeds to drawing monitoring (S25) shown in FIG. When the operation information related to the drawing of the virtual line is input (S45), the control unit 31 transmits a function inquiry request signal including the drawing operation information from the communication processing unit 32 to the server 40 via the network N (S50). ).
Here, in the client terminal 30 </ b> A, when the user touches the touch pad unit 36 b and draws a desired virtual line, the touch position of the touch panel unit 36 b is tracked and detected, and the touch position data group is output to the operation display control unit 35. To do. The operation display control unit 35 outputs the touch position data group to the image composition unit 35a, and the image composition unit 35a draws the touch position data group on the VRAM. Thereby, as shown in FIG. 11, for example, Line 1 and Line 2 are drawn as virtual lines and displayed on the display unit 36a.
On the other hand, the operation display control unit 35 outputs a touch position data group indicating a virtual line to the control unit 31. Then, the control unit 31 passes the touch position data group indicating the virtual line to the communication processing unit 32. The communication processing unit 32 generates a packet by adding a header to the touch position data group, and transmits the touch position data group indicating the virtual line to the server 40 indicated by the URL code as drawing coordinate information.

In the server 40 that has received the drawing coordinate information from the client terminal 30, the control unit 41 transmits the coordinate information of the waveform peak image area or the bottom peak image area indicated by the virtual line to the currently connected image collection device 20.
The image acquisition device 20 that has received the coordinate information of the waveform peak image area or the bottom peak image area indicated by the virtual line from the server 40 performs the intersection check, and the peak is obtained when the waveform image deviates from the range indicated by the virtual line. The value interval timing is transmitted to the server 40.
The server 40 that has received the interval timing from the image collection device 20 outputs the interval timing to the history management processing unit 47. The history management processing unit 47 stores the input interval timing in the history management DB 47a. Furthermore, the server 40 transmits the interval timing to the client terminal 30A.
In addition, when the shared object management unit 44 is checked with the client terminal on the image sharing partner side and it is confirmed that the client terminal 30B is currently connected as a sharing partner, this interval timing is transmitted to the client terminal 30B. To do.

  In the client terminal 30 </ b> B that has received the interval timing from the server 40, the control unit 31 outputs the interval timing to the operation display control unit 35. The operation display control unit 35 outputs the drawing coordinate information to the image synthesis unit 35a, and the image synthesis unit 35a draws the drawing coordinate information on the VRAM. Thereby, as shown in FIG. 11, for example, Line 1 and Line 2 are drawn as virtual lines and displayed on the display unit 36a.

As the interval timing, as shown in FIG. 11, a message “interval time () Sec” and a warning message image “warning: interval time is over” are combined and displayed in the stream data area 68.
As a result, on the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, the drawn images of Line1 and Line2 are also displayed on the client terminal 30B on the client terminal 30A. . For this reason, for example, a virtual line can be drawn on a medical image at a desired location and shared between terminals.

Next, a flowchart for executing the waveform detection process in the image collection device 20 will be described with reference to FIG.
The image acquisition device 20 that has received the coordinate information of the waveform peak image area or the bottom peak image area indicated by the virtual line from the server 40 outputs the waveform peak image area or the bottom peak image area from the communication processing unit 27 to the image processing unit 26. To do.
First, in step S151, the image processing unit 26 sets the waveform peak image area or the bottom peak image area by storing the waveform peak image area or the bottom peak image area as the threshold value 1 and the threshold value 2 in the memory 26a.
Next, in step S155, the image processing unit 26 captures an image from the image encoder unit 23 and writes it in the memory 26a.
Next, in step S160, the image processing unit 26 performs resizing processing of the image captured in the memory 26a, that is, reduction and enlargement of the image in the vertical direction and the horizontal direction.

Next, in step S165, the image processing unit 26 performs an image binarization process on the image (multivalued) subjected to the resizing process in the memory 26a, and outputs a binary image as a processing result to the memory 26a. Store in the area.
Next, in step S170, the image processing unit 26 performs a threshold determination process on the binary images stored in other areas of the memory 26a with reference to the thresholds 1 and 2. That is, in the threshold determination process, a collision determination process for determining whether a specific pixel (pixel) collides with the threshold 1 or the threshold 2 is performed.

Here, when it collides with the threshold value 1 or the threshold value 2 (S170, Y), it progresses to step S175 and performs an alert process. In the alert processing, an image “21: 01: 15/01/07/2013” is generated as time data together with messages “Line 1 over” and “Line 2 over” as the interval timing described above. In step S180, such interval timing is transmitted from the communication processing unit 27 to the server 40 as monitoring data.
In the alert process, a warning message image “warning: interval time is over setting” may be generated.
In step S185, end determination processing is performed. That is, when the end signal is transmitted from the server 40 to the image collection device 20 and the end signal is delivered from the communication processing unit 27 to the image processing unit 26, the processing is ended. On the other hand, when the waveform detection process is continued (S185, N), the process returns to step S155 and the above-described process is repeated.

  As described above, the image processing unit receives position information indicating the position of the waveform included in the waveform image information in the medical image information from the client terminal, and receives from the client terminal the waveform region included in the waveform image information. The set position information is set as at least one virtual line serving as a threshold, it is determined whether or not the waveform to be drawn deviates from the range indicated by the virtual line, and the waveform to be drawn is indicated by the virtual line An alarm is generated when the value deviates from the range (alarm generating means). Accordingly, at least one virtual line can be set according to an instruction from the client terminal, and a warning can be generated when the waveform to be drawn deviates from the range indicated by the virtual line. It can be confirmed by an alarm that the waveform deviates from the position (threshold). In addition to this, the virtual line similarly has a function of issuing an alarm when it deviates from the time pattern of the waveform by setting the interval timing of the peak value, and can detect an abnormal pattern.

In addition, the image processing result data is transmitted to the server, and the image processing result data (warning message) is transmitted to one or a plurality of client terminals via the server, so that a composite image (warning message) is transmitted between the plurality of client terminals. ) Can be shared. Further, medical image information can be shared between the image collection device and the client terminal.
As a result, it is possible to perform maintenance explanations and equipment explanations by referring to composite images shared among multiple client terminals, and the quality of information sharing between them is extremely high, making it easy to understand each other Can be provided.

<Third Embodiment>
A medical image sharing system according to a third embodiment of the present invention will be described. The medical image sharing system according to the third embodiment is applied to the medical image sharing system 1 according to the first embodiment shown in FIG.
First, the area measurement sequence will be described with reference to FIG.
Here, although not shown in the area measurement sequence illustrated in FIG. 12, it is assumed that the image stream data transmitted from the image collection device 20 is transmitted to the client terminals 30 </ b> A and 30 </ b> B via the server 40. Accordingly, it is assumed that the display image 36c is displayed on the display unit 36a of the client terminals 30A and 30B, and the image stream data is displayed in the stream data area 68.

In FIG. 12, in the client terminal 30A, when the user's finger is touched with respect to the position of the pen icon 61 displayed on the display screen, the process proceeds to drawing monitoring (S25) shown in FIG. When the operation information related to the drawing of the closed loop indicating the desired area specified by the pen is input (S45), the control unit 31 sends the function inquiry request signal including the drawing operation information from the communication processing unit 32 to the network N. To the server 40 (S50).
Here, in the client terminal 30A, when the user touches the touch pad unit 36b with a pen and draws a desired closed loop, the touch position of the touch panel unit 36b is tracked and detected, and the touch position data group is stored in the operation display control unit 35. Output. The operation display control unit 35 outputs the touch position data group to the image composition unit 35a, and the image composition unit 35a draws the touch position data group on the VRAM. Thereby, as shown in FIG. 14, for example, a closed loop 81 indicating a desired area is drawn and displayed on the display unit 36a. FIG. 15A is a diagram showing a state before processing. As shown in FIG. 15B, for example, a closed loop 68a indicating a desired area is drawn and displayed on the display unit 36a.

  On the other hand, the operation display control unit 35 outputs a touch position data group indicating a desired closed loop to the control unit 31. Then, the control unit 31 passes a touch position data group indicating a desired closed loop to the communication processing unit 32. The communication processing unit 32 adds a header to the touch position data group to generate a packet, and transmits the touch position data group indicating the desired closed loop to the server 40 indicated by the URL code as drawing coordinate information.

In the server 40 that has received the drawing coordinate information drawn by the pen from the client terminal 30, the control unit 41 transmits the coordinate information of the image range indicated by the desired closed loop to the currently connected image collection device 20.
The image collection device 20 that has received the coordinate information of the image range drawn by the pen from the server 40 searches for the number of pixels in the region, and transmits the pixel number data of the region to which the time data is added to the server 40.
The server 40 that has received the pixel count data of the area from the image collection device 20 outputs the pixel count data of the area to the history management processing unit 47. The history management processing unit 47 stores the pixel number data of the input area in the history management DB 47a. Furthermore, the server 40 transmits the number of pixels in the area to the client terminal 30A as area data.
The area is represented by dpi ² and, if the actual size of the medical image is represented, it is represented in mm.
Further, when the shared object management unit 44 is checked with the client terminal on the image sharing partner side and it is confirmed that the client terminal 30B is currently connected as a sharing partner, for example, this area data is transmitted to the client terminal 30B. To do.

In the client terminal 30 </ b> B that has received the area data from the server 40, the control unit 31 outputs the interval timing to the operation display control unit 35. The operation display control unit 35 outputs the drawing coordinate information to the image synthesis unit 35a, and the image synthesis unit 35a draws the drawing coordinate information on the VRAM. Thereby, as shown in FIG. 14, for example, a desired closed loop 81 is drawn and displayed on the display unit 36a.
As the area data, as shown in FIG. 14, an image in which the area data is converted into text is combined and displayed on the left side of the stream data area 68 in the display box in the area calculation tab 64.
As a result, on the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, a desired closed loop 81 drawing image is also displayed on the client terminal 30B. The For this reason, for example, a closed loop can be drawn at a desired location on a medical image and shared between terminals.

Next, a flowchart for executing the area measurement process will be described with reference to FIG.
Receiving the coordinate information drawn by the pen from the server 40, the image collection device 20 outputs the pen designation information and the closed region drawing instruction from the communication processing unit 27 to the image processing unit 26. On the other hand, the image processing unit 26 captures an image from the image encoder unit 23 and writes it in the memory 26a.
First, in step S201, the image processing unit 26 sets that a pen is designated.
Next, in step S205, the image processing unit 26 draws a closed region on the image written in the memory 26a according to the received drawing coordinate information. It is preferable that the closed region is formed by overlapping the end of the drawn pen locus with the start point.

Therefore, in step S210, the image processing unit 26 determines whether the end and the start point of the pen locus drawn in the memory 26a are not in the closed region. If the end of the pen locus and the start point are not in the closed region (S210, Y), the process proceeds to step S215.
Next, in step S215, the image processing unit 26 forms a closed region by connecting the end of the pen locus and the start point.
Next, in step S220, the image processing unit 26 calculates the number of pixels in the closed region drawn in the memory 26a.
In step S225, the image processing unit 26 converts the number of pixels into a text message, converts the text message into stream data, and outputs the stream data to the communication processing unit 27.
As a result, as shown in FIG. 14, an image in which the area data is converted into text is synthesized and displayed on the left side of the stream data area 68 in the display box in the area calculation tab 64.

In this way, the image processing unit receives the specified range information that specifies the range of the image information in the medical image information from the client terminal, and the medical image information included in the range indicated by the specified range information received from the client terminal. An area is calculated from the number of pixels (area calculation means). Thereby, the area of the range designated from the client terminal can be calculated, and the area can be confirmed in the client terminal.
Also, by transmitting the image processing result data to the server and transmitting the image processing result data (area) to one or a plurality of client terminals via the server, the composite image is shared among the plurality of client terminals. Medical image information can be shared between the image collection device and the client terminal.
As a result, it is possible to perform maintenance explanations and equipment explanations by referring to composite images shared among multiple client terminals, and the quality of information sharing between them is extremely high, making it easy to understand each other Can be provided.

<Fourth embodiment>
A medical image sharing system according to a fourth embodiment of the present invention will be described. The medical image sharing system according to the fourth embodiment is applied to the medical image sharing system 1 according to the first embodiment shown in FIG.
First, a character search sequence will be described with reference to FIG.
Here, although not shown in the character search sequence shown in FIG. 12, it is assumed that the image stream data transmitted from the image collection device 20 is transmitted to the client terminals 30 </ b> A and 30 </ b> B via the server 40. Accordingly, it is assumed that the display image 36c is displayed on the display unit 36a of the client terminals 30A and 30B, and the image stream data is displayed in the stream data area 68.

16, in the client terminal 30A, when the user's finger is touched with respect to the position of the search icon 63 displayed on the display screen, the process proceeds to search monitoring (S30) shown in FIG. When the desired character string information as a candidate is input from the keyboard following the touch on the search icon 63 (S45), the control unit 31 sends a function inquiry request signal including drawing operation information to the communication processing unit 32. To the server 40 via the network N (S50).
Here, in the client terminal 30A, as shown in FIG. 18, for example, “V_Level □ up” and “V_Level □ down” are drawn as image areas 85 and 86 indicating operation buttons and operation screens of medical devices together with a waveform image, for example. The displayed image is displayed in the stream data area 68. Further, as shown in FIG. 19A, for example, an image area 87 including a character image “ABCD...” Is displayed as a display image 36c.

  On the other hand, the operation display control unit 35 outputs search character data indicating a search request and a desired candidate character string to the control unit 31. Then, the control unit 31 passes desired search character data to the communication processing unit 32. The communication processing unit 32 adds a header to the search character data to generate a packet, and transmits the desired search character data to the server 40 indicated by the URL code.

In the server 40 that has received the search character data from the client terminal 30, the control unit 41 transmits the character string data to the currently connected image collection device 20.
The image collection device 20 that has received the character string data from the server 40 performs character determination from the medical image in the screen, and transmits True character position data to the server 40 when the character strings match.
The server 40 that has received the True character position data from the image collection device 20 outputs the True character position data to the history management processing unit 47. The history management processing unit 47 stores the input True character position data in the history management DB 47a.

Further, the server 40 draws the frame image data 88 indicating the character range in a rectangular shape based on the True character position data, and transmits the frame image data to the client terminal 30A.
Also, when the shared object management unit 44 is checked with the client terminal on the image sharing partner side and it is confirmed that the client terminal 30B is currently connected as a sharing partner, for example, this frame image data is sent to the client terminal 30B. Send.

In the client terminal 30 </ b> B that has received the frame image data from the server 40, the control unit 31 outputs the frame image data to the operation display control unit 35. The operation display control unit 35 outputs the frame image data to the image composition unit 35a, and the image composition unit 35a draws the frame image data on the VRAM. Thereby, as shown in FIG. 19, for example, frame image data 88 surrounding the operation button “XYZ...” Is drawn and displayed on the display unit 36a.
As the frame image data, the frame image data 88 is synthesized and displayed in the stream data area 68 as shown in FIG.
As a result, on the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, the frame image data including a desired character string is combined with the stream data on the client terminal 30A. Are also displayed on the client terminal 30B. For this reason, for example, frame image data including a desired character string can be drawn on a medical image and shared between terminals.

Next, a flowchart for executing the character search process will be described with reference to FIG.
The image collection device 20 that has received the character string data from the server 40 outputs the character string data from the communication processing unit 27 to the image processing unit 26. The image processing unit 26 stores the character string data in the memory 26a.
First, in step S251, the image processing unit 26 captures an image from the image encoder unit 23 and writes it in the memory 26a.
Next, in step S255, the image processing unit 26 performs an image binarization process on the image (multi-value) captured in the memory 26a, and stores the binary image as a processing result in another area of the memory 26a. Remember. Here, as for the coordinates of the binary image stored in the memory 26a, the xy coordinates of the upper left corner are treated as (0, 0) as the origin, and the xy coordinates of the lower right corner are treated as (x _e , y _e ). To do.

Next, in step S260, the image processing unit 26 moves one pixel in the horizontal (x) direction from the origin with respect to the binary image stored in the memory 26a.
Next, in step S <b> 265, the image processing unit 26 determines whether a linear pixel indicating that there are valid pixels continuously in the horizontal direction has been found.
When there is no linear pixel (S265, N), the process proceeds to step S270, and the image processing unit 26 determines whether it is the end of the X shift (x _e ). If it is not the end (x _e ) of the X shift (S270, N), the process returns to step S260 and the above-described processing is repeated.
On the other hand, if it is the end (x _e ) of the X shift (S270, Y), the process proceeds to step S275, the image processing unit 26 moves one pixel in the vertical (Y) direction, returns to step S260, and performs the above-described processing. repeat.

On the other hand, when a linear pixel is found (S265, Y), the process proceeds to step S280, and linear clustering processing is performed. That is, in the linear clustering process, the region division can be performed based on the position information.
Next, in step S285, the image processing unit 26 performs character recognition processing using a known OCR determination device.
Next, in step S290, the image processing unit 26 stores the MaxSquare e value of the XY coordinates of the single character in the memory 26a.
Next, in step S295, the image processing unit 26 stores the character string (set as long as continuous characters are found) in the memory 26a.
Next, in step S300, the image processing unit 26 determines whether or not the MaxSquar value is different from the previous value.

If the MaxSquar value is different from the previous value (S300, Y), the process proceeds to step S305, and the image processing unit 26 updates the MaxSquar value and stores it in the memory 26a.
Next, in step S310, the image processing unit 26 performs a labeling process on the continuous characters, assigns a label #k in association with the continuous characters, returns to step S260, and repeats the above-described processing.
On the other hand, when the MaxSquar value is the same as the previous value (S300, N), the process returns to step S260 and the above-described processing is repeated.

  As described above, the image processing unit receives the specified range information indicating the range of the character information included in the medical image information from the client terminal, and adds the medical image information included in the range indicated by the specified range information received from the client terminal. On the other hand, the area of the first character is detected, the area of the character string existing adjacent to the detected one character area is detected, and the detected character area information is analyzed by the OCR discriminator (character Column search means). Thereby, the character contained in the image of the range designated from the client terminal can be analyzed, and the client terminal can confirm the character.

Further, the image processing result data (characters) is transmitted to the server, and the image processing result data is transmitted to one or a plurality of client terminals via the server. Thereby, a composite image can be shared among a plurality of client terminals, and medical image information can be shared between the image collection device and the client terminal.
As a result, it is possible to perform maintenance explanations and equipment explanations by referring to composite images shared among multiple client terminals, and the quality of information sharing between them is extremely high, making it easy to understand each other Can be provided.

<Fifth Embodiment>
A medical image sharing system according to a fifth embodiment of the present invention will be described. The medical image sharing system according to the fifth embodiment is applied to the medical image sharing system 1 according to the first embodiment shown in FIG.
First, the pattern search sequence will be described with reference to FIG.
Here, although not shown in the pattern search sequence shown in FIG. 20, it is assumed that the image stream data transmitted from the image collection device 20 is transmitted to the client terminals 30 </ b> A and 30 </ b> B via the server 40. Accordingly, it is assumed that the display image 36c is displayed on the display unit 36a of the client terminals 30A and 30B, and the image stream data is displayed in the stream data area 68.

20, in the client terminal 30A, when the user's finger is touched with respect to the position of the search icon 63 displayed on the display screen, the process proceeds to search monitoring (S30) shown in FIG. Then, when a desired search image associated with the touch of the search icon 63 is input by, for example, a drag operation or a keyboard (S45), the control unit 31 performs communication processing of a function inquiry request signal including drawing operation information. The data is transmitted from the unit 32 to the server 40 via the network N (S50).
Here, in the client terminal 30A, as shown in FIG. 21, for example, an operation button of a medical device or a search image 91 indicating a partial shape of the operation screen is drawn and displayed as a display image 36c. FIG. 21 shows a state where the search image “0.0 kV” is displayed.

  On the other hand, the operation display control unit 35 outputs a search instruction and search image data to the control unit 31. Then, the control unit 31 passes the search instruction and the search image data to the communication processing unit 32. The communication processing unit 32 generates a packet by adding a header to the search instruction and the search image data, and transmits the search instruction and the search image data to the server 40 indicated by the URL code.

In the server 40 that has received the search instruction and the search image data from the client terminal 30, the control unit 41 transmits the search instruction and the search image data to the currently connected image collection device 20.
The image collection device 20 that has received the search instruction and the search image data from the server 40 performs pattern matching processing with the medical image in the screen with reference to the search image data, and the True coordinate position where the square error shows the minimum value Data is transmitted to the server 40.

The server 40 that has received the True coordinate position data from the image collection device 20 outputs the True coordinate position data to the history management processing unit 47. The history management processing unit 47 stores the input True coordinate position data in the history management DB 47a. Further, the server 40 draws the frame image data 88 indicating the character range in a rectangle based on the True coordinate position data, and transmits the frame image data to the client terminal 30A.
Also, when the shared object management unit 44 is checked with the client terminal on the image sharing partner side and it is confirmed that the client terminal 30B is currently connected as a sharing partner, for example, this frame image data is sent to the client terminal 30B. Send.

In the client terminal 30 </ b> B that has received the frame image data from the server 40, the control unit 31 outputs the frame image data to the operation display control unit 35. The operation display control unit 35 outputs the frame image data to the image composition unit 35a, and the image composition unit 35a draws the frame image data on the VRAM. Thereby, as shown in FIG. 23, for example, the frame image data 92 is drawn and displayed on the display unit 36a.
As the frame image data, as shown in FIG. 23, the frame image data 92 is combined in the stream data area 68, and the frame image data 92 is displayed together with “0.0 kV”.

  As a result, in the display screen of the image stream data transmitted from the image collection device 20 to the client terminals 30A and 30B via the server 40, the frame image data including the desired search image is combined with the stream data on the client terminal 30A. And displayed on the client terminal 30B. Therefore, for example, frame image data including a desired search image can be drawn on a medical image and shared between terminals.

Next, with reference to FIG. 22, a flowchart for executing the pattern search process will be described.
The image collection device 20 that has received the search instruction and the search image data from the server 40 outputs the search instruction and the search image data from the communication processing unit 27 to the image processing unit 26. The image processing unit 26 stores a search instruction and search image data in the memory 26a.
First, the image processing unit 26 captures an image from the image encoder unit 23 and writes it into the memory 26a.
Next, in step S351, the image processing unit 26 uses the coordinates of the image stored in the memory 26a as the origin with the xy coordinates of the upper left corner as (0, 0) and the xy coordinates of the lower right corner as (x _e , y _e ), and discovery ranges (0, 0) to (x _e , y _e ) are defined.
Next, in step S355, the image processing unit 26 at a specific position with respect to the search image data stored in the memory 26a within a range from the origin (0, 0) to (x _e , y _e ). The square error is calculated, label #k is updated and added to the calculated square error data each time, and stored in the memory 26a.

Next, in step S360, the image processing unit 26 calculates a square error for each of the RGB images while considering the rotation for the search image data stored in the memory 26a, and calculates the square after the calculation. Label #k _RGB is updated and added to the error data each time and stored in the memory 26a.
Next, in step S365, the image processing unit 26 moves the specific position by one pixel within the discovery range in order to perform a search within the region pixels within the discovery range (0, 0) to (x _e , y _e ). Returning to step S355, the above-described processing is repeated.
In step S370, the image processing unit 26 reads the currently calculated square error Diff from the memory 26a, and temporarily sets the smaller square error Diff as the latest least square error minDiff.
The image processing unit 26 determines whether or not the square error sDiff is smaller than the least square error minDiff.

sDiff <minDiff
Here, when the square error sDiff is smaller than the minimum square error minDiff (S370, Y), the process proceeds to step S375, the position where the square error sDiff = the minimum square error minDiff is specified, and the coordinate range (x _sk , y _sk ) to (x _ek , y _ek ) are stored.
On the other hand, when the square error sDiff is not smaller than the minimum square error minDiff (S370, N), the process proceeds to step S380, and the square error corresponding to the number of scales within the discovery range (0, 0) to (x _e , y _e ). In order to repeat the calculation, the process returns to step S351 to repeat the above-described processing.
By this iterative process, the least square error minDiff calculated in step S370 is gradually replaced with a smaller value.
When the repetitive processing in step S380 is completed, the process proceeds to step S385, determines the minimum value of the square error, the coordinate range from the memory _{26a (x sk, y sk)} ~ (x ek, y ek) read out.

  In this way, the image processing unit receives the image pattern from the client terminal, expands the medical image information on the two-dimensional plane, moves the region within the discovery range on the two-dimensional plane, and is received from the client terminal A square error between the image pattern and the image information in the region is calculated and stored, and the image information that minimizes the stored square error is determined as an image pattern (template analysis unit). Thereby, the position of the image information closest to the image pattern specified from the client terminal can be determined, and the position of the image information closest to the specified image pattern can be confirmed at the client terminal.

Also, the image processing result data is transmitted to the server, and the image processing result data (position of image information) is transmitted to one or a plurality of client terminals via the server, so that a composite image can be obtained between the plurality of client terminals. Can be shared. Further, medical image information can be shared between the image collection device and the client terminal.
As a result, it is possible to perform maintenance explanations and equipment explanations by referring to composite images shared among multiple client terminals, and the quality of information sharing between them is extremely high, making it easy to understand each other Can be provided.

<Other embodiments>
In the first to fifth embodiments described above, as shown in FIG. 1, an image collection device 20 that collects medical image information output from the medical device 10, a server 40, and a plurality of client terminals 30. The medical image sharing system 1 has been described, in which information is shared between the plurality of client terminals 30 via the server 40.
However, the present invention is not limited to such a system configuration.
That is, as another embodiment, the image collection device 20 that collects medical image information output from the medical device 10, the server 40, and the client terminal 30 are connected via the network N, and the image is obtained via the server 40. It may be a medical image sharing system that shares information between the collection device 20 and the client terminal 30.

Specifically, in the image collection device 20, a display control unit (not shown) having a VRAM that sequentially stores images captured by the image capture unit 22, and an image read from the VRAM of the display control unit at a frame rate are displayed. Provide a monitor. Further, the display control unit is configured to provide an image combining unit that combines the medical image information and the image processing result image information.
In the image collection device 20, when instruction information related to image processing for medical image information is received from the client terminal 30 via the communication processing unit 27, the image processing unit 26 performs image processing based on this instruction information, The image processing unit 26 outputs image processing result image information to an image composition unit provided in the display control unit. Then, the medical image information and the image processing result image information are combined by the image combining unit and output to the monitor.

In this way, an image collection device that collects medical image information output from a medical device, a server, and a client terminal are connected via a network, and information is transmitted between the image collection device and the client terminal via the server. The image collection device acquires operation setting image information and medical image information related to operations and settings output from a medical device (medical image information acquisition unit), and medical image information Is subjected to image processing (image processing means), and medical image information and image processing result image information obtained by the image processing are transmitted to the server (transmission means). The server receives the medical image received from the image collection device Information and image processing result image information are transferred to the client terminal (transfer means), and the client terminal receives medical image information and image processing result image information from the server. Receive (reception means), combined (image synthesizing means) the image processing result image on the received medical image information, and displays the synthesized composite image (display means). Thereby, medical image information can be shared between the image collection device and the client terminal.
As a result, it is possible to explain maintenance and equipment by referring to the composite image shared between the image collection device and the client terminal, and the quality of information sharing between the two is extremely high, and mutual understanding is possible. An easy situation can be provided.

  DESCRIPTION OF SYMBOLS 1 ... Medical image sharing system, 10 ... Medical equipment, 20 ... Image collection device, 21 ... A / D conversion part, 22 ... Image capture part, 23 ... Image encoder part, 24 ... Stream transmission part, 26 ... Image processing part 27 ... Communication processing unit, 30 ... Client terminal, 31 ... Control unit, 33 ... Image decoder unit, 35 ... Operation display control unit, 36 ... Operation display unit, 40 ... Server, 43 ... Streaming monitoring processing unit, 44 ... Sharing Object management unit 45 ... Message management unit 46 ... User management processing unit 46 ... User management DB 47 ... History management processing unit 47 ... History management DB

Claims (13)

An image displayed on a display device of a medical device is photographed using a camera, image data output from the camera is A / D converted, or RGB signals output from the medical device are generated. An image collection device that generates A / D converted image data and collects medical image information that is image stream data based on the image data, a server connected to the image collection device, the server, and a plurality of clients A medical image sharing system for connecting a terminal via a network and sharing information between the plurality of client terminals via the server,
The image collecting device includes:
Operation setting image information related to operation and setting output from the medical device, medical image information acquisition means for acquiring the medical image information which is image stream data ;
Image processing means for performing image processing on the medical image information, which is image stream data acquired from the medical device, based on information for performing image processing received from the client terminal via the server;
And said image processing result image information is image stream data obtained by the image processing means and the medical image information is image stream data and transmitting means for transmitting to said server,
The server
Transmitting means for transmitting to the image collecting apparatus information for causing the image processing means of the image collecting apparatus received from the client terminal to perform image processing;
Transfer means for transferring the medical image information, which is image stream data received from the image collection device, and image processing result image information to the plurality of client terminals;
The client terminal is
Transmitting means for transmitting information for causing the image processing means of the image collecting apparatus to perform image processing to the server;
Receiving means for receiving the medical image information which is image stream data and the image processing result image information from the server;
Image combining means for combining the image processing result image with the medical image information that is image stream data received by the receiving means;
Display means for displaying a composite image synthesized by the image composition means;
A medical image sharing system comprising: An image displayed on a display device of a medical device is photographed using a camera, image data output from the camera is A / D converted, or RGB signals output from the medical device are generated. An image collection device that generates A / D converted image data and collects medical image information that is image stream data based on the image data, a server connected to the image collection device, the server and a client terminal A medical image sharing system for connecting information via a network and sharing information between the image collection device and the client terminal via the server,
The image collecting device includes:
Operation setting image information related to operation and setting output from the medical device, medical image information acquisition means for acquiring the medical image information which is image stream data ;
Image processing means for performing image processing on the medical image information, which is image stream data acquired from the medical device, based on information for performing image processing received from the client terminal via the server;
And said image processing result image information is image stream data obtained by the image processing means and the medical image information is image stream data and transmitting means for transmitting to said server,
The server
Transmitting means for transmitting to the image collecting apparatus information for causing the image processing means of the image collecting apparatus, which is image stream data received from the client terminal, to perform image processing;
Transfer means for transferring the medical image information, which is image stream data received from the image collection device, and image processing result image information to the client terminal;
The client terminal is
Transmitting means for transmitting information for causing the image processing means of the image collecting apparatus to perform image processing to the server;
Receiving means for receiving the medical image information which is image stream data and the image processing result image information from the server;
Image combining means for combining the image processing result image with the medical image information that is image stream data received by the receiving means;
A medical image sharing system comprising: display means for displaying a composite image synthesized by the image synthesis means. The medical image information acquisition means includes
The medical image sharing system according to claim 1, wherein the medical image sharing system is a camera that captures an image displayed on a display device of the medical device. The medical image information acquisition means includes
The medical image sharing system according to claim 1, wherein the medical image information output from the medical device to an external output terminal is acquired. The image processing means includes
Receiving means for receiving position information indicating the position of the waveform included in the waveform image information in the medical image information from the client terminal via the server;
For the waveform area included in the waveform image information, the position information received by the receiving means is set as at least one virtual line serving as a threshold, and the waveform to be drawn deviates from the range indicated by the virtual line. Waveform analysis means for determining whether or not,
The medical image sharing system according to claim 1, further comprising alarm generation means for generating an alarm when the waveform to be drawn deviates from a range indicated by the virtual line. The image processing means includes
Receiving means for receiving designated range information for designating a range of image information in the medical image information from the client terminal via the server;
The medical image according to claim 1, further comprising: an area calculating unit that calculates an area from the number of pixels of the medical image information included in the range indicated by the specified range information received by the receiving unit. Shared system. The image processing means includes
Receiving means for receiving designated range information indicating a range of character information included in the medical image information from the client terminal via the server;
For the medical image information included in the range indicated by the specified range information received by the receiving means, a first character region is detected, and a character string region existing adjacent to the detected one character region is detected. The medical image sharing system according to claim 1, further comprising: a character string search unit configured to detect and perform character analysis on the detected character region information with an OCR determiner. The image processing means includes
Receiving means for receiving an image pattern from the client terminal via the server;
The medical image information is developed on a two-dimensional plane, an area within the discovery range on the two-dimensional plane is moved, and a square error between the image pattern received by the receiving means and the image information in the area is calculated. The medical image sharing system according to claim 1, further comprising: template analysis means for determining the stored image information that minimizes the stored square error as the image pattern. The server transfer means includes:
3. The medical image sharing system according to claim 1, wherein the medical image information and the image processing result image information are transferred only to a client terminal permitted to share information. An image displayed on a display device of a medical device is photographed using a camera, image data output from the camera is A / D converted, or RGB signals output from the medical device are generated. An image collection device that generates A / D converted image data and collects medical image information that is image stream data based on the image data, a server connected to the image collection device, the server, and a plurality of clients A medical image sharing method in a medical image sharing system for connecting a terminal via a network and sharing information between the plurality of client terminals via the server,
The image collecting device includes:
Medical image information acquisition step for acquiring operation setting image information related to operation and setting output from the medical device , the medical image information which is image stream data ,
An image processing step of performing image processing on the medical image information, which is image stream data acquired from the medical device, based on information for performing image processing received from the client terminal via the server;
And a transmission step of transmitting said an image stream data obtained by the image processing step and the medical image information is image stream data image processing result and the image information to the server,
The server
A transmission step of transmitting information for performing image processing to the image processing step of the image collection device received from the client terminal to the image collection device;
A transfer step of transferring the medical image information, which is image stream data received from the image collection device, and image processing result image information to the plurality of client terminals;
The client terminal is
A transmission step of transmitting information for performing image processing to the image processing step of the image collection device to the server;
Receiving the medical image information which is image stream data and the image processing result image information from the server;
An image synthesis step of synthesizing the image processing result image with the medical image information which is the image stream data received by the reception step;
A medical image sharing method comprising: a display step of displaying the composite image synthesized by the image synthesis step. An image displayed on a display device of a medical device is photographed using a camera, image data output from the camera is A / D converted, or RGB signals output from the medical device are generated. An image collection device that generates A / D converted image data and collects medical image information that is image stream data based on the image data, a server connected to the image collection device, the server and a client terminal A medical image sharing method in a medical image sharing system for sharing information between the image collection device and the client terminal via the server,
The image collecting device includes:
Medical image information acquisition step for acquiring operation setting image information related to operation and setting output from the medical device , the medical image information which is image stream data ,
An image processing step of performing image processing on the medical image information, which is image stream data acquired from the medical device, based on information for performing image processing received from the client terminal via the server;
And a transmission step of transmitting said an image stream data obtained by the image processing step and the medical image information is image stream data image processing result and the image information to the server,
The server
A transmission step of transmitting information for performing image processing to the image processing step of the image collection device, which is image stream data received from the client terminal, to the image collection device;
A transfer step of transferring the medical image information, which is image stream data received from the image collection device, and image processing result image information to the client terminal;
The client terminal is
A transmission step of transmitting information for performing image processing to the image processing step of the image collection device to the server;
Receiving the medical image information which is image stream data and the image processing result image information from the server;
An image synthesis step of synthesizing the image processing result image with the medical image information which is the image stream data received by the reception step;
A medical image sharing method comprising: a display step of displaying the composite image synthesized by the image synthesis step.   12. The medical image sharing program according to claim 10, wherein the image collecting apparatus causes a processor to execute each step.   12. The medical image sharing program according to claim 10, wherein the client terminal causes a processor to execute each step.

Images