JP6352503B2 - Medical video display system - Google Patents

Description

  The present invention relates to a medical moving image display system.

In recent years, in surgical operations such as endoscopic surgery, not only the affected part is directly viewed, but also a moving image captured by an imaging device attached to a medical device is displayed on a monitor and the moving image is viewed. There are many techniques.
In such a surgical operation, there may be a plurality of modes of imaging the affected part. In such a case, it is necessary to appropriately switch the moving image output to the monitor. In addition, a moving image captured in such a surgical operation may be recorded and used for clinical research or the like.
Examples of this type of technology include Patent Document 1 and Patent Document 2 below.

  Patent Document 1 describes an apparatus having a matrix switch that selects and switches video signals and an on-screen controller that superimposes title signals such as characters and graphics on the selected video signals. Specifically, this apparatus is characterized in that the selection and switching of the matrix switch and the display switching of the on-screen controller are performed simultaneously.

  Patent Document 2 describes a video system used in a surgical operation, in which an endoscope video signal and an ultrasonic video signal are reproduced and displayed on different monitors or recorded on a recording device. In addition, the video system includes a determination unit that receives unique information from a video device (camera) from which a video signal is output by a monitor group and determines the type of the video device, thereby determining the connection state of a plurality of video devices. It is possible to display.

JP-A-10-98708 JP 2004-31468 A

The operability according to the prior art exemplified in Patent Document 1 and Patent Document 2 is not good, and a certain degree of skill is required to perform a desired operation.
The present invention has been made in view of the above-described problems, and provides a medical moving image display system in which operability is improved with respect to operations related to display of medical moving images.

According to the present invention, an input unit that inputs one or a plurality of moving images related to surgery, and a control unit that distributes the one moving image input from the input unit to a plurality and displays them on both the touch panel and the monitor, And the control means displays an operation screen or an operation icon for accepting an operation related to the monitor on the touch panel displaying the moving image, and displays a display area of the touch panel and the monitor as a main screen and the main screen. An operation performed on the main screen when the moving image can be displayed separately on a sub-screen superimposed on the screen and the moving image is displayed on the main screen of the touch panel. The display mode of the main screen can be changed based on the table, and the table based on the operation on the main screen of the touch panel When the change of mode is reflected on the display mode of the main screen of the monitor that distributes and displays the moving image, and the moving image is displayed on the sub screen of the touch panel, The size of the moving image can be enlarged / reduced while maintaining the size of the outline of the sub screen based on the operation performed in response to the operation performed in response to the operation on the sub screen of the touch panel. The size of the moving image displayed on the sub screen can be enlarged or reduced while maintaining the size of the outline of the sub screen of the monitor on which the moving image is distributed and displayed. A medical moving image display system that does not affect the display mode of the screen and the main screen of the monitor is provided.
Further, according to the present invention, the input means for inputting one or a plurality of moving images related to the operation, and the control means for distributing the one moving image input from the input means to a plurality and displaying them on both the touch panel and the monitor. And the control means displays an operation screen or an operation icon for accepting an operation related to the monitor on the touch panel displaying the moving image, and the display area of the touch panel and the monitor is a main screen. The moving image can be displayed separately on a sub-screen superimposed on the main screen, and when the moving image is displayed on the main screen of the touch panel, the moving image is displayed on the main screen. The display mode of the main screen can be changed based on the operated operation, and based on the operation on the main screen of the touch panel. In the case where the change of the display mode is reflected on the display mode of the main screen of the monitor on which the moving image is distributed and displayed, and the moving image is displayed on the sub screen of the touch panel, the sub screen The display position of the moving image can be moved while maintaining the display position of the sub screen based on the operation performed on the sub screen, and the sub screen of the touch panel on which the moving image is distributed and displayed According to the movement of the display position of the moving image based on the operation, the display position of the moving image displayed on the sub screen can be moved while maintaining the display position of the sub screen of the monitor. A medical moving image display system that does not affect the display mode of the main screen of the touch panel and the main screen of the monitor is provided.
Further, according to the present invention, the input means for inputting one or a plurality of moving images related to the operation, and the control means for distributing the one moving image input from the input means to a plurality and displaying them on both the touch panel and the monitor. And the control means displays an operation screen or an operation icon for accepting an operation related to the monitor on the touch panel displaying the moving image, and the display area of the touch panel and the monitor is a main screen. The moving image can be displayed separately on a sub-screen superimposed on the main screen, and when the moving image is displayed on the main screen of the touch panel, the moving image is displayed on the main screen. The display mode of the main screen can be changed based on the operated operation, and based on the operation on the main screen of the touch panel. When the change of the Ku display mode is reflected in the display mode of the main screen of the monitor is displayed by distributing the moving image to display the video image on the sub-screen of the touch panel, the sub-screen The moving image can be rotated while maintaining the display angle of the sub-screen based on the operation performed on the sub-screen, and according to the rotation of the display angle of the moving image based on the operation on the sub-screen of the touch panel The moving image displayed on the sub screen can be rotated while maintaining the display angle of the sub screen of the monitor on which the moving image is distributed and displayed, and the main screen of the touch panel and A medical moving image display system that does not affect the display mode of the main screen of the monitor is provided.

  According to the above invention, it is possible to perform a desired operation on the moving image displayed on the monitor while viewing the moving image displayed on the touch panel without viewing the moving image displayed on the monitor. .

  ADVANTAGE OF THE INVENTION According to this invention, the medical moving image display system which aimed at the improvement of operativity about operation which concerns on the display of a medical moving image is provided.

It is a figure which shows the medical moving image display system which concerns on this embodiment. It is a figure which shows a specific example of the display screen of a touchscreen, and the display screen of a monitor. It is a figure which shows one specific example of the division system which concerns on the display screen of a monitor. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is a schematic diagram for demonstrating the operation method which concerns on a touchscreen. It is an enlarged view of an expansion panel.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

<About each component included in the medical moving image display system 100>
First, each component included in the medical moving image display system 100 will be described with reference to FIG. FIG. 1 is a diagram showing a medical moving image display system 100 according to the present embodiment.
Note that the arrows shown in FIG. 1 indicate the output source and input destination of a moving image exchanged between the components. Therefore, information and data other than the moving image need not necessarily coincide with the contents indicated by the arrows.

The medical moving image display system 100 includes a switching device 110, a workstation 120, a distribution device 130, a touch panel 140, and a plurality of monitors 150 (a first monitor 151, a second monitor 152, and a third monitor 153). Prepare.
The switching device 110 functions as an input unit that inputs one or more moving images related to surgery.
The workstation 120 and the distribution device 130 are linked to each other, so that one moving image input from the switching device 110 is distributed to a plurality of images and displayed on both the touch panel 140 and the monitor 150, and a moving image is displayed. The touch panel 140 functions as a control unit that displays an operation screen or an operation icon for receiving an operation related to the monitor 150.

  Here, the “moving image” is a set of still images that appear to move the object being imaged by displaying continuously changing still images, and is synonymous with video. In the description according to the present embodiment, the term “moving image” may mean file data (moving image data) displayed on the touch panel 140 or the monitor 150 as a moving image by a predetermined display process.

  Here, the “moving image related to surgery” is a moving image related to surgery performed as a medical practice. As a specific example of the “moving image related to surgery”, for example, a moving image captured by an imaging device attached to a medical device such as an endoscope, or a moving image output by a measuring device that measures the state of a patient An image etc. are mentioned.

Here, “distributing one moving image to a plurality of images” means outputting one moving image to a plurality of output destinations. For example, a moving image captured by an endoscope (not shown) This corresponds to the case where the station 120 inputs and the workstation 120 outputs the input moving image to the touch panel 140 and the monitor 150, respectively. Alternatively, the distribution device 130 inputs the moving image via the workstation 120, and the distribution device 130 outputs the input moving image to each of the first monitor 151, the second monitor 152, and the third monitor 153. Applicable.
In the case of “distributing one moving image to a plurality of”, the same output method may be used for a plurality of output destinations, or different types of output methods may be used. For example, the output method of the workstation 120 with respect to the touch panel 140 and the monitor 150 in this embodiment employs HDMI (registered trademark) (High-Definition Multimedia Interface). The output method described here is only a specific example, and an appropriate output method may be selected in accordance with the specification of the output destination.

  The switching device 110 has a function of inputting a moving image related to surgery and selectively switching a moving image to be displayed on the touch panel 140 and the monitor 150 from the input moving image, and this function is also referred to as switching. The The selection of a moving image to be displayed on the touch panel 140 and the monitor 150 is based on an operation using the operation screen P3 or the operation icons I1 to I6 displayed on the touch panel 140. This operation will be described in detail later.

The workstation 120 has a function of outputting a moving image to each of the touch panel 140 and the monitor 150 and synchronizing the moving images with each other. Here, the term “synchronization” means that the display of the moving images of each other changes simultaneously, but a time difference caused by a processing delay in each component is allowed.
Further, the workstation 120 requests the switching device 110 to change the display mode of the moving image on the touch panel 140 and the monitor 150 based on the operation received by the touch panel 140 and to output the moving image selected by the operation. It has a function.

  The distribution device 130 has a function of distributing (split) the moving image output from the workstation 120 to the plurality of monitors 150.

  The touch panel 140 is an electronic device that combines a display device and a position input device, and operates by recognizing a function of displaying a moving image output from the workstation 120, a display position touched by an operator, and how to touch it. And a function of accepting.

  The monitor 150 is a display device and has a function of displaying a moving image output from the workstation 120. The monitor 150 is a general term for the first monitor 151, the second monitor 152, and the third monitor 153 in the present embodiment.

Note that the size and weight of the touch panel 140 are preferably smaller than the size and weight of the monitor 150. Since the touch panel 140 is a device that can be operated intuitively by the operator while displaying a moving image, it is desirable that the touch panel 140 be easily carried to the immediate vicinity of the operator. This is because the usage is sufficient and the need to carry is lower than that of the touch panel 140.
Further, the display area of the monitor 150 is preferably larger than the display area of the touch panel 140. This is because the display on the touch panel 140 is sufficient if the operator can visually recognize the display, whereas the display on the monitor 150 is preferably viewed by a plurality of surgical staff.
However, the size and weight of the touch panel 140 and the monitor 150 can be appropriately selected depending on the usage environment of the medical moving image display system 100, and the touch panel 140 and the monitor 150 are allowed to have the same size and size. The

<Display on Touch Panel 140 and Monitor 150 and Operations Related to Display>
Next, display on the touch panel 140 and the monitor 150 and operations related to the display will be described with reference to FIGS.
FIG. 2 is a diagram illustrating a specific example of the display screen of the touch panel 140 and the display screen of the monitor 150. FIG. 3 is a diagram illustrating a specific example of the division method related to the display screen of the monitor 150. 4 to 12 are schematic diagrams for explaining an operation method related to the touch panel 140. FIG. FIG. 13 is an enlarged view of the extension panel EX3.

  In the example shown in FIG. 2, the display screen of the monitor 150 includes a main screen P1 and a sub screen P2. The display screen of the touch panel 140 includes an operation screen P3, a main screen P4, and a sub screen P5.

FIG. 2A shows a state in which different moving images are displayed on the main screen P1 and the sub screen P2 of the monitor 150 at a certain point in time. As shown in FIG. 2A, the sub screen P2 is displayed so as to be superimposed on the main screen P1.
An example of displaying the main screen P1 and the sub screen P2 on the display screen of the monitor 150 is shown in FIG. For example, FIG. 3A shows an example in which the display screen of the monitor 150 is used only for the main screen P1 (full screen). FIG. 3B shows an example in which the main screen P1 is enlarged and displayed on the entire display screen of the monitor 150, and the sub-screen P2 is superimposed on the lower right portion of the main screen P1. FIG. 3C shows an example in which the main screen P1 is enlarged and displayed on the entire display screen of the monitor 150, and the sub-screen P2 is superimposed on the lower left portion of the main screen P1. FIG. 3B shows an example in which the main screen P1 is enlarged and displayed on the entire display screen of the monitor 150, and the sub-screen P2 is superimposed on both the lower right and lower left of the main screen P1, that is, one main screen. In this example, two sub-screens P2 are displayed on P1.
The embodiment of the present invention is not limited to the example shown in FIG. 3, and for example, three or more sub screens P2 may be provided for one main screen P1, or the entire display screen of the monitor 150 may be provided as the sub screen P2. It may be equally divided (2 divisions, 4 divisions, etc.).

In FIG. 2B, a moving image synchronized with the main screen P1 at the time point is displayed on the main screen P4 of the touch panel 140, and the sub screen P5 of the touch panel 140 is synchronized with the sub screen P2 at the time point. This shows a state where a moving image is displayed. FIG. 2B shows a state in which the operation screen P3 is enlarged on the touch panel 140.
In FIG. 2C, a moving image synchronized with the main screen P1 at the time is displayed on the main screen P4 of the touch panel 140, and the sub screen P5 of the touch panel 140 is synchronized with the sub screen P2 at the time. This shows a state where a moving image is displayed. FIG. 2C shows a state in which the operation screen P3 is reduced and displayed on the touch panel 140.
As shown in FIG. 4A, an up arrow display P33 is displayed at the center of the reduced operation screen P3. When the up arrow display P33 is touched, the operation screen P3 is enlarged. . As shown in FIG. 4B, a down arrow display P32 is displayed at the upper center of the enlarged operation screen P3. When the down arrow display P32 is touched, the operation screen P3 is reduced. Display.

The operation screen P3 displayed on the touch panel 140 includes a thumbnail P31 of a moving image input from the switching device 110. In other words, all the moving images input by the switching device 110 are displayed on the operation screen P3 regardless of whether or not the operator makes a selection.
The workstation 120 displays the moving image selected based on the touch operation received by the touch panel 140 among the moving images shown in the thumbnail P31 on the touch panel 140 separately from the thumbnail P31, and displays the moving image on the monitor 150. To display.
Here, the thumbnail is a list of moving images. In the present embodiment, all moving images input by the switching device 110 are configured to be displayed as thumbnails P31 on the operation screen P3 as they are, and each moving image is a moving image displayed on the main screen P1 or the sub screen P2. Synchronize with the image. However, this aspect is a specific example, and the moving images displayed on the operation screen P3 as the thumbnails P31 are displayed so that at least the gist of each moving image can be understood (for example, the beginning portion of each moving image, the title, etc.). It may be.
In FIG. 2B and the like, an example in which three moving images are displayed on the thumbnail P31 is illustrated, but the number of moving images that can be displayed on the thumbnail P31 may be appropriately increased or decreased.
Also, as shown in FIG. 2B, depending on the arrangement of the main screen P4 and the sub screen P5 on the touch panel 140, the operation screen P3 is superimposed to hide the display of the moving image on the main screen P4 and the sub screen P5. It can happen. As a countermeasure, it is preferable that the display on the operation screen P3 has a certain degree of transparency. This is because even if the operation screen P3 is superimposed on the main screen P4 or the sub screen P5, the moving image displayed on the main screen P4 or the sub screen P5 can be visually recognized.

The operation for selecting a moving image displayed on the operation screen P3 (thumbnail P31) will be described in more detail with reference to FIG. Note that the pointing symbol H1 shown in FIG. 5A indicates that the operator is touching the screen, and is not displayed on the screen on the touch panel 140. The same applies to the pointing symbols H2 to H8 appearing in the following description.
For example, it is assumed that a moving image M1, a moving image M2, and a moving image M3 are displayed on the operation screen P3, and the operator once touched (touched) the moving image M2 (see FIG. 5A). In this case, the workstation 120 displays the operation icon I1, the operation icon I2, and the operation icon I3 so as to be superimposed on the moving image M2 (see FIG. 5B).
When the operation icon I1 is touched, the workstation 120 displays the moving image M2 on the main screen P4, replacing the image displayed on the main screen P4.
When the operation icon I2 is touched, the workstation 120 displays the moving image M2 in full screen regardless of the display mode of the main screen P4.
When the operation icon I3 is touched, the workstation 120 newly provides the sub screen P5 so as to be superimposed on the main screen P4, and displays the moving image M2 on the sub screen P5. Here, the position where the sub screen P5 is provided may be set in advance in accordance with the example shown in FIG. When the sub screen P5 is already displayed, the workstation 120 may display the moving image M2 on the sub screen P5 by replacing the image currently displayed on the sub screen P5.

The operator can also select a moving image displayed on the operation screen P3 (thumbnail P31) by the following operation.
FIG. 6A shows an operation for moving the moving image M3 on the main screen P4 while touching the moving image M3 displayed on the operation screen P3 (operation indicated by the pointing design H2) (pointing with the arrow design A1). (Operation indicated by symbol H3). Such an operation is referred to as a drag operation in the present embodiment.
When the touch panel 140 accepts the above operation, the workstation 120 provides the sub screen P5 so as to be superimposed on the main screen P4 at the position where the moving image M3 is dragged, and displays the moving image M3 on the sub screen P5. Can be made. At this time, on the display screen of the touch panel 140, it looks as if the moving image M3 has been moved from the operation screen P3 to the sub screen P5.

The drag operation can also be used for the following processing.
For example, FIG. 7A shows that the moving image M3 is moved from the lower right portion to the upper left portion of the main screen P4 while touching the moving image M3 displayed on the sub screen P5 (operation indicated by the pointing symbol H4). The operation (the operation indicated by the arrow symbol A2 and the pointing symbol H5) is shown. Such an operation is also referred to as a drag operation in the present embodiment.
When the touch panel 140 accepts the above operation, the workstation 120 can move the display position of the sub screen P5 (moving image M3) (see FIG. 7B).

When the two display processes by the drag operation are arranged, the following can be said.
That is, the workstation 120 is configured to be able to move the display position of the moving image displayed in a part of the display area of the touch panel 140 based on a drag operation received by the touch panel 140. Further, the workstation 120 can move the moving image display position on the monitor 150 in accordance with the movement of the moving image display position by the drag operation received by the touch panel 140.

Furthermore, the drag operation can be used for the following processing.
For example, FIG. 8 (a) shows the touched portion in the outer direction (FIG. 8 (a)) of the sub-screen P5 while touching the corner (or outline) of the sub-screen P5 (the operation indicated by the pointing symbol H6). Indicates an operation (an operation indicated by an arrow symbol A3 and a pointing symbol H7) that moves in the lower right direction. Such an operation is also referred to as a drag operation in the present embodiment.
When the touch panel 140 accepts the above operation, the workstation 120 can enlarge the size of the outer frame of the sub-screen P5 (moving image M3) (see FIG. 8B).
Although illustration is omitted, when the touch panel 140 receives an operation for moving the touched portion in the inner direction of the sub screen P5 while touching the corner (or outline) of the sub screen P5, the workstation 120 Can reduce the size of the sub-screen P5.

If the display process by the above drag operation is arranged, it can be expressed as follows.
The workstation 120 is configured so that the size of the moving image displayed in the display area of the touch panel 140 can be enlarged or reduced based on a drag operation received by the touch panel 140. Furthermore, the workstation 120 can also enlarge / reduce the size of the moving image on the monitor 150 in accordance with the enlargement / reduction of the size of the moving image by the drag operation.

Furthermore, when the touch panel 140 accepts a pinch operation, the workstation 120 can perform the following processing. Here, the pinch operation refers to an operation of touching two points on the display area of the touch panel 140 with two fingers and expanding or reducing the interval between the two touched points.
For example, FIG. 9A illustrates a pinch operation (an operation indicated by an arrow symbol A4 and a pointing symbol H9) in which two points are touched in the display area of the moving image M3 displayed on the sub-screen P5 and the two points are enlarged. ).
When the touch panel 140 accepts such a pinch operation, the workstation 120 can enlarge and display a part of the moving image M3 while maintaining the size of the outline of the sub screen P5 (see FIG. 9B). . The pointing design H10 illustrated in FIG. 9B indicates that the interval between the two touched points is enlarged as compared to the pointing design H9.
The touch panel 140 according to the present embodiment has a configuration that can be scaled up and down in a range from 1 × (1 ×) to 3 ×. However, this range is a specific example, and it may be possible to enlarge more than 3 times or to reduce less than 1x.

When the pinch operation as described above is accepted, the expansion panel EX1 is displayed along with the sub screen P5, and the current magnification is shown. For example, the extension panel EX1 shown in FIG. 9A indicates that the moving image M3 is displayed at the same magnification at that time. In addition, in the extension panel EX1 shown in FIG. 9B, it is indicated that the moving image M3 is displayed three times at that time.
Further, when the moving image M3 is displayed on the sub screen P5 at an enlargement magnification exceeding 1 × by the pinch operation as described above, a status icon ST1 indicating that the enlarged display is being performed is displayed at the corner of the sub screen P5. Is done. The moving image M3 is being enlarged and displayed for a person who has not performed the pinch operation (for example, a person who is looking at the monitor 150 on which the synchronized image of the touch panel 140 is displayed). This is to notify the user.

  In the description using FIG. 9, the example in which the moving image M3 displayed on the sub screen P5 is enlarged or reduced by the pinch operation has been described, but the same pinch is applied to the moving image M2 displayed on the main screen P4. You may employ | adopt the structure which can be expanded / contracted by operation.

Furthermore, when the touch panel 140 accepts a drag operation in a state where two points in the display area are touched, the workstation 120 can perform the following processing.
For example, FIG. 10A shows an operation of moving two touched points in the lower left direction in a state where a two-point touch is performed on the moving image M3 partially enlarged by the pinch operation. (Operation indicated by an arrow symbol A5 and a pointing symbol H11). Such an operation is also referred to as a drag operation in the present embodiment.
When the touch panel 140 accepts the drag operation as described above, the workstation 120 can move the display position of the moving image M3 displayed in the sub-screen P5. For example, although the central portion of the moving image M3 is displayed on the sub screen P5 in FIG. 10A, the moving image is displayed on the sub screen P5 in FIG. 10B by accepting the drag operation as described above. The lower left part of M3 can be displayed. Note that the pointing symbol H12 illustrated in FIG. 10B indicates that the position touched in the lower left has moved from the position indicated by the pointing symbol H11.

When the drag operation as described above is received, the extension panel EX2 is displayed along with the sub screen P5, and the display position of the moving image M3 at the present time is shown. For example, in the extension panel EX2 shown in FIG. 10A, the position notification frame EX21 is displayed at the center of the extension panel EX2, indicating that the center of the moving image M3 is displayed at that time. . Further, in the extension panel EX2 shown in FIG. 10B, it is indicated that the display position of the moving image M3 has moved to the lower left by moving the position notification frame EX21 to the lower left of the extension panel EX2.
Thereby, the display position of the moving image M3 is also clearly shown to a person who has not performed the drag operation (for example, a person who is viewing the monitor 150 on which the synchronized image of the touch panel 140 is displayed).

  In the description using FIG. 10, the example in which the moving image M3 displayed on the sub-screen P5 is moved by the drag operation has been described, but the same dragging is applied to the moving image M2 displayed on the main screen P4. It may be movable by operation.

Further, the workstation 120 can perform the following process by accepting a rotation operation in a state where two points of the display area of the touch panel 140 are touched.
For example, FIG. 11A shows an operation (indicated by an arrow symbol A6 and a pointing symbol H13) that rotates the two touched points while performing a two-point touch on the moving image M3 displayed on the sub-screen P5. The operation shown in FIG. Such an operation is referred to as a rotation operation in the present embodiment.
When the touch panel 140 receives the rotation operation as described above, the workstation 120 can rotate the display position of the moving image M3 displayed in the sub-screen P5 by 90 degrees in the direction of the rotation operation. For example, when the rotation operation performed on the moving image M3 displayed on the sub screen P5 in FIG. 11A is clockwise, the moving image M3 is rotated 90 degrees clockwise and the sub screen P5 is displayed. Is displayed (see FIG. 11B). Note that the pointing symbol H14 illustrated in FIG. 11B indicates that the two touch positions indicated by the pointing symbol H13 have been rotated clockwise.

  When the rotation operation as described above is accepted, as shown in FIG. 11B, a status icon ST2 indicating that the rotation display is being performed is displayed at the corner of the sub-screen P5. This is to notify a person who is not performing the rotation operation (for example, a person who is viewing the monitor 150 on which the synchronized image of the touch panel 140 is displayed) that the moving image M3 is being rotated.

In the description using FIG. 11, the example in which the moving image M3 displayed on the sub-screen P5 is rotated by the rotation operation has been described. However, the same rotation is applied to the moving image M2 displayed on the main screen P4. You may rotate by operation.
In the description using FIG. 11, the example in which the moving image M3 displayed on the sub screen P5 is rotated clockwise is described. However, when the rotation operation received by the touch panel 140 is counterclockwise, The moving image M3 may be rotated 90 degrees counterclockwise.
In the description using FIG. 11, an example in which the touch panel 140 receives the rotation operation once and the moving image M3 is rotated 90 degrees and displayed on the sub-screen P5 has been described. However, the touch panel 140 receives the rotation operation. You may rotate 90 degree | times for every. That is, if the rotation operation is received twice, the moving image M3 may be displayed by rotating 180 degrees, and if the rotating operation is received three times, the moving image M3 may be displayed by rotating 270 degrees. When received once, it may be rotated 360 degrees (in-situ) and displayed.

The display processing based on each operation (pinch operation, drag operation, and rotation operation) on the sub-screen that is based on the two-point touch described with reference to FIGS. 9 to 11 can be summarized as follows.
That is, the workstation 120 can display a moving image by dividing the display area of the touch panel 140 and the monitor 150 into a main screen and a sub screen superimposed on the main screen, and the moving image is displayed on the sub screen of the touch panel 140. Can be displayed, the display mode of the sub screen can be changed based on the operation performed on the sub screen. At this time, the workstation 120 distributes and displays the moving image displayed on the sub screen of the touch panel 140 on the sub screen of the monitor 150, and the display mode change based on the operation on the sub screen of the touch panel 140 is changed to the monitor 150. It is reflected in the display mode of the sub screen.
For example, on the basis of a pinch operation performed on the sub screen of the touch panel 140, the size of the moving image being displayed can be enlarged and reduced while maintaining the size of the outline of the sub screen, and the sub screen of the touch panel 140 can be expanded. In accordance with the enlargement / reduction of the size of the moving image based on the pinch operation, the size of the moving image displayed on the sub screen can be enlarged / reduced while the size of the outline of the sub screen of the monitor 150 is maintained.
Alternatively, based on a drag operation performed on the sub screen of the touch panel 140, the display position of the moving image being displayed can be moved while the display position of the sub screen is maintained, and the sub screen of the touch panel 140 can be moved. In accordance with the movement of the display position of the moving image based on the pinch operation, the display position of the moving image displayed on the sub screen can be moved while the display position of the sub screen of the monitor 150 is maintained.
Further, based on the rotation operation performed on the sub screen of the touch panel 140, the moving image being displayed can be rotated while maintaining the display angle of the sub screen, and the operation on the sub screen of the touch panel 140 is performed. The moving image displayed on the sub screen can be rotated while the display angle of the sub screen of the monitor 150 is maintained in accordance with the rotation of the display angle of the moving image based on the above.

In addition, each operation on the sub-screen that is based on the two-point touch described with reference to FIGS. 9 to 11 can also be applied to the main screen. In other words, when a moving image is displayed on the main screen of the touch panel 140, the workstation 120 can change the display mode of the main screen based on an operation performed on the main screen. At this time, the workstation 120 distributes and displays the moving image displayed on the main screen of the touch panel 140 on the main screen of the monitor 150, and changes in the display mode based on operations on the main screen of the touch panel 140 are displayed on the monitor 150. It is reflected in the display mode of the main screen.
For example, the size of a moving image displayed on the main screen can be enlarged or reduced based on a pinch operation performed on the main screen of the touch panel 140, and the size of the moving image based on the pinch operation on the main screen of the touch panel 140 The size of the moving image displayed on the main screen of the monitor 150 can be enlarged or reduced in accordance with the enlargement / reduction.
Alternatively, the display position of the moving image being displayed on the main screen can be moved based on a drag operation performed on the main screen of the touch panel 140, and the moving image is based on a pinch operation on the main screen of the touch panel 140. The display position of the moving image displayed on the main screen of the monitor 150 can be moved according to the movement of the display position.
Further, the moving image being displayed on the main screen can be rotated based on the rotation operation performed on the main screen of the touch panel 140, and the display angle of the moving image based on the operation with respect to the main screen of the touch panel 140 is displayed. The moving image displayed on the main screen of the monitor 150 can be rotated according to the rotation.

In addition to the operations described so far, the touch panel 140 can accept the following operations.
For example, in the state where the main screen P4 and the sub screen P5 are displayed on the touch panel 140, when the operator touches the sub screen P5, the workstation touches the moving image displayed on the thumbnail P31. 120 displays an operation icon I4, an operation icon I5, an operation icon I6, and an operation icon I7 so as to be superimposed on the moving image M3 displayed on the sub-screen P5 (see FIG. 12A).
When the operation icon I4 is touched in this state, the workstation 120 displays the moving image M2 on the main screen P4 by replacing the moving image M3 displayed on the main screen P4, and the moving image displayed on the sub screen P5. The moving image M3 is displayed on the sub screen P5 by replacing M2 (not shown).
Further, when the operation icon I5 is touched in this state, the workstation 120 displays the moving image M3 on the full screen regardless of the display mode of the main screen P4 (not shown).
In addition, when the operation icon I6 is touched in this state, the workstation 120 causes the sub screen P5 to disappear from the main screen P4 (not shown). That is, the workstation 120 displays only the main screen P4 on the touch panel 140.

Further, when the operation icon I7 is touched in the state shown in FIG. 12A, the workstation 120 displays the expansion panel EX3 along with the sub screen P5. In FIG. 12A, the pointing symbol H15 indicates that the operator is touching the operation icon I7.
The expansion panel EX3 includes icons from the operation icon I8 to the operation icon I20 (see FIG. 13).
When the operation icon I8 is touched, the workstation 120 rotates the moving image M3 displayed on the sub screen P5 by 90 degrees clockwise. That is, the same processing as that performed in accordance with the rotation operation is performed. When the operation icon I9 is touched, the workstation 120 returns the moving image M3 being rotated to the original position. The operation icon I9 can return not only the moving image M3 rotated and displayed by the operation of the operation icon I8 but also the moving image M3 rotated and displayed in accordance with the rotation operation to the original position. is there.
When the operation icon I10 is touched, the workstation 120 reverses the moving image M3 displayed on the sub screen P5, and when the operation icon I11 is touched, the workstation 120 displays the moving image M3 displayed on the sub screen P5. Flip it upside down. Further, when the operation icon I12 is touched, the workstation 120 returns the moving image M3 that is being flipped horizontally or flipped vertically to the original position.
When the operation icon I13 is touched, the workstation 120 increases the brightness (luminance) of the moving image M3 displayed on the sub screen P5. When the operation icon I14 is touched, the workstation 120 is displayed on the sub screen P5. The brightness of the moving image M3 is lowered. When the operation icon I15 is touched, the workstation 120 returns the brightness of the moving image M3 that is rising or descending from the reference value to the reference value. A numerical value shown between the operation icon I13 and the operation icon I14 is a numerical value indicating the brightness of the moving image M3, and 0 (zero) indicates a reference value.
When the operation icon I16 is touched, the workstation 120 increases the contrast (light / dark ratio) of the moving image M3 displayed on the sub screen P5. When the operation icon I17 is touched, the workstation 120 is displayed on the sub screen P5. The contrast of the moving image M3 is lowered. Further, when the operation icon I18 is touched, the workstation 120 returns the contrast of the moving image M3 that is rising or descending from the reference value to the reference value. A numerical value shown between the operation icon I16 and the operation icon I17 is a numerical value indicating the contrast of the moving image M3, and 0 (zero) indicates a reference value.
When the operation icon I19 is touched, the workstation 120 returns all parameters (display angle, display position, inversion, brightness, and contrast of the moving image M3) that can be changed on the expansion panel EX3 to the original state. When the operation icon I20 is touched, the workstation 120 closes the expansion panel EX3 (returns to the state shown in FIG. 12A).

Note that, among the operation icons illustrated in FIG. 13, the operation of the operation icon I8 is described as being performed in the same manner as the above rotation operation. (An operation that can be performed without displaying an operation icon) may be substituted. For example, the brightness and contrast of the moving image M3 displayed on the sub screen P5 by tracing the end of the sub screen P5 (moving a finger toward the end while touching a certain point included in the end). May be changed.
The operation icons illustrated in FIGS. 12 and 13 are displayed in the sub screen P5 in response to the operator touching the sub screen P5, but the operator touches the sub screen P4. Accordingly, an operation icon displayed in the sub-screen P4 may be separately provided. At this time, the operation icon displayed in the sub-screen P4 changes the display mode of the main screen P4.

  Since the display on the touch panel 140 and the monitor 150 is changed by the operation as described above, the operator can intuitively operate the display on the monitor 150 (the main screen P1 and the sub screen P2), and the operability is improved. To do.

  The operation on the touch panel 140 described above is a specific example, and the operations that can be accepted by the touch panel 140 in the implementation of the present invention and the display changes of the touch panel 140 and the monitor 150 that occur according to the accepted operations are limited to those described above. I can't.

In addition, it is preferable that the workstation 120 does not display the operation screen P3 and the operation icons I1 to I20 (including the extended panel EX3 including the operation icons I8 to I20) on the monitor 150. That is, in the process in which the workstation 120 distributes the moving image to both the touch panel 140 and the monitor 150, the operation screen P3 and the operation icons I1 to I20 can be added only to the moving image distributed to the touch panel 140. It is desirable that the operation screen P3 and the operation icons I1 to I20 are not always added.
This is because the operation screen P3 and the operation icons I1 to I6 are displays for accepting operations and need not be displayed on the monitor 150 which is not a means for accepting operations. This is because the visibility of the moving image on the monitor 150 may be lowered.

<Modification of the present invention>
The present invention has been described with reference to the embodiments described with reference to the drawings so far. However, the present invention is not limited to the above-described embodiments, and various modifications can be made as long as the object of the present invention is achieved. It includes aspects such as deformation and improvement.

The monitor 150 in the above embodiment has been described so that the three display devices of the first monitor 151, the second monitor 152, and the third monitor 153 correspond, but the implementation of the present invention is not limited to this.
For example, the present invention may be implemented by an aspect in which the touch panel 140 and the monitor 150 are each one, and in this aspect, the distribution device 130 in the above embodiment may be omitted.

The distribution device 130 in the above embodiment only distributes the moving image output from the workstation 120 to a plurality of display devices (the first monitor 151, the second monitor 152, and the third monitor 153). The device 130 may distribute the moving image to a device different from the display device.
For example, the distribution device 130 may distribute the moving image output from the workstation 120 to a recorder device (not shown) that records the moving image.

In the specific examples shown in FIGS. 4 to 13, only an example in which the operation screen P3 is enlarged or reduced is displayed on the touch panel 140. However, the operation screen P3 need not always be displayed on the touch panel 140.
For example, when an operation for moving the operation screen P3 outside the display screen of the touch panel 140 is received while the operation screen P3 is touched, the workstation 120 may hide the operation screen P3. Such an operation is also referred to as a swipe operation.

  In the above description of the embodiment, the description has been made on the premise of the components shown in FIG. 1, but each component of the present invention may be formed so as to realize its function. Therefore, each component of the present invention does not have to be individually independent, and a plurality of components are formed as a single member, and a single component is formed of a plurality of members. It is allowed that a certain component is a part of another component, a part of a certain component overlaps a part of another component, and the like.

This embodiment includes the following technical ideas.
(1) An input unit that inputs one or a plurality of moving images related to surgery, and a control unit that distributes the moving image input from the input unit to a plurality and displays them on both the touch panel and the monitor, The medical moving image display system, wherein the control means displays an operation screen or an operation icon for accepting an operation related to the monitor on the touch panel displaying the moving image.
(2) The control means is configured to be able to move the display position of the moving image displayed in a part of the display area of the touch panel based on a drag operation received by the touch panel, and drag The medical moving image display system according to (1), wherein the display position of the moving image on the monitor is also moved in accordance with the movement of the display position of the moving image by an operation.
(3) The control unit is configured to be able to enlarge / reduce the size of the moving image displayed in the display area of the touch panel based on a drag operation received by the touch panel, and the moving image by the drag operation The medical moving image display system according to (1) or (2), wherein the size of the moving image on the monitor is also enlarged or reduced according to the enlargement or reduction of the size of the image.
(4) The control means can display the moving image by dividing the display area of the touch panel and the monitor into a main screen and a sub screen superimposed on the main screen, and the sub screen of the touch panel. In the case where the moving image is displayed on the screen, the display mode of the sub screen can be changed based on the operation performed on the sub screen, and the sub screen displayed on the sub screen is displayed. The moving image is distributed and displayed on the sub screen of the monitor, and the display mode change based on the operation of the touch panel on the sub screen is reflected in the display mode of the sub screen of the monitor (1) to ( The medical moving image display system according to any one of 3).
(5) In the case where the moving image is displayed on the main screen of the touch panel, the control unit can change the display mode of the sub screen based on an operation performed on the main screen. The moving image displayed on the main screen of the touch panel is distributed and displayed on the main screen of the monitor, and a display mode change based on an operation on the main screen of the touch panel is changed to the main screen of the monitor. The medical moving image display system according to (4), which is reflected in a display mode of the screen.
(6) When the moving image is displayed on the sub screen of the touch panel, the control unit maintains the size of the outline of the sub screen based on the operation performed on the sub screen. The size of the moving image can be enlarged / reduced, and the size of the moving image based on the pinch operation on the sub screen of the touch panel is maintained, while maintaining the size of the outline of the sub screen of the monitor. The medical moving image display system according to (4) or (5), wherein the size of the moving image displayed on the sub screen can be enlarged or reduced.
(7) In the case where the moving image is displayed on the sub screen of the touch panel, the control unit maintains the display position of the sub screen based on an operation performed on the sub screen. The display position of the moving image can be moved, and the display position of the sub screen of the monitor is maintained according to the movement of the display position of the moving image based on the pinch operation on the sub screen of the touch panel. The medical moving image display system according to any one of (4) to (6), wherein a display position of the moving image displayed on the sub-screen can be moved.
(8) In the case where the moving image is displayed on the sub screen of the touch panel, the control unit maintains the display angle of the sub screen based on an operation performed on the sub screen. A moving image can be rotated, and the display angle of the sub screen of the monitor is maintained while maintaining the display angle of the moving image according to the rotation of the display angle of the moving image based on an operation on the sub screen of the touch panel. The medical moving image display system according to any one of (4) to (7), wherein the displayed moving image can be rotated.
(9) The operation screen displayed on the touch panel includes a thumbnail of the moving image input from the input unit, and the control unit includes the touch panel of the moving image indicated by the thumbnail. The moving image selected based on the touch operation received by the user is displayed on the touch panel separately from the thumbnail, and the moving image is displayed on the monitor according to any one of (1) to (8) The medical moving image display system described.
(10) The medical moving image display system according to any one of (1) to (9), wherein the control unit does not display the operation screen and the operation icon on the monitor.
(11) The medical moving image display system according to any one of (1) to (10), wherein a display area of the monitor is larger than a display area of the touch panel.

DESCRIPTION OF SYMBOLS 100 Medical moving image display system 110 Switching apparatus 120 Workstation 130 Distribution apparatus 140 Touch panel 150 Monitor 151 1st monitor 152 2nd monitor 153 3rd monitor

Claims (6)

Input means for inputting one or more moving images related to the operation;
Control means for distributing the one moving image input from the input means to a plurality and displaying the same on both the touch panel and the monitor,
The control means includes
An operation screen or an operation icon for accepting an operation related to the monitor is displayed on the touch panel displaying the moving image,
The moving image can be displayed by dividing the display area of the touch panel and the monitor into a main screen and a sub screen superimposed on the main screen,
When the moving image is displayed on the main screen of the touch panel, the display mode of the main screen can be changed based on an operation performed on the main screen, and the main screen of the touch panel The change of the display mode based on the operation on is reflected in the display mode of the main screen of the monitor that distributes and displays the moving image,
When the moving image is displayed on the sub-screen of the touch panel, the size of the moving image can be enlarged / reduced while maintaining the size of the outline of the sub-screen based on the operation performed on the sub-screen. And the size of the moving image based on the operation on the sub screen of the touch panel is increased and reduced while maintaining the size of the outline of the sub screen of the monitor on which the moving image is distributed and displayed. A medical moving image display system in which a size of the moving image displayed on the screen can be enlarged or reduced, but does not affect a display mode of the main screen of the touch panel and the main screen of the monitor . Input means for inputting one or more moving images related to the operation;
Control means for distributing the one moving image input from the input means to a plurality and displaying the same on both the touch panel and the monitor,
The control means includes
An operation screen or an operation icon for accepting an operation related to the monitor is displayed on the touch panel displaying the moving image,
The moving image can be displayed by dividing the display area of the touch panel and the monitor into a main screen and a sub screen superimposed on the main screen,
When the moving image is displayed on the main screen of the touch panel, the display mode of the main screen can be changed based on an operation performed on the main screen, and the main screen of the touch panel The change of the display mode based on the operation on is reflected in the display mode of the main screen of the monitor that distributes and displays the moving image,
When the moving image is displayed on the sub screen of the touch panel, the display position of the moving image is moved while maintaining the display position of the sub screen based on an operation performed on the sub screen. And the display position of the sub-screen of the monitor is maintained while the display position of the sub-screen of the monitor is maintained according to the movement of the display position of the moving image based on the operation on the sub-screen of the touch panel on which the moving image is distributed and displayed. A medical moving image display system in which a display position of the moving image displayed on the sub screen is movable, but does not affect a display mode of the main screen of the touch panel and the main screen of the monitor . Input means for inputting one or more moving images related to the operation;
Control means for distributing the one moving image input from the input means to a plurality and displaying the same on both the touch panel and the monitor,
The control means includes
An operation screen or an operation icon for accepting an operation related to the monitor is displayed on the touch panel displaying the moving image,
The moving image can be displayed by dividing the display area of the touch panel and the monitor into a main screen and a sub screen superimposed on the main screen,
When the moving image is displayed on the main screen of the touch panel, the display mode of the main screen can be changed based on an operation performed on the main screen, and the main screen of the touch panel The change of the display mode based on the operation on is reflected in the display mode of the main screen of the monitor that distributes and displays the moving image,
When the moving image is displayed on the sub screen of the touch panel, the moving image can be rotated while maintaining the display angle of the sub screen based on an operation performed on the sub screen. In addition, according to the rotation of the display angle of the moving image based on the operation of the touch panel on the sub screen, the moving image is distributed and displayed on the sub screen while maintaining the display angle of the sub screen of the monitor. The medical moving image display system in which the displayed moving image is rotatable, but does not affect the display mode of the main screen of the touch panel and the main screen of the monitor . The operation screen displayed on the touch panel includes a thumbnail of the moving image input from the input means,
The control means provides the sub-screen so that the moving image selected based on the drag operation received by the touch panel among the moving images shown in the thumbnail is superimposed on the main screen at the dragged position. Te, the thumbnail and causes display the moving images individually the sub screen, medical moving image display system according to any one of claims 1 to 3 for displaying the moving image on the monitor. The medical moving image display system according to any one of claims 1 to 4 , wherein the control unit does not display the operation screen and the operation icon on the monitor. The medical moving image display system according to any one of claims 1 to 5 , wherein a display area of the monitor is larger than a display area of the touch panel.

Images