JP7016068B2 - Video integration system - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law Demonstration at an exhibition July 15-17, 2016 The 63rd Japan Arrhythmic Electrocardiography Society

Application of Article 30, Paragraph 2 of the Patent Law Demonstration at an exhibition October 20, 2016-October 22, 2016 CCT2016

Patent Law Article 30 Paragraph 2 Applicable Demonstration at Exhibition October 27-28, 2016 Catheter Ablation-related Autumn Meeting 2016

The present invention relates to a video integration system that integrates and displays images from a plurality of individual devices, for example, a plurality of medical devices in substantially real time.

In recent years, many diagnostic imaging devices have been used in the medical field. For example, in catheter treatment for cardiovascular disease, treatment is performed while the operator grasps the position of the catheter in real time with an X-ray image.

FIG. 14A shows a conventional surgical mode in which monitors are provided on a plurality of medical devices 310A to 310C, and the surgeon performs treatment while the surgeon observes the biological information of patient P and the image of the affected area. It is explanatory drawing which shows. However, in such an embodiment, during the operation, doctors and nurses are provided at different locations, including a biometric information monitor that acquires and displays biometric information of the patient, such as blood pressure, oxygen saturation, and electrocardiogram. It is necessary to grasp the video information from many medical devices at the same time. Performing complicated treatment while viewing the image display provided on each medical device on each device is complicated and there is a high possibility that the danger will be overlooked.

Therefore, as shown in FIG. 14B, a monitor device has been developed that integrates images from a plurality of medical devices 310 and provides them as one integrated screen 320 (see, for example, Patent Document 1).

Japanese Patent No. 581647

However, although the current device can display the input video from multiple medical devices on a single screen in multiple split screens, the standard of the video signal from each medical device is different, so the screen layout should be changed. It was difficult for non-specialized technicians to add images from a new device during surgery, and to change the image size in real time when the affected area was to be observed as a large image on a monitor during surgery. .. There is also the problem that it is difficult to change the screen layout as the surgery progresses.

In view of such circumstances, the present invention is intended to provide a video integration system that integrates a plurality of video signals of different standards generated by a plurality of medical devices in substantially real time and displays them in a freely changeable layout. be.

(1) The present invention has at least two individual video signal input terminals that are connected to video output terminals of a plurality of individual devices and input signals of individual video generated by the individual device, and a plurality of the individual video. By synthesizing in substantially real time, an output video generation processing unit that generates a signal for a composite video display screen in which a plurality of the individual videos are projected on a single screen, and a signal for the composite video display screen are combined. Provided is a video integrated system characterized by having a composite video output terminal for outputting to a display.

According to the invention described in (1) above, individual video signals from a plurality of devices can be synthesized in substantially real time and displayed in a single display screen. Therefore, the user is freed from the complicated operation of checking the images displayed on the monitors provided in each of the plurality of devices, which is a remarkably excellent effect of improving the accuracy and efficiency of the work. Play.

(2) The present invention maintains the individual video management unit that acquires management information of resolution and / or aspect ratio based on the signal of the individual video, and the aspect ratio of each of the plurality of individual videos. In order to apply to the signal for the composite video display screen, the output video generation processing unit includes a standardization processing unit that converts a plurality of the individual video, and the output video generation processing unit uses the standardized individual video. The video integration system according to (1) above is provided, which comprises generating a signal for the composite video display screen.

According to the invention described in (2) above, standardized video signals of different standards generated by a plurality of individual devices can be displayed on the screen while maintaining the aspect ratio even if the video size is changed. Since the standardization process is performed, it is possible to generate an image while maintaining the shape in real time, and it has an excellent effect of being able to display an image that can be used as a material for accurate judgment by the user.

(3) The present invention is characterized in that the standardization processing unit digitizes and standardizes the analog data when a part or all of the individual videos in the plurality of individual videos are analog data. , The video integration system described in (2) above is provided.

According to the invention described in (3) above, it is possible to simultaneously display a video signal from a device that generates an analog video signal and a video signal from a device that generates a digital video signal on a single screen. It has the excellent effect of being possible.

(4) The present invention includes an individual layout registration processing unit in which individual layouts displayed in the composite video display screen and having a positional relationship of a plurality of the individual videos are registered in advance, and the output video generation processing unit is provided. The video integration system according to any one of (1) to (3) above is provided, wherein a signal for the composite video display screen is generated with reference to the individual layout.

According to the invention described in (4) above, the user can register in advance individual layouts showing the positional relationship of a plurality of individual images, and the composite image can be displayed according to the individual layouts. Therefore, the layout required during a series of operations can be appropriately selected. It is possible to call and change the layout in real time, which has the excellent effect of improving work accuracy and efficiency.

(5) The present invention includes an operation input terminal for receiving an operation input of a user by an operation input means, and the individual layout registration processing unit provides a layout editing area for prompting the user to input an operation related to layout adjustment of the individual video. The video integration system according to (4) above is provided, which comprises the individual layout editing unit that outputs the layout registration screen including the layout and edits the individual layout based on the operation input.

According to the invention described in (5) above, since the layout of the individual video can be adjusted in real time, it is possible to change the layout of the individual video to the optimum layout during the work, which is an excellent effect.

(6) In the present invention, the output video generation processing unit has an individual layout selection unit that prompts the user to select a desired individual layout from the plurality of individual layouts, and is selected by the user. The video integration system according to (4) or (5) above is provided, which comprises generating a signal for the composite video display screen with reference to the individual layout.

According to the invention described in (6) above, the optimum layout can be easily selected from the individual layouts registered in advance by the user and displayed on the screen, so that the user himself / herself is optimal during a series of operations. It has the excellent effect of being able to proceed with the work while selecting the layout.

(7) The present invention is characterized in that the individual layout selection unit includes an individual layout list display area that is a list of selectable individual layouts in a part or all of the composite video display screen. The video integration system according to (6) is provided.

According to the invention described in (7) above, the individual layout list, which is a list of selectable individual layouts, can be displayed on the composite video display screen, so that the user himself / herself is optimal during a series of operations. It has the excellent effect of being able to proceed with the work while selecting the layout.

(8) In the present invention, the output video generation processing unit prompts the user to input an operation for adjusting the layout of the individual video in substantially real time on a part or all of the composite video display screen. (4) to (7) above, characterized by having the individual layout direct editing processing unit that outputs a signal including the above and changes the layout of the composite video display screen being generated based on the operation input. The video integration system described in any of the above is provided.

According to the invention described in (8) above, since the user himself / herself can adjust the layout of the individual video in real time during the work, it is possible to always change the layout of the individual video to the optimum effect. Play.

(9) The present invention is characterized in that at least one of the relative position, context, size, and brightness of a plurality of individual images displayed in substantially real time can be adjusted in the individual layout direct editing area. The video integration system described in (8) above is provided.

According to the invention described in (9) above, since the user himself / herself can adjust the relative position, context, size, and brightness of the individual images in real time while working, the accuracy of the user's work is improved. It has an excellent effect of being able to display an image that can be used as a material for the user to make an accurate judgment.

(10) In the present invention, the individual layout direct editing processing unit outputs a signal including a list of the individual images that can be newly added to the composite image display screen in a part or all of the composite image display screen. The video integration system according to (8) or (9) above, wherein the individual video selected based on the user's operation input is additionally displayed on the composite video display screen being generated. offer.

According to the invention described in (10) above, it is possible to obtain an excellent effect that the user can appropriately select necessary video signals during work and additionally display them on the screen.

(11) The present invention comprises a layout group registration processing unit in which a layout group in which a desired plurality of individual layouts are selected and grouped from the plurality of individual layouts is registered in advance, and the output video generation processing unit is provided. The individual layout selection unit prompts the user to select a desired individual layout from the layout group, and refers to the individual layout selected by the user from the layout group to perform the synthesis. The video integration system according to (6) or (7) above is provided, which comprises generating a signal for a video display screen.

According to the invention described in (11) above, it has an excellent effect that the user can proceed with the work while selecting the optimum layout in real time from the layout group which is a set of layouts registered in advance by the user. ..

According to the above -mentioned video integration system, it is possible to provide a video integration system that integrates a plurality of video signals of different standards generated by a plurality of medical devices in substantially real time and displays them in a freely changeable layout. Can have an effect.

It is a block diagram of the image integration system which concerns on embodiment of this invention. It is explanatory drawing of the composite image display screen. It is explanatory drawing of the individual video management screen. It is explanatory drawing of the composite image display screen in the case of having a composite image display area. (A) It is explanatory drawing of the composite image display screen which has an individual layout direct edit area. (B) It is explanatory drawing explaining the operation which selects an individual image from the individual image sample list display area for addition on the composite image display screen, and adds it to an individual layout. It is explanatory drawing of the composite video display screen which has an individual layout list display area. It is explanatory drawing of the layout registration screen which has a layout edit area. It is explanatory drawing of the layout group registration screen which has a category setting area. (A) It is explanatory drawing of the synthetic image display screen. (B) It is explanatory drawing which shows the operation which changes the position and size of an individual image on the composite image display screen, and the mode of transparent display of the overlap part of an individual image. (A) It is a functional block diagram concerning the processing of the signal of an individual video in the function realized by the control part of the video integrated system. (B) It is a functional block diagram regarding the registration process of an individual layout and a layout group. It is a functional block diagram about the processing about individual video and individual layout. It is a flowchart of the operation which directly edits an individual layout. It is a flowchart of an operation of performing layout group display, selecting an individual layout, and changing the display of the composite video display screen. (A) It is a conceptual diagram explaining the mode of the conventional operation using a plurality of medical devices each having a monitor. (B) It is a conceptual diagram explaining a conventional monitor which integrates images from a plurality of medical devices into one screen.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. 1 to 13 are examples of embodiments in which the invention is carried out, and in the drawings, the parts with the same reference numerals represent the same objects. It should be noted that some configurations are appropriately omitted in each drawing to simplify the drawings. Then, the size, shape, thickness, etc. of the member are appropriately exaggerated and expressed.

FIG. 1 shows a configuration diagram of a video integration system 1 according to an embodiment of the present invention. The video integration system 1 includes a control unit 30 that controls and processes the entire system, a bus 60 that connects each device to the control unit 30, a memory 40 that records information such as programs and data, and information input by the user. An operation input means 50 for performing an operation, an input interface 10 for signals from individual devices 15 each generating a video signal and being connected to the video integration system 1, and a display displaying the video integrated by the video integration system 1. The output interface 20 for the signal to the device 25 is provided.

The control unit 30 is composed of a CPU 70, a RAM 72, a ROM 74, and the like, and executes various controls. The CPU 70 is a so-called central processing unit, and various programs are executed to realize various functions. The RAM 72 is used as a work area and a storage area of the CPU, and the ROM 74 stores an operating system and a program executed by the CPU.

The memory 40 is a recording medium such as a hard disk or SSD (Solid State Drive), and has a program recording area 80 for recording programs and the like, a past video information recording area 90 for recording past video data, and an arrangement and size of individual videos. It is provided with a layout information recording area 100 or the like for recording layout information such as.

The operation input means 50 is a general input device such as a keyboard, a mouse, a trackball, and a touch panel provided in the display device 25.

The input interface 10 includes a plurality of individual video signal input terminals 12 for inputting video signals from the individual device 15. The individual video signal input terminal 12 is, for example, an HDMI (registered trademark) terminal (High-Definition Multimedia Interface: high-definition multimedia interface), an S-video terminal, a BNC terminal, a USB terminal, a VGA terminal, and the like.

The output interface 20 is an interface that outputs an integrated (synthesized) video signal to the display device 25, for example, an output signal distribution means 20A that distributes an HDMI (registered trademark) signal to a plurality of components, and an HDMI (registered trademark), for example. It has an output signal conversion means 20B that converts a signal into a LAN signal. Further, the output interface 20 has a composite video output terminal 22 that outputs a video signal synthesized by the display device 25. The composite video output terminal 22 is, for example, a LAN terminal, an HDMI (registered trademark) terminal (High-Definition Multimedia Interface: high-definition multimedia interface), an S-video terminal, a BNC terminal, a USB terminal, a VGA terminal, and the like.

That is, the video integration system 1 is connected to the video output terminals of the plurality of individual devices 15, respectively, and has at least two individual video signal input terminals 12 and a plurality of individual video signal input terminals 12 to which the signals of the individual videos generated by the individual devices 15 are input. An output video generation processing unit 600 that generates a signal for a composite video display screen 900 in which a plurality of individual videos are projected on a single screen of the display device 25 by synthesizing individual videos in substantially real time, and a composite video. A composite video output terminal 22 for outputting a signal for the display screen 900 to the display device 25 is provided.

FIG. 2 shows an explanatory diagram of the composite video display screen 900 displayed on the display device 25.

Here, an individual video is defined as an image obtained by a video signal from an individual device, an individual layout is defined as a positional relationship when arranging a plurality of individual images on one screen, and a set that handles a plurality of different individual layouts as a group is defined as a layout group.

In FIG. 2, the composite video display screen 900 displays a layout group selection area 905, which is a screen area in which a layout group, which is a set of layouts for arranging individual videos, can be selected, and a list of individual layouts of the designated layout group. The individual layout list display area 920 is provided.

The user can select a specific layout group by selecting the items displayed in the layout group selection area 905 by the operation input means 50. For example, in FIG. 2, when the item "A" is selected in the item 1 of the layout group selection area 905A and "t_k1_3" is selected in the item 2 of the layout group selection area 905B, the individual layout is displayed in the individual layout list display area 920. A layout group consisting of "LA", "LZ", and "LC" is displayed. For example, in a medical field, when a plurality of doctors use the video integration system 1, if the name of the doctor in charge is input as item 1 and, for example, the surgical method is input in item 2, the doctor in charge will use it during the operation. You can quickly choose the layout of the individual video you want.

The composite video display screen 900 is further selected in the system setting button 901 to be displayed on the individual video management screen 800 for managing individual videos, the new edit button 902 to display the layout registration screen 950 described later, and the layout group selection area 905. A start button 903 for starting the composite video display screen 900 for displaying the composite video display area 910, which will be described later, is provided according to the individual layout of the layout group.

FIG. 3 shows an explanatory diagram of the individual video management screen 800. On the individual video management screen 800, management information of the signal of the individual video from the individual device 15 input from the individual video signal input terminal 12 is displayed. The management information is, for example, the name of the individual device 15, the resolution of the image from the individual device 15, the aspect ratio, and the like. The video integration system 1 transmits appropriate EDID data (Extended Display Identification Data) to each of the individual devices 15 connected to the individual video signal input terminals 12, and receives signals according to the required resolution and aspect ratio. .. On the individual video management screen 800, the user can input and update the required resolution, the icon to be displayed in the registration individual video sample list display area 958 and the like described later, the background color of the individual video, and the like by the operation input means 50. The individual video management screen 800 further includes a decision button 904 that is displayed on the individual video management screen 800 and that updates or determines the input management information.

FIG. 4 shows an explanatory diagram of the composite video display screen 900 when the composite video display area 910 is provided. This synthetic image display screen 900 is used, for example, in a medical field when a doctor or a nurse performs a treatment while referring to a patient's biological information, an image of an affected area, or the like during an operation. Therefore, unnecessary control information and the like that are not related to surgery are not displayed. In the composite video display area 910, for example, individual videos KA, KB, KC, and KD are displayed according to a pre-registered individual layout. At this time, it is desirable that a plurality of individual layouts grouped together in the layout group selected in FIG. 2 are ordered and can be selected in order. Further, in FIG. 2, it is desirable that the order of the individual layouts can be changed by the operation input means 50 in the individual layout list display area 920. For example, it is desirable that the order can be changed by dragging the icon of each individual layout displayed in the individual layout list display area 920.

In the video integration system 1, the output video generation processing unit 600 provides an individual layout direct editing area 940 that prompts the user to input an operation for adjusting the layout of the individual video in substantially real time on a part or all of the composite video display screen 900. It is desirable to have an individual layout direct editing processing unit 640 that outputs the included signal and changes the layout of the composite video display screen 900 being generated based on the operation input.

When the individual video changes with time, it is desirable to refresh the video in substantially real time to prevent the individual video from stopping for a long time.

FIG. 5A shows an explanatory diagram of the composite video display screen 900 having the individual layout direct editing area 940. In order to display the composite video display screen 900, for example, the user left-clicks the mouse provided as the operation input means 50 in the composite video display area 910 of FIG. The composite video display screen 900 has an individual layout direct editing area 940 that transitions from the composite video display area 910 and enables direct editing of the individual layout currently being displayed. Further, the composite video display screen 900 includes an additional individual video sample list display area 930 as a sidebar, in which the individual video list is displayed and can be additionally displayed in the current individual layout. In FIG. 5A, for example, as the individual layout LZ, a layout for displaying the individual images KA, KB, and KD in the individual layout direct editing area 940 is selected. In the individual layout direct editing area 940, the user can change the size, position, etc. of each individual image by operating the operation input means 50, for example, a mouse.

That is, in the individual layout direct editing area 940, it is desirable that at least one of the relative position, context, size, and brightness of a plurality of individual images displayed in substantially real time can be adjusted.

When the individual video changes with time, it is desirable to refresh the video in substantially real time to prevent the individual video from stopping for a long time.

FIG. 5B is an explanatory diagram illustrating an operation of selecting a specific individual video from the additional individual video sample list display area 930 on the composite video display screen 900 and additionally displaying it on the composite video display screen 900. .. For example, the user selects the individual video KC1 displayed as a sample in the additional individual video sample list display area 930 by the mouse which is the operation input means 50, and forms the locus indicated by the alternate long and short dash arrow. Therefore, by performing a so-called drag-and-drop operation, the individual video KC2 can be displayed in the individual layout direct editing area 940 at an appropriate position. By selecting, for example, the update button 945 shown in FIG. 5, the user can update and register the individual layout LZ as a new individual layout including the individual video KC.

That is, the individual layout direct editing processing unit 640 that edits the individual layout outputs and uses a signal including a list of individual images that can be newly added to the composite video display screen 900 on a part or all of the composite video display screen 900. The individual video selected based on the operation input of the person is additionally displayed on the composite video display screen 900 being generated.

FIG. 6 is an explanatory diagram of a composite video display screen 900 having an individual layout list display area 920. The individual layout list display area 920 displays a list of individual layouts of the designated layout group. The composite video display screen 900 is displayed, for example, by the user right-clicking the mouse provided as the operation input means 50 in the composite video display area 910 of FIG.

The composite video display screen 900 includes a composite video display area 910 and an individual layout list display area 920, and the individual layout list display area 920 displays individual layouts in the selected layout group. The layout of the composite video display area 910 is changed by the user selecting a specific individual layout by the operation input means 50. For example, in FIG. 6, the individual video KA, KB, EC, and KD are displayed in the composite video display area 910 according to the individual layout LZ. By changing the layout of the screen, for example, the individual layouts LB, LD, LZ, LA in the layout group according to the progress of the surgical procedure, the user can create an individual image that the user thinks is most necessary at that time. , Can be displayed in an appropriate layout.

That is, the video integration system 1 includes a layout group registration processing unit 550 in which layout groups in which a desired plurality of individual layouts are selected and grouped from a plurality of individual layouts are registered in advance, and the individual output video generation processing units 600 are individually registered. The layout selection unit 630 prompts the user to select a desired individual layout from the layout group, refers to the individual layout selected by the user from the layout group, and refers to the composite video display screen 900. Generate a signal.

If the individual video changes over time even when the layout is changed or updated, it is desirable to refresh the video in substantially real time to prevent the individual video from stopping for a long time.

FIG. 7 shows an explanatory diagram of the layout registration screen 950 having the layout editing area 952. The layout editing area 952 displays layout contents (including a plurality of individual images) edited by the user. The layout registration screen 950 further includes a layout sample display area 954 for reducing and displaying the created layout sample, and a registration individual video sample list display area 958 for displaying a displayable individual video sample list.

Specifically, when you want to create a new individual layout, select the new button 957. In the new individual layout, nothing is displayed in the layout editing area 952. The user selects an icon corresponding to the individual video to be displayed from the registration individual video sample list display area 958 on the layout registration screen 950, and performs a so-called drag-and-drop operation on the layout edit area 952. Select an individual video. In the layout editing area 952, the user can change the size, position, and the like of each individual image by operating the operation input means 50, for example, a mouse. After editing the individual layout, the individual layout is registered by selecting the registration button 956.

FIG. 8 shows an explanatory diagram of the layout group registration screen 960 having the category setting area 968. On the layout group registration screen 960, the user can edit and register the layout group. The layout group registration screen 960 further completes layout editing, including a layout group editing area 962 for displaying a plurality of selected individual layouts, an individual layout sample display area 964 for displaying a list of created individual layout samples, and layout editing. Then, a registration button 966 for newly registering the layout as an individual layout is provided. The user can select a specific layout group by selecting the item displayed in the category setting area 968 by the operation input means 50. For example, in FIG. 8, when the item "B" is selected in the item 1 of the category setting area 968 and "t_k1_1" is selected in the item 2 of the ray category setting area 968, the layout group editing area 962 has an individual layout. A layout group consisting of "LB", "LD", and "LZ" is displayed. By selecting the add button, the user can appropriately select an individual layout from the individual layout sample display area 964 and add it to the layout group. The user can also delete a specific individual layout from the layout group by selecting the delete button.

FIG. 9 shows an explanatory diagram of the composite video display screen 900. In the video integration system 1 according to the present embodiment, the size and layout of the individual video of the composite video display area 910 included in the composite video display screen 900 of the display device 25 can be changed in real time. Specifically, when the layout is as shown in FIG. 9A and the user wants to enlarge and display the individual video KB1, the KC and KD1 of the individual video are reduced and the individual video KB1 is displayed. It can be enlarged and displayed as an individual video KB2 (see FIG. 9B). At this time, the overlapping portion of the individual video KB2 and the individual video KD2 and the overlapping portion of the individual video KB2 and the individual video KA may be displayed by changing the display transmittance, respectively. You may highlight one by clicking.

FIG. 10A shows a functional block diagram relating to signal processing of individual video in the function realized by the control unit 30 of the video integrated system 1. What is realized by the control unit 30 is a composite image generation control function corresponding to the synthetic image generation control unit 500 that synthesizes a plurality of screens, and a display display authentication function corresponding to the display display authentication unit 510 that authenticates the display display. And the individual video management authentication function corresponding to the individual video management unit 520 that manages the management information of the individual video such as the resolution, the resolution acquisition processing authentication function corresponding to the resolution acquisition processing unit 522 that acquires the resolution, and the aspect ratio. Aspect ratio acquisition processing authentication function corresponding to the aspect ratio acquisition processing unit 524 to be acquired, and an individual video display method corresponding to the setting processing unit 526 that can set the name, icon, frame color, etc. of the individual video for each input system. It is a setting process.

That is, the video integration system 1 has an individual video management function for acquiring management information of resolution and / or aspect ratio based on the signal of the individual video, and a composite video display while maintaining the aspect ratio of each of the plurality of individual videos. It is equipped with a standardized processing function that converts multiple individual images in order to apply it to the screen signal, and the output video generation processing function uses the standardized individual video to display the signal for the composite video display screen. Generate.

Further, the standardization processing function may standardize the analog data by digitally converting it when a part or all of the individual images in the plurality of individual images are analog data.

FIG. 10B shows a functional block diagram relating to the individual layout and the layout group registration process. What is realized by the control unit 30 is an individual layout registration processing function corresponding to the individual layout registration processing unit 540 and a layout group registration processing function corresponding to the layout group registration processing unit 550.

The video integration system 1 is provided with an individual layout registration processing function in which individual layouts having a positional relationship of a plurality of individual videos displayed in the composite video display screen by the control unit 30 are registered in advance, and an output video generation processing function. Is desirable to generate a signal for the composite video display screen by referring to the individual layout.

The video integration system 1 includes an operation input terminal 51 that receives an operation input of a user by an operation input means, and as a function realized by the control unit 30, an individual layout registration processing function, that is, an operation input related to layout adjustment of the individual video. It is desirable to have an individual layout editing function that outputs a layout registration screen including a layout editing area that prompts the user and edits the individual layout based on the operation input.

FIG. 11 shows an individual video and a functional block diagram related to processing related to the individual layout. What is realized by the control unit 30 is a composite video by combining an output video generation processing function corresponding to the output video generation processing unit 600 that generates a composite video and outputs it to the outside (output video output terminal) and an individual video. When the individual video compositing processing function corresponding to the individual video compositing processing unit 610 to be generated and the individual video overlap in the composite video, the individual video on the front is transparent and the individual video on the back can be seen through. The individual video transmission display processing function corresponding to the individual video transmission display processing unit 612 and the video signals of different standards generated by multiple individual devices are displayed on the screen while maintaining the aspect ratio even if the video size is changed. The individual video standardization processing function corresponding to the individual video standardization processing unit 614 that performs standardization processing to standardize the layout group, and the layout group selection function corresponding to the layout group selection unit 620 that selects the layout group. The individual layout selection function corresponding to the individual layout selection unit 630 that selects the individual layout, the individual layout direct editing processing function corresponding to the individual layout direct editing processing unit 640 that makes it possible to edit the layout being displayed, and the size of the individual video. , The individual video adjustment processing function corresponding to the individual video adjustment processing unit 642 that can change the context, and the individual video addition processing function corresponding to the individual video addition processing unit 644 to add individual video, and a new addition with a single button. This is an individual video update processing function corresponding to the individual video update processing unit 646 that can add the individual video to the list.

These functions are realized by the control unit 30 executing the program stored in the recording area 80 such as the program of the memory 40, and the hardware such as the input interface 10, the output interface 20, and the operation input means 50 working together. To.

Next, the operation of the above-described embodiment will be described.

FIG. 12 shows a flowchart of an operation for directly editing an individual layout among the operations executed by the control unit 30.

First, the control unit 30 selects a specific layout group by the layout group selection function for selecting the layout group selected by the user (step S1). Next, a signal for output to the display device 25 is generated by the individual video composition processing function and the output video generation processing function according to the individual layout in the layout group, and the composite video display screen 900 is displayed on the display device 25 (step). S2). If there is no layout edit command (NO in step S3), the composite video display screen 900 is continuously displayed as it is. If there is a layout edit command (YES in step S3), a screen (see FIG. 5) where the layout can be edited and registered is displayed (step S4), and layout editing is performed by the individual layout direct editing processing function (not shown). ). Then, the layout after editing is generated by the individual video transparent display processing function, the individual video adjustment processing function, and the individual video addition processing function, and the screen is displayed in the edited layout (step S5). If the update button (see FIG. 5A) is selected (YES in step S6), the individual layout is updated to the edited layout (step S7). If the update button (see FIG. 5A) is not selected (NO in step S6), the individual layout is not updated and the composite video display screen 900 is displayed according to the original individual layout (returning to step S2). If there is a display stop command (YES in step S8), it ends (step S9), and if there is a display stop command (NO in step S8), the composite video display screen 900 is displayed according to the individual layout (step). Return to S2).

FIG. 13 shows a flowchart of an operation of displaying a layout group among the operations executed by the control unit 30, selecting an individual layout, and changing the display of the composite video display screen.

First, the control unit 30 selects a specific layout group by the layout group selection function for selecting the layout group selected by the user (step T1). Next, a signal for output to the display device 25 is generated by the individual video composition processing function and the output video generation processing function according to the individual layout in the layout group, and the composite video display screen 900 is displayed on the display device 25 (step). T2). If there is no layout selection command (NO in step T3), the composite video display screen 900 is continuously displayed. If there is a layout selection command (YES in step T3), a screen for displaying the individual layout list in the layout group is displayed (see FIG. 6) (step T4). The layout group selection function allows the user to select an individual layout in the layout group (step T5), and displays the screen in the layout after selection (step T6). If there is a display stop command (YES in step T7), it ends (step T8), and if there is a display stop command (NO in step T7), the composite video display screen 900 is displayed according to the individual layout (step). Return to T2).

According to the video integration system 1 according to the embodiment of the present invention, individual video signals from a plurality of individual devices 15 can be synthesized in substantially real time and displayed on a single display screen 25. Therefore, the user is freed from the complicated operation of checking the images displayed on the monitors provided in each of the plurality of individual devices 15, which is extremely excellent in improving the accuracy and efficiency of the work. Has an effect.

According to the video integrated system 1 according to the embodiment of the present invention, video signals of different standards generated by a plurality of individual devices 15 can be displayed on the screen while maintaining the aspect ratio even if the video size is changed. Since the standardization process is performed to standardize the image so that it can be standardized, it is possible to generate an image in real time while maintaining the shape, and it has an excellent effect of being able to display an image that can be used as a material for accurate judgment by the user.

According to the video integrated system 1 according to the embodiment of the present invention, a video signal from a device that generates an analog video signal and a video signal from a device that generates a digital video signal are simultaneously displayed on a single screen. It has the excellent effect of being able to do.

According to the video integration system 1 according to the embodiment of the present invention, the user can register in advance individual layouts representing the positional relationships of a plurality of individual videos, and the composite video can be displayed according to the individual layouts, which is necessary during a series of operations. It is possible to call the layout as appropriate and change the layout in real time, which has the excellent effect of improving work accuracy and efficiency.

According to the video integration system 1 according to the embodiment of the present invention, since the layout of the individual video can be adjusted in real time, it is possible to change the layout of the individual video to the optimum layout during the work, which is an excellent effect.

According to the video integration system 1 according to the embodiment of the present invention, the optimum layout can be easily selected from the individual layouts registered in advance by the user and displayed on the screen, so that the user himself / herself can display the layout during a series of operations. Has the excellent effect of being able to proceed with the work while selecting the optimal layout.

According to the video integration system 1 according to the embodiment of the present invention, the individual layout list, which is a list of selectable individual layouts, can be displayed on the composite video display screen 900, so that the user can display the individual layout list during a series of operations. It has the excellent effect of being able to proceed with the work while selecting the optimum layout.

According to the video integration system 1 according to the embodiment of the present invention, the user can adjust the layout of the individual video in real time while working, so that the layout of the individual video can always be changed to the optimum layout. It has an excellent effect.

According to the video integration system 1 according to the embodiment of the present invention, the user himself / herself can adjust the relative position, context, size, and brightness of the individual video in real time while working, so that the user's work is accurate. It has the excellent effect of improving the performance and displaying an image that can be used as a material for accurate judgment by the user.

According to the video integration system 1 according to the embodiment of the present invention, there is an excellent effect that the user can appropriately select necessary video signals during work and additionally display them on the screen.

According to the video integration system 1 according to the embodiment of the present invention, the user can proceed with the work while selecting the optimum layout in real time from the layout group which is a set of layouts registered in advance by the user. It works.

It should be noted that the video integration system of the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made without departing from the gist of the present invention.

For example, the video integration system of the present invention has an embodiment in which the above-mentioned individual device 15 is premised on a medical device, a monitoring system in a cell culture factory, a nuclear reactor control system, and device management in a large ship or an aircraft. In an environment such as a system where postponement or interruption of work is not allowed, it is desirable that the type, arrangement, and size of individual video required by the user can be easily changed in near real time. Used in.

1 Video integrated system 10 Input interface 12 Individual video signal input terminal 15 Individual device 20 Output interface 20A Output signal distribution means 20B Output signal conversion means 22 Synthetic video output terminal 25 Display device 30 Control unit 40 Memory 50 Operation input means 51 Operation input terminal 60 bus 70 CPU
72 RAM
74 ROM
80 Program recording area 90 Past video information recording area 100 Layout information recording area 500 Composite video generation control unit 510 Display display authentication means 520 Individual video management unit 522 Resolution acquisition processing unit 524 Aspect ratio acquisition processing unit 526 Individual video display method setting processing 540 Individual layout registration processing unit 550 Layout group registration processing unit 600 Output video generation processing unit 610 Individual video composition processing unit 612 Individual video transmission display processing unit 614 Individual video standardization processing unit 620 Layout group selection unit 630 Individual layout selection unit 640 Individual layout direct editing processing unit 642 Individual video adjustment processing unit 644 Individual video addition processing unit 646 Individual video update processing unit 800 Individual video management screen 900 Composite video display screen 905 Layout group selection area 910 Composite video display area 920 Individual layout list display area 930 Individual video sample list display area for addition 940 Individual layout direct edit area 950 Layout registration screen 952 Layout edit area 954 Layout sample display area 956 Registration button 958 Individual video sample list display area for registration 960 Layout group registration screen 962 Layout group edit area 964 Individual layout sample display area 966 Registration button 968 Category setting area

Claims (8)

At least two individual video signal input terminals that are connected to video output terminals of a plurality of medical devices that acquire patient information during surgery and to which individual video signals generated by the medical device are input.
An output video generation processing unit that generates a signal for a composite video display screen in which a plurality of the individual videos are projected on a single screen by synthesizing the plurality of the individual videos in substantially real time.
A composite video output terminal that outputs a signal for the composite video display screen to the display,
An individual layout registration processing unit in which individual layouts displayed in the composite video display screen and having a positional relationship between the plurality of individual videos are registered in advance.
A layout group registration processing unit in which a layout group in which a desired plurality of individual layouts are selected and grouped from the plurality of individual layouts is registered in advance, and a layout group registration processing unit.
Equipped with
The output video generation processing unit includes a plurality of individual layout list display areas for displaying a list of a plurality of individual layouts that can be selected from the layout group in a part of the composite video display screen. It has an individual layout selection unit that allows the desired individual layout to be selected from the individual layouts.
The output video generation processing unit refers to the individual layout selected by the user from the layout group to generate a signal for the composite video display screen.
The composite video display screen includes a layout group selection area, which is a screen area in which the layout group can be selected.
In the layout group selection area, a plurality of items that can be selected by the user are displayed.
A video integration system, characterized in that a specific layout group corresponding to the selected item is displayed in the individual layout list display area . An individual video management unit that acquires resolution and aspect ratio management information based on the individual video signal, and
A standardization processing unit that converts a plurality of the individual images in order to apply the signal to the composite image display screen while maintaining the aspect ratio of each of the plurality of individual images is provided.
The output video generation processing unit is characterized in that the signal for the composite video display screen is generated by using the standardized individual video.
The video integration system according to claim 1. The standardization processing unit is characterized in that, when a part or all of the individual images in the plurality of individual images are analog data, the analog data is digitally converted and standardized.
The video integration system according to claim 2. It is equipped with an operation input terminal that accepts the operation input of the user by the operation input means.
The individual layout registration processing unit outputs a layout registration screen including a layout editing area that can be edited by the user and displays layout contents including a plurality of the individual videos in a part of the composite video display screen. It is characterized by having an individual layout editing unit that edits the individual layout based on the operation input.
The video integration system according to any one of claims 1 to 3. The output video generation processing unit outputs a signal including an individual layout direct editing area that displays a list of the individual videos in substantially real time on a part of the composite video display screen, and is based on the operation input of the user. It is characterized by having the individual layout direct editing processing unit for changing the layout of the composite video display screen being generated.
The video integration system according to any one of claims 1 to 4. The individual layout direct editing area is characterized in that at least one of the relative position, context, size, and brightness of the plurality of individual images displayed in substantially real time can be adjusted.
The video integration system according to claim 5. The individual layout direct editing processing unit outputs a signal including a list of the individual images that can be newly added to the composite image display screen in a part of the composite image display screen, and is based on the operation input of the user. The individual video selected in the above is additionally displayed on the composite video display screen being generated.
The video integration system according to claim 5 or 6. It is provided with an individual video management unit that acquires management information of resolution and aspect ratio based on the signal of the individual video.
The individual video management unit gives an instruction to output the individual video at the vertical resolution and the horizontal resolution required by the display to each of the plurality of medical devices, and displays the individual video management screen on the display. The video integration system according to claim 1, wherein the values of the vertical resolution and the horizontal resolution for instructing each of the medical devices can be input / updated.

Images