JP2018112716A - Video integration system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video integration system that integrates a plurality of video signals generated by a plurality of pieces of medical equipment and differing in standard substantially in real time, and displays the resulting video in a layout freely changeable state.SOLUTION: A video integration system comprises: at least two individual video signal input terminals to which video output terminals of a plurality of pieces of individual equipment are connected respectively and signals of individual videos generated by the individual equipment are input; an output video generation processing part which puts a plurality of individual videos together substantially in real time so as to generate a signal for composite video display screen for displaying the plurality of individual videos in a single picture; and a composite video output terminal which outputs the signal for composite video display screen to a display.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video integration system that integrates and displays video from a plurality of individual devices, for example, a plurality of medical devices, in substantially real time.

  In recent years, many diagnostic imaging apparatuses are used in the medical field. For example, in catheter therapy for circulatory diseases, treatment is performed while an operator grasps the position of the catheter in real time using an X-ray image.

  FIG. 14A shows a conventional surgical mode in which a plurality of medical devices 310A to 310C are provided with monitors, respectively, and the surgeon performs treatment while observing the biological information of the patient P and the video of the affected area. It is explanatory drawing which shows. However, in such an embodiment, during the operation, doctors and nurses are provided in different places, including a biological information monitor that acquires and displays the patient's biological information such as blood pressure, oxygen saturation, and electrocardiogram. It is necessary to grasp video information from many medical devices at the same time. Carrying out complex procedures while viewing the image displays provided on individual medical devices on each device is cumbersome and likely to overlook danger.

  For this reason, as shown in FIG. 14B, a monitor device has been developed that integrates videos from a plurality of medical devices 310 and provides them as a single integrated screen 320 (see, for example, Patent Document 1).

Japanese Patent No. 585647

  However, in the current device, input video from multiple medical devices can be displayed in multiple screens on a single screen, but the video signal standard from each medical device is different, so changing the screen layout, It was difficult for non-specialized engineers to add video from a new device during surgery, and to change the video size in real time when observing the affected area as a large video on the monitor during surgery. . In addition, there is a problem that it is difficult to change the screen layout as the operation progresses.

  In view of such circumstances, the present invention intends to provide a video integration system that integrates a plurality of video signals of different standards generated by a plurality of medical devices in substantially real time and displays the layout in a freely changeable manner. is there.

  (1) The present invention includes at least two individual video signal input terminals that are connected to video output terminals of a plurality of individual devices, to which individual video signals generated by the individual devices are input, and a plurality of the individual videos. Are synthesized in substantially real time, an output video generation processing unit that generates a signal for a composite video display screen in which a plurality of the individual videos are displayed in a single screen, and a signal for the composite video display screen. Provided is a video integration system comprising a composite video output terminal for outputting to a display.

  According to the invention described in (1) above, individual video signals from a plurality of devices can be synthesized in substantially real time and displayed in a single display screen. Therefore, the user is freed from the troublesome operation of confirming the images displayed on the monitors provided in each of the plurality of devices, so that the remarkably excellent effect of improving the accuracy and efficiency of the work is achieved. Play.

  (2) In the present invention, an individual video management unit that acquires management information of resolution and / or aspect ratio based on the signal of the individual video, and maintaining the aspect ratio of each of the plurality of individual videos, In order to apply the signal for the composite video display screen, a standardization processing unit that converts a plurality of the individual video, the output video generation processing unit, using the standardized individual video, The video integration system according to (1) above, wherein a signal for the composite video display screen is generated.

  According to the invention described in (2) above, video signals with different standards generated by a plurality of individual devices can be displayed on the screen while maintaining the aspect ratio even if the video size is changed. Since the normalization process is performed, it is possible to generate an image with its shape maintained in real time, and to display an image that can be used as a material for accurate judgment by the user.

  (3) The present invention is characterized in that the normalization processing unit standardizes the analog data by performing digital conversion when some or all of the individual videos in the plurality of individual videos are analog data. The video integration system according to (2) is provided.

  According to the invention described in (3) above, the video signal from the device that generates the analog video signal and the video signal from the device that generates the digital video signal can be simultaneously displayed in a single screen. There is an excellent effect that it becomes possible.

  (4) The present invention includes an individual layout registration processing unit in which individual layouts that are displayed in the composite video display screen and have a positional relationship among the plurality of individual videos are registered in advance, and the output video generation processing unit includes: The video integration system according to any one of (1) to (3) above, wherein a signal for the composite video display screen is generated with reference to the individual layout.

  According to the invention described in (4) above, since the user can register in advance an individual layout that represents the positional relationship of a plurality of individual videos, and a composite video can be displayed accordingly, a layout required during a series of operations can be appropriately selected. It is possible to call and change the layout in real time, which has an excellent effect of improving work accuracy and efficiency.

  (5) The present invention includes an operation input terminal that receives a user's operation input by an operation input unit, and the individual layout registration processing unit has a layout editing area that prompts the user for an operation input related to layout adjustment of the individual video. The video integration system according to (4) is provided, which includes the individual layout editing unit that outputs a layout registration screen including the editing information and edits the individual layout based on the operation input.

  According to the invention described in (5) above, since the layout adjustment of the individual video can be performed in real time, there is an excellent effect that the layout can be changed to the optimum individual video layout during the work.

  (6) In the present invention, the output video generation processing unit includes an individual layout selection unit that prompts the user to select a desired individual layout from among the plurality of individual layouts, and is selected by the user. In addition, the video integration system according to (4) or (5) is provided, wherein a signal for the composite video display screen is generated with reference to the individual layout.

  According to the invention described in (6) above, since the optimum layout can be easily selected and displayed on the screen from the individual layouts registered in advance by the user, the user himself / herself is optimal during a series of operations. There is an excellent effect that work can be performed while selecting a layout.

  (7) The present invention is characterized in that the individual layout selection unit includes an individual layout list display area that is a list of selectable individual layouts in a part or all of the composite video display screen. A video integration system according to (6) is provided.

  According to the invention described in (7) above, since the individual layout list that is a list of selectable individual layouts can be displayed on the composite video display screen, the user himself / herself is optimal during a series of operations. There is an excellent effect that work can be performed while selecting a layout.

  (8) The present invention provides an individual layout direct editing area in which the output video generation processing section prompts a user to input an operation for adjusting the layout of the individual video in substantially real time in a part or all of the composite video display screen. (4) to (7), wherein the individual layout direct editing processing unit is configured to output a signal including, and change a layout of the composite video display screen being generated based on the operation input. A video integration system according to any of the above is provided.

  According to the invention described in (8) above, since the user can adjust the layout of the individual video in real time while working, the excellent effect that the layout can always be changed to the optimum individual video layout. Play.

  (9) The present invention is characterized in that, in the individual layout direct editing area, at least one of the relative position, the front-rear relationship, the size, and the brightness of the plurality of individual images displayed in substantially real time can be adjusted. The video integration system described in (8) above is provided.

  According to the invention described in (9) above, since the user can adjust the relative position, the context, the size, and the brightness of the individual video in real time while working, the accuracy of the user's work is improved. This makes it possible to display an image that can be used as a material for accurate judgment by the user.

  (10) In the present invention, the individual layout direct editing processing unit outputs a signal including a list of the individual videos that can be newly added to the composite video display screen in part or all of the composite video display screen. The video integration system according to (8) or (9), wherein the individual video selected based on a user operation input is additionally displayed on the composite video display screen being generated. provide.

  According to the invention described in the above (10), there is an excellent effect that the user can appropriately select a necessary video signal during work and additionally display it on the screen.

  (11) The present invention includes a layout group registration processing unit in which a layout group obtained by selecting and grouping a plurality of desired individual layouts from a plurality of the individual layouts is registered in advance, and the output video generation processing unit The individual layout selection unit prompts the user to select a desired individual layout from the layout group, and refers to the individual layout selected by the user from the layout group and performs the synthesis A video integration system according to (6) or (7), characterized in that a signal for a video display screen is generated.

  According to the invention described in (11) above, there is an excellent effect that the user can proceed with work while selecting an optimum layout in real time from a layout group that is a set of layouts registered in advance by the user. .

  According to the video integration system of claims 1 to 11 of the present invention, video that integrates a plurality of video signals having different standards generated by a plurality of medical devices in substantially real time and displays the layout in a freely changeable manner. An excellent effect that an integrated system can be provided can be achieved.

1 is a configuration diagram of a video integration system according to an embodiment of the present invention. It is explanatory drawing of a synthetic | combination video display screen. It is explanatory drawing of an individual image | video management screen. It is explanatory drawing of the synthetic | combination video display screen in the case of having a synthetic | combination video display area. (A) It is explanatory drawing of the synthetic | combination video display screen which has an individual layout direct edit area. (B) It is explanatory drawing explaining the operation | movement which selects an individual image | video from the addition separate image | video sample list display area and adds it to an individual layout in a synthetic | combination image | video display screen. It is explanatory drawing of the synthetic | combination video display screen which has an individual layout list display area. It is explanatory drawing of the layout registration screen which has a layout edit area. It is explanatory drawing of the layout group registration screen which has a category setting area | region. (A) It is explanatory drawing of a synthetic | combination video display screen. (B) It is explanatory drawing which shows the mode of the transparent display of the operation | movement which changes the position and size of an individual image | video in a synthetic | combination image | video display screen, and the overlapping part of an individual image | video. (A) It is a functional block diagram regarding the process of the signal of an individual video in the function implement | achieved by the control part of a video integration system. (B) It is a functional block diagram regarding the registration process of an individual layout and a layout group. It is a functional block diagram regarding the process regarding an individual video and an individual layout. It is a flowchart of the operation | movement which directly edits an individual layout. It is a flowchart of the operation | movement which performs a layout group display, selects an individual layout, and changes the display of a synthetic | combination video display screen. (A) It is a conceptual diagram explaining the aspect of the conventional operation | movement using the some medical device which has a monitor, respectively. (B) It is a conceptual diagram explaining the conventional monitor which integrates the image | video from several medical devices on one screen.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. 1 to 13 are examples of embodiments for carrying out the invention, and in the drawings, the same reference numerals denote the same components. In addition, a part of the configuration is omitted as appropriate in each drawing to simplify the drawing. The size, shape, thickness, etc. of the members are exaggerated as appropriate.

  FIG. 1 shows a configuration diagram of a video integration system 1 according to an embodiment of the present invention. The video integration system 1 includes a control unit 30 that controls and processes the entire system, a bus 60 that connects each device to the control unit 30, a memory 40 that records information about programs and data, and a user who inputs information. Operation input means 50 for performing operations, an input interface 10 for signals from individual devices 15 that each generate a video signal and connected to the video integration system 1, and a display that displays the video integrated by the video integration system 1 An output interface 20 for signals to the device 25 is provided.

  The control unit 30 includes a CPU 70, a RAM 72, a ROM 74, and the like, and executes various controls. The CPU 70 is a so-called central processing unit and executes various programs to realize various functions. The RAM 72 is used as a work area and a storage area for the CPU, and the ROM 74 stores an operating system and programs executed by the CPU.

  The memory 40 is a recording medium such as a hard disk or an SSD (Solid State Drive), such as a program recording area 80 for recording a program, a past video information recording area 90 for recording past video data, and an arrangement and size of individual videos. Layout information recording area 100 for recording layout information such as.

  The operation input means 50 is a general input device such as a keyboard, a mouse, a trackball, and a touch panel provided in the display device 25.

  The input interface 10 includes a plurality of individual video signal input terminals 12 for inputting video signals from the individual device 15. The individual video signal input terminal 12 is, for example, an HDMI (registered trademark) terminal (High-Definition Multimedia Interface: high definition multimedia interface), an S video terminal, a BNC terminal, a USB terminal, a VGA terminal, or the like.

  The output interface 20 is an interface that outputs an integrated (synthesized) video signal to the display device 25. For example, the output interface 20A distributes an HDMI (registered trademark) signal into a plurality of signals, and an HDMI (registered trademark), for example. Output signal conversion means 20B for converting a signal into a LAN signal is provided. The output interface 20 has a composite video output terminal 22 that outputs a composite video signal to the display device 25. The composite video output terminal 22 is, for example, a LAN terminal, an HDMI (registered trademark) terminal (High-Definition Multimedia Interface: high definition multimedia interface), an S video terminal, a BNC terminal, a USB terminal, a VGA terminal, or the like.

  That is, the video integration system 1 is connected to the video output terminals of a plurality of individual devices 15, and includes at least two individual video signal input terminals 12 to which individual video signals generated by the individual devices 15 are input. An output video generation processing unit 600 that generates a signal for a composite video display screen 900 in which a plurality of individual videos are displayed in a single screen of the display device 25 by synthesizing the individual video in substantially real time, and a composite video A composite video output terminal 22 for outputting a signal for the display screen 900 to the display device 25 is provided.

  FIG. 2 is an explanatory diagram of a composite video display screen 900 displayed on the display device 25.

  Here, an image based on a video signal from an individual device is defined as an individual image, a positional relationship when arranging a plurality of individual images on one screen is defined as an individual layout, and a set that handles a plurality of different individual layouts as a group is defined as a layout group.

  In FIG. 2, a composite video display screen 900 displays a layout group selection area 905 that is a screen area that can select a layout group that is a set of layouts that are individual video arrangements, and a list of individual layouts of the designated layout group. An individual layout list display area 920 is provided.

  The user can select a specific layout group by selecting items displayed in the layout group selection area 905 by the operation input means 50. For example, when the item “A” is selected in item 1 of the layout group selection area 905A in FIG. 2 and “t_k1_3” is selected in item 2 of the layout group selection area 905B, the individual layout list display area 920 displays the individual layout. A layout group consisting of “LA”, “LZ”, and “LC” is displayed. For example, when a plurality of doctors use the video integration system 1 in a medical field, if the name of the doctor in charge is input as item 1 and the operation method is input in item 2, for example, the doctor in charge uses it during the operation. You can quickly choose the layout of the individual video you want.

  The composite video display screen 900 is further selected in a system setting button 901 displayed on the individual video management screen 800 for managing individual video, a new edit button 902 for displaying a layout registration screen 950 described later, and a layout group selection area 905. According to the individual layout of the layout group, a start button 903 for starting a composite video display screen 900 that displays a composite video display area 910 described later is provided.

  FIG. 3 shows an explanatory diagram of the individual video management screen 800. On the individual video management screen 800, management information of the individual video signal from the individual device 15 input from the individual video signal input terminal 12 is displayed. The management information is, for example, the name of the individual device 15, the resolution of the video from the individual device 15, the aspect ratio, and the like. The video integration system 1 transmits appropriate EDID data (Extended Display Identification Data) to each of the individual devices 15 connected to the individual video signal input terminal 12, for example, and receives a signal according to the necessary resolution and aspect ratio. . On the individual video management screen 800, the user can input and update the necessary resolution, icons displayed in a registration individual video sample list display area 958, which will be described later, the background color of the individual video, and the like by the operation input means 50. The individual video management screen 800 further includes a determination button 904 for updating or determining the management information displayed on the individual video management screen 800 and input.

  FIG. 4 is an explanatory diagram of a composite video display screen 900 when the composite video display area 910 is provided. The synthetic video display screen 900 is used when, for example, in a medical field, a doctor or a nurse performs a procedure while referring to a patient's biological information, an image of an affected part, or the like during surgery. For this reason, unnecessary control information not related to surgery is not displayed. In the composite video display area 910, for example, individual videos KA, KB, KC, and KD are displayed according to individual layouts registered in advance. At this time, it is desirable that a plurality of individual layouts grouped in the layout group selected in FIG. 2 are ordered and selected in order. In FIG. 2, it is desirable that the order of the individual layouts can be changed by the operation input means 50 in the individual layout list display area 920. For example, it is desirable that the order can be changed by dragging the icon of each individual layout displayed in the individual layout list display area 920.

  In the video integration system 1, the output video generation processing unit 600 includes an individual layout direct editing area 940 that prompts the user to input an operation for adjusting the layout of the individual video in substantially real time on a part or all of the composite video display screen 900. It is desirable to have an individual layout direct editing processing unit 640 that outputs a signal including the output and changes the layout of the composite video display screen 900 being generated based on the operation input.

  When the individual video changes over time, it is desirable to prevent the individual video from stopping for a long time by refreshing the video in substantially real time.

  FIG. 5A shows an explanatory diagram of a composite video display screen 900 having an individual layout direct editing area 940. In order to display the composite video display screen 900, the user left-clicks the mouse provided as the operation input unit 50 in the composite video display area 910 of FIG. The composite video display screen 900 includes an individual layout direct editing area 940 that allows transition from the composite video display area 910 to directly edit an individual layout that is currently displayed. The composite video display screen 900 also includes an additional individual video sample list display area 930 that displays an individual video list and can be additionally displayed on the current individual layout as a sidebar. In FIG. 5A, for example, a layout for displaying individual videos KA, KB, and KD in the individual layout direct editing area 940 is selected as the individual layout LZ. In the individual layout direct editing area 940, the user can change the size, position, etc. of each individual video by operating the operation input means 50, for example, a mouse.

  That is, in the individual layout direct editing area 940, it is desirable to be able to adjust at least one of the relative position, the front-rear relationship, the size, and the brightness of a plurality of individual videos displayed in substantially real time.

  When the individual video changes over time, it is desirable to prevent the individual video from stopping for a long time by refreshing the video in substantially real time.

  FIG. 5B is an explanatory diagram for explaining an operation of selecting a specific individual video from the additional individual video sample list display area 930 and additionally displaying it on the synthetic video display screen 900 on the synthetic video display screen 900. . For example, the user selects the individual video KC1 displayed as a sample in the additional individual video sample list display area 930 with the mouse as the operation input unit 50, and follows the locus indicated by the one-dot chain line arrow. Therefore, a so-called drag-and-drop operation can be displayed in the individual layout direct editing area 940 as the individual video KC2 at an appropriate position. Note that the user can update and register the individual layout LZ as a new individual layout further including the individual video KC by selecting the update button 945 shown in FIG. 5, for example.

  That is, the individual layout direct editing processing unit 640 that edits the individual layout outputs a signal including a list of individual videos that can be newly added to the synthesized video display screen 900 in part or all of the synthesized video display screen 900 for use. The individual video selected based on the user's operation input is additionally displayed on the composite video display screen 900 being generated.

  FIG. 6 is an explanatory diagram of a composite video display screen 900 having an individual layout list display area 920. The individual layout list display area 920 displays a list of individual layouts of the designated layout group. The composite video display screen 900 is displayed, for example, when the user right-clicks a mouse provided as the operation input unit 50 in the composite video display area 910 of FIG.

The composite video display screen 900 includes a composite video display area 910 and an individual layout list display area 920, and an individual layout in the selected layout group is displayed in the individual layout list display area 920. When the user selects a specific individual layout by the operation input means 50, the layout of the composite video display area 910 is changed. For example, in FIG. 6, individual videos KA, KB, EC, and KD are displayed in the composite video display area 910 according to the individual layout LZ. For example, the user can change the individual layouts LB, LD, LZ, LA in the layout group and the screen layout according to the progress of the surgical procedure, so that the individual image that the user thinks is most necessary at that time is displayed. Can be displayed in an appropriate layout.

  That is, the video integration system 1 includes a layout group registration processing unit 550 in which a layout group obtained by selecting and grouping a plurality of desired individual layouts from a plurality of individual layouts is registered in advance. The layout selection unit 630 prompts the user to select a desired individual layout from the layout group, and refers to the individual layout selected by the user from the layout group, for the composite video display screen 900. Generate a signal.

  Even when the layout is changed and updated, if the individual video changes over time, it is desirable to prevent the individual video from stopping for a long time by refreshing the video in substantially real time.

  FIG. 7 shows an explanatory diagram of a layout registration screen 950 having a layout editing area 952. The layout editing area 952 displays layout contents (including a plurality of individual videos) edited by the user. The layout registration screen 950 further includes a layout sample display area 954 for displaying a reduced layout sample and a registration individual video sample list display area 958 for displaying a list of displayable individual video samples.

  Specifically, when a new individual layout is to be created, the new button 957 is selected. In the new individual layout, nothing is displayed in the layout editing area 952. The user selects an icon corresponding to the individual video to be displayed from the registration individual video sample list display area 958 on the layout registration screen 950, and performs a so-called drag and drop operation on the layout editing area 952. Select individual images. In the layout editing area 952, the user can change the size, position, etc. of each individual video by operating the operation input means 50, for example, a mouse. After the editing of the individual layout is completed, the individual layout is registered by selecting a registration button 956.

  FIG. 8 shows an explanatory diagram of a layout group registration screen 960 having a category setting area 968. On the layout group registration screen 960, the user can edit and register a layout group. The layout group registration screen 960 further completes layout editing, a layout group editing area 962 that displays a plurality of selected individual layouts, an individual layout sample display area 964 that displays a list of created individual layouts as a list A registration button 966 for newly registering the layout as an individual layout is provided. The user can select a specific layout group by selecting the items displayed in the category setting area 968 with the operation input means 50. For example, when the item “B” is selected in the item 1 of the category setting area 968 in FIG. 8 and “t_k1_1” is selected in the item 2 of the ray category setting area 968, the layout group editing area 962 has an individual layout. A layout group consisting of “LB”, “LD”, and “LZ” is displayed. The user can select an individual layout from the individual layout sample display area 964 and add it to the layout group by selecting an add button. The user can also delete a specific individual layout from the layout group by selecting a delete button.

  FIG. 9 is an explanatory diagram of the composite video display screen 900. In the video integration system 1 according to the present embodiment, the composite video display area 910 of the composite video display screen 900 of the display device 25 can change the size and layout of the individual video in real time. Specifically, in the layout as shown in FIG. 9A, when the user wants to enlarge and display the individual video KB1, the individual video KC and KD1 are reduced and the individual video KB1 is displayed. It can be enlarged and displayed as an individual video KB2 (see FIG. 9B). At this time, the overlapping part of the individual video KB2 and the individual video KD2 and the overlapping part of the individual video KB2 and the individual video KA may be displayed by changing the display transmittance, respectively. You may highlight either by clicking.

  FIG. 10A shows a functional block diagram related to individual video signal processing in the functions realized by the control unit 30 of the video integration system 1. The control unit 30 realizes a composite video generation control function corresponding to the composite video generation control unit 500 that combines a plurality of screens, and a display display authentication function corresponding to the display display authentication unit 510 that performs display display authentication. An individual video management authentication function corresponding to the individual video management unit 520 that manages individual video management information such as resolution, a resolution acquisition processing authentication function corresponding to the resolution acquisition processing unit 522 that acquires resolution, and an aspect ratio. An aspect ratio acquisition processing authentication function corresponding to the acquired aspect ratio acquisition processing unit 524 and an individual video display method corresponding to the individual video display method setting processing unit 526 capable of setting the name, icon, frame color, etc. of the individual video for each input system It is a setting process.

  In other words, the video integration system 1 can display a composite video while maintaining the individual video management function for acquiring the management information of the resolution and / or aspect ratio based on the individual video signal and the aspect ratio of each of the plurality of individual videos. A standardization processing function for converting a plurality of individual videos to be applied to a screen signal, and the output video generation processing function uses a standardized individual video to convert a composite video display screen signal. Generate.

  The normalization processing function may be standardized by digitally converting the analog data when some or all of the individual videos are analog data.

  FIG. 10B shows a functional block diagram related to individual layout and layout group registration processing. The control unit 30 realizes an individual layout registration processing function corresponding to the individual layout registration processing unit 540 and a layout group registration processing function corresponding to the layout group registration processing unit 550.

  The video integration system 1 includes an individual layout registration processing function in which individual layouts that are displayed in the composite video display screen by the control unit 30 and are registered in advance as positional relationships among a plurality of individual videos are provided, and an output video generation processing function It is desirable to generate a signal for the composite video display screen with reference to the individual layout.

  The video integration system 1 includes an operation input terminal 51 that receives a user's operation input by an operation input unit. As a function realized by the control unit 30, an individual layout registration processing function, that is, an operation input related to the layout adjustment of the individual video. It is desirable to have an individual layout editing function that outputs a layout registration screen including a layout editing area that prompts the user to edit the individual layout based on the operation input.

  FIG. 11 shows a functional block diagram related to processing related to individual video and individual layout. What is realized by the control unit 30 is to generate a composite video by combining the output video generation processing function corresponding to the output video generation processing unit 600 that generates a composite video and outputs it to the outside (output video output terminal), and the individual video. When the individual video composition processing function corresponding to the individual video composition processing unit 610 to be generated and the individual videos overlap in the synthesized video, the front individual video is transmitted and the rear individual video is seen through. The individual video transmission display processing function corresponding to the individual video transmission display processing unit 612 and the video signals of different standards generated by a plurality of individual devices are displayed on the screen while maintaining the aspect ratio even when the video size is changed. Select an individual video standardization processing function corresponding to the individual video standardization processing unit 614 that performs standardization processing to standardize the layout and a layout group. A layout group selection function corresponding to the out group selection unit 620, an individual layout selection function corresponding to the individual layout selection unit 630 for selecting an individual layout, and an individual layout direct editing processing unit 640 that enables editing of the displayed layout. Corresponding to the corresponding individual layout direct editing processing function, the individual video adjustment processing function corresponding to the individual video adjustment processing unit 642 that can change the size and context of the individual video, and the individual video addition processing unit 644 for adding the individual video. This is an individual video update processing function corresponding to the individual video update processing unit 646 capable of adding a list of newly added individual videos with the individual video addition processing function and one button.

  These functions are realized by the control unit 30 executing the program stored in the program recording area 80 of the memory 40, and the hardware such as the input interface 10, the output interface 20, and the operation input unit 50 cooperating. The

  Next, the operation of the above embodiment will be described.

  FIG. 12 shows a flowchart of an operation for directly editing an individual layout among the operations executed by the control unit 30.

  First, the control unit 30 selects a specific layout group by a layout group selection function for selecting a layout group selected by the user (step S1). Next, a signal to be output to the display device 25 is generated by the individual video composition processing function and the output video generation processing function according to the individual layout in the layout group, and the composite video display screen 900 is displayed on the display device 25 (step). S2). If there is no layout editing command (NO in step S3), the composite video display screen 900 is continuously displayed. If there is a layout editing command (in the case of YES at step S3), a screen for editing and registering the layout (see FIG. 5) is displayed (step S4), and layout editing is performed by the individual layout direct editing processing function (not shown). ). Then, an edited layout is generated by the individual video transmission display processing function, the individual video adjustment processing function, and the individual video addition processing function, and screen display is performed with the edited layout (step S5). If the update button (see FIG. 5A) is selected (YES in step S6), the individual layout is updated to the edited layout (step S7). If the update button (see FIG. 5A) is not selected (NO in step S6), the individual layout is not updated and the composite video display screen 900 is displayed according to the original individual layout (return to step S2). If there is a display stop command (in the case of YES in step S8), the process ends (step S9), and if there is a display stop command (in the case of NO in step S8), the composite video display screen 900 is displayed according to the individual layout (step). (Return to S2).

  FIG. 13 shows a flowchart of an operation of performing layout group display, selecting an individual layout, and changing the display of the composite video display screen among the operations executed by the control unit 30.

First, the control unit 30 selects a specific layout group by a layout group selection function for selecting a layout group selected by the user (step T1). Next, a signal to be output to the display device 25 is generated by the individual video composition processing function and the output video generation processing function according to the individual layout in the layout group, and the composite video display screen 900 is displayed on the display device 25 (step). T2). If there is no layout selection command (NO in step T3), the composite video display screen 900 is continuously displayed. If there is a layout selection command (in the case of YES at step T3), a screen for displaying the individual layout list in the layout group is displayed (see FIG. 6) (step T4). The layout group selection function allows the user to select an individual layout in the layout group (step T5), and screen display is performed with the selected layout (step T6). If there is a display stop command (YES in step T7), the process ends (step T8), and if there is a display stop command (NO in step T7), the composite video display screen 900 is displayed according to the individual layout (step). Return to T2).

  According to the video integration system 1 according to the embodiment of the present invention, individual video signals from a plurality of individual devices 15 can be synthesized in substantially real time and displayed in a single display screen 25. Therefore, the user is relieved from the complicated operation of confirming the images displayed on the monitors provided in each of the plurality of individual devices 15, so that the work accuracy and efficiency are remarkably improved. Has an effect.

  According to the video integration system 1 according to the embodiment of the present invention, video signals having different standards generated by the plurality of individual devices 15 can be displayed on the screen while maintaining the aspect ratio even when the video size is changed. Since normalization processing is performed to normalize the image, it is possible to generate an image with its shape maintained in real time, and to display an image that can be used as a material for accurate determination by the user.

  According to the video integration system 1 according to the embodiment of the present invention, a video signal from a device that generates an analog video signal and a video signal from a device that generates a digital video signal are simultaneously displayed in a single screen. There is an excellent effect that it becomes possible to do.

  According to the video integration system 1 according to the embodiment of the present invention, a user can register in advance an individual layout representing the positional relationship of a plurality of individual videos, and can display a composite video accordingly, which is necessary during a series of operations. It is possible to call the layout appropriately and change the layout in real time, which has an excellent effect of improving work accuracy and efficiency.

  According to the video integration system 1 according to the embodiment of the present invention, since the layout adjustment of the individual video can be performed in real time, there is an excellent effect that the layout can be changed to the optimal individual video layout during the work.

  According to the video integration system 1 according to the embodiment of the present invention, an optimum layout can be easily selected from individual layouts registered in advance by the user and displayed on the screen. Has the excellent effect of being able to proceed while selecting the optimal layout.

  According to the video integration system 1 according to the embodiment of the present invention, an individual layout list that is a list of selectable individual layouts can be displayed on the composite video display screen 900, so that a user can perform a series of operations. There is an excellent effect that the user can work while selecting an optimal layout.

  According to the video integration system 1 according to the embodiment of the present invention, since the user can adjust the layout of the individual video in real time while working, it can always be changed to the optimal individual video layout. Excellent effect.

  According to the video integration system 1 according to the embodiment of the present invention, since the user can adjust the relative position, the context, the size, and the brightness of the individual video in real time while working, the accuracy of the user's work can be adjusted. It is possible to improve the performance and display an image that can be used as a material for accurate judgment by the user.

  According to the video integration system 1 according to the embodiment of the present invention, there is an excellent effect that the user can appropriately select a necessary video signal during the work and additionally display it on the screen.

  According to the video integration system 1 according to the embodiment of the present invention, the user can proceed with work while selecting an optimal layout in real time from a layout group that is a set of layouts registered in advance by the user. There is an effect.

  It should be noted that the video integration system of the present invention is not limited to the above-described embodiment, and it is needless to say that various changes can be made without departing from the gist of the present invention.

  For example, in the video integration system of the present invention, in addition to the embodiment based on the premise that the individual device 15 is a medical device, a monitoring system in a cell culture factory, a reactor control system, device management in a large ship or aircraft In an environment where work cannot be postponed or interrupted, such as a system, it is desirable that the type of video information necessary for the user, the arrangement, and the size of the individual video can be easily and substantially changed in real time. Used in.

DESCRIPTION OF SYMBOLS 1 Image | video integrated system 10 Input interface 12 Individual video signal input terminal 15 Individual apparatus 20 Output interface 20A Output signal distribution means 20B Output signal conversion means 22 Composite video output terminal 25 Display apparatus 30 Control part 40 Memory 50 Operation input means 51 Operation input terminal 60 bus 70 CPU
72 RAM
74 ROM
80 Program recording area 90 Past video information recording area 100 Layout information recording area 500 Composite video generation control section 510 Display display authentication means 520 Individual video management section 522 Resolution acquisition processing section 524 Aspect ratio acquisition processing section 526 Individual video display method setting process Unit 540 individual layout registration processing unit 550 layout group registration processing unit 600 output video generation processing unit 610 individual video composition processing unit 612 individual video transparent display processing unit 614 individual video normalization processing unit 620 layout group selection unit 630 individual layout selection unit 640 Individual layout direct editing processing unit 642 Individual video adjustment processing unit 644 Individual video addition processing unit 646 Individual video update processing unit 800 Individual video management screen 900 Composite video display screen 905 Layout group selection area 910 Composite video display area 920 Individual layout list display area 930 Individual video sample list display area for addition 940 Individual layout direct edit area 950 Layout registration screen 952 Layout edit area 954 Layout sample display area 956 Registration button 958 Individual video sample list display for registration Area 960 Layout group registration screen 962 Layout group edit area 964 Individual layout sample display area 966 Registration button 968 Category setting area

Claims (11)

At least two individual video signal input terminals connected to video output terminals of a plurality of individual devices, respectively, to which individual video signals generated by the individual devices are input;
An output video generation processing unit that generates a signal for a composite video display screen in which a plurality of the individual videos are projected in a single screen by synthesizing the plurality of individual videos in substantially real time;
A video integration system comprising: a composite video output terminal that outputs a signal for the composite video display screen to a display. An individual video management unit that acquires management information of resolution and / or aspect ratio based on the signal of the individual video;
A normalization processing unit that converts the plurality of individual videos to be applied to the composite video display screen signal while maintaining the aspect ratio of each of the plurality of individual videos.
The output video generation processing unit generates the signal for the composite video display screen using the standardized individual video.
The video integration system according to claim 1. The standardization processing unit, when a part or all of the individual videos in the plurality of individual videos is analog data, the analog data is digitally converted and standardized,
The video integration system according to claim 2. An individual layout registration processing unit in which individual layouts that are displayed in the composite video display screen and are in a positional relationship with each other are registered in advance;
The output video generation processing unit generates a signal for the composite video display screen with reference to the individual layout.
The video integration system according to claim 1. Provided with an operation input terminal for receiving a user's operation input by the operation input means,
The individual layout registration processing unit outputs a layout registration screen including a layout editing area that prompts a user to input an operation related to layout adjustment of the individual video, and edits the individual layout based on the operation input. Having a part,
The video integration system according to claim 4. The output video generation processing unit includes an individual layout selection unit that prompts a user to select a desired individual layout from among the plurality of individual layouts.
A signal for the composite video display screen is generated with reference to the individual layout selected by a user.
The video integration system according to claim 4 or 5. The individual layout selection unit includes an individual layout list display area that is a list of selectable individual layouts in a part or all of the composite video display screen.
The video integration system according to claim 6. The output video generation processing unit outputs a signal including an individual layout direct editing area that prompts a user to input an operation for adjusting the layout of the individual video that is substantially in real time in part or all of the composite video display screen, The individual layout direct editing processing unit for changing the layout of the composite video display screen being generated based on the operation input,
The video integration system according to claim 4. In the individual layout direct editing area, it is possible to adjust at least one of the relative position, the front-rear relationship, the size, and the brightness of the plurality of individual videos displayed in substantially real time.
The video integration system according to claim 8. The individual layout direct editing processing unit outputs a signal including a list of the individual videos that can be newly added to the composite video display screen in a part or all of the composite video display screen, and is used for a user operation input. The individual video selected based on the display is additionally displayed on the composite video display screen being generated,
The video integration system according to claim 8 or 9. A layout group registration processing unit in which a layout group obtained by selecting and grouping a plurality of desired individual layouts from a plurality of the individual layouts is registered in advance;
The individual layout selection unit of the output video generation processing unit prompts the user to select a desired individual layout from the layout group,
The signal for the composite video display screen is generated with reference to the individual layout selected by the user from the layout group.
The video integration system according to claim 6 or 7.

Images