KR101251304B1 - Picture control device - Google Patents

Abstract

PURPOSE: An image control device is provided to simultaneously express multiple images by providing a controlling function according to the automatic recognition of an image type and the bidirectional N:N real time communication function of IP communication. CONSTITUTION: A communication part(110) transmits a virtual window attribute information array, which is calculated from a processing part(120), to a display device. The communication part receives the present condition of image expression from the display device. The processing part generates the virtual window attribute information array. A storing part(150) stores and manages channel image information for expressing at a virtual window. An user interface part(130) provides a function for inputting a coordinate value by virtual window at a monitor and image channel information. A display engine group part(140) inquires images, which are expressed to the display device, autonomously in a form of preview. [Reference numerals] (110) Communication part; (120) Processing part; (130) User interface part; (140) Display engine group part; (150) Storing part;

Description

Image control device {PICTURE CONTROL DEVICE}

The present invention relates to an image control apparatus, and in particular, to display and control a plurality of images simultaneously to a plurality of display apparatuses, and to change the display form by checking the displayed image state, as well as to an image generating apparatus such as a PC or a camera. It relates to an image control device that can be controlled.

By arranging a plurality of display devices to display images and verifying them, image facilities for recognizing and sharing the situation are installed and used in the fields of transportation, securities, crime prevention, and defense.

As one of these facilities, an apparatus and a user interface (UI) are used that provide a function and a procedure of selecting an image to be displayed and selecting a display device to be displayed from one of a plurality of images. Such a device includes a function of receiving a user's command, selecting each input image for processing the same, and delivering a performance command to the display device. To this end, these devices provide a user interface composed of a plurality of selection buttons and status display labels for the purpose of receiving user commands.

In addition, devices have been developed and used to improve the user input unit and provide a user interface supporting icons and drag-and-drop methods.

The conventional control device as described above has a limitation in accurately confirming the appearance and state of the image displayed on the actual multiple display device arrangement by providing only a selection button and a status display label.

Although the device supporting the icon and the drag-and-drop method slightly improved, a plurality of display apparatuses may be operated, but a plurality of images to be displayed are limited at the same time.

In addition, the user interface of the control device that shows the image being displayed does not fetch the image from the presenter, but instead shows the expected appearance of the control device. There is a problem that makes you mistaken.

In addition, these conventional control devices include functions such as computer remote control, camera remote control, image play and stop, document page movement, sound control, and password authentication that are required according to the type of image displayed on the display device. It is not yet possible to control in real time.

On the other hand, as one of the technologies for operating a plurality of image panel devices as one, the constraint that the image should be enlarged and reduced only by the frame unit between the image panel devices, the constraint that multiple original images cannot be simultaneously enlarged / reduced, and the plurality of displayed images It is a conventional patented technology that has limitations that cannot be controlled by enlargement, reduction, movement, PIP, and overlapping by pixel size unit. A single imaging device is configured by combining a plurality of image panel devices to have a plurality of screens. Only one video panel device of the video panel device can selectively display an image of a broadcast signal or a non-broadcast signal, or a plurality of video panel devices can display an image of one broadcast signal or non-broadcast signal as an independent screen. Broadcast signal and non- An imaging device and a control method having a plurality of screens so as to display the songsinho same time has been proposed (see Patent Document 1)

Domestic Publication No. 10-2011-0136179

Accordingly, the present invention is to solve the above problems, by providing a bi-directional N: N real-time communication function of the IP communication and the control function according to the automatic recognition of the image type to simultaneously display a plurality of images, the state of the image being displayed It is an object of the present invention to provide an image control apparatus capable of controlling the contents of each image channel by controlling an individual image generation providing apparatus that changes the display form and generates an image source.

In order to achieve the above object, the image control apparatus according to the first embodiment of the present invention can display and control a plurality of images simultaneously to a plurality of display apparatuses, and also change the display form by checking the displayed image state. An image control apparatus comprising: a communication unit configured to perform real-time bidirectional simultaneous communication with a plurality of display apparatuses, to transmit a virtual window attribute information array calculated by a processing unit to a display apparatus, and to receive an image display status from the display apparatus; A processor configured to calculate virtual window attribute information arrays by combining coordinate values and image channel information for each virtual window on the monitor input from the user interface unit and channel image information stored and managed by the storage unit; A storage unit to store and manage channel image information for display in a virtual window; In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit providing a function that can be performed through a monitor touch; The image control device itself includes a display engine group unit for inquiring in a preview form an image to be displayed on the display device, wherein the virtual window property information constituting each object in the virtual window property information array is a virtual window display position, virtual It includes the width and height of the window, the logical position path information of the image to be displayed in the virtual window and the attribute information of the image.

delete

delete

In addition, the communication unit may transmit all the information to a plurality of display devices at the same time and each display device may filter and receive only the corresponding information thereof, or the communication unit may transmit only the corresponding information to each display device.

The processor may convert the coordinate values of each virtual window on the monitor into coordinate values on the display device.

In order to achieve the above object, the image control apparatus according to the second embodiment of the present invention can display and control a plurality of images simultaneously to a plurality of display apparatuses, and also change the display form by checking the displayed image state. An image control apparatus comprising: a communication unit configured to perform real-time bidirectional simultaneous communication with a plurality of display apparatuses, to transmit a virtual window attribute information array calculated by a processing unit to a display apparatus, and to receive an image display status from the display apparatus; A processor configured to calculate virtual window attribute information arrays by combining coordinate values and image channel information for each virtual window on the monitor input from the user interface unit and channel image information stored and managed by the storage unit; A storage unit to store and manage channel image information for display in a virtual window; In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit providing a function that can be performed through a monitor touch; The image control device itself includes a display engine group unit for inquiring the image to be displayed on the display device in the form of a preview, wherein the virtual window coordinate values and the image channel information are pixel coordinate values of the display device preview area on the monitor, The horizontal pixel quantity, the vertical pixel quantity, the horizontal pixel quantity of the display apparatus, the vertical pixel quantity of the display apparatus, and the size of the boundary line are included.

In order to achieve the above object, the image control apparatus according to the third embodiment of the present invention can display and control a plurality of images simultaneously to a plurality of display apparatuses, and also change the display form by checking the displayed image state. An image control apparatus comprising: a communication unit configured to perform real-time bidirectional simultaneous communication with a plurality of display apparatuses, to transmit a virtual window attribute information array calculated by a processing unit to a display apparatus, and to receive an image display status from the display apparatus; A processor configured to calculate virtual window attribute information arrays by combining coordinate values and image channel information for each virtual window on the monitor input from the user interface unit and channel image information stored and managed by the storage unit; A storage unit to store and manage channel image information for display in a virtual window; In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit providing a function that can be performed through a monitor touch; The image control device itself includes a display engine group unit for inquiring in a preview form an image to be displayed on the display device, wherein the channel image information includes a serial number for each channel image, attributes of the image, and logical position path information of the image. And management target information for each image including a transmission state of the video stream.

In addition, the attribute of the image is maintained in the form of a code value indicating the type of image including the PC monitor image real-time stream, CCTV video stream, IP-CCTV video stream, presentation file, document file, video file, remote PC control video The logical location path information of the image may be maintained in the form of a combination of a network IP address and a sub path thereof or in a combination of a directory and a file name on a computer host.

In addition, the transmission state of the video stream may be automatically updated at regular intervals by the information transmitted from the communication unit 110, and other attribute information may be updated by a result of the user input in the user interface unit.

In order to achieve the above object, the image control apparatus according to the fourth embodiment of the present invention can display and control a plurality of images simultaneously to a plurality of display apparatuses, and also change the display form by checking the displayed image state. An image control apparatus comprising: a communication unit configured to perform real-time bidirectional simultaneous communication with a plurality of display apparatuses, to transmit a virtual window attribute information array calculated by a processing unit to a display apparatus, and to receive an image display status from the display apparatus; A processor configured to calculate virtual window attribute information arrays by combining coordinate values and image channel information for each virtual window on the monitor input from the user interface unit and channel image information stored and managed by the storage unit; A storage unit to store and manage channel image information for display in a virtual window; In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit providing a function that can be performed through a monitor touch; The image control device itself includes a display engine group unit for inquiring in a preview form an image to be displayed on the display device, wherein the user interface unit includes a display control function unit, an image property management function unit, and a preset management function unit. The display control function unit includes a view area, an input list area, and a presentation list area, wherein the view area provides a function of displaying an expression on a display device in real time, and the input list area displays a list of input images. Providing a function for the user to select, the display list area shows a list of virtual windows currently displayed on the display device, provides a function for allowing a user to execute a corresponding control menu for each virtual window, and With image property management function If you execute, it provides the function to assign channel number and name for each image and set the logical location path information, and if you execute the preset management function, it saves the display position and image contents of all currently displayed virtual windows. It provides a function of creating and editing presets to be called again in batch.

In addition, the display control function may include only the wall view area or a combination of any one of the input list area and the display list area and the wall view area.

In addition, the input list area may display the video stream transmission status information in real time through communication with the storage.

In addition, the logical location path information may be set by designating a file or stream in storage in the display device or by designating a specific file or stream in the network.

The preset management function unit may include a preset list view area, a preset array type preview area, a virtual window list list area arranged in the preset, and an image channel list list area to be displayed in each virtual window of the preset.

The display control function may be configured to manage the simultaneous display of a plurality of images on a plurality of display devices by generating a plurality of virtual windows that can be formed irrespective of the bezel (actual border and boundary line) of the display device rather than the physical display device. It may include.

In addition, the wall view area may provide a function of dividing functions provided by the actual display device and the virtual window device constituting the image display area by device type and controlling each type by left-clicking and right-clicking the mouse. .

The display control function may include a function of providing a thumbnail for preview of an image to be displayed, and a function of displaying the generated thumbnail in the wall view area in the same manner as the actual display device.

In addition, the display control function may include a function of controlling the overlay of each or all of the channel number information, channel name information, channel attribute information of each virtual window being displayed on each virtual window.

The display control function unit may include a function of controlling the image generating apparatus in real time using information stored and managed by the storage unit and a communication function of the communication unit.

The display engine group unit may further include a PC monitor video network stream decoding and rendering engine, an RGB, DVI, HDMI, and composite video rendering engine, an IP-CCTV video decoding and rendering engine, a video file decoding and rendering engine, a document and presentation file rendering engine. , A web page rendering engine, an image engine, a remote control standard protocol based image rendering engine, and a standalone executable window control engine.

delete

The image control device may be a dedicated device having dedicated hardware corresponding to a communication unit, a processor, a storage unit, a user interface unit, and a display engine group unit therein, or may be a network adapter, a processor and a memory, a hard disk, a graphics adapter. And a computer equipped with a monitor, a computer equipped with a dedicated adapter, or a control software mounted on a server.

According to the present invention, a plurality of images are configured to be displayed simultaneously on a plurality of display devices in various ways, and the user checks the configured state in real time in the same or similar form as the actual one, and changes the display state again based on the result. And by enabling the pattern to check the results again there is an advantage that can create an optimized image display state. At this time, it is possible to facilitate the optimization of the image display state by providing a control function for zooming in, zooming out, moving, and PIP functions on a pixel-by-pixel basis regardless of the boundary of the display panel. In addition, it is possible to identify whether or not a disorder in the process of displaying each image. In addition, by providing various video input devices or contents control functions such as remote control, execution and stop, document page movement, sound control, and password authentication, depending on the type of image such as PC monitor, CCTV, video file, document, slide show, etc. It also provides the advantage of controlling the contents of the image.

1 is a block diagram of an image control apparatus according to the present invention;
2 is a presentation control function block diagram according to the present invention;
3 is a block diagram of a preset management function according to the present invention;
FIG. 4 is a diagram illustrating a plurality of simultaneous display of various types of images in a video wall in which a plurality of physical display devices are configured adjacent or spaced apart according to the present invention.
5 is a view showing a state in which the same image is expressed in various sizes and aspect ratios according to the size of each virtual window in accordance with the present invention.
6 to 12 is a view showing the arrangement of the virtual window of various forms in accordance with the present invention.
Fig. 13 is a functional flowchart of an expression control function unit in the present invention.
FIG. 14 is a diagram illustrating functions provided by a plurality of real display devices and a plurality of virtual window devices that form a WallView area of a display control function unit for providing a command flow according to the present invention.
FIG. 15 is a diagram showing image display engines and image identification algorithms built in a control device for a thumbnail function according to the present invention; FIG.
FIG. 16 is a flowchart illustrating a procedure in which a control function is provided according to an image being displayed on the virtual window when the user selects the virtual window in the wall view area according to the present invention.
17 illustrates a caption function overlaid on a specific area of each virtual window or videowall in accordance with the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the preferred embodiments of the present invention will be described below, but it is needless to say that the technical idea of the present invention is not limited thereto and can be variously modified by those skilled in the art.

1 is a block diagram of an image control apparatus according to the present invention, FIG. 2 is a presentation control function block diagram according to the present invention, and FIG. 3 is a preset management function block diagram according to the present invention.

The video control apparatus according to the present invention provides a bidirectional N: N: real-time communication function of IP communication and a control function according to automatic recognition of image types to simultaneously display a plurality of images, and check the state of the images being displayed in pixel units. The technical gist of the present invention is that it is possible to control the contents of each video channel by changing the display mode or even controlling the individual video channel generating apparatus that generates the video source.

As shown in FIG. 1, the image control apparatus 100 according to the present invention is capable of simultaneously displaying and controlling a plurality of images to a plurality of display apparatuses, and also changing the display form by checking the displayed image state. As a large part, the communication unit 110, the processing unit 120, the storage unit 130, the user interface unit 140, and the display engine group unit 150 are included.

The communication unit 110 performs real-time bidirectional simultaneous communication through a plurality of display devices and a network cable or a serial cable by using the bidirectional N: N real-time communication characteristic of IP communication, and the virtual window attribute calculated by the processing unit 120. The information array is transmitted to the display device, and the image display status is received from the display device.

For reference, the display apparatus is a concept including an image panel apparatus (hereinafter, referred to as a "video wall") such as a video wall having a plurality of displayers and a plurality of screens. Accordingly, a plurality of images are displayed on the video wall through the presenter via a network cable such as UTP or Fiber or an image cable such as RGB / DVI / HDMI / Composite. Then, the video display status including the video stream and the display state information on the state that the video is being displayed through the video wall is transmitted from the presenter to the communication unit 110.

The virtual window refers to a virtual display device that is formed independently of the bezel (actual boundary line) of the display device.

Specifically, the display device is a TV, LCD, LED, PDP and Beam Projector or RGB Matrix Switcher, DVI Matrix Switcher, Wall Controller and IP that can receive video signals such as RGB, Composite, DVI, HDMI, S-video. It can be any one of Video Wall Servers.

 The virtual window property information constituting each object in the virtual window property information array may include a virtual window presentation position, a width and height of the virtual window, logical position path information of an image to be displayed in the virtual window, and attribute information of the image. .

In addition, the communication unit 110 may communicate with two or more display devices (expressors). In this case, the communication unit 110 simultaneously transmits all information to a plurality of display devices (expressors) and displays each display. The device (expressor) may filter and receive only the corresponding information thereof, or the communication unit 110 may transmit only the corresponding information to each display device (expressor).

The processor 120 calculates a virtual window attribute information array by combining virtual window coordinate values and image channel information on the monitor input from the user interface unit 140 and channel image information stored and managed by the storage unit 130. do. In this case, the processing unit 120 may convert the coordinate values for each virtual window on the monitor into coordinate values on the display device (video wall). The virtual window coordinate values and the image channel information may include a pixel coordinate value of a display device (video wall) preview area, a horizontal pixel quantity, a vertical pixel quantity, a horizontal pixel quantity of a display device (video wall), and a display device (video wall) on a monitor. ) May include a vertical pixel quantity and a border size.

The storage unit 130 stores and manages channel image information (source image of the image) to be displayed on the virtual window. In this case, the channel image information may include image management target information including the serial number of each channel image, the attribute of the image, the logical position path information of the image, and the transmission status of the image stream.

The attribute of the image is maintained in the form of a code value indicating a type of image including a PC monitor image real time stream, a CCTV image stream, an IP-CCTV image stream, a presentation file, a document file, a video file, and a remote PC control image. The logical location path information of the image may be maintained in the form of a combination of a network IP address and a sub path thereof or in a combination of a directory and a file name on a computer host.

The transmission state of the video stream is automatically updated at a predetermined period (for example, within a few seconds) by the information transmitted from the communication unit 110, and other attribute information is input by the user in the user interface unit 140. Can be updated by the result. Through the automatic update function as described above, the image control apparatus 100 can easily check in advance whether the image is normally transmitted to the display apparatus and the image control apparatus 100 even before the user expresses the image.

The user interface unit 140 provides a function of inputting coordinate values and image channel information for each virtual window on a monitor, and provides a user with an image display status received by the communication unit 110 and a user displaying an image. It provides a function to change the image, that is, add, delete, move, resize, etc. with a mouse or monitor touch.

As illustrated in FIG. 2, the user interface unit 140 includes an expression control function unit 141, an image attribute management function unit 142, and a preset management function unit 143.

The presentation control function unit 141 includes a preset array type wall view area 141-1, a preview area 143-2, an input list area 141-2, and a presentation list area 141-3. .

The preset array type wall view area 141-1 and the preview area 143-2 provide a function of displaying an expression on a display device in real time. The input list area 141-2 provides a function of selecting a user by providing a list of input images. The input list area 141-2 may display the video stream transmission state information in real time through communication with the storage 130. The display list area 141-3 shows a list of virtual windows currently displayed on the display device, and provides a function for allowing a user to execute a corresponding control menu for each virtual window.

In the preset arrangement type wall view area 141-1 and the preview area 143-2, all virtual windows currently displayed on the display device (video wall) and corresponding images are reduced to fit the size of the user interface of the control device monitor. do. The display state of the image being displayed on the display device (video wall) can be checked through the preset array wall view area 141-1 and the preview area 143-2. Alternatively, you can execute the additional function by executing the mouse or monitor touch on the virtual window. The wall view area 141-1 may classify functions provided by the actual display device and the virtual window device that constitute the image display area by device type and control each type by left-clicking and right-clicking the mouse. Can be provided.

The display control function unit 141 includes only the wall view area 141-1, or any one of the input list area 141-2 and the display list area 141-3 and the wall view area 141-1. It can be composed of a combination of.

The display control function unit 141 generates a plurality of virtual windows that can be formed irrespective of the bezel (actual border and boundary line) of the display device rather than the physical display device, thereby simultaneously displaying a plurality of images to the plurality of display devices. It may include a management function.

The display control function unit 141 provides a function of providing a thumbnail for preview of an image to be displayed, and when the generated thumbnail is moved to the wall view area 141-1, the display control function unit 141 may display the same on an actual display device. It can include a function.

In addition, the expression control function unit 141 may include a function of controlling the overlay or display of part or all of channel number information, channel name information, and channel attribute information of each virtual window being displayed on each virtual window. Can be.

In addition, the expression control function unit 141 may include a function of controlling the image generating apparatus in real time using information stored and managed by the storage unit 130 and a communication function of the communication unit 110. That is, it is possible to control the image generating device itself such as PC and camera in real time, such as computer remote control, camera remote control, image execution and stop, document page movement, sound control, and password authentication, depending on the type of image. It can be included.

The image property management function unit 142 provides a function of assigning a channel number and a name for each image and setting logical location path information. In this case, the logical location path information may be set by designating a file or stream in a storage device in a display device or by designating a specific file or stream in a network.

The preset management function unit 143 provides a function of generating and editing presets that store the presentation positions and video contents of all currently displayed virtual windows and collectively call them again when necessary.

The preset management function unit 143 may include a preset list view area 143-1, a preset array type preview area 143-2, a virtual window list list area 143-3 arranged in a preset, and each of the presets. And a video channel list listing area 143-4 to be displayed on the virtual window.

The preset management function unit 143 provides a UI capable of previewing a preset before displaying it on a display device (video wall), editing a part of the preset before displaying the preset, and comparing and examining the expressions of each preset being managed. .

The display engine group unit 150 is for inquiring in a preview form the image to be displayed on the display device by the image control device itself.

Specifically, the display engine group unit 150 is a PC monitor video network stream decoding and rendering engine, RGB, DVI, HDMI, Composite video rendering engine, IP-CCTV video decoding and rendering engine, video file decoding and rendering engine, document And a presentation file rendering engine, a web page rendering engine, an image engine, a remote control standard protocol based image rendering engine, and a standalone executable file control engine.

The physical form of the image control apparatus 100 is dedicated to each corresponding to the communication unit 110, the processing unit 120, the storage unit 130, the user interface unit 140, and the display engine group unit 150 therein. It may be a dedicated device with hardware, or a computer equipped with control software in a computer or server having a network adapter, a processor and memory, a hard disk, a graphics adapter and a monitor, a dedicated adapter.

4 is a view showing a plurality of different types of images simultaneously displayed in a video wall in which a plurality of physical display devices are configured adjacently or spaced apart according to the present invention. FIG. 6 to 12 are views showing the arrangement of virtual windows of various forms according to the present invention.

As shown in FIG. 4, the image control device 100 of the present invention can freely create a plurality of virtual display devices, that is, virtual windows, regardless of the bezel (boundary line) of the display device. The size and position of each virtual window can be freely generated and specified by the user in units of pixels or through a mouse or monitor touch of the control device.

Each virtual window can be overlapped with each other or arranged in the form of a picture in picture (PIP) and can be resized or relocated while it is being displayed.

Since the number of pixels occupied by each virtual window may be different in size or aspect ratio than the number of pixels in the original image, each virtual virtual window is displayed by performing an operation of enlarging, reducing, and changing the aspect ratio according to its size. At this time, even if several virtual screens of the same size or the same size exist for the same image, pixels are added / deleted and color corrected according to the size of the virtual window, so that images having various sizes and aspect ratios that fit the size of each virtual window are displayed. It is expressed.

The method for arranging a virtual window that can be specified by the image control apparatus 100 according to the present invention includes arranging one virtual window per display device, one virtual window per multiple display device, multiple virtual windows within one display device, and a display bezel. Irrespective of this, the virtual window may be arranged in various forms such as a virtual window arrangement, an overlapping arrangement between the virtual windows, another virtual window arrangement on the virtual window, and a combination of some or all of the arrangement methods.

As described above, the image control apparatus 100 of the present invention has a function of editing a user interface showing a reduced form of a virtual window displayed on a display device (video wall) and an associated virtual window or editing information on the entire virtual window. To provide.

The type of video content displayed in the virtual window may be a PC monitor screen real time stream, CCTV video stream, IP-CCTV video stream, presentation file, document file, video file, remote PC control image, and the like.

13 is a functional flowchart of an expression control function unit in the present invention.

That is, even in a complex interface in which a plurality of display devices and a plurality of virtual windows, and various control functions for each display device and virtual window devices are connected, most of the image display and control functions are displayed and controlled according to the present invention. ) Is a flow chart showing that it is possible with 3 mouse clicks or monitor touch.

The first command flow is to display the designated video channel in the virtual window of the size of one display device. If you select the wall view area 141-1 with the left mouse button as the first step of the first command flow, the virtual window that matches the size and location of the display panel of the click position is automatically created. In the second step, the input list area 141- In 2), when left-clicking an input video channel, the sea channel is automatically displayed on the virtual window created in the previous step, and the command flow is completed.

The second command flow is to display a designated video channel in virtual windows of several display devices. In the first step, when the mouse left-clicks on the wall view area 141-1, a virtual window whose size and location match the display panel of the click position is automatically generated. If you left-click on another point of Wall View in step 2, the second display device is identified, and a virtual window of size and position that automatically corners the display device identified in the previous step and the display device identified in the current step is automatically generated. If the mouse left-clicks on the input video channel in the input list area 141-2 in step 3, the sea channel is automatically displayed in the virtual window created in the previous step, and the command flow is completed.

The third command flow is to display a designated video channel in a virtual window in which a region of one designated display device is divided at a predetermined ratio such as 4/6/9/16 division. In the first step, when the user left-clicks the wall view area 141-1, a virtual window whose size and position match the display panel of the click position is automatically generated. If you right-click on the display panel in step 2, you can select one of 4/6/9/16 split mode. In step 3, when one small virtual window among the split ratio and the selected split ratio is selected by moving the mouse cursor and left-clicking, the virtual window generation is completed. In step 4, when the user left-clicks an input video channel in the input list area 141-2, the channel is automatically displayed in the virtual window created in the previous step and the command flow is completed.

The fourth command flow is to display the designated video channel in the virtual window designated by the mouse drag. In step 1, the mouse drag designation mode is selected by a menu button or a keyboard function key, and in step 2, when the virtual window is selected by dragging the mouse in the wall view area 141-1, the virtual window generation is completed. If the mouse left-clicks on the input video channel in the input list area 141-2 in step 3, the sea channel is automatically displayed in the virtual window created in the previous step, and the command flow is completed.

The fifth command flow is to display the designated video channel in the virtual window of the size corresponding to the pixel value input by the keyboard. In step 1, when the pixel value input mode is selected by a menu button click or a keyboard function key, and in step 2, when the left mouse is clicked on the wall view area 141-1, the pixel value input window is automatically generated. After inputting pixel value in 3rd step, left click mouse on input video channel in input list area 141-2 in 4th step, the sea channel is automatically displayed in the virtual window created in the previous step and the command flow is completed. .

The sixth command flow is to enlarge or reduce the size of the virtual window being displayed. Right-clicking on the Wall View area 141-1 automatically creates a menu that allows you to select either the zoom or move mode for the virtual window displayed at the click position. Select zoom mode or move mode in 2 steps. In step 3, the command flow is completed by zooming in or out of the virtual window with left mouse click and drag and drop.

FIG. 14 illustrates the functions provided by the plurality of real display devices and the plurality of virtual window devices that constitute the wall view area 141-1 of the display control function unit for providing the command flow according to device types. Drawing.

As described above, the image control apparatus according to the present invention selects and controls the display device within the wall view area 141-1 for left and right mouse clicks, and separates the mouse right click for the user's consistent and simple operation. On (141-1), the virtual window device is divided so as to control selection.

In order for the user to intuitively learn the six command flows, there is a need for minimized command classification and command step placement based on a single criterion. To this end, the present invention introduces a real window concept and a virtual window concept that can simplify the concept of all functional divisions in only two categories, and assigns them to the left and right mouse buttons, respectively. In addition, each step was unified and arranged in a single progression concept of selecting an image to be displayed in the display type designation.

When an image of the input list area 141-2 is selected while a virtual window is generated according to each command flow, a command for displaying the corresponding image on the virtual window is generated by the user interface 140 in the control device. After passing through the communication unit 110 is delivered to the display. The viewer will display the image on the video wall according to the command.

The wall view area 141-1 of the display control function unit 141 provides a thumbnail function. In the input list window for selecting an image to be displayed in the virtual window, the corresponding image is assigned to the virtual window in the video wall. Preview before rendering. This thumbnail is provided in the form of a video that shows the actual video live stream as it is, not a still image. If the thumbnail is dragged and dropped into the wall view area 141-1, the thumbnail, size, aspect ratio, The image whose position is automatically adjusted is displayed on the video wall. If there is no virtual window, the virtual channel of the same size or the same size as the thumbnail is automatically created and the video channel is displayed on the virtual window near the thumbnail placement position.

FIG. 15 is a diagram illustrating image display engines and an image identification algorithm built in an image control apparatus for a thumbnail function according to the present invention.

Image control device 100 of the present invention is a PC monitor video network stream decoding and rendering engine, RGB, DVI, HDMI, Composite image rendering engine, IP-CCTV video decoding and rendering engine, video file decoding and It includes a rendering engine, a document and presentation file rendering engine, a web page rendering engine, an image rendering engine, a remote control standard protocol based image rendering engine, and a standalone executable window control engine.

When the user selects one image channel of the input list region 141-2 by using a mouse or a monitor touch, the image control apparatus 100 may determine data of the storage 130 based on the identifier of the image channel. Process to check the property of the video channel. The engine is called from among the display engines built according to the identified video channel property, and the engine renders the video by overlaying the display control function by calling the video according to the logical position value of the video channel.

As described above, since the control device incorporates various display engines and identification algorithms, real-time thumbnails of the images displayed on the video wall by the control device are possible.

Even if the user cannot accidentally drop the thumbnail on the virtual window, the video is displayed on the virtual window like a magnet. If the thumbnail is dragged and dropped into the wall view area 141-1 without creating a virtual window, a virtual window of the size corresponding to the thumbnail is automatically created in the dragged and dropped position, and the image is then created. Express to

This thumbnail continues to display video even during drag and drop. Thumbnail can display the enlarged image of the thumbnail through the mouse or touch monitor to the control device, and this image provides the function to control the source device PC of the image. This allows the PC to be controlled remotely from the controller.

By combining Thumbnail with automatic original image display function, drag-and-drop, magnet function, and display coordinate value conversion function as enlarged as above, Thumbmail is optimized as a common single starting point of user activity for image preview, display and control. It is possible to provide a user experience (UX).

If the virtual window is selected in the wall view area 141-1, a selection menu for temporarily executing the source device control command of the virtual window image is temporarily generated. Table 1 is a table listing common control functions that can be executed for each virtual window and special control functions that can be executed for each virtual window displayed image property.

FIG. 16 is a flowchart illustrating a procedure of providing a control function according to an image being displayed on a virtual window when a user selects a virtual window in a wall view area according to the present invention.

When the user selects one virtual window of the wall view area 141-1 by using a mouse or a monitor touch of the image control device 100, after checking the identifier of the virtual window, the virtual window is displayed in the memory area of the storage 130. Extract the identifier of the image being displayed. The data of the storage unit 130 is processed again based on the identifier of the image to check the property of the image. According to the checked image property, the user interface 140 provides a temporary menu screen for the user to select a special control function together with the common control function. When the user executes the special control function, the command is transmitted through the network to the device generating the image.

In order for the image control apparatus 100 to distinguish the image channel to the user and automatically match the image channel and the display engine in a single concept, the image control apparatus 100 provides a concept of logical position path information of the image channel. Logical location path information of video channel is composed of slot number, IP address, Port number, disk drive identifier, protocol type, subdirectory information, file name, some or all combination of stream name, and each combination is network-host-directory -Arranged in file-stream order and combined into one string.

Through the automatic processing function in which the virtual window, the image channel, the control command, and the location path information are interconnected with each other, the user can control the image content in a consistent pattern regardless of the type of the image.

17 illustrates a caption function overlaid on a specific area of each virtual window or video wall according to the present invention.

The caption control function provided for each virtual window device present in the wall view area 141-1 of the display control function unit 141 is a channel number and image name assigned to the image being displayed on the virtual window being displayed on the video wall. To overlay text on the virtual window. The caption may control whether to display in units of individual virtual windows, and may control whether to display all virtual windows in the wall view area 141-1 collectively.

Through the caption function as described above, the user can quickly identify which image generating device is provided with the source of the corresponding video channel.

Each virtual window can be resized or relocated to overlap each other or to form a PIP. Each virtual window has its own level, so when it is placed in an overlapped form, the virtual windows with high level priority are placed on the overlapping virtual windows. The function that provides the highest priority of the virtual window in units of individual virtual windows is provided.

Each virtual window and thumbnail has a built-in remote control that can accept keyboard or mouse input. If the user selects one of several virtual windows or thumbnails to activate the remote control function, the keyboard or mouse input signal connected to the image control device 100 is not the control device, but the image that is generating the original video channel of the virtual window or thumbnail. It is delivered to the generating device (eg PC, IP-CCTV). To this end, the image control apparatus 100 provides a function of transmitting a keyboard or mouse input signal to an image generating apparatus connected with a network or a serial cable instead of the user interface 140 of the image control apparatus 100 when a specific state is reached. do.

As described above, since the image control apparatus 100 provides a keyboard or mouse input signal forwarding function, the same control task can be performed by the image control apparatus 100 of the present invention without the control equipment provided for each channel image.

Representative applications of the above control functions include PC control function using PC monitor remote image, Play, Pause, Stop, Sound control function of video being displayed on video wall, Pan, Tilt, Zoom control function of CCTV camera. Etc.

The image control apparatus 100 of the present invention may generate a sequential image channel composed of an array of image channels having a sequence and a time interval value. Unlike the other video channels, the sequential video channel serves as an image generating device by the control device itself.

When the user commands to display the sequential video channel, the controller displays the first video of the data array of the sequential video channel in the virtual window, maintains it for the time corresponding to the specified time interval value, and then automatically displays the second video of the video array. Will be expressed. In the same way, when the last image of the array is advanced and the display of the last image is finished, the first image is automatically displayed again.

Through the sequential video channel function, which is a virtual channel concept as described above, when the virtual window is smaller than the number of video channels, the entire video channel can be displayed on the video wall without repetition of the user.

Image control device 100 of the present invention provides a status check and remote initialization function. The image control apparatus 100 automatically checks whether the display is normally operated by a predetermined interval and a reference through a status check function. When the image control apparatus 100 exceeds a reference value set by the user, the remote initialization function is automatically activated. When the remote initialization function is executed, the image control apparatus 100 transmits an initialization command to the viewer and receives the command to restore the abnormal expression back to the normal state. The remote initialization function provides the option to be executed manually by the user without the automatic judgment of the control device.

The state check of the image control device is performed by the processor 120 analyzing the state information of the display device received through the communication unit 110, and the remote initialization function which can be performed thereafter is performed by analyzing the analyzed state information and the storage unit ( This is performed by the processor 120 automatically determining the threshold setting value stored in the 130 and then transmitting the threshold setting value to the display device through the communication unit 110.

Through the state checking and remote initialization function of the image control device 100 as described above, the presenter can maintain the normal operating state without the operator's intervention in the image control device 100.

On the other hand, although the image control device according to the present invention has been described in accordance with a limited embodiment, the scope of the present invention is not limited to a specific embodiment, it is within the scope obvious to those skilled in the art in connection with the present invention Alternatives, modifications and variations of the branches may be implemented.

Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by the embodiments and the accompanying drawings. . The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

100: video control device
110:
120: processing unit
130:
140: user interface unit
141: display control function
142: image property management function
143: Preset management function
150: display engine group unit

Claims (22)

delete delete An image control apparatus 100 is configured to display and control a plurality of images simultaneously to a plurality of display apparatuses, and to change a display form by checking a displayed image state.
A communication unit 110 which transmits the virtual window attribute information array calculated by the processing unit 120 to the display device while performing real-time bidirectional simultaneous communication with a plurality of display devices, and receives an image display status from the display device;
A processor 120 for calculating virtual window attribute information arrays by combining virtual window coordinate values and image channel information on the monitor input from the user interface unit 140 and channel image information stored and managed by the storage unit 130; ;
A storage unit 130 for storing and managing channel image information for display in a virtual window;
In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit 140 providing a function that can be performed through a monitor touch;
The image control device itself includes a display engine group unit 150 for inquiring in the form of a preview of the image to be displayed on the display device,
The virtual window property information constituting each object in the virtual window property information array includes a virtual window presentation position, a width and height of the virtual window, logical position path information of an image to be displayed in the virtual window, and attribute information of the image. Video control device. The method according to claim 3,
The communication unit 110 transmits all the information to a plurality of display devices at the same time and each display device receives only the filtered information of its own, or the image is characterized in that the communication unit transmits only the corresponding information to each display device controller. The method according to claim 3,
The processing unit 120 converts the coordinate value of each virtual window on the monitor to the coordinate value on the display device. An image control apparatus 100 is configured to display and control a plurality of images simultaneously to a plurality of display apparatuses, and to change a display form by checking a displayed image state.
A communication unit 110 which transmits the virtual window attribute information array calculated by the processing unit 120 to the display device while performing real-time bidirectional simultaneous communication with a plurality of display devices, and receives an image display status from the display device;
A processor 120 for calculating virtual window attribute information arrays by combining virtual window coordinate values and image channel information on the monitor input from the user interface unit 140 and channel image information stored and managed by the storage unit 130; ;
A storage unit 130 for storing and managing channel image information for display in a virtual window;
In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit 140 providing a function that can be performed through a monitor touch;
The image control device itself includes a display engine group unit 150 for inquiring in the form of a preview of the image to be displayed on the display device,
The virtual window-specific coordinate values and the image channel information include pixel coordinate values of the display device preview area, horizontal pixel quantity, vertical pixel quantity, horizontal pixel quantity of the display apparatus, vertical pixel quantity of the display apparatus, and border line size on the monitor. Image control device, characterized in that. An image control apparatus 100 is configured to display and control a plurality of images simultaneously to a plurality of display apparatuses, and to change a display form by checking a displayed image state.
A communication unit 110 which transmits the virtual window attribute information array calculated by the processing unit 120 to the display device while performing real-time bidirectional simultaneous communication with a plurality of display devices, and receives an image display status from the display device;
A processor 120 for calculating virtual window attribute information arrays by combining virtual window coordinate values and image channel information on the monitor input from the user interface unit 140 and channel image information stored and managed by the storage unit 130; ;
A storage unit 130 for storing and managing channel image information for display in a virtual window;
In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit 140 providing a function that can be performed through a monitor touch;
The image control device itself includes a display engine group unit 150 for inquiring in the form of a preview of the image to be displayed on the display device,
The channel image information includes the management target information for each image including a serial number for each channel image, attribute of the image, logical position path information of the image, and transmission status of the image stream. The method of claim 7,
The property of the video is maintained in the form of a code value indicating the type of video including a PC monitor video real time stream, CCTV video stream, IP-CCTV video stream, presentation file, document file, video file, remote PC control video,
And the logical location path information of the image is maintained in the form of a combination of a network IP address and a sub path thereof or a combination of a directory and a file name on a computer host. The method of claim 7,
The transmission state of the video stream is automatically updated at regular intervals by the information transmitted from the communication unit 110, and the other property information is updated by the result of the user input in the user interface unit 140 controller. An image control apparatus 100 is configured to display and control a plurality of images simultaneously to a plurality of display apparatuses, and to change a display form by checking a displayed image state.
A communication unit 110 which transmits the virtual window attribute information array calculated by the processing unit 120 to the display device while performing real-time bidirectional simultaneous communication with a plurality of display devices, and receives an image display status from the display device;
A processor 120 for calculating virtual window attribute information arrays by combining virtual window coordinate values and image channel information on the monitor input from the user interface unit 140 and channel image information stored and managed by the storage unit 130; ;
A storage unit 130 for storing and managing channel image information for display in a virtual window;
In addition to providing a function of inputting coordinate values and image channel information for each virtual window on the monitor, the user can provide a video display status received by the communication unit 110 to the user and change the image display image by a mouse or a mouse. A user interface unit 140 providing a function that can be performed through a monitor touch;
The image control device itself includes a display engine group unit 150 for inquiring in the form of a preview of the image to be displayed on the display device,
The user interface unit 140 includes a display control function unit 141, an image property management function unit 142, and a preset management function unit 143.
The expression control function unit 141 includes a wall view area 141-1, an input list area 141-2, and an expression list area 141-3.
The wall view area 141-1 provides a function of displaying an expression on a display device in real time, and the input list area 141-2 provides a function of selecting a user by providing a list of input images. The display list area 141-3 shows a list of virtual windows currently displayed on the display device, and provides a function for allowing a user to execute a corresponding control menu for each virtual window.
The image property management function unit 142 provides a function of assigning a channel number and name for each image and setting logical location path information.
The preset management function unit 143 stores a display position and image contents of all currently displayed virtual windows, and provides a function of generating and editing presets which are collectively called again when necessary. The method of claim 10,
The display control function unit 141 includes only the wall view area 141-1, or any one of the input list area 141-2 and the display list area 141-3 and the wall view area 141-1. Image control device, characterized in that consisting of a combination. The method of claim 10,
The input list area (141-2) is a video control device, characterized in that for displaying the video stream transmission status information in real time through communication with the storage unit (130). The method of claim 10,
And the logical location path information is set by designating a file or stream in a storage device in a display device or by designating a specific file or stream in a network. The method of claim 10,
The preset management function unit 143 may include a preset list view area 143-1, a preset array type preview area 143-2, a virtual window list list area 143-3 arranged in a preset, and each of the presets. And a video channel list listing area (143-4) to be displayed on the virtual window. The method of claim 10,
The display control function unit 141 includes a function of generating a plurality of virtual windows that can be formed irrespective of the bezel of the display device rather than the physical display device to manage the simultaneous display of a plurality of images to the plurality of display devices. Image control device. The method of claim 10,
The wall view area 141-1 divides functions provided by the actual display device and the virtual window device constituting the image display area by device type and provides a function to control each type by left-clicking and right-clicking the mouse. Image control device, characterized in that. The method of claim 10,
The display control function unit 141 provides a function of providing a thumbnail for preview of an image to be displayed, and a function of displaying the generated thumbnail in the wall view area 141-1 to display the same on an actual display device. Image control apparatus comprising a. The method of claim 10,
The expression control function unit 141 may include a function of controlling the overlay of each or all of the channel number information, channel name information, and channel property information of each virtual window to be displayed on each virtual window. Image control device. The method of claim 10,
The display control function unit 141 includes a function of controlling the image generating apparatus in real time by using the information stored and managed by the storage unit 130 and the communication function of the communication unit 110. delete The method according to any one of claims 3, 6, 7, 10,
The display engine group unit 150 includes a PC monitor video network stream decoding and rendering engine, an RGB, DVI, HDMI, composite video rendering engine, an IP-CCTV video decoding and rendering engine, a video file decoding and rendering engine, a document and a presentation file. And at least one of a rendering engine, a web page rendering engine, an image engine, a remote control standard protocol based image rendering engine, and a standalone executable window control engine. The method according to any one of claims 3, 6, 7, 10,
The image control device may be a dedicated device having respective dedicated hardware corresponding to the communication unit 110, the processing unit 120, the storage unit 130, the user interface unit 140, and the display engine group unit 150. And a computer equipped with a control software in a computer or a server having a network adapter, a processor and a memory, a hard disk, a graphics adapter and a monitor, and a dedicated adapter.

Images