KR101085554B1 - Real-time input/output module system for Ultra High-Definition image - Google Patents

Abstract

The present invention relates to a real-time input / output module system for an ultra high definition image, and more particularly, an ultra high definition image signal corresponding to ultra high definition (UHD) can be input from an external device to be stored and input and output in real time as raw data. The present invention relates to a real-time input / output module system for ultra-high definition images. The present invention configures a plurality of modules to correspond to the number of the plurality of divided HD images constituting the UHD image, and each module independently stores and real-time input and output for one HD image, thereby effectively loading data Dispersion can cover a huge amount of data transfer.

Ultra High Definition, UHD, Real Time, Storage, I / O

Description

Real-time input / output module system for ultra high-definition image

The present invention relates to a real-time input / output module system for an ultra high definition image, and more particularly, an ultra high definition image signal corresponding to ultra high definition (UHD) can be received from an external device and stored in real time, and the stored image signal is stored in real time. This is a real time input / output module system for ultra-high definition images which can be output by

As imaging technology changes from analog to digital, it has evolved from SD (Standard-Definition) to HD (Hi-Definition) in order to provide a more realistic image. SD supports 704 × 480 resolution and consists of 350,000 pixels, HD is divided into HD and Full HD, and Full HD, which supports the higher resolution, supports 1920 × 1080 resolution and 2 million pixels. It is configured to provide a substantial high quality image compared to the SD.

Recent imaging technology is growing one step further to the Full High-Definition (UHD) beyond the Full HD, and the UHD, which supports ultra-high definition and ultra-high resolution, is spotlighted as a next-generation media environment. The UHD supports 4K (3840 × 2160) and 8K (7680 × 4320) resolutions and up to 22.2 channels of surround audio. Such UHD provides 4 times clearer picture quality than 4K UHD picture compared to the HD, and 8K UHD provides 16 times more clear picture quality than the HD picture.

In order to provide the image produced in the UHD, as shown in FIG. 1, the image content produced in the UHD is divided into four HD images to form one image frame in the case of 4K UHD, and 8K In the case of 16 HD images are divided and produced. That is, four input devices supporting HD are required to produce 4K UHD video, and 16 HD supporting input devices are required to support 8K UHD.

In addition, in outputting the UHD-class image input through the external input device to an external output device such as an LCD and a beam projector in real time, in order to output so that the user does not feel discomfort in viewing the image, 60 frames per second image is displayed. It should be transmitted to an external output device, which means that 13.9Gbps throughput should be supported for 4K UHD, and 55.6Gbps throughput should be supported for 8K UHD.

In addition, in providing the UHD video in real time, not only a simple video signal is provided but also an audio signal, the conventional HD requires a transmission rate of 3.7 Mbps to support 5.1 channels. In this case, up to 22.2 channels are supported, and accordingly, the transmission rate is required to be 48.8Mbps.

Accordingly, in order to process the UHD image in real time by utilizing the performance of the hardware currently provided, a real time input / output system as shown in FIG. 2 is provided. 2 is a conventional real-time input / output system for 4K UHD still image, the real-time input / output system for real-time processing the image between the external input device and the output device is one UHD from four external input devices supporting HD The still image is divided into four screens and received, and a plurality of storage media 40 are connected in a RAID manner to store each screen as raw data in a storage unit.

Such a system relies on one main processor 10 or a graphics processor installed on a motherboard to output UHD images provided from an external input device to an external output device in real time. After divided storage in the storage unit has a configuration for splitting the output to the portion where each HD image is matched to the UHD display of the external output device.

Therefore, the main processor 10 performs control of each HD video signal transmitted to the input / output interfaces 20 and 30 through the operating system installed therein, and controls the operation of the graphics card and the storage unit.

In this case, the RAID storage unit in the system as described above is made up of a plurality of storage medium 40, even if one storage medium satisfies the data transfer amount for one HD video, the data processing of the plurality of HD video flows The main process 10 should be stored in the storage while performing synchronization between a plurality of HD images collectively output from an external input device to a plurality of storage media included in the storage. In other words, since the storage of a plurality of HD images in one main processor must be accompanied by synchronization, the load on the main processor increases exponentially, and the cost is greatly increased as it must be composed of high-end hardware to solve this problem. There is a problem.

In addition, the main processor 10 completes the synchronization operation before outputting the HD video to the output interface 30, but the main processor 10 receives a huge amount of transmission data generated while simultaneously loading the HD video stored in each storage medium. Since the processor 10 does not handle each HD image that matches each screen of the UHD display, there is a problem that the output is not synchronized with each other.

As such, the existing system relies on transmission control and synchronization control of an image in one processor, thereby increasing the overall system configuration and cost.

In addition, the system is based on 4K UHD video, and in the case of higher resolution 8K UHD, the main processor should be able to control 4 times the amount of transmission required for 4K UHD video. The existing system in which the problem is presented is problematic in that 8K UHD video is normally stored and output in real time.

The present invention is to control the input and output of each divided HD image constituting one UHD image, not to be collectively performed in one main processor to perform independent control, so that massive data can be stored and inputted in real time. The purpose is to provide a system that can be used.

In addition, the present invention comprises a system consisting of a plurality of modules, each module is responsible for the control of one HD video, and through the linkage operation with other modules to synchronize the divided HD video accurately without time delay The purpose is.

In addition, an object of the present invention is to facilitate the editing of the UHD image by the communication of the file format sharing or storage method through the network interface between the modules.

In addition, an object of the present invention is to provide expandability that can be easily responded to by simply disposing a simple module as the resolution of the UHD image increases.

A real-time input / output module system for an ultra-high definition image which divides and receives one UHD image into a plurality of HD images to independently store and process each HD image to achieve the above object receives and interworks with each HD image. And a plurality of modules, wherein each module receives an HD video signal and outputs the HD video to an external output device, a high speed storage medium for storing the HD video through a high speed interface, and a LAN. NIC (Network Interface Card) that supports network connection with other modules through, and the HD image received from the input and output interface unit in real time to the high-speed storage medium in a predetermined raw data storage method, and the other module through the NIC It includes a main processing unit for performing synchronization with other modules through the real-time control signal exchange with.

In this case, the high speed storage medium may include an E-IDE hard disk drive (HDD) or a solid state disk (SSD).

In addition, when the UHD image is 4K UHD, the module may be configured in four, and in the case of 8K UHD image, the module may be configured in sixteen.

The preset raw data storage method may include at least one of an interleave, a non-interleaved method, consideration of screen size, a storage location of audio information, or a video compression format.

The main processor may include an operating system to provide a user interface for receiving a user input through the input / output interface unit, and receive an input for the preset raw data storage method or synchronization setting based on the user input. .

In addition, the main processing unit may set the master or slave of the module, and the main processing unit of the module set as the master among the modules determines a synchronization time point, and another module configured to set the control signal for the synchronization time point as a slave through the NIC. The main processor of the module configured as the slave may generate an interrupt of the highest priority based on the control signal to synchronize the HD image according to the synchronization time point.

In addition, the main processor may determine a master or a slave of the module according to a user input through the input / output interface unit, configuration of hardware configured in the module, or real-time state information of each module.

In this case, the real-time status information includes the real-time data transmission amount of the HD video received at each module or the time of receiving the HD video, the main processor receives its real-time status information of the other module through the NIC and then real-time Compared to the status information, if the data transmission amount is larger than other modules or the reception time is slower than other modules, it may set itself as a master. In addition, the master or slave setting of the main processing unit according to the real-time state information may be periodically changed according to the periodic real-time state information comparison with other modules over time.

The main processor may process the HD image received from the input / output interface unit according to the predetermined raw data storage method and store the A / V storage manager in the high speed storage medium, and synchronize the HD image. A file formatter unit configured to transmit information on the preset raw data storage method to the A / V storage unit, and to transmit or receive a synchronization time point through the NIC to synchronize the HD image according to the synchronization time point. The controller may be configured to control the synchronization unit and to change a setting of the preset raw data storage method of the file formatter unit.

In this case, the main processor controls the file formatter to transmit the synchronization point when the synchronization point of the synchronization unit is determined, and the file formatter unit generates index information based on the synchronization point to generate the index information through the A / V storage management unit. The index information may be stored in the fast storage medium.

According to the present invention, a plurality of modules are configured to correspond to the number of divided HD images constituting the UHD image, and each module independently stores and processes real-time input / output for one HD image, thereby loading data. It can effectively distribute the data to cover a large amount of data transmission.

In addition, the present invention is to determine the synchronization time point through the network communication between the modules, and each module performs the synchronization of the images independently according to the determined synchronization time point, thereby improving the storage speed and the UHD video normally synchronized when the stored video output Has the effect of outputting

In addition, the present invention can individually control each of a plurality of modules, so that the user can edit each of the divided HD video to be output later edited UHD video, providing editing speed and ease of editing for the video can do.

In addition, the present invention can store and input / receive UHD images in real time simply by simply adding modules corresponding to the number of divided HD images according to the resolution of the UHD image, and the performance of hardware included in the module is improved later. Only UHD video can be covered with a smaller number of modules, and even UHD video resolutions can be easily handled by expanding the number of modules, which provides convenient scalability.

The present invention performs input and output and storage as a real-time raw data for the ultra-high-definition image, such as UHD, to facilitate the synchronization of a plurality of HD images constituting the UHD image to an external output device, increasing the resolution of the UHD We propose a real-time input / output module system for ultra-high definition images that can support high resolution by providing scalability.

The real-time input / output module system for an ultra-high definition image according to the present invention collects, in real time, a plurality of HD images for one UHD image provided by an external input device having a plurality of HD cameras for generating an HD image as raw data. In the case of outputting the UHD image to an external output device such as a UHD display, each HD image constituting the UHD image is processed by one independent module, thereby distributing data load concentrated on one main processor and Synchronization can be easily performed through network communication between modules.

In addition, through the network communication as described above, the present invention makes it difficult for an existing system to concentrate on real-time input / output of a simple UHD image by allowing a user to install a specific application to the module so that control of a plurality of modules is integrated. UHD image editing and file format scalability such as rendering can be easily provided.

Hereinafter, a configuration of a real time input / output module system for an ultra high definition image according to the present invention having the above-described features will be described in detail with reference to FIG. 3.

Referring to FIG. 3, the real-time input / output module system for an ultra high definition image according to the present invention may be configured with a plurality of real-time input / output modules 100, and in the case of 4K UHD image, four modules 100 may be configured. Can be. That is, each module 100 receives one of the four HD images constituting the 4K UHD image, processes it independently, and then displays one of four screens matching one of the four divided screens of the display of the external output device. The HD image may be output.

Similarly, in the case of 8K UHD video, the module may be configured to 16 and independently process one HD video, and then output the HD video to a matching screen among 16 divided screens of a display of an external output device. In addition, the real-time input / output module system for an ultra-high definition image according to the present invention may provide easy scalability.

Hereinafter, the present invention described below will be described with reference to 4K UHD video.

Each module includes an input / output interface 120, a main processor 110, a high speed storage medium 130, and a network interface card (NIC) 140. In this case, the input / output interface 120 is connected to an external input / output device with an optical transmission cable to sufficiently cover the data transmission amount for one HD video, and the high-speed storage medium 130 is an E-IDE type hard disk. Including a solid state disk (SSD), the HD image is stored in real time, and the NIC 140 may be connected to an external network such as a LAN to exchange control signals between the modules 100.

In addition, the main processor 110 may store an HD image received from the input / output interface 120 in real time on the high speed storage medium 130, including an operating system, and may be connected to another module through the NIC 140. Synchronization of images, file format determination, and editing can be performed from control signal exchange. In addition, the main processor 110 may receive a user input through the input / output interface 120, and control the main processor 110 of the other module 100 through the NIC 140 to integrate the image. Can be done. In this case, one of the modules 100 is set as a master, so that the main processing unit 110 included in the master module 100 is the main processing unit 110 of the remaining modules 100 corresponding to slaves based on a user input. It can be set to integrated management.

Meanwhile, in the case of an 8K UHD image, a real time input / output module system for an ultra high definition image according to the present invention may be configured with 16 modules, and thus, an 8K UHD image may be easily extended and coped with.

In addition, if the hardware components included in the module improve their own performance, inputs for four HD video signals can be processed in one module in a batch, and for 8K UHD video and video with higher resolution It can provide easy scalability.

4 is a diagram illustrating the hardware configuration of FIG. 3 as described above in a hierarchical reference model, and the module may be configured of a physical layer, a middleware layer, and an application layer.

First, the physical layer includes a physical communication path such as a data bus or a control bus for exchanging data or control signals between the external input / output interface or hardware constituting the module, and the middleware layer includes the main processor of FIG. 3. It is installed at and manages the exchange of control signals and data processing through the physical layer. The application layer may generate various applications that utilize functions related to the actual storage and output of the UHD image, inter-module synchronization and control provided by the middleware layer. Through such an application, the application layer may generate data of the HD image. Determination of transmission path, synchronization, file format determination, control signal generation according to user input, control of high speed interface protocol of HD video, storage management control of HD video through the middleware layer, and synchronization between modules through NIC Can be controlled.

5 is a diagram illustrating a detailed configuration of one module constituting a real-time input / output module system for an ultra-high definition image according to the present invention. As described above, one module 100 independently processes one HD image. 5 is an embodiment in which the module configuration of FIG. 3 described in detail is configured.

Referring to FIG. 5, the detailed configuration may be configured as the external input / output interface 120, the main processing unit 110, the high speed interface unit 131, and a dedicated hard disk (HDD) 132 unit.

In this case, the external input / output interface 120 may receive an HD video signal from an external source and provide it to the main processor 110. The NIC 140 is described in a separate configuration in FIG. As shown, it may be included in the configuration of the main processing unit 110.

Meanwhile, the main processor 110 includes an A / V storage manager 114, a NIC 140, a synchronizer 112, a file formatter 111, and a controller 115. The control unit 115 interleaves an HD video signal received as raw data to the A / V storage management unit 114 through the external input / output interface 120 according to a file format preset through the file formatter unit 111. Formats such as non-interleaved method, consideration of screen size, storage location of audio information, etc. can be controlled, and if necessary, they can be compressed into a predetermined video format (MPEG, AVI, MPEG-2 TS, etc.).

In this case, the image data formatted by the A / V storage management unit 114 may be stored in the dedicated hard disk unit 132 through the high speed interface unit 131. The high speed interface unit 131 and the dedicated hard disk unit 132 may be configured as an E-IDE type hard disk drive (HDD) or SSD as described above.

The controller 115 may add index information for subsequent video management to the stream of the HD video through the file formatter 111, and the A / V storage manager 114 may control the file format. According to the generation of the index information of the touch unit 111, the HD image having the index setting added thereto may be stored in the dedicated hard disk unit 132 through the high speed interface unit 131.

At this time, the control unit 115 receives the information on the synchronization time of the video signal from the other module through the NIC 140 in the addition of the index information through the file formatter unit 111 and the index based on this Information can be generated. That is, the controller 115 synchronizes the HD image through the synchronization unit 112 based on the synchronization time received through the NIC 140, and provides the synchronization time to the file formatter unit 111. The file formatter unit 111 may generate the synchronization time point as index information. The index information may be stored in the dedicated hard disk unit 132 together with the HD image by the A / V storage management unit 114.

In addition, the synchronization unit 112 may be linked to a separate A / V synchronization unit 113. Through this, the synchronization unit 112 may be connected to an external network such as a LAN 140 as described above. Synchronize with the HD image received by the other module through the A / V synchronization unit 113 is linked with the synchronization unit 112 based on the synchronization time of the synchronization unit 112 based on the HD image. The synchronization time point of the audio signal transmitted together with the signal may be synchronized with the synchronization time point of the HD video signal and transmitted to the file formatter unit 111.

On the other hand, the controller 115 generates a synchronization time determined by the synchronization unit 112 as a control signal regardless of the index configuration, and transmits the control signal to other modules through the NIC 140 to synchronize between modules. Synchronization of a plurality of HD images may be performed by matching all viewpoints. At this time, the module including the control unit 115 to determine the synchronization time is set to the master, the control unit 115 of the other module receiving the control signal generated by the control unit 115 of the module set as the master is the control signal Based on this, the highest priority interrupt is generated to control the hardware. The master setting may be made according to an interface provided by the controller 115 or a hardware setting of the module.

In addition, in the master setting, the controller 115 may determine the master or the slave of the module 100 according to the real time status information of each module 100. That is, the real-time status information may include the amount of real-time data transmission of the HD image received at each module 100 or the point of time of receiving the HD image, the control unit 115 is the real-time status information of the other module to the NIC ( If the data transmission amount is larger than other modules or the reception time is slower than other modules, the terminal may set itself as a master after receiving through the real time status information.

Accordingly, the master or slave setting of the controller 115 according to the real time state information may be periodically changed according to the periodic real time state information comparison with other modules.

FIG. 6 is a diagram illustrating a synchronization process according to master and slave settings of a real-time input / output module system for an ultra-high definition image according to the present invention. Referring to FIG. 6, one 4K UHD image is divided into four and received in each module. do.

At this time, as shown in the figure, the input / output module 2 has the fastest time for receiving the video signal, and since the video signal is received by each module thereafter, since the input / output module 2 corresponds to a slave module, the input / output module 2 displays the image. It is set as not authorized to determine when to synchronize signals.

On the other hand, even if the video signal reception time of the input / output module 1 corresponding to the master is delayed compared to other modules, the input / output module 1 may be arbitrarily determined because the input / output module 1 is a module corresponding to the master.

Accordingly, the input / output module 1 determines the synchronization time point as n, and transmits this to the input / output modules 2, 3, and 4 corresponding to the slaves as control signals. The input / output modules 2, 3, and 4 may synchronize a synchronization time point for the UHD image to n based on the control signal, and sequentially store the received images in a dedicated hard disk included in each module in a stream form. .

In addition, when the input / output module 1 outputs the image to an external display, the synchronization time point may be transmitted to the input / output modules 2, 3, and 4 in real time through the NIC. In addition, the input / output module 1 may control the input / output module corresponding to the slave so that the synchronization of the transport streams is synchronized by transmitting the synchronization time through the NIC for each period when the synchronization point is periodically set in one video stream. have.

1 is a diagram illustrating a production process of a UHD image.

2 is a block diagram of a conventional UHD real-time input and output system.

3 is a block diagram of a real-time input and output module system for an ultra-high definition image according to the present invention.

4 is a diagram illustrating a hierarchical reference model of a real-time input / output module system for an ultra high definition image according to the present invention.

5 is a detailed configuration diagram of a real time input / output module system for an ultra high definition image according to the present invention;

6 is a diagram illustrating a synchronization process of a real time input / output module system for an ultra high definition image according to the present invention;

<Explanation of symbols for the main parts of the drawings>

100: module 110: main processing unit

111: file formatter section 112: synchronization section

113: A / V synchronization unit 114: A / V storage management unit

115: control unit 120: input and output interface

130: high speed storage medium 131: high speed interface unit

132: dedicated hard disk unit 140: NIC

Claims (11)

In the real-time input / output module system for ultra-high definition video that receives and stores one UHD video into a plurality of HD video separately to store and process each HD video, Receiving each of the HD video and includes a plurality of modules that interoperate, Each module above An input / output interface unit for receiving an HD video signal and outputting the HD video to an external output device; A high speed storage medium for storing the HD video through a high speed interface; A network interface card (NIC) supporting a network connection with another module via a LAN; And A main processor configured to store the HD image received from the input / output interface unit in real time on the high speed storage medium through a predetermined raw data storage method, and to synchronize with another module through real time control signal exchange with another module through the NIC. Including, The main processing unit An A / V storage management unit processing the HD image received from the input / output interface unit according to the preset raw data storage method and storing the HD image on the high speed storage medium; A synchronization unit for processing the synchronization of the HD image; A file formatter unit for transmitting information on a predetermined raw data storage method to the A / V storage unit; And And a control unit for transmitting or receiving a file format or a synchronization time point through the NIC to control the synchronization unit to synchronize the HD image according to the synchronization time point, and changing a setting for a preset raw data storage method of the file formatter unit. Real-time input and output module system for ultra-high definition video, characterized in that. The method according to claim 1, The high speed storage medium includes an E-IDE type hard disk drive (HDD) or a solid state disk (SSD). The method according to claim 1, If the UHD image is 4K UHD, the module is composed of four, and if the 8K UHD image, the module is composed of 16 real-time input / output module system for ultra-high definition image. The method according to claim 1, The preset raw data storage method includes at least one of interleaved, non-interleaved, screen size consideration, audio information storage location, or video compression format. The method according to claim 1, The main processor includes a operating system to provide a user interface for receiving a user input through the input and output interface unit, The real-time input / output module system for the ultra-high definition image, characterized in that for receiving an input for the predetermined raw data storage method or synchronization setting based on the user input. The method according to claim 1, The main processor may set a master or slave of the module. The main processor of the module set as the master among the modules determines a synchronization time point and transmits a control signal for the determined synchronization time point to another module set as a slave through the NIC, and the main processor of the module set as the slave receives the control signal. Real-time input / output module system for ultra-high definition video, characterized in that to generate the interrupt of the highest priority based on the synchronization to the HD video according to the synchronization time. The method according to claim 6, The main processor determines a master or a slave of the module according to a user input through the input / output interface unit, hardware configuration of the module, or real time status information of each module. . The method of claim 7, The real-time status information includes the real-time data transmission amount of the HD video received at each module or the time of reception of the HD video, The main processor is configured to set itself as a master when the data transmission amount is greater than other modules or when the reception time is slower than other modules by receiving real time status information of another module through the NIC and comparing it with its real time status information. Real-time input and output module system for ultra-high definition video, characterized in that. The method according to claim 8, The master or slave setting of the main processing unit according to the real-time state information is periodically changed according to the periodic real-time state information comparison with other modules according to time. delete The method according to claim 1, The main processor controls to transmit the synchronization time to the file formatter when the synchronization time of the synchronization is determined. The file formatter unit generates index information based on the synchronization time point, and stores the index information on the high speed storage medium through the A / V storage management unit.

Images