KR100460081B1 - A moving picture virtual reality image construction system and a method thereof - Google Patents

Abstract

The present invention relates to a system and method for producing virtual reality images. Many cameras photograph subjects and output video signals. The plurality of video signals are captured and generated as a video object file in one file format. The video object file is compressed, reduced and stored. Read and display the saved video object file according to the user's control signal. By doing so, it is possible to minimize the amount of data of a plurality of video signals, store a plurality of videos in a single file in a unique classification system, and display a variety of new video data formats using a unique classification system.

Description

Moving image virtual reality image construction system and a method

The present invention relates to a video virtual reality image production system, and more particularly, to a video virtual reality image production system for acquiring an object video using a plurality of video cameras and to display it in real time via a network and local; It is about a method.

The technology of the conventional still picture object VR and computer graphics object VR has already made much progress.

In general, unlike a graphic virtual reality (VR) image, the technique of producing a virtual reality image through a photo is called photorealistic VR or photo VR.

Thanks to ease of production and excellent price competitiveness, the field of photography VR has been growing rapidly for a short time.

Photo VR, a technique that creates software illusions by connecting several pictures taken separately in the same place and looking at the surroundings or looking at objects in the field, can be said to be a virtual reality in a narrow sense.

Panorama VR is a method of moving the reality of 360 ° on the left and right horizontal lines from a fixed point of view through a pre-recorded picture, that is, using a mouse to move in a desired direction. The object VR is a method of photographing the camera as if it is rotated by a degree and rotating it in a desired direction by using a user's selection, that is, a mouse.

Photo VR produced in this way can be combined with the web by various types of viewers, that is, a program that makes it possible to continuously move and view images or to sequentially view overlapping images.

Current VR technology is being developed in more various forms. The hotspot feature can be used to move one distant VR image to another associated image, and can be combined with a geographic information system to provide accurate information about the current location and orientation.

In the case of Object VR, it can be used to effectively show a product and can make detailed observation through zoom in and zoom out.

Video VR is basically no big difference from photographic VR. Photo VR uses still images, but Video VR uses moving video to view the desired image from the user's selection and manipulation in two views, 360 ° on the horizon, with an object centered on the subject and a panorama centered on the viewer. There is only a difference.

Companies that have this technology around the world today include US behere and ipix. However, it is true that the video VR technology developed by the above company uses expensive digital cameras, and has defects such as poor image resolution and non-continuous image of the connection part.

And most importantly, video VR so far is only showing panoramic VR. No company in the world currently develops or possesses video object VR.

On the other hand, in the case of the still picture image object VR, there is a limit to show everything through a single image that does not move. There are many weak points to experience complete virtual reality.

In the case of computer graphics object VR, sophisticated work can produce images that are almost as realistic.

However, this requires a lot of work time and skilled manpower and this also has a limitation that can only show a still image.

The technical problem to be achieved by the present invention is to minimize the amount of data of a plurality of video signals, to store a plurality of video in a single file in a unique classification system, and to use a variety of new video data format using a unique classification system The present invention provides a virtual reality image production system and method for displaying and allowing a user to control the image in a desired direction.

1 is a block diagram of a system for producing a virtual reality video image according to an embodiment of the present invention.

2 is a flowchart illustrating a method of producing a moving image virtual reality image according to a first embodiment of the present invention.

3 is a basic photographing configuration diagram of the photographing unit.

4 is a layout view of a camera for expanding an angle of view on a vertical line using multiple stages.

5 is a diagram illustrating a classification system of a moving image.

6 is a diagram illustrating an image arrangement of a file generated by a video object file generation unit.

7 is a gray level brightness histogram for red, green and blue.

8 is a view showing an image display method in a moving image virtual reality image production method according to a first embodiment of the present invention.

9 is a block diagram of a system for producing a virtual reality video image according to a second embodiment of the present invention.

In order to solve this problem, a video virtual reality image production system according to one feature of the present invention,

A photographing unit including a plurality of cameras to photograph the subject at various angles;

A video capture unit for capturing and transmitting video signals respectively output from a plurality of cameras of the photographing unit;

A video object file generation unit generating a plurality of video signals received from the video capture unit as a video object file in the form of a file;

And a storage unit for storing the video object file.

Video virtual reality image production method according to another aspect of the present invention for achieving the above object,

Photographing the projectile by a plurality of cameras to output an image signal;

Capturing the plurality of video signals to generate a video object file in the form of a file;

Compressing, reducing and storing the video object file.

Then, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

1 is a block diagram of a video system for producing a virtual reality image according to a first embodiment of the present invention.

As shown in Figure 1, the video virtual reality image production system according to a first embodiment of the present invention,

A photographing unit 100 including a plurality of cameras 110, 120, 130... To photograph a subject at various angles;

A video capture unit 210 for capturing and transmitting image signals respectively output from a plurality of cameras of the photographing unit 100;

A video object file generator 220 for generating a plurality of video signals received from the video capture unit 210 into a video object file in one file format;

A compression unit 230 for compressing the video object file;

A data amount reduction unit 240 for reducing the video object file compressed by the compression unit 230 using a chroma key technique;

A storage unit 250 for storing the video object file reduced by the data amount reduction unit 240;

An input device 300 that receives data to perform a function desired by a user;

A display controller 260 which controls to read and display a video object file of the storage unit 250 according to a signal of the input device 300;

And a display 400 for displaying a video under the control of the display controller 260.

Next, the operation of the virtual reality image production system having such a configuration will be described in detail with reference to FIGS. 1 to 9.

2 is an operation flowchart of a method for producing a virtual reality video image according to an embodiment of the present invention.

First, the video cameras 110, 120, 130... Are positioned at 360 ° on the horizontal line within the same radius around the subject as shown in FIG. 3. Here we have six cameras, but you can change the number to work as needed.

Next, power is supplied to each of the cameras 110, 120, 130, ..., and the system (S201).

In addition to these basic shooting methods, if one stage, or one stage, is placed at 360 ° on the horizontal line of the same radius around the subject, the second stage, three stages, etc. will be used in the same manner except for the first stage within the same radius around the subject. If you draw a virtual circle with the same radius around the subject, you can form multiple stages as shown in Figure 4 to widen the angle of view not only on the horizontal 360 ° but also on the vertical line.

In addition, various photographing methods can be modified.

When photographing starts, the plurality of cameras 110, 120, 130... Output the image signals photographed from the subjects to the moving image capture unit 510 (S202).

Then, the image data photographed by the plurality of video cameras 110, 120, 130... Are input to the video object file generator 220 through the video capture unit 510 of the main computer.

Then, the original images photographed by the plurality of video cameras 110, 120, 130... Are generated as one file by the video object file generator 220 and have a new video data format (S203).

Here, the captured video images are generated as a single file with a unique classification system. Each frame of each video image is classified as shown in FIG. 5.

In FIG. 5, video 1 is a frame photographed by camera 1, video 2 is a frame photographed by camera 2, video 3 is a frame photographed by camera 3, and video 4 is photographed by camera 4. This is a frame taken.

The video images classified as above are arranged as shown in FIG. 6 so that a plurality of video original images are generated as a single file in a new video data format.

That is, among the first frames of the video taken by each video camera, the frames taken by the first video camera to the frames taken by the last video camera are sequentially arranged, and then the second frame taken by the first video camera is located. .

In the same way as above, all moving image images are generated as moving object files. In FIG. 6, four cameras are described as an example.

Next, the video compression unit 230 performs primary compression through video compression.

The video is displayed continuously in a frame of 24-30 frames per second, which makes you feel as if you are watching a moving reality. The difference between the frame and the next frame is almost no movement of the image.

Therefore, according to the situation of the previous image can be divided into a case where there is no movement of the continuous frame and there is a movement.

In the first case, if there is no change at all (stopped), since there is no change in data, the previous video image can be used as it is and the data of the next video image can be deleted.

In the second case, a part of the current screen has moved from a part of the previous screen. Coordinate the movement amount (x, y coordinates) of the moving part of the entire image to display only the actual moving information, and the non-moving part can efficiently use the data using the whole image.

As such, the video compression unit 230 compresses the video object file by coordinates the change amount of the current frame and the next frame. Such a compression technique is widely known in the art (S204).

Next, the data amount reduction unit 240 reduces the data amount of the video object file by using a chroma key used as a synthesis technique, which is a kind of special effect.

That is, the background image of the subject is used as a background complementary to the subject, such as a blue screen or a green screen, and after shooting with multiple cameras, the color used as the color complementary to the subject among 16 million colors represented in the digital domain is randomly selected. By deleting it, the amount of data is significantly reduced (S205).

Colors represent all the colors of nature through a combination of the primary colors of red, green and blue.

The three primary colors of light each have a gray level brightness histogram as shown in FIG.

By manipulating this histogram, you can delete all the specific colors. Since such chroma key technology is a well known technology, detailed description thereof will be omitted.

As described above, the data amount reduction unit 240 reduces and outputs the compressed video object file by the video compression unit 230 by removing the background information by using the chroma key technique.

Then, the storage unit 250 stores the new video data format generated and compressed and reduced through the video object file generator (S206).

By this process, a video virtual reality image is produced.

Meanwhile, a method of viewing a video virtual reality image produced as described above is as follows.

First, the user selects a video virtual reality image to be viewed using the input device 300.

Then, the display controller 260 reads the corresponding video file from the storage 250 and restores the compressed video to its original state and displays it on the display 400 (S801). In this case, the restored files are sequentially arranged for each frame of the video image as in the new video data format generated by the video object file generation unit 220 of FIG. 6.

In FIG. 6, 1-1, 1-2, 1-3, etc. are frame numbers of videos captured by the first video camera, and 2-1, 2-2, 2-3, etc. are captured by the second video camera. This is a video.

The first frame of the video merged into one file is arranged sequentially from the first video camera to the last video camera and then passed to the next frame.

The generated file plays only one side of the subject while moving directly from 1-1 to 1-2 until there is no movement of the mouse or keyboard, which is the input device 300 of the computer, until the user requests it. S802).

This displays only the image of the subject viewed by a single camera. In other words, frames 2-1, 3-1, 4-1, etc. of all moving image images shot by another video camera instead of the first video camera are not displayed at all.

When the user wants to see the right or left side of the photographed object, the user inputs a command to move the mouse, which is the input device 300 of the computer, to the right or left on the screen or to the right or left through the keyboard.

Then, the display controller 540 determines whether the user uses the input device 300 such as a mouse or a keyboard to view the right side of the subject (S803).

If the user uses the input device 300 to view the right side of the subject, the display controller 540 continues to display the subject while moving the right side (S805), and the user inputs 300 to view the right side of the subject. If not used, the display controller 540 determines whether the user uses the input device 300 such as a mouse or a keyboard to look at the left side of the subject (S804).

If the user has used the input device 300 to view the left side of the subject, the display controller 540 continues to display the subject while moving the subject to the left (S806), and determines whether the user has stopped the command.

In the above process, the moving image file is displayed from 1-1 to 2-1 and 3-1 frames or vice versa by moving from 1-1 to 4-1 and 3-1 frames.

That is, this is an image of the photographed subject (object) viewed from another side.

In order to observe one subject in detail, it is displayed while being naturally moved to the other side of the subject as shown by turning left and right and up and down.

Next, when the user stops the command, the display control unit 540 continues to display one side of the moment of stopping the command. In other words, when the mouse movement or the keyboard command is completed in 3-1, only one side of 3-2, 3-3, etc. is displayed.

On the other hand, the display control unit 540 may display the moving image as the first side image after the command from the input device 300, such as moving the mouse or keyboard.

In the first embodiment, the video object file is compressed and reduced and stored. However, if necessary, the video object file may be stored without being compressed or reduced.

This is shown in FIG.

As shown in FIG. 9, the video captured by the photographing unit 100 is output through the video capturing unit 510, and the video object file generating unit 520 receives a plurality of inputs from the video capturing unit 510. The video signal is generated as a video object file in one file format and stored in the storage unit 530.

As described above, the second embodiment can produce a moving image virtual reality image with a simple configuration.

In addition, the process of displaying the stored image is similar to the first embodiment, and since there is no compression and reduction process, the display controller 540 does not need to restore the data, and may display the stored file directly.

This second embodiment requires more storage space of the storage unit 530 occupied by the video object file than the first embodiment, but can produce a virtual reality image with a simple configuration.

Embodiment of the present invention as described above there are various modifications, it can be applied to the computer or the Internet.

As described above, in the embodiment of the present invention, the amount of data of the plurality of video signals is minimized, the plurality of videos are stored in a single file in a unique classification system, and a new video data format is generated using the unique classification system. It can provide a variety of displays, and can provide a virtual reality image production system and method for viewing in the desired direction under the control of the user.

Claims (10)

(Correction) a photographing unit including a plurality of cameras to photograph the subject at various angles; A video capture unit for capturing and transmitting video signals respectively output from a plurality of cameras of the photographing unit; A video object file generation unit generating a plurality of video signals received from the video capture unit as a video object file in the form of a file; A storage unit for storing the video object file; A compression unit for compressing the video object file; A data amount reduction unit for reducing the video object file compressed by the compression unit using a chroma key technique; An input device for receiving data to perform a function desired by a user; A display control unit which controls to read and display a video object file of the storage unit according to a signal of the input device; Video virtual reality image production system comprising a display for displaying a video under the control of the display control unit. delete delete delete (Correction) a photographing unit including a plurality of cameras to photograph the subject at various angles; And a computer system for capturing video signals output from the plurality of cameras of the photographing unit, and generating and storing the plurality of video signals as a video object file in one file form. The computer system, An input device for receiving data to perform a function desired by a user; A display control unit which controls to read and display a video object file of the storage unit according to a signal of the input device; Video virtual reality image production system comprising a display for displaying a video under the control of the display control unit. delete (Correction) photographing a projectile by a plurality of cameras and outputting an image signal; Capturing the plurality of video signals to generate a video object file in the form of a file; Compressing, reducing, and storing the moving object file; A method for producing a virtual reality video image including reading and displaying a stored video object file according to a user's control signal. delete (Correction) According to claim 7, Reading and displaying the video object file, The method of claim 1, wherein the image of the subject photographed by one camera is displayed while the other side is displayed according to a user's control signal. delete