KR101249447B1 - Real time reflex composition method using analyzing module of moving object and broadcasting method thereof - Google Patents

Abstract

The present invention relates to a system for synthesizing real-life and virtual image images in real time using an object analysis module of a moving object. The present invention provides an object analysis module 200 for analyzing information of a moving object, and the object analysis. CG generation module 400 for generating a virtual image showing the contents including the information on the moving object based on the information received from the module 200 and the virtual generated in connection with the CG generation module 400 The image synthesis module 600 receives the image and synthesizes the actual image transmitted from the image capturing unit 100, and is located between the CG generation module 400 and the image synthesis module 600 to perform a virtual image interface. It is configured to include a shared memory buffer 500.

Description

Real time reflex composition method using analyzing module of moving object and broadcasting method

The present invention relates to a real-time video synthesis system that analyzes location information, such as ball movement trajectory, in a sports game such as ball game, and implements it in computer graphics, and a method for performing broadcast broadcasting using the same.

In general, broadcast receiving media such as television, which transmits broadcast signals through airwaves, cables, and IP networks, deliver broadcast signals to viewers in real time, thereby resolving the viewers' desire to satisfy various information.

In particular, the broadcast system provides viewers with live video of a sports event in real time by recording a video of a sports event in the field (the stadium) and including a commentary and commentary of the sports game.

Recently, various methods for adding computer graphics to real images have been proposed. For example, inserting a virtual advertisement implemented in computer graphics into a real game video, or in synchronizing ball trajectories and speeds in ball games, and synthesizing various data into live-action video To increase viewer engagement.

To this end, Augmented Reality (Augmented Reality) technology is used, augmented reality is generally a term derived from the virtual environment and virtual reality, which means to express the information generated by the computer over the real world. In other words, real-world information may contain information that the user does not need, and sometimes the user may lack information. However, using a computer-generated virtual environment, you can simplify the information you don't need or create invisible information.

In other words, the augmented reality system is to allow the user to interact with the user in real time by combining the real world and the virtual world, and is widely used in news, entertainment, or sports relay.

For reference, FIGS. 1 and 2 are presently used relay screens, which show AR (Augmented Reality) implemented as computer graphics in actual game images. Specifically, in FIG. 1, a flag indicating a player's nationality 2 is expressed by synthesizing, and in the case of FIG.

As described above, as a conventional technique for synthesizing computer graphics in the field of sports relay, a number of techniques such as Korean Patent Nos. 10-1025899 and 10-0941749 have been disclosed.

However, the prior art as described above has the following problems.

Conventionally, in the case of synthesizing sports broadcasting relay, especially the trajectory of the ball used in the ball game using computer graphics, a separate system is used for each ball game. For example, in the case of synthesizing the trajectory of a golf ball, and in synthesizing the trajectory of a baseball, each of them is implemented through a synthesis system using a separate object analysis module. Therefore, a separate system must be established for each item, and there is no uniformity among them, and thus, there is an inefficient problem because a separate process must be performed for each system.

In addition, synchronization between the actual image and the image implemented in computer graphics is important. In the related art, it is difficult to precisely synchronize one image after delaying one image for such synchronization.

The present invention is to solve the problems of the prior art as described above, the present invention implements the information such as the moving trajectory of the moving object that is the subject of the broadcast relay or the advertisement screen for the advertisement as a virtual image and the actual image It is to provide a unified system that can be applied to various items in the synthesis.

Another object of the present invention is to facilitate synchronization between a real image and a computer-implemented CG image.

Still another object of the present invention is to smoothly interface in synthesizing a computer-implemented CG image.

According to a feature of the present invention for achieving the above object, the present invention is a system for synthesizing real-life image and virtual image image in real time using the object analysis module of the moving object, analyzing the information of the moving object A CG generation module for generating a virtual image showing a content including information about a moving object based on the information received from the object analysis module, the object analysis module, and the virtual generated in connection with the CG generation module An image synthesis module for receiving an image and synthesizing the actual image transmitted from the image photographing unit, and a shared memory buffer positioned between the CG generation module and the image synthesis module to perform the interface of the virtual image.

The object analysis module is connected to a trajectory measuring unit for measuring moving information including a trajectory of a moving object or an image photographing unit for photographing a live-action image, and analyzes the actual image transmitted from the image capturing unit or data transmitted from the trajectory measuring unit. The moving information of the moving object is analyzed on the basis of.

The object analysis module is provided with a time stamp for generating a time code on the live image captured by the image photographing unit, and the screen analysis unit or trajectory analyzing unit provided in the object analysis module uses the time stamp to determine the moving object. Analyze and transmit movement information.

The object analysis module is provided with a transmission unit for transmitting the movement information of the moving object, the CG generation module connected to the object analysis module is provided with a corresponding reception unit, the transmitter and the receiving unit is to receive the movement information of the moving object, respectively Display on the interface.

 At least one side of the CG generation module or the image synthesis module is provided with a delay unit for delaying the virtual image or the real image.

The CG generation module is provided with a plurality of individual scenes for providing virtual image screens according to a plurality of different relay items, and the individual scenes and the live-action image correspond to each other by a matching process.

The virtual image generated by the CG generating module is at least one of a speed, a trajectory, a moving distance, a launch angle, a rotational speed, a blow speed of a tool hitting the moving object, a back swing speed, and a record of a player.

According to another feature of the present invention, the present invention is a broadcast relay method for synthesizing and broadcasting a real-time image and a virtual image in real time using the object analysis module of a moving object, the shooting step of taking a photo-realistic image by the image taking unit And an object analysis step of analyzing the movement information of the moving object measured by the image photographing unit or the trajectory measuring instrument using an object analysis module, and moving through the CG generation module based on the movement information transmitted from the object analysis module. CG generation step of generating a virtual image showing the information about the object, and a video synthesis step of synthesizing the virtual image transmitted through the shared memory buffer and the live image transmitted from the image taking unit using the image synthesis module It is configured by.

The object analysis step is performed through a screen analysis unit for analyzing the screen by the image pickup unit or a trajectory analysis unit for analyzing the object data of the moving object measured by the trajectory measuring device.

Following the photographing step, a step of assigning a time code to the photographed real picture is further included.

In the CG generation step using the CG generation module, a scene selection step of selecting any one of a plurality of individual scenes providing virtual image screens according to different relay events, and a view port of the selected individual scene and the actual image ) And a rendering step of generating a virtual image suitable for the selected individual scene.

The image synthesizing step includes a delay step of delaying at least one of the virtual image generated in the CG generation step and the actual image photographed in the photographing step, and adjusting a play time of the other image to fit the delayed image. It comprises a synchronization step.

As described above, in the real-time video synthesis system using the object analysis module of the moving object and the broadcast relay method using the same, the following effects can be expected.

 In the present invention, the individual scene can be selected in advance prior to the creation of the virtual image, to realize the information such as the moving trajectory of the moving object, which is the subject of the broadcast relay, or the advertisement screen for advertising into a virtual image and synthesize it into the actual image. There is an advantage to provide a unified system that can be applied to a variety of items.

In addition, in the present invention, synchronization between the real image and the computer-implemented CG image may be easily performed by the time code assigned by the time stamp and the delay unit of the image synthesis module, so that virtual image synthesis may be easily and accurately performed. It has an effect.

In addition, in the present invention, in synthesizing a computer-implemented CG image, a user interface is provided for each of the synthesis unit of the image synthesis module and the CG generation unit of the CG generation module, thereby enabling easy operation by a user.

In the present invention, the interface between the real image and the virtual image is smoothly performed by the shared memory buffer and the image buffer of the image synthesis module connected thereto, thereby enabling more accurate and faster image synthesis.

1 is a sports relay screen using the augmented reality technology according to the prior art.
Figure 2 is a sports relay screen using the augmented reality technology according to the prior art.
Figure 3 is a block diagram showing the configuration of a preferred embodiment of a real-time image synthesis system using the object analysis module of a moving object according to the present invention.
Figure 4 is a block diagram showing the configuration of an object analysis module constituting an embodiment of the present invention.
Figure 5 is a block diagram showing the configuration of a CG generation module constituting an embodiment of the present invention.
6 is a block diagram showing the configuration of an image synthesis module constituting an embodiment of the present invention.
7 is an exemplary view showing a user interface screen for controlling a transmitting unit constituting an embodiment of the present invention.
8 is an exemplary view showing a user interface screen for controlling a receiving unit constituting an embodiment of the present invention.
9 is an exemplary view showing a user interface screen for operating the CG generation module constituting an embodiment of the present invention.
10 is an exemplary view showing a user interface screen for operating the image synthesis module constituting an embodiment of the present invention.
11 is an exemplary view showing an actual game image photographed by an image capturing unit constituting an embodiment of the present invention.
12 is an exemplary view showing a virtual image image generated by the CG generation module constituting an embodiment of the present invention.
FIG. 13 is an exemplary view showing how a real game image and a virtual image image are synthesized using an image synthesis module constituting an embodiment of the present invention. FIG.
14 is another exemplary view showing a composite of a real game image and a virtual image image using the image synthesis module constituting an embodiment of the present invention.
15 is a flowchart showing the configuration of a preferred embodiment of a broadcast relay method according to the present invention;
16 is a flowchart illustrating a process of generating a virtual image by the CG generation module constituting an embodiment of the present invention.

Hereinafter, a detailed embodiment of a real-time video synthesis system using the object analysis module of a moving object according to the present invention and a broadcast relay method using the same will be described in detail with reference to the accompanying drawings. Hereinafter, a description will be given taking an example of synthesizing a virtual image into a ball game such as golf and baseball.

3 is a configuration diagram of a preferred embodiment of a real-time image synthesis system using the object analysis module of a moving object according to the present invention.

As shown in the drawing, an actual game image, for example, a live action image for sports relaying such as a golf game or a baseball game, is captured by the image capturing unit 100. The image capturing unit 100 is composed of a recording apparatus such as a general video camera, it is possible to obtain not only an image but also an audio at the same time.

The image capturing unit 100 is preferably composed of a plurality of photographing apparatus. This is to enable a more realistic relay by acquiring different screens from various angles.

In this case, at least one of the image capturing unit 100 captures an image of a ball used in a moving object, for example, ball game. For example, the image photographing unit 100 is to shoot the trajectory of a golf ball or a baseball used in a baseball game. In addition, the captured image is stored or immediately transmitted to the image synthesis module 600 and the object analysis module 200 or both to be described later.

An object analysis module 200 is connected to the image capturing unit 100. The object analysis module 200 is for analyzing the information of the object to be analyzed, wherein the object is a ball (golf ball, baseball ball, etc.) used in athletics or means for hitting the ball (golf club or Baseball bat).

More precisely, the object analysis module 200 is a movement trajectory of the ball, the movement speed of the ball, the initial velocity and subordination of the ball, the movement distance, the launch angle, the rotational speed, the rotational direction, the blow speed of the tool hitting the moving object, the back swing speed And then quantify it.

In this case, the object analysis module 200 may obtain the basic data (RAW DATA) for analyzing the object from the image capturing unit 100 or the trajectory measuring unit 300 to be described below. That is, the object analysis module 200 analyzes the trajectory or the moving speed of the object through the image screen transmitted from the image capturing unit 100 or traces or moves the object measured by the separate trajectory measuring device 300. You can analyze the speed and receive it.

In more detail, the object analysis module 200 analyzes an object moving on an image screen obtained from the image capturing unit 100. In this case, an actual image obtained as an image screen using an image tracking technique. By analyzing the actual size of the background and the actual time taken, it is possible to obtain the trajectory or moving speed of the object. For example, in baseball games, the absolute coordinates of the ball can be obtained as a result of tracking the trajectory of the ball through the image comparison algorithm from the moment the pitcher throws the ball from the fixed camera. Data can be obtained.

When the data is obtained from the locus measuring device 300, the data transmitted by the locus measuring device 300 is analyzed to organize various information of the object. In this case, a Doppler radar system is used. The Doppler radar system may be implemented in hardware by the trajectory measuring device 300. The Doppler radar system uses the feature that radio waves hit and reflect on a target to capture the reflected wave to determine the existence of an object.

To this end, the trajectory measuring device 300 is connected to the object analysis module 200. The trajectory measuring unit 300 extracts data such as a moving speed including an object trajectory using a Doppler radar system and the like. In the case of a golf game, the trajectory measuring unit 300 is installed behind the tee shot point to measure the trajectory of the golf ball. In the present embodiment, the trajectory measuring device 300 may be a commercially available product.

In this case, the connection between the image capturing unit 100 and the object analysis module 200 and the trajectory measuring unit 300 and the object analysis module 200 may be wired or wireless. If they are connected wirelessly, they may be connected via TCP / IP or the like.

Referring to FIG. 4, the object analysis module 200 will be described in more detail. The object analysis module 200 includes a screen analyzer 210 and a trajectory analyzer 220. As described above, the screen analyzer 210 analyzes information of an object from an image image of the image capturing unit 100 using an image tracking technique, and the trajectory analyzer 220 is connected to the trajectory measurer 300. The data measured by the trajectory measuring device 300 is analyzed / arranged.

The screen analyzer 210 and the trajectory analyzer 220 are connected to the time stamp 230, respectively. The time stamp 230 is for adding time information (time code) to movement information of a moving object (object). In the present embodiment, the time stamp 230 is applied to data obtained by the screen analyzer 210 and the trajectory analyzer 220. Although it is implemented by inputting a time, the time information may be previously applied to data transmitted from the image capturing unit 100 or the trajectory measuring device 300.

The object analysis module 200 is provided with a transmitter 250. The transmitter 250 is for transmitting the information analyzed for the object (animal or hitting subject) to the receiver 410 of the CG generation module 400 to be described below.

The transmitter 250 may be displayed by a user interface. This is for the user to check and control the information of the transmitter 250 and may be displayed through a monitor or the like.

7 illustrates a user interface of the transmitter 250. This is a screen displayed through the actual monitor through which the user can operate the object analysis module 200. The user interface shows various kinds of information of the moving object and the hitting subject, and is implemented to manipulate the selection of a port for transmission, a port initialization, and a delay time of data transmission.

Next, the CG generation module 400 will be described. The CG generation module 400 is for generating a virtual image, where the virtual image refers to computer graphics, and the virtual image refers to an object (a animal or a hitting subject). Express information or virtual advertisements. The virtual image forms a unit frame for expressing an image and finally becomes a virtual image.

More precisely, as shown in FIG. 5, the CG generation module 400 includes a receiver 410, a data buffer 420, and a CG generator 450. The receiver 410 corresponds to the transmitter 250 described above, and serves to receive movement information of a moving object. In some cases, the receiver 410 may display the movement information of the moving object as a user interface.

For reference, FIG. 8 illustrates an example of a user interface for operating the receiver 410. As shown in the figure, various data are shown in the user interface of the receiver 410. In this embodiment, the speed, ball speed, shot angle, back spin, and the like of the golf player and the club head on which each golf player has swinged are displayed. The user can change the server IP or the like through the user interface, or correct any errors in the received information.

Next, a data buffer 420 is connected to the receiver 410. The data buffer is a kind of storage space, which stores the movement information received by the receiver 410, and then transfers it to the CG generator 450 to provide data for creating a virtual image.

The CG generation unit 450 is connected to the data buffer 420. The CG generation unit 450 substantially generates a virtual image (computer graphic), and may include a graphics generation program internally, and may be implemented using an Open Graphics Library (OpenGL) or Direct3D. have.

In this case, the mall CG generator 450 may generate a virtual image at a desired time by using the time code transmitted from the receiver 410. That is, the CG generation unit 450 uses the time code included in the movement information to delay the time that the virtual image is made or to transfer the created virtual image to the shared memory buffer 500 as much as desired. It can be delayed.

9 illustrates an example of a user interface screen for operating the CG generation module 400. As shown in the drawing, a virtual image (②) representing the trajectory of the ball is generated on the background screen (①), and this virtual image (②) is generated based on the data received by the receiving unit 410 as described above. Can be. In addition, letters or numbers may also be generated as shown.

Looking specifically, it is possible to implement a two-dimensional or three-dimensional image according to the user's operation (③), it is also possible to adjust the specific position, rotation angle, size, etc. of the virtual image (④).

Along with this, letters or numbers to be added to the virtual image can be arbitrarily inputted (⑤), and the camera's viewpoint adjustment function (⑥) looking at the virtual image and other color of the trajectory (⑦) are also controlled. Can be changed by operation.

At this time, the viewpoint adjustment (⑥) of the camera is for aligning the view port with the position of the camera where the real image is taken, and adjusts the virtual image so that the viewpoint of the virtual image to be generated coincides with the point of view of the camera where the real image is taken. Function to adjust the viewing point. This function can also be used to match the viewport of the live action image to a separate individual scene, described below.

The virtual image is transferred to the image synthesis module 600 through the shared memory buffer 500. The shared memory buffer 500 is located between the CG generation module 400 and the image synthesis module 600 to perform an interface of a virtual image.

The shared memory buffer 500 is a kind of storage device shared by the CG generating module 400 and the image synthesizing module 600, and is processed between the CG generating module 400 and the image synthesizing module 600 for synthesizing the same. It also serves to cushion the speed difference. Of course, the CG generation unit 450 may also simultaneously perform the role of the shared memory buffer 500 by delaying the time at which the virtual image is arbitrarily created.

The image synthesis module 600 is connected to the shared memory buffer 500. The image synthesizing module 600 combines the real image captured by the image capturing unit 100 with the virtual image generated by the CG generating module 400 to create a final image.

As shown in FIG. 6, the image synthesis module 600 includes a delay unit 610, an image buffer 630, and a synthesis unit 650. The delay unit 610 is connected to the image capturing unit 100 to receive a photographed image and to selectively delay the image. That is, the delay unit 610 appropriately delays the live image for synchronizing between the photographed real image and the generated virtual image described above. In this case, the delay time may be adjusted by the user.

The image buffer 630 is connected to the delay unit 610. The image buffer 630 is a space for storing the virtual image transferred from the real image and the shared memory buffer 500 for layer synthesis of the real image and the virtual image, and these images are designated and stored for each frame. Can be.

Then, the image stored in this way is finally synthesized by the combining unit 650. At this time, synchronization may be performed by a time code assigned to the live image and a time code assigned to a virtual image. The synthesizing unit 650 synchronizes the time code information transmitted by the time stamp 230.

 In addition, the synthesis unit 650 may selectively add various effects including chroma keys.

FIG. 10 shows an example of a user interface screen for manipulating the image synthesis module 600 constituting the embodiment of the present invention. As can be seen, it is possible to control the transmission channel and set the transmission method, for example, the SD method or the HD method (①), and the delay by the delay unit 610 described above can be adjusted for each frame (②). Effects can be selectively inserted (③). In the present embodiment, the chroma key technique and the multi cam effect can be selectively reflected. At this time, detailed setting of these effects is also possible (④). For example, when chroma key technique is applied, direct color input using numerical values is possible (⑥), but it can also be specified by clicking a specific point on the screen (⑤).

On the other hand, the CG generation module 400 is provided with a plurality of individual scenes to provide a plurality of different relay events or a virtual image screen according to different relay time. The individual scene is to provide various basic screens according to relay events or viewpoints to be broadcasted, and the settings of the basic screen and various other screens basically used for each item are stored in the image buffer 630 or other database. In, when a user selects an individual scene, the selected individual scene is used as the CG generation module 400.

For example, in the present embodiment, the baseball relay scene and the golf relay scene may be selected as individual scenes. When the baseball relay scene is selected, the basic baseball relay screen (for example, the pitcher and the batter viewed from the outfielder) On the basis of this, basic settings for synthesizing the pitching pitch of the pitcher into a virtual image may be completed.

That is, the user selects an individual scene according to the relay event or the angle of the relayed camera and prepares the generation of a virtual image corresponding thereto in the CG generation unit 450. In other words, when the basic information of the CG generation unit 450 is set to match the position, center position, camera angle, etc. of the camera based on the previously input data, the data is transferred based on the data transmitted from the object analysis module 200. The trajectory of the object can be created. Of course, in this case, additional viewport matching may be performed by manipulating the user interface.

Hereinafter, the process of synthesizing and relaying images according to the present invention will be described in detail.

Referring to FIG. 15, first, a photographing step of photographing a live-action image by the image capturing unit 100 is performed. This is a game screen shot by the actual camera, the number and the viewpoint of the camera can be variously modified. (S100) FIG. 11 is a photographed real picture taken as an example.

At the same time, the step of assigning a time code to the photographed live image may be further included. The time code is allocated by the time stamp 230, and by assigning a separate time code to each frame of the live-action video, it is possible to synchronize with the virtual image later.

Subsequently, the movement information of the moving object measured by the image capturing unit 100 or the trajectory measuring unit 300 is analyzed using the object analysis module 200 (S200). It may be made through the screen analysis unit 210 for analyzing the screen by the photographing of the unit 100 or through the trajectory analysis unit 220 for analyzing the object data of the moving object measured by the trajectory measuring unit 300. have.

Such movement information is transmitted by the transmission and reception of the transmitter 250 and the receiver 410, and information about the moving object through the CG generation module 400 based on the movement information transmitted from the object analysis module 200. Generate a virtual image to illustrate the (S300).

That is, the CG generation module 400 is a tool for hitting the moving trajectory of the moving object, the moving speed of the ball, the initial velocity and subordination of the ball, the moving distance, the firing angle, the rotating speed, the rotating direction, and the moving object based on the moving information. Hitting speed, backswing speed, etc. will create a virtual image is shown.

The virtual image generated as described above is transferred through the shared memory buffer 500 and synthesized by the image synthesizing module 600 together with the actual image transmitted from the image capturing unit 100. (S400) That is, the actual image The synthesized virtual image is synthesized, and may be layer synthesized through the image buffer 630 included in the image synthesis module 600.

In this case, since the time code is assigned to the live image and the delay unit 610 is provided in the image synthesis module 600, the live image and the virtual image may be synchronized. Specifically, each unit virtual image (frame) is matched to match the time code allocated to each unit screen (frame) constituting the real picture. In this case, the delay time may be adjusted through the user interface as necessary.

The final image synthesized as described above is finally transmitted through the transmitting unit 700 to broadcast. 13 and 14 show a final broadcast transmission screen in which the trajectory of the ball is synthesized into a virtual image.

Meanwhile, FIG. 16 illustrates a process of generating a virtual image by the CG generation module 400. As shown in FIG. 16, the scene selection step may be preceded by the previous CG generation step (S310). Different scenes are selected according to the event to be played or the viewpoint of the camera to be relayed. Since the basic information about the individual scenes (camera viewpoint, position, etc.) is already stored, when this is selected, the basic information is loaded and a virtual image is generated based on this.

Thereafter, a matching step of matching the selected individual scene and the view port of the live image may be further included (S320). That is, if the viewport of the selected individual scene and the viewport of the live action image do not match, this can be additionally matched, which is made by the synthesis unit 650 of the CG generation module 400 as described above. Through visual confirmation, it can be manipulated and matched.

Subsequently, the synthesis unit 650 finally generates a virtual image through a rendering step of generating a virtual image corresponding to the selected individual scene.

On the other hand, the preceding image synthesis step (S400), the delay step of delaying at least one of the virtual image generated in the CG generation step and the actual image photographed in the photographing step, and the other one to fit the delayed image It can be divided into a synchronization step of adjusting the playing time of the video.

This is for synchronizing the real image with the virtual image time corresponding thereto. For example, the actual image may be delayed by a predetermined time and the virtual image corresponding thereto may be simultaneously synthesized. This means that the actual image can be delayed in advance in consideration of the generation time of the virtual image or the wired / wireless transmission environment.

The rights of the present invention are not limited to the embodiments described above, but are defined by the claims, and those skilled in the art can make various modifications and adaptations within the scope of the claims. It is self-evident.

100: the image capture unit 200: object analysis module
300: trajectory measuring instrument 400: CG generation module
500: shared memory buffer 600: video synthesis module
700: sending part

Claims (12)

In the system for synthesizing real-time image and virtual image image in real time using the object analysis module of a moving object,
An object analysis module for analyzing the information of the moving object,
A CG generation module for generating a virtual image showing content including information on a moving object based on the information received from the object analysis module;
An image synthesizing module for receiving the virtual image generated in connection with the CG generating module and synthesizing the real image transmitted from the image photographing unit;
It is configured to include a shared memory buffer located between the CG generation module and the image synthesis module to perform the interface of the virtual image,
At least one side of the CG generation module or the image synthesis module is a real-time image synthesis system using an object analysis module of a moving object, characterized in that a delay unit for delaying a virtual image or a live image.
The apparatus of claim 1, wherein the object analysis module is connected to an image photographing unit for photographing a real image or a trajectory measuring unit for measuring movement information including a trajectory of a moving object, and analyzes the actual image transmitted from the image capturing unit; Real-time image synthesis system using the object analysis module of the moving object, characterized in that for analyzing the movement information of the moving object based on the data transmitted from the trajectory measuring device.
According to claim 2, wherein the object analysis module is provided with a time stamp for generating a time code on the live image captured by the image photographing unit, the screen analysis unit or trajectory analysis unit provided in the object analysis module is the time stamp Real-time image synthesis system using the object analysis module of the moving object, characterized in that for analyzing and transmitting the moving information of the moving object.
The method of claim 3, wherein the object analysis module is provided with a transmitter for transmitting the movement information of the moving object, the CG generation module connected to the object analysis module is provided with a corresponding receiver, the transmitter and the receiver are respectively moved Real-time image synthesis system using the object analysis module of the moving object, characterized in that to display the movement information of the object to the user interface.
delete The CG generation module according to any one of claims 1 to 4, wherein the CG generation module is provided with a separate individual scene for providing a virtual image screen according to different relay events, and the individual scene and the live-action image are determined by a matching process. Real-time image synthesis system using the object analysis module of the moving object, characterized in that corresponding.
The method of claim 6, wherein the virtual image generated by the CG generating module is at least one of a speed, a trajectory, a moving distance, a launch angle, a rotational speed of the moving object, a blow speed of the tool hitting the moving object, a back swing speed, and a record of the player. Real-time image synthesis system using the object analysis module of the moving object, characterized in that one.
In the broadcast relay method for synthesizing and broadcasting real-time video and virtual image in real time using the object analysis module of a moving object,
A shooting step of shooting a live-action image by an image photographing unit;
An object analysis step of analyzing movement information of a moving object measured by the image photographing unit or a trajectory measuring unit using an object analysis module;
A CG generation step of generating a virtual image showing information on a moving object through the CG generation module based on the movement information transmitted from the object analysis module;
And an image synthesizing step of synthesizing the virtual image transmitted through the shared memory buffer and the real image transmitted from the image capturing unit using an image synthesizing module.
The image synthesis step
A delay step of delaying at least one of the virtual image generated in the CG generation step and the actual image photographed in the shooting step;
And a synchronization step of adjusting a playback time of the other video to match the delayed video.
The method of claim 8, wherein the object analysis step
The broadcast relay method, characterized in that it is made through a screen analysis unit for analyzing the screen by the image pickup unit or the trajectory analysis unit for analyzing the object data of the moving object measured by the trajectory measuring device.
10. The broadcasting relay method of claim 9, further comprising a step of designating a time code in the photographed live image after the photographing step.
The method according to any one of claims 8 to 10, wherein the CG generation step using the CG generation module
A scene selection step of selecting any one of individual scenes providing virtual image screens according to different relay events;
A matching step of matching the selected individual scene with a view port of the real image;
And a rendering step of generating the virtual image.



delete

Images