WO2016140444A1

WO2016140444A1 - Device for generating virtual video related to event of game and method using same

Info

Publication number: WO2016140444A1
Application number: PCT/KR2016/001398
Authority: WO
Inventors: 안태훈; 이윤주
Original assignee: 안태훈; 이윤주
Priority date: 2015-03-02
Filing date: 2016-02-11
Publication date: 2016-09-09
Also published as: KR101559469B1

Abstract

Disclosed are a device and a method for generating a virtual video of a game. The device for generating a virtual video of a game, according to one embodiment of the present invention, comprises: a decoding unit for decoding data related to an event of a game, the data being encoded using preset fields, and extracting event information; a database for storing templates each corresponding to objects in a game arena; and a video generation unit for generating, on the basis of the event information and the templates, a virtual video corresponding to the event.

Description

Apparatus for generating virtual video related to event of game and method using same

The present invention relates to an apparatus for generating a virtual video related to an event of a game, and a method using the same (APPARATUS FOR CREATING VIRTUAL VIDEO RELATED TO EVENT OF GAME AND METHOD USING THE SAME).

Recently, the popularity of sports games such as soccer games and baseball games is gradually increasing. Accordingly, while broadcasting a video related to an event occurring during a game in sports relay broadcasting or analysis broadcasting, analysis thereof is increasing.

In recent years there has been an increasing tendency to analyze professionally beyond enjoying sports. Up to now, the analysis of sporting events has only re-broadcasted the actual video shot. This hinders the analysis of sporting events in various ways. Rather, analyzing the game using virtual video related to the event helps to analyze the game in more various ways.

However, the conventional techniques are inconvenient because they generate a virtual video by directly rendering a reference to the actual image of the game.

Accordingly, a technique for generating a virtual video related to an event during a game more quickly is urgently needed.

An object of the present invention is to provide a more sophisticated and realistic virtual video using event information extracted by decoding encoded data related to an event of a game.

Also, an object of the present invention is to quickly generate a virtual video by storing a template corresponding to an object in a database and using the same for creating a virtual video.

In addition, an object of the present invention is to provide a more realistic virtual video by synchronizing the sound with the virtual video.

According to an aspect of the present invention, there is provided an apparatus for generating an event-related game virtual video, including: a decoder configured to decode event-related data of a game encoded with preset fields; A database storing templates corresponding to each of the objects in the stadium; And a video generating unit generating a virtual video corresponding to the event based on the event information and the templates.

At this time, the decoding unit is an event decoding unit for extracting the type and information of the event by decoding the information corresponding to the event included in the event-related data of the game; And a sensor decoding unit decoding information corresponding to sensors included in event related data of the game and extracting identifiers and position information of the sensors.

In this case, the sensor decoding unit may include an object identification unit that distinguishes each of the objects based on identifiers of sensors corresponding to the objects; And a location information extracting unit extracting location information corresponding to each of the objects based on the location information of the sensors.

In this case, the video generating unit may include a background screen generating unit which loads a background screen corresponding to the event from the database based on the event information; A virtual screen generation unit generating virtual screens by placing the templates corresponding to each of the objects on a background screen corresponding to the event based on location information corresponding to each of the objects; And a virtual video generator configured to sequentially synthesize the virtual screens to generate the virtual video corresponding to the event.

At this time, the game virtual video generating device may further include a sound extracting unit for extracting a sound from the pre-recorded game image corresponding to the event.

At this time, the game virtual video generating device may further include a synchronization unit for synchronizing the sound extracted by the sound extraction unit and the virtual video.

At this time, the game virtual video generating apparatus may further include a control unit for expanding, reducing and controlling each of the objects present in the video.

In this case, the encoded event-related data may include an event ID field, an event attribute field, a sensor ID field associated with an event, and a sensor data field. ), And the fields may have a data frame existing between a start of field (SOF) and an end of field (EOF).

In addition, the event-related virtual video generating method according to the present invention comprises the steps of extracting the event information by decoding the event-related data of the game encoded in the predetermined field; And generating a virtual video corresponding to the event based on templates corresponding to each of the objects in the stadium stored in the event information and the database.

In this case, the extracting of the event information may include extracting the type and information of the event by decoding information corresponding to the event included in the event related data of the game; And extracting identifiers and location information of the sensors by decoding information corresponding to the sensors included in the event-related data of the game.

In this case, extracting the identifiers and location information of the sensors may include distinguishing each of the objects based on the identifiers of the sensors corresponding to the objects; And extracting location information corresponding to each of the objects based on location information of the sensors.

The generating of the virtual video may include: loading a background screen corresponding to the event from the database based on the event information; Generating virtual screens by placing the templates corresponding to each of the objects on the background screen based on location information corresponding to each of the objects; And sequentially synthesizing the virtual screen to generate the virtual video corresponding to the event.

In this case, the game virtual video generating method may further include extracting a sound from a pre-recorded game video corresponding to the event.

At this time, the game virtual video generating method may further comprise the step of synchronizing the sound and the virtual video.

In this case, the game virtual video generating method may further include expanding, reducing, and controlling each of the objects existing in the virtual video.

The present invention can provide a more precise and realistic virtual video using the decoded and extracted event information.

In addition, the present invention can quickly generate a virtual video by storing a template corresponding to the object in a database, and using it for creating a virtual video.

In addition, the present invention can provide a more realistic virtual video by synchronizing the sound with the virtual video.

1 is a block diagram illustrating an event-related virtual video generating device according to an embodiment of the present invention.

FIG. 2 is a block diagram of an embodiment of a video generating unit illustrated in FIG. 1.

3 is a diagram illustrating an embodiment of a data frame of event-related data of an encoded game of the present invention.

4 is a diagram illustrating extracting location information of objects in a virtual video generating apparatus according to an embodiment of the present invention.

5 to 8 are diagrams illustrating an embodiment of an event related virtual video generating apparatus of the present invention.

9 to 13 illustrate another embodiment of an event related virtual video generating apparatus of the present invention.

14 is a flowchart illustrating an event-related virtual video generation method according to an embodiment of the present invention.

FIG. 15 is a flowchart illustrating an embodiment of generating a virtual video shown in FIG. 14.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. Here, the repeated description, well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention, and detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more completely describe the present invention to those skilled in the art. Accordingly, the shape and size of elements in the drawings may be exaggerated for clarity.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1, an event related virtual video generating apparatus includes a decoding unit 110, a video generating unit 120, and a database 130.

The decoding unit 110 extracts event information by decoding event related data of a game encoded with preset fields.

In this case, the event means an event occurring during the game, for example, the approaching event of the ball and the player, the event of the ball entering the goal post, the successful tackle event of the player, the set piece event, the pass interception event, the near the player defending the ball. Events that have passed but succeeded in a pass, events with counterattack, and the ball passing behind the fence in a baseball game can be events.

In this case, the event information is information about the event, and may include, for example, a time when the event occurred, a type of event, a time when the event lasted, and the like.

In this case, the event data may be configured as a data frame composed of preset fields. This will be described later in FIG. 3.

At this time, although not shown in Figure 1, the decoding unit 110 decodes the information corresponding to the event included in the event-related data of the game to extract the type and information of the event and event-related data of the game The sensor decoding unit may decode information corresponding to sensors included in and extract identifiers and position information of the sensors.

At this time, the event decoding unit may extract the event-related information, the event-related information has been described above may include the time the event occurred, the type of event, the duration.

At this time, the sensor decoding unit may extract the identifiers of the sensors corresponding to the objects in the stadium and the location information of the sensors.

At this time, the objects in the stadium may include players in the stadium, exercise tools used by players, balls, and the like.

In this case, if one or more sensors are installed in each of the objects, and an identifier is set in advance, the location information of the sensors may be determined by decoding and extracting the identifier, corresponding to each of the objects in the location information of the sensors. Location information can be extracted. For example, if the sensor identifier installed in the attacker of the football game is 001, the sensor identifier is 001 inside the decoded event related data, and the position is (0,10,100), the position of the attacker of the football game is (0,10,100). This can be

At this time, the number of sensors installed in each of the objects is not limited. In order to extract the location information accurately, several sensors may be installed in the object.

The database 130 stores a template corresponding to each of the objects in the stadium.

At this time, a template corresponding to each of the objects may be stored in advance to quickly generate a virtual video.

For example, in a soccer game, players' bodies and faces may be pre-rendered and stored as templates. It is also possible to pre-render the movements of the players and save them as templates.

In addition, for example, the audience of the stadium may be pre-rendered and stored as a template to generate a more realistic video when generating a virtual video.

The video generator 120 may generate a virtual video corresponding to the event based on the event information and the templates. The video generating unit 120 will be described later with reference to FIG. 2.

In this case, the generated video may be transmitted to the device and output to the user to watch the video.

In this case, although not shown in FIG. 1, a sound extracting unit extracting sound from the captured game image corresponding to the event and a synchronization unit performing synchronization between the sound extracted from the sound extracting unit and the virtual video may be included.

At this time, there is no restriction on the method of extracting the sound. The sound may be extracted from the game relay screen, or the sound may be extracted by recording.

At this time, the synchronization unit serves to synchronize the sound and the virtual video. A virtual video corresponding to a sound corresponding to a specific time may be generated.

Referring to FIG. 2, the video generator 120 includes a background screen generator 210, a virtual screen generator 220, and a virtual video generator 230.

The background screen generator 210 calls a background screen corresponding to the event in the database based on the event information.

For example, in the event of a goal entry, you can retrieve a background image of the stadium where the ball was crossed and the stadium background near the goal area from the database.

The virtual screen generation unit 220 generates a virtual screen by placing templates corresponding to each of the objects on a background screen based on location information corresponding to each of the objects.

For example, it corresponds to an event where a goal is entered, and the location information of the player who scored the goal was extracted as (0,1,10) in 3D coordinates, and the location information of the player corresponding to the goalkeeper was (1,2). , 9), a virtual screen is generated by synthesizing the templates corresponding to the two players on the stadium wallpaper with the location of the wallpaper corresponding to the location information.

In this case, virtual screens corresponding to time information among the extracted event information may be generated.

The virtual video generator 230 sequentially synthesizes the virtual screens generated by the virtual screen generator 220 to generate a virtual video corresponding to the event.

At this time, to synthesize sequentially means to synthesize in order over time.

At this time, the synthesis rate per second is not limited. More virtual screens can be synthesized to create high quality virtual video.

Referring to FIG. 3, the data frame includes a start field 310, an event ID field 320, a property of event field 330, and a sensor ID field associated with an event. ID field associated with the event 340, a data field of the sensor 350, and an end of field 370.

The Start of field 310 is a field where data starts.

The event ID field 320 is a data field relating to the type of event. For example, an event in which a goal is scored in a soccer game may be 'ID: 001', and an event in which a foul is generated may be 'ID: 010'. When the counterattack begins, it may be 'ID: 011'.

The Properties of event field 330 is a data field including time information, location information, and object information related to an event.

In this case, the time information may include an event occurrence time, a time of a predetermined interval before event occurrence, and a time of a predetermined interval after event occurrence. For example, in the case of data collected when a goal is scored in a soccer game, the time information includes data such as the time the goal was entered, one minute before the goal was entered, and one minute after the goal was entered. Can be.

At this time, the location information may include information located in the stadium of the sensors related to the event. For example, in the case of data collected when an event of entering a goal occurs in a soccer game, a circular area having a radius of 5 m with respect to the ball may be included in the location information.

In this case, the object information may include information of sensors related to the event. For example, in the case of data collected when a goal is entered in a soccer game, information including IDs of one or more sensors within a circular area having a radius of 5 m from the ball may be included in the object information.

The sensor ID field associated with the event 340 is a data field including a sensor ID associated with the event.

The data field of the sensor 350 is a data field including data corresponding to the sensor ID in the sensor ID field immediately preceding.

In this case, there may be one or more sensors associated with the event. In this case, a sensor ID field associated with the event 340 and a data field of the sensor 350 are sequentially repeated. The repeated data fields are 360 shown in FIG. 3. Located in

The end field 370 is a field in which data indicating that an event related data field ends is located.

Referring to FIG. 4, four

vertices

410, 420, 430, and 440 and

players

450 and 460 are formed in a square stadium.

There is no limitation on the way of expressing the location information in the stadium. In FIG. 4, a 3D coordinate (x, y, z) format is commonly used. X and y correspond to the horizontal and vertical directions of the stadium, and in the case of z, height information may be expressed.

In FIG. 4, four vertices are set as (0,0,0), (500,0,0), (500,300,0), and (0,300,0), respectively, and objects in the stadium are displayed in 3D coordinates. It was.

For example, the position information of the player 450 may be represented by (100, 150, 150), and the position information of another player 460 may be represented by (120, 150, 50).

In this case, the coordinates may be expressed by dividing the same (uniform) interval, or may be expressed by dividing the other (non-uniform) interval. More precise location information may be obtained by narrowing the coordinates in the vicinity of the goal area where many events occur.

5 to 8 illustrate a part of a virtual video regarding an event in which a player viewed from another direction shoots.

At this time, the virtual video may be controlled to enlarge or reduce or rotate the object. For example, as shown in FIGS. 5 to 8, the virtual video may be rotated in a clockwise direction.

9 to 13 illustrate a part of a virtual video related to an event in which an attacking team performs a penalty kick by a defensive team in a penalty area.

9 to 13 may be sequentially synthesized to generate a virtual video. For example, starting with a virtual screen that prepares for a penalty kick, a goal screen also creates a virtual screen that prevents the penalty kick, and synthesizes them in chronological order to generate a virtual video.

First, event information is extracted by decoding event related data (S1410).

In this case, the event data may be configured as a data frame composed of preset fields. The description thereof has been described with reference to FIG. 3.

In addition, a virtual video is generated based on the event information and the template (S1420).

Referring to FIG. 15, first, a background screen stored in a database is loaded based on event information (S1510).

In operation S1520, the virtual screen is generated by placing a template on the background screen.

In operation S1530, a virtual video is generated by synthesizing the virtual screens.

At this time, the synthesis rate per second is not limited. More virtual screens may be synthesized to create high quality virtual video.

As described above, the apparatus and method for generating an event-related virtual video according to the present invention may not be limitedly applied to the configuration and method of the embodiments described above, and the embodiments may be modified in various ways so that various modifications may be made. All or part of the examples may be optionally combined.

Claims

A decoder configured to decode event-related data of a game encoded with preset fields to extract the event information;

A database storing templates corresponding to each of the objects in the stadium; And

Video generation unit for generating a virtual video corresponding to the event based on the event information and the templates

Match virtual video generating device comprising a.
The method according to claim 1,

The decoding unit

An event decoding unit for extracting the type and information of the event by decoding information corresponding to the event included in the event related data of the game; And

Sensor decoding unit for extracting the identifier and location information of the sensors by decoding the information corresponding to the sensors included in the event-related data of the game

Match virtual video generating device comprising a.
The method according to claim 2,

The sensor decoding unit

An object identifier which distinguishes each of the objects based on identifiers of sensors corresponding to the objects; And

Location information extraction unit for extracting location information corresponding to each of the objects based on the location information of the sensors

Match virtual video generating device comprising a.
The method according to claim 3,

The video generation unit

A background screen generation unit which loads a background screen corresponding to the event in the database based on the event information;

A virtual screen generation unit generating virtual screens by placing the templates corresponding to each of the objects on a background screen corresponding to the event based on location information corresponding to each of the objects; And

A virtual video generation unit configured to sequentially synthesize the virtual screens to generate the virtual video corresponding to the event

Virtual video generating device comprising a.
The method according to claim 1,

The game virtual video generating device

Sound extractor for extracting the sound from the pre-recorded match video corresponding to the event

Match virtual video generating device further comprising.
The method according to claim 5,

The game virtual video generating device

A synchronizer for synchronizing the sound extracted by the sound extractor with the virtual video

Match virtual video generating device further comprising.
The method according to claim 1,

The game virtual video generating device

Control unit to enlarge, reduce and control each of the objects present in the video

Match virtual video generating device further comprising.
The method according to claim 1,

The encoded event related data is

And at least one of an event ID field, an event attribute field, a sensor ID field associated with an event, and a data field of sensor. And the fields have a data frame present between a start of field (SOF) and an end of field (EOF).
Extracting event information by decoding event related data of a game encoded with preset fields; And

Generating a virtual video corresponding to the event based on the event information and templates corresponding to each of the objects in the stadium stored in the database;

Match virtual video generating method comprising a.
The method according to claim 9,

Extracting the event information

Extracting the type and information of the event by decoding the information corresponding to the event included in the event related data of the game; And

Extracting identifiers and location information of the sensors by decoding the information corresponding to the sensors included in the event-related data of the game.

Match virtual video generating method comprising a.
The method according to claim 10,

Extracting identifiers and location information of the sensors

Distinguishing each of the objects based on identifiers of sensors corresponding to the objects; And

Extracting location information corresponding to each of the objects based on the location information of the sensors;

Match virtual video generating method comprising a.
The method according to claim 11,

Generating the virtual video is

Loading a background screen corresponding to the event from the database based on the event information;

Generating virtual screens by placing the templates corresponding to each of the objects on the background screen based on location information corresponding to each of the objects; And

Generating the virtual video corresponding to the event by sequentially synthesizing the virtual screen

Match virtual video generating method comprising a.
The method according to claim 9,

The game virtual video generation method

Extracting a sound from a pre-recorded game image corresponding to the event

Match virtual video generating method further comprising a.
The method according to claim 13,

The game virtual video generation method

Synchronizing the sound with the virtual video

Match virtual video generating method further comprising a.
The method according to claim 9,

The game virtual video generation method

Enlarging, reducing and controlling each of the objects present in the virtual video

Match virtual video generating method further comprising a.
The method according to claim 9,

The encoded event-related data

And at least one of an event ID field, an event attribute field, a sensor ID field associated with an event, and a data field of sensor. And the fields have a data frame existing between a start of field (SOF) and an end of field (EOF).