WO2015133669A1

WO2015133669A1 - Stage display system

Info

Publication number: WO2015133669A1
Application number: PCT/KR2014/002075
Authority: WO
Inventors: 조홍래; 김길중; 이상훈; 안효진; 문치우; 최윤호; 박지현; 주영렬; 고승진; 유태진; 주인탁
Original assignee: (주)바이널
Priority date: 2014-03-03
Filing date: 2014-03-12
Publication date: 2015-09-11
Also published as: KR20150103791A

Abstract

The present invention relates to a stage display system. The present invention is characterized by comprising: a location acquisition unit for acquiring location information from electronic tags attached to one or more moving bodies; an image processing unit for compositing, in accordance with a previously set display pattern information, texture onto an image layer on the basis of the location information; and an image output unit for outputting the image layer. According to the present invention, by compositing a texture onto an image layer according to the display pattern and on the basis of the location information, and outputting the display pattern onto the stage, a variety of stage display effects are provided corresponding to the performance of the actors on the stage, thereby allowing the audience to be absorbed in the performance of the actors, and additionally having the benefit of significantly reducing the stage setup expense.

Description

Stage production system

The present invention relates to a stage rendering system.

Various production devices such as sound devices, video devices, and lighting devices are used to maximize the directing effects on stages such as musicals and concerts.

In general, the performance is recorded in detail in the cue sheet of the performance of the performer from the beginning to the end of the performance, such as the sequence of actions of the performer, timed sound effects, lighting effects, etc. Defer to the cue signal from the director. For this reason, the actor had to perform according to a predetermined script, there was a problem that it is difficult to provide a directing effect for expressing various emotions.

In order to solve this problem, the musical "Circus of the Sun" installs a sensor at the bottom of the stage and provides various graphic effects on the stage as image projection through image processing of the top view image.

However, such a conventional stage directing device recognizes the performer's position through a sensor installed at the bottom, so the accuracy of actor recognition is low, and the installation of such a stage theater takes a lot of cost and time, so performance on a limited stage is limited. It must be done. In addition, when two or more performers are adjacent to each other, the lower sensor recognizes one performer, so that the same graphic effect is produced to all the performers within a range, and thus there is a problem in that it is difficult to express various directing effects.

[Patent Documents]

(Patent Document 1) With such prior art, Korean Patent Application No. 10-2009-0040269 discloses a method of displaying various stage effects by tracking a performer's position on a stage in real time and controlling a stage device based on the position information. Known.

According to the present invention, by synthesizing a texture on an image layer based on positional information according to a direction pattern and outputting it on a stage, the audience can be immersed in the actor's act by providing various stage effects in response to the actor's act on the stage. In addition, it aims to provide a stage rendering system that can significantly reduce the cost of the stage installation.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention, which are not mentioned above, can be understood by the following description, and more clearly by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

The present invention for achieving the above object is a position acquisition unit for obtaining position information from an electronic tag attached to at least one moving object, an image processing unit for synthesizing a texture on an image layer based on the position information according to predetermined direction pattern information And an image output unit configured to output the image layer.

According to the present invention as described above, by synthesizing the texture on the image layer based on the positional information according to the direction pattern and output on the stage, by providing a variety of stage directing effects in response to the actor's acting on the stage, In addition to being able to immerse yourself in the performance of the stage, the cost of installing the stage is greatly reduced.

1 is a block diagram of a stage production system according to an embodiment of the present invention.

2 is a view for explaining an image layer and the direction pattern according to an embodiment of the present invention.

3 is a view for explaining the operation according to the moving object tracking direction pattern of the present invention.

4 is a view for explaining the operation according to the moving object tracking first direction pattern of the present invention.

5 is a view for explaining the operation according to the moving object tracking second direction pattern of the present invention.

6 is a view for explaining the operation according to the area recognition direction pattern of the present invention.

7 is a view for explaining the operation according to the stop direction pattern during movement of the present invention.

8 is a view for explaining an image layer and a rendering pattern for one or more moving objects.

9 is a view for explaining the operation according to the collective direction pattern of the present invention.

10 is a view for explaining the operation according to the background rendering pattern of the present invention.

The above objects, features, and advantages will be described in detail with reference to the accompanying drawings, whereby those skilled in the art to which the present invention pertains may easily implement the technical idea of the present invention. In describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to indicate the same or similar components.

1 is a block diagram of a stage production system according to an embodiment of the present invention. Referring to FIG. 1, the stage rendering system includes a

position obtaining unit

112a, 112b, 112c, and 112d for obtaining position information, an image processor 116 for synthesizing a texture on an image layer based on the position information, and an image layer. And an image output unit 118 output on the stage.

The

location obtaining units

112a, 112b, 112c, and 112d perform a function of obtaining location information from the electronic tag 108. The electronic tag 108 refers to a medium in which a small IC chip such as an RF tag or a smart tag is embedded to read information recorded on the chip. The electronic tag 108 may be attached to the moving object 110 on the stage, and the

position obtaining units

112a, 112b, 112c, and 112d may obtain location information from the electronic tag 108 attached to the moving object. The position information is information on the position of the moving object 110 on the stage. The moving object 110 may be an actor acting on the stage, an actor, a performer, or a specific object appearing in a performance.

Real-time location information supporting wireless communication standards such as ZigBee, RuBee, Ultra Wide Band (UWB), Wi-Fi in order for the

location acquisition unit

112a, 112b, 112c, 112d to obtain location information from the electronic tag 108 Technology related to the system (RTLS) and active RFID (RADIO FREQUENCY IDENTIFICATION) may be applied.

In one embodiment of the present invention, the position acquisition unit (112a, 112b, 112c, 112d) may obtain the identification information for identifying one or more moving objects as well as the position information for the position of the moving object. The identification information is information for identifying one or more moving objects on the stage, respectively, and may be a unique tag value recorded in the electronic tag 108.

For example, tag values 0x0001, 0x0002, and 0x0003 may be designated for each electronic tag 108. The

position acquisition units

112a, 112b, 112c, and 112d may identify and manage one or more moving objects on the stage by using the identification information.

The image processor 116 performs a function of synthesizing the texture on the image layer based on the position information according to the predetermined direction pattern information. In more detail, the image processor 116 may receive location information corresponding to the position of the moving object 110 on the stage from the electronic tag 108 attached to the moving object 110.

The image layer is a virtual plane modeled to correspond to the stage. That is, the size of the image layer corresponds to the size of the stage, and the coordinates of the image layer may correspond to any position or area of the stage.

Preferably, the stage may be formed of a stage stage 102 constituting the stage floor and a first background stage 104 and a second background stage 106 together with the stage stage 102 to form a three-dimensional space. . In this case, the image layer may be composed of three image layers to be reproduced in a three-dimensional space corresponding to each stage stage 102, the first background stage 104, and the second background stage 106.

Texture is a graphic element for applying realistic three-dimensional stereoscopic effect to a two-dimensional plane such as a stage stage, and can express various colors and textures on the stage. Textures include color textures representing colors or textures, normal textures representing arbitrary materials, highlight textures representing the reflection form of light, and the like.

In order to maximize the graphic expression effect, the image processor 116 may synthesize a texture that can be expressed in granular units on the image layer by using a computer-based application program, for example, an interface such as Direct X 11 or Vertex Shader. have. In addition, image distortion can be expressed in the background graphics on the image layer using Vertex Shader.

The image processor 116 may synthesize the texture on the corresponding coordinates of the image layer in consideration of the position information. As described above, the image layer may configure coordinates corresponding to any position or area of the stage. The image processor 116 may convert the position information acquired from the

position acquirers

112a, 112b, 112c, and 112d into coordinate information corresponding to the coordinates of the image layer. The image processor 116 determines coordinates on the image layer to synthesize the texture according to the predetermined presentation pattern information, and synthesizes the texture on the coordinates on the determined image layer.

For example, the predetermined direction pattern information may include a moving object tracking direction pattern for synthesizing a texture with coordinates on an image layer corresponding to the current position to indicate a current position of the moving object on the stage, and moving to display a moving trajectory of the moving object moving on the stage. Moving object tracking composition combining the texture in the path, the texture is applied to the area formed by the coordinates on the image layer corresponding to the arbitrary position of the image layer and the current position so that the area varies according to the movement trajectory of the moving object moving on the stage. Moving object tracking Second direction pattern, area recognition direction pattern that synthesizes different textures before entering if the moving object enters a specific area on the stage, and stops during movement of synthesizing different textures with the moving texture when the moving object stops on the stage. At least one rendering pattern .

In one embodiment of the invention, there may be one or more moving objects on the stage. In this case, the location obtaining unit obtains location information and identification information from the electronic tag. The image processor 116 receives location information and identification information, manages each moving object, and combines a texture corresponding to each moving object with coordinates on the image layer based on the location information according to the identification information. The image processor 116 may synthesize different textures with respect to one or more moving objects. As a result, the moving object on the stage can be identified through the identification information, and can produce different effects for each moving object.

Preferably, the relationship between the moving bodies can be established for one or more moving objects. For example, the direction pattern information may be displayed on the image layer corresponding to the current position information of each of the moving objects when the distance between the moving objects calculated based on the location information is within a certain distance so as to produce the collective directing effect when one or more moving objects are collected. It may be a collection directing pattern that synthesizes a texture in a collection area including coordinates.

As described above, the stage may be formed of the stage stage 102 constituting the stage floor and the first background stage 104 and the second background stage 106 together with the stage stage 102 to form a three-dimensional space. have. The image layer may include a background image layer to be reproduced in three-dimensional space corresponding to each stage stage 102, the first background stage 104, and the second background stage 106. It is also possible to set the relationship to the texture on the background image layer based on the positional information of the moving object.

For example, the direction pattern information may be a background direction pattern that synthesizes a texture on an image layer to have a size or position at a specific point in time with respect to the moving object based on the position information.

More specifically, the size and position of the object may vary depending on the distance to the object from the viewpoint of the moving object. When the moving object approaches the first background stage 104 or the second background stage from which the background image layer is output, the image processing unit 116 may synthesize an increasing texture on the background image layer, and the moving object becomes smaller when the moving object moves away from it. The texture may be synthesized on the background image layer.

In addition, when two or more textures are synthesized on the background image layer, the positions of the textures on the background image layer may vary according to the position information of the moving object. For example, when the moving object moves to the left, either texture may move to the right or the left and right of the textures may be different. As a result, background rendering at a specific point in time with respect to the moving object is possible.

The rendering pattern information may be determined by cue sheet data. The cue sheet data may include information about the number of moving objects, the designated textures for the moving objects, and the like, per film or chapter of the performance.

The cue sheet data may be as shown in Table 1.

Table 1

Mobile body information				Set directing pattern	Zone settings
Identifying information	0x0001	Direction	Tracking	Heart directing	x: 450 y: 300 fire pit
Identifying information	0x0002	Direction	Tracking	Heart directing	x: 450 y: 300 fire pit

For example, suppose the main character rescues a heroine in danger. The heroine is identified by identification information (0x0001), and the heroine is identified by identification information (0x0002). First, when the heroine appears, the texture having the light source effect may be synthesized with the coordinates on the image layer corresponding to the heroine position to make the heroine stand on the light. When the heroine enters the predetermined coordinates (x: 450, y: 300), the texture having the lameness effect can be synthesized in the set area, and the heroine is maximized in directing effect. At this time, the main character appears to rescue the heroine. For the main character, a texture with a wave effect can be directed to track the position of the main character, thereby emphasizing the effect of the main character. If the main character is within a certain distance from the heroine, the texture of the heart-shaped texture can be synthesized to maximize the expression of the emotion between the two main characters.

The image output unit 118 outputs a texture-synthesized image layer on the stage. The image output unit 118 may project an image layer on a stage stage or a background stage to produce as if the actor coexists with the graphic effect due to the image layer projected on the stage. The image output unit 118 may be installed corresponding to the number of stages so as to project an image layer to respective stages forming a three-dimensional space. If the stage size is large, the image output unit 118 may be configured to project the image layer in each region by dividing the stage into two or four regions.

As described above, the stage directing system of the present invention provides various stage directing effects in response to the acting of the performer on the stage, so that the audience can not only be immersed in the acting of the performer but also maximizes the directing effect with a minimum image projection apparatus. Because it can provide a significant cost savings in the installation stage.

2 is a view for explaining an image layer and a direction pattern according to an embodiment of the present invention. Referring to FIG. 2, an image layer 202 processed by the image processor 116 and a texture 204 synthesized with the image layer are displayed. The director or stage director can monitor the production situation and apply the effect according to the situation through the displayed video layer.

The image layer 202 is projected onto the stage composed of three-dimensional space through the image output unit 118, and the texture 204 synthesized on the image layer 202 is displayed on the stage. The position of the texture 204 synthesized on the image layer 202 may be determined according to the position information and the identification information of the moving object obtained from the electronic tag 108 through the

position acquisition units

112a, 112b, 112c, and 112d. .

The image processor 116 may maximize the rendering effect by synthesizing the texture 204 having a three-dimensional graphic effect on the image layer 202 using a graphic interface such as Direct X 11 or Vertex Shader.

Hereinafter, the functions provided by the stage rendering system of the present invention will be described with reference to FIGS. 3 to 10.

1. 이동체 추적 연출 기능1. Moving object tracking function

3 is a view for explaining the operation according to the moving object tracking direction pattern of the present invention. Referring to FIG. 3, the texture is synthesized on the image layer 302 to correspond to the current position on the stage of the moving object.

When the moving object moves from the first point 304 on the stage to the second point 306, when the current position of the moving object is the first point 304, the image processing unit 116 moves to the first point 304 on the stage of the moving object. The texture is synthesized at the coordinates 304 on the image layer corresponding to When the moving object moves to the second point 306, the image processor 116 synthesizes the texture at coordinates 306 on the image layer corresponding to the second point 306 on the stage of the moving object.

As a result, a texture is synthesized at each of the

coordinates

304 and 306 on the image layer corresponding to the current position of the moving object on the stage, and the texture, which is a graphic element, can produce the effect of tracking the moving object.

2. 이동체 트래킹 연출 기능2. Moving object tracking function

4 is a view for explaining the operation according to the moving object tracking first direction pattern of the present invention. Referring to FIG. 4, the texture is synthesized on the image layer 402 to correspond to the movement path 406 on the stage of the moving object.

When the moving object enters the stage and moves to a specific point 404 on the stage, the image processor 116 may record respective coordinates of the moving path 406 using the position information of the moving object. The image processor 116 synthesizes the texture in the coordinates or the region 406 on the image layer corresponding to the moving path 406 of the moving object.

As a result, specific graphic elements can be rendered on the movement path of the moving object on the stage. For example, it is possible to maximize the character of the moving object by synthesizing a flame texture in which the path of the moving object appears to be burning.

5 is a view for explaining an operation according to the moving object tracking second direction pattern of the present invention. Referring to FIG. 5, the texture is synthesized in an area formed by an arbitrary point of the image layer (designated as both bottom vertices in this embodiment) and the current position of the moving object.

When the moving object enters the stage and moves from the first point 504 to the second point 508 on the stage, when the current position on the stage of the moving object is the first point 504, the image processor 116 moves to the bottom of the stage. The texture is synthesized in the triangular region 506 formed by both vertices and the first point 504. When the moving object moves from the first point 504 to the second point 508, the image processor 116 may texture the triangular area 506 formed by the lower vertices of the stage and the second point 508. Synthesize.

As a result, arbitrary points and the area to be formed may change according to the current position on the stage of the moving object, and the specific area may produce the effect of tracking the moving object.

3. 특정 영역 인식 연출 기능3. Specific area recognition directing function

6 is a view for explaining an operation according to the area recognition direction pattern of the present invention. Referring to FIG. 6, the texture is synthesized at the current position in the region 606 on the image layer 602 or the specific region of the movable body corresponding to the specific region 606 when the movable body on the stage enters the predetermined specific region 606. do. In this case, the texture may be a texture 608 that is different from the texture 604 outside the specific region that produces a special effect corresponding to the preset specific region. The texture may be synthesized throughout the particular region 606 or only to some of the specific regions 606.

When the current position location information of the moving object enters the specific area 606 on the preset image layer, the image processing unit 116 is located on the specific layer 606 on the image layer 602 or on the image layer corresponding to the current location information of the moving object. The texture before entering the coordinates and a different texture 608 are synthesized.

As a result, when the moving object enters a predetermined specific area, an effect of emphasizing the specific area can be produced. For example, you can effectively create situations where the main character falls into a trap or falls into the water.

4. 이동 중 정치 연출 기능4. Political presentation on the go

7 is a view for explaining the operation according to the stop direction pattern during movement of the present invention. Referring to FIG. 7, when the moving object on the stage stops during the movement, a texture different from the moving texture is combined with coordinates on the image layer corresponding to the current position of the moving object.

The image processor 116 monitors the position information of the moving object and, if there is no change in the current position information of the moving object, synthesizes a texture and a different texture during movement to coordinates on the image layer corresponding to the current position information of the moving object.

As a result, when the performer stops while moving, a new graphic effect is produced, thereby maximizing visual presentation even with the small gesture of the performer.

5. 집합 연출 기능5. assembly rendering function

FIG. 8 is a diagram for describing an image layer and a rendering pattern for one or more moving objects. Referring to FIG. 8, the image layer 802 and the

textures

804 and 808 synthesized to the image layer 802 when one or more moving objects appear on the stage are shown.

The location obtaining unit may obtain identification information and location information from an electronic tag attached to one or more moving objects. The image processor 116 may synthesize a texture on an image layer by using

unique information

806 and 810 including position information and identification information of each moving object on the stage. Different textures are synthesized in the coordinates 804 corresponding to the current position 804 of the first moving object and the coordinates 808 corresponding to the current position 804 of the second moving object on the image layer 802. Can be distinguished through identification information.

As a result, the present invention can produce a different effect for each performer as compared to a stage directing device for acquiring the position of the performer using a sensor installed on the floor of the conventional stage can be a variety of acting of the performer.

9 is a view for explaining the operation according to the collective direction pattern of the present invention. Referring to FIG. 9, when one or more moving objects on the stage are gathered within a certain distance, a texture having an effect of emphasizing the moving moving objects is synthesized on the image layer.

If the distance between the moving objects calculated based on the identification information and the location information is within a certain distance, the image processing unit 116 includes an aggregation area 912 including coordinates on the image layer 902 corresponding to the current position information of each of the moving objects. You can synthesize the texture on At this time, the texture may be a graphic effect that is produced only when the actors gather.

That is, when the first mobile body, the second mobile body, the third mobile body, and the fourth mobile body appear on the stage, the respective mobile bodies can be distinguished through the identification information, and the coordinates on the image layer corresponding to each position of the mobile bodies Textures can be synthesized. For example, when the second mobile body 906, the third mobile body 908, and the fourth mobile body 910 are assembled within a predetermined distance, the second mobile body 906, the third mobile body 908, and the fourth mobile body 910 are located. The texture 912 may be synthesized in the aggregation area 912 including coordinates on the image layer 902 corresponding to each current location information.

As a result, when the actors gather, new graphic effects are produced to maximize the visual appearance of the actors' small gestures.

6. 배경 연출 기능6. Background rendering function

10 is a view for explaining the operation according to the background rendering pattern of the present invention. Referring to FIG. 10, a texture whose size and position are adjusted according to the position of the moving object is synthesized in the background image layer constituting the background of the stage.

The image processor may synthesize a texture on the background image layer to have a size or a position at a specific point in time with respect to the moving object based on the position information of the moving object. For example, a texture representing a house and a tree may be synthesized in the background image layer output to the background stage.

For example, comparing the scene 1002 before the moving object approaches the background stage and the scene 1014 after approaching the background stage, the moving object is moved to the background stage at a point of view 1006 away from the background stage. While the size of the texture 1004 to be synthesized is adjusted to be small, at the point of view 1016 where the moving object approaches the background stage, the size of the texture 1018 to be synthesized to the background stage is adjusted.

In another example, when the moving object moves to the left in the direction toward the background stage, the texture 1010 representing the tree and the texture 1025 representing the house are adjusted to move to the right relative to the movement of the viewpoint of the moving object. In this case, when the moving object moves to the left and close to the background stage, the size of the texture 1024 representing the tree may be largely adjusted to have a size at the viewpoint of the position 1022 of the moving object.

As a result, it is possible to produce a background effect in response to the position of the performer on the stage, and to provide a more three-dimensional and realistic rendering effect to the audience.

The above functions are exemplary and can be applied to provide a custom effect based on the position of the moving object within the scope of the present invention.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by.

Claims

A position obtaining unit obtaining position information from an electronic tag attached to at least one moving object;

An image processor for synthesizing a texture on an image layer based on the position information according to predetermined direction pattern information;

Image output unit for outputting the image layer

Stage production system comprising a.
The method of claim 1,

The rendering pattern information is determined by cue sheet data.

Stage rendering system.
The method of claim 1,

When the direction pattern information is moving object tracking direction pattern information,

The image processor

Comprising the texture to the coordinates on the image layer corresponding to the current position information of the moving object

Stage rendering system.
The method of claim 1,

When the direction pattern information is moving object tracking first direction pattern information,

The image processor

Comprising the texture to the coordinates on the image layer corresponding to the moving path of the moving object

Stage rendering system.
The method of claim 1,

When the direction pattern information is moving object tracking second direction pattern information,

The image processor

Comprising the texture in the area formed by the coordinates of the image layer corresponding to the first point, the second point and the current position information of the moving object of the image layer

Stage rendering system.
The method of claim 1,

When the direction pattern information is area recognition direction pattern information information,

The image processor

When the current position information of the moving object enters a specific area on the preset image layer,

Comprising a texture before the entry into the coordinates on the image layer corresponding to the current position information of the specific area or the moving object on the image layer

Stage rendering system.
The method of claim 1,

When the direction pattern information is the stop direction pattern information while moving,

The image processor

If there is no change in the current position information of the moving object,

Comprising a texture in motion and a different texture to the coordinates on the image layer corresponding to the current position information of the moving object

Stage rendering system.
The method of claim 1,

The image processor

Texture at a coordinate or area on the image layer according to at least one of moving object tracking direction pattern information, moving object tracking first direction pattern information, moving object tracking second direction pattern information, region recognition direction pattern information, and stationary direction direction pattern information during movement. To synthesize

Stage rendering system.
The method of claim 1,

The position acquisition unit

Obtaining identification information from an electronic tag attached to one or more moving objects,

The image processor

Comprising a different texture to each coordinate on the image layer based on the position information according to the identification information

Stage rendering system.
The method of claim 9,

When the direction pattern information is the group direction pattern information,

The image processor

When the distance between the moving objects calculated on the basis of the identification information and the position information is within a certain distance, a texture is synthesized in an aggregation area including coordinates on the image layer corresponding to current position information of each of the moving objects.

Stage rendering system.
The method of claim 1,

The image layer includes a background image layer constituting the background of the stage,

The image processor

Comprising a texture on the background image layer based on the position information according to the predetermined direction pattern information

Stage rendering system.
The method of claim 11,

When the direction pattern information is the background direction pattern information,

The image processor

Comprising a texture on the background image layer to have a size or position at a specific point in time with respect to the moving object based on the position information

Stage rendering system.