KR101839270B1 - Method of forming virtual reality of performance - Google Patents

Abstract

Disclosed is a method for forming a virtual reality video of a theater without separate three-dimensional digital capturing. The method for forming a virtual reality video of a theater comprises the following steps of: capturing image information from multiple seats; acquiring a relative coordinate of the multiple seats in which a stage where performance is performed and the image are captured; collecting the relative coordinate and the image information; and synthesizing the acquired image information from each seat based on the relative coordinate.

Description

METHOD OF FORMING VIRTUAL REALITY OF PERFORMANCE [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for forming a virtual reality video in a theater, and more particularly, to a method for forming a virtual reality video in a theater such as an idol concert, a classical performance, and a play.

Performances are a variety of genres such as dance, drama, pantomime, puppet theater, and opera, which provide the audience with various dances, music, and performances. The performance differs from other contents such as movies in that actors and spectators interact in the same space.

However, there is an advantage in that the concert is performed between performers who provide the performances and the audience who is the buyer. However, due to the temporal limitations such as the performance being limited to the temporary and narrow theaters, the supply price There is no choice but to increase. As a result, the number of people who can enjoy the performance is limited, and a problem that can not be provided to a large number occurs.

Therefore, there is a movement of making such a performance as a movie with a repetitive regeneration. However, in the case of performance, there is a movement to realize it as a virtual reality because the sense of presence of the performance is lowered when it is produced as a two - dimensional image.

Korean Unexamined Patent Application Publication No. 10-2009-0016234, 'Virtual Reality Performance System and Method' discloses a technique for allowing a viewer to select and appreciate a desired audience in the same manner as a reality park on a virtual reality in a desired audience position have.

According to this technique, digitalized performance information produced through 3D digital photography is stored, and when a viewer selects a desired audience, data from the selected audience is extracted from the performance database and transmitted.

However, since the performance is realized through a separate 3D digital photography in the process of implementing the virtual reality, there arises a problem that the production of the virtual reality database of the performance requires a lot of expenses.

Korean Patent Publication No. 10-2009-0016234

Accordingly, a problem to be solved by the present invention is to provide a method of forming a virtual reality moving picture in a theater without a separate three-dimensional digital photographing.

According to an exemplary embodiment of the present invention, there is provided a method for forming a virtual reality video of a theater, the method including: capturing image information from a plurality of seats; Acquiring the relative coordinates and the image information, and synthesizing the image information obtained in each of the seats based on the relative coordinates.

For example, the step of acquiring the relative coordinates may include receiving GPS information on the stage to obtain coordinates of the stage, receiving GPS information in a plurality of seats to obtain coordinates of the plurality of seats, And obtaining relative coordinates in the plurality of seats for the coordinates of the stage.

Alternatively, the step of obtaining the relative coordinates may be obtained through image information in a plurality of seats.

At this time, the image information includes an image of an LED signage behind the stage, and in the method of forming a virtual reality moving image of a theater according to an embodiment of the present invention, before the step of photographing image information from the plurality of seats, Comprising the steps of: obtaining GPS information and LED intensity information of the signage; encoding GPS information and LED intensity information of the LED signage; and transmitting GPS information and LED intensity information of the encoded LED signage to the LED signage And transmitting the information through visible light communication.

At this time, the step of encoding the GPS information and the LED intensity information of the LED signage may be performed through On-Off Keying (OOK).

Preferably, the GPS information and LED intensity information of the LED signage may transmit the same information more than once.

In addition, the GPS information and the LED intensity information of the LED signage may be transmitted in a plurality of frames.

On the other hand, the step of acquiring the relative coordinates of the stage where the performances are performed and the plurality of seats where the images are taken can be repeatedly performed at predetermined intervals.

In addition, the step of collecting the relative coordinates and the image information may be performed by clouding.

As described above, the virtual reality moving image forming method according to the present invention can realize a virtual reality of a theater by a smartphone located in each audience without a separate three-dimensional digital photographing.

Also, it is possible to easily realize the virtual reality of the theater by acquiring the relative coordinates of the stage and the audience using the GPS information of the stage and the audience.

In addition, when the intensity information is transmitted using the LED signage and the smart phone receives it and acquires the relative coordinates, the virtual reality of the performance site can be realized even where the GPS information can not be received, In this case, it is possible to realize the virtual reality of the theater by reflecting this.

In addition, the GPS information and the LED intensity information of the LED signage can be more reliably transmitted to the LED signage information even when the same information is transmitted twice or more at a frame rate of a certain smartphone camera, And LED intensity information.

Also, the step of acquiring the relative coordinates of the stage where the performance is performed and the plurality of seats in which the image is captured can be improved in the accuracy of the position in which data is accumulated and calculated when it is repeatedly performed every predetermined period.

FIG. 1 is a conceptual diagram for explaining a method of forming a virtual reality moving picture in a theater according to the present invention.
FIG. 2 is a flowchart illustrating a method for forming a virtual reality moving picture in a theater according to an exemplary embodiment of the present invention.
FIG. 3 is a flowchart showing the operation of the signage (transmitter) and the smartphone (receiver) shown in FIG.
4 is a conceptual diagram showing the data structure of the LED intensity information and the GPS information shown in FIG.
5 is a conceptual diagram showing a principle of calculating a position using LED intensity information.

The present invention is capable of various modifications and various forms, and specific embodiments are illustrated in the drawings and described in detail in the text. It should be understood, however, that the invention is not intended to be limited to the particular forms disclosed, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing. In the accompanying drawings, the dimensions of the structures may be exaggerated to illustrate the present invention.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprising" or "having ", and the like, are intended to specify the presence of stated features, integers, steps, operations, elements, parts, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof. In addition, A and B are 'connected' and 'coupled', meaning that A and B are directly connected or combined, and other component C is included between A and B, and A and B are connected or combined .

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not. Also, in the claims of a method invention, each step may be reversed in order, unless the steps are clearly constrained in order.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

FIG. 1 is a conceptual diagram for explaining a method of forming a virtual reality moving picture in a theater according to the present invention.

Referring to FIG. 1, a method for forming a virtual reality moving picture in a theater according to the present invention is implemented using a smartphone possessed by a plurality of audiences.

In the case of a theater, it has characteristics different from general virtual reality video. That is, in the case of the performance hall, the shooting direction is fixed and the seat is fixed. Because of these features, virtual reality can be realized more easily than other environments in a theater.

At idol concert venues, it is common for audiences to shoot videos of performances on their smartphones. It may not be implemented using audiences, but may be implemented with multiple steps during rehearsal. In the case where the photographed images and the photographed positions can be mapped, a virtual reality can be realized without using special shooting equipment.

After the images are collected by clouding them, they are synthesized to realize the virtual reality of the performance.

Hereinafter, the specific method will be described in more detail.

FIG. 2 is a flowchart illustrating a method for forming a virtual reality moving picture in a theater according to an exemplary embodiment of the present invention.

Referring to FIG. 2, according to a method of forming a virtual reality moving picture of a theater according to an exemplary embodiment of the present invention, image information is first captured from a plurality of seats (step S110). As described above, the subject who shoots the image information from a plurality of seats may be an audience, or the step information may be photographed by the steppe. In addition to the performance of the performer, the image information may include digital signage behind the performance site.

Digital signage is, for example, a screen that is installed behind the stage and is formed so that a stage can be seen from a seat far away from the stage, and a plurality of LED light sources constitute pixels to implement an image.

Thereafter, the relative coordinates of the stage where the performance is performed and the number of seats where the image is captured are obtained (step S120). The relative coordinates of the stage and the audience can be obtained using GPS information.

First, GPS information on the stage is received to acquire the coordinates of the stage. Thereafter, GPS information in a plurality of seats is received and coordinates of the plurality of seats are obtained. Thereafter, relative coordinates in the plurality of seats are obtained for the coordinates of the stage. That is, by subtracting the coordinates of the stage from the coordinates of a plurality of seats, relative coordinates of a plurality of seats are obtained, with the stage coordinates being the origin.

Then, relative coordinates and the image information are collected (step S130). As described above, relative coordinate and image information can be collected through clouding.

Then, based on the relative coordinates thus collected, the image information obtained from each seat is synthesized (step S140).

As described above, the virtual reality moving image forming method according to the present invention can realize a virtual reality of a theater by a smartphone located in each audience without a separate three-dimensional digital photographing.

However, in the case of obtaining relative coordinates using GPS, a problem may arise in a venue where GPS signals can not be received. In particular, when there is a height difference in the height of the audience, for example, .

Hereinafter, a method of forming a virtual reality moving picture with a more accurate performance by acquiring relative position information three-dimensionally is disclosed.

As shown in FIG. 1, a method of forming a virtual reality moving picture in a theater according to another exemplary embodiment of the present invention uses LED signage behind the stage as a transmitter, and utilizes a smartphone of the audience as a receiver, The relative position information of the seat can be acquired more accurately. Hereinafter, another exemplary embodiment of the present invention will be described in more detail with reference to FIG.

FIG. 3 is a flowchart showing the operation of the signage (transmitter) and the smartphone (receiver) shown in FIG.

Referring to FIG. 3, the GPS information and the intensity information of the LED signage for acquiring the position of the LED signage at the transmitting end are obtained (step T110).

Then, the GPS information and the intensity information of the LED signal are encoded (step T120). For example, OOK (On-Off Keying). That is, a binary signal can be generated by turning the LED light source on and off at high speed, and the audience can not visually recognize that the LED sign flashes because the LED flashes at high speed.

Thereafter, the encoded GPS information and the intensity information of the LED signage are transmitted by performing an on-off operation through LED signatures (step T130).

On the other hand, in many audiences, the performance of the performer is photographed by the LED signage (step R110), and the smartphone operates as a receiver of the signal.

Meanwhile, in the smart phone, GPS operation and LED intensity information are extracted (step R120) by analyzing the point-by-point operation of the photographed LED signage, and it is judged whether a frame requiring information extraction is left (step R130) (Step R120). If the frame requiring information extraction is not left, decoding is performed (step R140).

The reason for determining whether a frame requiring information extraction is left (step R130) is that the GPS information and the LED intensity information can not be stored in one frame.

Hereinafter, the data structure of the LED intensity information and the GPS information will be described with reference to FIG.

4 is a conceptual diagram showing the data structure of the LED intensity information and the GPS information shown in FIG.

Referring to FIG. 4, the image information captured in the embodiments of the present invention is composed of a plurality of frames (Frame1, Frame2, ..., FrameN-1, FrameN) . For example, in Frame N-1, it is composed of two identical blocks BlockN-1 and BlockN-1.

The frame rate of the LED of the signage is constant, but the frame rate of the smartphone camera is not constant. Therefore, there is a possibility that the signal of the transmitting end is received by missing the signal from the receiving end. Accordingly, when two identical blocks are successively transmitted and received, and two identical blocks are supplemented to supplement the missing information in each block, the GPS information and the LED intensity information of the LED signage can be acquired more stably.

Each block may include a header indicating a start of a block, a block sequence number (BSN), a 32-bit data, and a trailer indicating the end of the block. The intensity of the LED is 8 bits And the GPS signal requires 64 bits, so that a total of 72 bits are required and can not transmit all of them to 32-bit data.

Therefore, since data can not be stored in 64 bits, which is two blocks, data can not be stored in 64 bits which is a data space of one frame composed of two blocks.

Accordingly, in the present invention, the same block is formed in one frame, and divided into three frames (32 x 3 = 96 bits) to transmit and receive GPS information and LED intensity information of the LED signage.

On the other hand, the GPS information and the LED intensity information of the LED signage can be transmitted and received sequentially to the six blocks constituting the three frames, and the same information can be transmitted and received again. That is, although data of AA, BB, and CC is transmitted and received in the above example, data may be transmitted and received in the order of ABC and ABC.

Referring again to FIG. 3, when information is extracted from three frames or less (step R130), information is extracted from the next frame (step R120), and three frames The information extraction is completed. And decodes the extracted information (step R140).

Thereafter, the decoded information is used to obtain the LED signage and the relative coordinate values of the audience in which the photographing is performed.

Hereinafter, with reference to FIG. 5, the principle of obtaining the LED coordinate and the relative coordinate values of the audience in which photographing has been performed will be described.

5 is a conceptual diagram showing a principle of calculating a position using LED intensity information. 5 is a plan view as viewed from above.

Referring to FIG. 5, the signage displays an image by, for example, arranging a plurality of LEDs in a matrix form on a rectangular plate, and causing each LED to correspond to a pixel.

On the other hand, the distance L1A from the LED 1 on the left side is relatively close to the distance L2A from the LED 2 on the right side in the A-seat audience. On the other hand, in the B position, the distance L1B from the LED 1 on the left side is relatively long and the distance L2B from the LED 2 on the right side is relatively close.

On the other hand, since the intensity of the light source is inversely proportional to the square of the distance, the intensity of the intensity is weakened, so that the position of each audience can be determined. More specifically, in the case where the signage is arranged in a line, as shown in the drawing, when a circle having L1A as a radius around the LED 1 is drawn and a circle having L2A as a radius around the LED 2 is drawn, Can be obtained by the A coordinate.

Extend it to find the coordinates of the three-dimensional A position by calculating the sphere by the distance at at least three corners of the rectangle and the intersection of the three sphere.

Therefore, without using GPS information, it is possible to obtain the relative coordinates of the LED signage in each audience using only the intensity. However, if GPS information is used, the calculation process can be reduced.

Referring again to FIG. 3, after the seat position is calculated through this method (step R150), it is checked whether a predetermined time has elapsed (step R160). If the predetermined time has not elapsed, (Step R170). When the performance is finished, the relative position extraction is terminated, and it is checked whether a predetermined time has elapsed (step R160). If the predetermined time has elapsed or the performance is not finished, the GPS information and LED intensity The process of extracting information (step R120) is repeated.

In this way, the step of acquiring the relative coordinates of the stage where the performances are performed and the plurality of seats in which the images are captured can be improved in the accuracy of the position in which the data are accumulated and calculated when it is repeatedly performed every predetermined period.

While the present invention has been described in connection with what is presently considered to be practical and exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Signage (transmitter)
Smartphone (receiver)

Claims (5)

Capturing image information from a plurality of seats;
Obtaining relative coordinates of a stage where a performance is performed and a plurality of seats where a video is shot;
Collecting the relative coordinates and the image information; And
Synthesizing image information obtained from each of the seats based on the relative coordinates;
Lt; / RTI >
Wherein the obtaining of the relative coordinates comprises:
And is acquired through image information from a plurality of seats,
Wherein the image information includes an image of LED signage behind the stage,
Before the step of photographing the image information from the plurality of seats,
Obtaining GPS information and LED intensity information of the LED signage;
Encoding GPS information and LED intensity information of the LED signage; And
Transmitting GPS information and LED intensity information of the encoded LED signage via visible light communication through the LED signage;
The method of claim 1, further comprising:
delete The method according to claim 1,
The GPS information and the LED intensity information of the LED signage transmit the same information two or more times,
Wherein the GPS information and the LED intensity information of the LED signage are divided into a plurality of frames and transmitted.
The method according to claim 1,
Wherein the step of obtaining the relative coordinates of the stage where the performance is performed and the plurality of seats in which the video is captured is repeatedly performed every predetermined period.

The method according to claim 1,
Wherein the step of collecting the relative coordinates and the image information is performed by clouding.

Images