KR101743081B1 - Apparatus of controlling stage effect using motion recognition and method thereof - Google Patents

Abstract

The present invention relates to an apparatus and method for controlling a stage effect using motion recognition. According to the present invention, in a stage effect control method using a stage effect control device, a stage effect control method includes receiving motion measurement data according to an operation of the performer from a plurality of sensors attached to different body parts of a performer on the stage Comparing the motion measurement data with a plurality of thresholds corresponding to the plurality of sensors to determine whether or not the motion data is valid; if the motion data is determined to be valid motion data, Selecting a stage effect control signal based on the stage level control signal, and adjusting the stage type effect control signal based on a weight set according to the stage level of the performer and the stage effect control signal, A stage effect that controls at least one stage effect It includes.
As described above, according to the present invention, since the performer can directly control the sound effects, the lighting effects, the visual effects, and the special effects of the stage using the wearable sensor, not only the effective control of the stage effect is possible, Thereby reducing the cost of consuming.

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus and method for controlling a stage effect using motion recognition,

The present invention relates to an apparatus and method for controlling a stage effect using motion recognition, and more particularly, to an apparatus and method for controlling a stage effect using motion recognition capable of controlling a stage effect of a performance using performance information of a performer .

With the development of wired / wireless communication technology, the development of sensing technology for measuring information of people and environment is becoming more prominent. Especially, interest in internet (IoT) technology has been rapidly increased, and this technology development is more prominent.

Sensing technology that measures and measures human and environmental information is used for the treatment and prevention of diseases by detecting data essential for health management such as pulse wave, EMG, respiration of a person.

In addition, the sensing technology for measuring the defects of the products in the factory automation facilities helps construct more efficient production facilities than the conventional ones.

As such, sensing technology has a high potential to make life richer and richer in various aspects of life.

However, in the field of cultural contents, such as theater or musical, where people communicate and interact with people offline, the use of sensing technology is slow. It is necessary to use sensing technology to provide more diverse and high-quality cultural contents.

The technology of the background of the present invention is disclosed in Korean Patent Laid-Open No. 10-2000-0047056 (published on Jun. 25, 2000).

SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus and method for controlling a stage effect using motion recognition capable of controlling a stage effect of a performance using performance information of a performer.

According to an aspect of the present invention, there is provided a method for controlling a stage effect using a stage effect control device, the method comprising the steps of: receiving a signal from a plurality of sensors attached to different body parts of a performer on the stage, The method comprising the steps of: receiving motion measurement data according to motion; comparing the motion measurement data with a plurality of thresholds corresponding to the plurality of sensors to determine whether or not it is valid motion data; Selecting a stage effect control signal corresponding to the valid motion data from a database, and selecting a stage effect control signal corresponding to the effective motion data from the database, based on the weight set according to the cast level of the performer and the stage effect control signal, Color and lighting direction, at least one of the stage special effects And controlling the stage effect including one.

Wherein the step of determining whether the valid motion data is valid is a step of determining whether the sensed value of the motion measurement data is greater than a predetermined threshold value corresponding to each of the plurality of sensors, Is less than the predetermined threshold time, the motion measurement data can be determined as valid motion data.

The step of controlling the stage effect may include generating a second stage effect control signal by repeating a specific operation during the first period to generate a first stage effect control signal and then repeating another specific operation during the second period to generate a second stage effect control signal , It is possible to simultaneously reproduce the sound effect corresponding to the first stage effect control signal and the sound effect corresponding to the second stage effect control signal.

The step of controlling the stage effect may be configured such that, in the case of a plurality of performers, the weights are set differently corresponding to the main, auxiliary, and single levels set according to the roles of the plurality of performers, When a signal is generated, a stage effect control signal for operation of other assistive level performers and short-range level performers may not be generated or a stage effect may be reduced according to the weight.

The step of determining whether or not the valid motion data is valid may determine whether or not the level is valid motion data using an average value of motion measurement data of the same performer when the performance levels set for the plurality of performers are the same.

The effective data determination unit may determine whether the effective motion data is valid using the following equation when the performers are plural and the performer levels of the performers are different.

Here, S _x indicates the selected motion estimation data, S _{circumferential n} is the n-th mean motion estimation data from the peripheral, and, S _{Supporting n} refers to the motion estimation data of the n-th supporting, and S _{figurant n} is the n-th figurant , K denotes the number of assistant performers, and 1 denotes the number of monopoint performers.

The stage effect control apparatus according to another embodiment of the present invention includes a data receiving unit for receiving motion measurement data according to an operation of the performer from a plurality of sensors attached to different body parts of a performer on the stage, A validity data determination unit for determining whether the valid motion data is valid compared with a plurality of thresholds corresponding to a plurality of sensors, At least one of a sound type, a sound size, a lighting brightness, a lighting color, a lighting direction, and a stage special effect in the stage according to a weight value set according to a cast level of the performer and the stage effect control signal, Stage effect control to control the stage effect including It includes.

As described above, according to the present invention, since the performer can directly control the sound effects, the lighting effects, the visual effects, and the special effects of the stage using the wearable sensor, not only the effective control of the stage effect is possible, Thereby reducing the cost of consuming.

In addition, since the stage effect is controlled using the wearable sensor, it is possible to produce various stage effects with only one performer or small performer.

1 is a view for explaining a stage effect control system according to an embodiment of the present invention.
2 is a view for explaining a motion measurement sensor according to an embodiment of the present invention.
3 is a configuration diagram of a stage effect control apparatus according to an embodiment of the present invention.
4 is a flowchart of a stage effect control method according to an embodiment of the present invention.
5 is a view for explaining a sound effect control method according to an embodiment of the present invention.
6 is a view for explaining a stage effect control method considering a character level according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.

First, a stage effect control system using a stage effect control apparatus according to an embodiment of the present invention will be described with reference to FIG.

1 is a view for explaining a stage effect control system according to an embodiment of the present invention.

1, a stage effect control system according to an embodiment of the present invention includes a motion measurement sensor 100, a stage effect device 200, and a stage effect control device 300. As shown in FIG.

The stage effect control system according to an embodiment of the present invention can be realized by a motion sensor 100 attached to a body of a performer transmits motion measurement data measured according to the performance of a performer to the stage effect control apparatus 300 in real time do.

Then, the stage effect control device 300 selects the motion measurement data effective for performing the control from the motion measurement data, and selects the stage effect control signal corresponding to the valid data from the database.

Then, the stage effect control device 300 gives a weight to the stage effect control signal in consideration of the cast level of the selected performer. As a result, the intensity of the stage effect control signal changes.

Next, the stage effect control apparatus 300 sends a stage effect control signal to the stage effect apparatus 200, and the stage effect apparatus 200 produces various stage effects according to the stage effect control signal.

Hereinafter, the configuration of the stage effect control system according to the embodiment of the present invention will be described in detail with reference to FIG. 2 through FIG.

2 is a view for explaining a motion measurement sensor according to an embodiment of the present invention.

The motion measurement sensor 100 means a sensor capable of measuring the operation of the performer, and the motion measurement sensor 100 can be attached to at least one part of the performer's body. The motion measurement sensor 100 includes an acceleration sensor, a gyro sensor, a magnetic sensor, an electromyogram sensor, and the like.

As shown in Figure 2, according to an embodiment of the present invention, the motion measurement sensor 100 includes sensors attached to the upper arm and forearm of both arms of a performer, sensors attached to the chest, thighs of both legs, And may include nine sensors 100a through 100i of the sensor.

The nine sensors 100a to 100i are detachable from the body and transmit motion measurement data to the stage effect controller 300 using a wireless communication module such as a WIFI or a Bluetooth communication module.

3 is a configuration diagram of a stage effect control apparatus according to an embodiment of the present invention.

3, the stage effect control apparatus 300 includes a data receiving unit 310, a valid data determiner 320, a stage effect selector 330, a stage effect controller 340, .

The data receiving unit 310 receives the motion measurement data according to the performance of the performer from a plurality of sensors attached to different body parts of the performer on the stage.

The valid data determination unit 320 compares the processed motion measurement data with a plurality of threshold values corresponding to a plurality of sensors to determine whether the valid motion data is valid.

Specifically, the valid data determination unit 320 determines whether or not the sensed value of the motion measurement data is greater than a preset threshold value corresponding to each of the plurality of sensors, and the time interval between the current time and the valid motion data at the previous time point is preset If it is smaller than the threshold time, the motion measurement data is judged as valid motion data.

The valid data determination unit 320 determines whether the valid motion data is valid using the average value of the motion measurement data of the performers having the same level, if the performance levels set for the plurality of performers are the same.

Here, the castle level is preset according to the performer.

The stage effect selection unit 330 selects a stage effect control signal corresponding to the valid motion data from the pre-stored database, if it is determined that the effective motion data is valid.

At this time, the stage effect control unit 340 includes at least one of a sound type, a sound size, a lighting brightness, a lighting color, a lighting direction, and a stage special effect on the stage in accordance with a weight and a stage effect control signal set according to a cast level of a performer To control the stage effect.

In addition, the stage effect controller 340 generates a first stage effect control signal by repeating a specific operation during the first period, and then repeats another specific operation during the second period to generate a second stage effect control signal , The sound effect corresponding to the first stage effect control signal and the sound effect corresponding to the second stage effect control signal are simultaneously reproduced.

If there are a plurality of performers, the stage effect control unit 340 sets weights corresponding to the main, auxiliary, and single levels set according to the roles of the plurality of performers, The stage effect control signal is not generated or the stage effect is reduced depending on the weights so that the stage effect control signal for the operation of the other assistant level performers and the single level performer is not generated.

Next, the stage effect device 200 refers to a device capable of producing various effects of the stage. The stage effect device 200 includes a sound device for emitting sound, and a lighting device for irradiating light. In addition, the accessory devices may include bubble, dry-ice, liquefied nitrogen (LN ₂ ), carbon dioxide (CO ₂ ) fog, fire flame, air- a magic-balloon, and an auto-drop.

Hereinafter, a stage effect control method using the stage effect control apparatus according to an embodiment of the present invention will be described with reference to FIG. 4 through FIG.

4 is a flowchart of a stage effect control method according to an embodiment of the present invention.

First, the data receiving unit 310 receives motion measurement data according to the performance of the performer from a plurality of sensors attached to different body parts of a performer on the stage (S410).

Then, the valid data determination unit 320 compares the processed motion measurement data with a plurality of threshold values corresponding to the plurality of sensors to determine whether the data is effective motion data (S420).

First, the thresholds are preset corresponding to each of the plurality of sensors attached to the body part of the performer.

For example, suppose that the motion measurement sensor 100 is attached to the three body parts (left arm, right arm, chest) of the performer. In this case, the threshold value is set corresponding to the sensor attached to the left arm, the sensor attached to the right arm, and the sensor attached to the chest. That is, at least three threshold values may be preset.

Next, the valid data determination unit 320 determines whether the sensed value of the processed motion measurement data is greater than a predetermined threshold corresponding to each of the plurality of sensors, and whether the time interval between the current time and the valid motion data at the previous time is If it is smaller than the predetermined threshold time, the motion measurement data is judged as valid motion data.

The motion measurement data of the motion measurement sensor 100 attached to the right front arm of the performer will be described as an example. And a threshold value corresponding to the motion measurement sensor 100 attached to the right forearm is 10.

At this time, if the sensed value measured by the performer moving the right arm is 13 at the current point, the time at which the valid motion data at the previous closest point at the current point is detected is detected. However, if the sensed value of the motion measurement data at the present time is 9, the motion measurement data at the present time is filtered because it is not valid data.

Then, the valid data determination unit 320 calculates the time interval between the previous time and the current time, and compares the calculated time interval with the threshold time. When the threshold time is 1 second, if the time interval is 0.8 seconds, the motion measurement data of the current time point is judged as valid motion data. However, if the time interval is 1.1 seconds, it is determined that the motion measurement data at the current time point is not valid, and filtering is performed.

On the other hand, when the performance levels set for the plurality of performers are the same, the valid data determination unit 320 determines whether or not it is effective motion data by using the average value of the motion measurement data of the performers having the same play level. Here, the castle level is set in advance.

For example, if there are performers A, B, and C at the performance level, the average value of the three motion measurement data is compared with a plurality of thresholds corresponding to the plurality of sensors to determine whether the motion data is valid motion data

If there are a plurality of performers and the performance levels of the performers are different, the valid data determination unit 320 determines whether the valid motion data is valid using the following equation (1).

Here, S _x indicates the selected motion estimation data, S _{circumferential n} is the n-th mean motion estimation data from the peripheral, and, S _{Supporting n} refers to the motion estimation data of the n-th supporting, and S _{figurant n} is the n-th figurant , K denotes the number of assistant performers, and 1 denotes the number of monopoint performers.

For example, assume that the sensing value of the periphery 1 is 12, the sensing value of the periphery 2 is 11, the sum of the sensing values of the three persons is 10, and the sum of the sensing values of the two regions is 6.

In this case, since the sensing value of the periphery 1 is larger than the sensing value or sum value of the periphery 2, the supports, and the partial regions, the valid data determination unit 320 determines the motion estimation data of the periphery 1 as a plurality And judges whether or not it is valid motion data

Next, when it is determined that the motion measurement data is effective motion data, the stage effect selection unit 330 selects a stage effect control signal corresponding to the valid motion data from the pre-stored database (S430).

For example, suppose that the motion measurement sensor 100 is attached to the forearm of the left arm and the forearm of the right arm. At this time, the database stores the stage effect control signal according to the forearm of the left arm and the forearm of the right arm.

If the sensed value of the effective motion data corresponding to the left arm front arm is 10 and the sensed value of the effective motion data corresponding to the right arm front arm is 7, the stage effect selector 330 selects the sensed value 10 of the valid motion data in the left arm front arm, The stage effect control signal that simultaneously satisfies the sensing value 7 of the valid motion data is selected.

The stage effect controller 340 includes at least one of a sound type, sound size, lighting brightness, illumination color, illumination direction, and stage special effects on the stage in accordance with the weight and the stage effect control signal set according to the cast level of the performer (S440).

5 is a view for explaining a sound effect control method according to an embodiment of the present invention.

When the performer repeats a specific operation for a first period to generate a first stage effect control signal and then repeats another specific operation for a second period to generate a second stage effect control signal, The sound effect corresponding to the first stage effect control signal and the sound effect corresponding to the second stage effect control signal are simultaneously reproduced.

For example, it is assumed that a trumpet playing sound is reproduced through the act of the performer blowing the trumpet at the time (a) as shown in FIG. 5 (a).

5 (b), when the performer performs an action of turning on the violin at a time (a) later than the time (a), the stage effect control unit 340 reproduces the violin playing sound simultaneously with the trumpet playing sound .

5 (c), when the performer performs an action to play the drum at a time point later than the point (b), the stage effect controller 340 controls the drum performance sound, the violin performance sound, Play back the playing sound.

This allows a single performer to control the sound effects required by a large number of performers, such as orchestral performances and band ensembles.

6 is a view for explaining a stage effect control method considering a character level according to an embodiment of the present invention.

When the plurality of performers is plural, the stage effect control unit 340 sets weights different from each other corresponding to the main, auxiliary, and single levels set according to the performances of the plurality of performers.

Accordingly, when the stage effect control signal is generated in accordance with the operation of the pertinent level performer, the stage effect control unit 340 controls the stage effect control signal for the performances of the assistant level performers and the individual level performers to be different according to the weights, Thereby reducing the effect.

For example, as shown in Fig. 6 (a), when a performer at the assistive level takes an action of lifting the right arm, the stage effect control unit 340 sends the dry ice act to the performer in accordance with the stage effect control signal It is assumed to spray.

However, if the performers at the leading level perform at the same time, the weights are controlled to control the stage effect.

Specifically, as shown in Fig. 6 (b), the stage effect is controlled so as not to spray the dry ice smoke to the performer at the performance level by illuminating only the performer at the performance level, And controls the performers of the assistive level to spray the dry ice smoke to a smaller extent than in Figure 6 (a).

According to the embodiment of the present invention, since the performer can directly control the sound effects, the lighting effects, the visual effects, and the special effects of the stage using the wearable sensor, not only the stage effect can be efficiently controlled, Thereby reducing the cost incurred by the user.

In addition, since the stage effect is controlled using the wearable sensor, it is possible to produce various stage effects with only one performer or small performer.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100 (a to i): motion measurement sensor 200: stage effect device
300: stage effect controller 310: data receiver
320: Valid data determiner 330: Stage effect selector
340: stage effect control unit

Claims (12)

A stage effect control method using a stage effect control device,
Receiving motion measurement data according to an operation of the performer from a plurality of sensors attached to different body parts of a performer on the stage,
Comparing the motion measurement data with a plurality of thresholds corresponding to the plurality of sensors to determine whether the motion data is valid motion data,
Selecting a stage effect control signal corresponding to the valid motion data from a pre-stored database if the valid motion data is determined; and
A stage effect including at least one of an acoustic type, an acoustic size, a lighting brightness, an illumination color, a lighting direction, and a stage special effect in the stage according to a weight set according to a cast level of the performer and the stage effect control signal ≪ / RTI >
Wherein controlling the stage effect comprises:
Wherein when the plurality of performers are plural, the weights are set to be different from each other in correspondence with the levels of the main, auxiliary, and single stations set according to the roles of the plurality of performers,
A stage effect control method for preventing a stage effect control signal from being generated for an operation of another assistant level performer or a short-range level performer or reducing a stage effect according to the weight, when a stage effect control signal is generated according to an operation of a main-level performer. The method according to claim 1,
Wherein the determining whether the valid motion data is valid comprises:
If the sensing value of the motion measurement data is greater than a preset threshold corresponding to each of the plurality of sensors and the time interval between the current time and the effective motion data at the previous time is less than a preset threshold time, As effective motion data. The method according to claim 1,
Wherein controlling the stage effect comprises:
When the performer repeats a specific operation for a first period to generate a first stage effect control signal and then repeats another specific operation for a second period to generate a second stage effect control signal, Wherein the sound effect corresponding to the signal and the sound effect corresponding to the second stage effect control signal are simultaneously reproduced. delete The method according to claim 1,
Wherein the determining whether the valid motion data is valid comprises:
And determining whether or not the level is valid motion data using an average value of motion measurement data of the same performer, when the plurality of performers have the same cast level. The method according to claim 1,
Wherein the determining whether the valid motion data is valid comprises:
Determining whether the effective motion data is valid using the following equation when the performers are plural and the performer levels of the performers are different:

Here, S _x indicates the selected motion estimation data, S _{circumferential n} is the n-th mean motion estimation data from the peripheral, and, S _{Supporting n} refers to the motion estimation data of the n-th supporting, and S _{figurant n} is the n-th figurant , K denotes the number of assistant performers, and 1 denotes the number of monopoint performers. A data receiving unit for receiving motion measurement data according to an operation of the performer from a plurality of sensors attached to different body parts of a performer on the stage,
A valid data determination unit for comparing the motion measurement data with a plurality of thresholds corresponding to the plurality of sensors to determine whether the data is effective motion data,
A stage effect selector for selecting a stage effect control signal corresponding to the valid motion data from a previously stored database if the valid motion data is determined;
A stage effect including at least one of an acoustic type, an acoustic size, a lighting brightness, an illumination color, a lighting direction, and a stage special effect in the stage according to a weight set according to a cast level of the performer and the stage effect control signal A stage effect control unit,
The stage effect control unit,
Wherein when the plurality of performers are plural, the weights are set to be different from each other in correspondence with the levels of the main, auxiliary, and single stations set according to the roles of the plurality of performers,
Wherein the stage effect control signal is generated according to the operation of the main level performer so that the stage effect control signal for the operation of the other assistant level performer and the single level performer is not generated or the stage effect is reduced according to the weight. 8. The method of claim 7,
The valid data determination unit may include:
If the sensing value of the motion measurement data is greater than a preset threshold corresponding to each of the plurality of sensors and the time interval between the current time and the effective motion data at the previous time is less than a preset threshold time, As effective motion data. 8. The method of claim 7,
The stage effect control unit,
When the performer repeats a specific operation for a first period to generate a first stage effect control signal and then repeats another specific operation for a second period to generate a second stage effect control signal, The sound effect corresponding to the signal and the sound effect corresponding to the second stage effect control signal are simultaneously reproduced. delete 8. The method of claim 7,
The valid data determination unit may include:
And judges whether or not the level is valid motion data by using an average value of motion measurement data of the same performer when the performance levels set for the plurality of performers are the same. 8. The method of claim 7,
The valid data determination unit may include:
The stage effect control device for determining whether or not the effective motion data is using the following equation when the performers are plural and the performer levels of the performers are different:

Here, S _x indicates the selected motion estimation data, S _{circumferential n} is the n-th mean motion estimation data from the peripheral, and, S _{Supporting n} refers to the motion estimation data of the n-th supporting, and S _{figurant n} is the n-th figurant , K denotes the number of assistant performers, and 1 denotes the number of monopoint performers.

Images