WO2017209439A1

WO2017209439A1 - Method and system for motion-based control of studio equipment

Info

Publication number: WO2017209439A1
Application number: PCT/KR2017/005439
Authority: WO
Inventors: Sol Jee CHUN
Original assignee: Jam2Go, Inc.
Priority date: 2016-05-31
Filing date: 2017-05-25
Publication date: 2017-12-07
Also published as: KR101800192B1

Abstract

The method includes defining a fixed time interval and an optional time interval; storing default performance motion data and default control data for controlling the studio equipment according to the default performance motion; storing optional performance motion data and optional control data distinguished from the default control data and for controlling the studio equipment according to the optional performance motion; starting control of the studio equipment; controlling a motion recognition module to generate recognized motion data; and controlling the studio equipment using the default control data when the recognized motion data and the default performance motion data are determined to substantially match as a result of mutual comparison, and controlling the studio equipment using the optional control data when the recognized motion data and the optional performance motion data are determined to substantially match as a result of mutual comparison.

Description

METHOD AND SYSTEM FOR MOTION-BASED CONTROL OF STUDIO EQUIPMENT

At least one example embodiment relates to a method and system for controlling studio equipment based on a motion, and more particularly, to a studio equipment control method and system that may recognize a performance motion and may automatically produce video content adaptively optimized for the performance motion.

With an increase in the number of video sharing sites, such as YouTube, the number of user generated contents (UGC) is also rapidly increasing. However, since many UGC are simply taken by general users using mobile phone cameras, the quality of video contents may be poor even with the good contents due to a lack of professional-level photographing and editing techniques.

Thus, general users are increasingly interested in such professional-level photographing and editing techniques, for example, implementation of various angles of views and editing of a dynamic scene. However, to produce high quality video contents using the profession-level photographing and editing techniques, the general users need to use specialized equipment of a broadcasting station level (used by the broadcasting station), for example, various lightings, a plurality of cameras for specialists, and camera moving systems for dynamic camera works. However, the specialized equipment requires excessive cost and is also difficult for the general users to handle. In addition, it is difficult for the general users to use professional editing software capable of editing video contents as well as professional photographing equipment. Further, as a matter of fact, there are not many specialists in the art. To outperform such issues, there are simple editing apps and apps for applying various video filters and effects to help the general users to generate high-quality UGC. However, these apps only contribute to partially enhancing the quality of the video content since the apps are at a level of facilitating editing and improving the mood of a screen. Most of the high-quality video contents are still produced by specialists in professional studios.

In the meantime, editing techniques, such as subtitles and special effects, as well as various broadcasting equipment, such as lightings and cameras, are increasingly automated and a system for integrating the editing techniques and the broadcasting equipment is also emerging. That is, a system for automatically controlling a plurality of cameras according to a preset sequence, a system for automatically controlling a plurality of lightings according to a preset sequence, a system for automatically applying preset editing effects to a video captured by a camera, and the like, have been developed individually.

Here, in the case of an automatic control system for studio equipment, when a user suddenly moves away from a preset angle of camera view, the automatic control system may not recognize that the user moves away from the preset angle of camera view and a blank screen may be captured(the user may not be captured by the camera). The automatic control system may not adaptively change lighting or a camera work capable of highlighting the users' motion when the user makes an impromptu motion to lead the response from the audience or viewers at the climax of a performance.

U.S. Patent Registration NO. 8,957,942 of Studio one entertainment, Inc., titled "Studio booth configured to produce illusion that customer is photographed in different locale", discloses a system for producing a performance of a user within a studio booth as video content. According to this system, it is possible to easily produce video content without the help from a specialist, whereas it is difficult to enhance quality of the video dramatically since a fixed camera and a fixed lighting are used.

U.S. Patent Publication NO. 2012/0236160 of Rezek et al., titled "Remote studio management and control", discloses a method of managing and controlling studio equipment at a remote location. According to this method, it is possible to produce (or create) video content according to a user's performance since a specialist controls studio equipment at a remote location in real time. On the other hand, it is unsuitable for a user desiring to generate UGC at low cost since photographing and editing specialists for controlling the studio equipment at a remote location are required.

U.S. Patent Registration NO. 8,562,403 of Harmonix music systems, Inc., titled "Prompting a player a dance game", discloses a method of guiding a dance game sequence, comparing a dance motion of a user to a guided dance motion, and calculating the accuracy of the dance motion based on a motion comparison result. This method only uses the motion comparison result of comparing a recognized dance motion of the user to a preset dance motion only as the score in a game, and does not disclose or imply adaptively using the motion comparison result to produce video content including the dance motion of the user.

At least one example embodiment provides a motion-based studio equipment control system and method that may easily produce video content optimized for a motion of a performance object without a manipulation of studio equipment by a studio manpower by recognizing the motion of the performance object in an optional time interval, by identifying the recognized motion of the performance object as a default performance motion or an optional performance motion, and by automatically controlling studio equipment, for example, a lighting, a camera, sound, and the like, to adaptively cope with the motion of the performance object.

At least one example embodiment also provides a motion-based studio equipment control system and method that may increase a probability capable of producing video content most optimized even for an impromptu motion of a performance object by pre-storing a plurality of pieces of optional performance motion data and a plurality of pieces of optional control data in the same time interval, and by comparing a motion of the performance object to the pre-stored plurality of pieces of optional performance motion data.

At least one example embodiment also provides a motion-based studio equipment control system and method that may produce video content that optimally captures various series of motions of a performance object by changing a type of studio equipment control data in a following time interval that follows a precedent time interval according to a motion of the performance object in the precedent time interval.

At least one example embodiment also provides a motion-based studio equipment control system and method that may enhance the quality of video content by visualizing and thereby displaying a default performance motion and an optional performance motion that a performance object is capable of taking in an optional time interval through a motion guide module, such as a display and the like, and by guiding the performance object to take any one of preset motions opportunely in the middle of a performance.

At least one example embodiment also provides a motion-based studio equipment control system and method that enables a performance object to verify in advance a production result of video content according to a motion by simulating a control result of studio equipment according to a default performance motion or an optional performance motion that the performance object is capable of taking in an optional time interval and by providing a simulation result to the performance object during a performance through a motion guide module.

According to at least one example embodiment, there is provided a method for controlling studio equipment based on a motion, the method comprising: a first step of defining, by a studio equipment control system, a fixed time interval in a total time interval in which a performance object makes a performance, and defining an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval; a second step of storing, by the studio equipment control system, default performance motion data corresponding to the default performance motion that the performance object is capable of performing in the optional time interval and default control data for controlling the studio equipment according to the default performance motion in a data storage module; a third step of storing, by the studio equipment control system, an optional performance motion data and an optional control data in the data storage module, wherein the optional performance motion data corresponds to the optional performance motion that the performance object is capable of performing in the optional time interval, wherein the optional control data distinguished from the default control data and is for controlling the studio equipment according to the optional performance motion; a fourth step of starting, by the studio equipment control system, control of the studio equipment in response to a start of a performance; a fifth step of controlling, by the studio equipment control system, a motion recognition module to recognize a motion of the performance object during the optional time interval and to generate recognized motion data; and a sixth step of controlling, by the studio equipment control system, the studio equipment using the default control data when the recognized motion data recognized during the optional time interval and the default performance motion data allocated to the optional time interval are determined to substantially match as a result of mutual comparison, and controlling the studio equipment using the optional control data when the recognized motion data recognized during the optional time interval and the optional performance motion data allocated to the optional time interval are determined to substantially match as a result of mutual comparison.

According to an aspect, in the sixth step, the studio equipment control system controls the studio equipment using the default control data when the recognized motion data recognized during the optional time interval is determined to be different from all of the default performance motion data and the optional performance motion data allocated to the optional time interval.

According to an aspect,, in the third step, the studio equipment control system stores, in the data storage module, first optional performance motion data to n-th optional performance motion data corresponding to first optional performance motion to n-th optional performance motion that the performance object is capable of performing in the optional time interval and first optional control data to n-th optional control data corresponding to the first optional performance motion to the n-th optional performance motion, respectively, in the sixth step, the studio equipment control system compares the recognized motion data recognized in the optional time interval to the first optional performance motion data to the n-th optional performance data allocated to the optional time interval, searches optional performance motion data among the first optional performance motion data to the n-th optional performance data substantially matching with the recognized motion data and controls the studio equipment using any one of the first optional control data to the n-th optional control data corresponding to the found optional performance motion data.

According to an aspect, in the first step, the studio equipment control system defines a precedent optional time interval and a following optional time interval, in the second step, the studio equipment control system stores, in the data storage module, precedent default performance motion data that is the default performance motion data in the precedent optional time interval, precedent default control data that is the default control data in the precedent optional time interval, first following default performance motion data and second following default performance motion data that are the default performance motion data in the following optional time interval, and first following default control data and second following default control data that are the default control data in the following optional time interval, in the third step, the studio equipment control system stores, in the data storage module, precedent optional performance motion data that is the optional performance motion data in the precedent optional time interval, precedent optional control data that is the optional control data in the precedent optional time interval, first following optional performance motion data and second following optional performance motion data that are the optional performance motion data in the following optional time interval, and first following optional control data and second following optional control data that are the optional control data in the following optional time interval, in the fifth step, the studio equipment control system controls the motion recognition module to generate precedent recognized motion data during the precedent optional time interval, and in the sixth step, the studio equipment control system controls the studio equipment using any one of the precedent default control data or the precedent optional control data according to the precedent recognized motion data, and the motion-based studio equipment control method further comprises: a seventh step of controlling, by the studio equipment control system, the motion recognition module to generate following recognized motion data during the following optional time interval; an eighth step of controlling, by the studio equipment control system, the studio equipment using any one of the first following default control data or the first following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent default control data in the precedent optional time interval; and a ninth step of controlling, by the studio equipment control system, the studio equipment using any one of the second following default control data or the second following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent optional control data in the precedent optional time interval.

According to an aspect, in the second step, the studio equipment control system further stores fixed control data for controlling the studio equipment in the fixed time interval in the data storage module, and the motion-based studio equipment control method further comprises: a tenth step of controlling, by the studio equipment control system, the studio equipment using the fixed control data during the fixed time interval after the fourth step.

According to an aspect, an eleventh step of controlling, by the studio equipment control system, the motion recognition module to be inactivated during the fixed time interval after the fourth step.

According to an aspect, a twelfth step of controlling, by the studio equipment control system, a motion guide module to visualize and thereby display the default performance motion data and the optional performance motion data as the default performance motion and the optional performance motion, respectively, during the optional time interval.

According to an aspect, in the twelfth step, the studio equipment control system controls the motion guide module to simulate controlling the studio equipment using the default control data and the optional control data, and to apply a simulation result to visualization of the default performance motion and the optional performance motion.

According to at least one example embodiment, there is provided a system for controlling studio equipment based on a motion, the system comprising: a plurality of studio equipment; a studio equipment control module configured to control the studio equipment; a motion recognition module configured to recognize a motion of a performance object and to generate recognized motion data; a time interval definition module configured to define a fixed time interval in a total time interval in which the performance object makes a performance, and to define an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval; a data storage module configured to store default performance motion data corresponding to the default performance motion that the performance object is capable of performing in the optional time interval and default control data for controlling the studio equipment according to the default performance motion, and to store an optional performance motion data corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval and an optional control data distinguished from the default control data and for controlling the studio equipment according to the optional performance motion; a motion data comparison module configured to compare the recognized motion data recognized during the optional time interval to the default performance motion data and the optional performance motion data allocated to the optional time interval; and a control data selection module configured to control the studio equipment control module to control the studio equipment using the default control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the default performance motion data substantially match, and to control the studio equipment control module to control the studio equipment using the optional control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the optional performance motion data substantially match.

According to an aspect, the control data selection module controls the studio equipment control module to control the studio equipment using the default control data when the recognized motion data is determined to be different from all of the default performance motion data and the optional performance motion data as a comparison result of the motion data comparison module.

According to an aspect, the data storage module stores first optional performance motion data to n-th optional performance motion data corresponding to first optional performance motion to n-th optional performance motion that the performance object is capable of performing in the optional time interval and first optional control data to n-th optional control data corresponding to the first optional performance motion to the n-th optional performance motion, respectively, wherein the studio equipment control system compares the recognized motion data recognized in the optional time interval to the first optional performance motion data to the n-th optional performance data allocated to the optional time interval, searches optional performance motion data among the first optional performance motion data to the n-th optional performance data substantially matching with the recognized motion data and controls the studio equipment using any one of the first optional control data to the n-th optional control data corresponding to the found optional performance motion data.

According to an aspect, the time interval definition module defines a precedent optional time interval and a following optional time interval, the data storage module stores precedent default performance motion data that is the default performance motion data in the precedent optional time interval, precedent default control data that is the default control data in the precedent optional time interval, first following default performance motion data and second following default performance motion data that are the default performance motion data in the following optional time interval, and first following default control data and second following default control data that are the default control data in the following optional time interval, and stores precedent optional performance motion data that is the optional performance motion data in the precedent optional time interval, precedent optional control data that is the optional control data in the precedent optional time interval, first following optional performance motion data and second following optional performance motion data that are the optional performance motion data in the following optional time interval, and first following optional control data and second following optional control data that are the optional control data in the following optional time interval, and the motion recognition module generates precedent recognized motion data during the precedent optional time interval and generates following recognized motion data during the following optional time interval, and the control data selection module controls the studio equipment control module to control the studio equipment using any one of the precedent default control data or the precedent optional control data according to the precedent recognized motion data, controls the studio equipment control module to control the studio equipment using any one of the first following default control data or the first following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent default control data in the precedent optional time interval, and controls the studio equipment control module to control the studio equipment using any one of the second following default control data or the second following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent optional control data in the precedent optional time interval.

According to an aspect, the data storage module further stores fixed control data for controlling the studio equipment in the fixed time interval, and the control data selection module controls the studio equipment control module to control the studio equipment using the fixed control data during the fixed time interval.

According to an aspect, the motion recognition module is inactivated during the fixed time interval.

According to an aspect, a motion guide module configured to visualize and thereby display the default performance motion data and the optional performance motion data as the default performance motion and the first optional performance motion, respectively, during the optional time interval.

According to an aspect, the motion guide module simulates controlling the studio equipment using the default control data and the optional control data, and applies a simulation result to visualization of the default performance motion and the optional performance motion.

According to at least one example embodiment, there is provided a system for controlling studio equipment based on a motion, the system comprising: a plurality of studio equipment; a studio equipment control module configured to control the studio equipment; a motion recognition module configured to recognize a motion of a performance object and to generate recognized motion data; a time interval definition module configured to define a fixed time interval in a total time interval in which the performance object makes a performance, and to define an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval; a data storage module configured to store default control data for controlling the studio equipment in the optional time interval, and to store optional performance motion data corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval and optional control data distinguished from the default control data and for controlling the studio equipment according to the optional performance motion; a motion data comparison module configured to compare the recognized motion data recognized during the optional time interval to the optional performance motion data allocated to the optional time interval; and a control data selection module configured to control the studio equipment control module to control the studio equipment using the default control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval is substantially different from the optional performance motion data, and controls the studio equipment control module to control the studio equipment using the optional control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the optional performance motion data substantially match.

A motion-based studio equipment control system and method according to example embodiments may easily produce video content optimized for a motion of a performance object without a manipulation of studio equipment by a studio manpower by recognizing the motion of the performance object in an optional time interval, by identifying the recognized motion of the performance object as a default performance motion or an optional performance motion, and by automatically controlling studio equipment, for example, a lighting, a camera, a sound, and the like, to adaptively cope with the motion of the performance object.

A motion-based studio equipment control system and method according to example embodiments may increase a probability capable of producing video content most optimized even for an impromptu motion of a performance object by pre-storing a plurality of pieces of optional performance motion data and a plurality of pieces of optional control data in the same time interval, and by comparing a motion of the performance object to the pre-stored plurality of pieces of optional performance motion data.

A motion-based studio equipment control system and method according to example embodiments may produce video content that optimally captures various series of motions of a performance object by changing a type of studio equipment control data in a following time interval that follows a precedent time interval according to a motion of the performance object in the precedent time interval.

A motion-based studio equipment control system and method according to example embodiments may enhance the quality of video content by visualizing and thereby displaying a default performance motion and an optional performance motion that a performance object is capable of taking in an optional time interval through a motion guide module, such as a display and the like, and by guiding the performance object to take any one of preset motions opportunely in the middle of a performance.

A motion-based studio equipment control system and method according to example embodiments enables a performance object to verify in advance a production result of video content according to a motion by simulating a control result of studio equipment according to a default performance motion or an optional performance motion that the performance object is capable of taking in an optional time interval and by providing a simulation result to the performance object during a performance through a motion guide module.

Additional aspects of example embodiments will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the disclosure.

These and/or other aspects, features, and advantages of the invention will become apparent and more readily appreciated from the following description of example embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a diagram illustrating a configuration of a motion-based studio equipment control system according to an example embodiment.

FIG. 2 is a diagram illustrating a configuration of a motion-based studio equipment control system according to a first example embodiment.

FIG. 3 is a diagram illustrating a configuration of a data storage module of a motion-based studio equipment control system according to a second example embodiment.

FIG. 4 illustrates an example of a motion guide module that guides a performance motion of a performance object according to an example embodiment.

FIG. 5 illustrates an example of a motion guide module that simulates and thereby guides a performance motion of a performance object according to an example embodiment.

FIG. 6 is a diagram illustrating a configuration of a motion-based studio equipment control system according to a third example embodiment.

FIG. 7 is a flowchart illustrating a motion-based studio equipment control method according to an example embodiment.

FIG. 8 is a flowchart illustrating a motion-based studio equipment control method according to the first example embodiment.

FIGS. 9 and 10 are flowcharts illustrating a motion-based studio equipment control method according to the second example embodiment.

FIG. 11 illustrates an example of a fixed time interval and an optional time interval in a motion-based studio equipment control system and method according to an example embodiment.

FIG. 12 illustrates an example of a fixed time interval, a precedent optional time interval, and a following optional time interval in a studio equipment control system and method according to an example embodiment.

Hereinafter, some example embodiments will be described in detail with reference to the accompanying drawings. Regarding the reference numerals assigned to the elements in the drawings, it should be noted that the same elements will be designated by the same reference numerals, wherever possible, even though they are shown in different drawings. Also, in the description of embodiments, detailed description of well-known related structures or functions will be omitted when it is deemed that such description will cause ambiguous interpretation of the present disclosure.

The terms used herein are for the purpose of describing particular example embodiments only and are not to be used to limit the disclosure. Unless otherwise defined, all terms including technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. Terms, such as those defined in commonly used dictionaries, are to be interpreted as having meanings consistent with the meanings they have in the context of the relevant art, and are not to be interpreted in an idealized or overly formal sense unless expressly so defined herein.

Accordingly, configurations illustrated in the example embodiments and drawings are provided as examples only and do not reflect the technical sprit of the disclosure. Accordingly, there may be various equivalents and modifications to replace the configurations at the time of application of this disclosure.

It should be noted that if it is described in the specification that one part includes one component, it indicates that another component may be further included and not that another component is excluded, unless described otherwise. Also, terms "-module", "-er/or", "-system", etc., indicate a unit to process at least one function or operation, and may be configured through hardware or software or combination of hardware and software, and may be included in a single apparatus or each different apparatus.

Hereafter, a motion-based studio equipment control system 100 according to an example embodiment will be described. FIG. 1 is a diagram illustrating a configuration of the motion-based studio equipment control system 100 according to an example embodiment.

Referring to FIG. 1, the motion-based studio equipment control system 100 according to an example embodiment includes studio equipment 110, a studio equipment control module 120, a motion recognition module 130, a time interval definition module 140, a data storage module 150, a motion data comparison module 160, and a control data selection module 170. The studio equipment control module 120, the motion recognition module 130, the time interval definition module 140, the motion data comparison module 160, and the control data selection module 170 are implemented by one or more processors.

The respective components are functionally classified to explicitly describe an operation of the motion-based studio equipment control system 100 according to an example embodiment. Accordingly, instead of being classified into a physically distinct single component, each module may be configured as, for example, a set of computer instructions that constitute a portion of a program and a function of the corresponding module may be expressed by an arithmetic processing apparatus in response to an execution of the program.

Also, all of the components of the motion-based studio equipment control system 100 according to an example embodiment may be configured in a form of a program/application executed on a single information processing terminal, for example, a smartphone or a user computer. A portion of the components may be configured on a client terminal and another portion of the components may be configured in a form of a server-client service on a server computer that is connected to a client terminal over a communication network. Components may be distributively configured in each server of a distributive server system. Alternatively, components may be configured as a set of logic circuits that constitute a semiconductor processor.

The studio equipment 110 may include a first camera 111, a second camera 112, a lighting 113, and an audio console 114. The first camera 111 and the second camera 112 may be configured to be capable of controlling a focus, an angle of view, a shutter speed, and the like, by a remote control. Also, the first camera 111 and the second camera 112 may be mounted to a remotely controlled moving system and to be capable of performing a professional photographing technique without a field specialist in a studio. In this case, the moving system that moves a camera may be included in the studio equipment 110. The number of cameras is not limited to two cameras and three or more cameras may be used for further dynamic photographing. The lighting 113 may include a plurality of luminous bodies (or light emitting sources) and may be configured as a system capable of controlling brightness, colors, lighting time, locations, etc., of each luminous body by a remote control. The audio console 114 may be, for example, various types of audio recording devices, a mixer, an effector, a fader, and the like, and may include a communication module for a remote control.

The studio equipment control module 120 controls the studio equipment 110. A protocol commonly used in the art may be used for a control protocol between the studio equipment 110 and the studio equipment control module 120.

The motion recognition module 130 recognizes a motion of a performance object and generates recognized motion data (data_motion_recognized). The motion recognition module 130 may be a depth camera for acquiring three-dimensional (3D) information of an object. As an example of the depth camera, there are a stereo camera, Realsense camera of Intel Corporation, Kinect of Microsoft Corporation, and the like. However, the example of the depth camera is not limited thereto. The motion recognition module 130 may be configured with a simple two-dimensional (2D) camera according to a level (or degree) of motion recognition.

Depending on example embodiments, the motion recognition module 130 may be controlled to be activated during an optional time interval (time_optional) and to be inactivated during a fixed time interval (time_fixed), or may also be controlled to be activated across the entire time interval.

As shown in FIG. 11, the time interval definition module 140 defines a fixed time interval (time_fixed) in a total time interval (time_total) in which the performance object makes a performance. Also, the time interval definition module 140 defines an optional time interval (time_optional) in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval (time_fixed). Data representing the defined fixed time interval (time_fixed) and optional time interval (time_optional) is stored in the data storage module 150. The default performance motion may be a motion of the performance object that is designed in advance and preset in the optional time interval (time_optional). The optional performance motion, as a motion distinguished from the default performance motion and as a motion that the performance object is capable of optionally taking based on a preference of the performance object, enables the performance object to experience the production of further various video contents.

The data storage module 150 stores default performance motion data (data_motion_default) corresponding to the default performance motion that the performance object is capable of performing in the optional time interval (time_optional) and default control data (data_control_default) for controlling the studio equipment 110 according to the default performance motion. Also, the data storage module 150 stores optional performance motion data (data_motion_optional) corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval (time_optional) and optional control data (data_control_optional) distinguished from the default control data (data_control_default) and for controlling the studio equipment 110 according to the optional performance motion.

In the meantime, the data storage module 150 may be nonvolatile data storage medium that stores data, such as a hard driver, a flash memory, and a solid state drive (SSD), and may be a buffer memory that temporarily stores data, such as random access memory (RAM).

The performance motion may be, for example, a series of gestures or motions represented by the performance object using a body during the performance when the performance object is a person. The performance motion data may be, for example, a set of series data indicating a relative location between body parts by vectorizing the body parts of the person. In the other words, the system may express movement of each of the body parts using vectors as the set of series data. The default control data (data_control_default) may be, for example, a set of control instructions for integrally controlling the studio equipment 110, such as the first camera 111, the second camera 112, the lighting 113, and the audio console 114, and the like. Also, the default control data (data_control_default) may be a set of control instructions for controlling the camera moving systems for change position and angle of the first camera 111 or the second camera 112.

The motion data comparison module 160 compares recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) to default performance motion data (data_motion_default) and optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional).

When the motion data comparison module 160 determines that the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) and the default performance motion data (data_motion_default) substantially match, the control data selection module 170 controls the studio equipment control module 120 to control the studio equipment 110 using the default control data (data_control_default). Here, the expression 'substantially match' may indicate matching at a level, for example, 90% or more, at which a recognized motion and pre-stored motion data are distinguishable from each other. However, it is not limited thereto. Also, when the motion data comparison module 160 determines that the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) and the optional performance motion data (data_motion_optional) substantially match, the control data selection module 170 controls the studio equipment control module 120 to control the studio equipment 110 using the optional control data (data_control_optional).

Here, when the recognized motion data (data_motion_recognized) is determined to be different from all of the default performance motion data (data_motion_default) and the optional performance motion data (data_motion_optional) as a comparison result of the motion data comparison module 160, the control data selection module 170 may control the studio equipment control module 120 to control the studio equipment 110 using the default control data (data_control_default).

In the meantime, when the motion recognition module 130 becomes inactivated during the fixed time interval (time_fixed), the control data selection module 170 may control the studio equipment control module 120 to control the studio equipment 110 using fixed control data (data_control_fixed) that is pre-stored in the data storage module 150 during the fixed time interval (time_fixed).

Hereinafter, a first example embodiment will be described with reference to FIG. 2. The first example embodiment relates to an example embodiment capable of adaptively coping with various motions of the performance object by including n pieces of optional performance motion data and n pieces of optional control data. The motion-based studio equipment control system 100 includes the n pieces of optional performance motion data and the n pieces of optional control data and may produce video contents based on the n pieces of optional performance motion data and the n pieces of optional control data. To avoid a repeating description, a detailed description related to the same configuration of FIG. 1 is omitted here. FIG. 2 is a diagram illustrating a configuration of the motion-based studio equipment control system 100 according to the first example embodiment.

The data storage module 150 stores first optional performance motion data (data_motion_optional_1) to n-th optional performance motion data (data_motion_optional_n) corresponding to a first optional performance motion to an n-th optional performance motion, respectively, that the performance object is capable of performing in the optional time interval (time_optional). Also, the data storage module 150 stores first optional control data (data_control_optional_1) to n-th optional control data (data_control_optional_n) corresponding to the first optional performance motion to the n-th optional performance motion, respectively.

The motion data comparison module 160 compares the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) to the first optional performance motion data (data_motion_optional_1) to the n-th optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional), searches optional performance motion data substantially matching with the recognized motion data and controls the studio equipment control module 120 to control the studio equipment 110 using any one of the first optional control data (data_control_optional_1) to the n-th optional control data (data_control_optional_n) corresponding to the found optional performance motion data (data_control_optional).

According to the first example embodiment, the motion-based studio equipment control system 100 may produce video content by integrally controlling the studio equipment 110 through adaptively coping with n or more motions and thus, may produce the further high quality video content.

Hereinafter, a second example embodiment will be described with reference to FIG. 3. The second example embodiment relates to an example embodiment capable of adaptively coping with all of various motions of the performance object by further variously applying control data for controlling the studio equipment 110 in a following optional time interval (time_optional_follow) according to a selection of performance motion data in a precedent optional time interval (time_optional_precedent). To avoid a repeating description, a detailed description related to the same configuration of FIG. 1 is omitted here. FIG. 3 is a diagram illustrating a configuration of the motion-based studio equipment control system 100 according to the second example embodiment.

As shown in FIG. 12, the data storage module 150 stores data representing the precedent optional time interval (time_optional_precedent) and the following optional time interval (time_optional_follow) defined by the time interval definition module 140. Here, the time interval definition module 140 may define a single follow optional time interval and a plurality of follow optional time intervals, such as a first following optional time interval (time_optional_follow_1) to an n-th following optional time interval (time_optional_follow_n). Here, n denotes an integer greater than or equal to 2.

Also, the data storage module 150 stores precedent default performance motion data (data_motion_default_precedent) that is default performance motion data (data_motion_default) in the precedent optional time interval (time_optional_precedent), precedent default control data (data_control_default_precedent) that is default control data (data_control_default) in the precedent optional time interval (time_optional_precedent), first following default performance motion data (data_motion_default_follow_1) and second following default performance motion data (data_motion_default_follow_2) that are default performance motion data (data_motion_default) in the following optional time interval (time_optional_follow), and first following default control data (data_control_defalut_follow_1) and second following default control data (data_control_defalut_follow_2) that are default control data (data_control_default) in the following optional time interval (time_optional_follow).

Also, the data storage module 150 stores precedent optional performance motion data (data_motion_optional_precedent) that is optional performance motion data (data_motion_optional) in the precedent optional time interval (time_optional_precedent), precedent optional control data (data_control_optional_precedent) that is optional control data (data_control_optional) in the precedent optional time interval (time_optional_precedent), first following optional performance motion data (data_motion_optional_follow_1) and second following optional performance motion data (data_motion_optional_follow_2) that are optional performance motion data (data_motion_optional) in the following optional time interval (time_optional_follow), and first following optional control data (data_control_optional_follow_1) and second following optional control data (data_control_optional_follow_2) that are optional control data (data_control_optional) in the following optional time interval (time_optional_follow).

The motion recognition module 130 of the motion-based studio equipment control system 100 according to the second example embodiment generates precedent recognized motion data (data_motion_recognized_precedent) during the precedent optional time interval (time_optional_precedent) and generates following recognized motion data (data_motion_recognized_follow) during the following optional time interval (time_optional_follow).

The control data selection module 170 of the motion-based studio equipment control system 100 according to the second example embodiment controls the studio equipment control module 120 to control the studio equipment 110 using any one of the precedent default control data (data_control_default_precedent) or the precedent optional control data (data_control_optional_precedent) according to the precedent recognized motion data (data_motion_recognized_precedent). Also, in the case of controlling the studio equipment 110 using the precedent default control data (data_control_default_precedent) in the precedent optional time interval (time_optional_precedent), the control data selection module 170 controls the studio equipment control module 120 to control the studio equipment 110 using the first following default control data (data_control_defalut_follow_1) or the first following optional control data (data_control_optional_follow_1) according to the following recognized motion data (data_motion_recognized).

Also, in the case of controlling the studio equipment 110 using the precedent optional control data (data_motion_optional_precedent) in the precedent optional time interval (time_optional_precedent), the control data selection module 170 of the motion-based studio equipment control system 100 according to the second example embodiment controls the studio equipment control module 120 to control the studio equipment 110 using the second following default control data (data_control_default_follow_2) or the second following optional control data (data_control_optional_follow_2) according to the following recognized motion data (data_motion_recognized_follow).

According to the second example embodiment, the motion-based studio equipment control system 100 may produce video content adaptively diversified and optimized for a change in various series of motions of the performance object by changing a type of studio equipment control data in the following optional time interval (time_optional_follow) that follows the precedent optional time interval (time_optional_precedent) according to a motion of the performance object in the precedent optional time interval (time_optional_precedent).

FIG. 4 illustrates an example of the motion guide module 180 that guides a motion of a performance object in the motion-based studio equipment control system 100 according to the aforementioned example embodiment.

Referring to FIG. 4, the motion guide module 180 visualizes and thereby displays default performance motion data (data_motion_default) and optional performance motion data (data_motion_optional) as a default performance motion and an optional performance motion, respectively, during an optional time interval (time_optional).

Although not illustrated in FIG. 4, the motion guide module 180 may be configured to simultaneously guide performance motions corresponding to a precedent time interval and a following time interval based on a current optional time interval in terms of time series. In this case, the motion guide module 180 may be configured to guide a performance motion using an animation image instead of using a still image.

FIG. 5 illustrates an example of the motion guide module 180 that simulates and guides a motion of a performance object in the motion-based studio equipment control system 100 according to the aforementioned example embodiment.

Referring to FIG. 5, the motion guide module 180 simulates controlling the studio equipment 110 using the default control data (data_control_default) and the optional control data (data_control_optional) and applies a simulation result to visualization of the default performance motion and the optional performance motion. In other words, the motion guide module 180 simulates controlling the equipment 110 using the default control data (data_control_default) and the optional control data (data_control_optional) and creates image or video based on the simulate result. The image or the video represents motion which the user is going to take. The motion guide module 180 displays the image or the video for the user to watch. In the case of a simulated default performance motion (data_motion_default_simulated) shown on the left of FIG. 5, camera information, for example, wide angle-of-view information, zoom-in information, and camera rotation information, in the default control data (data_control_default) are applied to visualization of the simulated default performance motion. In the case of a simulated optional performance motion (data_motion_optional_simulated) shown on the right of FIG. 5, camera information, for example, wide angle-of-view information, zoom-out information, and camera information, and virtual stage information, for example, a background lighting, in the optional control data (data_control_selected) are applied to visualization of the simulated optional performance motion. The camera information and the virtual stage information applied in FIG. 5 are only examples. Various editing effects and special effects may be applied to the visualization.

Hereinafter, a third example embodiment will be described with reference to FIG. 6. FIG. 6 is a diagram illustrating a configuration of the motion-based studio equipment control system 100 according to the third example embodiment. A difference with the configuration of the motion-based studio equipment control system 100 of FIG. 1 lies in that the data storage module 150 of FIG. 6 does not store default performance motion data (data_motion_default) corresponding to a default performance motion that the performance object is capable of performing in the optional time interval (time_optional). Also, default control data (data_control_default) may be preset control data that does not correspond to the default performance motion data (data_motion_default).

The data storage module 150 stores default control data (data_control_default) for controlling the studio equipment 110 in the optional time interval (time_optional). Also, the data storage module 150 stores optional performance motion data (data_motion_optional) corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval (time_optional), and optional control data (data_control_optional) distinguished from the default control data (data_control_default) and for controlling the studio equipment 110 according to the optional performance motion.

The motion data comparison module 160 compares recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) to optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional).

When the motion data comparison module 160 determines that the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) is substantially different from the optional performance motion data (data_motion_optional), the control data selection module 170 controls the studio equipment control module 120 to control the studio equipment 110 using the default control data (data_control_default). Also, when the motion data comparison module 160 determines that the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) and the optional performance motion data (data_motion_optional) substantially match, the control data selection module 170 controls the studio equipment control module 120 to control the studio equipment 110 using the optional control data (data_control_optional).

<Motion-based studio equipment control method>

Hereinafter, a motion-based studio equipment control method according to an example embodiment will be described with reference to FIGS. 7 through 10.

FIG. 7 is a flowchart illustrating a motion-based studio equipment control method according to an example embodiment. Referring to FIG. 7, the studio equipment control system 100 performs first step s110 of defining a fixed time interval (time_fixed) in a total time interval (time_total) in which a performance object makes a performance and defining an optional time interval (time_optional) in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval (time_fixed). Although FIG. 11 illustrates a single fixed time interval (time_fixed) and a single optional time interval (time_optional) in the total time interval (time_total), a plurality of fixed time intervals (time_fixed) and a plurality of optional time intervals (time_optional) may be present in the total time interval.

Next, the studio equipment control system 100 performs second step s120 of storing default performance motion data (data_motion_default) corresponding to the default performance motion that the performance object is capable of performing in the optional time interval (time_optional) and default control data (data_control_default) for controlling the studio equipment 110 according to the default performance motion in the data storage module 150.

Also, the studio equipment control system 100 performs third step s130 of storing optional performance motion data (data_motion_optional) corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval (time_optional) and optional control data (data_control_optional) distinguished from the default control data (data_control_default) and for controlling the studio equipment 110 according to the optional performance motion in the data storage module 150.

Next, the studio equipment control system 100 performs a fourth step of determining whether a performance is started (s141), and, when the performance is determined to be started, starting control of the studio equipment 110 (s142).

Next, the studio equipment control system 100 performs fifth step s150 of controlling the motion recognition module 130 to generate recognized motion data (data_motion_recognized) by recognizing a motion of the performance object during the optional time interval (time_optional).

Finally, the studio equipment control system 100 performs a sixth step of controlling the studio equipment 110 using the default control data (data_control_default) (s162) when the recognized motion data (data_motion_recognized) recognized during the optional time interval (time_optional) and default performance motion data (data_motion_default) allocated to the optional time interval (time_optional) are determined to substantially match as a result of mutual comparison (s161), and also controlling the studio equipment 110 using the optional control data (data_control_optional) (s164) when the recognized motion data (data_motion_recognized) recognized during the optional time interval (time_optional) and the optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional) are determined to substantially match as a result of mutual comparison (s163). In other words, the studio equipment control system 100 controls the studio equipment 110 using the default control data when the recognized motion data is substantially same as the default performance motion data. Also, the studio equipment control system 100 controls the studio equipment 110 using the optional control data when the recognized motion data is substantially same as the optional performance motion data.

According to the aforementioned method, the studio equipment control system 100 may easily produce video content optimized for a performance motion of the performance object without a manipulation of the studio equipment 110 by a studio manpower (a person) by recognizing a motion of the performance object in the optional time interval (time_optional), by identifying the recognized motion of the performance object as a default performance motion or an optional performance motion, and by automatically controlling the studio equipment 110, such as the first camera 111, the second camera 112, the lighting 113, the audio console 114, and the like, to adaptively cope with the motion of the performance object.

In the meantime, the studio equipment control system 100 controls the studio equipment 110 using the default control data (data_control_default) (s165) when the recognized motion data (data_motion_recognized) recognized during the optional time interval (time_optional) is determined to be different from all of the default performance motion data (data_motion_default) and the optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional) as the results of mutual comparison. The studio equipment control system 100 may easily produce the video contents using at least the default control data even though the performance object does not perform a proper performance motion in the optional time interval (time_optional).

FIG. 8 is a flowchart illustrating a motion-based studio equipment control method according to the first example embodiment. Referring to FIG. 8, the studio equipment control system 100 stores first optional performance motion data (data_motion_optional_1) to n-th optional performance motion data (data_motion_optional_n) corresponding to a first optional performance motion to an n-th optional performance motion respectively, that the performance object is capable of performing in the optional time interval (time_optional), and first optional control data (data_control_optional_1) to n-th optional control data (data_control_optional_n) corresponding to the first optional performance motion to the n-th optional performance motion respectively, in the data storage module 150 (s131). Also, the studio equipment control system 100 compares the recognized motion data (data_motion_recognized) recognized by the motion recognition module 130 during the optional time interval (time_optional) to the first optional performance motion data (data_motion_optional_1) to the n-th optional performance motion data (data_motion_optional) allocated to the optional time interval (time_optional), searches optional performance motion data substantially matching with the recognized motion data and controls the studio equipment control module 120 to control the studio equipment 110 using any one of the first optional control data (data_control_optional_1) to the n-th optional control data (data_control_optional_n) corresponding to the found optional performance motion data (data_control_optional) (s167).

According to the aforementioned method, the studio equipment control system 100 may increase a probability capable of producing video content most optimized even for an impromptu motion of the performance object by pre-storing a plurality of pieces of optional performance motion data (data_motion_optional) and a plurality of pieces of optional control data (data_control_optional) in the same optional time interval (time_optional), and by comparing a motion of the performance object to the pre-stored plurality of pieces of optional performance motion data (data_motion_optional).

FIGS. 9 and 10 are flowcharts illustrating a motion-based studio equipment control method according to the second embodiment. Referring to FIG. 9, the studio equipment control system 100 defines a precedent optional time interval (time_optional_precedent) and a following optional time interval (time_optional_follow) (s111).

Next, the studio equipment control system 100 stores, in the data storage module 150, precedent default performance motion data (data_motion_default_precedent) that is default performance motion data (data_motion_default_precedent) in the precedent optional time interval (time_optional), precedent default control data (data_control_default_precedent) that is default control data (data_control_default) in the precedent optional time interval (time_optional_precedent), first following default performance motion data (data_motion_default_follow_1) and second following default performance motion data (data_motion_default_follow_2) that are default performance motion data (data_motion_default) in the following optional time interval (time_optional_follow), and first following default control data (data_control_default_follow_1) and second following default performance motion data (data_motion_default_follow_2) that are default control data (data_control_default) in the following optional time interval (time_optional_follow) (s121).

Next, the studio equipment control system 100 stores, in the in the data storage module 150, precedent optional performance motion data (data_motion_optional_precedent) that is optional performance motion data (data_motion_optional) in the precedent optional time interval (time_optional_precedent) and precedent optional control data (data_control_optional_precedent) that is optional control data (data_control_optional) in the precedent optional time interval (time_optional_precedent), and also stores first following optional performance motion data (data_motion_optional_follow_1) and second following optional performance motion data (data_motion_optional_follow_2) that are optional performance motion data (data_motion_optional) in the following optional time interval (time_optional_follow) and first following optional control data (data_control_optional_follow_1) and second following optional control data (data_control_optional_follow_2) that are optional control data (data_control_optional) in the following optional time interval (time_optional_follow) (s132).

Next, the studio equipment control system 100 controls the motion recognition module 130 to generate precedent recognized motion data (data_motion_recognized_precedent) during the precedent optional time interval (time_optional_precedent) (s151).

Next, the studio equipment control system 100 compares the recognized motion data (data_motion_recognized) and default performance motion data (data_motion_default), and determines that the recognized motion data (data_motion_recognized) and default performance motion data (data_motion_default_precedent) substantially match based on a result of mutual comparison (s161-1).

Next, the studio equipment control system 100 compares the recognized motion data (data_motion_recognized) and the precedent optional performance motion data (data_motion_optional_precedent), and determines that the recognized motion data (data_motion_recognized) and the precedent optional performance motion data (data_motion_optional_precedent), substantially match based on a result of mutual comparison (s163-1).

Next, the studio equipment control system 100 controls the studio equipment 110 using any one of the precedent default control data (data_control_default_precedent) or the precedent optional control data (data_control_optional_precedent) according to the precedent recognized motion data (data_motion_recognized_precedent) (s162-1, s164-1, s165-1).

Next, the studio equipment control system 100 controls the motion recognition module 130 to generate following recognized motion data (data_motion_recognized_follow) during the following optional time interval (time_optional_follow) (s170).

Next, in the case of controlling the studio equipment 110 using the precedent default control data (data_control_default_precedent) in the precedent optional time interval (time_optional_precedent), the studio equipment control system 100 controls the studio equipment 110 using the first following default control data (data_control_default_follow_1) or the first following optional control data (data_control_optional_follow_1) according to the following recognized motion data (data_motion_recognized_follow) (s181, s182).

The aforementioned steps relate to the motion-based studio equipment control method in the precedent optional time interval (time_optional_precedent) and are substantially same as the aforementioned example embodiment.

Here, in the case of controlling the studio equipment 110 using the precedent optional control data (data_control_optional_precedent) in the precedent optional time interval (time_optional_precedent), the studio equipment control system 100 controls the studio equipment 110 using the second following default control data (data_control_default_follow_2) or the second following optional control data (data_control_optional_follow_2) according to the following recognized motion data (data_motion_recognized_follow) (s191, s192).

The studio equipment control system 100 controls the studio equipment 110 using the first following default control data (data_control_default_follow_1) (s193).

According to the aforementioned method, the studio equipment control system 100 may produce video content further diversified and optimized for a change in various series of motions of the performance object by changing a type of studio equipment control data in the following optional time interval (time_optional_follow) that follows the precedent optional time interval (time_optional_precedent) according to a motion of the performance object in the precedent optional time interval (time_optional_precedent).

Although not illustrated, the studio equipment control system 100 further stores fixed control data (data_control_fixed) for controlling the studio equipment 110 in a fixed time interval (time_fixed) in the data storage module 150. Here, the studio equipment control system 100 controls the studio equipment 110 using the fixed control data (data_control_fixed) during the fixed time interval (time_fixed). Also, the studio equipment control system 100 may inactivate the motion recognition module 130 during the fixed time interval (time_fixed). Through this, the studio equipment control system 100 may relieve burden that the performance object is to select and perform a performance motion every time and the performance object has a time for preparation when a subsequent performance motion is an optional performance motion. Even in this case, the studio equipment control system 100 may continuously produce video content using the fixed control data (data_control_fixed) irrelevant to the performance motion of the performance object.

As shown in FIGS. 4 and 5, the motion-based studio equipment control method according to the example embodiment may visually guide a performance motion that the performance object is capable of taking in the optional time interval (time_optional).

For example, the studio equipment control system 100 controls the motion guide module 180 to visualize and thereby display the default performance motion data (data_motion_default) and the optional performance motion data (data_motion_optional) as the default performance motion and the optional performance motion, respectively, during the optional time interval (time_optional).

The studio equipment control system 100 may control the motion guide module 180 to simulate controlling the studio equipment 110 using the default control data (data_control_default) and the optional control data (data_control_optional) and to apply a simulation result to visualization of the default performance motion and the optional performance motion, so that the performance object may verify a result to be generated during a performance through a studio control.

According to the aforementioned method, the studio equipment control system 100 may enhance the quality of video content by visualizing and thereby displaying the default performance motion and the optional performance motion that the performance object is capable of taking in the optional time interval (time_optional) through the motion guide module 180, such as a display and the like, and by guiding the performance object to take any one of preset motions opportunely in the middle of a performance.

Also, the studio equipment control system 100 enables the performance object to verify in advance a production result of video content according to a performance motion by simulating controlling the studio equipment 110 according to the default performance motion or the optional performance motion that the performance object is capable of taking in the optional time interval (time_optional) and providing a simulation result to the performance object through the motion guide module 180.

A number of example embodiments have been described above. Nevertheless, it should be understood that various modifications may be made to these example embodiments. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents. Accordingly, other implementations are within the scope of the following claims.

Claims

A method for controlling studio equipment based on a motion, the method comprising:

a first step of defining, by a studio equipment control system, a fixed time interval in a total time interval in which a performance object makes a performance, and defining an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval;

a second step of storing, by the studio equipment control system, default performance motion data corresponding to the default performance motion that the performance object is capable of performing in the optional time interval and default control data for controlling the studio equipment according to the default performance motion in a data storage module;

a third step of storing, by the studio equipment control system, an optional performance motion data and an optional control data in the data storage module, wherein the optional performance motion data corresponds to the optional performance motion that the performance object is capable of performing in the optional time interval, wherein the optional control data distinguished from the default control data and is for controlling the studio equipment according to the optional performance motion;

a fourth step of starting, by the studio equipment control system, control of the studio equipment in response to a start of a performance;

a fifth step of controlling, by the studio equipment control system, a motion recognition module to recognize a motion of the performance object during the optional time interval and to generate recognized motion data; and

a sixth step of controlling, by the studio equipment control system, the studio equipment using the default control data when the recognized motion data recognized during the optional time interval and the default performance motion data allocated to the optional time interval are determined to substantially match as a result of mutual comparison, and controlling the studio equipment using the optional control data when the recognized motion data recognized during the optional time interval and the optional performance motion data allocated to the optional time interval are determined to substantially match as a result of mutual comparison.
The method of claim 1, wherein, in the sixth step, the studio equipment control system controls the studio equipment using the default control data when the recognized motion data recognized during the optional time interval is determined to be different from all of the default performance motion data and the optional performance motion data allocated to the optional time interval.
The method of claim 1, wherein, in the third step, the studio equipment control system stores, in the data storage module, first optional performance motion data to n-th optional performance motion data corresponding to first optional performance motion to n-th optional performance motion that the performance object is capable of performing in the optional time interval and first optional control data to n-th optional control data corresponding to the first optional performance motion to the n-th optional performance motion, respectively,

in the sixth step, the studio equipment control system compares the recognized motion data recognized in the optional time interval to the first optional performance motion data to the n-th optional performance data allocated to the optional time interval, searches optional performance motion data among the first optional performance motion data to the n-th optional performance data substantially matching with the recognized motion data and controls the studio equipment using any one of the first optional control data to the n-th optional control data corresponding to the found optional performance motion data.
The method of claim 1, wherein, in the first step, the studio equipment control system defines a precedent optional time interval and a following optional time interval,

in the second step, the studio equipment control system stores, in the data storage module, precedent default performance motion data that is the default performance motion data in the precedent optional time interval, precedent default control data that is the default control data in the precedent optional time interval, first following default performance motion data and second following default performance motion data that are the default performance motion data in the following optional time interval, and first following default control data and second following default control data that are the default control data in the following optional time interval,

in the third step, the studio equipment control system stores, in the data storage module, precedent optional performance motion data that is the optional performance motion data in the precedent optional time interval, precedent optional control data that is the optional control data in the precedent optional time interval, first following optional performance motion data and second following optional performance motion data that are the optional performance motion data in the following optional time interval, and first following optional control data and second following optional control data that are the optional control data in the following optional time interval,

in the fifth step, the studio equipment control system controls the motion recognition module to generate precedent recognized motion data during the precedent optional time interval, and

in the sixth step, the studio equipment control system controls the studio equipment using any one of the precedent default control data or the precedent optional control data according to the precedent recognized motion data, and

the motion-based studio equipment control method further comprises:

a seventh step of controlling, by the studio equipment control system, the motion recognition module to generate following recognized motion data during the following optional time interval;

an eighth step of controlling, by the studio equipment control system, the studio equipment using any one of the first following default control data or the first following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent default control data in the precedent optional time interval; and

a ninth step of controlling, by the studio equipment control system, the studio equipment using any one of the second following default control data or the second following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent optional control data in the precedent optional time interval.
The method of claim 1, wherein, in the second step, the studio equipment control system further stores fixed control data for controlling the studio equipment in the fixed time interval in the data storage module, and

the motion-based studio equipment control method further comprises:

a tenth step of controlling, by the studio equipment control system, the studio equipment using the fixed control data during the fixed time interval after the fourth step.
The method of claim 5, further comprising:

an eleventh step of controlling, by the studio equipment control system, the motion recognition module to be inactivated during the fixed time interval after the fourth step.
The method according to any one of claims 1 to 5, further comprising:

a twelfth step of controlling, by the studio equipment control system, a motion guide module to visualize and thereby display the default performance motion data and the optional performance motion data as the default performance motion and the optional performance motion, respectively, during the optional time interval.
The method of claim 7, wherein, in the twelfth step, the studio equipment control system controls the motion guide module to simulate controlling the studio equipment using the default control data and the optional control data, and to apply a simulation result to visualization of the default performance motion and the optional performance motion.
A system for controlling studio equipment based on a motion, the system comprising:

a plurality of studio equipment;

a studio equipment control module configured to control the studio equipment;

a motion recognition module configured to recognize a motion of a performance object and to generate recognized motion data;

a time interval definition module configured to define a fixed time interval in a total time interval in which the performance object makes a performance, and to define an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval;

a data storage module configured to store default performance motion data corresponding to the default performance motion that the performance object is capable of performing in the optional time interval and default control data for controlling the studio equipment according to the default performance motion, and to store an optional performance motion data corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval and an optional control data distinguished from the default control data and for controlling the studio equipment according to the optional performance motion;

a motion data comparison module configured to compare the recognized motion data recognized during the optional time interval to the default performance motion data and the optional performance motion data allocated to the optional time interval; and

a control data selection module configured to control the studio equipment control module to control the studio equipment using the default control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the default performance motion data substantially match, and to control the studio equipment control module to control the studio equipment using the optional control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the optional performance motion data substantially match.
The system of claim 9, wherein the control data selection module controls the studio equipment control module to control the studio equipment using the default control data when the recognized motion data is determined to be different from all of the default performance motion data and the optional performance motion data as a comparison result of the motion data comparison module.
The system of claim 9, wherein the data storage module stores first optional performance motion data to n-th optional performance motion data corresponding to first optional performance motion to n-th optional performance motion that the performance object is capable of performing in the optional time interval and first optional control data to n-th optional control data corresponding to the first optional performance motion to the n-th optional performance motion, respectively,

wherein the studio equipment control system compares the recognized motion data recognized in the optional time interval to the first optional performance motion data to the n-th optional performance data allocated to the optional time interval, searches optional performance motion data among the first optional performance motion data to the n-th optional performance data substantially matching with the recognized motion data and controls the studio equipment using any one of the first optional control data to the n-th optional control data corresponding to the found optional performance motion data.
The system of claim 9, wherein the time interval definition module defines a precedent optional time interval and a following optional time interval,

the data storage module stores precedent default performance motion data that is the default performance motion data in the precedent optional time interval, precedent default control data that is the default control data in the precedent optional time interval, first following default performance motion data and second following default performance motion data that are the default performance motion data in the following optional time interval, and first following default control data and second following default control data that are the default control data in the following optional time interval, and stores precedent optional performance motion data that is the optional performance motion data in the precedent optional time interval, precedent optional control data that is the optional control data in the precedent optional time interval, first following optional performance motion data and second following optional performance motion data that are the optional performance motion data in the following optional time interval, and first following optional control data and second following optional control data that are the optional control data in the following optional time interval, and

the motion recognition module generates precedent recognized motion data during the precedent optional time interval and generates following recognized motion data during the following optional time interval, and

the control data selection module controls the studio equipment control module to control the studio equipment using any one of the precedent default control data or the precedent optional control data according to the precedent recognized motion data, controls the studio equipment control module to control the studio equipment using any one of the first following default control data or the first following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent default control data in the precedent optional time interval, and controls the studio equipment control module to control the studio equipment using any one of the second following default control data or the second following optional control data according to the following recognized motion data in the case of controlling the studio equipment using the precedent optional control data in the precedent optional time interval.
The system of claim 9, wherein the data storage module further stores fixed control data for controlling the studio equipment in the fixed time interval, and

the control data selection module controls the studio equipment control module to control the studio equipment using the fixed control data during the fixed time interval.
The system of claim 13, wherein the motion recognition module is inactivated during the fixed time interval.
The system according to any one of claims 9 to 13, further comprising:

a motion guide module configured to visualize and thereby display the default performance motion data and the optional performance motion data as the default performance motion and the first optional performance motion, respectively, during the optional time interval.
The system of claim 15, wherein the motion guide module simulates controlling the studio equipment using the default control data and the optional control data, and applies a simulation result to visualization of the default performance motion and the optional performance motion.
A system for controlling studio equipment based on a motion, the system comprising:

a plurality of studio equipment;

a studio equipment control module configured to control the studio equipment;

a motion recognition module configured to recognize a motion of a performance object and to generate recognized motion data;

a time interval definition module configured to define a fixed time interval in a total time interval in which the performance object makes a performance, and to define an optional time interval in which the performance object is capable of optionally performing a default performance motion and an optional performance motion distinguished from the default performance motion in a time interval excluding the fixed time interval;

a data storage module configured to store default control data for controlling the studio equipment in the optional time interval, and to store optional performance motion data corresponding to the optional performance motion that the performance object is capable of performing in the optional time interval and optional control data distinguished from the default control data and for controlling the studio equipment according to the optional performance motion;

a motion data comparison module configured to compare the recognized motion data recognized during the optional time interval to the optional performance motion data allocated to the optional time interval; and

a control data selection module configured to control the studio equipment control module to control the studio equipment using the default control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval is substantially different from the optional performance motion data, and controls the studio equipment control module to control the studio equipment using the optional control data when the motion data comparison module determines that the recognized motion data recognized during the optional time interval and the optional performance motion data substantially match.