KR20170129274A - Method and system for performing performance output and performance content generation - Google Patents

Method and system for performing performance output and performance content generation Download PDF

Info

Publication number
KR20170129274A
KR20170129274A KR1020177032726A KR20177032726A KR20170129274A KR 20170129274 A KR20170129274 A KR 20170129274A KR 1020177032726 A KR1020177032726 A KR 1020177032726A KR 20177032726 A KR20177032726 A KR 20177032726A KR 20170129274 A KR20170129274 A KR 20170129274A
Authority
KR
South Korea
Prior art keywords
performance
module
content
sound
spectator
Prior art date
Application number
KR1020177032726A
Other languages
Korean (ko)
Other versions
KR102013054B1 (en
Inventor
천솔지
Original Assignee
(주)잼투고
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)잼투고 filed Critical (주)잼투고
Publication of KR20170129274A publication Critical patent/KR20170129274A/en
Application granted granted Critical
Publication of KR102013054B1 publication Critical patent/KR102013054B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • H04N21/274Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743Video hosting of uploaded data from client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/802Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving processing of the sound signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/091Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

The present invention relates to a method and a system for outputting performance and generating performance contents, and more particularly, to a system in which an on-site spectator can enjoy a performance output from a performance room by outputting a transparent member of a performance room and a performance sound signal And to a method and system for performance output and performance content generation capable of simultaneously generating high-quality performance content.

Description

Method and system for performing performance output and performance content generation

The present invention relates to a method and a system for outputting performance and generating performance contents, and more particularly, to a system in which an on-site spectator can enjoy a performance output from a performance room by outputting a transparent member of a performance room and a performance sound signal And to a method and system for performance output and performance content generation capable of simultaneously generating high-quality performance content.

In a traditional karaoke room with a half-length karaoke called the karaoke in Japan and the karaoke in Korea, people can sing and pay in a separate and enclosed space or space.

These karaoke rooms have been developed by combining various types of techniques to satisfy various users' needs. In particular, because the user wanted to record sound and video from his or her song, the half-clock additionally provided a storage medium such as a CD and a USB memory to provide sound and video to the user.

In particular, recently, the image and sound of the user's song are not stored on the storage medium, but the signal generated in the song accompaniment facility is directly uploaded to e-mail, Social Network Service (SNS), or a specific website. In addition, it provides a public studio that can produce sound and video by using a professional music player.

US Patent Publication No. US20050097613, which is a public studio proposed in the prior art, discloses a technique in which performances such as singing and dancing performed by a user (performer) using a studio in a studio are recorded and transmitted to a main server of a studio, It is being made available to the public by the Internet via a server.

U.S. Patent Publication No. US20050097613 is for producing contents such as songs in a studio. By transmitting the produced contents on-line, the contents can be disclosed only to the public. Therefore, in the prior patent documents, the real-time performances performed in the studio can not be accessed by the field viewers, and the performance can be displayed only through the generated contents.

The studio for contents production disclosed in the prior patent document can not make a bidirectional communication with a performer and an audience through a live performance in which a performance of a performer can be directly seen.

The problems presented in the prior patent documents can be solved through live performances. For example, the performances of songs, the plays and the like can be disclosed to the audience in an open place (for example, an open studio, a theater, etc.) where audiences are gathered, and these performances can be photographed and recorded to produce contents.

US Patent Publication No. US20080201276 can solve the disadvantage of US20050097613. US Patent Publication No. US20080201276 includes a studio section, a video casting stage, an internet communication center and a cafe in the campus. The campus is a single building, and in particular, the videocast stage is open in the cafe, where live performances or recorded performances performed on the videocast stage can be provided to the audience of the cafe.

US Patent Publication No. US20080201276 can solve the problem disclosed in US20050097613 when a video cast stage opened in a cafe is used. However, since a performance performed in a public space is produced as contents, high-quality contents It may not be generated. That is, noises and undesirable sounds produced in the public place can be included in the recording.

As a result, the voice and sound effects generated by the performers in the cafe during the production of the contents can be combined with the undesirable sounds and noise such as the conversation or the talk of the customers and the audience in the cafe. Contents are recorded together with the sound of the user performing the performance and the sound effect performed in the performance, as well as the cries of the guests of the cafe and the cries of the cafe audiences. Content with such noise, noise, and undesirable sound makes the customer feel uncomfortable and negative.

Throughout this specification, a number of patents and publications are referenced and their citations are indicated in parentheses. The disclosures of these patents and publications are hereby incorporated by reference in their entirety to more clearly illustrate the present invention and the level of skill in which the invention pertains.

Patent Document 1 (US Publication No. US20050097613, May 05, 2005) Patent Document 2 (U.S. Publication No. 20080201276, Aug. 21, 2008)

In order to solve the problems of the related art as described above, the present inventors have developed a new processing method for generating a performance performed in a performance room as a performance content while providing performance to a field visitor located at a performance room.

According to the present invention, when a performance performed in a performance room in which an on-site spectator can view is generated as performance contents, external sound from the on-site spectator is prevented from flowing into the performance room, Further, the performance is provided to the field viewers through the transparent member installed on at least one side of the performance room, thereby realizing the real-time performance more vividly to the field viewers.

Accordingly, an object of the present invention is to provide a method for outputting performances of performers performed in a performance room to the outside of a performance room in real time, and generating performance contents according to the performance.

Another object of the present invention is to provide a system for outputting performance of a performer in a performance room to the outside of a performance room in real time and generating performance content according to performance.

Other objects and advantages of the present invention will become apparent from the appended claims and drawings and the detailed description of the invention.

According to an embodiment of the present invention, there is provided a method for real-time output of performances of performers performed in a performance room outside the performance room, including the following steps, and generating performance-based performance contents: (a) Controlling an acoustic input module provided in the performance room to convert a performance sound generated according to performance within the performance room into an electrical signal to generate a performance acoustic signal; Wherein the performance room comprises soundproofing means for shielding external noise and at least one transparent member arranged on one side to show the performance to the field spectator; (b) the performance room control unit transmits the performance sound signal to the sound signal output module, and outputs the performance sound signal to the on-site spectator visually viewing the performance from the outside of the performance room through the transparent member Controlling the acoustic signal output module provided outside the performance room; (c) the performance room control unit transmitting the performance sound signal generated by the sound input module to the content generation unit; And (d) the content generation unit generates the performance content including the sound content data added to the performance sound signal.

According to an embodiment of the present invention, in the step (b), the performance sound signal output from the sound signal output module is added with a preset sound effect in real time.

According to an embodiment, in the step (d), the content generation unit may generate the performance content further including an on-scene spectator sound signal obtained by converting sound generated from the on-site spectator into an electrical signal; And the field spectator sound signal is generated in the field sound input module under the control of the performance room controller.

According to an embodiment, after the step (b) or (d), the method may further include the step of using an on-site spectator evaluation result of at least one of the performance or the performance sound signal And providing a performance evaluation result, wherein the on-scene visitor evaluation result is input to the evaluation module by the terminal of the on-scene spectator.

According to an embodiment, after the step (d), the method further includes the step of the evaluation module providing a content evaluation result using the online spectator evaluation result on the performance content, wherein the online spectator evaluation result is And is input to the evaluation module by the terminal of the online spectator.

According to one embodiment, in the step (a), the performance room control unit controls an image input module provided in the performance room to convert a scene generated from the performance into an electrical signal to generate a performance image signal, In the step (c), the performance room control unit transmits the performance video signal generated by the video input module to the content generation unit.

According to an embodiment of the present invention, in the step (d), the content generation unit may generate the performance content further including image content data in which a preset video effect is added to the performance video signal.

According to one embodiment, in the step (b), the performance room control unit transmits the performance video signal to a video signal output module provided outside the performance room, and transmits the performance video signal to the performance room, And controls the video signal output module to output the video signal to a field visitor in real time.

According to an embodiment of the present invention, in the step (b), the performance image signal is added in real time and output from the video signal output module.

According to an embodiment, in the step (d), the content generation unit may generate the performance content further including a scene-viewer image signal obtained by converting a scene generated from the scene-viewer into an electrical signal; And the field view image signal is generated in the field image input module under the control of the performance room controller.

According to an embodiment, after the step (b) or (d), the method may further include the step of the evaluation module providing an evaluation result using the field spectator evaluation result on the performance video signal Further include; And the on-scene spectator evaluation result is input to the evaluation module by the terminal of the on-scene spectator.

According to an embodiment, after the step (d), the method may further include the step of the evaluation module providing a result of content evaluation using an online spectator evaluation result on the performance content; And the online spectator evaluation result is input to the evaluation module by the terminal of the online spectator.

According to one embodiment, the performance room control unit controls the transparency adjusting module to adjust transparency of the transparent member or to block part or all of the transparent member according to the evaluation result.

According to one embodiment, the performance room control unit may control the output strength of the sound signal output module or the video signal output module in response to the evaluation result, And an output module.

According to an embodiment of the present invention, there is provided a system for real-time output of performance of a performer performed in a performance room including: a system for generating performance-based performance based on the performance outside of the performance room; And a transparent member installed on at least one side of the performance room to show the performance to the spectator outside the performance room; An acoustic input module for converting a performance sound generated from the performance of the performance room into an electrical signal to generate a performance acoustic signal; A sound signal output module provided outside the performance room and outputting the performance sound signal to an on-site spectator who watches the performance through the transparent member of the performance room in real time; A performance room controller for controlling the sound input module and the sound signal output module; And a content generating unit for generating performance content including the generated sound content data by adding a predetermined sound effect to the performance sound signal.

According to an embodiment of the present invention, the performance sound signal output from the sound signal output module is added with a preset sound effect in real time.

According to an embodiment of the present invention, the system further comprises a sound effect module for generating the predetermined sound effect by adding the preset sound effect to the performance sound signal in real time.

According to an embodiment, the content generation unit may generate the performance content further including an on-scene spectator sound signal obtained by converting sound generated from the on-site spectator into an electrical signal; And the field spectator sound signal is generated in the field sound input module under the control of the performance room controller.

According to one embodiment, the system may provide a performance evaluation result using an on-site spectator evaluation result of at least one of the performance and the performance sound signal to be viewed or use an online spectator evaluation result of the performance content And an evaluation module for providing a content evaluation result, wherein the on-scene visitor evaluation result is input to the evaluation module by the terminal of the on-scene visitor, and the on-line viewer evaluation result is transmitted to the evaluation module Is input.

According to an embodiment of the present invention, the system further includes an image input module for generating a performance image signal obtained by converting a scene generated from the performance into an electrical signal.

According to an embodiment, the content generation unit may generate the performance content further including image content data to which a predetermined image effect is added to the performance image signal.

According to an embodiment, the system may further include a video signal output module provided outside the performance room for outputting a performance video signal to the field person in real time, wherein the performance video signal is provided to the performance video signal And a preset video effect is added in real time and output by the video signal output module.

According to an embodiment, the system may further include a video effect module for generating the predetermined video effect added to the performance video signal.

According to an embodiment, the content generation unit may generate the performance content further including a scene-viewer image signal obtained by converting a scene generated from the scene-viewer into an electrical signal; And the scene viewer image signal is generated in the scene image input module under the control of the performance room controller.

According to one embodiment, the system further comprises an evaluation module for providing a performance evaluation result using an on-scene viewer evaluation result for the performance video signal, wherein the on-scene viewer evaluation result is transmitted from a terminal of the on- Is input to the control unit.

According to an embodiment, the system may further include an evaluation module for providing a content evaluation result using the online spectator evaluation result of the performance content, wherein the online spectator evaluation result is transmitted by the terminal of the online spectator to the evaluation module Is input to the control unit.

According to one embodiment, the system may further include a transparency adjustment module for adjusting the transparency of the transparent member according to the control of the performance room control unit or blocking a part or all of the transparent member in accordance with the evaluation result .

According to one embodiment of the present invention, at least one of the sound signal output module or the video signal output module is provided to adjust the output intensity of the sound signal output module or the video signal output module, Or more.

According to one embodiment, the system further includes a web service unit for providing the performance content generated by the content generation unit to a user, wherein the web service unit includes: a content publishing module for posting the performance content on-line; And a website module for providing the posted performance content to a terminal of an online spectator.

FIG. 1 is an exemplary diagram showing performance of a performer in a performance room according to the present invention, FIG.
FIG. 2 is an exemplary view for outputting a performance sound / video signal and a performance to an on-site spectator according to the present invention,
FIG. 3 is an exemplary view for outputting contents to an online spectator according to the present invention,
FIG. 4 is an exemplary diagram showing output and evaluation of performance and performance contents according to the present invention,
5 is a diagram illustrating a system for outputting performance and generating content according to the present invention.
6 is a flow chart showing the output of performance and generation of performance content according to an embodiment of the present invention;
FIG. 7 is a flowchart showing a performance evaluation by an on-site spectator according to an embodiment of the present invention;
8 is a flowchart illustrating content evaluation by an online spectator according to an embodiment of the present invention.

The terms and words used in the description and the claims should not be construed to be limited to ordinary or dictionary meanings and the inventor should properly interpret the concepts of the terms in order to describe their invention in the best way. It should be interpreted in accordance with the meaning and concept consistent with the technical idea of the present invention based on the principle that it can be defined.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

In addition, when an element is referred to as being " comprising " any element throughout the specification, it does not exclude other elements unless specifically stated to the contrary. Also, the terms "means," "part," "module," "server," "system," and the like denote units that process at least one function or operation , Which may be embodied in hardware or software or a combination of hardware and software, and may be included in one system or in a different system.

As used herein, the singular forms are intended to include the plural forms unless the context clearly dictates otherwise.

Hereinafter, preferred embodiments of the present invention will be described in detail.

FIG. 1 is an exemplary diagram showing performance of a performer in a performance room according to the present invention. FIG. The performance room 110 is located where the on-site spectator B exists and includes a transparent member 114 made of a transparent material having at least one surface for outputting the performance to the on-site spectator B, (Not shown).

In addition, a video input module 111 for converting a scene generated according to performance within the performance room 110 into an electrical signal to generate a performance video signal, and a performance sound signal generated by converting the performance sound generated from the performance into an electrical signal, And a sound input module 112 for generating sound.

As used herein, the term " field spectator " refers to an audience located outside the performance room and viewing real-time performance.

The performances performed by the performers A in the performance room 110 can be output to the audience B using the performance room 110 and the performance can be generated as the performance content . In addition, it is possible to block external noises (noise of the field viewers, etc.), and thereby produce high-quality performance contents without the field noise.

The performer A is made up of at least one person who is located inside the performance room 110 and performs the performance and the performance performed by the performer A is a song, a performance, a smoke, a gag, a magic performance, A martial arts performance, a chorus, a dance, and the like.

The performer A performs the performance in the performance room 110 to perform the performance more effectively through the sympathy with the on-site spectator B located outside the performance room 110 . The field spectator B can output a performance sound signal and a performance image signal obtained by converting the performance sound and performance image generated through the performance of the performer A into an electrical signal to the outside of the performance room 110 and enjoy it. In addition, the on-site spectator B can actually see the performance inside the performance room 110 through the transparent member 114. [

The on-site spectator B can view the performance progressed through the transparent member 114 of the performance room 110 and can view the performance sound generated through the performance through the sound signal output module 132.

The transparent member 114 is installed on at least one side of the performance room 110 in such a size that the sighted person B can easily view performance of the performer A. [

The acoustic signal output module 132 of the field output unit 130 outputs a performance acoustic signal obtained by converting the performance sound of the performer A into an electrical signal and outputs audio data such as performance background music, .

As used herein, the term " field output " refers to an output for field viewers. The field outputs may be located inside or outside the performance room.

 The sound input module 112 includes a device such as a microphone for receiving the performance sound of the performer A. [ The acoustic signal output module 132 includes devices such as a speaker and a headphone for outputting a performance acoustic signal obtained by converting the performance sound inputted to the acoustic input module 112 into an electrical signal.

The performance content generation is performed by the content generation unit 150 using the performance image and the performance sound input according to the performance performed by the performer A in the performance room 110. [ At this time, the image recording is performed through the image input module 111, and the sound recording can be performed through the sound input module 112.

In the performance room 110, an entrance door 116 through which the performer A can enter and exit is located on one side.

FIG. 2 is an exemplary diagram for outputting a performance sound / video signal and a performance to an on-site spectator according to the present invention and showing a performance evaluation thereof. When the performer A performs a performance in the performance room 110, the sound input module 112 and the image input module 111 generate a performance sound signal and a performance image signal from the performance, And outputs the performance sound signal and the performance image signal to the outside of the real-time performance room 110 according to the control. At this time, the on-site spectator B can view the real-time performance seen through the transparent member 114.

That is, the field person B can view the performance image signal and / or the performance sound signal output from the image signal output module 131 and / or the sound signal output module 132, 114), you can enter a performance evaluation of the performance.

The performance evaluation may be input directly or indirectly to the evaluation module 163 using a local terminal 230 or a terminal 210 of a field visitor B who can input information.

That is, the performance evaluation input by the field person B can be inputted in a local manner not connected to the Internet or in an online manner connected to the Internet. The local method or the online method may be input through a terminal using various communication means.

For example, the field person B can input a performance evaluation using a mobile device such as a smart phone, a smart pad, or the like.

Optionally, the field person B can directly input the performance evaluation to the evaluation module 163 using the keyboard.

The performance evaluation inputted from the terminal 210 of the on-line spectator B on the on-line system is recorded in the website module 162 via the Internet and then transmitted to the evaluation module 163 so that the input of the performance evaluation can be completed have.

The evaluation module 163 then compiles the performance evaluation recorded in the website module 162 via the terminal 210 of the local terminal 230 or the field visitor B to provide a performance evaluation result. The provided performance evaluation result is applied to the performance contest so that the performance can be selected.

FIG. 3 is an exemplary diagram for outputting a performance to an online spectator according to the present invention, and showing a content evaluation thereof. When the performer A performs a performance in the performance room 110, the video input module 111 and the sound input module 112 perform a performance scene and sound by performing a video recording and a sound recording to perform a performance video signal and a performance sound Signal.

The content generation unit 150 generates the performance content using at least one of the generated performance video signal and the performance sound signal.

The performance content generated by the content generation unit 150 is released to the online or the like by the content distribution module 154. The performance contents posted on the website module 162 outside the performance room 110 can be viewed by the online spectator C. [

Performance contents can be released using various media such as online or broadcasting.

At this time, the content distribution module 154 transmits the performance content to the content publishing module 161 of the web service unit 160. The content publishing module 161 causes the web site module 162 to publish the received performance content.

The web site module 162 may be configured to allow the online viewer C to access the terminal 220 in a computer environment such as a PC and may be connected to an online viewer The mobile terminal 220 of the mobile terminal C can be connected. The terminal 220 of the online spectator C may be connected to the website module 162 via a web browser or an installed application to view the performance content.

The method for the online spectator C to reproduce the performance content through the terminal 220 includes a method of downloading and playing the performance content to the terminal 220 of the online spectator C, Or a method of streaming playback through a player installed in the terminal 220, and the like. The content distribution module 154 may select at least one of the above methods to provide the performance content through the website module 162.

The online spectator C who reproduces the performance content posted on the website module 162 using the terminal 220 can input the content evaluation for the performance content.

The terminal 220 of the online spectator C transmits the input content evaluation to the website module 162 via the Internet and the website module 162 transmits the received content evaluation to the evaluation module of the web service unit 160 (163).

Thereafter, the evaluation module 163 collects the content evaluation sent via the Internet and provides the content evaluation result. The content evaluation result is applied to a performance content contest so that performance contents can be selected.

FIG. 4 is an exemplary diagram showing output and evaluation of performance and performance contents according to the present invention. FIG. When the performer A performs a performance in the performance room 110, the content generation unit 150 generates a sound signal corresponding to the performance input from the image input module 111 and the sound input module 112, which are operated under the control of the performance room control unit 120 And generates a performance content using at least one of a performance video signal or a performance sound signal generated by the performance video signal.

The performance room control unit 120 controls at least one of the video signal output module 131 and the audio signal output module 132 and transmits at least one of the performance video signal and the performance audio signal to the outside of the performance room 110 Output. At the same time, the content generation unit 150 can generate the performance content using at least one of the performance video signal and the performance sound signal.

The content distribution module 154 transmits the generated performance content to the content publishing module 161 of the web service unit 160 so that the online spectator C can view the generated performance content. The content publishing module 161 posts the received performance content to the website module 162. The terminal 220 of the online spectator C can access the performance contents through the Internet so that the online spectator C can view the performance contents via the Internet 220 using a terminal (PC, mobile device, etc.) The performance content can be posted to the website module 162,

The web site module 162 can be configured to allow the online viewer C to access the terminal 220 in a computer environment such as a PC or the like and can be connected to the online viewer C in a mobile device environment such as a smart phone The terminal 220 can be configured to be connectable. At this time, the terminal 220 of the online spectator C connects to the website module 162 through the web browser of each terminal, and watches the performance content, or transmits the performance content Can be seen.

Meanwhile, the content distribution module 154 may transmit the performance content generated by the content generation unit 150 to terrestrial broadcasting, DMB (digital multimedia broadcasting), or the like, so that the performance content can be viewed through a display device (Digital Multimedia Broadcasting) broadcasting, cable broadcasting, and the like to a broadcasting transmission facility (not shown) capable of transmitting signals.

The spectator B can observe the performance image signal and / or the performance sound signal outputted by the image signal output module 131 and / or the sound signal output module 132, separately from the performance image signal outputted from the performance room 110 The performance that is output through the transparent member 114 is visible.

The online spectator (C) can view the performance contents posted on the website module (162) through the terminal (220) of the online spectator (C). In addition, the online spectator C can view the performance content released by broadcasting by the content distribution module 154 through the terminal 220 of the online spectator C or a separate terminal capable of receiving the performance content .

The performance contents posted on the website module 162 may be provided in a download manner or may be provided in a streaming manner at the request of the online spectator C. [ The performance content outputted through the broadcast can receive and reproduce the performance content through a separate terminal capable of receiving the broadcast signal.

The on-site spectator B watches at least one of the performance image signal / performance sound signal outputted to the outside of the performance room 110 and the real-time performance through the transparent member 114 of the performance room 110, Performance evaluation can be performed. An online spectator (C) who watches the performance contents output on-line or on-air can perform content evaluation on the performance contents.

The on-site spectator B can input the performance evaluation using the local terminal 230 or the terminal 210 of the on-site spectator B provided outside the performance room 110, The content evaluation can be input using the terminal 220 of the viewer C. [

The local terminal 230 may comprise an input device such as a keyboard or mouse connected directly to the evaluation module 163 so as to be able to pass the performance evaluation entered by the field observer B to the evaluation module 163, And a terminal such as a PC or a mobile device indirectly connected to the terminals 163 and 163. The local terminal 230 may be connected to the evaluation module 163 in a wired or wireless manner without being connected to the Internet, and may transmit the performance evaluation.

The terminal 210 of the on-site spectator B or the terminal 220 of the on-line spectator C composed of a PC, a mobile device or the like inputs the inputted performance evaluation or content evaluation to the evaluation module 163 via the Internet send. At this time, it is transmitted to the evaluation module 163 through the website module 162. At this time, the terminal 210 of the on-site spectator B or the terminal 220 of the on-line spectator C inputting the performance evaluation or the content evaluation are connected to the web site module 162 of the web environment or the mobile environment, And input the evaluation through the application installed in the mobile device.

The performance evaluation or the content evaluation can be input using various alternative input terminals in addition to the terminal 210 of the on-site spectator B, the terminal 220 of the online spectator C, or the local terminal 230.

Thereafter, the evaluation module 163 provides evaluation results using at least one of a performance evaluation and a content evaluation. The evaluation results provided are applied to the contest so that the performance or contents can be selected.

The evaluation result provided may be (i) a performance evaluation result provided using only the performance evaluation inputted by the field visitor (B), (ii) a content evaluation result provided using only the content evaluation input by the online visitor (C) iii) the evaluation result provided using the performance evaluation and the content evaluation together.

Therefore, it is the performance that is applied by applying the performance evaluation result to the contest is the performance, the performance content evaluation result is applied to the contest to select the performance content, and the performance evaluation result and the content evaluation result are contest together ) Is selected from at least one of performance or performance content.

5 is a block diagram illustrating a performance output and content generation system according to the present invention. A system 100 for performing performance output and performance content creation includes a transparent member 114 formed on at least one surface to provide performance to the onlookers B and a soundproof means (not shown) for blocking external noise, A performance room 110 comprising: An acoustic input module 112 for converting a performance sound generated according to a performance in the performance room 110 into an electrical signal to generate a performance acoustic signal; An acoustic signal output module 132 provided outside the performance room 110 for outputting a performance acoustic signal in real time to an on-site spectator B who watches the performance through the transparent member 114 outside the performance room 110, ; A performance room control unit 120 for controlling the sound input module 112 and the sound signal output module 132 and the content room control unit 120 for generating performance contents including the sound content data in which the sound effect preset in the performance sound signal is added in real- And a generating unit 150.

The system further includes a field output unit 130 for outputting at least one of a performance video signal and a performance acoustic signal to the outside of the performance room 110.

In addition, the performance unit 140 may further include an effect unit 140 for adding a predetermined video effect and / or a predetermined sound effect to the performance video signal and / or the performance acoustic signal.

A content publishing module 161 for posting the performance content generated by the content creating unit 150 on-line, a website module 162 for publishing the performance content by the content publishing module 161, And an evaluation module 163 for receiving the content evaluation for the content evaluation result and providing the content evaluation result using the received content evaluation.

And a data storage unit 170 for storing performance contents and the like.

And a field input unit 180 for converting the sound and image of the on-site spectator B located outside the performance room 110 into electrical signals to generate on-site spectator image signals and on-site spectator sound signals.

The term 'performance output' is used herein to refer to performance video signals and performance sound signals provided to the field observer B as well as performance performed in the performance room 110 to the field observer B via the transparent member 114 ≪ / RTI >

As used herein, " field input " refers to an input present in the space in which the method is implemented. The field inputs can be located inside or outside the performance room.

The performance room 110 includes an image input module 111 for converting a scene of a performance performed by the performer A into an electrical signal to generate a performance image signal, and a performance acoustic signal And a sound input module 112 for generating sound. The performance output and performance content creation system 100 further includes a transparency adjustment module 115 for adjusting the transparency of the transparent member 114 or blocking the transparent member 114 according to the performance evaluation of the on-site spectator B .

In addition, the performance output and performance content generation system 100 may further include an illumination driving module 113 for supplying illumination to the interior of the performance room 110.

Further, the performance room 110 may further include soundproofing means (not shown) for substantially shielding external noise.

The performance room 110 may further include a monitoring module (not shown) for providing various information to the performer A performing the performance in the performance room 110.

The performer A can perform various performances in the performance room 110, and performances include singing, playing, acting, gag, magic, poetry recitation, martial arts, chorus, and dance.

The performance room 110 is provided in a space where the on-site spectator B is provided and is formed in a closed structure in order to separate the on-site spectator B from the performance performed in the performance room 110, A door 116 is included so that the performer A can enter and exit. The performance room 110 also includes a transparent member 114 and at least one surface of the performance to provide a scene of performance to the field observer B so that the field observer B can view the performance inside. And an acoustic input module 112 for converting the performance sound into an electrical signal to provide an auditor of performance to the audience. At this time, the image input module 111 and the sound input module 112 are generated as a performance sound signal and a performance image signal under the control of the performance room controller 120.

In other words, the performance room 110 can be installed indoors or outdoors with the sight spectator B, and a spectator seat for the spectator B can be provided outside the performance room 110. The performance room 110 for the performance visitor of the on-site spectator B can be installed in a cafe, restaurant, stadium, department store, subway waiting room, shopping mall, exhibition hall, educational institution, The components such as the field output unit 130, the effect unit 140, the content generation unit 150, and the field input unit 180 may be provided in the same place as the performance room 110, .

The performance room 110 is desirably provided in a size sufficient to accommodate a plurality of performers A and may be provided outside the performance room 110 so that performance contents can be generated using performances performed in the performance room 110. [ (Not shown) capable of blocking noises, in particular, the noise of the on-site spectator (B). At this time, the soundproofing means can use a soundproofing member, a soundproofing device, an soundproofing technology, or the like.

The video input module 111 is provided inside or outside the performance room 110 to capture a performance scene of the performer A. [ The image input module 111 may include a camera capable of capturing moving images such as a digital camera, a DSLR camera, and a broadcasting camera, and a mobile device such as a smart phone equipped with a camera module. A plurality of image input modules 111 may be provided at various positions according to the type of performances and the number of performers A. [

The sound input module 112 may be provided in the performance room 110 and records the performance sound of the performer A. [ The sound input module 112 may include a microphone or the like for professionally receiving sound. Also, it may be configured as a mobile device such as a smart phone equipped with a microphone or a microphone module provided together with the video input module 111. A plurality of sound input modules 112 may be provided at various positions depending on the type of performances and the number of performers A. [

The performance image signal and the performance sound signal generated by the image input module 111 and the sound input module 112 are transmitted to the field output unit 130 under the control of the performance room control unit 120, (B) outside the performance room (110) through the video signal output module (131) and the audio signal output module (132) of the video camera (130).

The lighting drive module 113 is provided with a performer A and a performance room 110 which are provided inside or outside the performance room 110 to improve the shooting quality of the video input module 111 for shooting a performance, (110). The illumination driving module 113 may use various lighting devices depending on the type of the light source.

In addition, the transparent member 114 provided in the performance room 110 for outputting performance performed inside the performance room 110 to an externally located on-site spectator B allows the on-site spectator B to easily perform the performance The size of which can be seen.

The transparent member 114 provided in the performance room 110 is made of a transparent material such as transparent glass or transparent plastic so that the performance of the inside can be seen.

The transparency adjustment module 115 may adjust the transparency of the transparent member 114 provided in the performance room 110 or block some or all of the transparent member 114 to control the visual observation of the sighted visitor B. The transparency adjustment module 115 adjusts the transparency of the transparent member 114 or blocks all or a part of the transparent member 114 under the control of the performance room controller 120.

The performance room control unit 120 uses the performance evaluation result of the on-site spectator B who watches at least one of performance, a performance video signal (including a predetermined video effect) and a performance sound signal (including a predetermined sound effect) And transmits a control command for controlling the transparency adjustment module 115 to the transparency adjustment module 115 to adjust or cut off the transparency of the transparent member 114. [

The performance room control unit 120 transmits a control command for controlling the transparency adjustment module 115 to the transparency adjustment module 115 using the content evaluation result of the online spectator C who watches the performance content, ) To adjust or block transparency.

In addition, the performance room control unit 120 may control or block the transparency of the transparent member 114 by using the performance evaluation result and the content evaluation result together.

The performance room control unit 120 may control or shut off the output of at least one of the video signal output module 131 and the audio signal output module 132 using at least one of a performance evaluation result and a content evaluation result. Adjusting the output can be done by adjusting the intensity of the output, adjusting the noise, adjusting the definition, providing a substitute image signal and a substitute sound signal, or blind processing the output performance image signal Operation, and the like.

As a result, since the output of the performance provided to the field visitor B can be controlled in various ways by the performance evaluation result or the content evaluation result provided in real time, the performer A, the field visitor B, the online visitor C, Lt; / RTI >

The transparency adjustment module 115 may be formed of a window canopy such as a blind, a curtain, a roll screen, or the like, which can block all or a part of the transparent member 114. In addition, the transparency adjustment module 115 may control the transparency or block the transparency by transmitting an electrical control signal to the film inserted in the transparent member 114.

A monitoring module (not shown) is a device for providing various information to the performer A performing the performance. The information provided to the performer A may include image information and sound information, and includes a display device for providing image information and an audio device for providing sound information. For example, when the performance performed by the performer A is a song, a monitoring module (not shown) can provide visual information such as lyrics through a display device, and can display acoustic information such as a song accompaniment .

The video signal output module 131 provided in the field output unit 130 outputs a performance video signal in which the scene of the performance is converted into an electrical signal by the video input module 111 so that the field visitor B can view the performance scene . The video signal output module 131 may include a display device for outputting a performance video signal to a screen, and may include a mobile device such as a smart phone carried by an individual as the need arises.

The acoustic signal output module 132 outputs a performance acoustic signal in which the sound of the performance is converted into an electrical signal by the acoustic input module 112 so that the field visitor B can hear the sound of the performance. The sound signal output module 132 includes an audio device capable of professionally outputting sound such as a speaker, an earphone, and a headphone. If necessary, the sound signal output module 132 may be a mobile phone, such as a smart phone, Equipment and the like.

The performance image signal and the performance sound signal are respectively generated by the image input module 111 and the sound input module 112 under the control of the performance room controller 120 and then a predetermined image effect or a predetermined sound effect is added And output from the direct image signal output module 131 and the sound signal output module 132 without being edited.

However, if it is necessary to edit a preset video effect or a preset sound effect, the performance room controller 120 controls the performance of the performance image signal and / Sound effects, and the like can be performed substantially in real time. The output signal is transmitted to the field output unit 130 under the control of the performance room control unit 120 and output through the video signal output module 131 and the acoustic signal output module 132. At this time, the performance room control unit 120 may use the video effect module 141 and the sound effect module 142 of the effect unit 140 to add a preset video effect or a predetermined sound effect.

The performance room control unit 120 controls the video input module 111 to convert the performance scene into the performance video signal and controls the acoustic input module 112 to convert the performance sound into the performance acoustic signal, To supply illumination to the inside of the performance room 110. [

The performance room control unit 120 controls the performance of the performance image signal and the performance sound signal so that the performance image signal and the performance sound signal generated by the image input module 111 and the sound input module 112 can be output to the on- Signals are transmitted to the video signal output module 131 and the audio signal output module 132 of the field output unit 130 and each of the video signal output module 131 and the audio signal output module 132 transmits the performance video signal And controls to output a performance acoustic signal.

The performance room control unit 120 controls the performance image signal and the performance sound signal so that editing can be performed to add a preset sound effect and a predetermined sound effect, and outputs the edited performance image signal and the performance sound signal to the on- And outputs it to the output unit 130.

The performance room control unit 120 controls the transparency adjusting module 115 to adjust the transparency of the transparent member 114 or to block all or a part of the transparent member 114 according to the evaluation result.

The performance room control unit 120 controls the output of the video signal output module 131 or the sound signal output module 132 of the field output unit 130 according to the evaluation result.

The effect unit 140 may perform editing to add a predetermined video effect and a preset sound effect to the performance video signal and the performance sound signal. The preset video effect and the predetermined sound effect include a predetermined video effect generated by the effect unit 140 or transmitted from the outside, and a predetermined sound effect.

The effect unit 140 includes a video effect module 141 and a sound effect module 142.

The video effect module 141 and the sound effect module 142 may add predetermined video effects and predetermined sound effects to the performance video signal and the performance sound signal output to the field visitor B,

The video effect module 141 and the sound effect module 142 provide the preset video effect and the predetermined sound effect respectively to the content generation unit 150 for the generation of the performance content to be added to the performance video signal or the performance sound signal . The predetermined video effect may include a background of a video, a video effect, an animation, a 3D object, and the like. The predetermined video effect includes information such as a background, a video effect, an animation, a 3D object, and the like of a video to be applied to the performance video signal.

The predetermined sound effect may include a background sound, an equalizer (EQ), an echo, a reverb, a virtual instrument sound, a recorded sound, and the like. In addition, the predetermined sound effect may include at least one of a background sound, an equalizer, an echo, a reverb, a virtual instrument sound, and a point of time and condition for applying the sound to the performance sound signal Information.

The predetermined sound effect or predetermined picture effect may be set according to the time table, wherein one or more sound effects or a visual effect added to the performance picture signal or the performance sound signal is set.

Accordingly, at least one of the video effect module 141 and the sound effect module 142 may be provided in the form of hardware, software, or a combination thereof.

The content generation unit 150 may be located inside or outside the performance room 110. If necessary, each configuration of the content generation unit 150 may be located inside and outside the performance room 110. [

The content generation unit 150 includes a video signal processing module 151 for processing the performance video signal generated by the video input module 111 under the control of the performance room control unit 120 to generate video content data, (ii) a sound signal processing module 152 for processing the performance sound signal generated by the sound input module 112 to generate sound content data, (iii) an image content data and sound content data, And a content distribution module 154 for outputting the performance content to the outside.

The video signal processing module 151 receives the performance video signal and performs editing such as adding a video effect to the performance video signal using a preset video effect in the video effect module 141 in the effect unit 140, To generate image content data.

The sound signal processing module 152 receives the performance sound signal and, if necessary, edits the sound content data through editing such as adding a sound effect to the performance sound signal using the sound effect preset in the sound effect module 142 .

The video signal processing module 151 and the sound signal processing module 152 may be provided in at least one of software (S / W) and hardware (H / W).

The image signal processing module 151 and the sound signal processing module 152 can perform real-time editing of the performance image signal and the performance sound signal according to the set information. The video signal processing module 151 and the acoustic signal processing module 152 can perform performance video signal and performance sound signal editing according to the set information after the performance of the performer A is terminated. In addition, the video signal processing module 151 and the sound signal processing module 152 perform real-time editing of the performance content generated using the performance video signal and the performance sound signal according to the set information.

In addition, the video signal processing module 151 and the sound signal processing module 152 perform the editing of the performance content generated using the performance video signal and the performance sound signal after the performance of the performer A ends, according to the set information Can be performed. The editing performed by the video signal processing module 151 and the sound signal processing module 152 may be performed under the control of the administrator according to the set information.

Editing performed by the video signal processing module 151 and the sound signal processing module 152 includes at least one of image synthesis and acoustic synthesis. Various synthetic algorithms can be used for the synthesis method for each synthesis have. Particularly, in the case of image synthesis, a chroma-key technique that can replace the background inside the performance room 110 with another background screen is used, and the performance content created and edited according to the chroma- The performance can be the same as that performed in a place other than the inside of the game.

The signal conversion module 153 converts the performance data of the performance image signal and the performance sound signal from the image signal processing module 151 and the sound signal processing module 152 into the performance data The file format of the content, the file capacity, and the screen size.

At this time, the signal conversion module 153 converts at least one of the image content data and the sound content data into performance content. The performance content may include image content data and / or sound content data. In addition, the video content data and the audio content data can be encoded together and converted into one performance content.

When converting the video content data into the performance content in the signal conversion module 153, the optimal screen size can be adjusted according to the type of the terminal that reproduces the performance content. For example, when the performance content is reproduced through a television and output as a broadcast signal, the performance content is converted into a high resolution according to the screen size of the television. In the case of performance content provided for mobile use, To low resolution.

The content distribution module 154 is a means for releasing the generated performance content to various media. Various media connected to the content distribution module 154 and receiving the performance content may be any of various media such as a PC, a mobile phone, a smart phone, an online medium such as a smart pad, a broadcast medium such as a television or a radio, A storage medium such as a CD, an audio device, and a display device.

Accordingly, the content distribution module 154 may release the performance content including the audio content data to the audio distribution device 154 directly or indirectly connected to the content distribution module 154. In addition, the content distribution module 154 can release the performance content including the image content data to a display device directly or indirectly connected to the content distribution module 154.

In addition, the content distribution module 154 may release the performance content including at least one of the sound content data and the image content data directly or indirectly to the connected on-line media. The online media on which the performance content is output may be a web site providing a PC target service, a web site providing a mobile target service, a mobile application, and the like. The performance contents output to the online medium can be downloaded or streamed from the website module 162 through the terminal 220 of the online viewer C who can access the Internet.

The content distribution module 154 can publish the generated performance content to SNS (Social Networking Service) such as Facebook, Twitter, Instagram, etc. corresponding to the online medium, And can be transmitted through an e-mail account established by users.

The content distribution module 154 may be any connection capable of providing the generated performance content to at least one of the terminal 210 of the on-site spectator B or the terminal 220 of the on- It is also possible to use means.

In addition, the content distribution module 154 releases the generated performance content to a broadcasting transmission facility (not shown) capable of transmitting signals such as terrestrial broadcasting, DMB (Digital Multimedia Broadcasting) broadcasting, cable broadcasting, . In addition, the content distribution module 154 may release the generated performance content to be stored in an offline storage medium or an external storage medium (not shown). As an external storage medium for storing performance contents, it is preferable to use a magnetic system such as a hard disk, an optical system such as CD, DVD, Blu-Ray, and a semiconductor system such as RAM, ROM, . In addition, it may be transmitted to a storage medium connected to the on-line and stored in an external storage medium located at a remote location, or other storage medium may be used.

That is, the external storage medium for storing the performance content released through the content distribution module 154 is a means for storing the performance content, and includes a performer A performing the performance, a performance sound signal, (B) for viewing at least one or more, an online spectator (C) for viewing the performance content, or a means for providing the user who requests the performance content. Accordingly, when the external storage medium is capable of storing performance contents, any type of storage medium may be used.

The content distribution module 154 may use any distribution means capable of providing the generated performance content to the terminal 220 of the online viewer C in addition to release to the Internet, Also,

The web service unit 160 includes a content publishing module 161 for posting performance content on a web site on-line, (ii) a website module 162 for publishing performance content by the content publishing module 161, And (iii) an evaluation module 163 for providing a content evaluation result using the content evaluation inputted by the online spectator C who watched the performance content posted in the website module 162. [

The evaluation module 163 may be described as one module of the web service unit 160 as described above, but may be included in another unit.

When the converted performance content is released through the content distribution module 154 to be output on-line via the signal conversion module 153, the content publishing module 161 transmits the corresponding performance content to the website module 162 ).

The content publishing module 161 publishes the PC-based performance content on the PC-based web site in the signal conversion module 153 according to the form of the terminal 220 of the online spectator C, Publish performance content on mobile-based websites.

The website module 162 is a module in which the performance content is posted online by the content publishing module 161. Depending on the form of the terminal 220 of the online spectator C, the website module 162 may be provided separately on a PC based web site and a mobile based web site.

The online spectator C connected through the terminal 220 selects at least one performance content and the website module 162 provides the selected performance content to the terminal 220 of the online spectator C. [

The performance contents through the website module 162 may be provided to the terminal 220 of the online spectator C by a streaming method or a download method. Such a method can be determined by the website module 162 or the online viewer C.

Web site module 162 may be provided within the performance output and performance content creation system 100 or outside. The operating entity of the website module 162 may be the same as or different from the performance output and performance content creation system 100.

The on-site spectator B monitors the performance of the performance room 110 through the transparent member 114, the performance video signal of the video signal output module 131 (which may include predetermined video effects) and the performance of the audio signal output module 132 And a sound signal (which may include a predetermined sound effect).

The evaluation module 163 receives the performance evaluation input by the field observer B from the terminal 210 of the field observer (B).

The performance evaluation inputted by the field spectator B may be a performance image signal including a predetermined video effect or a performance evaluation on a performance acoustic signal including a predetermined sound effect. The performance evaluation may be sent via the local terminal 230 connected directly or indirectly to the evaluation module 163. The local terminals 230 may be connected through a communication network such as a wired or wireless network. The local terminal 230 may be particularly provided outside the performance room.

The evaluation module 163 receives the content evaluation inputted by the online viewer C from the terminal 220 of the online viewer C who viewed the performance content posted on the website module 162. [

The evaluation module 163 receives the content evaluation inputted by the broadcast spectator from a terminal of a broadcast spectator (not shown) watching the released performance content through the content distribution module 154.

The evaluation module 163 receives the performance evaluation sent via the terminal 210 of the on-site spectator B or the local terminal 230 and provides the performance evaluation result.

The evaluation module 163 receives the content evaluation transmitted through the terminal 220 of the online spectator C and provides a result of content evaluation.

The evaluation module 163 receives a content evaluation transmitted through a terminal (not shown) of a broadcasting spectator (not shown), and provides a result of content evaluation.

The evaluation module 163 can also provide evaluation results combining at least two evaluation results of the performance evaluation of the on-site spectator B, the content evaluation of the online spectator C, or the content evaluation of the broadcast spectator (not shown) .

The performance evaluation result and the content evaluation result may be provided by the evaluation module 163 in a quantitative or qualitative manner.

These quantitative and qualitative methods are determined according to the form of performance evaluation and content evaluation. When the performance evaluation and the content evaluation are quantitative indicators such as score, ranking, and rating, the performance evaluation result and the content evaluation result can be provided in a quantitative manner.

When the performance evaluation and the content evaluation are qualitative indicators, the performance evaluation result and the content evaluation result can be provided in a qualitative way.

The content or method of the performance evaluation or content evaluation may vary depending on the genre or form of the performance and performance contents. The methods provided by the evaluation module 163 may be different if the content and method of the performance evaluation and content evaluation are different.

The performance evaluation result and the content evaluation result provided in the evaluation module 163 can be applied to the contest to select a better or better performance or content.

The evaluation module 163 can select better or better performance or content when the performance evaluation result or the content evaluation result is higher than a preset cut-off value.

Alternatively, the evaluation module 163 may compare at least two evaluation results of the performance evaluation result and the content evaluation result, and then select a performance or content having a higher evaluation result to select better or better performance content . In addition, the evaluation module 163 may include a method of using at least one of a performance evaluation result and a content evaluation result.

The data storage unit 170 may store at least one of a performance sound signal, a performance image signal, sound content data, image content data, and performance content.

In addition, the data storage unit 170 may store at least one of a performance evaluation, a content evaluation, a performance evaluation result, or a content evaluation result, and optionally, contest information.

The field input unit 180 generates an on-site spectator image signal or on-the-spot spectator sound signal obtained by converting a viewing scene or viewing sound generated from an on-site spectator B existing outside the performance room 110 into an electrical signal. The scene input unit 180 includes a scene image input module 181 for converting a scene of the scene viewer B into a scene viewer image signal and a scene sound conversion module 182 for converting a scene sound of the scene viewer B into a scene sound image And an input module 182.

The field image input module 181 records a scene where the field visitor B watches at least one of a performance, a performance image signal, or a performance sound signal.

The field image input module 181 may include a mobile device such as a smart phone having a camera and a camera module capable of capturing moving pictures such as a digital camera, a DSLR camera, and a broadcasting camera. A plurality of the scene image input modules 181 may be provided at various positions according to the number and view type of the field viewers B. [

The field acoustical input module 182 records the auditory sound generated when the field person B views at least one of a performance, a performance video signal, or a performance acoustic signal. The field acoustical input module 182 may include a microphone capable of recording high quality sound. The field acoustical input module 182 may include a mobile device, such as a smart phone, having a microphone and a microphone module mounted to the field video input module 181. The scene sound input module 182 may be provided in various places depending on the type of performance and the number of performers A. [

The scene viewer image signal and the scene viewer sound signal generated by the scene image input module 181 and the scene sound input module 182 are transmitted to the content generation unit 150 under the control of the performance room control unit 120 And is used for generating the performance content by the content generation unit 150 together with the performance sound signal and the performance video signal.

At this time, at least one of the on-scene spectator image signal and the on-scene spectator sound signal is edited by a predetermined image effect or a predetermined sound effect and is used for generating performance contents.

FIG. 6 is a flowchart for illustrating output of performance and generation of contents according to an embodiment of the present invention. According to one embodiment, the performance performed in the performance room 110 is output, and the performance-based performance content is generated in real time. An embodiment of the present invention includes the following steps. (i) The performance room controller 120 converts the performance sound generated according to the performance of the performance room 110 into an electrical signal to generate a performance sound signal, and the sound input module 112 provided in the performance room 110 ; (ii) The performance room control unit 120 transmits the performance sound signal to the sound signal output module 13 provided outside the performance room 110, and performs the performance through the transparent member 114 of the performance room 110 Controlling the sound signal output module 132 to output a performance sound signal in real time to a spectator viewing the sound; (iii) transmitting the performance sound signal generated by the sound input module 112 to the content generation unit 150 by the performance room control unit 120; And (iv) a performance content including sound content data in which a predetermined sound effect is added to a performance sound signal in real time is generated by the content generation unit 150. [

A transparent member 114 is formed on at least one surface of the spectator B to show performance and a performance room 110 including a soundproofing means for blocking external noise is provided in the performer A The performance is performed (S110).

At this time, the performance room 110 shows the performances performed to the on-scene viewer B through the transparent member 114. [ The performance room control unit 120 controls at least one of the sound input module 112 and the image input module 111 to receive a scene and sound of performances performed by the performer A in the performance room 110 Then, the signal is converted into a performance sound signal or a performance image signal, which is an electrical signal, in real time (S120).

The performance room control unit 120 controls the field output unit 130 so that at least one of the performance sound signal or the performance image signal is output to the field visitor B in step S130.

The field output unit 130 includes a video signal output module 131 for outputting a performance video signal and an acoustic signal output module 132 for outputting a performance acoustic signal. Optionally, the field-of-view outputting unit 130 may output together with at least one of the field viewers image signals and the field viewers sound signals input by the field image input module 181.

At least one of the performance image signal, the performance sound signal, the field spectator image signal, and the field spectator sound signal output through the field output unit 130 is transmitted to the video effect module 141 or the sound effect module 142 The preset sound effect or the predetermined sound effect can be added in substantially real time and output.

At least one of the performance sound signal or the performance image signal converted through the sound input module 112 and the image input module 111 is transmitted to the content generation unit 150 in real time under the control of the performance room control unit 120 (S140).

Thereafter, the content generation unit 150 generates performance content in real time using at least one of the delivered performance sound signal and the performance image signal (S160).

Alternatively, the content generation unit 150 may generate a performance content by adding a video effect or a sound effect in real time through the effect unit 140 (S150).

The video signal processing module 151 of the content generation unit 150 generates the video content data reflecting the predetermined video effect when the preset video effect is added to the performance video signal through the video effect module 141. [

When a predetermined sound effect is added to the performance sound signal through the sound effect module 142, the sound signal processing module 152 generates sound content data reflecting the predetermined sound effect.

The signal conversion module 153 of the content generation unit 150 generates performance content using video content data and / or sound content data to which a preset video effect or a predetermined sound effect is added.

 The content generation unit 150 may selectively add a preset video effect and a predetermined sound effect as needed. If a video effect or a sound effect is not required, the content generation unit 150 generates the performance content using at least one of the delivered performance video signal or the performance sound signal.

FIG. 7 is a flowchart for illustrating performance evaluation by an on-site spectator according to an embodiment of the present invention. Steps S110 to S160 in FIG. 7 are the same as those in FIG.

The evaluation module 163 of the web service unit 160 transmits the performance to the transparent member 114, the video signal output module 131 for the performance video signal, the audio signal output module for the performance sound signal, The performance evaluation of the on-site spectator B who watched the performance through at least one of the plurality of viewers 132 is received (S170).

The performance evaluation received by the evaluation module 163 is input using at least one of the terminal 210 of the on-site spectator B and the local terminal 230 provided on the outside of the performance room 110.

The evaluation module 163 receives the performance evaluation inputted through the terminal 210 of the field visitor B or the local terminal 230 connected to the evaluation module 163 and provides a performance evaluation result (S175).

The performance evaluation result provided in step S175 can be used for a contest that can select better or better performance. If the performance evaluation result is higher than the preset cut-off value, better or better performance can be selected. The predetermined cut-off value may vary depending on the genre and type of performance. Instead, at least two performance evaluation results can be compared with each other and a high performance evaluation result can be selected.

FIG. 8 is a flowchart for showing performance evaluation and content evaluation by an online spectator using a performance output system and a content generation system according to an embodiment of the present invention. Steps S100 to S160 of FIG. 8 are the same as those of FIG.

The performance content generated through the content generation unit 150 and released through the content distribution module 154 after step S160 is posted to the website module 162 in real time through the content publishing module 161 (S180).

The performance content is posted to the website module 162 by the content publishing module 161 included in the web service unit 160. The content publishing module 161 can publish the performance content released by the content distribution module 154 to the website module 162 so that the released performance content can be posted online. The online spectator C then views the performance content posted on the website module 162 using the terminal 220 and inputs the content evaluation of the performance content to the terminal 220. [ The input content evaluation is transmitted to the evaluation module 163 by the terminal 220. The evaluation module 163 receives the content evaluation transmitted from at least one of the terminals 220 of the online spectator C (S190).

The evaluation module 163 receives the content evaluation result input through the terminal 220 of the online spectator C and provides a content evaluation result (S195).

The content evaluation result provided in step S195 may be used for contest for selecting better or better performance content. If the performance evaluation result is higher than a preset cut-off value, better or better performance content can be selected. The predetermined cut-off value can be variously changed according to the genre and type of the performance content. Instead, at least two content evaluation results may be compared with each other, so that the performance content having a high evaluation result can be selected.

The video signal output module 131 and the acoustic signal output module 132 are provided in order to provide the live viewers B with the performance video signals and the performance acoustic signals that have been converted in real time by the video input module 111 and the audio input module 112, Outputs both signals in real time.

The real-time converted performance image signal and the performance sound signal are transmitted to the content generation unit 150 under the control of the performance room control unit 120. The generated performance content is posted to the website module 162 in real time via the content distribution module 154 and the content publishing module 161 so that the online spectator C can view the performance of the performance performed in the performance room 110 You can view the performance contents.

It is only one embodiment of the present invention that the performance content generated by the content generation unit 150 at the same time as performance is posted in the web site module 162 in real time in the above embodiment. For example, in the present invention, the performance image signal and the performance sound signal converted at the same time as the performance is performed are stored in the data storage unit 170, and then transmitted to the content generation unit 150 as needed, Examples may be included.

As described above, the method and system of the present invention can generate performance content using performance performed in a performance room, and simultaneously provide performance to an on-scene spectator at a place where the performance room is located.

In addition, the performance contents are created through the performance that is performed in the performance room where the viewers can view the performance, while the external sounds from the viewers are prevented from flowing into the performance room to generate high-quality performance contents .

In addition, the performance is shown to the field visitor through a transparent member installed on at least one side of the performance room, so that the real-time performance can be provided more vividly to the field visitor.

While the present invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (29)

A method for real-time output of a performance of a performer performed in a performance room, including the following steps, outside the performance room, and generating performance-based performance contents:
(a) controlling a sound input module provided in the performance room to convert a performance sound generated according to a performance in the performance room into an electric signal to generate a performance sound signal; Wherein the performance room comprises soundproofing means for shielding external noise and at least one transparent member arranged on one side to show the performance to the field spectator;
(b) the performance room control unit transmits the performance sound signal to the sound signal output module, and outputs the performance sound signal to the on-site spectator visually viewing the performance from the outside of the performance room through the transparent member Controlling the acoustic signal output module provided outside the performance room;
(c) the performance room control unit transmitting the performance sound signal generated by the sound input module to the content generation unit; And
(d) generating the performance content including the sound content data added to the performance sound signal by the content generation unit.
The method according to claim 1,
Wherein the performance sound signal output from the sound signal output module in the step (b)
Wherein a predetermined sound effect is added in real time and output.
The method according to claim 1,
In the step (d)
Generating the performance content further including a field spectator sound signal obtained by converting sound generated from the field spectator into an electrical signal; Wherein the field spectator sound signal is generated in a field sound input module under the control of the performance room control unit.
The method according to claim 1,
After the step (b) or (d), the method further comprises:
The evaluation module may further include a step of providing a performance evaluation result by using an on-scene viewer evaluation result of at least one of the performance or the performance sound signal, wherein the on- Lt; RTI ID = 0.0 > evaluation module. ≪ / RTI >
The method according to claim 1,
After the step (d)
Wherein the evaluation module further includes a step of providing a content evaluation result using an online spectator evaluation result on the performance content, wherein the online spectator evaluation result is input to the evaluation module by the terminal of the online spectator Way.
The method according to claim 1,
In the step (a), the performance room controller may include:
Controlling an image input module provided in the performance room to convert a scene generated from the performance into an electrical signal to generate a performance image signal,
In the step (c), the performance room control unit,
And transmits the performance video signal generated by the video input module to the content generation unit.
The method according to claim 6,
In the step (d)
And generating the performance content further including image content data in which a predetermined video effect is added to the performance video signal.
The method according to claim 6,
In the step (b), the performance-
And transmits the performance video signal to a video signal output module provided outside the performance room and further controls the video signal output module to output the performance video signal to the field viewers outside the performance room in real time . ≪ / RTI >
9. The method of claim 8,
In the step (b), the performance video signal may include:
Wherein the preset video effect is added in real time and output from the video signal output module.
8. The method of claim 7,
In the step (d)
Generating the performance content further including a field spectator image signal obtained by converting a scene generated from the field spectator into an electrical signal; Wherein the scene viewer image signal is generated in the scene image input module under the control of the performance room controller.
9. The method of claim 8,
After the step (b) or (d), the method further comprises:
Further comprising the step of the evaluation module providing an evaluation result using an on-scene viewer evaluation result for the performance video signal; Wherein the on-scene spectator evaluation result is input to the evaluation module by the terminal of the on-scene spectator.
8. The method of claim 7,
After the step (d)
Further comprising the step of the evaluation module providing a result of content evaluation using an online spectator evaluation result on the performance content; Wherein the online spectator evaluation result is input to the evaluation module by a terminal of an online spectator.
The method according to claim 4, 5, 11, or 12,
The performance-
And controls the transparency adjusting module to adjust the transparency of the transparent member or to block a part or all of the transparent member corresponding to the evaluation result.
The method according to claim 4, 5, 11, or 12,
The performance-
And controlling at least one of the sound signal output module or the video signal output module to adjust the output intensity of the sound signal output module or the video signal output module or cut off the output in accordance with the evaluation result Lt; / RTI >
A system for real-time output of performances of performers performed in a performance room including the following outside of the performance room and for generating performance-based performance contents:
A performance room including soundproofing means for blocking external noise and a transparent member provided on at least one side of the performance room to show the performance to a field spectator outside the performance room;
An acoustic input module for converting a performance sound generated from the performance of the performance room into an electrical signal to generate a performance acoustic signal;
A sound signal output module provided outside the performance room and outputting the performance sound signal to an on-site spectator who watches the performance through the transparent member of the performance room in real time;
A performance room controller for controlling the sound input module and the sound signal output module; And
And generating a performance content including the generated sound content data by adding a predetermined sound effect to the performance sound signal.
16. The method of claim 15,
Wherein the performance sound signal output from the sound signal output module comprises:
And the predetermined sound effect is added in real time and output.
17. The method according to claim 15 or 16,
The system comprises:
Further comprising a sound effect module for generating the predetermined sound effect by adding the predetermined sound effect to the performance sound signal in real time.
16. The method of claim 15,
The content generation unit may include:
And generating the performance content further including an on-scene spectator sound signal obtained by converting sound generated from the on-site spectator into an electrical signal; Wherein the field spectator sound signal is generated in a field sound input module under the control of the performance room control section.
16. The method of claim 15,
The system comprises:
An evaluation module that provides a performance evaluation result using at least one of the performance and at least one of the performance sound signal and the performance sound signal, or provides the content evaluation result using the online spectator evaluation result of the performance content, Wherein the on-site spectator evaluation result is input to the evaluation module by the terminal of the on-scene spectator, and the on-line spectator evaluation result is inputted to the evaluation module by the terminal of the online spectator.
16. The method of claim 15,
The system comprises:
Further comprising a video input module for generating a performance video signal obtained by converting a scene generated from the performance into an electrical signal.
21. The method of claim 20,
The content generation unit may include:
Wherein the performance content generating unit generates the performance content further including image content data to which a predetermined video effect is added to the performance video signal.
21. The method of claim 20,
The system comprises:
Further comprising a video signal output module provided outside the performance room for outputting a performance video signal to the on-scene viewer in real time, wherein the performance video signal has a predetermined video effect added to the performance video signal in real time, And output by the video signal output module.
23. The method of claim 21 or 22,
The system comprises:
And a video effect module for generating the predetermined video effect added to the performance video signal.
22. The method of claim 21,
The content generation unit may include:
Generating the performance content further including a scene viewer image signal obtained by converting a scene generated from the scene viewer into an electrical signal; Wherein the scene viewer image signal is generated in the scene image input module under the control of the performance room controller.
23. The method of claim 22,
The system comprises:
Further comprising an evaluation module for providing a performance evaluation result using an on-scene viewer evaluation result for the performance video signal, wherein the on-scene viewer evaluation result is input to the evaluation module from an on-site spectator's terminal.
22. The method of claim 21,
The system comprises:
Further comprising: an evaluation module that provides a content evaluation result using the online spectator evaluation result of the performance content, wherein the online spectator evaluation result is input to the evaluation module by the terminal of the online spectator.
26. The method of claim 19, 25 or 26,
The system comprises:
Further comprising a transparency adjustment module for adjusting transparency of the transparent member or blocking the transparent member in part or whole according to the result of the evaluation by the performance room control unit.
26. The method of claim 19, 25 or 26,
And controlling at least one of the sound signal output module or the video signal output module to adjust the output intensity of the sound signal output module or the video signal output module or cut off the output in accordance with the evaluation result .
16. The method of claim 15,
The system comprises:
And a web service unit for providing the performance content generated by the content generation unit to a user, wherein the web service unit includes: a content publishing module for posting the performance content on-line; And a website module for providing the posted performance contents to a terminal of an online spectator.
KR1020177032726A 2015-04-10 2016-04-05 Method and system for performing performance output and performance content creation KR102013054B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20150050769 2015-04-10
KR1020150050769 2015-04-10
PCT/KR2016/003540 WO2016163724A1 (en) 2015-04-10 2016-04-05 Method and system for outputting performance and creating performance content

Publications (2)

Publication Number Publication Date
KR20170129274A true KR20170129274A (en) 2017-11-24
KR102013054B1 KR102013054B1 (en) 2019-08-21

Family

ID=57073314

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177032726A KR102013054B1 (en) 2015-04-10 2016-04-05 Method and system for performing performance output and performance content creation

Country Status (2)

Country Link
KR (1) KR102013054B1 (en)
WO (1) WO2016163724A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106792245B (en) * 2016-11-22 2018-04-20 广州华多网络科技有限公司 Direct broadcasting room video flowing synthetic method, device and terminal device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR200347854Y1 (en) * 2004-01-09 2004-04-28 최충현 The soundproofing booth
US20050097613A1 (en) 2003-11-03 2005-05-05 Ulate Alberto J.R. Interactive personal service provider
US20080201276A1 (en) 2007-02-16 2008-08-21 David Hadland Music and art network
US20090231414A1 (en) * 2008-03-17 2009-09-17 Cisco Technology, Inc. Conferencing and Stage Display of Distributed Conference Participants
KR20100034657A (en) * 2008-09-24 2010-04-01 김학선 System and method for processing rating information, information storage medium and program recording medium
KR20110076379A (en) * 2009-12-29 2011-07-06 동국대학교 산학협력단 Apparatus and method for adaptive controlling of directing equipment, and recording medium thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100830130B1 (en) * 2001-10-25 2008-05-20 주식회사 온네트 A system for on-line performance and a method thereof
KR20140136632A (en) * 2013-05-21 2014-12-01 라정란 Managing system for live cafe

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050097613A1 (en) 2003-11-03 2005-05-05 Ulate Alberto J.R. Interactive personal service provider
KR200347854Y1 (en) * 2004-01-09 2004-04-28 최충현 The soundproofing booth
US20080201276A1 (en) 2007-02-16 2008-08-21 David Hadland Music and art network
US20090231414A1 (en) * 2008-03-17 2009-09-17 Cisco Technology, Inc. Conferencing and Stage Display of Distributed Conference Participants
KR20100034657A (en) * 2008-09-24 2010-04-01 김학선 System and method for processing rating information, information storage medium and program recording medium
KR20110076379A (en) * 2009-12-29 2011-07-06 동국대학교 산학협력단 Apparatus and method for adaptive controlling of directing equipment, and recording medium thereof

Also Published As

Publication number Publication date
KR102013054B1 (en) 2019-08-21
WO2016163724A1 (en) 2016-10-13

Similar Documents

Publication Publication Date Title
US7725203B2 (en) Enhancing perceptions of the sensory content of audio and audio-visual media
KR101381396B1 (en) Multiple viewer video and 3d stereophonic sound player system including stereophonic sound controller and method thereof
KR20030084948A (en) Integrated, adaptable theater, club and multiplex
JP2010541415A (en) Compositing multimedia event presentations
CN115209172B (en) XR-based remote interactive performance method
US20110304735A1 (en) Method for Producing a Live Interactive Visual Immersion Entertainment Show
KR20180052496A (en) Virtual performance-studio system
WO2022004103A1 (en) Performance effect control method, terminal device operation method, performance effect control system, and terminal device
Foust et al. Video production: Disciplines and techniques
JP2006041886A (en) Information processor and method, recording medium, and program
KR101414217B1 (en) Real time image synthesis apparatus and image synthesis method
KR102013054B1 (en) Method and system for performing performance output and performance content creation
Baxter A practical guide to television sound engineering
Roquet Acoustics of the one person space: headphone listening, detachable ambience, and the binaural prehistory of VR
JP2021021870A (en) Content collection/distribution system
JP2013156543A (en) Posting reproducer and program
JP2018028646A (en) Karaoke by venue
Scuda et al. Using audio objects and spatial audio in sports broadcasting
Ando et al. Production and live transmission of 22.2 multichannel sound with ultra-high definition TV
GB2532644A (en) Digital jukebox device with karaoke and/or photo booth features, and associated methods
Mellēna-Bartkeviča Opera across Borders: New technologies and Mediatization/Piire ületav ooper: Uued tehnoloogiad ja mediatiseerimine
Meyer-Kahlen et al. Inside The Quartet-A first-person virtual reality string quartet production
Malsky The Grandeur (s) of CinemaScope: Early Experiments in Cinematic Stereophony
KR20100055662A (en) Client terminal apparatus, performance impression service system and its method
Collins et al. Experimental sound mixing for The Well, a short film made for tablets

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
N231 Notification of change of applicant
E701 Decision to grant or registration of patent right
GRNT Written decision to grant