KR20180115928A - The smart multiple sounds control system and method - Google Patents

Abstract

According to an aspect of the present invention, a method and a system for smart multi-sound control use individually managed smart devices and microphones attached to the smart devices in a concert where a plurality of performers appear to build an integrated sound control service usable in a concert. Installation of microphones and a sound balance setting function for a plurality of microphones used to be performed by a sound director can be automatically performed. When sound data are inputted on a sound terminal used by a performer, the sound data are transmitted to a sound control console connected via a network. The sound control console selectively integrates and outputs sound data from the sound terminal selected by adjustment of a manager. A function for allowing manual or automatic sound adjustment for the volume of sound data is included. If the present invention is used, a plurality of performers use microphone systems managed by the performers to reduce a burden for management of microphone devices and reduce a burden for power management. Also, an economic burden is eased and a concert environment with sufficient mobility can be constructed. Preparation expenses for a concert can be reduced by extension to auxiliary terminals of various sound devices instead of voices of performers.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a smart sound terminal based acoustic control system and method,

The present invention relates to a method or system for collecting sound data from multiple sounds by using a plurality of sound terminals composed of a smart device and a sound control console automatically detected by a network means and adjusting and integrating the respective sound data, More specifically, a smart device including an acoustic input module such as a smart phone, a tablet PC, or a microphone such as a PC is configured as an acoustic terminal, a smart device such as a smart phone, a tablet PC, or a PC is configured as an acoustic control console, The sound terminal and the sound control console are automatically searched by the network means, and each of the plurality of sound terminals transmits the sound data to the sound control console, and the sound control console is configured to allow selection of a specific sound terminal or adjustment method of sound data And for the sound data transmitted from the selected acoustic terminal The present invention relates to a system or method for providing control and integration services of sound data by adjusting the sound according to a method, outputting the sound to an audio output device such as a speaker, or transmitting the sound to another device.

In the present specification, an 'acoustic terminal' is a terminal system connected to a sound control console through a network and capable of transmitting and receiving data. The acoustic terminal is composed of one or more hardware systems and software such as a PC, a smart phone, a mobile phone, and a tablet PC. The acoustic terminal may further include software such as a display device for displaying acoustic information, an acoustic output device such as a speaker, and an input device such as a touch pad, a keyboard, and a mouse. In addition, it may further include an interface for connecting auxiliary input devices such as Bluetooth.

A 'sound control console' is a system connected to a plurality of sound terminals via a network, receives sound data from the plurality of sound terminals, and processes sound adjustment and integrated output or integrated transmission according to a designated method. Sound control consoles are typically used by sound control specialists to manage sound adjustments and integrated outputs and transmissions. The sound control console is composed of at least one hardware system and software such as a PC, a smart phone, and a tablet PC. The sound control console may further include an output device such as a display or a speaker, and an input device such as a microphone or a touch pad keyboard. The sound control console includes wired or wireless network means and maintains connections with a plurality of acoustic terminals.

Throughout this specification, 'performer' refers to a person using a microphone in a broadcast or performance stage. Although it is explicitly designated as a person, in the present specification, it is proper to broaden the scope to a subject who makes a sound with a specific sound apparatus or musical instrument.

In the present specification, 'sound adjustment' may simply include adjusting the volume of sound data arriving from a specific sound terminal or sound data to be output, but is not limited thereto. Including special treatment such as adjusting the sound balance of a specific range or canceling the sound or synthesizing a specific sound or modifying the voice itself. It can also be adjusted by a method of inserting or removing watermark sounds. In addition, the time required for the arrival time may be different depending on the state of the network in the acoustic data transmitted from the plurality of acoustic terminals based on the smart device as digital data. At this time, the task of adjusting the latency to match the time of the plurality of sound data to be mixed falls into the category of the sound adjustment.

'Sound adjustment' can be specified by including both the method of acoustic deformation and the degree of adjustment of the volume. The method specified here is referred to as the 'sound adjustment method'. The sound adjustment can be specified by a combination of at least one of the above methods and the degree of adjustment.

In this specification, the sound control is performed in the sound control console. In the sound control console, the sound control may be integrated with the sound control for the sound data received from the respective sound terminals or may be divided into two steps of sound control for the sound data to be transmitted to the other device . Also, the 'sound adjustment' may be composed of steps performed by the sound terminal in response to a request from the sound control console.

Generally, each performer in a broadcasting studio or performance stage uses a microphone, and uses a multi-sound control system for processing sound signals input from a plurality of microphones. In a sound control system for receiving and processing sound signals using a microphone from a plurality of performers, it is very important to select individual adjustments to the sound signals received from the respective microphones or whether to output individual sounds. It is also important to adjust the sound for the output sound.

Conventional acoustic consoles are composed of multiple microphones and HW sound consoles which adjust the sound signals received from the microphones. Microphones usually have independent power sources.

The sound console has terminals for connecting a plurality of microphones, each of which is provided with a sound adjusting means for the input microphone and a switch for selecting a microphone input. The acoustic console further includes a terminal capable of outputting a combined sound and is equipped with an acoustic adjustment device for adjusting the output sound.

Wired microphones have been widely used as instruments for performances. An independent power supply is used, and batteries are often used. It is difficult to use it if it is a concert where many performers need to move freely because the line is used continuously.

A wireless microphone that allows free movement of performers consists of a transmitter and a receiver. The wireless microphone transmitter corresponds to the microphone itself, uses a separate power source, and transmits a sound signal using a frequency such as FM. The receiver of the wireless microphone is configured to receive the acoustic signal and then transmit to the control console connected by wire.

Wireless microphones are composed of a limited number of microphones in a single receiver, and usually two channels or less are supported in a single receiver.

Microphones and sound consoles used in broadcasting and performances are distributed at various prices in connection with quality, etc., and the number of physical microphones is limited to the operation of microphones over a certain scale due to limitations of the terminal of the sound console and the FM frequency band that can be operated .

The sound integrated control technique in such existing performances usually has a limited number of microphones that can be simultaneously supported, and the cost increases as the number of microphones increases.

Because it supports a limited number of microphones, the performer must share the microphone and use precise preparation to effectively share the microphone among the performers.

The existing technology is inconvenient for a separate power source used for the microphone, and it takes a lot of time and effort to set up the microphones and sound equipment and adjust the pre-acoustics which are held every time when performing or broadcasting. The installation and sound adjustment of sound equipment by the sound experts leads to an increase in cost.

The present invention relates to a system and method for automatically connecting a microphone terminal by using widely used smart devices and communication means such as WIFI, Bluetooth, and LTE, receiving acoustic data from a plurality of acoustic terminals, This paper proposes a system and a technical method to adjust the sound of the output sound and to adjust the output sound. In other words, based on a universal data network, a system and method for replacing existing technology are provided by having a SW that performs sound control functions on widely-spread equipment such as smart phones, tablet PCs, and PCs, do.

For example, it is assumed that a plurality of performers located on the stage perform in front of spectators of the auditorium.

Each performer executes a SW that performs an acoustic terminal function on his or her own smart phone and performs a performance using a microphone provided in the own smart phone. At this time, the smartphone of the performer becomes the acoustic terminal. The smartphone is automatically connected to the sound control console through the network environment, and the SW receives sound of the performer as sound data through the microphone. The SW transmits the received sound data to a sound control console connected to the network. The sound control console analyzes the sound data received from a plurality of sound terminals and sets a balance between volume, delay time, tone, etc. between the sound terminals through sound adjustment.

The sound control console usually functions as a sound control console SW by being operated on devices such as a PC, a laptop PC, a tablet PC, a smart phone, and a PC. The sound manager provides an interface for controlling the sound, and the controlled sound is output to an output device such as a speaker.

If the performer is playing the musical instrument, the sound played from the musical instrument inputs the sound data of the acoustic terminal composed of the smart device of the performer, and transmits it to the sound control console.

The sound control console can be divided into separate loudspeakers that can be exported or integrated, or it can be stored as a separate sound file or transmitted to other devices using network means.

It is a problem to be solved by the present invention to provide a technical method for anyone to easily create a performance environment by using a microphone attached to the own smart device in accordance with the future development of the smart device and the network.

In order to solve the above-mentioned technical problems, the present invention provides a sound processing apparatus and a method for processing multi-sound data by using a plurality of smart device-based acoustic terminals and corresponding sound control consoles, This paper proposes a smart sound control integration method and system.

In order to construct a smart sound control integrated system, it is necessary to create and apply an optimized SW together with a configuration of a plurality of sound terminals, a sound control console, a network environment, and the like.

The acoustic terminal allows all performance performers to use their own independent terminal systems. A smart phone can be a good acoustic terminal. Mobile PCs, wearable computers, and tablet PCs can be used instead of smartphones. The sound terminal device can be installed with SW and can be equipped with a microphone, a wired microphone, a Bluetooth microphone or equivalent sound input device.

The sound control console uses a system such as a PC, a tablet PC, or a smart phone that can be operated by running SW. A wired or wireless network must be operational, and a wired network is better for stable performance.

The present invention can be completed by constructing specially designed equipment as an acoustic terminal or a sound control console in addition to a method of installing dedicated SW in general equipment. In order to provide a single sound control integrated system, it is preferable to include network equipment such as a wired / wireless router supporting WIFI.

In the present invention, in a plurality of audio terminals and a sound control console connected via a network, a sound terminal constitutes a device such as a smart phone, a mobile phone, a tablet PC, a laptop PC, a PC and the like, Smart phones, mobile phones, tablet PCs, PCs, and SWs running on these devices.

Here, the acoustic terminal includes a sound input module such as a microphone for receiving sound data, a communication module capable of transmitting / receiving the sound control console through the network, and means for outputting sound such as a speaker or a headset.

A method of configuring a multi-acoustic control integrated system using a smart device owned by each of a plurality of performers as an acoustic terminal includes the steps of: executing a SW that a plurality of smart devices possessed by the performer performs an acoustic terminal function; Automatically searching the sound terminal and the sound control console using the network means; Receiving a voice of a performer using a microphone of the acoustic terminal; Transmitting the sound data received from the microphone to the sound control console connected to the network; Receiving a sound control signal from a sound control console while maintaining a network connection with a plurality of sound terminals; Comparing the sound data received from the plurality of sound terminals with the sound control console and adjusting the volume of each other to automatically adjust the sound balance; Outputting a connection state and an acoustic data reception state of each acoustic terminal to a display device; Receiving a designation data of a sound control system or an integration target of a sound terminal; The sound control console performing sound adjustment of the sound data of each acoustic terminal in a specified manner; And outputting the sound data of the sound terminal designated as the integration target by performing sound adjustment in a predetermined manner, or transmitting the sound data to another device.

In the PC of the performance technician, the switch for the sound control console is executed and set as the sound control console. The sound control console displays information on the acoustic terminals of the respective performers on the screen by including them in the sound information. The information about the sound terminal is displayed by a method of selectively combining some of various methods such as an identification code, whether or not the sound is currently input, and a real-time volume change display of the inputted sound.

It is preferable that each SW used in a sound terminal or a sound control console is composed of a single SW, but in a control part such as a sound output or input, there is a high possibility that there is a separate SW prepared for each terminal. It is preferable to provide it.

The sound control console provides a means for specifying the sound adjustment method for the sound data arriving from each sound terminal, the application of sound integration to each sound terminal, and the sound adjustment method for the integrated sound.

Each sound data received by the sound control console from the sound terminal is an input sound, and the sound to be output by the sound control console to the integration target sound data or the sound to be transmitted to the other device is defined as the output sound.

Adjustment of the volume, delay time, and tone for the input sound is related to the sound balance as processing for the individual micro input sound terminal, and adjustment for the output sound adjusts the volume, delay time, It is not related to the acoustic balance adjustment between each acoustic terminal.

The sound manager designates a sound integration target for each acoustic terminal, determines a cancellation target, or designates a sound adjustment method for the input sound or the output sound. It also specifies the way the sound is adjusted for the output sound of the sound control console.

The sound control console individually processes the sound adjustment according to the designated method for only the sound data received from each sound terminal designated as the integration target. In addition, the sound control console processes and outputs the additional sound adjustment according to the sound adjustment designation method for the output sound only for all the sound data.

In the sound control console, the method of sound adjustment may be at least one of the methods of adjusting the volume of the entire range, adjusting the volume of a specific range, inserting a watermark sound, removing a watermark sound, removing a specific range of sound, As shown in FIG. In addition, the sound control console sends a command related to the sound adjustment to the specific sound terminal, and causes the sound terminal to perform the sound adjustment before transmitting the sound data to the sound control console.

The outputting step of the sound control console includes a step of performing sound adjustment according to the designated method of the sound data to be output and a first method of outputting the sound data to a device such as a speaker or an amplifier, 2 method, a third method of transferring data to another device connected to the network, and a fourth method of storing the data in a designated storage device.

In the present specification, the steps of outputting data to be stored or output in connection with sound output, and transmitting the data to an amplifier or another server are described in short.

The sound control console analyzes the sound data of each sound terminal to automatically set the sound control method for the sound terminal, the step of receiving the sound control method from the user, or the step of receiving the sound control method to the specific sound terminal It is also desirable to further configure the step of requesting adjustment in a particular manner.

It is also preferable that the sound control console further includes a step of providing a sign-in procedure of a performer and a separate sign-in process for each sound terminal.

The present invention can realize a voice integration system that utilizes widely-spread smart devices. That is, when a plurality of performers inputs sounds by using a microphone connected to a plurality of smart devices, the smart device transmits sound data each secured as an acoustic terminal to the sound control console, and the sound control console selectively transmits the sound data It is possible to configure a popular multi-voice control console system which does not require the setting work of the sound experts by automatically setting the volume balance for the sound of the sound terminal and setting the sound terminal automatically with good portability .

As the HW device or SW is widely used, the rate of technology improvement is fast, but the price of related products tends to gradually decrease. Conventional professional microphones are expensive compared to microphones of personal smart handsets, but the quality of microphones attached to widely used personal handsets can be improved much more quickly.

These multi-voice control consoles can extend the use of wireless microphones in the performing stage by utilizing popular equipment such as mobile phones and PCs. In addition, by using personal devices, it is possible to reduce the purchase cost of additional microphone equipment and reduce the power management burden on individual microphones

The present invention can be implemented not only as a console for multi-voice control of performers but also as an extension to a sound device such as a musical instrument, thereby realizing an inexpensive but functional sound integration console system corresponding to multiple sound terminals.

According to the present invention, by supporting a method of processing a digital sound adjusting method by computing, automatic mutual searching between an acoustic terminal and a sound control console and automation of sound balance and sound adjustment through sound data analysis can be pursued. It does not require the input of experts to set up the sound equipment, and it can be widely used in amateur broadcasting and performances.

The present invention eliminates the limitation of the number of microphones at the performance site, so that the entire performer can use his own microphone. This reduces the burden of pre-equipment installation and testing, reduces the inconvenience of exchanging microphones, and reduces unnecessary contact with multiple people, thus greatly contributing to personal hygiene.

As the spread of smart phones has led to the possession of HD cameras by everyone, the technological advances of widely-deployed hardware products tend to progress more rapidly than those of individual devices. As the functions of the microphones and the power management of the smart devices for personal use are enhanced, the present invention will provide a more effective integrated management service while avoiding redundant investment in individual devices.

1 is a diagram illustrating a configuration of a smart multi-acoustic control integrated system according to an embodiment of the present invention.
2 is a block diagram illustrating the configuration of the acoustic terminal of FIG.
3 is a block diagram illustrating the configuration of the sound control console of FIG.

The description of the present invention is merely an example for structural or functional explanation, and the scope of the present invention should not be construed as being limited by the embodiments described in the text. That is, the embodiments are to be construed as being variously embodied and having various forms, so that the scope of the present invention should be understood to include equivalents capable of realizing technical ideas. Also, the purpose or effect of the present invention should not be construed as limiting the scope of the present invention, since it does not mean that a specific embodiment should include all or only such effect.

Meanwhile, the meaning of the terms described in the present invention should be understood as follows.

The terms " first ", "second" and the like are used to distinguish one element from another, and the scope of the right should not be limited by these terms. For example, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" to another element, it may be directly connected to the other element, but there may be other elements in between. On the other hand, when an element is referred to as being "directly connected" to another element, it should be understood that there are no other elements in between. On the other hand, other expressions that describe the relationship between components, such as "between" and "between" or "neighboring to" and "directly adjacent to" should be interpreted as well.

The use of the singular should be understood to include a plurality of representations unless the context clearly dictates otherwise, and the terms "comprise" or "have" are used to denote a feature, number, step, operation, It is to be understood that the combination is intended to specify that it does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

In each step, the identification code (e.g., a, b, c, etc.) is used for convenience of description, and the identification code does not describe the order of each step, and each step clearly specifies a specific order in the context Unless otherwise stated, it can happen differently from the specified sequence. That is, each step may occur in the same order as described, may be performed substantially concurrently, or may be performed in reverse order.

Unless defined otherwise, all terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Commonly used predefined terms should be interpreted to be consistent with the meanings in the context of the related art and can not be interpreted as having ideal or overly formal meaning unless explicitly defined in the present invention.

Referring to FIG. 1, the sound control console 100 should maintain a connection state with an acoustic terminal by a wire / wireless communication method. The sound control console 100 and the sound terminal 200 are configured to receive and transmit digital data such as sounds and images through a network.

In FIG. 1, a configuration of a typical smart multi-sound control integrated system, which is provided with a sound control console 100 and an acoustic terminal 200 and is connected by communication means such as RF, WIFI, LTE, Bluetooth or the Internet, is shown.

The sound control terminal 100 is equipped with a display and displays sound information related to sound data received from the sound terminal 100. The acoustic terminal in the currently connected state is displayed through the display and the acoustic information related to the acoustic data received at each acoustic terminal is displayed.

The acoustic information related to the acoustic data includes at least one of information on on / off of a microphone of a specific acoustic terminal, data capable of identifying a user such as a name or a photograph of a performer using the acoustic terminal, and an equalizing graph of acoustic data to be received .

It is preferable to display the information registered in the acoustic terminal to be connected even if it is not connected to the display of the sound control terminal 100 and to indicate that it is in the disconnected state.

The sound control terminal 100 displays a visual change amount of sound data in a manner of displaying a real time graph. For example, it is preferable to display a change in the volume of the entire range or a change in the volume of each band in real time using a graph.

The acoustic terminal related to the acoustic terminal and the acoustic data displayed on the display of the acoustic control terminal 100 displays whether or not the acoustic integration target of the acoustic terminal is designated and the method of individually adjusting the acoustic adjustment for the inputted acoustic data.

The methods of adjusting the sound include adjusting the overall volume, adjusting the volume of the specific range, deleting the sound of a specific range, converting adult voices to child voices, amplifying sounds of a specific range such as bass , And a complex transformation including a plurality of sound changes.

Here, the articulation information including the sound adjustment method to be changed, the degree of sound adjustment, the representative name, or the explanatory text is displayed on the display in the form of visualization using a graph, a graphic or a character.

The sound control console 100 is preferably configured in the form of at least one of a PC, a smart phone, a laptop PC, and a tablet PC, and an application executable in the system.

The executable application is a SW which collectively controls the functions of the sound control console so that it can be downloaded to a server on the Internet and downloaded and installed by each user.

Referring to FIG. 2, the sound control console 100 includes a communication module 101 that maintains connection with an acoustic terminal and transmits and receives data, and a communication module 101 that sets acoustic data of the acoustic terminal to designate integration target, And a setting module 102 used to designate an adjustment method of the display device.

The setting module 102 of the sound control console 100 enables a user to designate or release an integration target to a specific sound terminal by utilizing an input module. In addition, the setting module 102 analyzes sound data of a specific sound terminal or analyzes sound data of a plurality of sound terminals and automatically adjusts the sound adjusting method and level for each sound terminal.

The automatic setting function of the setting module 102 compares the volumes of sound data arriving from a plurality of sound terminals and adjusts the volume of a specific sound terminal.

That is, after setting the volume value to be adjusted by referring to the average value, the sound terminal is adjusted to adjust upward for an acoustic terminal to which a low volume is inputted, and to adjust the level of sound volume for an acoustic terminal inputted with a high volume value.

The sound adjusting method for the specific acoustic terminal of the automatic setting function of the setting module 102 can adjust the volume by comparing the volume of a specific frequency band.

The automatic setting function of the setting module 102 compares the volume of the average sound data for a predetermined time of a plurality of sound terminals and designates the sound adjustment method of the individual sound terminal to adjust the volume to a certain level. It is preferable to make the sound adjustment method automatic, but it is necessary for the user to manually adjust the sound adjustment method in case of an exceptional case.

The automatic setting function allows the user to set the sound balance to be automatically adjusted in response to various sound equipment such as a microphone mounted on a plurality of sound terminals.

The acoustic balance is divided into the volume balance and the tone balance of a plurality of terminals. Acoustic balance is obtained by ensuring an appropriate value for the sound adjustment taking into consideration the characteristics of each sound terminal and then adjusting the sound of each sound terminal with the adjustment value to be used for sound integration.

The sound adjustment may be performed by comparing the respective sound data or the sound band with one another. However, it is also possible to adjust the balance while narrowing down the error range by measuring again the changed one after the adjustment. The error range of the balance is reduced to a certain level or less It is preferable to designate the adjustment value at that time as an appropriate value.

The sound control console 100 performs a repetitive operation of comparing the sound input values while changing the volume adjustment value of the terminal and the volume adjustment value of each terminal of the terminal to find a sound balance value of a certain level. The automatic acoustic balance setting is a first method in which the acoustic terminal adjusts the volume of the entire volume or a specific band by a request of the acoustic control console 100, a first method in which the acoustic control console 100 receives the acoustic data, And a second method of adjusting the volume of the second electrode.

In order to perform the first scheme, the setting module 102 must have a function of transmitting a sound adjustment command for instructing adjustment to a volume or a whole volume of a specific band to a specific sound terminal, You should make the sound adjustment according to the command.

The setting module 102 is configured to automatically or manually adjust the tone color of each sound data. It is also desirable to configure the tone color for specific sound data to be automatically or manually adjusted. You can configure the sound for the tone by placing the theme or by directly specifying the volume control for each band.

The setting module 102 allows adjustment of the acoustic balance for a plurality of sound data by adjusting the delay time of each sound data received at each sound terminal.

The setting module 102 can designate only the volume. However, if the special effect is designated, the setting module 102 can be set to be strong or low based on the special effect, and a method of inserting or deleting a specific watermark, A method of adding a sound volume, and a method of adjusting a sound volume by a transliteration.

The setting module 102 has a function of presetting confirmation information necessary for log-in when allowing access to the sound terminal through the login process. The setting for login consists of an identifier that can distinguish the sound terminal and additional information necessary for authentication confirmation.

Also, the setting module 102 can additionally register an acoustic terminal to be connected. A sound terminal can display a name or a specific number. If the sound terminal is not connected, the sound terminal can be easily distinguished on the screen.

When a new connection is established among the registered sound terminals, the sound control console displays on the display such that the sound terminal is easily connected.

The sound control console 100 further comprises a login module 104 for collecting information on performers who are voice terminal users and maintaining the qualifications of the performers, and a storage module 105 for storing various information.

The sound control console further includes an acoustic output module 107 for outputting acoustic data integrated with an input module 106 such as a microphone, a keyboard, a keypad, a touch pad, or a mouse. The sound output module 107 of the sound control console 100 may be a speaker, a storage device, a network, or the like.

Although not shown in the drawings, the sound control console 100 preferably further includes a display module. The display includes display related devices such as graphic output terminals. In the case of a notebook, a tablet PC, or a smart phone, a display screen can be regarded as a display. In the case of a notebook, a terminal for connecting a display device such as HDMI is also regarded as a display output terminal.

The sound control console 100 allows the user to designate an output to another specific acoustic terminal for acoustic data received from a further configured microphone or arrives from a specific acoustic terminal or output to a sound output device by a specific software.

That is, when there are a plurality of acoustic terminals in the form of A, B, C, D,... The sound data arriving from the acoustic terminal A is subjected to the sound adjustment in a manner specified for the input sound, the sound adjustment for the output sound is performed or integrated, and then the sound data is transmitted to the acoustic terminals B and C.

The sound control console 100 transmits the sound data whose output is specified to a specific sound terminal by using the network module.

3, the acoustic terminal 200 includes a communication module 201 for maintaining connection with a sound control console and transmitting and receiving data, a display 202 for displaying acoustic information currently input to the sound control console, An input module 203 for inputting a voice or a specific value, an acoustic output module 204 for outputting sound like a speaker, or an acoustic output module 204 for storing sound such as a disk or a USB memory.

It is preferable that the acoustic terminal 200 utilizes smart devices such as a smart phone or a tablet PC widely popularized by the general public. In this case, the SW corresponding to the smart device is uploaded to the server on the network, and downloaded, installed and executed whenever necessary, and the audio terminal function is used.

The acoustic terminal 200 may be replaced with a personal laptop PC or a PC. At this time, a dedicated application that can be executed in the system is developed, uploaded to the server, and downloaded and used.

The acoustic terminal 200 may be implemented as a method of installing and distributing application applications in a terminal designed as a dedicated system.

The acoustic terminal 200 includes an acoustic data input module equivalent to a microphone or a microphone. In addition, a network module is configured to transmit sound data to the sound control console.

The acoustic terminal 200 may also perform a sound adjustment before transmitting the sound data to be transmitted according to a request of the sound control console and transmit the sound data. A network module such as LTE or WIFI can be used for mutual connection and data transmission between a sound terminal and a sound control console, and implemented using an internet protocol.

The acoustic terminal 200 can use different smart devices. Depending on the network situation, the acoustic data received at the respective sound control consoles have physical delay time, and the respective delay times can be changed. Therefore, it is necessary to adjust the delay time to balance the acoustic terminals.

The acoustic terminal 200 may be constructed by adding input modules such as a touch pad, a keypad, a keyboard, or a mouse, and it is also preferable that the built-in microphone is replaced with an external input device such as a Bluetooth or a headset.

The sound terminal 200 and the sound control console 100 are provided with means for satisfying various conditions for efficient transmission and reception of sound data. It is preferable to use a protocol for transmitting and receiving sound data in real time. It is also desirable to introduce a compression algorithm or to add an encryption algorithm so that efficient data transmission is possible in case that the number of acoustic terminals increases.

An application for the acoustic terminal is installed and executed in the acoustic terminal 200. When the performer inputs voice or the acoustic data is input from the acoustic device, the acoustic terminal 200 transmits the acoustic data to the acoustic control console 100 . At this time, the compression and encryption transmission protocol of the sound data corresponds to the sound control console 100.

It is also preferable that the sound control console 100 and the sound terminal 200 can be easily distinguished by allowing the sound terminal 200 to perform a login process for smooth connection. That is, the ID of the person using the sound terminal, the name of the face, and the name of the person.

The sound terminal 200 outputs sound so that the corresponding performer can hear the sound data transmitted from the sound control console 100. In this case, it is preferable to use an acoustic output module such as a speaker or an earphone, and display it on the display in place of or in place of the acoustic output module.

When the acoustic terminal 200 receives a sound adjustment command or related data requesting to adjust the pre-transmission of the sound data from the sound control console, the sound terminal 200 adjusts it to the request and transmits the sound data to the sound control server.

The pre-transmission sound adjustment commands of the sound data arriving at the sound terminal include, for example, equalization or tone adjustment of sounds contained in the sound field, volume adjustment, addition or deletion of specific watermarks, change of transmission protocol, change of compression method, May be included. The pre-transmission sound adjustment command may include a change in the manner of receiving sound data.

The watermark is a method of inserting a separate sound to provide sound information in a form recognizable by the sound control server without being perceived by the human ear in the sound data. When receiving a request for transmission of specific test sound data from the sound control console 100, the sound terminal 200 transmits the test sound data to the sound control console 100.

A smart device such as a laptop PC, a PC, or a smart phone used as a practical HW of the acoustic terminal 200 often has a terminal or a speaker for a microphone and an acoustic output. It is preferable that the volume control function of the sound control console is complementary or interlocked with the SW executed in the existing HW equipment in case that the SW function for adjusting the volume corresponding to the HW is also included.

The sound control console 100 permits the connection of the voice terminal from the communication module 101 and keeps the log in so that each acoustic terminal can be easily distinguished. The division of each terminal is classified into Ethernet information, IP address or connection address, user ID or name, connection number, and the like.

When the sound control console 100 has a login process, the sound terminal 200 attempts to log in by transmitting a separate identifier and additional information necessary for log-in of the sound terminal. If necessary, input and use necessary identifiers and additional information from the user.

In order for the sound control console 100 to easily distinguish each sound terminal, it is possible to use a unique ID value that can identify the sound terminal automatically obtained, use it as information related to the logged-in user through the sound terminal, May be configured to directly input separate information to the corresponding terminal in the sound control console.

The sound control console 100 includes information about the separated sound terminals in the sound information and displays them on the display. Whether or not the sound data coming from the sound terminal is mono or stereo, the current volume of the sound data, the adjustment method for the sound data, and whether the sound data is included in the integration are displayed together with the information of the respective sound terminals. It is recommended to display the total volume of the sound being input and the volume of each sound field in a graph or a number, but to show the real-time situation change.

In the adjustment method for the sound data in the sound control console 100, a method of adjusting the total volume to be input, a volume of a specific sound range, a specific water mark sound is to be included or deleted, a delay time of the sound data is increased or decreased , And adjustment information on whether to add a specific sound.

The sound control console 100 displays the selection status to the integrated sound or the adjustment status of the output volume. The output volume can be displayed as a number or a graph for the volume of the entire range or the volume for a specific range, but the change value can be easily judged according to the time change.

The sound control console 100 receives data on selection and cancellation of the sound integration target of a specific sound terminal from the input module, and displays it on the screen and records it in the adjustment information. The sound control console 100, when receiving data designating a sound control method of a specific sound terminal, displays it on a screen and stores sound control specifying data in a memory or in a storage device.

The sound control console preferably provides a method of providing a login function of the user unit to the sound terminal or a method of inputting and receiving a name or a picture corresponding to the device identification value if not so that the sound control and the performer are matched and displayed on the screen Do.

The sound control console 100 performs the sound adjustment according to the designated method for the sound data of the sound device selected as the integration target. If there is no adjustment, it is natural to omit the sound adjustment for the sound data.

The sound adjustment of the sound data of the sound control console 100 can be performed by deleting the watermark, deleting the sound source of a specific range, adjusting the volume of a specific range, adjusting the volume of the entire range, adding specific sound data, It is preferable to configure the apparatus so as to be able to selectively process and process it. In this case, it is needless to say that data related to the adjustment function must be inputted through the corresponding input module.

The sound control console 100 can change the tone of specific sound data by dividing the interval of the frequency band with respect to specific sound data received from a specific sound terminal and adjusting the volume of each frequency band. This function can balance the sound by adjusting the tone of the overall sound data similarly, or it can be used as a method of displaying specific sound data.

In the volume control of the sound control, the sound control console 100 allows automatic sound control through white noise by allowing the volume to be adjusted by comparing specific frequency bands coming in simultaneously from all the sound terminals.

The sound control console 100 may vary the arrival time of sound data depending on the network conditions and the characteristics of each sound terminal when a plurality of sound terminals are based on a smart device and operate in an IP-based network. Acoustic adjustment is also necessary to compensate for the delay time of arrival of acoustic data.

The method of adjusting the delay time of the sound data received from each sound terminal by the sound control console 100 is to balance the delay time deliberately with the delay time after deliberately receiving the respective sound data, .

In order to adjust the lag time of the sound data, it is necessary to obtain the difference of each lag time, to determine the optimum lag time to be commonly adjusted for the unified time balance, and to adjust to the determined lag time for each sound data And an adjustment step.

The difference in lag time for acoustic data can be easily solved by measuring the arrival time of acoustic data in a specific frequency band among the common acoustic data, and can also be replaced by a method utilizing RT technology.

Each sound terminal sends an acoustic adjustment command for adjusting the delay time to each acoustic terminal, and each acoustic terminal adjusts the amount of delay intentionally according to the acoustic adjustment signal or adjusts the amount of packets to catch up with a transmission rate that is too late So as to adjust the sound.

The sound adjustment performed by the sound control console 100 causes the sound terminal 200 to transmit the respective sound adjustment commands and reduces the load of the sound control console 100 by allowing each sound terminal to perform the sound adjustment function Or allow the sound control console 100 and the sound terminal 200 to process them at the same time.

The sound control console 100 includes a first method for integrally outputting the respective sound data processed through the sound adjustment step to the speaker, a second method for switching to integrated sound data and transmitting the integrated sound data to another device connected to the network, A third method of transmitting a sound signal to a recording apparatus, and a fourth method of recording to a recording apparatus.

The sound control console 100 allows to add a function of selectively sending specific sound data to the connected acoustic terminal. The specific sound data may include the integrated sound data, the sound data received from the sound terminal to which the director supervises the performance, the sound data input from the microphone attached to the sound control console, the sound output from the execution result of the specific application Data can be selectively adopted for each data.

The automatic sound adjustment module 103 of the sound control console 100 analyzes a total volume change of sound data coming from each sound terminal, a volume change of a specific sound range, whether or not a watermark sound source is included, Automatically sets the sound adjustment method.

The automatic sound adjustment module 103 requests transmission of sound data for testing to a specific sound terminal, and when test sound data comes in response to the sound, the automatic sound adjustment module 103 analyzes a sound signal of the sound terminal, The optimum adjustment value for each terminal is automatically searched to automatically adjust the acoustic balance for the acoustic terminal of the terminal. Here, the optimal adjustment value can be about how to adjust the volume of the sound, how to adjust the volume, etc., and how long each delay time is to compensate.

The optimum adjustment value includes the value of the volume of the entire range of the specific terminal or the value of the volume adjustment of each band. The automatic sound adjustment module determines to adjust the sound balance using the optimal adjustment value for each terminal. And thereafter continuously adjusts the volume of the entire sound range or the sound volume of each band by using the adjustment value until the adjustment value is determined again.

In order to capture the automatic sound adjustment, a standard sound is output using a noise of a specific frequency or an acoustic output device for comparison, and the sizes of sampled sounds of the standard sounds are compared with each other in the sound data received from each sound terminal Method is preferably used. The standard sound used to automatically adjust the sound balance can be replaced with a watermark sound.

In the step of automatically designating the sound adjusting method by the automatic sound adjusting module 103, it is possible to automatically perform the sound adjusting method manually specified by the sound technical person in advance. Depending on the sophistication of the technology, it may be possible to perform more physically sophisticated sound adjustments than the results of the sound technician.

The sound control console 100 displays real-time sound information on the finally outputted output sound on the screen. It is preferable that the real time sound information for the output sound is displayed in a visual manner such as a graph or the like in real time as to the total volume of the outputted sound and the output volume of the specific sound range.

The input module of the sound control console 100 receives data related to the sound control method for the output sound. It is preferable that the sound control console 100 is configured as a GUI system in which contents are displayed on the display when receiving the data specifying the sound control system.

Laptop PCs, PCs, and the like, which are used as actual HWs of the sound control console 100, often have terminals and speakers for microphone and sound output, respectively. It is preferable that the volume control function of the sound control console is complementary or interlocked with the SW executed in the existing HW equipment in case that the SW function for adjusting the volume corresponding to the HW is also included.

In the sound control console 100, the interface for setting the sound control method for the output sound is implemented similar to the method for setting the sound control method for the individual sound terminal. That is, it provides a graphical interface suitable for specifying each adjustment method and adjustment order using a touch pad, a mouse, a keyboard, and the like. In addition, the user can easily receive designation data from an input device such as a touch pad or a mouse.

The sound control console 100 modifies the input sound specified as the sound integration target to match the sound adjustment content of the output sound, and outputs the modified sound. Here, the sound adjustment includes at least one of a total volume adjustment, a volume adjustment of a specific range, removal of a specific watermark, inclusion of a watermark, deletion of a specific range of sound data, and addition of specific sound data.

The sound adjustment method for the output sound of the sound control console 100 may be selected from a method of adjusting the sound after total integration or a method of integrating after adjusting individual sounds. In addition, we integrate them into several groups and then integrate them after sound adjustment.

The output sound output method of the sound control console 100 allows the sound output to be directly performed by a connected speaker or an amplifier. The input sound can be divided into several groups and divided into separate speakers or amplifiers, or the integrated input sound can be output to a speaker or an amplifier.

The sound control console 100 allows the sound terminals to be divided into a plurality of groups and managed. In other words, when there are several performances, each group of performers is separately set for each performance, and each group manages information of acoustic terminals corresponding to the performers participating in a specific performance separately. The microphone function of all acoustic terminals included in a specific group can be activated or deactivated at one time. At this time, an input module for receiving the group belonging information of the cast terminal and a storage module for storing and managing information of the entered cast are additionally constructed.

The sound control console 100 outputs the output sound through an audio output device such as a speaker or an amplifier or by storing the output sound in a storage device. The storage device includes a hard disk, a USB memory, and the like. The sound control console 100 outputs an output sound by transmitting the sound to another apparatus via the network.

In the output step of the sound control console 100, a method of classifying a plurality of sound data into groups and partially integrating and outputting the sound data among the groups, a method of integrating and outputting all the sound data into one sound data, a method of integrating and outputting some sound data To be output by one or more methods.

And a GUI input / output interface for expressing and specifying the sound adjustment method of each sound terminal in a screen so that the sound adjustment method of the sound control console 100 can be easily designated.

The present invention can be further configured to manage the voice of a conference system or the like in which a plurality of users participate. This has the advantage of being able to use his own microphone equipment that he is familiar with at the meeting.

In order to manage the permission and blocking of the voice, the voice input application of the voice terminal 200 is received and the voice data is transmitted to the voice control console 100. The voice control console 100 receives the voice request from the specific voice control console Receiving an input of whether or not the talk right is permitted from the manager; And when the voice is granted, the audio terminal is notified of the permission and the audio data is received.

When the sound terminal 200 receives the notification that the voice is granted from the sound control console 100, it outputs the related information to the separate display or outputs the related information by sound to the sound output module so that the performer can recognize the voice.

The sound control console 100 adds a function of dividing and setting a plurality of sound terminals into a plurality of groups. And output the acoustic terminal groups included in each group in a distinctive manner.

The sound specified as the integration target is separately integrated from the sound terminal of the specific group and output independently. That is, the streaming server can be output by a method of transmitting to a specified sound terminal, and a streaming server can be designated separately for each sound terminal group, and when a streaming server is designated, output sound can be transmitted to the server.

The group of the sound terminals may bundle the sound terminals using the same language. In this case, the sound terminal may be concurrently grouped so that the sound of the interpreter can be shared by the interpreter of a specific language.

It is preferable that the acoustic terminal 200 and the sound control console 100 are connected to a single network using a WIFI hotspot using one private IP address. In WIFI, it is necessary to group specific service ports by using specific IP addresses.

Here, one side of the acoustic terminal 200 or the sound control console 100 is provided with a mutual automatic search function by allowing the other side to be searched. Automatic discovery tracks IP addresses and access ports within a specific category, or shares them using a server, to eliminate the hassle of manually entering IP addresses and access port numbers.

Even if an audio terminal and a sound control console are automatically assigned an IP address without using a specific IP address, a specific port is automatically opened and an attempt is made to connect to an IP address of a possible category automatically, A control console or an acoustic terminal.

Also, the audio terminal or the sound control console registers its own IP address and connection port number on a separate server on the Internet, and the other party connects to the other server, and the corresponding party tracks and tracks the corresponding IP addresser and access port .

More than one sound control console may be operating simultaneously within a network using a single WIFI router. At this time, a plurality of control consoles selectable to the user of the sound terminal are displayed on the display and one of them is selected.

In the above automatic search function, when IP address is received from WiFi and network router, the automatic search function automatically searches for IP address of 192.168.1. * Band in case of IP address of end number 0 to 256, .

It may be possible to track all IP addresses, but it is desirable to get a valid value through another server on the network or to search by specifying the search range.

The automatic search function consists of confirming each other between the sound terminal and the sound control console. The sound information of the automatically detected sound console can be displayed on the display of the sound control console or can be additionally configured to be turned on or off using the input module of the sound control console.

If one of the sound terminal and the sound control console automatically tracks and configures the other side, if the WIFI network is successfully established, the sound control console and the sound terminals can be automatically searched and used conveniently.

100: Sound control console
200: acoustic terminal

Claims (14)

In implementing an acoustic mixer system using a sound control console connected to a plurality of acoustic terminals via a network,
An audio terminal based on a smart device for automatically searching a sound control console using wired or wireless network means and receiving sound data and transmitting the sound data to a sound control console;
A plurality of sound terminals connected to the network through an automatic search method, receiving sound data from the plurality of sound terminals, displaying a part of the sound information of the plurality of sound terminals on a display, A sound control console for outputting to an output module; Wherein the sound control unit comprises: The method according to claim 1,
Wherein the sound terminal includes an output module for outputting sound data and is an acoustic terminal for outputting the sound data through an output module upon receipt of sound data from the sound control console; Wherein the sound control console is a sound control console for transmitting specific sound data to a specific sound terminal. The method according to claim 1,
The sound control console may include a first method for comparing sound data arriving from a plurality of sound terminals and adjusting sound data by itself, and a second method for sending an adjustment command of sound data to a specific sound terminal, Wherein the controller is a sound control console for adjusting the sound balance of the terminal. The method according to claim 1,
Wherein the sound control console includes a first method of requesting a specific sound terminal to perform sound adjustment before transmission, and a second method of specifying a sound adjustment method of sound of the specific sound terminal by the sound terminal, Wherein the data is sound-adjusted. The method according to claim 1,
Wherein the sound terminal is a smart device such as a smart phone, a tablet PC, a PC, and the like, and downloads an SW functioning as a sound terminal from a server and uses the installed SW terminal. The method according to claim 1,
Wherein the sound control console is one of a smart phone, a tablet PC, and a PC, and the SW that executes the sound control console is downloaded from a server and installed and used. The method according to claim 1,
Wherein the sound control console divides and manages a plurality of sound consoles into a plurality of groups, and integrates and outputs sound in a divided manner. In implementing an acoustic mixer system using a sound control console connected to a plurality of acoustic terminals via a network,
A step of automatically searching a plurality of acoustic terminals and a sound control console;
The sound terminal receives the sound data and transmits the sound data to the sound control console.
The sound control console receiving respective sound data from a plurality of sound terminals;
The sound control console displaying acoustic information of each acoustic terminal to a plurality of acoustic terminals;
Wherein the sound control console outputs sound data arriving from the plurality of sound terminals. The method of claim 8,
The acoustic terminal further comprises outputting sound when acoustic data arrives from the acoustic control console;
Wherein the sound control console further comprises transmitting specific sound data to a separately designated sound terminal. The method of claim 8,
Executing the SW performing the sound terminal function by the sound terminal; or
And executing a dedicated SW in the sound control console. The method of claim 8,
Analyzing acoustic data received from the specific acoustic terminal by the acoustic control console;
The method further comprises adjusting the acoustic balance between the plurality of acoustic terminals in at least one or more of a first manner in which the acoustic control console self-adjusts the acoustic data, and a second manner in which the acoustic control command is transmitted to the specific acoustic terminal Wherein the sound control unit is configured to control the sound control unit based on the sound control signal. The method of claim 8,
Wherein the acoustic terminal is one of a smartphone and a tablet PC and the acoustic terminal executes a dedicated SW. The method of claim 8,
Wherein the sound control console is one of a smart phone, a tablet PC, a PC, and a laptop PC, and the sound control console executes a dedicated SW. The method of claim 8,
Wherein the sound control console comprises: dividing connected acoustic terminals into a plurality of groups; Wow
Wherein the plurality of steps necessary for sound adjustment are performed independently for each group on only acoustic terminals included in a specific group.

Images