KR20020062921A - Recording and playback control system - Google Patents

Abstract

The present invention relates to a system for recording and reading both program data and sound control data and reproducing the data to optimize the performance of audio reproduction and to reproduce the effect sounds of the original sound environment. The system includes a recording device 10, a reproduction device and a recording medium. The recording apparatus 10 generates a recording medium having both sound control information and audio data. The playback device gives the user the ability to surpass other automatic variable adjustments. Optionally, metadata display system 90 collects information about the physical arrangement and recording time of the instrument and other characteristics of the recording studio and makes the information visually useful to the listener. The player type register 82 identifies the characteristics of the playback apparatus to adjust the characteristics of the playback system.

Description

Recording and playback control system {RECORDING AND PLAYBACK CONTROL SYSTEM}

The present invention relates to an apparatus and method for reproducing recorded material from a medium, but is not particularly limited to high density optical recording media such as DVD discs containing acoustic data, for example, music. For the purposes of this description, the term "music" should be fully recognized to encompass the realization of the image. A significant limitation of the system is that viewers (in the context of the "listener" in this text) may be controlled by a party to record the music in a studio or concert hall and to attempt to reproduce the intended sound of the musician at another venue, i.e. at home or in a car. To the music). However, since the recording and reproducing places mostly always have different acoustic characteristics, it is impossible to operate the reproducing equipment to the satisfaction of the listener.

The present invention relates to a system for recording and reproducing audio information on an optical recording medium. Specifically, the present invention relates to a system for correcting for a difference between the characteristics of a recording and reproduction location.

1 is a block diagram of a recording apparatus;

2 is a typical sector on a recording medium according to the present invention;

3 is a block diagram of a playback apparatus;

4 is a detailed view of a delay circuit;

5 is a block diagram of a closed loop control configuration; And

6 is a block diagram of a noise canceling circuit according to the present invention;

The present invention records and reads audio visual control data (hereafter referred to as "sound control data") together with music program data, and programs according to the sound control data to optimize the execution of audio reproduction and reproduce the original sound environment. Provide a system for reproducing data. Basically, the present invention provides a system for incorporating sound control data into information stored on a medium, and provides an element which, during playback, responds to control data during playback of a music program. The acoustic control data includes several variables and may preferably be used to regulate the operation of the playback system as accurately and frequently as millisecond intervals.

The system of the present invention includes a recording apparatus, a reproduction apparatus, and a high density digital recording medium, such as a DVD. The recording apparatus, in addition to the standard equipment, includes a precision microphone, a controller, a test signal generator and a data multiplexer for calculating a recording medium having both sound control information and audio data.

The playback system collects information about the physical arrangement of the instrument in a recording studio, optionally a demultiplexer, a user input interface that gives the user the ability to surpass other automatic variable adjustments. A metadata display system that visually makes it useful to the listener and a register that identifies the characteristics of the playback device. The reproduction device further includes a data processing element for processing the sound program data and dynamically controlled using the sound control data.

In addition, open and closed loop control schemes are provided. In an open loop scheme, the acoustic characteristics of the local playback site are provided by the listener in the playback device to the playback device.

In a closed loop control scheme, the acoustic parameters of the playback site are automatically determined by generating an acoustic test signal and sensing the response. In all cases, the characteristics of the recording and reproducing place are compared and used to control the operation of the reproducing element.

The reproducing apparatus may include a noise canceling circuit for receiving specific information of the sound program data from the recording place.

The present invention is disclosed with respect to certain preferred embodiments in conjunction with the drawings. This preferred embodiment of the present system relates to the generation and reproduction of audio data recorded on a pure audio DVD (Digital Versatile Disc). DVD is an optical recording disc medium having a very high data density of audio data and MPEG compression. The system, in addition to the DVD, further includes, in the text, the user's appreciation of the recording device and DVD from the overall recorder and the recording device, which refers to all of the equipment involved in the creation of a DVD medium having data depicting music live performances or other similar performance activities. It is composed of a playback device to be played back.

Referring to Fig. 1, the recording apparatus 10 is arranged at a recording place or site. The apparatus includes a plurality of first microphones 12 used for collecting sound generated during a performance. The signal generated by this microphone 12 is transmitted to a multichannel recorder 14. The signal is. For later processing, it may be stored in recorder 14 or immediately sent to mixer 16. The mixer 16 combines this signal into a multi-channel and stereo flow of audio data, referred to as program data for simplicity.

An important feature of the present invention is that before the performance is recorded, the data generator 18 measures the acoustic state of the recording site or controls the performance room and stores the above in memory 20. To measure this condition, the generator 18 operates a test signal generator 22, which in response generates a predetermined test signal to the auxiliary speaker 24. The precision microphone 17 senses the response to the test signal at the recording site and sends the response to the generator 18 and stores it in the memory 20. The recording location (or scene) is the actual area where the performance is performed. In addition, data generator 18 also receives hybrid information from mixer 16 and similarly stores the information in memory 20. In addition, the performance producer may input specific data related to performance performance reproduction into the memory 20 through the keyboard 26. All such information is referred to collectively as sound control data.

The sound control data stored in the memory 20 is inserted in the DVD together with the audio information and used during playback of the DVD to reproduce the state in which recording is made or other state selected by the producer, as more fully posted below. . In more detail, the memory 20 includes information that describes the acoustic characteristics of the space where the recording is to be made. Of course, these characteristics depend on the size of the space, the composition of the wall covering, the height, etc., all of which influence how the sound is recorded. These characteristics sequentially affect certain acoustic characteristics, such as delay, echo, and the like, and are measured by the data generator 18 from the response to the test signal from the generator 22.

In addition, the manner in which the sounds from the different microphones 12 are mixed, i.e. the various ratios or ratios, are reproduced by the speaker at a ratio according to this mixing ratio, as described below, for the most accurate reproduction. This is important when the performance is played back, especially in multichannel systems. Therefore, this information is also recorded in the memory 20.

In turn, the producer may intend to change certain such properties. This is particularly desirable if the multichannel signals are superimposed to produce two-channel stereo sound. The producer has the ability to define overlapping properties using the keyboard 26.

The producer may optionally provide various other variables to the data generator. Alternatively, this information may be automatically provided from the mixer 16 to the recording equipment or other microphone. Some of these variables

Instrument placement;

Classification and distribution arrangement of instruments;

Peak or RMS limit of mixer 16;

Equalization, compression, and other similar written information;

Dynamic data in studio and / or control space, such as echo time, delay time, standing waves, ambient noise;

Spatial frequency response, spatial dynamic information; And so on.

Sound visual control data or AVCD is supplied to a multiplexer 28 which combines this AVCD with program data and feeds the data to a formatter 30. The formatter 30 splits the combined data and, if necessary, adds additional data, including, for example, parity codes, error correction codes, etc., depending on the particular DVD standard used. The resulting data is recorded on the DVD by the recording device 32.

The typical data sector 40 shown in FIG. 2 consists of a header portion 42 and a data portion 44. In a typical DVD configuration, the data portion 44, which is typically stored as actual program data, is 2048 bytes, and the header portion 42, which carries other types of signals, includes 156 bytes. In the present invention, the small portion 46 is preferably provided for the AVCD signal by dividing the data portion 44, as shown. In FIG. 2, the portion 46 is shown at the beginning of the data portion 44, but it may be disposed at another location.

In FIG. 2, the AVCD is shown as being provided to sector 40, but it should be appreciated that this data need not be repeated in every sector. Instead, the AVCD may be provided for every sector on the DVD, or in extreme cases, once for each DVD.

The rest of the system is a playback device. As shown in FIG. 3, this playback device 50 includes a demultiplexer 52, an AVCD buffer 54 for AVCD signals, and a buffer 56 for program data. Demultiplexer 52 separates the AVCD and program data for individual buffers 54 and 56 from input data read from the DVD. It also reads header information and performs other control functions, such as error correction, which do not form part of the present invention. DVD players showing details of such demultiplexers are described in US Pat. No. 5,463,565, which is incorporated herein by reference.

The player 50 is preferably a multichannel audio DVD player capable of producing six channels. (The player typically refers to producing 5.1 channels, where the final channel is provided as a low frequency subwoofer.)

Program data from the buffer 56 is supplied to six processing channels via six lines L1 to L6. A typical processing circuit is shown in FIG. 3 for one channel, where the elements for the other channel are substantially the same.

The program on L1 is first fed to the gain / phase circuit 58 for amplification, gain adjustment and phase correction in accordance with a particular control signal, as described below.

The adjusted signal is sent to a delay / echo circuit 60 in which the signal delay for the appropriate echo is adjusted. The signal is then sent to an equalizer 62. After equalization, the signal is sent to the multiplexer 64.

The operation of the multiplexer 64 depends on the number and arrangement of speakers that the user wants to use. For up to 5.1 channel surround sound, the multiplexer sends the signal to the appropriate speaker 66, where it should be appreciated that the same speaker is provided for each other channel.

In order to achieve two channels of 'stereo sound', multiplexer 64 first transmits the sound for channel 1 to mixer 68 on line m1. This mixer 68 also receives signals on lines m2 and m3 for signals from other channels. The signals from these channels are mixed at a specific ratio, which is published more fully below, to produce a 'left' signal for the speaker 70. Similarly, signals from lines m3, m4, m5 generated by other channels (not shown) are combined to produce a so-called 'right' signal for speaker 70 '. Is supplied. As such, in practice, the two mixers 68 and 68 'overlap the signal from six channels to a standard two-channel stereo signal.

In addition, the playback device 50 further includes a user input interface 80 and a register 82. The user input interface 80 is used to enter its options by the user and, if desired, to surpass the AVCD, as more fully posted below. The register 82 is used by the manufacturer to store specific information of a particular device, such as whether the player is a car player, home player, personal or portable player, studio player, or the like.

The purpose of a given sound player is to reproduce the recorded performance as precisely as possible by reproducing the state in which the performance was recorded. Of course, the acoustic characteristics of the reproduction place play an important role in the precision of reproduction. These characteristics include the physical dimensions of the space in which the playback device is used, including the characteristics of the wall, the location of the speakers, and the like. For the best playback sound quality, playback device 50 should have information that describes all these characteristics.

Two configurations are envisioned to provide this local characteristic with the playback device 50. In one configuration, open loop control is used. In this configuration, the user provides the depiction information to the playback device 50. For example, in response to a prompt, the user can enter the size of the room, the location of the speaker, and the like. This information is then stored in memory 83. In addition, the relevant acoustic variables are also measured and stored in the memory 83.

The information from the memory 83 and the register 82 is used with the ACD information from the buffer 54 to perform its individual function by the respective elements 58, 60, 62, 64. This feature of the invention is best described with respect to certain elements. 4 is a detailed view of the delay circuit 60. Delay circuit 60 includes programmable delay line 91 and control block 92. The control block is one of the variables of the AVCD and receives a reference delay variable measured at the recording location 10. The control block also receives input values from register 82 or memory 83.

For example, the control block 92 uses the received information to generate a suitable delay for the signal of channel 1, for example by comparing the optimal delay represented by the reference delay variable with the spatial delay characteristics. It may be a search table. This delay control signal is then fed to a programmable delay line 91. For example, the original performance can be recorded in a concert hall with a delay of 2 seconds. On the other hand, the user can place his player in a relatively small space with a 0.5 second delay. Therefore, a delay of 1.5 seconds is required for optimum performance. This delay is manifested by delay line 91, as defined by control block 92.

Of course, the user may be required to obtain a sound played along with other characteristics. He can select these characteristics using the user interface 80. In contrast to having a system that automatically generates a delay, when the user makes his selection, the user's selection is fed from the memory 80 to the controller block 92 and used to reverse any previous decision.

As such, the operation of each element 58, 60, 62, 64 is adjusted using information from the AVCD, register 82, memory 83 and user input interface 80.

Of particular importance is the mixing ratio used by the mixer 68. As noted above, this ratio may be set using information about how the mixer 16 is set and, optionally, information from the ACD derived from the ratio set by the producer using the keyboard 26.

In a second configuration of the invention, a closed loop control system is used. In this configuration, a control circuit (FIGS. 5, 100) is provided that includes a microphone 102, an amplifier 104, a processor 106, and a test generator 108. The test generator is used to generate a test signal on command. For example, the test generator may be used to generate a specific test sound defined by pink noise or AVCD. This test signal is transmitted to the speaker of the player 50. The test may be the same as the test signal from the generator 22.

The microphone 102 is preferably located at a central point, at least temporarily, in any space in which the user wishes to listen to the player. The microphone 102 is connected to the processor 106 by direct wiring via an amplifier 104 or by indirect coupling such as RF, IR or other similar means.

In any case, the processor 106 may generate a test signal from the generator 108 so that the processor analyzes the acoustic characteristics of the user's listening space, including the size of the space, wall covering, speaker location, and the like. Continuously and / or simultaneously. As such, instead of calculating this characteristic with user input information, the characteristic is obtained directly. This property can be adjusted to compensate for changes in space.

After the property is obtained as published, it is stored in memory 110. The information from this memory is then used in the same way as the information from memory 83. Register 82 is also used to store player specific information.

AVCD can also be used for other important information. For example, many high quality players, especially players designated for use in automobiles, may include noise canceling circuitry to cancel road noise. Noise cancellation can be advantageously introduced into the present system as follows.

Referring to FIG. 6, the noise canceling circuit 140 includes a noise sensor 142, a noise correction generator 144, and a mixer 146. Sensor 142 is used to sense ambient sound and it can be, for example, a local microphone. The detected noise signal is supplied to the noise correction generator 144. The noise correction signal is also received from AVCD information depicting the spectral content of the program data on the corresponding channel, for example channel 1. The noise correction generator 144 analyzes the sensed noise signal and generates a noise compensation signal. In this way, the noise correction generator 144 does not need to perform its own analysis to differentiate between the desired acoustic signal and the undesirable noise signal. This compensation signal is added to the program signal by the mixer 146. The mixer 146 compensates for noise by sequentially mixing the signal of channel 1 with the noise correction signal.

As mentioned previously, the AVCD may include metadata describing the location of musical instruments, singers and / or recording microphones. This information is captured and displayed by the display 90 at the playback device to provide the user with more accurate information about how the performance was recorded.

While the present invention has been published in terms of specific embodiments, it is to be understood that the present invention includes the same substitutes for certain elements of this embodiment and that the protection provided by this patent invention is determined by the legal scope of the following claims. It is intended.

Claims (17)

The sound control data is input to a predetermined number N of input values. Gain and phase circuit, Delay and echo circuits, Equalizer circuit and Gain / Attenuation Circuit Provided by The gain / attenuation circuit is connected to an output for a second predetermined number M of addition channels, Audio data The gain and phase circuit, Delay and echo circuits and Equalizer circuit Continuously supplied via Demultiplexer for restoring audio data and sound control data And a reproduction system for reproducing audio data and reading sound control data. 2. The listener input circuit of claim 1, further comprising a listener input circuit connected to provide a signal adapted to change defaultdata from the medium and to dynamically interact with bias information in the default data. A reproduction system for reproducing audio data, which includes and reads sound control data. 2. A player type register as claimed in claim 1, further comprising a player type register for providing signals to said gain and phase circuits, delay and echo circuits, and equalizer circuits to provide information indicative of player characteristics for said medium. And a reproduction system for reproducing audio data and reading sound control data. 3. A player type register as claimed in claim 2, further comprising a player type register for providing a signal indicative of a variable of the playback medium to said gain and phase circuits, delay and echo circuits, and an equalizer circuit to provide information indicative of player characteristics for said medium. And a reproduction system for reproducing audio data and reading sound control data. 4. The playback system of claim 3, wherein the player type register is adapted to provide information to an active noise canceller. 5. A reproduction system as claimed in claim 4, wherein said player type register is adapted to provide information to an active noise canceling device. The method of claim 1, Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. The method of claim 2, Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. The method of claim 3, wherein Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. The method of claim 4, wherein Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. The method of claim 5, Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. The method of claim 6, Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system And a closed loop of sub-systems interfaced to the playback system, the playback data for playing audio data and reading sound control data. 2. The reproduction system of claim 1, wherein the reproduction system further comprises a metadata display system. 8. The playback system of claim 7, wherein the playback system further comprises a metadata display system. The authoring system generates and records sound control information including sound field information and control space field information, The acoustic scene information Echo time, Delay time, Standing Wave, Ambient noise, Frequency response of space and Dynamic information in space Dynamic data in the studio, including data selected from the group associated with Including, The control space field information Echo time, Delay time, Standing Wave and Ambient noise Contains data relating to, The test signal generator is adapted to detect a feedback signal received to output a pre-programmed test signal for a predetermined time and to measure recorded acoustic information. Precision microphones that provide signals to authoring systems and test signal generators, A data multiplexer for bringing the sound control information and audio information together into multiplexed data, Recording apparatus for fixing the multiplexed data to a medium that can be played back to the public Recording system comprising a And system for recording sound control data to optimize execution of audio reproduction comprising data and to provide data for reproduction of the original sound environment. The sound field information of claim 15, wherein Instrument layout, Instrument classification and distribution, Peak or RMS limits, Equalization compression Console with information recorded including Metadata that contains data selected from the group associated with The system for recording sound control data, further comprising: optimizing the execution of audio reproduction and providing data for reproduction of the original sound environment. The authoring system generates and records acoustic control information including acoustic field information and control space field information, The acoustic scene information Instrument layout, Instrument sorting and distribution arrangement, Peak or RMS limits, Equalization compression Console with information recorded including Metadata that contains data selected from the group associated with Including, Studio dynamic data Echo time, Delay time, Standing Wave, Ambient noise, Frequency response of space and Dynamic information in space Containing data selected from the group associated with The control space field information Echo time, Delay time, Standing Wave and Ambient noise Includes data selected from the group associated with The test signal generator is adapted to output a pre-programmed test signal for a predetermined time and to detect the received feedback signal to measure recorded acoustic information. Precision microphones that provide signals to authoring systems and test signal generators, A data multiplexer for bringing the sound control information and audio information together into multiplexed data, Recording apparatus for fixing the multiplexed data to a medium that can be played back to the public Recording system, including Media calculated from the mass media; The sound control data is input to a predetermined number N of input values. Gain and Metadata display system Provided by Demultiplexer for restoring audio data and sound control data And Applied to provide information to the active noise canceller, A player type register for providing signals to the gain and phase circuits, the delay and echo circuits, and the equalizer circuits to provide information indicative of the player's characteristics with respect to the media; Programmable delay section, Second generator for test signal, A precision microphone for receiving information returned from the test signal, Connection providing variable correction as a variable in the playback system Closed loop of the subsystem interfaced to the playback system including the A playback system for playing back audio data and reading sound control data And record and read sound control data to optimize execution of audio reproduction and to reproduce the original sound environment, and to reproduce sound information controlled by the data.