JP4830644B2 - Control device, synchronization correction method, and synchronization correction program - Google Patents

Description

  The present invention provides, for example, an AV (Audio / Visual) amplifier device that supplies an audio signal to both an external device having a built-in or connected speaker such as a television receiver and a speaker connected to the own device. The present invention relates to a method and a program for performing synchronization correction on a source signal such as an audio signal used in the AV control device.

  In content such as a movie recorded on a DVD (Digital Versatile Disc) or digital television broadcasting, so-called multi-channel audio data such as 5.1 channel and 7.1 channel is handled, and the user can Opportunities to set up multi-channel listening systems such as 5.1 channels and 7.1 channels are also increasing.

  For example, a 5.1 channel listening system is composed of six audio channels including a front left channel, a front center channel, a front right channel, a rear left channel, a rear right channel, and a subwoofer channel. It is possible to reproduce sound using the corresponding six speakers. In addition, [. The expression 1] means a subwoofer channel that compensates for low frequency components.

  Since the multi-channel listening system uses a plurality of speakers, the distance between each speaker and the user, the output characteristics of each speaker, and the speaker at the listening position where the user listens to the sound emitted from each speaker. The reproduction sound field formed by the multi-channel listening system may not be appropriate due to the influence of obstacles existing between users. For example, a sound image to be localized at the front center may be shifted to the right side or the left side.

  For this reason, the multi-channel listening system has a so-called time alignment function that appropriately cuts the sound emitted from each speaker so as to cut an appropriate reproduction sound field. There is something.

  The time alignment function is provided in an AV control device such as an AV amplifier that supplies an audio signal to each speaker. A microphone is installed at a position (listening position) where a listener who is a user listens to reproduced sound from a plurality of speakers, and the sound emitted from each speaker is collected and input to the AV control device. To be able to.

  Then, in the AV control device, for example, a test signal such as a TSP (Time-Stretched Pulse) signal is generated and supplied to each of a plurality of speakers connected to the own device in order, The reproduced sound of the test signal is emitted in order from each speaker.

  The reproduced sound of the test signal thus emitted is collected by a microphone installed at the listening position and returned to the AV control device. Thereby, in the AV control device, it is possible to know the timing when the test signal is supplied to each speaker and the timing when the test signal is emitted from the speaker and collected by the microphone at the listening position and returned. it can.

  That is, in the AV control device, for each speaker connected to the own device, the time taken for the emitted sound to be collected by the microphone at the listening position (the sound from each speaker to the microphone at the listening position). Time). Accordingly, the so-called time alignment of the speakers is adjusted by adjusting the delay amount of the audio signal supplied to each speaker so that the sound emitted from each speaker is simultaneously collected by the microphone at the listening position. As a result, it is possible to prepare a sound listening environment.

  In addition, as a technique related to the time alignment of the speaker in the above-described listening system, Patent Document 1 (Technology enabling time alignment in consideration of temperature change), Patent Document 2 (Listening Point for Time Alignment) (A technique for facilitating the setting operation of (listening position) and making time alignment available effectively), and Patent Document 3 (a technique for making the sound pressure level at the measurement position constant).

In addition, the patent document mentioned above is as showing below.
Japanese Patent Laid-Open No. 10-248097 Japanese Patent Laid-Open No. 10-248098 JP 2000-261900 A

  As described above, the so-called time alignment function can automatically adjust the gain, frequency characteristics, time alignment, and the like of each speaker used. However, depending on the configuration of the multi-channel home theater system, there is a possibility that a so-called lip sync shift occurs in which synchronization is lost between the reproduced video (image) and the reproduced audio.

  Here, let us consider a case where a source with video and audio recorded on a recording medium such as a DVD (Digital Versatile Disc) or a BD (Blu-ray Disc) is reproduced and viewed. As digital image quality of transmitted image signals increases, video data (image signal) processing calculation inside a television receiver that receives video data and audio data output from a DVD player or BD player becomes complicated, and video data It is known that decoding processing and image display take time.

  For this reason, in high-definition television receivers using display elements such as LCD (Liquid Crystal Display) and PDP (Plasma Display Panel), which have begun to spread rapidly in recent years, video data decoding processing and image display are involved. There is also provided a system in which an audio signal to be supplied to a speaker mounted on its own device is delayed based on time.

  As described above, when video data and audio data supplied from a DVD player or a BD player are reproduced using a television receiver having a delay processing function for audio signals, video and audio are generated inside the television receiver. There is no problem because it is adjusted so as to be synchronized with. However, for example, when video data is separately supplied to a television receiver and audio data is separately supplied to an external speaker or the like separate from the television receiver, the video data is complicated video data ( (Image signal) Since the calculation takes a long time due to processing calculation, the video (image) displayed on the display screen of the display element of the television receiver is out of synchronization with the sound emitted from the external speaker, A so-called lip sync problem occurs.

  In this case, the time required to process the audio data is shorter than the time required to process the video data, so that the audio is played faster than the displayed video, and the viewer feels uncomfortable. There is. In such a case, it is possible for the user to adjust the lip sync by delaying using the time delay processing in the AV amplifier, but the time required for processing the video data in the television receiver is unknown and the audibility is increased. Even if it is used, it is difficult to adjust accurately.

  In view of the above, the present invention has different synchronization destinations that may occur between the sounds emitted from the speakers of the respective supply destinations due to different supply destinations of the audio signals from the same source. It is an object to enable easy and appropriate correction without bothering the user (user). Furthermore, when reproducing an AV signal composed of a video signal and an audio signal to be reproduced in synchronization, a so-called lip sync shift caused by a difference in the supply destination of the audio signal is controlled by the user. Make corrections easy and appropriate without bothering you.

Further, the control device of the invention according to claim 1 is:
A control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker, and supplies an audio signal to one or more speakers connected to the own device,
Measurement signal generating means for generating a measurement signal;
Output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
Response signal receiving means for receiving a line input of a response signal for the measurement signal that is output after being subjected to delay processing in the external device;
Delay of the audio signal in the external device based on the output timing of the measurement signal output from the own device according to the control of the output control unit and the reception timing of the response signal received through the response signal reception unit Detection means for detecting time and recording it in a database;
Delay means for delaying an audio signal supplied to at least the speaker connected to the device;
Based on the recorded delay to the database, Ru and a delay control means for controlling the delay amount of said delay means.

According to the control device of the first aspect of the invention, the measurement signal generated in the measurement new generation means is supplied to the external device under the control of the output control means, and is delayed in the external device through the response signal receiving means. A response signal for the measurement signal that is processed and output is received by line input. The detection unit detects the delay time of the audio signal in the external device based on the output timing of the measurement signal and the reception timing of the response signal for the measurement signal in the response signal reception unit, and records it in the database.

  The delay control unit controls the delay unit based on the delay time of the database, and delays the audio signal supplied to the speaker connected to the own device (control device itself) separately from the external device. Processing is performed.

  This makes it easy and appropriate for users (users) to avoid the synchronization error of the sound emitted from the speakers of each supply source due to different supply destinations of the audio signals from the same source. Can be corrected. In addition, since the response signal is fed back through the line input, the delay time applied to the audio signal in the external device can be accurately detected regardless of the audio reproduction environment.

A control device according to a second aspect of the present invention is the control device according to the third aspect,
A sound collection sound reception means for receiving supply of a sound signal collected by a microphone installed at a listening position;
Second output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to a speaker connected to the apparatus;
The output timing of the measurement signal output from the own device according to the control of the second output control means, and the measurement signal emitted from the speaker connected to the own device at the collected sound reception means based on the reception timing of the response signal for, detecting the delay time of the audio signal is emitted from the speakers connected to the own device, Ru and a second detecting means for recording it in a database.

According to the control device of the second aspect of the present invention, as the second stage, the measurement signal generated by the measurement new generation means is transmitted to the speaker connected to the own device under the control of the second output control means. The sound corresponding to the measurement signal is emitted from the speaker supplied and connected to the own device.

  In this way, the sound corresponding to the measurement signal emitted from the speaker connected to the own device is collected as a response signal for the measurement signal by the microphone installed at the listening position and received by the collected sound receiving means. It is done. Then, the delay time of the sound signal emitted from the speaker connected to the own device is detected by the second detection means based on the output timing of the measurement signal and the reception timing of the response signal for the measurement signal. Recorded in the database.

  Then, both the delay time for the sound emitted from the speaker of the external device stored in the database by the delay control means and the delay time for the sound emitted from the external speaker connected to the own device In consideration of the above, the delay means is controlled, and the delay processing is performed on the audio signal supplied to the speaker connected to the own device (control device itself) separately from the external device.

  This makes it easy and appropriate for users (users) to avoid the synchronization error of the sound emitted from the speakers of each supply source due to different supply destinations of the audio signals from the same source. Can be corrected.

  Further, since the response signal is fed back through the line input, the delay time applied to the audio signal in the external device can be accurately detected regardless of the audio reproduction environment. Furthermore, since the delay amount of the audio signal supplied to the speaker connected to the own device (control device) can be taken into consideration, the synchronization of the audio signal can be adjusted more accurately.

Further, the control device of the invention according to claim 3 is:
A control device that supplies an audio signal to one or more speakers connected to the own device, as well as supplying an audio signal to an external device with a built-in speaker or connected to the speaker,
A discriminating means for discriminating whether or not it is possible to control the volume of the sound emitted from the speaker of the external device having the built-in speaker or connected to the speaker from the own device;
Measurement signal generating means for generating a measurement signal;
Means used when it is determined by the determining means that volume control is possible,
A sound collection sound reception means for receiving supply of a sound signal collected by a microphone installed at a listening position;
First output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
The output timing of the measurement signal output from the own device according to the control of the first output control means, and the response to the measurement signal emitted from the speaker of the external device at the collected sound reception means First detection means for detecting a delay time of the audio signal in the external device based on the reception timing of the signal and recording this in a database;
Means used when it is determined by the determining means that volume control is impossible;
Second output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
Response signal receiving means for receiving a line input of a response signal for the measurement signal that is output after being subjected to delay processing in the external device;
Delay of the audio signal in the external device based on the output timing of the measurement signal output from the own device according to the control of the output control unit and the reception timing of the response signal received through the response signal reception unit Second detection means for detecting time and recording it in a database;
Delay means for delaying an audio signal supplied to at least the speaker connected to the device;
Based on the recorded delay to the database, Ru and a delay control means for controlling the delay amount of said delay means.

According to the control apparatus of the invention as set forth in claim 3, the determining means, when the volume control of the sound to be emitted from the speaker of the external device from the control device is determined to be possible, measuring titration, The delay amount of the sound emitted from the speaker of the external device using the microphone is measured in a form including the spatial propagation delay.

Further, when it is determined by the determining means that the volume control of the sound emitted from the speaker of the external device from the control device is impossible, as in the case of the invention according to claim 1 , from the external device. Based on the line input, the amount of delay generated for the audio signal in the external device is measured.

  In this way, a method for measuring the delay amount of the audio signal can be selected according to the state of the system. And since the supply destinations of the audio signals from the same source are different, the synchronization deviation of the sound emitted from the speakers of the respective supply destinations can be easily and appropriately performed without bothering the user (user). It can be corrected.

  According to the present invention, the user himself / herself adjusts the synchronization shift that may occur between the sounds emitted from the speakers of the respective supply destinations due to different supply destinations of the audio signals from the same source. It is possible to realize a means for adjusting automatically and electrically without performing the process, and greatly enhance the convenience for the user.

  In addition, the automatic sound field measurement correction function can be expanded to solve the problem of the synchronization between video and audio (so-called lip sync).

  Hereinafter, an embodiment of an apparatus, a method, and a program according to the present invention will be described with reference to the drawings.

[Video and audio playback system that may cause lip sync shift]
[Outline of each component]
First, before specifically describing an embodiment of the apparatus, method, and program according to the present invention, connection of a video / audio reproduction system in which lip sync deviation (synchronization deviation between video and audio) may occur is described. A specific example of the connection mode will be described.

  Here, for example, content recorded on a recording medium such as a DVD (Digital Versatile Disc) or a BD (Blu-ray Disc) is provided, and a video signal (video data) to be reproduced synchronously A description will be given of a case where a lip sync shift occurs between channels when audio signals (audio data) are reproduced.

  FIG. 1 and FIG. 2 are block diagrams for explaining a specific example of a video / audio reproduction system in which a lip sync shift may occur. 1 and 2 are all connected to a source signal reproduction device 1, an AV control device (hereinafter referred to as a control device) 2, a television receiver 3, and a control device 2. It consists of an external speaker. Here, the outline | summary of each apparatus which comprises the audiovisual reproduction system shown in FIG. 1, FIG. 2 is demonstrated.

  The source signal player 1 is a video / audio player such as a DVD player or a BD player. In recent years, multi-channel audio such as 5.1 channel, 7.1 channel, and 9.1 channel has been developed, and the types of audio compression techniques are diversified according to needs. On the other hand, television receivers that mainly display video are not suitable for receiving multi-channel audio signals, and generally supply audio signals to control devices such as AV amplifiers through digital interfaces. It is customary to decompose (decode) each channel audio component with a decoder in the control device and connect to a speaker or a subsequent device.

  Various digital interfaces such as SPDIF (Sony Philips Digital Interface (IEC958)), IEEE (Institute of Electrical and Electronics Inc) 1394, and HDMI (High-Definition Multimedia Interface) are used.

  The control device 2 has a control function for an audio signal (Audio Data) and a video signal (Visual Data), and an AV amplifier is a typical example. The digital audio signal can be supplied with a compressed / uncompressed digital audio signal or an analog audio signal. The digital audio signal can be decoded or various audio signal processing can be performed on the supplied audio signal. It is something that can be done. In addition to audio signals, video signals can generally be handled.

  As described above, at present, audio signals are being multi-channeled (multi-channel), and the present invention also provides multi-channel such as 5.1 channels, 7.1 channels, and 9.1 channels. The present invention can be applied when reproducing an audio signal. However, in the video and audio reproduction system according to the embodiment described below, for the sake of simplicity, for example, a case of having a function of processing a compressed 5.0 channel multi-channel audio signal such as Dolby Digital. Will be described as an example.

  That is, the 5.0 channel is five channels of L (left) channel, R (right) channel, SL (left rear) channel, SR (right rear) channel, C (center) channel, and SL (left rear). ) Channel and SR (right rear) channel letter “S” means “surround”.

  The control device 2 generally has a plurality of video signal and audio signal input terminals and has a function that can be arbitrarily selected by the user. However, the control device 2 of the embodiment described below will be described briefly. Therefore, the input terminals other than the digital video input terminal Vin, the digital audio input terminal Ain, and the audio input terminal IA1 that receive the line input of the analog audio signal, which are mainly connected to the source signal reproduction device 1, are omitted.

  The control device 2 of the embodiment described below can supply a selected input signal to an external speaker through a DAC (Digital Analog Converter) and an amplifier unit. In recent years, some digital amplifiers in which a DAC and an amplifier are integrated are used.

  As described above, in addition to reproducing an audio signal with an external speaker via a built-in amplifier portion, as realized in the control device 2 of the video and audio reproduction system according to the embodiment described below, The output of the DAC can be transmitted as a line-level audio signal to a subsequent device. These are generally called pre-outs.

  The television receiver 3 includes a display element and a speaker, and can receive a video signal and an audio signal, reproduce them, and output video and audio. Also, the television receiver 3 has 480p (progressive scanning method (sequential scanning method) with 480 effective scanning lines), 720p (progressive scanning method with 720 effective scanning lines), and 1080i (1080 effective scanning lines). It is possible to receive and process video signals of various scanning line numbers / scanning methods such as an interlace scanning method (interlaced scanning method).

  In addition, the television receiver 3 includes signal processing modes such as a high image quality mode, a medium image quality mode, and a normal image quality mode, and a user can select an appropriate one from these signal processing modes. Here, in the high image quality mode, even when a 480p or 720p video signal is supplied, the highest image quality video signal (for example, 1080i video signal) is formed in the own device. In this mode, when a low-quality video signal is supplied, a high-quality image processing such as interpolation of the insufficient scanning lines is performed.

  In the medium image quality mode, for example, even when a 480p video signal is supplied, a medium-quality video signal (for example, a 720p video signal) is formed in the own device. However, when a low-quality video signal is supplied, it is not higher than that in the above-described high-quality mode, but it is a mode that involves high-quality processing such as interpolation of insufficient scanning lines.

  In the normal image quality mode, the image quality improvement processing in the high image quality mode and the medium image quality mode is passed, the supplied video signal is processed as it is to form a normal video signal, and this is used as a display element. To supply. This normal image quality mode is used, for example, when a game machine is connected. By performing image quality enhancement processing, the video of the game that should change according to the operation from the user changes after the operation. To prevent the occurrence of such as.

  In the following, a speaker attached to the television receiver 3 is referred to as a built-in speaker of the television receiver 3, and a speaker directly connected to the control device 2 is referred to as an external speaker (based on the television receiver 3). To do. In addition, when the built-in speaker of the television receiver 3 is used in combination with an external speaker as shown in FIG. 2, the built-in speaker of the television receiver 3 is set up to a volume that allows normal playback instead of being muted. It is necessary to be. Similarly, it is assumed that connection and speaker arrangement have already been set up in the external speaker.

[Specific example 1 of connection connection mode of audiovisual reproduction system]
Next, the connection connection mode of the video and audio reproduction system in which the lip sync shown in FIGS. 1 and 2 may be displaced will be described in detail. First, the connection connection mode of the video and audio reproduction system shown in FIG.

  A video / audio reproduction system shown in FIG. 1 includes a source signal reproduction device 1 such as a DVD player or a BD player, an AV control device (hereinafter referred to as a control device) 2 such as an AV amplifier, a television receiver 3, and a control device. 2 are connected to external speakers oL, oR, oC, oSL, and oSR.

  As described above, the source signal reproduction device 1 is a video / audio reproduction device such as a DVD player or a BD player, which is content data recorded on a recording medium, and is a video signal (synchronized reproduction). Video data) and multi-channel (5.0 channels in this embodiment) audio signal (audio data) are output.

  As shown in FIG. 1, the control device 2 has a video input terminal Vin, an audio input terminal Ain, and an interface (hereinafter abbreviated as I / F) 21 for receiving input signals supplied through these input terminals. A signal processing unit 22 having a multi-channel audio signal decoding function, a DAC (Digital Analog Converter) 23, a pre-out terminal group OA-M, a DAC / AMP (Digital Analog Converter / Amplifier) 24, It consists of a speaker output terminal group OAS-M for analog audio signals of channels and an input terminal IA1 for analog audio signals of two left and right channels.

  As shown in FIG. 1, the pre-out terminal group OA-M includes analog audio signal pre-out terminals L, R, SL, SR, and C corresponding to the digital video output terminal V and the multi-channel, respectively. The speaker output terminal group OAS-M also includes speaker output terminals L, R, SL, SR, and C corresponding to multi-channel analog audio signals.

  In the control device 2, the audio signal received through the audio input terminal Ain is supplied to the signal processing unit 22 through the I / F 21. The signal processing unit 22 is configured by, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and the like, and decodes a multi-channel audio signal supplied thereto to an audio signal before data compression. Are also separated into audio signals of the L (left) channel, R (right) channel, SL (left rear) channel, SR (right rear) channel, and C (center) channel, This is supplied to the DAC 23 and the DAC / AMP 24.

  The DAC 23 converts the audio signal (digital signal) of each channel from the signal processing unit 22 into an analog signal, and supplies the analog audio signal of each channel obtained by the conversion to the corresponding preout terminal of the preout terminal group OA-M. To do. Thereby, the analog audio signal of each channel is output through each pre-out terminal of the pre-out terminal group OA-M, and can be supplied to an external device or the like.

  The DAC / AMP 24 converts the decoded audio signals (digital signals) of the respective channels from the signal processing unit 22 into analog signals, and converts the analog audio signals of the respective channels into, for example, control of the signal processing unit 22. Is amplified and supplied to the speaker output terminals of the corresponding channels of the speaker output terminal group OAS-M.

  Thereby, the analog audio signal of each channel is output through each speaker output terminal of the speaker output terminal group OAS-M, and the external speakers oL, oR, oSL, oSR, oC that are connected to the control device 2 are output. The sound corresponding to the multi-channel audio signal supplied to the control device 2 can be emitted from each of the external speakers oL, oR, oSL, oSR, oC.

  Further, the television receiver 3 includes an input terminal group 31 having an input terminal (video input terminal) V for digital video signals, input terminals (audio input terminals) L and R for analog audio signals of two left and right channels, and an image decoder 32. An image display unit 33, delay units 34L and 34R that perform delay processing on the audio signal, AMP (Amplifier) 35L and 35R that amplify the audio signal, built-in speakers TVL and TVR, and analog audio signal And an output terminal group 36 having left and right two-channel output terminals (audio output terminals) L and R.

  The video signal (digital signal) received through the video input terminal V of the input terminal group 31 is supplied to the image decoder 32. Also, the audio signal (analog signal) supplied through the audio input terminal L of the input terminal group 31 is supplied to the delay unit 34L, and the audio signal (analog signal) supplied through the audio input terminal R of the input terminal group 31 is used. ) Is supplied to the delay unit 34R.

  The image decoder 32 forms an analog video signal to be supplied to the image display unit 33 from the video signal supplied thereto, and supplies this to the image display unit 33. The image display unit 33 includes, for example, a display element such as an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, a PDP (Plasma Display Panel), a CRT (Cathode Ray Tube), and a control circuit thereof, and an image decoder. In response to the supply of the analog video signal from 32, an image corresponding to this is displayed on the display screen of the display element.

  As described above, the television receiver 3 includes several image quality modes such as a high image quality mode, a medium image quality mode, and a normal image quality mode, and the image decoder 32 receives the supplied video signal. According to the format and the selected image quality mode, a video signal having an appropriately designated image quality can be formed.

  For this reason, in order to form a video signal of the instructed image quality, processing in the image decoder 32 may take time, and an image displayed on the display element of the image display unit 33 and a built-in speaker as will be described later. There may be a deviation (so-called lip sync deviation) between the sound emitted from TVL and TVR.

  Therefore, the image decoder 32 can control the delay units 34L and 34R in order to delay the audio signal according to the time required for the video signal processing in itself. The audio signals supplied to the delay units 34L and 34R are subjected to delay processing in accordance with the control from the image decoder 32, and then supplied to the AMPs 35L and 35R, and the audio output of the output terminal group 26 for analog audio signals. It is supplied to each of the terminals L and R.

  The delay-processed L (left) channel audio signal is amplified by the AMP 35L and then supplied to the L (left) channel built-in speaker TVL. The delay-processed R (right) channel audio signal is converted to the AMP 35R. Is supplied to the R (right) channel built-in speaker TVR, and sounds corresponding to the left and right channel audio signals are emitted from the built-in speakers TVL and TVR. At the same time, the audio signals of the left and right channels after delay processing are output from the audio output terminals L and R of the audio signal output terminal group 36, respectively.

  1, the video output terminal of the source signal playback device 1 and the video input terminal V of the input terminal group 31 of the television receiver 3 are directly connected. The video signal from the source signal reproducing device 1 is directly supplied to the television receiver 3.

  Thereby, the video signal from the source signal reproduction device 1 is received through the video input terminal V of the input terminal group 31 of the television receiver 3, processed by the image decoder 32, and then supplied to the image display unit 33. A video (image) corresponding to the video signal from the source signal reproducing device 1 is displayed on the display element of the image display unit 33 of the television receiver 3.

  Also, the audio output terminal of the source signal reproduction device 1 and the audio input terminal Ain of the control device 2 are connected, and the multi-channel audio signal from the source signal reproduction device 1 is connected to the audio input terminal Ain of the control device 2. Are decoded by the signal processing unit 22 and separated into audio signals of the respective channels, and then supplied to the DAC 23 and the DAC / AMP 24.

  The audio signals (digital signals) of the respective channels supplied to the DAC 23 are converted into analog audio signals here, and then passed through the preout terminals L, R, SL, SR, C of the audio signals of the preout terminal group OA-M. It is made to output.

  Further, the audio signals (digital signals) of the respective channels supplied to the DAC / AMP 24 are converted into analog audio signals here, and are subjected to amplification processing, so that the speaker terminals L, R, and R of the speaker output terminal group OAS-M The signals are supplied to the external speakers oL, oR, oSL, oSR, and oC connected to the control device 2 through SL, SR, and C, respectively. Thereby, the sound according to the audio signal from the source signal reproducing device 1 is emitted from each of the external speakers oL, oR, oSL, oSR, oC.

  Thus, in the case of the video / audio reproduction system shown in FIG. 1, the video signal from the source signal reproduction device 1 is directly supplied to the television receiver 3, and the audio signal from the source signal reproduction device 1 is It is configured to be connected and connected so as to be supplied to each of the external speakers oL, oR, oSL, oSR, and oC via the control device 2.

  For this reason, even if the video signal processing takes time in the image decoder 32 of the television receiver 3, the control device 2 cannot know that the video signal processing in the television receiver 3 takes time. Delay processing cannot be applied to the audio signal, and a deviation in synchronization between the reproduced video and audio, that is, a so-called lip sync deviation occurs.

  That is, in the case of the video / audio reproduction system shown in FIG. 1, the amount of delay generated by various image processing such as image decoding processing performed in the image decoder 32 in the television receiver 3 is automatically or by user selection. The control device 2 itself does not have means for automatically knowing the delay amount related to the image signal processing of the television receiver 3 other than the user manually inputting the value. . Therefore, in many cases, the control device 2 performs signal reproduction to each external speaker as it is without performing delay processing on the audio signal.

  In this situation, at the user (viewer) position, a delayed playback video arrives after multi-channel audio arrives at the time of source playback, resulting in a lip sync problem. In particular, as described above, when there is a delay of several hundred ms (milliseconds), the user feels uncomfortable with the lip sync and feels uncomfortable.

  Actually, due to the arrangement of multi-channel speakers before the problem of lip sync, a difference in distance from each speaker to the user (viewer) position occurs, so strictly speaking, the arrival time of each sound itself has already shifted. . However, for example, when considering two speakers, even if the difference in distance to the user is 1 m, it is a time shift of about 3 ms (milliseconds), which is much smaller than the aforementioned lip sync shift.

  In the video / audio reproduction system shown in FIG. 1, the audio signal is output only from the external speakers oL, oR, oSL, oSR, oC connected to the control device 2 and the built-in speaker TVL of the television receiver 3 is output. , TVR is not used by being muted.

[Specific example 2 of connection connection mode of video / audio reproduction system]
Next, the connection connection mode of the video / audio reproduction system shown in FIG. In the video / audio reproduction system shown in FIG. 2, the source signal reproduction device 1, the control device 2, and the television receiver 3 are respectively the source signal reproduction device 1, the control device 2, and the television of the video / audio reproduction system shown in FIG. It is configured in the same manner as each of the receivers 3. Therefore, in the audio / video reproduction system shown in FIG. 2, the same reference numerals as those in the audio / video reproduction system shown in FIG. The detailed description thereof will be omitted.

  2 differs from the audio / video reproduction system described with reference to FIG. 1 in that the audio / video reproduction system shown in FIG. 2 has built-in speakers TVL and TVR of the television receiver 3 and controls. The external speakers oSL, oSR, and oC connected to the device 2 are used together.

  Specifically, in the case of the video / audio reproduction system shown in FIG. 2, the video output terminal of the source signal reproduction device 1 and the video input terminal Vin of the control device are connected, and the pre-out terminal group OA− of the control device 2 is connected. The video output terminal V of M and the video influential terminal V of the input terminal group 31 of the television receiver 3 are connected, and the video signal from the source signal reproduction device 1 is transmitted to the television receiver 3 via the control device 2. To be supplied to.

  Thereby, the video signal from the source signal reproduction device 1 is received through the video input terminal V of the input terminal group 31 of the television receiver 3, processed by the image decoder 32, and then supplied to the image display unit 33. A video (image) corresponding to the video signal from the source signal reproducing device 1 is displayed on the display element of the image display unit 33 of the television receiver 3.

  Also, the audio output terminal of the source signal reproduction device 1 and the audio input terminal Ain of the control device 2 are connected, and the multi-channel audio signal from the source signal reproduction device 1 is connected to the audio input terminal Ain of the control device 2. Are decoded by the signal processing unit 22 and separated into audio signals of the respective channels, and then supplied to the DAC 23 and the DAC / AMP 24.

  The audio signals (digital signals) of the respective channels supplied to the DAC 23 are converted into analog audio signals here, and then passed through the preout terminals L, R, SL, SR, C of the audio signals of the preout terminal group OA-M. It is made to output. In the case of the video / audio reproduction system shown in FIG. 2, the audio signal pre-out terminals L and R of the pre-out terminal group OA-M of the control device 2 and the audio input terminal of the input terminal group 31 of the television receiver 3 are used. L and R are connected.

  Accordingly, among the 5.0 channel multi-channel audio signals, the L (left) channel audio signal and the R (right) channel audio signal are supplied to the television receiver 3 through the control device 2, and the television image is received. It can be played back through the built-in speakers TVL and TVR of the machine 3.

  Further, the audio signals (digital signals) of the respective channels supplied to the DAC / AMP 24 are converted into analog audio signals here, and are subjected to amplification processing, so that the speaker terminals L, R, and R of the speaker output terminal group OAS-M The data is output through SL, SR, and C. In the case of the video / audio reproduction system illustrated in FIG. 2, the audio signals are supplied to the external speakers oSL, oSR, and oC connected to the control device 2.

  As a result, among the 5.0-channel multi-channel audio signals, the SL (left rear) channel audio signal, the SR (right rear) channel audio signal, and the C (center) channel audio signal are controlled. It can be played back through the device 2 through the external speakers oSL, oSR, and oC connected thereto.

  As described above, in the case of the video / audio reproduction system shown in FIG. 2, the video signal from the source signal reproduction device 1 is supplied to the television receiver 3 via the control device 2, and is sent from the source signal reproduction device 1. Among the multi-channel audio signals, the L (left) channel audio signal and the R (right) channel audio signal are supplied to the television receiver 3 via the control device 2, and further from the source signal reproducing apparatus 1. Among the multi-channel audio signals, the SL (left rear) channel audio signal, the SR (right rear) channel audio signal, and the C (center) channel audio signal are connected to an external speaker via the control device 2. It is configured to be connected and connected so as to be supplied to each of oSL, oSR, and oC.

  2, the video (image) displayed on the display element of the image display unit 33 of the television receiver 3 and the external speakers oSL, oSR, oC connected to the control device 2 are used. As with the case of the audio / video reproduction system shown in FIG. On the other hand, between the video (image) displayed on the display element of the image display unit 33 of the television receiver 3 and the sound emitted from the built-in speakers TVL and TVR, as described above, the television As the receiver 3 alone, the problem of synchronization between audio and video is solved by the functions of the delay units 34L and 34R controlled by the image decoder 32, so that the problem of lip sync does not occur.

  However, in the case of the video / audio reproduction system shown in FIG. 2, between the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 and the sound emitted from the external speakers oSL, oSR, and oC. However, since the reproduction synchronization is shifted, the problem that the reproduction of the video and the sound is simply out of sync is not limited, and the sound emitted from the built-in speaker of the television receiver 3 and the sound emitted from the external speaker are not limited. The phenomenon that a synchronization shift occurs also between the audio and the audio to be generated.

  For this reason, especially when playing audio signals with high correlation between signals of each audio channel, such as music, problems such as frequency dip / peak, echo feeling, decreased intelligibility due to sound interference occur, and lip sync In addition to problems, the listening environment may be significantly degraded.

  Note that the video signal output from the source signal reproducing device 1 is directly supplied to the television receiver 3 in FIG. 1, but is supplied to the television receiver 3 via the control device 2 in FIG. Connected to. Here, when viewed from the user, there is a misunderstanding that the lip sync problem has been solved by inputting both the audio signal and the video signal from the source signal reproduction device 1 to the control device 2.

  However, as can be seen from the configuration of the television receiver 3 in FIG. 2, the largest delay related to the lip sync problem occurs in the television receiver 3 at the final stage, so that the video signal passes through the control device 2. Even if it is connected so that it is supplied to the television receiver 3, the problem of lip sync cannot be fundamentally solved.

[Video and audio playback system without lip sync shift]
FIG. 3 is a block diagram for explaining an example of a connection connection mode of a video / audio reproduction system in which a lip sync shift does not occur. In the video / audio reproduction system of FIG. 3, the source signal reproduction device 1 and the television receiver 3 are configured in the same manner as those used in the video / audio reproduction system shown in FIGS.

  In the case of the video / audio reproduction system shown in FIG. 3, the video output terminal of the source signal reproduction device 1 and the video input terminal V of the input terminal group 31 of the television receiver 3 are connected, and the source signal reproduction is performed. The left and right two-channel audio output terminals of the device 1 and the left and right two-channel audio input terminals L and R of the input terminal group 31 of the television receiver 3 are connected.

  As a result, the digital video signal Vd from the source signal reproduction device 1 is supplied to the television receiver 3 through the video input terminal V of the input terminal group 31 of the television receiver 3, and the left and right two-channel audio that is an analog signal is also provided. A signal is supplied to the television receiver 3 through audio input terminals L and R of the input terminal group 31 of the television receiver 3.

  Furthermore, the audio output terminals L and R of the left and right two-channel audio output terminal group 36 of the television receiver 3 and the audio input terminals L and R of the audio input terminal group 41 of the audio amplifier device 4 are connected. The audio amplifier device 4 includes an AMP (Amplifier) 42L for the L (left) channel and an AMP (Amplifier) 42R for the R (right) channel, and each of the left and right two channels received through the audio input terminal group 41. The audio signal is amplified and output through the audio output terminals L and R of the audio output terminal group 43.

  Corresponding external speakers oL and oR are connected to the audio output terminals L and R of the audio output terminal group 43, respectively. Thus, the audio signal from the source signal reproduction device 1 can be reproduced through the built-in speakers TVL and TVR of the television receiver 3 and the external speakers oL and oR connected to the audio amplifier device 4.

  The video / audio reproduction system shown in FIG. 3 uses an external audio amplifier device or an external speaker to compensate for, for example, when the built-in speakers TVL and TVR of the television receiver 3 are small and the sound is poor. This is the case. In the case of the video / audio reproduction system shown in FIG. 3, the left and right two-channel audio signals delayed by the delay units 34 </ b> L and 34 </ b> R in accordance with the control of the image decoder 32 inside the television receiver 3. Since the sound is output from the external speakers oL and oR, the reproduction synchronization does not deviate from the video (image) displayed on the display element of the image display unit 33 of the television receiver 3.

[Summary of connection and connection mode of audiovisual playback system]
As shown in the example of the internal structure of the television receiver 3 of the video and audio reproduction system shown in FIGS. 1 to 3, when a video signal is input to the television receiver 3, a television image (reproduction) corresponding to the video signal is reproduced. As described above, it takes time to decode the video signal and perform various image processing until the video is displayed on the display element of the image display unit 33, and the reproduction of the video signal is delayed with respect to the reproduction of the audio signal. There is a case. In particular, the amount of delay has increased due to the increase in the amount of image information associated with recent high definition, the evolution of image compression formats, and the complexity of information processing for image quality expression. There are cases where the playback is actually delayed by several tens of ms to several hundreds of ms.

  In such a case, if the audio signal input together with the video signal is reproduced as it is in the television receiver 3, the processing for the audio signal is naturally shorter, so the supplied audio signal The sound corresponding to is played back first, and then the video is played back. In general, it is said that when the audio deviates from the range of −25 ms to +100 ms with respect to the video, it causes a sense of incongruity, which becomes a so-called “lip sync” problem.

  Therefore, in the television receiver 3, the audio output is normally reproduced via the delay device (delay units 34L and 34R). Since the time required to display the image of the video signal (the delay amount of the video signal with respect to the audio signal) is known in the television receiver 3, the time is set as the delay amount in the delay device (delay unit 34L, 34R), By performing delay control in accordance with this, the television receiver 3 alone has a mechanism capable of reproducing video and audio in synchronization.

  Note that this delay amount is not fixed depending on the television receiver. For example, when the image processing method is automatically selected by automatically analyzing the input image quality inside the television receiver, or when the user specifies The delay amount itself may change depending on (for example, selecting a mode that prioritizes speed over image quality).

  In this way, in the case of using the television receiver 3 having the cause of the lip sync deviation, as shown in FIGS. 1 and 2, at least the video signal and the audio to be reproduced in synchronization with each other are used. In a video and audio reproduction system in which each signal is connected and connected so as to be supplied to a different external device (in the case of FIGS. 1 and 2, a television receiver 3 and an external speaker oSL, oSR, etc.) The problem of sink displacement occurs.

  In addition, as in the audiovisual system shown in FIG. 2, audio signals of different audio channels are connected so as to be supplied to a device that performs delay processing on the audio signal and a device that does not perform delay processing. In some cases, there is a difference in playback synchronization between these audio signals, causing problems such as frequency dip / peak, echo, and intelligibility due to sound interference as described above. There is.

  However, as shown in FIG. 3, in the case of a video and audio reproduction system in which the supply destinations of the video signal and the audio signal are always the same, the audio signal is processed according to the time required for processing the video signal. Since the delay processing can be appropriately performed and the sound corresponding to the delayed audio signal can be reproduced, the problem of the lip sync deviation does not occur.

  As described with reference to FIGS. 1 and 2, the video / audio reproduction system according to the embodiment described below is configured so that a video signal and an audio signal to be reproduced in synchronization are supplied to different external devices. In a connected audiovisual system, lip sync deviation can be corrected easily and reliably, and is mainly realized as a function in a control device.

[About devices, methods, and programs that perform lip sync deviation correction (synchronization correction)]
Hereinafter, an embodiment of an apparatus, method, and program according to the present invention will be described in detail. The embodiment described below is configured by connecting a source signal reproduction device 1, a control device 2, and a television receiver 3 in the same manner as the video and audio reproduction system described with reference to FIGS. An example of a video and audio reproduction system will be described.

  In the embodiment described below, since the processing of the video signal takes time as described above, the amount of delay applied to the audio signal in the television receiver 3 is set in the control device 2. Three embodiments in which detection is performed and the detection methods are different will be described.

[First Embodiment]
As will be described in detail below, the audiovisual system of the first embodiment described below uses a measurement microphone MIC installed at a listening point and uses a measurement signal in space to The amount of delay is measured.

  FIG. 4 is a block diagram for explaining the audiovisual reproduction system according to the first embodiment. In the video / audio reproduction system according to the first embodiment, the control device 2 and the television receiver 3 are configured in substantially the same manner as the control device 2 and the television receiver 3 of the video / audio system shown in FIGS. It is a thing. For this reason, in the video / audio reproduction system according to the first embodiment shown in FIG. 4, the same reference is made to the parts configured in the same manner as the devices constituting the video / audio reproduction system shown in FIGS. Reference numerals are assigned, and detailed description of the portions is omitted.

  In the video / audio reproduction system shown in FIG. 4, the control device 2 includes a control signal output terminal 2o and a control signal input terminal 2i. The control signal output end 2 o and the control signal input end 2 i are connected to the signal processing unit 22. As described above, the signal processing unit 22 is configured by a DSP or a CPU, and outputs a control signal through the output terminal 2o as necessary, or inputs a control signal from an external device. It can be received through the end 2i.

  Similarly, the television receiver 3 also includes a control signal output terminal 3o and a control signal input terminal 3i. The control signal output terminal 3 o and the control signal input terminal 3 i are connected to the controller 37. The controller 37 is a microcomputer composed of, for example, a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. As will be described later, for example, the gain of the AMPs 35L and 35R is controlled, and the image It is possible to control each part of the television receiver, such as instructing an image mode to the decoder 32. Then, the controller 37 of the television receiver 3 can output a control signal through the output terminal 3o as necessary, or can receive a control signal from an external device through the input terminal 3i. Yes.

  4, the control signal output terminal 2o of the control device 2 and the control signal input terminal 3i of the television receiver 3 are connected, and the control signal input terminal 2i of the control device 2 and the television receiver are connected. 3 is connected to the output terminal 3o of the control signal 3, and the control signal line is connected so that various control signals can be transmitted and received between the control device 2 and the television receiver 3. Yes.

  The control signal line between the control device 2 and the television receiver 3 may be connected to a dedicated control signal line as shown in FIG. 4, or an AV mouse or the like. A digital signal having a control signal line such as IEEE 1394 or HDMI, which is connected to each other by a called infrared remote control signal sending part and an infrared remote control signal light receiving part of a counterpart device, or connected by short-range wireless communication. It is possible to connect in various ways, such as connecting with an interface.

  The control device 2 includes a microphone connection terminal Min, a microphone amplifier (described as MIC-AMP in the drawing) 26, and an ADC (Analog Digital Converter) 25. As will be described in detail later, the control device 2 receives the audio signal received (collected) by the microphone MIC installed at the listening position (listening point) through the connection terminal Min of the microphone, and receives it. After being amplified by the microphone amplifier 26, it is converted into a digital audio signal by the ADC 25 and supplied to the signal processing unit 22 for analysis.

  As described later, the microphone MIC can be connected in this way by receiving a sound emitted from each speaker and analyzing the sound, for example, a television receiver. This is because the delay amount of the delay processing applied to the audio signal can be measured in consideration of the time related to the video signal processing. The control device 2 also includes a set value storage memory 27 that stores and holds information such as the measured delay amount of the audio signal, which will be described in detail later.

  The audio / video reproduction system according to the first embodiment shown in FIG. 4 includes the pre-out terminals L and R of the L (left) channel and the R (right) channel of the pre-out terminal group OA-M of the control device 2. The audio input terminals L and R of the two left and right channels of the input terminal group 31 of the television receiver 3 are connected to each other as in the case of the video / audio reproduction system shown in FIG.

  Further, each speaker output terminal L, R, SL, SR, C of the speaker output terminal group OAS-M of the control device 2 is connected to the corresponding external speaker oL, oR, oSL, oSR, oC. Is the same as in the case of the video and audio reproduction system shown in FIG.

  The control device 2 of the video / audio reproduction system according to the first embodiment generates a measurement signal, supplies the measurement signal to the television receiver 3, and emits sound from the built-in speakers TVL and TVR of the television receiver 3. The sound corresponding to the measurement signal is received by the measurement microphone MIC to obtain a response signal for the measurement signal. From the output timing of the measurement signal and the reception timing (input timing) of the response signal, The delay amount (delay time) of the audio signal in the television receiver 3 can be measured.

  Similarly, the control device 2 of the video / audio reproduction system according to the first embodiment generates a measurement signal and supplies it to the external speakers oL, oR, oSL, oSR, oC, and these external speakers oL. , OR, oSL, oSR, oC, the sound corresponding to the measurement signal is received by the measurement microphone MIC to obtain a response signal for the measurement signal, and the measurement signal output timing and response From the signal reception timing (input timing), the delay amount (delay time) of the audio signal emitted from the external speaker can also be measured.

  Then, the control device 2 applies the audio signal supplied to each of the external speakers oL, oR, oSL, oSR, oC in the television receiver 3 as described above based on the delay amount measured as described above. By delaying according to the delay of the audio signal, the lip sync is prevented from shifting.

  Note that such processing is performed by a key provided on the remote control or the main body with respect to the control device 2 when the user feels uncomfortable with the lip sync while viewing the video, or at any timing such as a preparation stage when viewing the video. It can be started by operating the operation unit.

  And in this 1st Embodiment, when the control apparatus 2 performs the measurement process which measures the delay amount of an audio | voice signal, two connection shown as conditions (1A) and conditions (1B) below・ Minimum setting conditions are required.

  First, the condition (1A) is that the audio signal is digitally transmitted through any channel from the control device 2 having a function of measuring the delay amount of the audio signal to the television receiver 3 in which the delay of the audio signal occurs. Or it must be able to be supplied in analog.

  The condition (1B) requires that a video signal for adjusting the lip sync is input to the television receiver 3 and displayed. At this time, it does not matter whether the video signal passes through the control device 2 or not. In addition, as in the television receiver 3 described above, when a user has a plurality of image quality modes and the user can select an image quality mode, it is necessary to select the image quality mode arbitrarily.

  The purpose of the condition (1A) is to output an arbitrary audio signal (measurement signal) from the control device 2 to the television receiver 3. By sending the measurement signal generated inside the control device 2 to the television receiver 3, it is possible to obtain an audio signal synchronized with the image processing delay generated inside the television receiver 3, that is, a response of the measurement signal. This response signal includes delay information.

  The purpose of the condition (1B) is the state where the actual television receiver 3 takes time to process the video and delays in order to match the final purpose of the lip sync (especially the synchronization of the video and the external speaker sound). In order to create a situation where it is necessary to match the lip sync now, the video needs to be streamed. For the same reason that the user wants to match the lip sync, the TV receiver 3 also needs to set the mode. This is because the delay time varies depending on the mode setting in most cases.

  Furthermore, in this first embodiment, as will be described in detail below, as a condition (1C), a volume is set from the control device 2 having a function for measuring the delay time of the audio signal to the television receiver 3. It is necessary to have means that can control (means that can control the volume). Specific means for controlling the volume include wireless control using infrared rays and radio waves equivalent to the remote control used for remote control in various electronic devices, digital interfaces having control signal lines such as IEEE 1394 and HDMI, etc. A standard analog / digital control signal line or the like can be used.

  When the volume of the television receiver 3 cannot be controlled from the control device 2, the function can be compensated by manual control by the user, as will be described later.

  In the first embodiment, as the condition (1D), an audio signal received by the measurement microphone MIC placed at the user's viewing position (listening point) is supplied to the control device 2, It needs to be converted into a digital signal and handled by the signal processing unit 22 constituted by a DSP or CPU.

  As described with reference to FIGS. 1 to 3, in the television receiver 3, an image delay occurs because various processes are required for the input video signal. In order to perform delay processing on the audio signal in the television receiver 3 so as to synchronize with it, the control apparatus 2 measures and records the audio delay state in the television receiver 3 and corrects the time axis for the audio signal during reproduction. It is used as reference information for

  Also, as a video signal supply path, a path for supplying the video signal directly from the source signal reproducing device 1 to the television receiver 3 and a path for supplying the video signal from the source signal reproducing device 1 to the television receiver 3 via the control device 2 are provided. However, since the control device 2 itself hardly causes a delay with respect to the video signal, it may be supplied to the television receiver 3 by any route.

[Configuration example of control device 2]
Next, a configuration example of the measurement module of the control device 2 having a function of measuring the delay amount for the audio signal will be described. FIG. 5 is a block diagram for explaining a configuration example of a measurement module for measuring the delay amount of the audio signal in the control device 2 of the video / audio reproduction system shown in FIG.

  In FIG. 5, each of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D is realized by the signal processing unit 22 including a DSP, a CPU, and the like. is there. That is, the signal processing unit 22 implements the functions of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D in order to execute the measurement process. The DAC 23 and the DAC / AMP 24 indicate that a DAC or a DAC / AMP is provided for each audio channel.

  The sequence controller 22A of the control device 2 can control each part of the control device 2, and is connected to the television receiver 3 through the control signal input terminal 2i and the control signal output terminal 2o. 3 can be supplied with a control signal, or a control signal can be received from the television receiver 3, and a target process can be executed using the control signal.

  The measurement signal generation unit 22B generates a predetermined measurement signal in accordance with the control of the sequence controller 22A, and supplies this to the output switching unit 22C. The measurement signal generated by the measurement signal generator 22B is not particularly defined as long as it is a wideband noise or signal having a known frequency characteristic. For example, the TSP signal described above may be used, broadband noise such as white noise, pink noise, and M-sequence noise may be used, and general voice / music signals may be used. The measurement signal can be generated by calculation according to a predetermined logic or by reading from a memory connected to the measurement signal generator 22B.

  The output switching unit 22C switches the supply destination of the measurement signal according to the control of the sequence controller 22A. For example, only the DAC 23 can be supplied, only the DAC / AMP 24 can be supplied, or both the DAC 23 and the DAC / AMP 24 can be supplied. Of course, the measurement signal can be supplied to one or more selected channels in the DAC 23, or the measurement signal can be supplied to one or more selected channels in the DAC / AMP 24.

  As will be described later, the response signal analysis unit 22D receives the sound from the measurement microphone MIC, receives the supply through the microphone input terminal Min, amplifies the signal by the microphone amplifier 26, and converts the measurement signal into a digital signal by the ADC 25. The response signal is supplied, and the delay amount of the audio signal is grasped based on the reception timing of the response signal and the output timing of the measurement signal from the measurement signal generator 22B grasped by the sequence controller 22A. It is something that can be done.

  In the first embodiment, as will be described later in detail, sound corresponding to the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3, and the sound is received by the measurement microphone MIC. As described above, the amount of delay of the audio signal in the television receiver 3 is measured by analyzing the response signal analysis unit 22D of the control device 2.

  Further, sound corresponding to the measurement signal is emitted from the external speakers oL, oS, oSL, oSR, and oC, and is received by the measurement microphone MIC. As described above, the response signal analysis unit 22D of the control device 2 is received. The delay amount of the sound emitted from the external speaker is measured.

  Based on both the delay amount of the audio signal in the television receiver 3 and the delay amount of the audio signal emitted from the external speaker, the delay amount of the audio signal supplied to the external speaker is appropriately grasped. Then, according to the grasped delay amount, the audio signal supplied to each of the external speakers oL, oS, oSL, oSR, oC can be appropriately subjected to delay processing.

[Regarding Grasping Process (Measurement Process) of Audio Signal Delay in First Embodiment]
Hereinafter, in the video and audio reproduction system according to the first embodiment, the process of grasping the delay amount of the reproduced audio signal mainly performed by the control device 2 will be described with reference to the flowcharts of FIGS. explain.

  FIG. 6 and FIG. 7 are flowcharts for explaining processing for grasping the delay amount of the reproduced audio signal mainly performed by the control device 2. As described above, the processing for grasping the delay amount of the audio signal performed in the video / audio reproduction system according to the first embodiment is performed from the measurement process using the measurement microphone MIC and mainly measuring the signal in the space. It will be. In the flowcharts shown in FIGS. 6 and 7, for the sake of simplicity, the television receiver 3 is abbreviated as TV, and the control device 2 is described as an AV amplifier.

  The processing of the flowcharts shown in FIGS. 6 and 7 is advanced by the function of the sequence controller 22A of the control device 2 shown in FIG. First, the sequence controller 22A determines (verifies) whether or not the control device 2 can perform volume control (volume control) of the television receiver 3 (step S101). Various methods can be used for the determination processing (verification processing) in step S101. For example, it is possible to use a “method for determining whether or not to control volume between a plurality of devices” described later in detail.

  In the determination process of step S101, when it is determined that the volume control of the television receiver 3 can be performed from the control device 2, the sequence controller 22A acquires the current volume value (volume value) of the television receiver 3, Is stored and held in a predetermined memory (step S102).

  Thereafter, the sequence controller 22A appropriately controls the volume of the television receiver 3 so that the response of the measurement signal can be obtained as a response signal of a necessary sound pressure by the measurement microphone MIC installed at the listening position. (Step S103). For this reason, before starting the processing shown in FIGS. 6 and 7, a method of reproducing and measuring / calculating a preparation signal for measuring a rough sound pressure, and a reproduction volume of the measurement signal gradually. It is also possible to take a technique of adjusting the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 to an appropriate level.

  Further, using a “volume synchronization method between a plurality of devices” described later in detail, for example, a correspondence table between a control volume value from the control device 2 and a corresponding volume level (sound pressure) in the television receiver 3 is converted into a numerical table, for example. And by referring to a numerical table indicating the correspondence, control is performed so that the sound level (sound pressure) emitted from the built-in speakers TVL and TVR of the television receiver 3 is an appropriate level. The device 2 may set the volume level of the television receiver 3.

  If it is determined in step S101 that the volume control of the television receiver 3 is not possible (impossible) from the control device 2, the sequence controller 22A manually increases the volume value of the television receiver 3. Although not shown in the figure, a message for instructing the user to manually set the volume value (volume value) of the television receiver 3 to the user by, for example, displaying it on an LCD (Liquid Crystal Display) provided in the control device 2. To make an adjustment (step S104).

  Note that the message for the user is formed in the control device 2, for example, and supplied to the television receiver 3 through the pre-out terminal group OA-M and displayed on the display screen of the image display unit 33 of the television receiver 3. It may be. Of course, the message is not limited to a display message, and a voice message may be used. When using a voice message, the voice message formed in the control device 2 is supplied to the television receiver 3 and emitted from the built-in speakers TVL and TVR of the television receiver 3 or connected to the control device 2. It is possible to emit sound from external speakers oL, oR, and the like.

  After the process of step S103 or step S104, the sequence controller 22A of the control device 2 controls the measurement signal generation unit 22B to generate a measurement signal and also controls the output switching unit 22C to output the generated measurement signal. The sound is supplied to the television receiver 3 and sound corresponding to the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3 (step S105). In this example, a TSP signal is used as the measurement signal.

  In the first embodiment, as described with reference to FIG. 4, the output terminal of the L (left) channel of the pre-out terminal group OA-M of the control device 2 is the input terminal group 31 of the television receiver 3. Connected to the input terminal of the L (left) channel, the output terminal of the R (right) channel of the pre-out terminal group OA-M of the control device 2 is the input terminal of the R (right) channel of the input terminal group 31 of the television receiver 3 Therefore, the measurement signal from the control device 2 is reliably supplied to the television receiver 3.

  Therefore, the assumed signal from the control device 2 is reliably supplied to the television receiver 3 and sound corresponding to the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3. Moreover, since the volume value of the television receiver 3 is controlled from the control device 2 side, the sound corresponding to the measurement signal is emitted at an appropriate reproduction volume, and the response signal for the measurement signal is appropriately obtained and controlled. Feedback to the device 2 is made possible.

  In addition, as described above, when the sound corresponding to the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3 and the measurement is performed by collecting the sound, the control device 2 is connected. It is necessary to appropriately switch and control the output switching unit 22C in the control device 2 so that sound is not reproduced from the external speakers oL, oR, oSL, oSR, and oC.

  As described with reference to FIGS. 4 and 5, the response signal for the measurement signal collected by the assumed microphone MIC is supplied to the control device 2 through the microphone input terminal Min, amplified by the microphone amplifier 26, and After being converted to a digital signal by the ADC, it is supplied to the response signal analysis unit 22D. The response signal analyzer 22D receives the response signal for the measurement signal supplied thereto, and measures the impulse response (step S106).

  As described above, in the first embodiment, since the TSP signal is used as the measurement signal, the response signal analysis unit 22D listens from the built-in speakers TVL and TVR of the television receiver 3 that is a reproduction speaker. The impulse response up to the measurement microphone MIC at the position (listening position) can be measured and calculated.

  Then, the response signal analysis unit 22D analyzes the measured impulse response, calculates the delay time (delay amount) for the audio signal based on the time when the measurement signal is started to be reproduced by considering the sound speed. The delay time thus stored is stored in the delay time table of the set value storage memory 27 (step S107). The method for obtaining the delay time is described in detail in a previous application (Japanese Patent Application No. 2005-067413, “Measuring apparatus, measuring method, program”) by the present inventor.

  In the first embodiment, the delay time for the audio signal obtained as described above is a television receiver as can be seen from the configuration of the video / audio reproduction system of the first embodiment shown in FIG. 3 includes both an audio delay synchronized with a delay due to image processing (video processing) within 3 and a delay due to spatial propagation of sound. In the video and audio reproduction system according to the first embodiment, the left and right two-channel audio signals of the pre-out terminal group OA-M of the control device 2 are supplied to the television receiver 3, and the built-in speaker TVL of the television receiver 3 Since the sound is emitted through the TVR, the numerical value of the delay amount is recorded in the database on the setting value storage memory 27 together with the channel information of the reproduction speaker on the television receiver 3 side.

  In the description of FIG. 6, the audio signals of the pre-out L (left) channel and R (right) channel of the control device 2 are supplied to the television receiver 3, but this is not necessarily general. For example, there is a case where a pre-out C (center) channel audio signal of the control device is supplied to a television receiver and distributed to the left and right channels of the television receiver 3.

  Originally, it is necessary to perform the impulse response measurement after examining the relationship between the output terminals of the pre-out terminal group OA-M of the control device 2 and the channels of the built-in speakers TVL and TVR of the television receiver 3. . As a method for examining the relationship between the connection channels, for example, there is a “connection analysis method between a plurality of devices” described later.

  Then, as described above, when the measurement related to the built-in speakers TVL and TVR of the television receiver 3 is completed by the processes of steps S101 to S107, the process directly from the step S108 to the step S114 shown in FIG. It moves to the measurement about the connected external speakers oL, oR, oSL, oSR, oC.

  That is, the system controller 22A proceeds to the process shown in FIG. 7, and determines whether the volume control (volume control) of the television receiver 3 can be performed from the control device 2 in the same manner as the process of step S101 shown in FIG. Judgment (verification) is made (step S108). If it is determined in step S108 that the volume control (volume control) of the television receiver 3 can be performed from the control device 2, the television receiver 3 is controlled from the control device 2, and the television receiver at that time is controlled. After the volume value of 3 is stored and held, muting is performed so that sound is not emitted from the built-in speakers TVL and TVR of the television receiver 3 (step S109).

  When it is determined in step S108 that the volume control (volume control) of the television receiver 3 is not possible (impossible) from the control device 2, the sequence controller 22A manually sets the volume value of the television receiver 3. Although not shown in the figure, a message for instructing the TV receiver 3 to be lowered is displayed on, for example, an LCD (Liquid Crystal Display) included in the control device 2, and the volume value (volume value) of the television receiver 3 is displayed to the user. Is manually adjusted (step S110).

  In the process of step S110, similarly to the process of step S104 described above, a message for the user is formed in the control device 2, for example, and this is supplied to the television receiver 3 through the pre-out terminal group OA-M. The image may be displayed on the display screen of the image display unit 33 of the television receiver 3. Further, the message is not limited to a display message, and a voice message can be used. When using a voice message, the voice message formed in the control device 2 is supplied to the television receiver 3 and emitted from the built-in speakers TVL and TVR of the television receiver 3 or connected to the control device 2. It is possible to emit sound from external speakers oL, oR, and the like.

  Thus, the volume control of the television receiver 3 does not necessarily have to be automatically performed from the control device 2 side, and when the control device 2 determines that the volume of the television receiver 3 cannot be controlled. By outputting a message to the user, it is possible to prompt the user to set the volume on the television receiver 3 side before and after the measurement, and to secure the intended volume and muting state.

  After the process of step S109 or step S110, the sequence controller 22A of the control device 2 controls the measurement signal generation unit 22B to generate the measurement signal (TSP signal), and also controls the output switching unit 22C to generate it. The measured signal is supplied to each of the external speakers (denoted as external SP in FIG. 7) oL, oR, oSL, oSR, oC, and the measurement signal is sent from each of the external speakers oL, oR, oSL, oSR, oC. A corresponding sound is emitted (step S111).

  In the first embodiment, as described with reference to FIG. 4, each of the speaker output terminals of the speaker output terminal group OAS-M of the control device 2 has an external speaker oL, oR, oSL, oSR. , OC is connected, the measurement signal from the control device 2 is reliably supplied to each external speaker oL, oR, oSL, oSR, oC, and the sound corresponding to the measurement signal is sent to each external speaker oL, oR, Sound is emitted from oSL, oSR, and oC.

  As described above, the sound is muted so that sound is not emitted from the built-in speakers TVL and TVR of the television receiver 3, but sound is not emitted from the built-in speakers TVL and TVR of the television receiver 3. The output switching unit 22C in the control device 2 may be appropriately switched and controlled.

  As described with reference to FIGS. 4 and 5, the response signal for the measurement signal collected by the assumption microphone MIC is supplied to the control device 2 through the microphone input terminal Min and amplified by the microphone amplifier 26. After being converted into a digital signal by the ADC, it is supplied to the response signal analysis unit 22D and an impulse response is measured (step S112).

  In the first embodiment, since the TSP signal is used as the measurement signal, the response signal analysis unit 22D receives the listening position (listening) from the external speakers oL, oR, oSL, oSR, oC that are reproduction speakers. The impulse response to the measurement microphone MIC at the position) can be measured and calculated.

  The response signal analysis unit 22D analyzes the measured impulse response, calculates the delay time (delay amount) for the audio signal based on the time when reproduction of the measurement signal is started by considering the sound speed, and calculates the calculated delay The time is stored and held in the delay time table of the set value storage memory 27 (step S113). The process in step S113 is the same as the process in step S107. In the case of an external speaker, except for the system delay, the spatial propagation delay of sound appears as a delay as it is.

  If the own controller is capable of controlling the volume of the television receiver 3, the sequence controller 22A reads the volume value stored and held before muting the volume of the television receiver 3 in the process of step S109. Then, the volume value of the television receiver 3 is returned to the value before mute (step S114), and the processes shown in FIGS. 6 and 7 are ended.

  Note that by returning the volume value to the value before mute in step S114, it is possible to prevent the audio / video reproduction system from outputting audio unintended by the user. That is, the video / audio reproduction system according to the first embodiment uses both the built-in speaker and the external speaker of the television receiver 3 as shown in FIG.

  However, in practice, as shown in FIG. 2, it is considered that there is a case where only an external speaker is used for reproducing an audio signal without using the built-in speaker of the television receiver 3. However, the main purpose of the processing shown in FIGS. 6 and 7 is to measure the delay amount (delay time) of the delay processing performed on the audio signal due to the time required for the image processing in the television receiver 3. is there.

  Therefore, even when the built-in speaker of the television receiver 3 is not used, it is necessary to measure the sound emitted from the image speaker with good S / N. Therefore, after the sound is emitted from the built-in speaker and measured, the system that does not use the built-in speaker by restoring the sound emission state (volume value state) of the sound from the built-in speaker. The sound can be prevented from being emitted from the built-in speaker.

  Of course, also in the case of the sound reproduction system using the built-in speaker of the television receiver 3, since the processing shown in FIGS. 6 and 7 is executed, the sound emitted from the built-in speaker of the television receiver 3 is It is possible to prevent inconveniences such as becoming smaller and conversely becoming larger.

  Then, the delay amount of the sound emitted from the built-in speaker of the television receiver 3 and the external speakers oL, oR, and oSL, which are measured by the processing for measuring the delay amount of the audio signal described with reference to FIGS. By properly controlling the delay amount of each audio channel of the control device 2 during audio reproduction based on the audio delay amount output from the oSR and oC, so-called lip sync deviation does not occur. Can be.

  That is, during playback, the built-in speaker and the external speaker of the television receiver 3 are basically combined, and the delay amount of the sound emitted from all the speakers is the same in the control device 2 during playback. Adjust the delay for the audio channel. In this case, adjustment can be performed in the same manner as in general speaker time alignment.

  FIG. 8 is a diagram for explaining video playback timing and audio signal playback timing of each audio channel in the video and audio playback system of the first embodiment. 8A shows a state before delay correction, and FIG. 8B shows a state after delay correction. The details of the audio signal reproduction process in the control device 2 including the delay correction processing corresponding to the measured delay time will be described later.

  As shown in FIG. 8A, before the delay correction for the audio signal, as described above, only in the television receiver 3, each audio channel is set according to the time required for the image processing in the image processing unit 32. Only the audio signal can be delayed. Therefore, the response of the sound emitted from the built-in speaker of the television receiver 3, that is, only the TVL response and the TVR response coincide with the synchronization of the reproduced video, and the sound is emitted from the external speakers oL, oR, etc. The audio response is out of sync with the reproduced video.

  However, by executing the audio signal delay amount measurement process described with reference to FIGS. 6 and 7, the delay amount of the audio signal emitted from each speaker can be accurately measured. In response to the sound signal of the sound emitted from the external speakers oL, oS, oSL, oSR, and oC so as to be synchronized with the sound emitted from the built-in speakers TVL and TVR of the television receiver 3. Apply delay processing.

  As can be seen from the impulse response of the TVL response and the TVR response in FIG. 8A, both are not exactly the same delay time due to the distance difference to the microphone. However, the video output timing almost coincides with the time adjustment in the TV device described above. In the data of FIG. 8A, since the delay amount of the TVL response is slightly larger than that of the TVR response, the delay time of the TVL response is used as the reference delay time here.

  Note that there are many methods for determining the reference delay time, such as the average of both of the results of the built-in speaker of the television receiver 3, the use of a specific one side, or the one with less delay. Compared to quantity, it is a very small problem, and it doesn't matter in any way.

  As will be described in detail later, in the control device 2, for the audio signal supplied to the external speakers oL, oS, oSL, oSR, oC, the reference delay time and the external speakers oL, oS, oSL, oSR, oC As shown in FIG. 8B, by appropriately determining the delay amount in consideration of the delay time of the sound emitted from the receiver and performing the delay process, the television receiver 3 can also receive the sound emitted from the external speaker. It is possible to synchronize the sound emitted from the built-in speakers TVL and TVR.

  However, in FIG. 8A, the delay amount for the audio signal emitted from the external speaker oC for some reason is larger than the reference delay time. Since the delay time due to the video is considerably larger than the spatial propagation of sound, the amount of delay for the audio signal emitted from the external speaker oC shown in FIG. 8A is a phenomenon that is usually difficult to occur. is there.

  In such a case, the delay cannot be adjusted in view of the causality so that it cannot approach the reference delay time, so no operation is performed. Speaking from the conventional concept of time alignment, all other signals are delayed with reference to the external speaker oC having the largest delay amount, but this is not performed here. The reason is that, in FIG. 8, it is clear from the lip sync concept that what is best synchronized with the video signal is an audio signal emitted from the built-in speakers TVL and TVR of the television receiver 3. is there.

  As described above, what is important in correcting the delay amount of the audio signal is not to make the delay device work so that all the response times are matched with the latest arrival time. In other words, the playback timing of the sound of the other audio channel is matched with the playback timing of the sound emitted from the TV built-in speaker.

  The technique used in the first embodiment mainly requires a measurement microphone (connected to the control device 2) at the listening position, and a sound propagation space and a delay corresponding to the image delay of the television receiver 3. Measurement and analysis of the delay time including, and the time relationship can be corrected during reproduction.

  In the first embodiment, as described above, first, as a first step, sound corresponding to the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3, and this is used for measurement. By receiving the microphone MIC and analyzing the response signal for the measurement signal obtained by receiving the sound, the delay amount for the audio signal generated in the television receiver 3 is accurately measured, and the set value storage memory 27 To store.

  Then, as a second stage, sound corresponding to the measurement signal is emitted from the external speakers oL, oR, oSL, oSR, oC connected to the control device 2, and the sound is received by the measurement microphone MIC. By analyzing the response signal for the measurement signal obtained in this manner, the amount of spatial propagation delay for the sound signal emitted from the external speaker is accurately measured and stored in the set value storage memory 27.

  Thereafter, the delay amount measured in the first stage process stored in the set value storage memory 27 (the delay amount for the audio signal generated in the television receiver 3) and the second stage process are measured. Based on the delay amount (spatial propagation delay amount of the sound emitted from the external speaker), an appropriate delay amount is set so that at least the audio signal supplied to the external speaker does not cause lip sync. In accordance with this setting, the audio signal supplied to the external speaker is subjected to delay processing.

  However, it is not limited to this. Since it is considered that the delay amount measured in the second stage processing (spatial propagation delay amount of sound emitted from the external speaker) is relatively small in many cases, for example, the first stage described above Only the measurement process is performed, and only the delay amount of the audio signal generated in the television receiver 3 is accurately measured, and based on this, the delay process for the audio signal to be reproduced in the control device 2 may be performed. .

  In addition, as described above, both the first-stage measurement and the second-stage measurement are performed, and as shown in the external speaker oC in FIG. 8C, the television receiver 3 is built-in. When the sound delayed from the sound emitted from the speaker is emitted, the delay amount for the audio signal reproduced through the control device 2 is set with the most delayed audio signal as a reference. May be.

  Further, the processing described with reference to the flowcharts of FIGS. 6 and 7 is an application of the method according to the present invention. The program for executing the processing described with reference to the flowcharts of FIGS. 6 and 7 is a program according to the present invention. Therefore, by forming a program for executing each step of the flowcharts shown in FIGS. 6 and 7 and mounting the program on the control device so that it can be executed, various control devices can implement the first embodiment. The invention described as a form can be applied.

[About volume control availability judgment method, volume synchronization method, connection analysis method between multiple devices]
Next, as described above, whether or not the volume control between a plurality of devices is performed in the process for measuring the delay time of the audio signal according to the first embodiment or before executing the process for measuring the delay time. Each of the method, the volume synchronization method, and the connection analysis method will be described.

[How to determine whether volume control is possible between multiple devices]
First, a method for determining whether or not to control volume between a plurality of devices will be described. FIG. 9 to FIG. 13 are diagrams for explaining a volume control availability determination method between a plurality of devices that can be used in the first embodiment.

  FIG. 9 is a flowchart for explaining a specific sequence of a determination process in the volume control availability determination method between a plurality of devices that can be executed by the control device 2 according to the first embodiment. FIG. 10 is a diagram for explaining, for example, a specific example of an interface assumed to be used between the control device 2 and the television receiver 3 according to the first embodiment described above and the priority order of determination. It is.

  The control device 2 of the first embodiment determines whether or not the volume control of the television receiver 3 is possible by executing the process shown in FIG. In consideration of reliability and accuracy among the interfaces that are considered to be able to control the volume of external devices (external volume control), try the interface according to the measurement order list with priorities as shown in FIG. Is to advance.

  As shown in the list of measurement order shown in FIG. 10, if the order of measurement is higher in reliability and accuracy, the measurement / determination is terminated when it is determined that the external volume control is possible. Can be efficient. In addition, although it is possible to control with an interface with high reliability and accuracy, it was possible to control with an interface with low reliability and accuracy, so there was a problem such as using an interface with low reliability and accuracy. Can also be prevented.

  In the control device 2 of this embodiment, as shown in FIG. 10, after determining the digital interface (HDMI, IEEE 1394) having high reliability and high accuracy, the determination is executed for the remote control interface. Yes.

  In addition, since the transmission format of the infrared remote control signal varies from manufacturer to manufacturer, trials of all codes (transmission formats) are prepared. That is, in the sequence controller 22A of the control device 2 of the first embodiment, all remote control signals having different assumed transmission formats can be formed and transmitted.

  In the sequence shown in FIG. 9 described in detail below, volume control is tried for each corresponding interface including a plurality of remote control interfaces using remote control signals having different transmission formats, and the response is analyzed. Normally, these remote control settings need to be input to the control device 2 after the user checks the manufacturer name of the device.

  However, when volume control is possible with the remote control interface, it is possible to determine which transmission format of the remote control signal can be controlled, so that the user can set which transmission format the control device 2 uses. This can be performed automatically without bothering the user, and the automatic manufacturer setting function of the remote controller shown here can improve user convenience.

  Hereinafter, a detailed sequence of the determination process will be described. By performing a predetermined operation for executing the determination process directly on the control device 2 or through a remote controller (not shown) of the control device 2, the signal processing unit 22 of the control device 2 performs the processing shown in FIG. To start.

  As described above, the signal processing unit 22 realizes the functions of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D. First, using the functions of the sequence controller 22A, The control I / F that is the target of determination of whether or not the volume control of the television receiver 3 is possible is advanced by one and specified (step S201). In the process of step S201 immediately after the start, the volume control of the television receiver is performed through the HDMI control signal line which is the first control I / F.

  A recent digital interface such as HDMI or IEEE 1394 has a bidirectional device control signal, and when a physical connection is established, the device control signal is transmitted and received to check whether communication is possible. An increasing number of people check whether they have established a handshake.

  Therefore, in the control device 2 of this embodiment, whether or not the control I / F to be determined is a handshake in the case of a bi-directional communication digital interface having a control signal line such as HDMI or IEEE1394. Is determined (step S202). If it is determined in step S202 that the handshake could not be confirmed, it is useless to control the volume of the television receiver 3 through the digital interface. Therefore, the processing from step S201 is repeated, The control I / F is selected.

  However, in the case of the remote control interface, since it is naturally unidirectional, even if the control device 2 actually transmits the control signal of the remote control signal, whether or not it works effectively has a built-in speaker of the television receiver 3. I don't know until I analyze the response of TVL and TVR. For this reason, when the control I / F to be determined is a unidirectional interface such as a remote control interface, the determination process in step S202 is bypassed. That is, when the control I / F to be determined is a unidirectional interface such as a remote control interface, the determination process in step S202 is not performed.

  In the determination process of step S202, if the establishment of handshake can be confirmed, or if the determination process of step S202 is bypassed because the control I / F to be determined is a unidirectional interface, the sequence The controller 22A generates a volume control signal, transmits it to the television receiver 3 through the currently selected control I / F, and outputs the volume of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 ( The volume is set to the minimum (mute state) (step S203).

  Next, the sequence controller 22A in the signal processing unit 22 controls the measurement signal generation unit 22B to generate a measurement signal (test signal), and also controls the output switching unit 22C to output the measurement signal from the measurement signal generation unit 22B. Is supplied to the built-in speakers TVL and TVR of the television receiver 3 through the DAC 23 and the L-channel output terminal and the R-channel output terminal of the video / audio pre-out terminal group (step S204).

  The generation of the measurement signal may be automatically generated by predetermined signal processing, or for example, a measurement signal prepared in advance in a memory in the signal processing unit or the like may be read and output. Further, an audio signal supplied from the playback device 1 may be used instead of using a measurement signal. In this case, the audio signal from the playback device 1 may be selected to be sent to the target channel.

  The sequence controller 22A of the signal processing unit 22 controls the measurement signal generation unit 22B to form a volume control signal while reproducing the measurement signal (supplying it to the television receiver 3), and this is generated as a television receiver. By supplying to the device 3, the volume of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is increased by a predetermined step (step S205). Here, the volume step is a control unit in each interface.

  It should be noted that how much the actual sound pressure increases when the increase of one step is controlled may be determined by each standard in the digital interface system. In addition, the standard of remote controllers varies from manufacturer to manufacturer, but it is thought that there is no extreme difference in terms of increase / decrease in volume for one step from the concept of human interface, even if the standardization of each company is not taken.

  For this reason, it is substantially monotonically increased by about +3 dB to +6 dB, rather than performing measurement signal reproduction / response signal reception by controlling every “step” in which the actual increase / decrease amount is completely different for each interface. It is more efficient and preferable to convert the number of steps in advance and perform a trial according to the converted number of steps.

  For example, a measurement microphone MIC is installed at the listening position of the user (viewer) as shown in FIG. 4, and this is connected to the control device 2, so that the control is performed as described later. The response sound (response signal) of the measurement signal is received inside the device 2 in a form including various effects in the space, and this is subjected to frequency analysis in the response signal analysis unit 22D of the signal processing unit 22, The obtained result is recorded in the specified value storage memory 27 (step S206).

  Next, with the function of the sequence controller 22A, the signal processing unit 22 has a control volume value (control VOL value) that is a volume control value of the volume control signal supplied to the television receiver 3 through the control I / F exceeds a threshold value. It is determined whether or not (step S207). The determination process in step S207 is a process for preventing the volume of the emitted sound from increasing abnormally.

  If it is determined in step S207 that the control volume value does not exceed the threshold, the signal processing unit 22 uses the function of the response signal analysis unit 22D to convert the received sound pressure level of the received response signal ( It is determined whether or not (sound pressure equivalent value) exceeds a prescribed threshold value (step S208). The determination processing in step S208 is processing for preventing speaker breakage and noise exposure.

  If it is determined in step S208 that the sound pressure equivalent value of the received response signal does not exceed the prescribed threshold value, the processing from step S205 is repeated by the function of the sequence controller 22A. That is, the control sound volume value is increased, the response signal received by the measurement microphone MIC at that time is subjected to frequency analysis to obtain a sound pressure equivalent value, and the process of recording the result in the database is repeated.

  If it is determined in step S208 that the sound pressure equivalent value of the received response signal has exceeded a prescribed threshold value, or if it is determined in step S207 that the control volume value has exceeded the threshold value, a response is made. Whether or not the volume of the television receiver 3 can be controlled through the currently selected control I / F based on the data recorded in the set value storage memory 27 in the process of step S206 using the function of the signal analysis unit 22D. Is determined (step S209).

  If it is determined in step S209 that the volume control of the television receiver 3 is not possible through the currently selected control I / F, the sequence controller 22A of the signal processing unit 22 performs the processing from step S201. The processing from step S202 to step S209 is repeated for the next control I / F.

  If it is determined in step S209 that the volume control of the television receiver 3 is possible through the currently selected control I / F, the control I / F that can control the volume of the television receiver 3 is specified. Since (judgment) has been made, the processing shown in FIG. 9 ends.

  In this way, the volume of the television receiver 3 is controlled by the volume control signal for each of the plurality of control I / Fs assumed to be used, and the measurement signal is transmitted to the built-in speakers TVL and TVR of the television receiver 3. From the relationship between the change in the response signal obtained by receiving the sound corresponding to the measurement signal with the measurement microphone MIC and the change in the volume control value (control volume value) of the volume control signal, A control I / F capable of volume control can be specified.

  The measurement signal generated in the measurement signal generation unit 22B of the signal processing unit 22 is not particularly defined as long as it is a wideband noise or signal with known frequency characteristics. For example, a TSP (Time Stretched Pulse) signal or broadband noise such as white noise, pink noise, or M-sequence noise may be used.

  FIG. 11 shows a frequency analysis of a response signal obtained by emitting sound corresponding to the TSP signal as a measurement signal from the built-in speakers TVL and TVR of the television receiver 3 and receiving the sound with the measurement microphone MIC. In this embodiment, it is a graph which shows the result of having performed FFT (Fast Fourier Transform). When the measurement result as shown in FIG. 11 is obtained, for example, the level average value at 300 Hz to 3 kHz is used as the measurement result used for determining whether or not the volume control is possible.

  12A and 12B show measurement results when the volume control signal of the television receiver 3 is controlled by transmitting a volume control signal from the control device 2 through the remote control interface, and the control volume value (control VOL value) is shown. ) Is an X axis, and a value (sound pressure equivalent value) obtained by converting a level average value at 300 Hz to 3 kHz shown in FIG.

  12A and 12B, when the number of steps of volume control is “3” and the control volume value is sequentially increased and transmitted as 0, 3, 6,... The sound pressure equivalent value obtained by converting the level average value of the response signal into the sound pressure is plotted so as to correspond to the above. Further, the maximum limit threshold value of the control sound volume value is 30, and the maximum limit threshold value of the sound pressure equivalent value is 82 dB.

  In this case, the control sound volume value is increased in certain steps, such as every three steps, but is not limited thereto. Of course, the number of steps of the volume control itself may be changed, for example, gradually increased.

  FIG. 12A shows an example of the case where the control volume value has reached the maximum limit threshold value “30”, and the measurement is terminated without performing any further measurement. In the case of FIG. 12B, the sound pressure as the measurement result is shown. Since the equivalent value is equal to or greater than the maximum limit threshold of “82 dB”, this is an example of the case where the measurement is terminated at this point.

  Based on the measurement results obtained as shown in FIGS. 12A and 12B, the control device 2 determines whether or not the volume control of the television receiver 3 is possible. This determination starts with a sound pressure equivalent value in the reverse order of the response signal measurement sequence, that is, the last (maximum control volume value) time when effective measurement was performed.

  This is because the measurement result of the portion with a large S / N is more reliable. Using this value as a reference, when the control volume value (horizontal axis in FIGS. 12A and 12B) is viewed in the reverse direction (the direction in which the control volume value decreases), the number of steps within which a continuous “monotone decrease” is recognized Judgment is made by calculating whether or not the equivalent amount is reached and comparing the calculation result with a threshold value.

  When the number of steps in which monotonous decrease is recognized is counted based on the largest control volume value, the control volume value is 3 steps from “30” to “27” in the case of FIG. 12A, and in the case of FIG. 12B. It can be seen that the control sound volume value is 18 steps from “27” to “9”. The threshold value to be compared with the number of steps in the monotonic phenomenon section calculated in this way is, for example, 10 steps.

  Accordingly, if it is determined that control is possible if a monotonic phenomenon interval of 10 steps or more is recognized, in the example shown in FIG. 12A, the number of steps in the monotonic decrease interval is 3 steps. In the case of the example shown in FIG. 12B, it is possible to determine that control is possible because the number of steps in the monotonically decreasing section is 18 steps.

  Further, in the above-described control availability determination process, the sound pressure equivalent value measured in the vicinity of the control sound volume value near zero is regarded as background noise, and the accuracy can be improved by subtracting this value from all the measured values.

  FIG. 13 is a flowchart for explaining a determination process performed by the signal processing unit 22 of the control device 2 according to the first embodiment as to whether or not the volume control of the television receiver 3 is possible. The process shown in FIG. 13 corresponds to the process performed in step S209 of the determination process shown in FIG.

  And the signal processing part 22 of the control apparatus 2 performs the process shown in FIG. 13 using the function of response signal analysis part 22D. First, as shown in FIGS. 12A and 12B, the response signal analysis unit, as shown in FIGS. A measurement result graph is created with the X axis as the control sound volume value and the Y axis as the sound pressure equivalent value, and the sound pressure equivalent value when the control sound volume value is the highest is specified as a reference (step S301).

  Next, the response signal analysis unit 22D calculates the number of steps of continuous monotonously decreasing steps by tracing the X axis in the reverse direction from the specified sound pressure equivalent value (step S302). Then, it is determined whether or not the number of steps in the monotonic phenomenon section calculated in step S302 is equal to or greater than a predetermined threshold (for example, 10 steps) (step S303).

  When it is determined in step S303 that the number of steps in the monotonic phenomenon section is equal to or greater than a predetermined threshold, the control device 2 determines that the volume control of the television receiver 3 is possible (step S304). Then, the process shown in FIG. If it is determined in step S303 that the number of steps in the monotonic phenomenon section is not equal to or greater than a predetermined threshold, the control device 2 determines that the volume control of the television receiver 3 is impossible (step S303). S305), the process shown in FIG.

  When it is determined in step S304 that the volume control of the television receiver 3 is possible, the sequence controller 22A of the signal processing unit 22 knows what interface is used for the control, so the sequence controller By using the 22A function, an interface capable of controlling the volume of the television receiver 3 can also be specified.

  When the interface for performing the volume control of the television receiver 3 is a remote control interface, the format of the remote control signal to be used can be specified, so that the remote controller to be used later with respect to the sequence controller 22A of the control device 2 is used. It is also possible to automatically set the signal format (manufacturer setting).

  In this way, the control device 2 can appropriately determine whether or not the volume control of the television receiver 3 is possible and, if possible, which interface can be used for control. When the control device 2 can control the volume of the television receiver 3, when a volume adjustment instruction is input through the remote control of the control device 2, for example, the control device 2 uses the external speakers oSL, oSR, and oC. The volume of the sound to be emitted is adjusted, and the control device 2 can control the volume of the television receiver 3 through the specified interface.

  It should be noted that the volume adjustment unit is not uniform among manufacturers or between devices and is different, so conventionally it has been necessary to individually adjust the volume for each device. Also, the relationship between the volume value (remote control level) and volume is generally not linear in many cases. For example, in order to improve the operational convenience of the device, even when the volume value changes, the small sound is small and the loud sound is greatly engraved, or a unique curve is set in consideration of loudness.

  For this reason, for example, even when the volume up key of the remote controller is operated once for the control device 2 to increase the volume, the volume up key is pressed three times for the television receiver 3. If the operation is not performed, there is a possibility that the sound emitted from the built-in speaker of the television receiver cannot be balanced with the sound emitted from the external speaker.

  Therefore, as in the case of the process for determining whether or not the control device 2 described above can perform the volume control of the television receiver 3, it is transmitted to the television receiver 3 through the interface that is determined to be capable of the volume control. While performing volume control, a predetermined measurement signal is supplied to the television receiver 3 to emit sound from the built-in speakers TVL and TVR. Then, a response signal of the measurement signal is obtained by receiving a sound corresponding to the measurement signal with the measurement microphone MIC installed at the listening position (listening point), and the sound pressure level of the response signal and the control at that time are obtained. The sound volume value is recorded in association with each other, and a correspondence table between the control sound volume value and the sound pressure level of the response signal is created.

  In this way, if the correspondence table between the control volume value and the sound pressure level is created, the volume of the sound emitted from the external speaker is adjusted by the control device 2 in accordance with the remote control signal from the remote control 100. In addition, referring to the association table, the control sound volume value having the same sound volume is specified, and the sound volume of the television receiver 3 is controlled by using the control sound volume value so as to follow the sound volume of the external speaker. The volume control of the machine 3 can be performed through the control device 2.

  The control device 2 can automatically and appropriately determine whether or not the volume control of the television receiver 3 is possible and specify the interface when the volume control is possible. As shown in FIG. 4, this is an important technique when a multi-channel video / audio reproduction system (listening system) is constructed by using a speaker built-in device such as a television receiver.

  In the embodiment described above, the speaker built-in device connected to the control device 2 is only the television receiver 3, but the present invention is not limited to this. Even when a plurality of speaker built-in devices such as a television receiver are connected to the control device 2 or a plurality of speaker connection devices to which a speaker such as a power amplifier is connected are connected, Volume control is performed by executing the processing shown in FIG. 9 for each connected speaker built-in device or speaker connected device when one or more speaker built-in devices or one or more speaker connected devices are connected. It is possible to appropriately determine whether or not the interface is possible, and if so, which interface.

  In the above-described embodiment, the measurement MIC is described as being installed at the listening position (listening point), but is not limited thereto. The measurement microphone MIC can be installed at any position where the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 can be received.

  In addition to the TSP signal generated for measurement and various noise signals, the reproduction audio signal supplied from the reproduction apparatus may be used as the measurement signal as the measurement signal.

In the embodiment described above, the following four points (1) to (4) can be given as important points. That is,
(1) For a control device with one or more external device volume control interfaces, connect the external device to the control line and signal line (including wireless connection), and then play the measurement signal and start from a small control volume value. Increase monotonously, and try to control the volume up to the default sound pressure value at the default sound volume or receiving location. The measurement signal reproduced from the speaker built in the external device is received by the measurement microphone, frequency-analyzed for each control volume value in the control device, and the average level of the band is recorded in the memory. It is determined whether or not volume control is possible based on the measurement result.

  (2) In the analysis subsequent to the measurement in (1), the maximum number of control sound values for which effective measurement has been performed is used as a reference value, and the corresponding number of steps indicating a continuous monotonic decrease is smaller than the predetermined threshold value when the control sound value decreases. If it is smaller, it is determined that volume control from the control device 2 is impossible, and if it is larger, it is determined that volume control is possible.

  (3) If there are a plurality of external device volume control interfaces, the most reliable volume can be obtained by sequentially selecting each interface based on the determined priority order and performing the measurement process (1) above. Identify the control interface.

  (4) The remote control signal code corresponding to each device maker is stored in the control device 2, and this is sequentially judged in the manner of (1) and (2). On the other hand, it is possible to automatically detect the manufacturer of the corresponding external device and set the code for specifying the format of the remote control signal without setting the manufacturer name or the like.

  Then, by realizing the point (1) and using the points (2) to (4) in combination with the point (1), the control device has a built-in speaker such as a television receiver. It is possible to appropriately determine whether or not the volume of a speaker device that is a speaker connection device such as a device or a power amplifier can be controlled, and when it is controllable, accurately determine which interface is controllable. It becomes possible to do.

  In the process shown in FIG. 9, the process is terminated when a control interface capable of controlling the sound volume is found, but the present invention is not limited to this. The processing shown in FIG. 9 may be executed for all assumed control interfaces, and as a result, a control interface capable of sound volume, and a control interface to be used for sound volume control may be specified.

  In this case, when there are a plurality of control interfaces capable of volume control, it is possible to select an optimal control interface in consideration of the device to be controlled.

  As described above, in the video / audio reproduction system according to the first embodiment, the control device 2 appropriately determines whether the volume control can be appropriately performed on the television receiver 3. Is possible. Further, the volume control availability determination method between a plurality of devices described here is also described in detail in Japanese Patent Application No. 2006-128173, which is an earlier application by the present inventor.

[About volume synchronization between multiple devices]
Next, a method for determining whether or not volume control is possible between a plurality of devices will be described. 14 to 19 are diagrams for explaining a volume synchronization method between a plurality of devices that can be used in the first embodiment.

  FIG. 14 and FIG. 15 are flowcharts for explaining the sequence (processing order) of the measurement process performed in the video / audio reproduction system of this embodiment, which is mainly executed in the signal processing unit 22 of the control device 2. Process. As described below, the process shown in FIG. 14 is a measurement process for sound emitted from the built-in speakers TVL and TVR of the television receiver 3, and the process shown in FIG. It is a measurement process about the sound emitted from oSR and oC.

  When a predetermined operation for executing the measurement process is performed directly on the control device 2 or through a remote controller (not shown) of the control device 2, the signal processing unit 22 of the control device 2 performs FIGS. The process shown in FIG. As described above, the signal processing unit 22 realizes the functions of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D. First, using the functions of the sequence controller 22A, A volume control signal is formed, and the volume (volume) of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is set to the minimum (step S401).

  In the video and audio reproduction system according to the first embodiment described above, the control signal output terminal 2o of the control device 2 and the control signal input terminal 3i of the television receiver 3 are connected as shown in FIG. Thus, the control signal input terminal 2i of the control device 2 and the control signal output terminal 3o of the television receiver 3 are connected to each other so that the control signals can be transmitted and received.

  For this reason, the volume control signal is supplied from the control device 2 to the television receiver 3 through the control signal line to which the volume control signal is connected. Thereby, in the television receiver 3, the AMP 33L and AMP 33R are controlled by the volume controller 34 so that the volume of the sound emitted from the built-in speakers TVL and TVR is minimized.

  The sequence controller 22A in the signal processing unit 22 controls the measurement signal generation unit 22B to generate a measurement signal (test signal), and also controls the output switching unit 22C to output the measurement signal from the measurement signal generation unit 22B. The measurement signal is supplied to the built-in speakers TVL and TVR of the television receiver 3 through the DAC 23 and the L-channel output terminal and the R-channel output terminal of the video / audio pre-out terminal group (step S402). The generation of the measurement signal may be automatically generated by predetermined signal processing, or for example, a measurement signal prepared in advance in a memory in the signal processing unit or the like may be read and output.

  The sequence controller 22A of the signal processing unit 22 controls the measurement signal generation unit 22B to form a volume control signal while reproducing the measurement signal (supplying it to the television receiver 3), and this is generated as a television receiver. By supplying to the device 3, the volume of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is increased (step S403).

  Then, a measurement microphone MIC is installed at the listening position of the user (viewer) as shown in FIG. 4 and is connected to the control device 2, so that the control device will be described later. It becomes possible to measure the response sound (response signal) of the measurement signal in the form including the various effects in the space.

  Then, the sequence controller 22A of the signal processing unit 22 determines whether or not the control sound volume value (volume setting) or the like for the television receiver 3 controlled by the sound volume control signal is equal to or higher than a predetermined threshold (step S404). . When it is determined in the determination process of step S404 that the control volume value (volume setting) for the television receiver 3 has reached a predetermined threshold value or more, it is estimated that there is some trouble with the connection. (Step S405), and the processing shown in FIGS. 14 and 15 is terminated.

  Further, in step S404, a warning message is presented to the user because the loudspeaker may be damaged even when the volume level of the response signal measured by the measurement microphone MIC exceeds a predetermined threshold. (Step S405), the processing shown in FIGS. 14 and 15 is terminated.

  As a warning message presentation mode, a message such as “There is a possibility of abnormality in the connection status. Please check” is displayed on the display device such as an LCD (Liquid Crystal Display) provided in the control device 2 and the control is performed. A warning sound may be emitted from the device 2, or either one of a message display and a warning sound may be performed. In this case, an LCD or a warning sound generation unit may be provided under the control of the signal processing unit 22.

  It is also possible to make a warning by turning on or blinking an LED (Light Emitting Diode), or to emit a warning message by voice. Alternatively, a warning message may be combined with a video signal supplied to the television receiver 3 and provided, and the warning message may be displayed on the image display unit of the television receiver 3 and provided to the user.

  If it is determined in step S404 that the control volume value (volume setting) or the like for the television receiver 3 is not equal to or greater than a predetermined threshold value, measurement is performed using the function of the response signal analysis unit 22D. It is determined whether or not a stable response of the measurement signal can be measured through the microphone MIC (step S406).

  If it is determined in step S406 that a stable response has not been measured, the processing from step S403 is repeated by the function of the sequence controller 22A, and the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is repeated. And the process of receiving the sound corresponding to the measurement signal emitted from the built-in speakers TVL and TVR of the television receiver 3 with the measurement microphone MIC is continued.

  When it is determined in step S406 that a stable response has been measured, the response signal from the measurement microphone MIC is first analyzed by the function of the response signal analysis unit 22D realized by the signal processing unit 22, The feature is stored, for example, in the television control-listening position volume table of the setting value storage database formed in the memory 27 provided in the AV control device (step S407). Specifically, the control volume value (volume setting) for the television receiver 3 controlled by the volume control signal by the function of the sequence controller 22A is associated with the volume level at that time (actual value for the response signal). Are recorded in the memory as a table.

  Then, the sequence controller 22A of the signal processing unit 22 determines whether or not the measured sound pressure is greater than the threshold value (step S408). If it is determined in step S408 that the measured sound pressure is not greater than the threshold value, the process from step S403 is repeated, and the control volume value (volume setting) is increased until the prescribed sound pressure can be measured. And repeat the measurement and analysis of the response signal.

  If it is determined in step S408 that the measured sound pressure has become larger than the threshold value, the measurement signal is emitted from the built-in speakers TVL and TVR of the television receiver 3, and the measurement signal is transmitted through the measurement microphone MIC. The measurement and analysis process of the response signal obtained by receiving the sound is finished, and the table information of the TV control-listening position volume table formed by the process of step S407 is changed to a curve about the table information as necessary. A straight line estimation process is performed, and a process of correcting the value of the table is performed according to this (step S409).

  Note that the measurement signal reproduced in step S402 is not limited to a specific signal, but is a signal having a wide band, and any signal type can be used as long as measurement can be completed with good S / N. For example, a TSP (Time Stretched Pulse) signal or broadband noise such as white noise, pink noise, or M-sequence noise may be used. If a TSP signal is used, an impulse response can be derived in an analysis routine, and information other than volume (such as time delay) can be measured. In this embodiment, the TSP signal is used as a measurement signal. Shall.

  The definition of the volume level measured from the response signal is not specified as a specific one. 16 and 17 are flowcharts for explaining a specific example of the definition of the volume level. In the response signal analysis unit 22D, for example, as shown in FIG. 16, the response signal is subjected to FFT (Fast Fourier Transform) (step S501), and a target band (for example, a band of 300 Hz to 3 kHz) in the frequency amplitude level. ) Level average value may be calculated (step S502), and this level average value may be used as the volume level.

  Further, in the response signal analysis unit 22D, for example, as shown in FIG. 17, a response signal such as noise or a TSP signal is subjected to a band filter (step S601), and the square of the time signal subjected to the band filter is taken. Then, the energy value may be obtained (step S602), and the obtained energy value may be used as the volume level.

  In the video / audio reproduction system of this embodiment, the volume level obtained by the method shown in FIG. 16 is used. As shown in FIG. 11, the level average value in the band of 300 Hz to 3 kHz is obtained here. Then, it shall record in a database as a volume level. Note that FIG. 11 corresponds to the frequency characteristics of the response signal of the TSP measurement signal having a flat all-band when the control volume value is “24”.

  FIG. 19 is a diagram illustrating a recording example of the setting value storage database 29. As shown in FIG. 19, as a numerical value corresponding to the control sound volume value, the sound volume level at the listening position is converted and recorded from the gain of the microphone amplifier and the performance of the ADC. Specifically, in the control device 2, as shown in FIG. 19, a table including a control volume value, a measured response signal linear response calculated value, and a measured response signal sound pressure equivalent value is formed in a set value storage database. To do.

  In FIG. 19, the measured response signal linear response calculated value is a value (linear value) obtained from the waveform of the response signal, and the measured response signal sound pressure equivalent value is a value obtained by converting the response signal into dB.

  As described with reference to FIG. 14, the response signal is measured while the volume of the television receiver 3 is gradually increased. However, the measurement response signal linear is not necessarily obtained for all the control volume values. There is no need to measure and record the calculated response value or the measured response signal sound pressure equivalent value. The table in the example shown in FIG. 19 is obtained by measuring the control sound volume value by three.

  However, actually, it is not necessary to measure and record the measurement response signal linear response calculation value or the measurement response signal sound pressure equivalent value at fixed numerical intervals. The purpose here is, for example, to obtain a correspondence graph as shown in FIG. That is, since the measurement response signal sound pressure equivalent value corresponding to the change in the control volume value (control VOL value) or the measurement response signal linear response calculation value is obtained, the measurement is performed with a rougher control VOL value. You may use the method of measuring the part required for graph preparation suitably.

  Further, as can be seen from FIG. 18, when the control volume value (control VOL value) is small, the graph is expected to be discontinuous. This is because the sound volume is measured through the real space, so that not only the measurement signal response but also the background noise is input to the measurement microphone MIC. Therefore, it is necessary to estimate the correct straight line / curve from the data portion where the S / N is considered to be secured as shown by the dotted line in FIG. This process is the process of step S409 shown in FIG.

  In this way, when the processing from step S401 to step S409 is performed for the sound emitted from the built-in speakers TVL and TVR of the television receiver 3, and the response of the measurement signal becomes larger than a certain level, The TV volume control is not further increased, the measurement using the built-in speakers TVL and TVR of the television receiver 3 is finished, and the sound emitted from the external speakers oSL, oSR, and oC shown in FIG. Perform the target measurement process.

  First, the gain controller provided as a function in the signal processor 22 is controlled using the function of the sequence controller 22A, and the volume (volume) of the sound emitted from the external speakers oSL, oSR, oC is set to the minimum. Then, the measurement signal generator 22B is controlled to generate a measurement signal (test signal), and the output switching unit 22C is controlled to send the measurement signal from the measurement signal generator 22B to the DAC / AMP 25 and the speaker output terminal. The signals are supplied to the external speakers oSL, oSR, and oC through the SL channel output terminal, the SR channel output terminal, and the C channel output terminal of the group 26 (step S410).

  The sequence controller 22A of the signal processing unit 22 controls the measurement signal generation unit 22B to reproduce the measurement signal (supplied to each external speaker) and gain control provided as a function of the signal processing unit 22 And the amplifier gain is increased to increase the volume of the sound emitted from the external speakers oSL, oSR, and oC (step S411).

  Then, the sequence controller 22A of the signal processing unit 22 determines whether or not the amplifier gain is equal to or greater than a predetermined threshold (step S412). When it is determined that the amplifier gain is equal to or greater than a predetermined threshold in the determination process in step S412, it is estimated that there is some trouble in the connection, so a warning message is presented to the user (step S413). The processes shown in FIGS. 14 and 15 are terminated.

  In step S412, a warning message is presented to the user because the loudspeaker may be damaged even when the volume level of the response signal measured by the measurement microphone MIC exceeds a predetermined threshold. (Step S413), the processing shown in FIGS. 14 and 15 is terminated. Note that the manner of presenting the warning message is the same as that described in step S405 of the process shown in FIG.

  When it is determined in step S412 that the amplifier gain or the like is not equal to or greater than a predetermined threshold value, the measurement signal is stabilized through the measurement microphone MIC using the function of the response signal analysis unit 22D. It is determined whether or not the response has been measured (step S414).

  If it is determined in step S414 that a stable response cannot be measured, the function from the sequence controller 22A is used to repeat the processing from step S411, and the volume of the sound emitted from the external speakers oSL, oSR, oC is increased. And the process of receiving the sound corresponding to the measurement signal emitted from the external speakers oSL, oSR, oC by the measurement microphone MIC is continued.

  If it is determined in step S414 that a stable response has been measured, first, the response signal from the measurement microphone MIC is analyzed by the function of the response signal analyzer 22D realized by the signal processor 22, The feature is stored in the amplifier gain-listening position volume table in a setting value storage database formed in, for example, a memory provided in the AV control device (step S415). Specifically, the amplifier gain in the gain control unit realized by the signal processing unit 22 by the function of the sequence controller 22A is associated with the volume level (actual value of the response signal) at that time and stored in the memory as a table. Record.

  Then, the sequence controller 22A of the signal processing unit 22 determines whether or not the measured sound pressure is greater than the threshold value (step S416). When it is determined in step S416 that the measured sound pressure is not greater than the threshold value, the processing from step S411 is repeated, and the gain control realized by the signal processing unit 22 until the prescribed sound pressure can be measured. Increase the amplifier gain in the unit, and repeat the measurement and analysis of the response signal.

  If it is determined in step S416 that the measured sound pressure has become larger than the threshold value, the measurement signal is emitted from the external speakers oSL, oSR, and oC, and the measurement signal is received through the measurement microphone MIC. In response to the table information of the amplifier gain-listening position volume table formed by the processing of step S415, the response signal obtained and the analysis processing of the response signal obtained by the above are estimated as necessary. Processing is performed, and processing for correcting the values in the table is performed according to this processing (step S417), and the measurement process shown in FIGS. 14 and 15 is terminated.

  In the processing shown in FIG. 15, the measurement signal generation in step S410 may be automatically generated by predetermined signal processing. For example, the measurement signal prepared in advance in a memory in the signal processing unit or the like may be used. You may make it read and output.

  The measurement signal reproduced in step S410 is the same as the measurement signal reproduced in step S402, for example, a TSP (Time Stretched Pulse) signal, and other white noise, pink noise, M-sequence noise, and the like. It is also possible to use a wide band noise.

  Further, the volume level in step S415 is also used as the volume level by calculating the level average value of the target band among the frequency amplitude levels by using the processing shown in FIG. The energy value can be obtained by applying a band filter to the response signal and taking the square of the time signal with the band filter, and using this as the volume level. Even in step S415, the volume level is grasped by a technique using FFT.

  In step S415, an amplifier gain-listening point volume table in which the control volume value of the television control-listening position volume table shown in FIG. 19 is changed to the amplifier gain is formed.

  In addition, what is controlled in the processing of step S410 to step S417 shown in FIG. 15 is an amplifier gain value built in the control device 2. Naturally, the signal processing unit 22 in the control device 2 has an amplifier gain value and a volume level. You can know the relationship in advance. Therefore, if measurement is performed at a sound pressure at which S / N is guaranteed to some extent, the table can already be estimated internally, and the loop shown in FIG. 15 can be simplified or omitted.

  Thus, in the video / audio reproduction system of the first embodiment, the built-in speaker of the television receiver 3 is obtained by the measurement process shown in FIGS. 14 and 15 realized by the control device 2 actively functioning. A TV control (TV control) -listening position volume table (shown in FIG. 19) in which control volume values for TVL and TVR are associated with volume levels of response signals to measurement signals is created, and an external speaker oSL, An amplifier gain-listening position volume table (in which the control volume value is changed to the amplifier gain in FIG. 19) in which the amplifier gain for oSR and oC is associated with the volume level of the response signal to the measurement signal can be created. It is.

  Even when the user performs a volume adjustment operation on the control device 2 based on the created TV control (TV control) -listening position volume table or amplifier gain-listening position volume table, the control device With the function, the volume adjustment for the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 can also be automatically adjusted appropriately. The volume synchronization method between a plurality of devices described here is also described in detail in Japanese Patent Application No. 2006-134652, which is an earlier application by the present inventor.

[Connection analysis method between multiple devices]
Next, a connection analysis method between a plurality of devices will be described. 20 and 21 are diagrams for explaining a connection analysis method (a method for grasping a routing state between devices) between a plurality of devices that can be used in the first embodiment. Here, for example, as shown in FIG. 4, the case where the control device 2 grasps the routing state in the video / audio reproduction system including the control device 2 and the television receiver 3 will be described as an example.

  In addition, here, for example, the control device 2 includes a plurality of output interfaces (output terminals) for outputting audio signals as shown in FIG. 21A, and inputs audio signals as shown in FIG. 21B. It is assumed that a plurality of input interfaces (input terminals) for receiving are provided and connected to the television receiver 3 through any one of them so that audio signals can be transmitted and received in both directions.

  In the example shown in FIG. 21A, the left and right channel (L (left) channel and R (right) channel) analog audio output terminals OA1 and the digital audio output for outputting the left and right channel audio signals are used as output interfaces. Multi-channel analog output with terminal OD1 and, for example, five output ends of L (left) channel, R (right) channel, SL (left rear) channel, SR (right rear) channel, C (center) channel It shows that the terminal group OA-Multi is provided.

  In the example shown in FIG. 21B, as input interfaces, analog audio input terminals IA1 and IA2 of two left and right channels (L (left) channel and R (right) channel) and two left and right channel audio signals are output. Audio input terminals ID1 and ID2, and a multi-channel having, for example, five input terminals of an L (left) channel, an R (right) channel, an SL (left rear) channel, an SR (right rear) channel, and a C (center) channel It shows that the channel has an analog input terminal group IA-Multi.

  FIG. 20 is a flowchart for explaining connection analysis processing (processing for grasping the routing state between devices) executed by the signal processing unit 22 mainly in the control device 2 shown in FIGS. 4 and 5. It is. The control device 2 shown in FIGS. 4 and 5 includes a key operation unit that receives an instruction input from the user. When an instruction to execute a process for grasping the routing state is received through the key operation unit, the control device 2 performs control. The sequence controller 22A of the signal processing unit 22 configured by a DSP, a CPU, or the like of the device 2 executes the process shown in FIG.

  First, the sequence controller 22A of the signal processing unit 22 uses a function such as the output switching unit 22C to output an output I to be verified from one or more output interface channels (hereinafter abbreviated as an output I / F channel). One / F channel is specified (step S701). This step S701 is a process of specifying one output I / F channel to be verified according to the output I / F channel sequence shown in FIG. 21A. Therefore, in the process of step S701 immediately after the start, the L (left) channel of the analog output terminal group OA1 is selected.

  Then, the sequence controller 22A of the signal processing unit 22 controls the measurement signal generation unit 22B to generate a measurement signal, and outputs the measurement signal through the output I / F channel specified in Step S701 (Step S702). In step S702, the measurement signal generation unit 22B may output a measurement signal generated according to a predetermined logic, or is stored in advance in a memory (not shown) in the signal processing unit 22. A measurement signal may be used, or a signal supplied through one of the input terminals may be selected and used as the measurement signal.

  Next, although not shown, the sequence controller 22A of the signal processing unit 22 is provided in the preceding stage of the response signal analysis unit 22D, receives audio signals received through each input interface, and receives audio from any input interface. A function of an input switching unit that switches whether a signal is supplied to the response signal analysis unit 22D is used to verify an input I / F to be verified from one or more input interface channels (hereinafter abbreviated as an input I / F channel). One F channel is specified (step S703).

  This step S703 is processing for identifying one input I / F channel to be verified according to the input I / F channel sequence shown in FIG. 21B. Therefore, in the process of step S701 immediately after the start, the L (left) channel of the analog input terminal group IA1 is selected.

  Then, by the function of the response signal analysis unit 22D of the signal processing unit 22, the correlation coefficient between the target output, that is, the output measurement signal, and the input signal, that is, the input response signal is calculated, and the maximum threshold value is calculated. The comparison result is stored in the set value storage memory 27 (step S704).

  In the process of step S704, if the calculated correlation value is equal to or greater than the threshold value, it can be determined that the route from the output specified this time to the input passes (the route passes), and the calculated correlation If the value is less than the threshold, it can be determined that the route from the output specified this time to the input does not pass (the route does not pass).

  Then, the sequence controller 22A of the signal processing unit 22 determines whether or not the input I / F channel has reached the end (step S705). In the determination processing in step S705, the input I / F channel is not completed, that is, in the input I / F channel sequence shown in FIG. 21B, the C (center) channel of the multi-channel analog input terminal group IA-M is set. If it is determined that the process has not reached, the process from step S703 is repeated to perform the process for the next input I / F channel.

  If it is determined in step S705 that the input I / F channel has been verified to the end, the sequence controller 22A of the signal processing unit 22 determines whether or not the output I / F channel has reached the end (step S706). ). In the determination processing in step S706, the output I / F channel is not reached to the end, that is, in the output I / F channel sequence shown in FIG. 21A, the C (center) channel of the multi-channel analog output terminal group OA-M is set. If it is determined that the process has not reached, the process from step S701 is repeated, and the process for the next output I / F channel is performed.

  In step S706, when it is determined that the last output I / F channel has been verified, the sequence controller 22A of the signal processing unit 22 determines that the processing for grasping the routing state has ended, and performs the processing illustrated in FIG. finish. As described above, the control device 2 performs, for each output I / F channel shown in FIG. 21A, from the first input I / F channel to the last input I / F channel of the input I / F channel sequence shown in FIG. 21B. I am trying to verify. That is, this is a method of verifying the input and output one by one.

  In this manner, the control device 2 can grasp which output terminal and input terminal of the own device are connected to the external device 2 without bothering the user. As a result, the actual connection path can be grasped automatically and accurately, so that the control device 2 can determine to which output end the measurement signal should be supplied. This measurement process can be performed quickly and reliably.

  As described above, in the first embodiment, as described with reference to FIGS. 9 to 21, by using the volume control availability determination method, the volume synchronization method, and the connection analysis method between a plurality of devices, The control device 2 determines whether or not the volume control of the television receiver 3 can be performed without bothering the user, and if possible, the control device 2 appropriately controls the inside of the television receiver 3. The volume of the sound emitted from the speakers TVL and TVR can be adjusted, and the route through which the television receiver 3 is connected (routing state) can be analyzed.

  As a result, the control device 2 can spontaneously grasp the connection relationship between the own device and the television receiver 3 and appropriately measure the delay amount of the audio signal accordingly. . The connection analysis method between a plurality of devices described here is also described in detail in Japanese Patent Application No. 2006-136020, which is an earlier application by the present inventor.

  Note that even if the volume control availability determination method, the volume synchronization method, and the connection analysis method cannot be used among a plurality of devices, the sound manually emitted from the built-in speakers TVL and TVR of the television receiver 3 by the user. 6 and FIG. 7 are appropriately performed by adjusting the volume of the audio signal and appropriately grasping the routing state between the control device 2 and the television receiver 3. It is also possible to accurately measure the amount of delay for the signal.

[Second Embodiment]
Next, a second embodiment will be described. The video / audio reproduction system according to the second embodiment measures the delay amount of the audio signal based on the line signal measurement, as will be described in detail below.

  Also in the second embodiment, as in the case of the first embodiment, as a condition (2A), from the control device 2 having a function of measuring the delay amount of the audio signal, the delay of the audio signal is obtained. As a condition (2B), a video signal intended for lip sync is input to the television receiver 3 as a condition (2B). It is necessary to have a means for transmitting a digital or analog audio signal from the audio output terminal of the television receiver 3 to the audio input terminal of the control device 2 as a condition (2C). is there.

  FIG. 22 is a block diagram for explaining a video / audio reproduction system according to the second embodiment. In the video / audio reproduction system according to the second embodiment, the control device 2 and the television receiver 3 are substantially the same as the control device 2 and the television receiver 3 of the video / audio system according to the first embodiment shown in FIG. It is constituted similarly. For this reason, in the video / audio reproduction system of the second embodiment shown in FIG. 22, the same reference numerals are given to the parts configured in the same manner as each device constituting the video / audio reproduction system shown in FIG. Detailed description of this part will be omitted.

  22 and the audio / video reproduction system of the first embodiment shown in FIG. 4 are compared with the audio / video reproduction system of the first embodiment shown in FIG. In the case of the video / audio reproduction system according to the second embodiment, the measurement microphone MIC is not connected to the control device 2. Instead, the audio output terminal 36 of the television receiver 3 and the control device 2 are connected. Audio input terminal IA1 is connected.

  That is, the control device 2 and the television receiver 3 are line-connected (line input) to each other. Since the audio output terminal 36 of the television receiver 3 and the audio input terminal IA1 of the control device 2 are connected, the audio output terminal of the television receiver 3 is directed toward the audio input terminal of the control device 2. The above-described condition (2C) of having a digital or analog audio signal transmission means is satisfied. In the second embodiment, the audio output terminal 36 of the television receiver 3 and the audio input terminal IA1 of the control device 2 are both for analog signals.

  FIG. 23 is a block diagram for explaining a configuration example of the measurement module of the control device 2 according to the second embodiment. As can be seen from a comparison between the control device 2 of the second embodiment shown in FIG. 23 and the control device 2 of the first embodiment shown in FIG. 5, the configuration is the same.

  That is, in the control device 2 of the second embodiment, each of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D is a signal processor configured by a DSP, a CPU, or the like. The function is realized by the unit 22. That is, the signal processing unit 22 implements the functions of the sequence controller 22A, the measurement signal generation unit 22B, the output switching unit 22C, and the response signal analysis unit 22D in order to execute the measurement process. The DAC 23 and the DAC / AMP 24 indicate that a DAC or a DAC / AMP is provided for each audio channel.

  In the case of the control device 2 according to the second embodiment, as shown in FIG. 22, the L (left) channel output terminal and the R (right) channel output terminal of the pre-out terminal group OA-M. Are connected to the input terminal of the L (left) channel and the input terminal of the R (right) channel of the input terminal group 31 of the television receiver 3, and the audio input terminal IA1 and the audio output terminal of the television receiver 3 36 is connected.

  Thus, the measurement signal generator 22A generates the signals under the control of the sequence controller 22A. The output switching unit 22C, the DAC 23, the output terminal of the L (left) channel and the output terminal of the R (right) channel of the pre-out terminal group OA-M. And the measurement signal output through the input terminal group 31 of the television receiver 3 is supplied through the input terminal of the L (left) channel and the input terminal of the R (right) channel.

  The measurement signal supplied through the input terminal of the L (left) channel and the input terminal of the R (right) channel of the input terminal group 31 of the television receiver 3 is supplied to the delay units 34L and 34R. With this control, after being delayed according to the time required for processing the video signal, it is supplied to the audio output terminal 36 and also supplied to the built-in speakers TVL and TVR through the AMPs 35L and 35R.

  As a result, in the delay units 34L and 34R of the television receiver 3, the measurement signal appropriately delayed by the control of the image decoder 32 is fed back to the control device 2 and the sound corresponding to the delay-processed measurement signal. Is emitted from the built-in speakers TVL and TVR of the television receiver 3.

  In the control device 2, the response signal for the measurement signal supplied through the audio input terminal IA1 is converted into a digital signal by the ADC 25, and then supplied to the response signal analysis unit 25, where it is analyzed, and the television receiver. 3, the delay amount for the audio signal is obtained.

[Regarding Grasping Process of Audio Signal Delay in Second Embodiment]
Hereinafter, in the video and audio reproduction system according to the second embodiment, a process for grasping the delay amount of the reproduced audio signal mainly performed by the control device 2 will be described with reference to the flowchart of FIG.

  FIG. 24 is a flowchart for explaining the process of grasping the delay amount of the reproduced audio signal mainly performed by the control device 2. As described above, the processing for grasping the delay amount of the audio signal performed in the video / audio reproduction system according to the second embodiment includes a measurement process mainly including line signal measurement. In the flowchart shown in FIG. 24, the television receiver 3 is abbreviated as TV and the control device 2 is described as an AV amplifier in order to simplify the description.

  The processing of the flowchart shown in FIG. 24 is advanced by the function of the sequence controller 22A of the control device 2 shown in FIG. First, in the sequence controller 22A, the sound input from the control device (AV amplifier) 2 to the TV (television receiver) 3 passes through the internal block and the sound output of the television receiver 3, and returns to the control device 2 again. It is confirmed whether or not the connection is made (step S801).

  The confirmation processing in step S801 can be confirmed using various methods, but can be confirmed using the connection analysis method between a plurality of devices described above with reference to FIGS. . As described above, in the second embodiment, an example in which analog line output and line input are intended for connection is shown. However, in actuality, the signal from the control device 2 is the starting point. If a loop system is established, digital input / output may be used.

  In the confirmation processing in step S801, when it is determined that a loop is not formed by line connection between the control device 2 and the television receiver 3, the sequence controller 22A manually outputs the audio output of the television receiver 3 to the user. A message prompting connection to the control device 2 is output (step S802).

  The processing in step S802 is performed by displaying a display message formed by, for example, control of the sequence controller 22A on a display element such as an LCD (not shown) provided in the control device 2, or by a display message formed in the control device 2. May be supplied to the television receiver 3 and displayed on the display screen of the image display unit 33 of the television receiver 3.

  In addition, the control device 2 forms a voice message and supplies it to the television receiver 3 to emit sound from the built-in speakers TVL and TVR of the television receiver 3 or external speakers connected to the own device. Or a voice message may be emitted from an external speaker.

  Of course, both a display message and a voice message may be used, or between the control device 2 and the television receiver 3 by turning on or blinking an LED (Light Emitting Diode) or emitting an alarm sound. It is also possible to notify that the assumed connection is not established.

  Then, as in the case of the control device 2 of the first embodiment, the sequence controller 22A generates a measurement signal by the measurement signal generation unit 22B realized as a function of the signal processing unit 22 of the control device 2, This is output through the output switching unit 22C, the DAC 23, and the L (left) channel pre-out terminal and the R (right) channel pre-out terminal of the pre-out terminal group OA-M, and is supplied to the television receiver 3 (step S803).

  In the television receiver 3, as described above, the audio signal delayed by the delay units 34 </ b> L and 34 </ b> R is output from the audio output terminal (TV line output) 36 in accordance with the control of the image decoder 32. The signal is received through the audio input terminal IA2 of the control device 2, converted into a digital signal by the ADC 25, and supplied to the response signal analysis unit 22D.

  Therefore, as described above, the control device 2 can generate and output a TSP signal as a measurement signal, and obtain an impulse response of the system extending from the control device 2 → the television receiver 3 → the control device 2.

  The response signal analysis unit 22D of the control device 2 receives the response signal for the measurement signal supplied thereto, and measures the impulse response (step S804). Then, the response signal analysis unit 22D analyzes the measured impulse response, calculates a delay time (delay amount) for the audio signal with reference to the time when the measurement signal is started to be reproduced, and sets the calculated delay time as a set value. It is stored and held in the delay time table of the storage memory 27 (step S805). As for the method for obtaining the delay time, as in the case of the first embodiment described above, the previous application by the inventor of the present application (Japanese Patent Application No. 2005-067413, “measuring device, measuring method, program”). Can be used.

  And in the audiovisual reproduction system of this 2nd Embodiment, it is not the measurement via space like the audiovisual reproduction system of 1st Embodiment. For this reason, the delay time (delay amount) for the audio signal obtained in step S805 coincides with the audio delay amount generated in the television receiver 3 as it is.

  FIG. 25 is a diagram for explaining video playback timing and audio signal playback timing of each audio channel in the video and audio playback system of the second embodiment. 25A shows a state before delay correction, and FIG. 25B shows a state after delay correction. The details of the audio signal reproduction process in the control device 2 including the delay correction processing corresponding to the measured delay time will be described later.

  In the case of the second embodiment, as described with reference to FIGS. 23 and 24, only the response of the line input (line L, line R) from the television receiver 3 to the control device 2 is used. Measurements using space such as other external speakers are not performed, and there is no data on the database.

  Therefore, as shown in FIG. 25A, based on the line L response and the line R response, the delay time of the delay for the audio signal generated in the television receiver 3 is measured, and this measured delay time is used as the reference delay time. After the determination, the lip sync status is corrected by correcting the delay for the sound emitted from the external speakers oL, oR, oSL, oSR, and oC as shown by the dotted line of each external speaker in FIG. 25B. Can be improved.

  In the video / audio reproduction system according to the second embodiment, since a spatial factor is not included, for example, a difference in distance to the listening position due to the position of each speaker cannot be corrected. However, as described above, the delay in video reproduction timing caused by the time required for processing the video signal in the television receiver 3 is much larger than the spatial propagation delay of the sound. The effect of combining lip sync is great.

  In the second embodiment, a measurement microphone is installed at the listening point, and the measurement microphone MIC is input to the microphone of the control device 2 as in the case of the video / audio reproduction system of the first embodiment. Connected to the terminal Min, collects the sound corresponding to the measurement signal emitted from the external speakers oL, oR, oSL, oSR, oC connected to the speaker output terminal group OAS-M of the control device 2 and measures it. The impulse response for the signal may be measured and taken into account.

  In this case, after the processing shown in FIG. 24, impulse response measurement may be performed for an external speaker directly connected to the AV amplifier. More specifically, the processing from step S108 to step S114 shown in FIG. 7 may be performed after the processing shown in FIG.

  Thereby, as described above, the amount of delay through the space is added and recorded as an external speaker response to the database in which the audio delay amount in the television receiver 3 measured using the line input is recorded, Taking these into account, the delay amount of the audio signal supplied to the external speaker connected to the control device 2 is appropriately corrected so that it is synchronized with the image displayed on the image display unit 33 of the television receiver 3. Thus, the reproduced sound can be emitted from each of the external speakers.

  FIG. 26 shows a method for measuring a delay amount of an audio signal used in the second embodiment (a method of lip sync delay analysis by line input / output) and using a measurement microphone MIC to release from an external speaker. It is a figure for demonstrating the reproduction | regeneration timing of the image | video in an audiovisual reproduction system, and the reproduction | regeneration timing of the audio | voice signal of each audio | voice channel in the case of measuring also the delay amount about the audio | voice signal of the sound sounded . 25A shows a state before delay correction, and FIG. 25B shows a state after delay correction.

  Also in the case shown in FIG. 26A, the reference signal is processed by the control device 2 in the video signal generated in the television receiver 3 based on the line L response and the line R response, as in the case shown in FIG. 25A. The delay amount applied to the audio signal due to the time required is measured, and the delay amount (spatial propagation delay amount) for the sound emitted from the external speakers oL, oR, oSL, oSR, oC. ), And based on these, the audio signal supplied to the external speaker can be appropriately delayed.

  Therefore, in this example, the line L response and the line R response include only the video delay in the television receiver 3 and are emitted from the external speakers oL, oR, oSL, oSR, oC. The voice that contains only the spatial propagation delay. Originally, as described in the first embodiment, at the listening position, the actual delay amount of the audio signal is measured based on the actually measured value of the response signal in the space, and correction processing is performed accordingly. Ideally.

  However, even in this example, considering that the delay due to the video is much larger than the spatial delay of the sound, improvement can be expected as the adjustment of the lip sync, and each time alignment between the external speakers can be adjusted. At the same time, it is possible to contribute to improving the overall sound quality.

  As described above, the technique used in the second embodiment does not necessarily require a measurement microphone, and is satisfied only by interconnecting signals connected by a line between the control device 2 and the television receiver 3. It is what Even in the case of the technique used in the second embodiment, as described above, it is possible to perform time axis correction with higher accuracy by performing measurement using a measurement microphone.

  In the second embodiment, the measurement microphone MIC is also used to measure the spatial propagation delay of the sound emitted from the external speaker, from the built-in speaker of the television receiver 3. When the sound delayed from the sound to be emitted is emitted, the delay amount for the audio signal reproduced through the control device 2 may be set on the basis of the most delayed audio signal. Good.

  Further, the process described with reference to the flowchart of FIG. 24 is an application of the method according to the present invention. A program for executing the processing described with reference to the flowchart of FIG. 24 is a program according to the present invention. Therefore, by forming a program for executing each step of the flowchart shown in FIG. 24 and mounting the program on the control device so that it can be executed, it will be explained to various control devices as the second embodiment. The invention can be applied.

[Third Embodiment]
Next, a third embodiment will be described. When comparing the measurement method of the delay time for the audio signal used in the first embodiment described above and the measurement method of the delay time used in the video and audio reproduction system of the second embodiment described above, Actually, the method of measuring the delay amount for the audio signal based on the signal measurement in the space used in the first embodiment is based on the actual measurement value in the listening space of the actual sound, Since the delay amount of the audio signal can be measured, more ideal correction is possible.

  However, in the case of the method of measuring the delay amount of the audio signal based on the line signal measurement used in the second embodiment, the volume control of the television receiver 3 is not necessary, and the measurement is not necessarily performed. The advantage is that a microphone is not required. Therefore, considering the convenience of the user, it is very convenient if the connection / setting state is automatically determined from the user environment and a suitable method is automatically selected. In this case, in the delay amount measurement sequence of the first embodiment shown in FIGS. 6 and 7, it is not necessary to display a message to the user and prompt the user to intervene.

  Therefore, in the video / audio reproduction system according to the third embodiment, the delay time measurement method for the audio signal used in the video / audio reproduction system according to the first embodiment described above and the second implementation described above. The optimum method is automatically selected from the delay time measurement method for the audio signal used in the video / audio reproduction system of the form.

  The video / audio reproduction system according to the third embodiment is described with reference to the video / audio reproduction system according to the first embodiment described with reference to FIGS. 4 and 5, or with reference to FIGS. 22 and 23. It has the same configuration as the video / audio reproduction system of the second embodiment. For this reason, in the third embodiment, the description of the configuration of the video / audio reproduction system is omitted, and the part using the measurement microphone is the part using the line input while referring to FIGS. Will be described with reference to FIGS.

  However, in the video / audio reproduction system according to the third embodiment, the measurement microphone MIC is connected to the control device 2 and the audio signal from the television receiver 3 is input as a line. It shall be connected.

[Regarding Grasping Process of Audio Signal Delay in Third Embodiment]
In the following, in the audiovisual reproduction system of the third embodiment, the processing for grasping the delay amount of the reproduced audio signal mainly performed by the control device 2 will be described with reference to the flowcharts of FIGS. explain.

  FIG. 27 and FIG. 28 are flowcharts for explaining processing for grasping the delay amount of the reproduced audio signal mainly performed by the control device 2. In the flowcharts shown in FIGS. 27 and 28, for the sake of simplicity, the television receiver 3 is abbreviated as TV, the speaker is abbreviated as SP, and the control device 2 is described as an AV amplifier. .

  The processing of the flowcharts shown in FIGS. 27 and 28 is advanced by the function of the sequence controller 22A of the control device 2 shown in FIGS. First, the sequence controller 22A determines (verifies) whether or not volume control (volume control) of the television receiver 3 is possible from the control device 2 (step S901). Various methods can be used for the determination processing (verification processing) in step S901. As in the case of the first embodiment described above, the “multiple devices” described with reference to FIGS. It is possible to use the “volume controllability determination method”.

  In the determination process of step S901, when it is determined that the volume control of the television receiver 3 can be performed from the control device 2, the sequence controller 22A appropriately controls the volume of the television receiver 3, and the response of the measurement signal is the listening position. Is set so as to be obtained as a response signal of a necessary sound pressure by the measurement microphone MIC installed in (step S902).

  For this reason, as in the case of the first embodiment described above, using the “volume synchronization method between multiple devices” described with reference to FIGS. 14 to 17, the control volume value from the control device 2 in advance, The correspondence relationship of the corresponding sound volume levels (sound pressures) in the television receiver 3 is grasped by, for example, forming a numerical table, and referring to the numerical table indicating the correspondence relationship, the built-in speakers TVL and TVR of the television receiver 3 are referred to. It is possible for the control device 2 to set the volume level of the television receiver 3 so that the level (sound pressure) of the emitted sound becomes an appropriate level.

  Of course, as in the case of the video / audio reproduction system of the first embodiment, the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is set to an appropriate level by using other methods. You may take the method of adjusting.

  When determining that the volume control of the television receiver 3 is not possible (impossible) from the control device 2 in the determination process in step S901, the sequence controller 22A determines that the measurement signal generation unit 22B, the output switching unit 22C, The response signal analyzer 22D is controlled to output a measurement signal as a test and determine whether or not a stable response can be obtained through the measurement microphone MIC (step S903).

  After the process of step S902 or in the determination process of step S903, when it is determined that a stable response can be obtained through the measurement microphone MIC, the sequence controller 22A of the control device 2 controls the measurement signal generator 22B. Then, the measurement signal is generated and the output switching unit 22C is controlled to supply the generated measurement signal to the television receiver 3, and the sound corresponding to the measurement signal is output from the built-in speakers TVL and TVR of the television receiver 3. The sound is emitted (step S904). In this example, a TSP signal is used as the measurement signal.

  As described with reference to FIGS. 4 and 5, the response signal for the measurement signal collected by the assumed microphone MIC is supplied to the control device 2 through the microphone input terminal Min, amplified by the microphone amplifier 26, and After being converted to a digital signal by the ADC, it is supplied to the response signal analysis unit 22D. The response signal analyzer 22D receives the response signal for the measurement signal supplied thereto, and measures the impulse response (step S905).

  As described above, also in the third embodiment, since the TSP signal is used as the measurement signal, the response signal analysis unit 22D listens from the built-in speakers TVL and TVR of the television receiver 3 which is a reproduction speaker. The impulse response up to the measurement microphone MIC at the position (listening position) can be measured and calculated.

  Then, the response signal analysis unit 22D analyzes the measured impulse response, calculates the delay time (delay amount) for the audio signal based on the time when the measurement signal is started to be reproduced by considering the sound speed. The delay time thus stored is stored and held in the delay time table of the set value storage memory 27 (step S906). As to how to obtain this delay time, as in the first and second embodiments, the previous application by the inventor of the present application (Japanese Patent Application No. 2005-067413, “Measurement apparatus, measurement method, program”). ).

  Next, the sequence controller 22A controls the television receiver 3 from the control device 2 so as to mute the sound so as not to emit sound from the built-in speakers TVL and TVR of the television receiver 3 (step S907). ), The process proceeds to step S908 in FIG.

  Then, the sequence controller 22A of the control device 2 controls the measurement signal generation unit 22B to generate a measurement signal (TSP signal) and also controls the output switching unit 22C to send the generated measurement signal to the external speaker oL, The sound is supplied to each of oR, oSL, oSR, and oC, and the sound corresponding to the measurement signal is emitted from each of the external speakers oL, oR, oSL, oSR, and oC (step S908).

  Also in the third embodiment, each speaker output terminal of the speaker output terminal group OAS-M of the control device 2 is the same as in the case of the audiovisual reproduction system of the first embodiment described with reference to FIG. Are connected to the external speakers oL, oR, oSL, oSR, oC, so that the measurement signal from the control device 2 is reliably supplied to the external speakers oL, oR, oSL, oSR, oC, Sound corresponding to the measurement signal is emitted from each external speaker oL, oR, oSL, oSR, oC.

  As described above, the sound is muted so that sound is not emitted from the built-in speakers TVL and TVR of the television receiver 3, but sound is not emitted from the built-in speakers TVL and TVR of the television receiver 3. The output switching unit 22C in the control device 2 may be appropriately switched and controlled.

  The response signal for the measurement signal collected by the assumed microphone MIC is supplied to the control device 2 through the microphone input terminal Min, amplified by the microphone amplifier 26 and converted into a digital signal by the ADC, and then the response signal. The impulse response is measured by being supplied to the analysis unit 22D (step S909).

  Also in the third embodiment, as in the case of the first embodiment, since the TSP signal is used as the measurement signal, the response signal analysis unit 22D includes the external speaker oL, which is a reproduction speaker, The impulse response from the oR, oSL, oSR, oC to the measurement microphone MIC at the listening position (listening position) can be measured and calculated.

  The response signal analysis unit 22D analyzes the measured impulse response, calculates the delay time (delay amount) for the audio signal based on the time when reproduction of the measurement signal is started by considering the sound speed, and calculates the calculated delay The time is stored and held in the delay time table of the set value storage memory 27 (step S910), and the processes shown in FIGS. 27 and 282 are terminated.

  In the process of step S907 shown in FIG. 27, the volume value of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 before mute is stored and held, and the process of step S910 of FIG. Later, the volume value of the television receiver 3 may be restored.

  As described above, when the volume of the television receiver 3 can be controlled from the control device 2, the volume of the sound emitted from the built-in speakers TVL and TVR of the television receiver 3 is appropriately controlled so that the volume can be controlled in the space. The reproduction sound signal is appropriately measured, and the delay amount of the sound signal can be measured based on the signal measurement in space.

  On the other hand, if it is determined in step S903 shown in FIG. 27 that a stable response cannot be obtained through the measurement microphone MIC, that is, the volume control of the television receiver 3 cannot be performed from the control device 2. In addition, when a stable response cannot be obtained with respect to the sound emitted from the built-in speaker of the television receiver 3, the signal measurement in the space cannot be performed appropriately. , The process from step S911 shown in FIG. 28 is executed.

  First, the sequence controller 22A causes the sound input from the control device (AV amplifier) 2 to the TV (TV receiver) 3 to return to the control device 2 again after passing through the internal block and the sound output of the TV receiver 3. It is confirmed whether it is connected (step S911).

  The confirmation processing in step S911 can be confirmed using various methods, but can be confirmed using the connection analysis method between a plurality of devices described above with reference to FIGS. . In the case of the video and audio reproduction system of the third embodiment, analog line output / line input is used for connection as in the case of the second embodiment. As long as a loop system of signals starting from the control device 2 is created, digital input / output may be used.

  When it is determined in step S911 that the sound output from the control device (AV amplifier) 2 is connected to return to the control device 2 via the television receiver 3, the sequence controller 22A As in the case of the control device 2 of the first embodiment, a measurement signal is generated by the measurement signal generation unit 22B that is realized as a function of the signal processing unit 22 of the control device 2, and this is output to the output switching unit 22C, The signal is output through the DAC 23 and the L (left) channel pre-out terminal and the R (right) channel pre-out terminal of the pre-out terminal group OA-M, and is supplied to the television receiver 3 (step S912).

  In the television receiver 3, as described above, the audio signal delayed by the delay units 34 </ b> L and 34 </ b> R is output from the audio output terminal (TV line output) 36 in accordance with the control of the image decoder 32. The signal is received through the audio input terminal IA2 of the control device 2, converted into a digital signal by the ADC 25, and supplied to the response signal analysis unit 22D.

  Therefore, as described above, the control device 2 can generate and output a TSP signal as a measurement signal, and obtain an impulse response of the system extending from the control device 2 → the television receiver 3 → the control device 2.

  The response signal analysis unit 22D of the control device 2 receives the response signal for the measurement signal supplied thereto, and measures the impulse response (step S913). Then, the response signal analysis unit 22D analyzes the measured impulse response, calculates a delay time (delay amount) for the audio signal with reference to the time when the measurement signal is started to be reproduced, and sets the calculated delay time as a set value. It is stored and held in the delay time table of the storage memory 27 (step S914). Note that the method for obtaining the delay time is the same as in steps S906 and S910.

  As described above, the time required for the video signal processing in the television receiver 3 based on the response signal for the measurement signal supplied from the television receiver 3 to the control device 2 by line connection through the processing from step S911 to step S914. Accordingly, the delay amount of the delay processing applied to the audio signal can be accurately grasped.

  Then, after the processing of step S914, the processing from step S908 to step S910 described above is performed, so that the spatial delay (spatial propagation delay) of the audio signal emitted from the external speaker connected to the control device 2 can be accurately determined. Can grasp. Then, based on the delay amount of the audio signal generated in the television receiver 3 calculated in step S914 and the spatial propagation delay of the sound emitted from the external speaker calculated in step S910, the control device 2 sends an external signal. The delay amount to be applied to the audio signal supplied to the speaker is specified, and the delay process can be appropriately performed.

  In the confirmation process in step S911, when it is determined that a loop is not formed by line connection between the control device 2 and the television receiver 3, the sequence controller 22A reviews the connection and setting between the devices. Is displayed (step S915), and the processing shown in FIGS. 27 and 28 is terminated.

  The processing in step S915 is performed such that a display message formed by control of the sequence controller 22A, for example, is displayed on a display element such as an LCD (not shown) provided in the control device 2, or a display message formed in the control device 2 May be supplied to the television receiver 3 and displayed on the display screen of the image display unit 33 of the television receiver 3.

  In addition, the control device 2 forms a voice message and supplies it to the television receiver 3 to emit sound from the built-in speakers TVL and TVR of the television receiver 3 or external speakers connected to the own device. Or a voice message may be emitted from an external speaker.

  Of course, both a display message and a voice message may be used, or between the control device 2 and the television receiver 3 by turning on or blinking an LED (Light Emitting Diode) or emitting an alarm sound. It is also possible to notify that the assumed connection is not established.

  As described above, the processing for grasping the delay amount of the audio signal performed in the video / audio reproduction system according to the third embodiment is the same as the delay for the audio signal used in the video / audio reproduction system according to the first embodiment. The optimum method can be automatically selected from the time measurement method and the delay time measurement method for the audio signal used in the video and audio reproduction system of the second embodiment described above.

  As described above, in the third embodiment, as the first stage, as in the case of the first embodiment, the built-in speakers TVL and TVR of the television receiver 3 respond to the measurement signal. The sound is emitted and the sound is received and analyzed by the measurement microphone MIC to measure the delay amount of the audio signal generated in the television receiver 3 or in the case of the second embodiment. As described above, it is possible to select whether to measure the delay amount of the audio signal generated in the television receiver 3 by receiving and analyzing the audio signal from the television receiver 3 inputted in line. is there.

  After this first stage, as a second stage, sound corresponding to the measurement signal is emitted from the external speakers oL, oR, oSL, oSR, oC connected to the control device 2, and this is output to the measurement microphone MIC. The spatial propagation delay amount of the sound signal emitted from the external speaker is accurately measured by analyzing the response signal of the measurement signal obtained by receiving the sound.

  However, also in the third embodiment, the second stage is not necessarily an essential process, and a delay process may be performed on the audio signal to be reproduced in the control device 2 based on the measurement result of the first stage. Good.

  In the third embodiment, the measurement microphone MIC is also used to measure the spatial propagation delay of the sound emitted from the external speaker, and from the built-in speaker of the television receiver 3. When the sound delayed from the sound to be emitted is emitted, the delay amount for the audio signal reproduced through the control device 2 may be set on the basis of the most delayed audio signal. Good.

  Further, the processing described with reference to the flowcharts of FIGS. 27 and 28 is obtained by applying the method according to the present invention. A program for executing the processing described using the flowcharts of FIGS. 27 and 28 is a program according to the present invention. Therefore, a program for executing each step of the flowcharts shown in FIGS. 27 and 28 is formed, and this is installed in the control device so that it can be executed. The invention described as a form can be applied.

[About the playback process]
A reproduction process in the control device 2 that performs a delay process on the output audio signal based on the delay time (delay amount) for the audio signal grasped as described in the first to third embodiments. Will be described. FIG. 29 is a block diagram for explaining a configuration example of a playback module of the control device 2.

  As shown in FIG. 29, the playback module of the control device 2 includes a video input terminal Vin, an audio input terminal Ain, an I / F 21, a signal processing unit 22, a DAC 23, a DAC / AMP 24, a setting value storage memory 27, and a system controller 28. , A multi-channel pre-out terminal group OA-M and a multi-channel speaker output terminal group OAS-M.

  Then, as shown in FIG. 29, a signal processing unit 22 constituted by a CPU or DSP receives a multi-channel audio signal, decodes it, and separates it into audio signals of each channel as an audio decoder 22E. And a delay unit 22F including a delay unit that delays the audio signal of each channel supplied to the DAC 23 and a delay unit that delays the audio signal of each channel supplied to the DAC / AMP 24. ing.

  The audio decoder 22E and the delay unit 22F are controlled by the system controller 28. The system controller 28 may realize its function by the signal processing unit 22 configured by a CPU or DSP, or as shown in FIG. 29, the CPU or memory is independent of the signal processing unit 22. You may make it implement | achieve by the microcomputer etc. which consist of.

  Then, the video signal from the source signal reproduction device 1 such as a DVD player or a BD player is received through the video input terminal Vin of the control device 2, and is output through the video output terminal of the pre-out terminal group OA-M through the I / F 21. The television receiver 3 is supplied.

  On the other hand, the audio signal from the source signal reproduction device 1 is received through the audio input terminal Ain of the control device 2 and supplied to the audio decoder 22E realized by the signal processing unit 22 through the I / F 21. As described above, the audio decoder 22 decodes the multi-channel audio signal supplied to the audio decoder 22 and separates the multi-channel audio signal into audio signals of the respective channels, and each delay on the DAC 23 side provided corresponding to each channel. And a delay unit on the DCA / AMP 24 side provided corresponding to each channel.

  The delay units corresponding to the respective channels constituting the delay unit 22F perform delay processing on the audio signal supplied to the own device under the control of the system controller 28. That is, as described in the first to third embodiments, the delay value for the audio signal is measured and stored in the set value storage memory 27. The system controller 28 refers to the delay amount of the audio signal stored and held in the set value storage memory 27, and determines how much the audio signal is actually delayed according to this, and configures the delay unit 22F. Each delay unit is controlled.

  Note that the delay processing for the audio signal is mainly for the audio signal to be supplied to the external speakers oL, oR, oSL, oSR, oC, and is provided in the front stage of the DAC / AMP 24. Delay processing is performed in the delay unit, and in the delay unit provided in the previous stage of the DACV 23, delay processing is not performed greatly, and delay processing (correction processing) for fine adjustment, for example, is performed.

Thus, in the delay processing unit 22F, the time axis of each channel of the audio signal to be reproduced is adjusted under the control of the system controller 28. And as mentioned above,
Different delay values can be set for the system in which the source audio signal is connected to the pre-out terminal group OA-M through the DAC 23 and the system in which the source audio signal is connected to the speaker output terminal group OAS-M through the DAC / AMP 24.

  Further, for example, as in the video and audio reproduction system described with reference to FIG. 2, the L (left) channel audio signal and the R (right) channel audio signal are transmitted from the built-in speakers TVL and TVR of the television receiver 3. The SL (left rear) channel audio signal, the SR (right rear) channel audio signal, and the C (center) channel audio signal are released from the external speakers oSL, oSR, and oC connected to the control device 2. When the sound signal of each channel of the multi-channel is reproduced through different devices so as to sound, the configuration of the reproduction module of the control device 2 can be configured as shown in FIG.

  FIG. 30 is a block diagram for explaining another configuration example of the playback module of the control device 2. In the case of the playback module of the control device 2 shown in FIG. 30, a delay unit (consisting of a delay unit for each channel) 22G shared by the DAC 23 and the DAC / AMP 24 is provided in the preceding stage. It is.

  That is, the delay unit 22G is, in order from the top, an L (left) channel delay unit, an R (right) channel delay unit, an SL (left rear) channel unit, an SR (right rear) channel delay unit, a C It consists of five delay units, the (center) channel delay unit, and control is possible for each channel delay unit. Also, the audio decoder 22E placed before the delay unit 22G is configured in the same manner as the audio decoder 22E shown in FIG.

  As described above, the L (left) channel audio signal and the R (right) channel audio signal are supplied to the television receiver 3 through the pre-out terminal, and the SL (left rear) channel audio signal and SR are supplied. Consider a case where the audio signal of the (right rear) channel and the audio signal of the C (center) channel are supplied to the external speakers oSL, oSR, and oC through the speaker output terminals.

  In this case, in the delay unit 22G, the upper two delay units, that is, the L (left) channel delay unit and the R (right) channel delay unit, perform the delay process without performing the delay process. Through the L (left) channel DAC and R (right) channel DAC, and the L (left) channel output terminal and R (right) channel output terminal of the pre-out terminal group OA-M. It is supplied to the receiver 3.

  On the other hand, the system controller 28 refers to the delay amount of the audio signal stored and held in the setting value storage memory 27, and in response to this, actually the audio signal of the SL (left rear) channel and the SR (right rear) ) Determines how much the audio signal of the channel and the audio signal of the C (center) channel are delayed, and the lower three delay units, that is, the SL (left rear) channel delay unit and the SR (right rear) channel By controlling the delay unit and the C (center) channel delay unit, the SL (left rear) channel audio signal, the SR (right rear) channel audio signal, and the C (center) channel audio signal, Apply delay processing appropriately.

  The delay-processed SL (left rear) channel audio signal, SR (right rear) channel audio signal, and C (center) channel audio signal correspond to the corresponding channel DAC / AMP and speaker output terminal group OAS-. Through the output terminal of the SL (left rear) channel, the output terminal of the SR (right rear) channel, and the output terminal of the C (center) channel, the L (left) channel speaker oL and the R (right) channel speaker oR, C Supplied to the (center) channel speaker.

  Accordingly, the audio signal of the L (left) channel and the audio signal of the R (right) channel are supplied to the television receiver 3 and are reproduced by the delay processing function for the audio signal provided in the television receiver 3. The sound corresponding to the sound signal that is made to be synchronized is emitted from the built-in speakers TVL and TVR.

  The SL (left rear) channel audio signal, the SR (right rear) channel audio signal, and the C (center) channel audio signal are measured in advance and stored in the setting value storage memory as described above. Since delay processing is performed in the delay unit 22G of the control device 2 in accordance with the delay amount of the audio signal and the signal is supplied to the external speaker of the corresponding channel, it is synchronized with the video and audio reproduced on the television receiver 3. Will be matched.

  As described above, the configuration of the playback module of the control device 2 depends on the configuration of the video and audio playback system, such as whether the built-in speaker of the television receiver is used or how the external speaker is used. Can do.

[Summary]
The outline of the grasping process (measurement process) of the delay amount of the audio signal in the video and audio reproduction system of the first embodiment described above is summarized as follows. That is,
An arbitrary video signal and a measurement signal such as a TSP signal or broadband noise are input from a signal processing unit 22 including a DSP and CPU inside the AV control device 2 to a video / audio reproduction device such as a television receiver 3. Playback from a speaker connected to the audio playback device. The response signal is received by the measurement microphone placed at the listening position, and the delay time is obtained and recorded in the database. Next, the same measurement is performed on the speaker directly or indirectly connected to the AV control device 2, and the delay time is recorded in the database. With reference to the delay time database, delay processing (delay processing) can be set for a channel corresponding to another speaker on the basis of the delay time related to the speaker of the video / audio reproduction device.

Further, the outline of the grasping process (measurement process) of the delay amount of the audio signal in the video and audio reproduction system of the second embodiment described above is summarized as follows. That is,
An arbitrary video signal and a measurement signal such as TSP signal or broadband noise are input to a video / audio reproduction device such as a television receiver 3 from a signal processing unit consisting of a DSP or CPU inside the AV control device, and the video / audio reproduction is performed. The audio response signal that has been subjected to delay processing in order to synchronize with the video in the device is re-input to the AV control device 2, thereby obtaining the delay time and recording it in the database. Using this delay time as a reference, delay processing (delay processing) can be set for a channel corresponding to another speaker.

In the video and audio reproduction system of the second embodiment described above,
An arbitrary video signal and a measurement signal such as a TSP signal or broadband noise are input from a signal processing unit 22 including a DSP and CPU inside the AV control device 2 to a video / audio reproduction device such as a television receiver 3. The audio response signal that has been subjected to delay processing in order to synchronize with the video in the audio reproduction device is re-input to the AV control device, thereby obtaining the delay time and recording it in the database. The same measurement is performed on the speaker directly or indirectly connected to the AV control device 2 and the delay time is recorded in the database. With reference to this delay time database, delay processing (delay processing) can also be performed on channels corresponding to other speakers on the basis of the delay time related to the speakers of the video / audio reproduction device.

  The video / audio reproduction system according to the third embodiment described above is configured in the first embodiment when the volume of sound emitted from the built-in speaker of the television receiver 3 can be controlled from the AV control device 2. When the volume control of the sound emitted from the built-in speaker of the TV receiver 3 is impossible from the AV control device 2 and the delay amount of the audio signal is grasped (measurement processing), When the sound corresponding to the measurement signal emitted from the built-in speaker of the television receiver 3 cannot be received properly, the audio signal delay amount grasping process (measurement process) according to the second embodiment is performed. As described above, it is possible to automatically select an appropriate audio signal delay amount grasping process (measurement process).

  Further, in the case of the first embodiment and the third embodiment, there is provided means for automatically adjusting the volume of the video / audio reproduction device such as the television receiver 3 from the AV control device 2 to the optimum one. By providing, it is possible to appropriately measure the delay amount of the audio signal without bothering the user.

  When the AV control device 2 performs delay correction based on the delay amount (delay time) of the audio signal that is measured and stored in the setting value storage memory, the video / audio of the television receiver 3 or the like is used. Rather than using the playback device as a reference, delay processing is performed on the audio signal output from the AV control device 2 based on the largest delay time of the audio signal recorded in the database of the setting value storage memory. You may make it give.

  In this case, the amount of delay differs between the audio signal supplied to the video / audio player such as the television receiver 3 and the audio signal supplied to the external speaker connected to the AV control device 2. That is, in a video / audio reproduction machine such as the television receiver 3, delay processing is performed on the audio signal in accordance with the time required for video signal processing.

  Further, when delay correction is performed in the AV control device 2 based on the delay amount (delay time) of the audio signal measured and stored in the setting value storage memory, for example, the television receiver 3 or the like In the audiovisual reproduction apparatus, the delay amount for the audio signal may change because the image quality mode is suddenly changed according to the input operation from the user.

  Therefore, the delay amount for the audio signal is measured in advance according to each image quality mode, and a database for the delay amount according to each image quality mode is provided, and the delay processing for the audio signal is not appropriately performed. In some cases, by making it possible to change the database used in response to an instruction input from the user, it is possible to cope with a sudden change in the image quality mode.

  Here, the case where the image quality mode is changed has been described as an example, but a plurality of types of databases that should be prepared in advance are in accordance with the combination of the format of the video signal to be processed and the image quality mode to be selected. A measurement process may be performed in advance and created in the set value storage memory. In addition, if a list of a plurality of databases that store and hold delay amounts for audio signals is created, it is easy to select a database that stores and holds appropriate delay amounts via the list. It is also possible to do.

  It is also possible to perform a so-called maintenance operation such as addition, change, or deletion of a database in which a delay amount for an audio signal is stored and held in accordance with information input from a user.

[Others]
From a practical point of view, it is not necessary to have a single database. As described above, a plurality of presets that can be arbitrarily called by the user during playback may be stored. Calls may be handled according to the selected device / output selected device.

  Further, the AV control device 2 used in the above-described embodiment has been described as having the measurement microphone input terminal Min. However, a common automatic sound field correction function (equalizer, level adjustment, etc.) may be used. In other words, the function of the invention may be an independent measurement, but in the sense of correcting lip sync, it can be interpreted as a kind of automatic sound field correction, and in that sense, as part of an automatic sound field correction measurement sequence having other functions, May be incorporated.

  In the above-described embodiment, the control device 2 is described as being an AV amplifier, for example. However, the control device 2 is not limited to an AV amplifier. For example, the present invention can be applied to various electronic devices such as personal computers and audio amplifiers that output measurement signals and can receive and analyze the input of response signals.

  In the above-described embodiment, the television receiver 3 has been described as having a built-in speaker, but the built-in speaker may not necessarily be provided. Even if a speaker is not built in, it is sufficient if it has an output terminal for outputting an audio signal subjected to delay processing according to the time required for video signal processing. Therefore, various devices capable of processing video signals and audio signals, such as personal computers and monitor receivers, can be used for the television receiver 3 as well as general television receivers.

  In the above-described embodiment, the external speaker is described as being directly connected to the control device 2, but the present invention is not limited to this. For example, the present invention can be applied even when a power amplifier device or the like is connected to the control device 2.

  In the above-described embodiment, the TSP signal is used as the measurement signal. However, the present invention is not limited to this. As described above, it may be broadband noise such as white noise, pink noise, M-sequence noise, or may be a general voice / music signal. The measurement signal can be generated by calculation according to a predetermined logic or by reading from a memory connected to the measurement signal generator 22B.

  In the reproduction module, the delay unit may use a so-called delay line or a memory.

It is a block diagram for demonstrating the specific example of the video-audio reproduction | regeneration system in which the shift | offset | difference of a lip sync may generate | occur | produce. It is a block diagram for demonstrating the specific example of the video-audio reproduction | regeneration system in which the shift | offset | difference of a lip sync may generate | occur | produce. It is a block diagram for demonstrating an example of the connection connection aspect of the audiovisual reproduction system in which the deviation | shift of a lip sync does not generate | occur | produce. 1 is a block diagram for explaining a video and audio reproduction system according to a first embodiment. It is a block diagram for demonstrating the structural example of the measurement module of the control apparatus 2 of the audiovisual reproduction system shown in FIG. It is a flowchart for demonstrating the process which grasps | ascertains the delay amount of the audio | voice signal of 1st Embodiment. It is a flowchart following FIG. It is a figure for demonstrating the reproduction | regeneration timing of the image | video in the audiovisual reproduction system of this 1st Embodiment, and the reproduction | regeneration timing of the audio | voice signal of each audio channel. It is a figure for demonstrating the volume control availability determination method between several apparatuses. It is a figure for demonstrating the volume control availability determination method between several apparatuses. It is a figure for demonstrating the volume control availability determination method between several apparatuses. It is a figure for demonstrating the volume control availability determination method between several apparatuses. It is a figure for demonstrating the volume control availability determination method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the volume synchronization method between several apparatuses. It is a figure for demonstrating the connection analysis method between several apparatuses. It is a figure for demonstrating the connection analysis method between several apparatuses. It is a block diagram for demonstrating the audiovisual reproduction system of 2nd Embodiment. It is a block diagram for demonstrating the example of a structure of the measurement module of the control apparatus 2 of this 2nd Embodiment. It is a flowchart for demonstrating the process which grasps | ascertains the delay amount of the audio | voice signal of 2nd Embodiment. It is a figure for demonstrating the reproduction | regeneration timing of the image | video in the audiovisual reproduction system of this 2nd Embodiment, and the reproduction | regeneration timing of the audio | voice signal of each audio channel. It is a figure for demonstrating the reproduction | regeneration timing of the image | video in an audio-video reproduction | regeneration system measured with the measurement microphone MIC in 2nd Embodiment, and the reproduction | regeneration timing of the audio signal of each audio channel. It is a flowchart for demonstrating the process which grasps | ascertains the delay amount of the audio | voice signal of 3rd Embodiment. It is a flowchart following FIG. 3 is a block diagram for explaining a configuration example of a playback module of the control device 2. FIG. 12 is a block diagram for explaining another configuration example of the reproduction module of the control device 2. FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Source signal reproduction | regeneration apparatus, 2 ... AV control apparatus, Vin ... Video | video input terminal, Ain ... Audio | voice input terminal, 2i ... Control signal input terminal, 2o ... Control signal output terminal, 21 ... I / F, 22 ... Signal Processing unit, 22A ... sequence controller, 22B ... measurement signal generation unit, 22C ... output switching unit, 22D ... response signal analysis unit, 23 ... DAC, 24 ... DAC / AMP, 25 ... ADC, 26 ... MIC-AMP (microphone amplifier) ), 27... Setting value storage memory, OA-M... Preout terminal group, OAS-M... Speaker output terminal group, IA1... Audio input terminal, Min. Microphone input terminal, 3. 32 ... Image decoder, 33 ... Image display unit, 34L, 34R ... Delay unit, 35L, 35R ... AMP, 36 ... Audio output terminal group, 37 ... Controller, TVL, T R ... built-in speaker, oL, oR, oSL, oSR, oC ... external speaker, MIC ... measurement microphone

Claims (11)

A control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker, and one or more speakers connected to the own device,
Measurement signal generating means for generating a measurement signal;
Output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
Response signal receiving means for receiving a line input of a response signal for the measurement signal that is output after being subjected to delay processing in the external device;
Delay of the audio signal in the external device based on the output timing of the measurement signal output from the own device according to the control of the output control unit and the reception timing of the response signal received through the response signal reception unit Detection means for detecting time and recording it in a database;
Delay means for delaying an audio signal supplied to at least the speaker connected to the device;
Based on the recorded delay to the database, Turkey Control equipment and a delay control means for controlling the delay amount of said delay means. The control device according to claim 1 ,
A sound collection sound reception means for receiving supply of a sound signal collected by a microphone installed at a listening position;
Second output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to a speaker connected to the apparatus;
The output timing of the measurement signal output from the own device according to the control of the second output control means, and the measurement signal emitted from the speaker connected to the own device at the collected sound reception means based on the reception timing of the response signal for, detecting the delay time of the audio signal is emitted from the speakers connected to the own device, and a second detecting means for recording it in a database Turkey Control equipment. A control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker and one or more speakers connected to the device;
A discriminating means for discriminating whether or not volume control of sound emitted from the speaker of the external device is possible from the own device;
Measurement signal generating means for generating a measurement signal;
Means used when it is determined by the determining means that volume control is possible,
A sound collection sound reception means for receiving supply of a sound signal collected by a microphone installed at a listening position;
First output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
The output timing of the measurement signal output from the own device according to the control of the first output control means, and the response to the measurement signal emitted from the speaker of the external device at the collected sound reception means First detection means for detecting a delay time of the audio signal in the external device based on the reception timing of the signal and recording this in a database;
Means used when it is determined by the determining means that volume control is impossible;
Second output control means for controlling the measurement signal generated by the measurement signal generation means to be supplied to the external device;
Response signal receiving means for receiving a line input of a response signal for the measurement signal that is output after being subjected to delay processing in the external device;
Delay of the audio signal in the external device based on the output timing of the measurement signal output from the own device according to the control of the output control unit and the reception timing of the response signal received through the response signal reception unit Second detection means for detecting time and recording it in a database;
Delay means for delaying an audio signal supplied to at least the speaker connected to the device;
Based on the recorded delay to the database, Turkey Control equipment and a delay control means for controlling the delay amount of said delay means. Claim 1, claim 2 or a control apparatus according to claim 3,
It said delay control means, of the recorded delay to the database, the largest delay time with respect to the, Turkey Control device to control the delay amount of audio signals supplied to the speakers connected to the own apparatus. Claim 1, claim 2 or a control apparatus according to claim 3,
Multiple databases with different delay information,
Selection input receiving means for receiving a selection input of which of the plurality of databases to use, and
It said delay control means by using the delay time of the database that is to be selected through the selection input receiving means, benzalkonium Control device to control the delay amount of the said delay means. A synchronization correction method for an audio signal used in a control device that supplies an audio signal to an external device having a built-in speaker or connected to the speaker and one or more speakers connected to the device. ,
A measurement signal generating step for generating a measurement signal to be supplied to the external device;
An output control step for controlling to supply the measurement signal generated in the measurement signal generation step to the external device;
A response signal receiving step for receiving a line input of a response signal for the measurement signal output after being subjected to delay processing in the external device;
Based on the output timing of the measurement signal output from the own device according to the control in the output control step and the reception timing of the response signal received in the response signal reception step, the audio signal of the external device A detection step of detecting a delay time and recording it in a database;
Based on the recorded delay to the database synchronization correction method that have a delay control step of controlling the delay amount of the delay means for delaying the audio signal to be supplied to the speakers connected to at least its own device. The synchronization correction method according to claim 6 , wherein
In the previous stage of the delay control step,
A second measurement signal generating step for generating a measurement signal to be supplied to the speaker connected to the own device;
A second output control step for controlling the measurement signal generated in the second measurement signal generation step to be supplied to the speaker connected to the device;
A sound collection sound receiving step for receiving a response signal for the measurement signal emitted from the speaker connected to the sound collected by the microphone installed at the listening position;
Based on the output timing of the measurement signal output from the own device according to the control in the second output control step and the reception timing of the response signal in the collected sound reception step It has been detected a delay of the audio signal output from the speaker, synchronization correction method and a second detection step of recording it in the database. This is a synchronization correction method for an audio signal used in a control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker and one or more speakers connected to the own device. And
A determination step of determining whether or not volume control of sound emitted from a speaker of the external device is possible from the own device;
A measurement signal generating step for generating a measurement signal to be supplied to the external device;
In the determination step, a step executed when it is determined that the volume control is possible,
A first output control step for controlling the measurement signal generated in the measurement signal generation step to be supplied to the external device;
A first collected sound reception step of receiving a response signal for the measurement signal emitted from a speaker of the external device to be collected by a microphone installed at a listening position;
About the output timing of the measurement signal output from the own device according to the control in the first output control step, and the measurement signal emitted from the speaker of the external device in the collected sound reception step A first detection step of detecting a delay time of the audio signal in the external device based on the reception timing of the response signal and recording it in a database;
In the determination step, the step is executed when it is determined that the volume control is impossible.
A second output control step for controlling the measurement signal generated in the measurement signal generation step to be supplied to the external device;
A response signal receiving step for receiving a line input of a response signal for the measurement signal output after being subjected to delay processing in the external device;
Based on the output timing of the measurement signal output from the own device according to the control in the second output control step and the reception timing of the response signal received in the response signal reception step, in the external device A second detection step of detecting a delay time of the audio signal and recording it in a database;
Based on the recorded delay to the database synchronization correction method that have a delay control step of controlling the delay amount of the delay means for delaying the audio signal to be supplied to the speakers connected to at least its own device. In a computer installed in a control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker and one or more speakers connected to the own device,
A measurement signal generating step for generating a measurement signal;
An output control step for controlling the measurement signal generated in the measurement signal generation step to be supplied to the external device;
A response signal receiving step for receiving a line input of a response signal for the measurement signal output after being subjected to delay processing in the external device;
Based on the output timing of the measurement signal output from the own device according to the control in the output control step and the reception timing of the response signal received in the response signal reception step, the audio signal of the external device A detection step of detecting a delay time and recording it in a database;
A delay that controls the delay amount of the delay means that delays the audio signal supplied to the speaker connected to the own apparatus with reference to the information recorded in the database and based on the delay time of the audio signal in the external device synchronization correction program that is executed and a control step. The synchronization correction program according to claim 9 ,
In the previous stage of the delay control step,
A second measurement signal generating step for generating a measurement signal to be supplied to the speaker connected to the own device;
A second output control step for controlling to supply the measurement signal generated in the second measurement signal generation step to a speaker connected to the own device;
A collected sound reception step for receiving a response signal for the measurement signal emitted from the speaker connected to the sound collected by the microphone installed at the listening position;
Based on the output timing of the measurement signal output from the own device according to the control of the second output control step, and the reception timing of the response signal in the collected sound reception step, it is connected to the own device. detects a delay time of the audio signal output from the speaker, synchronization correction program that is executed and a second detection step of recording it in the database. In a computer installed in a control device that supplies an audio signal to an external device with a built-in speaker or connected to the speaker and one or more speakers connected to the own device,
A determination step of determining whether or not volume control of sound emitted from a speaker of the external device is possible from the own device;
A measurement signal generating step for generating a measurement signal to be supplied to the external device;
In the determination step, it is a step executed when it is determined that the volume control is possible,
A first output control step for controlling the measurement signal generated in the measurement signal generation step to be supplied to the external device;
A first collected sound reception step of receiving a response signal for the measurement signal emitted from a speaker of the external device to be collected by a microphone installed at a listening position;
The output timing of the measurement signal output from the own device according to the control in the first output control step, and the measurement signal emitted from the speaker of the external device in the collected sound reception step A first detection step of detecting a delay time of the audio signal in the external device based on the reception timing of the response signal and recording it in a database;
In the determining step, the step is executed when it is determined that the volume control is impossible,
A second output control step for controlling the measurement signal generated in the measurement signal generation step to be supplied to the external device;
A response signal receiving step for receiving a line input of a response signal for the measurement signal output after being subjected to delay processing in the external device;
Based on the output timing of the measurement signal output from the own device in accordance with the control of the second output control step and the reception timing of the response signal received in the response signal reception step, the audio in the external device A second detection step of detecting a delay time of the signal and recording it in a database;
Based on the recorded delay to the database synchronization correction program that have a delay control step of controlling the delay amount of the delay means for delaying the audio signal to be supplied to the speakers connected to at least its own device.

Images