JP2009089076A - Av system and millimeter-wave transmitter - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To optimize surround effects or the like in accordance with a viewing space when transmitting an AV signal to AV equipment by using a millimeter waveband. <P>SOLUTION: A millimeter-wave transmitter 30 in a digital recorder 10 transmits an AV signal in a millimeter waveband to a plurality of AV equipment (surround speakers) via an AV signal transmitting part 32 and an antenna part 34. The millimeter-wave transmitter 30 includes a millimeter-wave radar device 40 so as to acquire spatial information of a viewing space by scanning a prescribed viewing space. A surround control part 54 executes optimization of reproduction of the AV signal, transmitted to each AV equipment by a millimeter wave, on the basis of the spatial information of the viewing space acquired by the millimeter-wave radar device 40 in order to obtain surround effects or the like matched with the viewing space and the viewer's position. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an AV system and a millimeter wave transmission apparatus, and more particularly to a technique for transmitting an AV signal using an millimeter wave band to an AV (Audio Video) device arranged in a predetermined viewing space.

  Conventionally, when arranging a plurality of speakers corresponding to a plurality of channels (for example, 5.1 channels) in a viewing room and constructing an acoustic system having a surround effect, each speaker is disposed at an appropriate position, There is a problem that the connection work for connecting the output terminal of the sound reproduction apparatus and the input terminal of each speaker is performed while considering which sound signal should be supplied to which speaker, and the work is complicated.

  In order to solve this problem, a test signal is sequentially supplied to each of a plurality of speakers, the sound is received by a microphone, and the connection between the signal input and the speaker is automatically optimized according to the sound reception result. Has been proposed (Patent Document 1), which can notify the effective setting of and that constructs an optimum reproduction environment with a simple operation.

Also, an audio video wireless transmission device has been proposed that can transmit millimeter-wave band audio signals to a plurality of speakers and enjoy surround sound (Patent Document 2).
JP 2001-25085 A JP-A-2005-65169

  However, the channel arrangement device described in Patent Document 1 requires a dedicated microphone for specifying the position of each speaker, and since each speaker and the playback device are connected by wire, the wiring is obstructive. Therefore, once wiring is performed, there is a problem that the position of the speaker or the like cannot be freely moved. In addition, the regular layout of each speaker is determined, and the viewing position where the optimum surround effect is obtained is also determined, and there is a problem that there is no degree of freedom.

  On the other hand, the audio video wireless transmission device described in Patent Document 2 has an advantage that a wiring is not necessary because a millimeter-wave audio signal is transmitted wirelessly, but has a surround effect on the position of the viewer. There is no function to optimize.

  The present invention has been made in view of such circumstances, and an AV system capable of optimizing a surround effect or the like in accordance with a viewing space when an AV signal is transmitted to an AV device using a millimeter wave band. And it aims at providing a millimeter wave transmission device.

  In order to achieve the above object, the invention according to claim 1 is directed to a millimeter wave transmission device arranged in a predetermined viewing space, and the viewing for performing millimeter wave communication using the millimeter wave transmission device and a millimeter wave band. In an AV system including AV devices arranged in space, the millimeter wave transmission device scans the predetermined viewing space and acquires spatial information of the viewing space, the AV device and the millimeter wave. Millimeter wave communication means for performing wave communication; and control means for optimizing reproduction of an AV signal transmitted from the millimeter wave communication means to the AV equipment based on spatial information acquired by the millimeter wave radar apparatus; It is characterized by having.

  This AV system wirelessly transmits millimeter-wave AV signals from the millimeter-wave transmission device to the AV equipment, so no wiring is required. In particular, the spatial information of the viewing space is acquired by a millimeter-wave radar device using millimeter waves. Since the reproduction of the AV signal transmitted from the millimeter wave communication means to the AV device is optimized based on the acquired spatial information, the surround effect and the like are optimized according to the viewing space. Can do.

  The AV system according to claim 1, wherein the millimeter wave radar device shares an antenna unit with the millimeter wave communication unit, and the antenna unit is used when acquiring spatial information of the predetermined viewing space. And scanning the predetermined viewing space.

  That is, as the millimeter wave radar device, the cost can be reduced by using a part of the millimeter wave communication means (an antenna unit, a circuit unit for generating a millimeter wave, etc.) for transmitting an AV signal as a millimeter wave. .

  3. The AV system according to claim 2, further comprising a spatial information acquisition mode for acquiring spatial information of the predetermined viewing space, wherein the millimeter wave radar device includes the spatial information acquisition mode. Sometimes, the predetermined viewing space is scanned. The spatial information acquisition mode may be selected by operating a dedicated mode switching unit, or may be automatically selected from the time of system startup until the acquisition of spatial information.

  4. The AV system according to claim 2, wherein the millimeter wave radar device scans the predetermined viewing space by interrupting transmission of the AV signal from the millimeter wave communication means. It is a feature.

  As shown in claim 5, in the AV system according to claim 4, the millimeter wave radar device divides the scanning range of the predetermined viewing space into a plurality of parts, and scans by shifting the time for each scanning range. It is characterized by. As a result, spatial information of a predetermined viewing space can be obtained at all times, and there is no hindrance to millimeter wave transmission of AV signals.

  6. The AV system according to claim 1, wherein the AV device is a plurality of speaker devices, or a plurality of speaker devices and a video display device. The multi-channel audio signal or the multi-channel audio signal and the video signal are transmitted. The multi-channel audio signal or the multi-channel audio signal and the video signal are transmitted simultaneously in a plurality of millimeter wave frequency bands.

  The AV system according to claim 6, wherein the control unit adjusts the output timing of the multi-channel audio signal or the reproduction timing of the speaker device, and the volume by adjusting the volume. It is characterized by optimizing the reproduction of the transmitted AV signal.

  The AV system according to any one of claims 1 to 5, wherein the AV device is a stereoscopic video display device, and the millimeter wave communication means transmits a stereoscopic video signal. It is said.

  The AV system according to any one of claims 1 to 8, wherein the display unit displays the spatial information acquired by the millimeter wave radar device and the spatial information displayed on the display unit. Viewer instruction means for instructing the position of the viewer, and the control means optimizes reproduction of the AV signal based on the position of the viewer instructed by the viewer instruction means. It is characterized by that.

  That is, in the spatial information acquired by the millimeter wave radar device, in addition to the position information of the AV equipment (target object), non-target objects such as furniture installed in the viewing space, and viewers (non-target objects) However, the viewer cannot be automatically determined from this spatial information. Accordingly, the spatial information is displayed on the display means, and the viewer displayed on the display screen is designated by the viewer instruction means such as a pointer or a touch panel, so that the millimeter wave transmission apparatus recognizes the position of the viewer. I can do it. Further, the control means optimizes the reproduction of the AV signal so as to obtain an optimum surround effect or the like at the designated viewer position.

  In the AV system according to any one of claims 1 to 8, as shown in claim 10, storage means for storing the spatial information acquired by the millimeter wave radar device, spatial information stored in the storage means, and the Difference information with respect to the spatial information acquired by the millimeter wave radar apparatus after the spatial information is stored in the storage means is acquired, and the viewer's position that has entered the predetermined viewing space based on this differential information, the viewer who has moved Or a viewer detecting means for detecting the position of the viewer who has increased or decreased, and the control means reproduces the AV signal based on the viewer position detected by the viewer detecting means. It is characterized by performing optimization.

  For example, in a state where there is no viewer in a predetermined viewing space, the spatial information of the viewing space is acquired and stored in the storage means, and then the spatial information is acquired with the viewer entering the viewing space. When the difference information with respect to the stored spatial information is acquired, the position of the viewer can be recognized. In addition, spatial information in a state in which a viewer is present in the viewing space is stored in a storage unit, and after that, when difference information with the acquired spatial information is acquired, the movement of the viewer or the viewer's Positions that have increased or decreased can be recognized. When there are a plurality of viewers, AV signal reproduction is optimized so as to obtain an optimal surround effect or the like at a position equidistant from the plurality of viewers.

  The AV system according to any one of claims 1 to 10, wherein the display unit displays spatial information acquired by the millimeter wave radar device and the spatial information displayed on the display unit. Device instruction means for instructing the position and type of the AV device, and the control means is adapted to optimize the reproduction of the AV signal based on the position and type of the AV device designated by the device designation means. It is characterized by performing.

  That is, the spatial information acquired by the millimeter wave radar device includes position information of non-objects such as furniture installed in the viewing space, in addition to position information of AV equipment (objects). The object cannot be automatically determined from the spatial information. Therefore, the spatial information is displayed on the display means, and the AV device displayed on the display screen is designated by the viewer instruction means such as a pointer or a touch panel, so that the millimeter wave transmission apparatus side recognizes the position of the AV device. I can do it. In addition, when specifying the position of the AV device, the type of the specified AV device (for example, the type of the speaker device or the video display device, or the type of each of the plurality of speaker devices) is specified at the same time. Yes.

  The AV system according to any one of claims 1 to 10, wherein the AV device includes a millimeter wave communication unit that transmits information indicating a type of the AV device, and the millimeter wave radar The apparatus acquires information indicating the position and type of the AV device during scanning of the predetermined viewing space, and the control unit optimizes reproduction of the AV signal based on the acquired position and type of the AV device. It is characterized by performing.

  That is, information indicating the type of the AV device is transmitted as a millimeter wave signal from the AV device, and the millimeter wave radar device detects the AV device based on the millimeter wave signal received from the AV device during scanning of a predetermined viewing space. The position and type are automatically acquired.

  The AV system according to any one of claims 1 to 12, wherein the millimeter wave is transmitted from the millimeter wave communication means in the direction of the AV device so that the directivity of the millimeter wave is high. It further comprises directivity control means for controlling the directivity of the antenna section of the wave communication means.

  That is, the higher the directivity of millimeter waves, the longer the reach. Therefore, control is performed so that the directivity of the millimeter wave transmitted in the direction of the AV device is increased with respect to the AV device located far from the millimeter wave transmission device.

  The invention according to claim 14 is a millimeter wave transmission device applied to the AV system according to any one of claims 1 to 13.

  According to the present invention, when the AV signal is transmitted to the AV device using the millimeter wave band, the spatial information of the viewing space is acquired by the millimeter wave radar device, so that the surround sound according to the acquired viewing space is obtained. The effects can be optimized.

Hereinafter, preferred embodiments of an AV system and a millimeter wave transmission device according to the present invention will be described with reference to the accompanying drawings.
[Overall configuration of AV system]
FIG. 1 is a system configuration diagram of an AV system according to the present invention, and shows a case of a 5.1 channel home theater system.

  The 5.1 channel home theater system 1 includes a digital recorder 10, an image display device 12, front 3 channel (left, center, right) speaker devices 14, 16, 18 and rear 2 channel (rear left, rear right). ) Speaker devices 20 and 22 and a woofer speaker device 24.

  A 5.1-channel surround speaker system is configured by the five channels of the five speaker devices 14, 16, 18, 20, and 22 and the 0.1 channel of the woofer speaker device 24. Note that the woofer is described as 0.1 channel because it only handles a narrow band of heavy low frequencies.

  Further, the digital recorder 10, the video display device 12, and the speaker devices 14, 16, 18, 20, 22, and 24 are respectively disposed at appropriate positions in a room 26 that is a viewing space.

  The digital recorder 10 is, for example, an HD (high quality) DVD built-in digital recorder. The digital recorder 10 and each AV device (video display device 12, speaker devices 14, 16, 18, 20, 22, 24) communicate wirelessly using a millimeter wave band, and the digital recorder 10 has a millimeter wave band. AV (Audio Video) signal is transmitted. Furthermore, the digital recorder 10, the video display device 12, and the speaker devices 14, 16, 18, 20, 22, and 24 function as an access point and repeater for communication using the millimeter wave band.

In addition, the digital recorder 10 includes a millimeter wave transmission device having a millimeter wave radar device for acquiring spatial information of the viewing space as described later.
[Digital recorder]
FIG. 2 is a block diagram showing an embodiment of the digital recorder 10.

  The digital recorder 10 includes an HD DVD recording / reproducing unit 28, a remote control light receiving unit 29, and a millimeter wave transmission device 30 according to the present invention.

  The recording / playback unit 28 includes an HD DVD drive, a hard disk device, and the like, and performs playback of AV signals from the HD media or the hard disk device, and recording of AV signals to the HD media or the hard disk device.

  The remote control light receiving unit 29 receives an infrared remote control signal for remote-controlling the digital recorder 10 from an infrared remote control device (not shown), and outputs an operation signal to the recording / reproducing unit 28 of the digital recorder 10 and each part of the millimeter wave transmission device 30. To do.

  The millimeter wave transmission device 30 transmits the transmission data reproduced from the recording / reproducing unit 28 as a millimeter wave band AV signal, or receives the millimeter wave band AV signal and outputs it to the recording / reproducing unit 28. A millimeter wave radar device 40, a display control unit 52, a surround control unit 54, and a millimeter wave communication unit and a control unit 50 that controls the millimeter wave radar device 40 in an integrated manner. The AV signal transmitting unit 32, the antenna unit 34, the AV signal receiving unit 36, and the frequency synthesizer unit 38 are configured.

  The AV signal transmission unit 32 includes a DA converter 32A, a mixer / upconverter circuit 32B, and a transmission amplifier 32C.

  To the DA converter 32A, 5.1 channel digital audio signals and video signals are added as transmission data, and the DA converter 32A converts each input digital signal into an analog signal. Output to the mixer and up-converter circuit 32B.

  A plurality of millimeter wave carriers in the millimeter wave band are added from the frequency synthesizer unit 38 to the other input of the mixer and up-converter circuit 32B.

  The frequency synthesizer unit 38 includes a voltage-controlled oscillator (VCO) 38A, a frequency divider 38B, and a timing adjustment circuit 38C, and a plurality of channels having different bands corresponding to the number of channels of 5.1 digital audio signals and video signals. Minute millimeter-wave carrier waves are generated and added to the AV signal transmission unit 32 and the AV signal reception unit 36. Here, the millimeter wave is a radio wave having a frequency of 30 to 300 GHz (wavelength 10 to 1 mm).

  The mixer and up-converter circuit 32B converts a 5.1 channel digital audio signal and video signal into a millimeter wave modulation signal by a millimeter wave carrier wave for a plurality of channels corresponding to each AV signal applied from the frequency synthesizer unit 38. Convert. The millimeter-wave band AV signal frequency-converted in this way is amplified by the transmission amplifier 32C, output to the antenna unit 34, and transmitted from the antenna unit 34 as a millimeter-wave band AV signal.

  The AV signal receiving unit 36 includes a receiving amplifier 36A, a mixer / downconverter circuit 36B, and an AD converter 36C.

  The millimeter wave band AV signal received by the antenna unit 34 is amplified by the receiving amplifier 36A and then added to the mixer and down-converter circuit 36B. A millimeter wave carrier wave for a plurality of channels is added to the other input of the mixer and down converter circuit 36B from the frequency synthesizer unit 38, and the mixer and down converter circuit 36B converts the input millimeter wave AV signal into a millimeter wave. Demodulate with carrier wave. The demodulated AV signal is converted into a digital signal by the A / D converter 36 </ b> C and output to the recording / reproducing unit 28.

  Next, the millimeter wave radar device 40 will be described.

  The millimeter wave radar device 40 is, for example, an FM-CW (Frequency Modulated Continuous Wave) millimeter wave radar device, and mainly includes a signal processing unit 41, a transmission / reception unit 42, a directivity control unit 43, an antenna driving unit 44, and spatial information. The processing unit 45 and the antenna unit 34 are included.

  The millimeter wave radar device 40 shares the antenna unit 34 with the millimeter wave communication means for transmitting and receiving the above-described millimeter wave band AV signals. Further, the transmission / reception unit 42 can also be shared with a part of the AV signal transmission unit 32, the AV signal reception unit 36, and the frequency synthesizer unit 38 of the millimeter wave communication means.

  The signal processing unit 41 scans the viewing space using the millimeter wave and acquires the millimeter wave signal frequency-modulated by the triangular wave from the transmission / reception unit 42 in the mode for acquiring the spatial information of the viewing space (spatial information acquisition mode). 34 to output. The antenna unit 34 to which the millimeter wave signal is input radiates the millimeter wave to the viewing space. The radiated millimeter wave is reflected by an object existing in the viewing space, a part of which is received by the antenna unit 34 and output to the transmission / reception unit 42.

  The transmission / reception unit 42 modulates the frequency of the millimeter wave (reflected wave) received by the antenna unit 34, mixes it with the radiated wave, and creates a time difference between the radiated wave and the reflected wave (time delay corresponding to the round-trip distance to the reflecting object). The corresponding beat wave (frequency difference between the radiated wave and the reflected wave) is output to the signal processing unit 41.

  The signal processing unit 41 calculates the distance to the reflecting object based on the frequency of the beat wave input from the transmission / reception unit 42. Since the frequency of the beat wave is proportional to the delay time of the frequency-modulated triangular wave (reciprocating distance to the reflecting object), the distance from the frequency of the beat wave to the reflecting object can be obtained.

  In addition, the signal processing unit 41 outputs a command for increasing the directivity of the millimeter wave transmitted from the antenna unit 34 to the directivity control unit 43 in the spatial information acquisition mode. A scan command for scanning the space is output.

  The directivity control unit 43 drives and controls the antenna unit 34 via the antenna drive unit 44 based on the command from the signal processing unit 41, and at least 1 viewing space is generated by millimeter waves with high directivity in the spatial information acquisition mode. Scan once. The antenna unit 34 may be either a mechanical scanning system that mechanically rotates the antenna or an electronic scanning system that switches a plurality of antenna elements.

  As described above, the signal processing unit 41 calculates the distance to the reflecting object based on the frequency of the beat wave input from the transmission / reception unit 42, acquires the azimuth (scan direction), and sends this to the spatial information processing unit 45. Output.

  The spatial information processing unit 45 includes a spatial information storage unit 45A, and spatial information of the viewing space based on the distance and direction to the reflective object (position information of the reflective object in the viewing space based on the millimeter wave radar device 40). And the created spatial information is stored in the spatial information storage unit 45A.

  Further, the spatial information processing unit 45 has a function of outputting to the display control unit 52 of the control unit 50 so that the spatial information stored in the spatial information storage unit 45A can be monitored, and an initial state stored in the spatial information storage unit 45A Spatial information (or spatial information stored in the previous spatial information acquisition mode) and then the position of the viewer that entered the viewing space based on the difference information between the acquired spatial information, the position of the viewer that moved, Or, a viewer detection function for detecting the position of the increased or decreased viewer, the position and type of the AV device instructed by the manual operation (in this embodiment, the type of the position of each speaker device), and the viewer's A function of outputting the position to the surround control unit 54 of the control unit 50 or automatically detecting the position and type of the AV device and the position of the viewer and outputting the information to the surround control unit 54 The has. Details of each function of the spatial information processing unit 45 will be described later.

  The display control unit 52 outputs, for example, a video signal corresponding to the spatial information to the video display device 12 based on the spatial information input from the spatial information processing unit 45. The video signal can be transmitted via the AV signal transmitting unit 32 and the antenna unit 34 that transmit millimeter-wave AV signals.

  FIG. 3 is a diagram illustrating an example of spatial information displayed on the video display device 12 in the spatial information acquisition mode.

  In FIG. 3, the viewing space partitioned by a wall or the like is the viewing space of the room 26, the reflecting objects A1 to A4 corresponding to the four speaker devices, and the reflecting object A5 corresponding to the viewer exist in the viewing space. Has been shown. O indicates the position of the digital recorder 10 (millimeter wave radar device 40), but this position may not be displayed as spatial information.

  The millimeter wave radar device 40 can acquire spatial information, but cannot specify the type of reflective object from the spatial information.

  Therefore, the viewer operates an infrared remote control device (not shown) while viewing the spatial information displayed on the video display device 12 to align the pointer with the position of the viewer, and the reflecting object at the position indicated by the pointer. A5 is instructed to be a viewer. Thereby, the spatial information processing unit 45 can recognize the position of the viewer in the viewing space (spatial information).

  Similarly, the pointer is set to the position of the reflective object A1, and it is instructed that the reflective object A1 at the position indicated by the pointer is a front left speaker device (type of AV device). Similarly, the other reflecting objects A2 to A4 are also instructed to be front-right, rear-left, and rear-right speaker devices, respectively. In this embodiment, the position and type of the reflecting object are instructed by the remote control operation and the graphical user interface (GUI) of the video display device 12. However, the present invention is not limited to this, and the GUI may be a touch panel or other pointing device. If these are provided, position designation or the like may be performed using these.

  When the surround control unit 54 acquires information on the position and type of each speaker device in the viewing space and the position of the viewer from the spatial information processing unit 45, an optimal surround effect or the like can be obtained at the viewer position. The audio signal playback is optimized.

  That is, the surround control unit 54 adjusts the output timing of the multi-channel audio signal corresponding to each 5.1 channel speaker device from the AV signal transmission unit 32, and also adjusts the volume (volume ratio) of each speaker device. The volume adjustment signal to be adjusted is transmitted via the AV signal transmission unit 32 and the antenna unit 34.

In addition, when each speaker device has a reproduction timing adjusting means (for example, a delay circuit) that adjusts the time until the reproduction after receiving the audio signal, the timing adjustment for adjusting the reproduction timing of each speaker device. The signal may be transmitted via the AV signal transmission unit 32 (or transmission / reception unit 42) and the antenna unit 34, and the reproduction timing may be adjusted.
[Speaker device]
FIG. 4 is a block diagram showing an embodiment of a speaker device applied to the AV system according to the present invention.

  The speaker device (front left) 14 shown in FIG. 4 includes a millimeter wave communication device 60 and a digital speaker 62. The millimeter wave communication device 60 includes an antenna unit 60A, a reception amplifier 60B, a bandpass filter 60C, and a down filter. It is composed of a converter circuit 60D, an AD converter 60E, a control unit 60F, a DA converter 60G, an up converter circuit 60H, and a transmission amplifier 60I.

  The antenna unit 60A transmits and receives millimeter wave AV signals, control signals, and the like. The multi-channel AV signals received here are amplified by the receiving amplifier 60B and then added to the band filter 60C. Yeah.

  The band-pass filter 60C passes only a desired signal component (a signal in a band assigned to itself among multi-channel AV signals) and outputs it to the down-converter circuit 60D. The down-converter circuit 60D demodulates the input millimeter-wave AV signal or the like and outputs the demodulated signal to the A-D converter 60E.

  The digital speaker 62 generates sound based on the AV signal input from the A-D converter 60E.

  When a control signal for controlling the sound volume is transmitted from the digital recorder 10, the control unit 60F takes in the control signal via the AD converter 60E and controls the sound volume for controlling the sound volume of the digital speaker 62. A control signal is output to the digital speaker 62. In addition, the control unit 60F has a reproduction timing adjusting unit that adjusts the time until the sound generation after the speaker device 14 inputs the AV signal, and a timing control signal for adjusting the reproduction timing of the speaker device 14 is transmitted from the digital recorder 10. If it is, the timing control signal is taken in via the AD converter 60 and a control signal for controlling the reproduction timing (delay time) of the digital speaker 62 is output to the digital speaker 62.

  Furthermore, when transmitting necessary transmission information to the digital recorder 10 or the like, the control unit 60F outputs the information to the DA converter 60G.

  The DA converter 60G converts the input transmission information into an analog signal and outputs it to the up-converter circuit 60H. The up-converter circuit 60H frequency-converts the transmission information input from the DA converter 60G into a millimeter-wave modulated signal using a predetermined millimeter-wave carrier (for example, a millimeter-wave carrier in a band assigned to the speaker device 14). The millimeter-wave band transmission information frequency-converted in this way is amplified by the transmission amplifier 60I, output to the antenna unit 60A, and transmitted from the antenna unit 60A as millimeter-wave band transmission information.

  The other speaker devices 16, 18, 20, and 22 of the 5.1 channel home theater system 1 shown in FIG. The video display device 12 also includes a millimeter wave communication device similar to the millimeter wave communication device 60 built in the speaker device 14.

[Surround setting]
<Initial setting operation>
FIG. 5 is a flowchart showing an initial setting operation of surround setting in the AV system according to the present invention.

  When the digital recorder 10 is turned on or receives an operation command for initial setting operation, the digital recorder 10 enters a spatial information acquisition mode, radiates a millimeter wave for signal from the millimeter wave radar device 40 so as to scan the viewing space (room), A reflected wave from the reflecting object is received (steps S10 and S12).

  The distance to the reflecting object is calculated based on the frequency of the beat wave corresponding to the time difference between the radiated wave and the reflected wave, and the spatial information in the room is formed from the radiation direction of the signal millimeter wave (step S14). .

  Subsequently, as shown in FIG. 3, the reflection object (object) in the room is displayed on the video display device 12 based on the formed spatial information (step S16).

  While viewing the screen of the video display device 12, the viewer moves the pointer to an object corresponding to the viewer among the objects in the screen by remote control operation, and the object at the position indicated by the pointer is the viewer. Is instructed (step S18).

  On the digital recorder 10 side, the position of the viewer in the viewing space (spatial information) can be recognized by an instruction input from the remote controller operation, and this is set as the initial space value of the viewing space (step S20).

  When the 5.1 channel speaker devices, digital recorders, etc. are initially placed in the viewing space, or when the layout of each speaker device is changed, the position and type of each speaker device are the same as described above. It is necessary to instruct based on a remote control operation or the like, and to make the digital recorder recognize the position and type of each speaker device in the viewing space (spatial information).

Based on the position of the viewer and each speaker device set as described above, a multi-channel corresponding to each 5.1-channel speaker device is obtained so that an optimum surround effect is obtained at the position of the viewer. The setting of the output timing of the audio signal and the volume (volume ratio) of each speaker device is optimized (step S22).
<Normal operation (manual)>
FIG. 6 is a flowchart showing a normal operation (manual) of surround setting in the AV system according to the present invention. In addition, the same step number is attached | subjected to the part which is common in the initial setting operation | movement shown in FIG. 5, and the detailed description is abbreviate | omitted.

  The normal operation (manual) of the surround setting is executed periodically or based on an instruction from the viewer after the initial setting operation shown in FIG.

  When the spatial information in the room is newly formed by the millimeter wave radar device in step 14, in step S30, a difference from the spatial information (initial value) formed during the initial setting operation is obtained, and the presence or absence of the difference is determined. Determine. If there is no difference, the surround setting is not optimized and is left set during the initial setting operation.

  On the other hand, if there is a difference, difference information (object) between the spatial information formed during the initial setting operation and the spatial information formed in step S14 is displayed on the video display device 12 (step S32).

  In addition, although it exists in the spatial information formed at the time of the initial setting operation, it does not exist in the spatial information formed at the time of the initial setting operation. It is preferable that an object existing in the formed spatial information is displayed so as to be distinguishable by color coding or the like.

  While viewing the difference information displayed on the video display device 12, the viewer is prompted to select by remote control operation or the like (step S34), and when the difference information is determined to be the viewer (step S36), the remote control operation or the like is performed. Instruct to that effect.

  Thereby, the digital recorder 10 side can recognize the moving position of the viewer in the viewing space, and optimizes the surround setting based on the newly recognized position of the viewer (step S38).

Note that the spatial information formed in step S14 is an initial value for the spatial information formed at the next scan. Further, since the difference information is also formed when the speaker device is moved, the viewer determines that the difference information is the speaker device while looking at the difference information displayed on the video display device 12, so that a remote control operation or the like is performed. To that effect.
<Normal operation (Auto)>
FIG. 7 is a flowchart showing a normal operation (auto) of surround setting in the AV system according to the present invention. Parts common to the normal operation (manual) of the surround setting shown in FIG. 6 are given the same step numbers, and detailed description thereof is omitted.

  The normal operation (auto) of the surround setting is executed periodically or based on an instruction from the viewer after the initial setting operation shown in FIG.

  If it is determined in step 30 that there is a difference between the spatial information newly formed by the millimeter wave radar device and the spatial information (initial value) formed during the initial setting operation, based on the difference information indicating the difference. It is determined whether or not the viewer has increased or decreased (step S40), or whether or not the viewer has moved (step S42, see FIG. 1). Note that the millimeter wave radar device can determine whether or not the reflecting object indicated by the difference information is a viewer (human) based on the shape, size, and the like of the reflecting object.

  If it is determined in step S40 that the number of viewers has increased or decreased, the process proceeds to step S44, where the center position of the increased or decreased viewers is calculated. When the number of viewers decreases and becomes one, the position of the one viewer is calculated.

  On the other hand, in step S40, the process proceeds to step S42 without determining that the number of viewers has increased or decreased, and when it is determined that the viewer has moved, the process proceeds to step S46. In step S46, the position of the moved viewer is reset.

In step S48, the surround setting is optimized based on the center positions of the plurality of viewers calculated in step S44 or the viewer positions reset in step S46.
[Control of millimeter wave directivity]
FIG. 8 is a flowchart showing a procedure for controlling the directivity of millimeter waves in the AV system according to the present invention, and FIG. 9 is a conceptual diagram showing how the directivity is controlled according to the direction of the object.

  In FIG. 8, the digital recorder 10 scans the viewing space (room) for the millimeter wave for signal from the millimeter wave radar device 40 in the mode for controlling the directional characteristics of the millimeter wave (may be simultaneously with the spatial information acquisition mode). The reflected wave from the reflecting object is received (steps S10 and S12). The distance to the reflecting object is calculated based on the frequency of the beat wave corresponding to the time difference between the radiated wave and the reflected wave, and the spatial information in the room is formed from the radiation direction of the signal millimeter wave (step S14). .

  The digital recorder 10 determines whether or not each 5.1 channel speaker device (wireless HD device) has been extracted (step S50). Here, the millimeter wave transmitted with non-directionality has a short reach, but the millimeter wave transmitted with directivity has a long reach. Since the millimeter wave for signal radiated from the millimeter wave radar device 40 has high directivity, it reaches at least each speaker device.

  For example, when each speaker device receives a millimeter wave for signals emitted from the millimeter wave radar device 40, each speaker device transmits information indicating the type of the speaker device itself as a millimeter wave signal.

  If the digital recorder 10 can receive a millimeter wave signal indicating the type of the speaker device from each speaker device, the digital recorder 10 determines that the wireless HD device has been detected. The digital recorder 10 recognizes which type of speaker device is arranged in which direction based on the scanning direction of the millimeter wave radar device 40 and the reception timing of the millimeter wave signal indicating the type of the speaker device itself. can do.

  If the desired wireless HD device cannot be extracted in step S50, the digital recorder 10 displays a warning on the video display device 12 or the like and prompts the target device to be placed near the digital recorder 10 (step S52). .

  On the other hand, when the desired wireless HD device can be extracted, the position of the wireless HD device is determined (step S54), and the distance between the digital recorder 10 and the determined wireless HD device (target object) is, for example, a digital recorder. When the AV signal is transmitted as a non-directional millimeter wave signal from 10, it is determined whether or not the millimeter wave signal is less than a reachable limit value (step S 56).

  If the distance of the wireless HD device (object) exceeds the limit value, the process proceeds to step S52, where a warning is displayed.

When the distance of the wireless HD device (target object) is equal to or less than the limit value, as shown in FIG. 9, the radiation angle of the AV signal to the target object (AV device group, access point / repeater) is narrowed (directivity is reduced). The radiation direction of the narrowed AV signal is optimized (steps S58 and S60). As a result, the transmission distance of the millimeter wave signal in the direction of the object can be extended, and the millimeter wave signal can reliably reach each object.
[Modification]
Obtain spatial information of the viewing space when the viewer is not in the room, store this spatial information, and calculate the difference information between this spatial information and the spatial information obtained after the viewer enters the room By doing so, it is possible to automatically detect the position of the viewer who has entered the room (viewing space), the position of the viewer who has moved, or the position of the viewer who has increased or decreased.

  In this embodiment, the digital recorder 10 and each AV device (video display device 12, speaker devices 14, 16, 18, 20, 22, 24) communicate wirelessly using the millimeter wave band. However, AV devices (for example, the video display device 12, the speaker device (center) 16, and the speaker device (woofer) 24 in the example shown in FIG. 1) are connected to each other by a wired connection. You may do it.

  In this embodiment, the millimeter wave transmission device 30 according to the present invention is incorporated in the digital recorder 10, but the millimeter wave transmission device 30 and the source of the AV signal may be separated.

  Furthermore, the millimeter wave radar device of this embodiment acquires spatial information of the viewing space when the power is turned on or when an operation command for an initial setting operation is received. The space information of the viewing space may be acquired by interrupting the transmission of the AV signal from the means, and in this case, it may be performed periodically or continuously at regular time intervals. Furthermore, when acquiring the spatial information of the viewing space by interrupting the transmission of the AV signal, the millimeter wave radar device divides the scanning range of the viewing space into a plurality of parts, and scans by shifting the time for each scanning range. As a result, the spatial information of the viewing space can always be acquired and the millimeter wave transmission of the AV signal is not hindered.

  Further, as described in [Control of Directional Characteristics of Millimeter Wave], the millimeter wave radar apparatus transmits the information indicating the type of the AV device from the AV device, so that the millimeter wave radar apparatus scans the AV device when scanning the viewing space. Information indicating the position and type can be acquired. That is, the position and type of the AV device in the viewing space can be automatically acquired. Therefore, it is possible to optimize the reproduction of the AV signal based on the position and type of the AV device that is automatically acquired.

  Further, in this embodiment, the case where the AV system according to the present invention is applied to the 5.1 channel home theater system 1 has been described, but the present invention can also be applied to other surround systems.

  In addition, the AV signal according to the present invention includes cases of multi-channel audio signals and video signals, only multi-channel audio signals, and only multi-channel video signals.

  As the multi-channel video signal, a multi-view video signal for a stereoscopic video display device in which a subject is photographed from a plurality of viewpoint positions (two or more viewpoints) can be considered.

  In other words, a technique for optimizing the stereoscopic effect of a stereoscopic image in consideration of the viewer's position (distance, direction) is known (for example, Japanese Patent Laid-Open No. 2005-142819). For this purpose, the millimeter wave radar apparatus according to the present invention can be applied to optimize a multi-channel video signal for stereoscopic video. Further, by tracking the movement of the viewer and optimizing the multi-channel video signal for stereoscopic video, it is possible to obtain a real sense of reality and reality.

  The present invention is not limited to the above-described embodiments, and the embodiments may be combined as appropriate, and various modifications can be made by those skilled in the art without departing from the spirit of the present invention. Needless to say.

FIG. 1 is a system configuration diagram of an AV system according to the present invention. FIG. 2 is a block diagram showing an embodiment of the digital recorder. FIG. 3 is a diagram illustrating an example of spatial information displayed on the video display device in the spatial information acquisition mode. FIG. 4 is a block diagram showing an embodiment of a speaker device applied to the AV system according to the present invention. FIG. 5 is a flowchart showing an initial setting operation of surround setting in the AV system according to the present invention. FIG. 6 is a flowchart showing a normal operation (manual) of surround setting in the AV system according to the present invention. FIG. 7 is a flowchart showing a normal operation (auto) of surround setting in the AV system according to the present invention. FIG. 8 is a flowchart showing a procedure for controlling the directivity characteristics of millimeter waves in the AV system according to the present invention. FIG. 9 is a conceptual diagram showing a state in which the directivity is controlled according to the direction of the object.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... AV system, 10 ... Digital recorder, 12 ... Video display apparatus, 14, 16, 18, 20, 22, 24 ... Speaker apparatus, 26 ... Room, 28 ... Recording / reproducing part, 29 ... Remote control light-receiving part, 30 ... Millimeter Wave transmission device, 32 ... AV signal transmission unit, 34 ... antenna unit, 36 ... AV signal reception unit, 40 ... millimeter wave radar device, 41 ... signal processing unit, 42 ... transmission / reception unit, 43 ... directivity control unit, 44 ... Antenna drive unit 45 ... Spatial information processing unit 45A ... Spatial information storage unit 50 ... Control unit 52 ... Display control unit 54 ... Surround control unit 60 ... Millimeter wave communication device 62 ... Digital speaker

Claims (14)

In an AV system comprising a millimeter wave transmission device disposed in a predetermined viewing space, and an AV device disposed in the viewing space that performs millimeter wave communication using the millimeter wave transmission device and a millimeter wave band,
The millimeter wave transmission device is:
A millimeter wave radar device that scans the predetermined viewing space and acquires spatial information of the viewing space;
Millimeter wave communication means for performing millimeter wave communication with the AV device;
Control means for optimizing reproduction of an AV signal transmitted from the millimeter wave communication means to the AV equipment based on spatial information acquired by the millimeter wave radar apparatus;
An AV system characterized by comprising:   The millimeter wave radar device shares an antenna unit with the millimeter wave communication unit, and scans the predetermined viewing space by controlling the antenna unit when acquiring spatial information of the predetermined viewing space. The AV system according to claim 1.   3. The spatial information acquisition mode for acquiring spatial information of the predetermined viewing space, and the millimeter wave radar device scans the predetermined viewing space in the spatial information acquisition mode. The AV system described in 1.   3. The AV system according to claim 2, wherein the millimeter wave radar apparatus interrupts and scans the predetermined viewing space during transmission of the AV signal from the millimeter wave communication means.   5. The AV system according to claim 4, wherein the millimeter wave radar device divides a scanning range of the predetermined viewing space into a plurality of parts, and scans each scanning range while shifting a time.   The AV device is a plurality of speaker devices, or a plurality of speaker devices and a video display device, and the millimeter wave communication means transmits a multi-channel audio signal or a multi-channel audio signal and a video signal. The AV system according to any one of claims 1 to 5.   The control means optimizes the reproduction of the AV signal transmitted in the millimeter wave by adjusting the output timing of the multi-channel audio signal or the reproduction timing of the speaker device and the volume. The AV system according to claim 6.   The AV system according to claim 1, wherein the AV device is a stereoscopic video display device, and the millimeter wave communication unit transmits a stereoscopic video signal. Display means for displaying spatial information acquired by the millimeter wave radar device;
Viewer instruction means for indicating the position of the viewer using the spatial information displayed on the display means,
9. The AV system according to claim 1, wherein the control unit optimizes reproduction of the AV signal based on a position of the viewer instructed by the viewer instruction unit. Storage means for storing spatial information acquired by the millimeter wave radar device;
Difference information between the spatial information stored in the storage means and the spatial information acquired by the millimeter wave radar apparatus after the spatial information is stored in the storage means is acquired, and a predetermined viewing space is obtained based on the difference information. Viewer detection means for detecting the position of the viewer who has entered, the position of the viewer who has moved, or the position of the viewer who has increased or decreased;
9. The AV system according to claim 1, wherein the control unit optimizes reproduction of the AV signal based on a viewer position detected by the viewer detection unit. Display means for displaying spatial information acquired by the millimeter wave radar device;
Device instruction means for instructing the position and type of the AV equipment using the spatial information displayed on the display means;
11. The AV system according to claim 1, wherein the control unit optimizes reproduction of the AV signal based on the position and type of the AV device designated by the device designation unit. . The AV device has millimeter wave communication means for transmitting information indicating the type of the AV device,
The millimeter wave radar device acquires information indicating the position and type of the AV device during scanning of the predetermined viewing space;
11. The AV system according to claim 1, wherein the control unit optimizes reproduction of the AV signal based on the acquired position and type of the AV device.   Further comprising directivity control means for controlling the directivity of the antenna part of the millimeter wave communication means so that the directivity of the millimeter wave transmitted from the millimeter wave communication means in the direction of the AV device is increased. The AV system according to any one of claims 1 to 12, characterized in that:   A millimeter wave transmission device applied to the AV system according to claim 1.

Images