JP2617112B2 - Indoor space audio-visual simulation system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention simulates sound and video at an arbitrary viewing position in an indoor space, and synchronizes sound and video that change according to the movement of the viewing position. The present invention relates to an indoor space audio-visual simulation system for outputting simultaneously.

[Prior Art] Conventionally, as a building design support system (CAD), a computer simulation system for calculating properties of room reflected sound, acoustic physical quantity, and the like using geometric acoustic theory has been put into practical use (Kiyoshi Nakagawa, "Computer And problems of room sound field simulation by Architectural Engineer, Tokyo Vol. 21, No. 247
(1985)).

In addition, by convolving and integrating various characteristics (impulse response) of the room reflected sound obtained by computer simulation with the separately input sound source signal, an acoustic space similar to the completed architectural space is created in the laboratory. Audible indoor sound field simulator (indoor sound generation system) has already reached the stage of commercialization (Morimoto Morimoto,
"Homomi is not heard-about audible simulator-", Acoustic Technology, No. 60 / dec. (1987)).

On the other hand, the psychological impression of the architectural space is largely influenced by visual elements, and visual information plays an important role in the evaluation of architectural spaces, such as music halls and recording studios, mainly for acoustic purposes. It is well known that

It has also been pointed out that the psychological evaluation value changes even if the acoustic characteristics are the same due to the change in the seat position in the hall (W. Reichardt und U. Lehmann.
mierung von Raumeindruck und Durchsichtigkeit von
Musikdarbietungen durch Auswertung von Impulsschal
ltests, "(Acustica 48, 175-185 (1981)).

As described above, it has been clarified that the visual information that changes in accordance with the listening position also has a very important meaning in a psychological experiment focusing on sound.

[Problems to be Solved by the Invention] By the way, in the above-described conventional indoor space acoustic evaluation, visual information, particularly, video information viewed from a viewer position is not considered. That is, despite the fact that video information is largely involved in the above-mentioned acoustic evaluation, conventionally only acoustic elements are mainly handled, and the sound and video in the indoor space are simulated in consideration of the movement of the viewer. And
A device that allows them to experience them at the same time has not yet been realized.

The present invention has been made under such a background,
It is an object of the present invention to provide a room acoustic image simulation system that simulates sound and image at an arbitrary listening position in a room in consideration of the movement of a viewer and allows them to experience both at the same time.

Means for Solving the Problems To solve the above problems, the present invention provides an acoustic signal for calculating an impulse response at a viewer position in a room sound field based on architectural design specification data, a sound source and viewer position data. Processing means, sound source signal generating means in which a sound source signal of music or the like recorded in an anechoic room is recorded in advance, and a convolution integral of the sound source signal output from the sound source signal generating means and the impulse response data is calculated,
An indoor reflected sound generating means for generating an indoor reflected sound signal, an acoustic system for converting the indoor reflected sound signal into an acoustic signal and outputting the acoustic signal, and based on the architectural design specification data, viewer position data, and screen position information. A video signal processing means for calculating projection screen data corresponding to a room image viewed by a viewer from an arbitrary position in the room; and the screen changed by movement of the viewer while synchronizing with the sound signal processing means. A video signal control means for sequentially outputting data, and a video system for projecting an indoor image on a screen based on the screen data supplied from the video signal control means.

[Operation] The present invention newly adds a system for simulating an image of an indoor space viewed from a viewer position (indoor space image synthesizing system) to the conventional indoor sound synthesis system, and temporally combines both of them. By operating in synchronization, it is possible to simulate the sound and the video at an arbitrary listening position in the room in consideration of the movement of the viewer. Therefore,
You can experience the change of sound and video depending on the viewing position at the same time.

Example An example of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of one embodiment of the present invention. Reference numeral 10 denotes a room sound generation system, and reference numeral 50 denotes an indoor space image synthesis system.

The room sound system 10 is an acoustic design CAD system 20
And a sound component 30.

The acoustic design CAD system 20 is a means for inputting architectural design specification data 11 such as room shapes and materials and data 12 such as sound source positions and audience positions, and an acoustic database for storing various acoustic data such as sound absorption of materials. 13 and a computer 14 for calculating room acoustic characteristics and room reflected sound configuration data by a simulation method such as a virtual image method and a sound ray method from these data, and a display unit 15 for displaying the calculated room acoustic characteristics. Be composed. The details of the virtual image method, the sound ray method, and the like are described in the documents described in the section of “Prior Art”.

Here, as the room acoustic characteristics, the spatial characteristics of the reflected sound composed of data such as the direction in which the reflected sound arrives, the temporal characteristics such as tone burst response (echo time), and various characteristics of the reflected sound are quantified. There are physical quantity calculation results and the like.

Further, the room reflected sound configuration data is data that describes the sound of which frequency characteristic reaches the viewer from which direction, at what timing, when a predetermined sound is emitted.

The room reflected sound configuration data is transferred to the acoustic signal processing computer 31. The computer 31 converts the room reflected sound configuration data into multi-channel impulse response data or binaural data according to the reproduction method of the sound generation system, that is, according to the multi-channel sound field reproduction method or the binaural reproduction method.・ Convert to impulse response data and store it in storage device 32
Write to. Note that these reproduction methods will be described later.

The impulse response data is supplied to the indoor reflected sound generator 33. The room reflected sound generation device 33 convolves and integrates the sound source signal output from the sound source signal generation device 34 and converted into a digital signal by the A / D converter 35 with the impulse response data to generate a sound signal. Generates indoor reflected sound signal. Note that music or the like recorded in advance in an anechoic room is used as the sound source signal.

The indoor reflected sound signal generated by the indoor reflected sound generation device 33 is converted into an analog signal by the D / A converter 36, amplified by the power amplifier 37, and output from the speaker 38 or the earphone 39. Thus, a synthesized sound field having acoustic characteristics similar to the actual room sound field is obtained. In addition, in the indoor reflected sound generation device 33, reverberation for simulating a reflected sound in a time domain exceeding the range of the convolution integration is performed simultaneously with the convolution integration.

Next, the configuration of the indoor space image synthesizing system 50 will be described.

The video signal processing computer 51 calculates projection screen data for synthesizing an indoor video as viewed from a viewer. That is, based on the interior surface configuration data (which is a part of the architectural design specification data) transferred from the computer 14, the sound source / viewer position data, and the screen position information in the simulation room, the The screen data which is the basis of the image to be projected on the screen 56 is calculated.

More specifically, screen data is created as follows.

First, by defining the conditions of the screen in the simulation room, that is, the number, position, scale, form, etc. of the screen as basic specifications of the simulation system, the relative relationship between the viewer and the screen is uniquely defined.

Next, in the indoor space configured in the computer 51, a virtual window is set at a position corresponding to the screen in the simulation room viewed from the viewer position. The position of the virtual window is uniquely determined from the visual direction of the viewer and the position of the screen in the indoor space.

Next, when viewed from the viewer, an image (including colors, shadows, and the like) reflected on the virtual window is calculated to obtain screen data. That is, an image created by passing an indoor image through a virtual window and being projected is calculated as screen data of a screen corresponding to each virtual window.

The screen data (projection screen data) thus obtained is
It is stored in the storage device 53 via the video signal system control device 52. The video signal system control device 52 is composed of a personal computer or the like, reads out projection screen data from the storage device 53 and supplies it to the video signal converter 54 in response to a synchronization control signal from the audio signal processing computer 31.

The video signal converter 54 converts the projection screen data into a video signal and supplies it to the projector 55. Projector
55 projects an indoor space image viewed from a viewer on a screen 56 based on the image signal.

In such a configuration, the sound source position and the viewer position are input by the sound source / viewer position specifying means (usually a keyboard) 57. In this case, the viewer position can be specified to change with time. For example, it is possible to specify to move forward one seat per second.

When the above input is completed, the computer for acoustic signal processing
The 31 reads the impulse response data corresponding to the designated viewer position from the storage device 32 and supplies the read impulse response data to the indoor reflected sound generation device 33 and supplies a synchronization control signal to the video signal system control device 52.

Upon receiving the synchronization control signal, the video signal controller 52
The projection screen data corresponding to the designated viewer position is read from the storage device 53 and transferred to the video signal converter 54.

Thus, the room reflected sound generator 33 and the video signal converter 54
The audio signal and the video signal corresponding to the designated viewer position are supplied in synchronization with each other, and are simultaneously output as sound from the speaker 38 (or the earphone 39) and as video from the projector 55.

The above operation is repeatedly executed according to the movement of the designated viewer position, and the simulation of sound and image is performed.

It is ideal that the above-described sound / video simulation is calculated in real time according to a change in a sound source, a viewer position, or the like. However, in the present situation, especially in sound field simulations, it takes considerable computation time, and so-called timing control such as time synchronization between sound and video or continuous display of simulation results calculated in advance is intended. Required.

Storage devices 32 and 53 of FIG. 1, sound source / viewer position designation means
57 and the like are provided for performing these timing controls.

The reproduction method of the sound generation system is roughly classified into two, that is, a multi-channel sound field reproduction method and a binaural reproduction method. In this embodiment, any reproduction method can be used. Hereinafter, these reproduction methods will be described.

The multi-channel sound field reproduction method divides the room space around the viewer into several tens of solid angles, calculates the impulse response of the room reflected sound coming from each direction,
This is a method of reproducing from a speaker arranged at a predetermined position in an anechoic room as a reflected sound representing each direction of the indoor space.

On the other hand, the binaural reproduction method calculates the impulse response (two channels) at the binaural entrance including the influence of the viewer's head and pinna from the room reflected sound data and the head-related transfer function, and converts the obtained acoustic signal into This is a method of reproducing directly by earphone.

As a compromise between the two, the acoustic signal obtained from the impulse response at the binaural entrance is converted from two speakers in the anechoic chamber, including a correction signal for canceling the crosstalk signal reaching the opposite ear. Attempts have also been made to reproduce channels.

FIG. 2 is a plan view showing a specific configuration of the multi-channel sound field reproduction system.

This is an example of a configuration based on a 12-channel sound field reproduction system including six speakers 38A installed in a horizontal plane (elevation angle 0 degrees) and six speakers 38B installed diagonally upward (elevation angle 45 degrees). .

In the case of this multi-channel sound field reproduction system, the anechoicness of the simulation room is an important condition, so use a sound absorbing screen for the screen 56, or use a reflective screen as much as possible. It is required to be smaller.

At this stage, since a high-performance sound absorbing screen has not been put to practical use, a method using only one transmission type (rear projection type) screen (acoustically reflective) has been adopted.

 FIG. 3 shows an example of a configuration based on the viral reproduction method.

In this method, since the room reflected sound signal is directly reproduced to the viewer's ear by the earphone 39, the condition on the acoustic characteristics of the simulation room is gradual, and almost any screen condition can be set.

Specifically, three reflective (front projection) screens
By using the 56 and three projectors 55 installed on the upper ceiling of the viewer, an indoor image simulation with a horizontal field of view of 180 degrees is realized.

[Effects of the Invention] As described above, the present invention simulates an indoor sound field in consideration of not only the acoustic characteristics of a room but also the characteristics of an indoor image viewed from the position of a viewer. In addition, it is possible to realize a simulation of a sound effect including an effect by a video.

This simulation system can also be used as an architectural design support system for a designer or an orderer to confirm the sound and video (interior design) in a completed room at the time of building design with ears and eyes. In addition, it can be used as a psychological experiment device for examining interaction with visual perception and synergistic effects related to evaluation of architectural space.

As a result, the acoustic evaluation of the building space can be easily and inexpensively performed at the design stage.

[Brief description of the drawings]

FIG. 1 is a block diagram showing the configuration of one embodiment of the present invention,
FIG. 2 is a plan view showing a configuration example of the simulation room of the embodiment, and FIG. 3 is a plan view showing another configuration example of the simulation room of the embodiment. 10 …………………………………………………………………………………………………………………………………………………… chido memorial equipment which is easy to use.
38 …… speaker, 39 …… earphone, 50 …… indoor space video synthesis system, 51 …… video signal processing computer, 52
…… Video signal system control device, 53 …… Storage device, 54 …… Video signal converter, 55 …… Projector, 56 …… Screen,
57… Sound source / viewer position designation means.

Claims (1)

(57) [Claims] 1. An acoustic signal processing means for calculating an impulse response at a viewer position in a room sound field based on architectural design specification data, a sound source and viewer position data, and a sound source signal such as music recorded in an anechoic room. Sound source signal generating means in which the sound source signal output from the sound source signal generating means and the impulse response data are convoluted and integrated to generate an indoor reflected sound signal; Based on the acoustic system that converts the reflected sound signal into an acoustic signal and outputs the same, based on the architectural design specification data, the viewer position data, and the screen position information, the viewer corresponds to an indoor image viewed from an arbitrary position in the room. Video signal processing means for calculating projection screen data to be processed, and before changing by the movement of the viewer while synchronizing with the audio signal processing means. Room audio / video simulation comprising: video signal control means for sequentially outputting screen data; and a video system for projecting an indoor image on a screen based on the screen data supplied from the video signal control means. system.