JP2015050493A - Information processing unit, av receiver, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve an information processing unit that provides information that a user can intuitively understand that what pseudo reflected sound is generated.SOLUTION: In a space having a hearing position G as an original point, a voice analyzing section 201 uses, as a distance D, a delay time from a direct sound included in sound field effect information, and displays an image of a pseudo reflected sound in a position determined by a direction from the hearing position G. The size L of the image of a pseudo reflected sound is changed according to the ratio of the level of reflected sound to the level of direct sound. Using input of a predetermined level or higher as direct sound, the voice analyzing section 201 calculates the display position of pseudo reflected sound, and generates an image of the pseudo reflected sound in a calculated display position. For example, if an R channel, L channel, and C channel for an input audio signal simultaneously receive input of a predetermined level or higher, a display position calculated from these direct sounds and the image 501 of a pseudo reflected sound corresponding to the level are generated.

Description

  The present invention relates to an information processing apparatus that is connected to a device that imparts a sound field effect to an audio signal or is built in the device.

  Conventionally, there has been proposed a sound field control device that imparts a sound field effect to the sound of content (see, for example, Patent Document 1). The sound field effect is the reproduction of simulated reflection sound that simulates the reflection sound generated in an acoustic space such as a concert hall, so that you can feel like you are in another space such as an actual concert hall while staying in the room. The listener can experience this.

  FIG. 8 is a conceptual diagram for explaining the sound field effect. FIG. 8A is an arrangement diagram of speakers connected to the sound field control device, and FIG. 8B is an image diagram of the sound source distribution of the direct sound and the pseudo-reflected sound when the sound with the sound field effect is reproduced. FIG. 8C is a diagram showing an impulse response of a certain acoustic space (a graph showing the generation time and level of the direct sound and the pseudo reflection sound).

  First, as shown in FIG. 8A, the sound field control device has a volume and arrival timing of reproduced sounds from a plurality (five in this example) of speakers SP1 to SP5 installed around the listening position J. The gain and delay amount of the signal supplied to each speaker are adjusted in advance so as to be equivalent at the listening position J.

  Then, the sound field control device generates a signal corresponding to the pseudo reflection sound from the input audio signal based on the sound field effect information corresponding to the acoustic space (for example, concert hall) selected by the user, and the original audio Append to signal. The sound field effect information includes information indicating the impulse response of the reflected sound group generated in a certain acoustic space (see FIG. 8C) and the sound source position of the reflected sound group. Based on the sound field effect information, the sound field control device changes the gain ratio and the delay amount of the signal supplied to each speaker, and as shown in FIG. Is generated.

Japanese Patent No. 2755208

  However, it is difficult for the user to intuitively understand what pseudo-reflected sound is generated for the acoustic space to be selected (how much pseudo-reflected sound comes from which direction).

  Therefore, an object of the present invention is to realize an information processing apparatus that provides information that allows a user to intuitively understand what kind of pseudo-reflected sound is generated.

  The information processing apparatus according to the present invention obtains information indicating a listening environment and generates a video corresponding to the current listening environment based on the information indicating the listening environment, and pseudo-reflection on the audio signal. Sound field effect information for providing sound is acquired, and based on information indicating the sound source position, generation timing, and level of the pseudo-reflected sound included in the sound field effect information, video corresponding to the listening environment is displayed. Sound field effect image generation means for superimposing an image of the pseudo-reflected sound.

  As described above, the information processing apparatus of the present invention acquires information indicating the listening environment (for example, information indicating the size of the room), and schematically shows the listening environment (for example, a video showing the room in three dimensions). ) Is generated. The generated video is displayed on the display device of the device itself, or output to another display device as a video signal and displayed on the other display device. As the information indicating the listening environment, for example, information selected by the user from a plurality of templates is acquired. Or, output the measurement sound (noise sound, etc.) from the speaker installed in the listening environment, and pick up the sound with the microphone installed at the listening position, measure the transfer characteristics of the listening environment, and use the measurement results to determine the listening environment (room) May be estimated.

  And since the image | video of a pseudo reflection sound is superimposed and displayed on the image | video of such a room, a user can understand intuitively what kind of pseudo reflection sound is produced | generated.

  The sound field effect image generating means preferably changes the image of the pseudo reflection sound based on information indicating the sound source position, generation timing, and level of the pseudo reflection sound included in the sound field effect information. The sound field effect information includes an orientation from the listening position (information indicating a horizontal angle and a vertical angle) as a sound source position, a delay time from the direct sound, and a ratio of the reflected sound level to the direct sound level. Therefore, the sound field effect image generating means displays the image of the pseudo reflected sound at a position determined by the azimuth and distance from the listening position, with the delay time as the distance, in the three-dimensional space having the listening position as the origin, and according to the level. To change the magnitude of the pseudo reflection sound.

  Further, the information indicating the listening environment includes information indicating the arrangement of the speakers in the listening environment, and the listening environment video generation means displays the video corresponding to the speaker arrangement in the video corresponding to the listening environment. Is preferred.

  In addition, by superimposing the image of the acoustic space corresponding to the sound field effect information on the image corresponding to the listening environment, what kind of acoustic space is reproduced by the sound field effect may be presented. .

  The information processing apparatus according to the present invention includes an audio signal processing unit that outputs a pseudo reflection sound to an audio signal, and a video signal output unit that outputs a video signal corresponding to a listening environment. It may be a function built in the computer, or may be realized as a program executed by an information processing apparatus such as a smartphone or a personal computer.

  According to the present invention, the user can intuitively understand what kind of pseudo-reflected sound is generated.

It is the block diagram which showed the structure of the audio system. It is the figure which showed the functional block diagram of AV receiver and a user terminal. It is the figure which showed the measurement result (time axis) of the measurement sound. It is the figure which showed the frequency characteristic. FIG. 5A is an image schematically showing a listening environment, and FIG. 5B is a diagram showing an image of an acoustic space. FIG. 6A is a diagram in the case where the image of the acoustic space is superimposed on the image schematically showing the listening environment, and FIG. 6B is a diagram in the case where the image of the direct sound and the pseudo reflected sound is superimposed. is there. It is a figure explaining the method of producing | generating the image | video of a pseudo reflection sound. It is a conceptual diagram for demonstrating a sound field effect.

  FIG. 1A is a block diagram illustrating a configuration of an audio system including the information processing apparatus of the present invention. FIG. 1B is a schematic view of the listening environment in plan view. The audio system includes an AV receiver 1, a user terminal 2, a microphone 3, a content reproduction device 5, a display device 7, and a plurality of speakers 10 (speaker 10L, speaker 10R, speaker 10SL, speaker 10SR, and speaker 10C). .

  The plurality of speakers 10 are installed around the listening position G in the listening environment. In this example, the speaker 10C is installed in front of the listening position (hereinafter, the front of the listening position is set to 0 ° azimuth and is set to a positive angle in the clockwise direction), and right front of the listening position (45 ° azimuth). The speaker 10R is installed at the right rear (135 ° azimuth) of the listening position, the speaker 10SL is installed at the left rear (225 ° azimuth) of the listening position, and the left front (315) of the listening position. A mode in which the speaker 10L is installed in the direction (°).

  The AV receiver 1 includes an input unit 11, a DSP 12, a video processing unit 13, a CPU 14, a memory 15, an output unit 16, and a network I / F 17.

  The input unit 11 receives content data from the content reproduction device 5, outputs an audio signal extracted from the content data to the DSP 12, and outputs a video signal extracted from the content data to the video processing unit 13. Note that the input unit 11 can individually input an audio signal and a video signal from external devices, and also has a function of converting an analog signal into a digital signal when the analog signal is received.

  The CPU 14 reads a program stored in the memory 15 and controls the input unit 11, DSP 12, video processing unit 13, and network I / F 17.

  The video processing unit 13 corresponds to a video signal output unit, and performs predetermined processing (for example, upscaling processing) on the video signal input from the input unit 11 and outputs the video signal to the display device 7 under the control of the CPU 14.

  The DSP 12 corresponds to an audio signal processing unit, and performs predetermined processing on the audio signal input from the input unit 11 under the control of the CPU 14. Here, a case where a sound field effect is applied will be described.

  FIG. 2 is a functional block diagram of the AV receiver 1 and the user terminal 2. The sound field effect applying unit 101, the listening environment measuring unit 102, and the adder 103 of the AV receiver 1 are realized by the DSP 12. The sound field effect applying unit 101 generates a pseudo reflected sound from the input audio signal. The pseudo reflected sound generated by the sound field effect applying unit 101 is added to the original audio signal by the adder 103 and output.

  The pseudo reflected sound is generated based on the sound field effect information stored in the memory 15. The sound field effect information includes information indicating an impulse response of a reflected sound group generated in a certain acoustic space and a sound source position of the reflected sound group. Specifically, information indicating the azimuth (horizontal azimuth and vertical azimuth) from the listening position of each pseudo-reflected sound, delay time from the direct sound (information indicating the generation timing), and the level of the reflected sound relative to the level of the direct sound The information indicating the ratio (information indicating the level) is included.

  The sound field effect providing unit 101 reads out sound field effect information corresponding to the sound field effect selected by the user from the memory 15, and based on the read sound field effect information, determines the distribution gain ratio of the audio signal supplied to each speaker. By changing, a pseudo reflected sound is generated. For example, as shown in FIG. 1B, in the case where a pseudo reflected sound is generated on the left side (270 ° horizontal orientation) of the listening position G, the two speakers 10L and 10SL closest to the sound source position are given predetermined sounds. An audio signal is supplied with a delay amount and a predetermined gain ratio (eg, 1: 1). In FIG. 1B, a plan view is shown and only the horizontal direction has been described. Similarly, in the vertical direction as well, a pseudo reflected sound is generated by supplying audio signals to the two speakers 10 closest to the sound source position. be able to. However, when all the speakers 10 are at the same height, the vertical orientation is not considered. When the audio signal input from the input unit 11 is multi-channel, the sound field effect imparting unit 101 generates a pseudo reflected sound from a signal mixed down to a monaural signal.

  Returning to FIG. 1A, the output audio signal of the DSP 12 is input to the output unit 16. The output unit 16 outputs the output audio signal to the speaker 10L, the speaker 10R, the speaker 10SL, the speaker 10SR, and the speaker 10C.

  Then, the audio system of this embodiment generates an image (see FIG. 5A) schematically showing the listening environment, and an image corresponding to the pseudo reflected sound generated by the sound field effect applying unit 101. By superimposing the image of the acoustic space corresponding to the sound field effect information (see FIG. 5B) (see FIG. 6B), what kind of acoustic space is reproduced and what kind of simulation The user can intuitively understand whether the reflected sound is generated.

  Such a video is generated by the user terminal 2 and displayed on the display device (here, the touch panel 24) of the user terminal 2.

  The user terminal 2 is an information processing apparatus such as a smartphone or a personal computer, and includes a network I / F 21, a CPU 22, a memory 23, and a touch panel 24. The AV receiver 1 and the user terminal 2 are connected via a network I / F 17 and a network I / F 21.

  The CPU 22 reads a program from the memory 23 and controls the network I / F 21 and the touch panel 24. As illustrated in FIG. 2, the user terminal 2 functionally executes a voice analysis unit 201, a listening environment analysis unit 202, and a display unit 203 according to the program.

  First, the listening environment analysis unit 202 will be described. The listening environment analysis unit 202 corresponds to the listening environment image generation means of the present invention, acquires information indicating the listening environment (for example, information indicating the size of the room), and an image (for example, a room) schematically showing the listening environment Is generated in a three-dimensional manner.

  The information indicating the listening environment is obtained, for example, by displaying a plurality of templates on the touch panel 24 and selecting a template close to the listening environment from the displayed templates. The template is, for example, an image 200 that three-dimensionally represents a room as shown in FIG. The selected template is generated as an image 200 corresponding to the current listening environment. Video 200 corresponding to the generated listening environment is output to display unit 203.

  Note that the listening environment measurement unit 102 of the AV receiver 1 outputs measurement sound (white noise or the like) from the speaker 10 and picks up the measurement sound with the microphone 3 installed at the listening position G, thereby transmitting the listening environment transfer characteristics. It is also possible to estimate the listening environment (room size, etc.) by receiving the measurement result, or to narrow down the template from the estimated listening environment.

  For example, as shown in FIG. 3A, the listening environment measuring unit 102 of the AV receiver 1 includes an elapsed time from when the measurement sound is output from the speaker 10 until a signal of a predetermined level or more is input from the microphone 3, and each signal. Information indicating the sound pressure level is output to the listening environment analysis unit 202 of the user terminal 2 as a measurement result. The high level signal with the shortest elapsed time is regarded as a direct sound from the speaker 10 to the microphone 3. A high-level signal observed after the direct sound is regarded as a reflected sound that reaches the microphone 3 after the measurement sound output from the speaker 10 is reflected on the wall surface of the room. The listening environment measurement unit 102 performs such measurement for all the speakers 10.

  Note that the AV receiver 1 makes the arrival timing of the sound output from each speaker 10 and the volume of the reproduced sound equal at the listening position G based on the elapsed time and sound pressure level of the signal corresponding to the direct sound. In addition, the gain and delay amount of the signal supplied to each speaker 10 can be adjusted in advance.

  The listening environment analysis unit 202 estimates the listening environment based on the reflected sound group of the received measurement results. For example, the reflected sound group in FIG. 3B has a longer interval between the reflected sounds and a smaller number of reflected sounds than the reflected sound group in FIG. Thus, when the interval between the reflected sounds is long and the number of reflected sounds is small, it can be estimated that the speaker 10 and the microphone 3 are far away from the wall surface and the like and the room is wide. Therefore, the listening environment analysis unit 202 can estimate the size of the room based on the measurement result of each speaker 10. The listening environment analysis unit 202 displays a template corresponding to the estimated room size on the touch panel 24. For example, since the measurement results of the speaker 10R and the speaker 10SR correspond to the distance to the right wall, if it is determined that the distance to the right wall estimated from the measurement results of the speaker 10R and the speaker 10SR is long, A template having a long distance to the wall surface is displayed on the touch panel 24.

  The listening environment analysis unit 202 can also analyze the frequency characteristics obtained from the measurement results and estimate the wall material and the like. For example, when a flat frequency characteristic as shown in FIG. 4 (A) has a frequency characteristic that attenuates a high frequency as shown in FIG. 4 (B), a material having a high sound absorption property such as a curtain is formed on the wall surface. It can be judged that it is arranged. This determination is also made based on the measurement result of each speaker 10. For example, when the listening environment analysis unit 202 analyzes the frequency characteristics of the measurement results of the speaker 10R and the speaker 10SR and determines that a curtain having a high sound absorption property is disposed on the right wall of the listening position, the listening environment analysis unit 202 The curtain image is superimposed on the right side of the position and displayed on the touch panel 24.

  Of the measurement results received from the AV receiver 1, the elapsed time and the sound pressure level of the signal corresponding to the direct sound correspond to information indicating the arrangement of the speakers in the listening environment. Therefore, as shown in FIG. 5A, the listening environment analysis unit 202 includes a speaker image 202L, a speaker image 202R, and a speaker schematically representing the speaker 10L, the speaker 10R, the speaker 10SL, the speaker 10SR, and the speaker 10C, respectively. Video 202SL, speaker video 202SR, and speaker video 202C are displayed. In this example, a screen 205 corresponding to the display device 7 is also displayed. However, displaying an image corresponding to such a speaker arrangement or an image corresponding to a display device is not an essential configuration in the present invention.

  The display unit 203 superimposes the image of the acoustic space corresponding to the sound field effect provided by the sound field effect applying unit 101 on the image 200 corresponding to the listening environment generated as described above. For example, an image of a concert hall 301 having a stage 302 and a guest seat 303 as shown in FIG. 5B is read from the memory 23, and a superimposed image as shown in FIG. 6A is created. The display unit 203 further superimposes a pseudo reflected sound image 501 (a circular icon in this example) as shown in FIG. 6B on the superimposed image. The image of the pseudo reflection sound is generated by the sound analysis unit 201.

  The sound analysis unit 201 corresponds to the sound field effect image generation means of the present invention, and generates a pseudo reflected sound image based on the sound field effect information received from the sound field effect applying unit 101. FIG. 7 is a diagram for explaining a method of generating a pseudo reflected sound image.

  The voice analysis unit 201 uses the delay time from the direct sound included in the sound field effect information as the distance D in the space having the listening position G as the origin (in this example, a three-dimensional space). The image of the pseudo reflected sound is displayed at a position determined by the azimuth θ (front is 0 °) and the vertical azimuth φ (horizontal is 0 °). The image size L of the pseudo reflected sound is changed according to the ratio of the level of the reflected sound to the level of the direct sound. Then, the audio analysis unit 201 inputs an audio signal from the AV receiver 1, and when the audio signal is input at a predetermined level or higher, the sound analysis unit 201 uses the input at the predetermined level or higher as a direct sound to display the pseudo reflected sound display position. And an image of pseudo reflection sound is generated at the calculated display position.

  For example, as shown in FIG. 6B, when the input audio signal has R channel, L channel, and C channel having inputs of a predetermined level or more at the same time, direct sound images 401R, L corresponding to the R channel are provided. The direct sound image 401L corresponding to the channel and the direct sound image 401C corresponding to the C channel are generated, and the pseudo reflection corresponding to the display position and the level calculated from these direct sounds (mixed down signals). A sound image 501 is generated. Although shown as a still image in FIG. 6B, the pseudo reflection sound with respect to the direct sound changes every moment and is displayed as an animation.

  It is not essential to display a direct sound image. In addition, when displaying a direct sound image, it is preferable that the direct sound image and the pseudo reflected sound image be different (for example, different colors).

  The images of the direct sound and the pseudo reflected sound generated as described above are output to the display unit 203. The display unit 203 superimposes the images of the direct sound and the pseudo-reflected sound on the image corresponding to the listening environment, the image indicating the arrangement of the speakers, and the image of the acoustic space corresponding to the sound field effect.

  The video generated as described above is displayed on the touch panel 24 of the device itself, or is output as a video signal to another display device (for example, AV receiver 1), and connected to the other display device (AV receiver 1). Displayed on the display device 7).

  Thereby, the user can intuitively understand what acoustic space is reproduced and what kind of pseudo-reflected sound is generated.

  In this example, a circular icon is shown as an image showing the direct sound and the pseudo-reflected sound. However, other images (for example, images such as vectors and clouds) may be displayed. Further, as an image showing frequency characteristics, a vector from the sound source position to the listening position may be displayed in the case of a high sound, and an icon that extends in a circular shape from the sound source position may be displayed in the case of a low sound.

  In the present embodiment, the audio analysis unit 201, the listening environment analysis unit 202, and the display unit 203 are executed by the program of the user terminal 2, but may be executed by the AV receiver 1 or a personal computer. It may be executed in other information processing terminals such as.

DESCRIPTION OF SYMBOLS 1 ... AV receiver 2 ... User terminal 3 ... Microphone 5 ... Content reproduction apparatus 7 ... Display apparatus 10L, 10R, 10SL, 10SR, 10C ... Speaker 11 ... Input part 12 ... DSP
13 ... Video processing unit 14 ... CPU
15 ... Memory 16 ... Output unit 22 ... CPU
DESCRIPTION OF SYMBOLS 23 ... Memory 24 ... Touch panel 101 ... Sound field effect provision part 102 ... Listening environment measurement part 103 ... Adder 201 ... Speech analysis part 202 ... Listening environment analysis part 203 ... Display part

Claims (6)

Listening environment video generation means for acquiring information indicating the listening environment and generating a video corresponding to the current listening environment based on the information indicating the listening environment;
Sound field effect image generating means for acquiring sound field effect information for giving a pseudo reflection sound to an audio signal and superimposing a pseudo reflection sound image on an image corresponding to the listening environment based on the sound field effect information When,
An information processing apparatus comprising:   The sound field effect image generating means changes the image of the pseudo reflection sound based on information indicating a sound source position, generation timing, and level of the pseudo reflection sound included in the sound field effect information. The information processing apparatus according to claim 1. The information indicating the listening environment includes information indicating the arrangement of speakers in the listening environment,
The information processing apparatus according to claim 1, wherein the listening environment image generation unit displays an image corresponding to an arrangement of speakers in the image corresponding to the listening environment.   The information processing apparatus according to claim 1, wherein an image of an acoustic space corresponding to the sound field effect information is superimposed on an image corresponding to the listening environment. An information processing apparatus according to any one of claims 1 to 4,
A sound field effect applying unit that generates a pseudo-reflected sound from the audio signal and applies the pseudo reflected sound to the audio signal;
A video signal output unit for outputting a video signal corresponding to the listening environment;
An AV receiver characterized by comprising: Obtaining information indicating the listening environment, and generating a video corresponding to the current listening environment based on the information indicating the listening environment;
Obtaining sound field effect information for giving a pseudo-reflected sound to an audio signal, and based on the information indicating the sound source position, generation timing, and level of the pseudo-reflected sound included in the sound field effect information, the listening environment A sound field effect image generation step of superimposing a pseudo reflection sound image on an image corresponding to
A program characterized by causing an information processing apparatus to execute.