JP2010105643A - Audio processing device and audio processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an audio processing device and an audio processing method capable of preventing motion sickness through sound even under conditions where a passenger does not view an image. <P>SOLUTION: The audio processing device processes an audio signal to be output to each speaker in a moving body having an audio field space formed by amplification through a plurality of speakers, obtains information relating to the behavior of the moving body, and controls a fixed position of the sound and image depending on the information relating to the behavior of the moving body. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technical field such as an apparatus and a method for performing processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by loud sound of a plurality of speakers.

  In an environment where shaking occurs like a moving body such as a vehicle, the passenger may become motion sickness. In particular, when an occupant sees an image from a TV tuner, a DVD playback device, or the like mounted on a moving body on a display in an environment in which shaking occurs, it tends to cause motion sickness.

In Patent Document 1, by displaying an image that changes according to the movement of the moving body on the display, the passenger can see visual information that matches the movement of the moving body. Techniques have been proposed that can prevent inconsistencies that can be felt and prevent motion sickness.
Japanese Patent Laid-Open No. 2005-294554

  By the way, even when the occupant is not viewing the video, for example, when the vehicle is traveling on a curve, or when the vehicle suddenly stops or starts suddenly, the occupant has a gravitational acceleration (G ), It tends to cause motion sickness. However, in the conventional technology, it was difficult to prevent motion sickness under such circumstances.

  Therefore, an example of the problem of the present application is to provide a voice processing device, a voice processing method, and the like that can prevent motion sickness through sound even when a passenger is not watching a video.

  In order to solve the above-described problem, the invention according to claim 1 is an audio processing device that performs processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by loud sound of a plurality of speakers. And the acquisition means which acquires the information regarding the behavior of the said mobile body, The sound image localization control means which controls the localization position of a sound image based on the information regarding the behavior of the said mobile body is provided, It is characterized by the above-mentioned.

  The invention according to claim 9 is an audio processing method for performing processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by loud sound of a plurality of speakers, wherein the moving body And a step of controlling the localization position of the sound image based on the information on the behavior of the moving body.

  The invention of a sound processing program according to claim 10 is a computer that performs processing on a sound signal to be output to each speaker in a moving body having a sound field space formed by loud sound of a plurality of speakers. It is made to function as a sound image localization control means for controlling the localization position of the sound image based on the acquisition means for acquiring information related to the behavior of the moving object and the information related to the behavior of the moving body.

  Hereinafter, the best embodiment of the present application will be described with reference to the accompanying drawings. The embodiment described below is an embodiment in the case where the audio processing device of the present application is applied to an audio reproduction device mounted on a vehicle as a moving body having a sound field space.

  In the present embodiment, speakers are installed at four positions on the front right side, front left side, rear right side, and rear left side in the vehicle (for example, all near the door). A sound field space is formed. FIG. 1 shows the positional relationship of each speaker in the vehicle. Hereinafter, the speaker at the front right position is referred to as the FR speaker, the speaker at the front left position is referred to as the FL speaker, the speaker at the rear right position is referred to as the RR speaker, and the speaker at the rear left position is referred to as the RL speaker.

  Next, the configuration and function of the audio playback device according to the present embodiment will be described with reference to FIG.

  FIG. 2 is a diagram illustrating a schematic configuration example of the audio reproduction device according to the present embodiment.

  As shown in FIG. 2, the audio playback device 1 includes an audio playback unit 11, an audio processing unit 12, a G (gravity acceleration) sensor 13, a GPS (Global Positioning System) receiver 14, a control unit 15, and an operation unit 16. The sound signal to be output to each speaker is processed. In addition, operation information of operation devices (for example, steering (steering wheel), accelerator, brake, etc.) operated by the driver of the vehicle is input to the audio playback device 1 from the in-vehicle device sensor via the I / F 17. It has become.

  The audio reproducing unit 11 reproduces audio data from a recording medium (for example, a CD (Compact Disc), a card type recording medium, etc.) on which audio data is recorded. The audio playback unit 11 may be a hard disk drive.

  The audio processing unit 12 is configured by a DSP (Digital Signal Processor) or the like, and performs predetermined audio processing such as demodulation processing on the audio data reproduced by the audio reproduction unit 11, and thereby an FR speaker, an FL speaker, and an RR. After generating audio signals for four channels for the speaker and the RL speaker, the signal level (that is, volume) of each audio signal is adjusted and output to each speaker.

  The G sensor 13 detects the size of G in the front-rear direction and the size of G in the left-right direction received by a passenger of the vehicle. While the vehicle is stopped, the passenger receives 1G from the earth, but receives a lateral G (in other words, centrifugal force) toward the outside while the vehicle is traveling on a curve or the like. The G sensor 13 detects such G and outputs information indicating the size and direction to the control unit 15.

  The GPS receiver 14 receives navigation radio waves output from GPS satellites arranged in the satellite orbit and orbiting the earth via an antenna (not shown), and based on the received signals, the current position (longitude and latitude) ) And outputs information indicating the current position to the control unit 15.

  The control unit 15 includes a CPU, a ROM, a RAM, a non-volatile memory, and the like. The control unit 15 performs overall control of the entire audio reproduction device 1 according to an operation instruction from the user (passenger) through the operation unit 16, and for example, By executing the sound processing program of the present application stored in the ROM, it functions as an acquisition means and a sound image localization control means.

  Specifically, the control unit 15 acquires information related to the behavior of the vehicle and controls the localization position of the sound image based on the information related to the behavior of the vehicle. For example, the localization position of the sound image is shifted from the reference position to the right side or the left side. Move. The control of the localization position of the sound image is performed by adjusting the volume and output timing of each audio signal. For example, the volume of the audio signal to be output to the FR speaker is increased while the volume of the audio signal to be output to the FL speaker is decreased. As a result, the localization position of the sound image changes.

  Here, as the information regarding the behavior of the vehicle, for example, information indicating the size and direction of G acquired from the G sensor 13 can be used. In this case, for example, the control unit 15 decreases the volume of the audio signal to be output to the speaker installed in the direction in which G is applied (the direction in which the occupant is inclined) by an amount corresponding to the size of G. The localization position of the sound image is changed by increasing the volume of the audio signal to be output to the speaker installed on the opposite side of the direction by an amount corresponding to the magnitude of G.

  Alternatively, the control unit 15 reduces the volume of an audio signal to be output to a speaker installed in the direction in which G is applied by an amount corresponding to the size of G, and is installed on the opposite side to the direction in which G is applied. The localization position of the sound image may be changed by keeping the volume of the audio signal to be output to the speaker as it is. The nonvolatile memory in the control unit 15 stores in advance information related to the installation positions of the FR speaker, FL speaker, RR speaker, and RL speaker in the vehicle.

  FIG. 3 is a diagram illustrating the relationship between the magnitude of G applied in a certain direction and the adjustment amount of the volume of the audio signal. In the example of FIG. 3, only one direction is shown as the direction G for simplicity, but each direction (for example, the right direction, the left direction, the front (traveling) direction, and the rear (retreating) direction) There is such a relationship.

  Here, the large adjustment amount of the volume of the audio signal means that the increase or decrease of the volume of the audio signal is large. For example, as G applied to the right increases, the amount of decrease in volume of the audio signal to be output to the FR speaker and RR speaker installed in the same direction increases, and the FL speaker and RL installed in the opposite direction increase. The increase amount of the volume of the audio signal to be output to the speaker increases. Alternatively, as G applied in the backward direction increases, the amount of decrease in the volume of the audio signal to be output to the RR speaker and the RL speaker installed in the same direction increases, and the FR speaker and FL installed in the opposite direction increase. The increase amount of the volume of the audio signal to be output to the speaker increases.

  As shown in FIG. 3, such a relationship can be represented by a straight line 51 (that is, a proportional relationship), a quadratic curve 52, or a quadratic curve 53. Specifically, such a relationship is defined. Calculation formulas (functions), tables, and the like are stored in advance in a nonvolatile memory in the control unit 15. The control unit 15 controls the localization position of the sound image using the calculation formula (function) and the table stored in this way. Note that the user can arbitrarily select which relationship of the straight line 51, the quadratic curve 52, and the quadratic curve 53 is used.

  Further, as shown in FIG. 3, a dead zone is set in which the adjustment amount is “0” when G is smaller than the threshold value. That is, the control unit 15 controls the localization position of the sound image when the magnitude of G is equal to or greater than the threshold value. The reason why the dead zone is provided in this way is that if the localization position of the sound image is frequently changed under a moderate shaking condition, it may lead to an adverse effect. This dead zone can be changed by the user arbitrarily selecting a threshold value.

  Also, in the dead zone, the localization position of the sound image is not controlled. For example, the adjustment rate is increased in accordance with an increase in G (decreasing the sensitivity), or the adjustment amount is increased step by step. Also good.

  When G is applied in the left-right direction, the volume of each audio signal to be output to the rear RR speaker and the RL speaker is determined based on the volume adjustment amount of each audio signal to be output to the front FR speaker and the FL speaker. You may comprise so that adjustment amount may be enlarged. This is because the passenger sitting in the rear seat is more susceptible to changes in the behavior of the vehicle, for example, it is difficult to deal with because the forward visibility is poor and it is difficult to cope with it. Moreover, you may comprise so that variable control, such as reversing polarity by a front seat and a back seat, may be performed.

  In addition, as described above, the dead zone is provided as a method of masking the trigger to be controlled. As another example, a value obtained by averaging G sampled by the G sensor 13 for a certain period of time is used as the magnitude of G. You may do it.

  If the sampling period is too short, noise components are picked up. As a method of avoiding this, there are a method of taking a sampling period as long as 500 msec and a method of judging whether a certain threshold value has been exceeded for a certain period of time.

  Depending on the passenger's situation, the direction of G and the direction of volume increase / decrease may be more effective. For example, the driver should be out of phase with the other passengers because the body is fixed.

  Further, not only the G sensor 13 but also a gyro sensor or a geomagnetic sensor may be used to detect rotation and control the localization position of the sound image according to the rotation direction.

  Next, a processing example related to the localization position control of the control unit 15 will be described with reference to FIGS. 4 and 5.

  4 and 5 are flowcharts showing a processing example related to the localization position control of the control unit 15 when information indicating the size and direction of G is used. FIG. 4 is a flowchart illustrating the first embodiment, and FIG. Example 2.

  Note that the processing shown in FIGS. 4 and 5 is started, for example, when an audio playback instruction is given through the operation unit 16 from the user. According to the audio playback instruction, for example, a volume previously selected by the user is set in the audio processing unit 12 (hereinafter referred to as “initial setting”), and an audio signal corresponding to the audio data played back from the audio playback unit 11 is The audio processing unit 12 outputs to each speaker at the initially set volume. Further, at this initial stage, that is, before the sound image localization position control, the volume of the audio signal to be output to the FR speaker, FL speaker, RR speaker, and RL speaker is, for example, a volume that is initially adapted to the environment. (Volume corresponding to each speaker position). Note that the volume of audio signals output to the speakers for four channels may be set to be the same.

Example 1
First, in the process shown in FIG. 4 according to the first embodiment, first, the control unit 15 acquires (stores in RAM) information indicating the magnitude and direction of G output from the G sensor 13 (step S1).

  Next, the control unit 15 determines whether or not the magnitude of G obtained from the G sensor 13 is greater than or equal to the first threshold (step S2), and if it is greater than or equal to the first threshold (step S2). : YES), the direction of G is specified, and the process proceeds to step S3. If it is not equal to or greater than the first threshold (that is, the dead zone) (step S2: NO), the process returns to step S1.

  In step S3, the control unit 15 specifies the speaker for decreasing the volume and the speaker for increasing the volume based on the direction G that is equal to or greater than the first threshold, and the calculation formula stored in the nonvolatile memory. Alternatively, the adjustment amount (increase or decrease) of the volume of the audio signal for each speaker is calculated using a table or the like. Note that the volume adjustment amount of the audio signal to one of the left and right speakers may be “0”.

  Next, the control unit 15 gives an adjustment command including information indicating the association between each speaker and the adjustment amount to the audio processing unit 12 (step S4). Thus, the audio processing unit 12 sets a new volume by adding or subtracting the adjustment amount included in the adjustment command to the volume related to the initial setting of the audio signal for each speaker, and sets each speaker at the volume. An audio signal is output with respect to.

  Next, the control unit 15 determines whether or not the magnitude of G is smaller than the first threshold value (step S5). If the magnitude is smaller than the first threshold value (step S5: YES), step 6 is performed. If it is not smaller than the first threshold (step S5: NO), the process returns to step S3.

  In step S6, the control unit 15 gives an adjustment amount reset (initialization) command to the audio processing unit 12, and returns to step S1. As a result, the audio processing unit 12 returns the volume of the audio signal for each speaker to the initial setting (returns to the state before the automatic localization position control), and the audio signal is output to each speaker at the initial setting volume. Will be output.

  Thereafter, such processing is repeatedly performed until, for example, audio reproduction ends.

(Example 2)
First, the control part 15 acquires the information which shows the magnitude | size and direction of G output from the G sensor 13 (step S11).

  Next, the control unit 15 determines whether or not the magnitude of G obtained from the G sensor 13 is greater than or equal to the first threshold (step S12), and if it is greater than or equal to the first threshold (step S12). : YES), the direction of the G is specified, and the process proceeds to step S13. If it is not equal to or greater than the first threshold (that is, the dead zone) (step S12: NO), the process proceeds to step S14.

  In step S14, the control unit 15 gives an adjustment amount reset (initialization) command to the audio processing unit 12, and the process returns to step S11.

  In step S13, as in step S3, the control unit 15 specifies a speaker for decreasing the volume and a speaker for increasing the volume based on the direction G that is equal to or greater than the first threshold, and each speaker. The amount of adjustment of the volume of the audio signal with respect to is calculated.

  Next, as in step S4, the control unit 15 gives an adjustment command including information indicating the association between each speaker and the adjustment amount to the audio processing unit 12 (step S15).

  Next, the control unit 15 acquires information indicating the size and direction of the G output from the G sensor 13 (step S16), and determines whether or not the size of the G is greater than a second threshold value. (Step S17), when it becomes larger than the second threshold (Step S17: YES), it returns to Step 16, and when it is not larger than the second threshold (Step S17: NO), it goes to Step S11. Return. The relationship between the first threshold and the second threshold is “first threshold <second threshold”.

  Thereafter, such processing is repeatedly performed until, for example, audio reproduction ends.

  As described above, according to the above-described embodiment, the audio reproduction device 1 is configured to acquire information related to the behavior of the vehicle and control the localization position of the sound image based on the information related to the behavior of the vehicle. Even when the passenger is not watching the video, it is possible to more effectively prevent motion sickness through sound.

  In particular, by using information indicating the magnitude and direction of the G detected by the G sensor 13 as information on the behavior of the vehicle, the optimum position corresponding to the actual magnitude of the shake (that is, the sense of the shake is reduced). The sound image can be localized at the position where

  In addition, you may comprise so that the operation information of the operating devices (for example, steering (handle), an accelerator, a brake) operated by the driver | operator of a vehicle may be utilized as information regarding the behavior of a vehicle. In this case, the control unit 15 acquires the operation information from the in-vehicle device sensor via the I / F 17, and controls the localization position of the sound image based on the operation information. For example, since the left and right G can be estimated from the steering angle, etc., the speaker for decreasing the volume and the speaker for increasing the volume are identified and the audio signal for each speaker can be specified. The amount of volume adjustment is calculated. Further, since the G in the front-rear direction can be estimated from the accelerator signal, the brake signal, and the like, this enables to specify the speaker that decreases the volume and the speaker that increases the volume, as in the above-described embodiment. The adjustment amount of the volume of the audio signal is calculated.

  Moreover, you may comprise so that the road information in the advancing direction from the present position of the vehicle measured by the GPS receiving part 14 may be utilized as information regarding the behavior of a vehicle. In this case, the control unit 15 acquires information indicating the current position of the vehicle from the GPS receiving unit 14, and further, from the map data (for example, stored in a hard disk not shown) used in the navigation function, from the current position of the vehicle. Get road information in the direction of travel. Then, the control unit 15 predicts the behavior of the vehicle based on the road information, and controls the localization position of the sound image based on the information indicating the predicted behavior of the vehicle. For example, since the left and right G can be estimated from directions such as a curve and a corner shown in the road information, the speaker for decreasing the volume and the speaker for increasing the volume are specified in the same manner as in the above embodiment. The amount of adjustment of the volume of the audio signal for each speaker is calculated. Further, since the G in the front-rear direction can be estimated from the traffic lights, crossings, intersections, temporary stop locations, deceleration locations, acceleration lanes, etc. shown in the road information, this allows a speaker to reduce the volume, as in the above embodiment, The speaker whose volume is to be increased is specified, and the adjustment amount of the volume of the audio signal for each speaker is calculated. According to this configuration, it is possible to control the localization position of the above-described sound image before actual shaking occurs (G is applied to the passenger).

  In the control of the localization position of the sound image in the above embodiment, it is assumed that the volume of the audio signal related to audio data such as music is adjusted (increased or decreased), but noise superimposed on audio data such as music It may be configured to adjust the volume of the sound signal (for example, noise heard as “Zur”).

  In the control of the localization position of the sound image in the above embodiment, the volume of the sound signal to be output to each speaker is adjusted. As another example, the sound signal to be output to each speaker is adjusted. You may comprise so that an output timing may be adjusted (that is, the output timing of the audio signal to a speaker according to the direction of G is delayed).

  In the above-described embodiment, the vehicle is described as an example of the moving body. However, the present invention can be applied to, for example, a ship, an aircraft, a train, or the like on which a person can board.

It is a figure which shows the positional relationship of each speaker in a vehicle. It is a figure which shows the example of a schematic structure of the audio reproduction apparatus which concerns on this embodiment. It is a figure which shows the relationship between the magnitude | size of G concerning a fixed direction, and the adjustment amount of the volume of an audio | voice signal. 6 is a flowchart illustrating a processing example of the first embodiment related to the localization position control of the control unit 15 when information indicating the size and direction of G is used. 10 is a flowchart illustrating a processing example of the second embodiment related to the localization position control of the control unit 15 when information indicating the magnitude and direction of G is used.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Audio reproduction apparatus 11 Audio reproduction part 12 Audio processing part 13 G sensor 14 GPS receiver 15 Control part 16 Operation part

Claims (11)

An audio processing device that performs processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by a plurality of speakers.
Obtaining means for obtaining information on the behavior of the moving body;
Sound image localization control means for controlling the localization position of the sound image based on information on the behavior of the moving body;
An audio processing apparatus comprising: The speech processing apparatus according to claim 1,
The acquisition means acquires information indicating the magnitude and direction of gravitational acceleration (G) received by a passenger of the moving body as the information on the behavior of the moving body,
The sound processing apparatus according to claim 1, wherein the sound image localization control means controls a localization position of the sound image based on information indicating a magnitude and direction of the gravitational acceleration (G). The speech processing apparatus according to claim 2, wherein
The sound image localization control means changes the localization position of the sound image by reducing the volume of the audio signal output to the speaker installed in the direction in which the gravitational acceleration (G) is applied. Processing equipment. The speech processing apparatus according to claim 2, wherein
The sound image localization control means changes the localization position of the sound image by increasing the volume of the audio signal output to the speaker installed on the side opposite to the direction in which the gravitational acceleration (G) is applied. A voice processing device. The speech processing apparatus according to any one of claims 2 to 4,
The sound processing apparatus according to claim 1, wherein the sound image localization control unit controls the localization position of the sound image when the magnitude of the gravitational acceleration (G) is equal to or greater than a threshold value. The speech processing apparatus according to claim 1,
The acquisition means acquires operation information of an operation device (for example, a steering wheel, an accelerator, a brake) operated by a driver of the moving body as information on the behavior of the moving body,
The sound image localization control means controls a localization position of a sound image based on the operation information. The speech processing apparatus according to claim 1,
Further comprising behavior prediction means for predicting the behavior of the mobile body based on road information in the traveling direction from the current position of the mobile body,
The acquisition means acquires information indicating the behavior of the predicted moving body as information on the behavior of the moving body,
The sound processing apparatus according to claim 1, wherein the sound image localization control means controls a localization position of a sound image based on the information indicating the predicted behavior of the moving body. The speech processing apparatus according to any one of claims 1 to 7,
In the moving body, speakers are installed on each of the front right side and the front left side, and speakers are installed on each of the rear right side and the rear left side,
The sound image localization control means controls the localization position of the sound image by adjusting the volume of the audio signal to be output to the speaker,
The volume adjustment amount of each audio signal to be output to the rear right and rear left speakers is larger than the volume adjustment amount of each audio signal to be output to the front right and front left speakers. A voice processing device. An audio processing method for performing processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by a loudspeaker of a plurality of speakers,
Obtaining information on the behavior of the mobile object;
Controlling the localization position of the sound image based on information on the behavior of the moving body;
An audio processing method comprising: A computer that performs processing on an audio signal to be output to each speaker in a moving body having a sound field space formed by loudspeaker of a plurality of speakers;
An audio processing program that functions as acquisition means for acquiring information related to the behavior of the moving object and sound image localization control means for controlling a localization position of a sound image based on information related to the behavior of the moving object.   A recording medium in which the audio processing program according to claim 10 is recorded so as to be readable by a computer.

Images