JP4837512B2 - Sound source selection device - Google Patents

Description

  The present invention relates to a virtual sound source selection device in which an operator wearing headphones selects one virtual sound source from a plurality of virtual sound sources.

  In recent years, it has become possible to access an enormous number of songs using a music download service via the Internet. However, opportunities to touch non-major music are still limited, and many users listen to only a few major music. Therefore, various techniques have been proposed for smoothly searching for a target music while previewing a large number of music using only sound without a screen display such as a display.

  For example, in Japanese Patent Laid-Open No. 9-90963 (Patent Document 1), a plurality of sound images (virtual sound sources) are fixedly arranged around a user wearing headphones, and the front of the user's head is fixed. A technique for selecting a specific sound image from a plurality of sound images by directing to the sound image is disclosed.

  In Japanese Patent Laid-Open No. 2000-236600 (Patent Document 2), a plurality of sound images (virtual sound sources) are rotated in a circular shape on the front face of a user wearing a headphone, and have come around in front of the user's eyes. A technique is shown that allows a sound image to be selected.

  Japanese Patent Laid-Open No. 2000-194460 (Patent Document 3) arranges a plurality of sound images (virtual sound sources) around a user wearing headphones and rotates the plurality of sound images around the user according to the movement of the head. And a technique for selecting a sound image coming in front of the user.

In Japanese Patent Laid-Open No. 2-25900 [Patent Document 4], a vibration gyroscope is attached to a headphone worn by a listener, the rotation of the listener's head is detected, and the left and right sound volumes are adjusted according to the detected rotation. A technique for increasing the sense of realism by adjusting the sound source so that the sound source is fixed at one point in the space even when the listener's head rotates is shown. Japanese Patent Application Laid-Open No. 8-9490 [Patent Document 5] discloses a technique for detecting the rotation angle of the head using a microphone attached to the headphone body. Furthermore, Japanese Patent Application Laid-Open No. 9-205700 [Patent Document 6] discloses a technique in which a sensor for detecting the head direction of a headphone is mounted on the headphone. Further, JP-A-8-237790 [Patent Document 7] discloses a technique for detecting not only the rotation of the head but also information on the orientation and position of the listener.
Japanese Patent Laid-Open No. 9-90963 JP 2000-236600 A JP 2000-194460 A JP-A-2-25900 JP-A-8-9490 JP-A-9-205700 JP-A-8-237790

  However, with the technique disclosed in Patent Document 1, when the number of virtual sound sources increases, it is not possible to easily select a sound image. In the techniques described in Patent Documents 2 and 3, selection must be waited until a desired virtual sound source appears in front of the user's eyes, and therefore the time until the desired virtual sound source is selected cannot be shortened. Further, in the techniques described in Patent Documents 1 to 3, since the virtual sound source arrangement pattern is fixed, the selection operation is also fixed. Therefore, even when the number of virtual sound sources increases or when it is difficult to discriminate because the virtual sound sources are approximate, it has been necessary to make a selection through the efforts of the operator. In addition, depending on the place of implementation, there is a problem that a predetermined selection operation causes trouble for the surrounding people.

  An object of the present invention is to provide a sound source selection device capable of increasing the degree of freedom in selecting a plurality of virtual sound sources as compared with the prior art.

  Another object of the present invention is to provide a sound source selection device capable of limiting the movement range of the head according to the situation of the place of implementation when selecting a virtual sound source by the movement of the head. is there.

  Another object of the present invention is to provide a sound source selection device that can easily select a virtual sound source in a short time even when the number of virtual sound sources to be provided at a time increases. .

  The sound source selection device of the present invention selects a virtual sound source from a plurality of virtual sound sources, a virtual sound source providing means for providing a plurality of virtual sound sources localized through the headphones to a headphone, and a listener wearing the headphones. Virtual sound source selection means. The virtual sound source providing means includes a localization sound source arrangement pattern storage means, an arrangement pattern selection means, and a mixing means. Here, the plurality of virtual sound sources localized means a plurality of virtual sound sources that are not moved (fixed) even when the head of a listener wearing headphones is moved.

  The localization sound source arrangement pattern storage means stores a plurality of localization sound source arrangement patterns of a plurality of virtual sound sources provided to the listener. As a plurality of localization sound source arrangement patterns, for example, an arrangement pattern that arranges a plurality of virtual sound sources localized along a virtual circle or virtual polygon around the listener, or a plurality of virtual sound sources localized in front of the listener Various arrangement patterns such as an arrangement pattern for arranging the lines along a virtual straight line, a virtual arc, or the like can be adopted. The arrangement pattern selection means selects a desired pattern from a plurality of localization sound source arrangement patterns according to the listener's selection operation. Here, the listener's selection operation means an operation to be performed when the listener selects a localization sound source arrangement pattern. When a dedicated controller is used, the operation includes the operation of the controller, and the headphones are switched. In the case of wearing, including the operation of operating the switch, and in the case where a predetermined selection is made based on the movement of the head of the listener wearing the headphones, the operation of the listener's head is included. Furthermore, a composite operation in which a plurality of types of operations are combined is also included. The mixing means provides a plurality of virtual sound sources according to the selected localization sound source arrangement pattern.

  When a desired pattern can be selected from a plurality of localization sound source arrangement patterns as in the present invention, it is difficult to identify when the number of virtual sound sources increases or the virtual sound sources are approximated. In this case, by changing the localization sound source arrangement pattern, it is possible to increase the degree of freedom of the sound source selection operation and to obtain an opportunity to facilitate the selection of the sound source. In addition, by changing the localization sound source arrangement pattern when a predetermined selection operation causes trouble to surrounding people, such as when selecting a sound source in a public vehicle, By limiting the range of the selection operation, it becomes possible to select a sound source without disturbing the surroundings.

  When the selection is performed mainly using the motion of the listener's head, a head motion detection sensor and a head motion determination means are further provided. As the head movement detection sensor, a sensor that is attached to headphones and detects the movement of the listener's head can be used. The head movement determination means determines the movement of the head based on the output of the head movement detection sensor, and detects that the movement of the head is one of a plurality of predetermined movements. Various commands are output based on When using the head movement determination means, the arrangement pattern selection means detects another arrangement sound source arrangement pattern from the localization sound source arrangement pattern storage means when the head movement determination means detects a predetermined arrangement pattern change operation from the movement of the head. Can be selected and output to the mixing means. In this way, it is possible to change the arrangement pattern of a plurality of localized virtual sound sources provided to the listener by performing a predetermined operation with the head. Therefore, even when the user cannot operate the switch, such as when riding a vehicle or walking, it is possible to easily change the arrangement pattern by performing a predetermined operation with the head. . At the time of starting (starting up), when a plurality of virtual sound sources are provided with one predetermined sound source arrangement pattern without performing a predetermined arrangement pattern changing operation, and then the arrangement pattern changing operation is detected, You may make it change from one localization sound source arrangement pattern to another localization sound source arrangement pattern. Alternatively, the first localization sound source arrangement pattern may be determined from the start on the condition that the arrangement pattern change operation is detected, and a plurality of virtual sound sources may be provided with the determined first localization sound source arrangement pattern. Note that the types of the plurality of localization sound source arrangement patterns that can be selected by the arrangement pattern changing operation and the shapes of the arrangement patterns are arbitrary. This selection is generally performed in a predetermined order. However, when the number of types of patterns is small, the selection may be performed randomly without determining the order.

  When the number of sound sources to be selected is large, it is not possible to provide all the sound sources to the listener at once. In such a case, the virtual sound source providing means is further provided with a sound source type changing means. The sound source type changing means may change the types of a plurality of virtual sound sources provided by the localization sound source arrangement pattern by voice recognition. The sound source type changing means may be configured to change the types of a plurality of virtual sound sources provided by the localization sound source arrangement pattern when the head movement determining means detects a predetermined sound source changing action from the head movement. Good. Specifically, a plurality of sound sources (acoustic signals) provided to the mixing means are changed. That is, the sound source type changing means, for example, provides 10 sound sources (acoustic signals) in a predetermined arrangement pattern, and if a sound change command or a sound source changing operation is detected, the previous 10 music sources are selected. Change to another 10 songs. Depending on the mode of the sound source changing operation, it is possible to return to the 10 previously provided songs.

  The virtual sound source selection means includes sound source determination means. The sound source determining means is a means for mixing a sound source determination command for determining a sound source when the head movement determining means detects a predetermined sound source determining action from the movement of the head after the arrangement pattern selecting means selects the localization sound source arrangement pattern. Output to. This sound source determination operation is arbitrary. For example, since a plurality of virtual sound sources are in a localized (non-moving) state, the listener searches for one favorite sound source from among the plurality of sound sources that do not move, and heads for the one sound source, so A sound source can be defined. If the sound source determining operation is a motion of nodding by shaking the head up and down, the sound source can be determined by the head operation determining means determining the operation. When the sound source is determined, the mixing means provides the sound reproducing apparatus with an acoustic signal for reproducing only the determined sound source.

  The head motion detection sensor is provided on the headphones, and an azimuth angle difference between a predetermined reference azimuth and a pointing azimuth in which the front of the listener's face is facing in a virtual sound source space where a plurality of virtual sound sources exist It is preferable to include an azimuth angle difference detecting means for detecting. The mixing means is configured to mix a plurality of sound signals supplied from a plurality of sound signal channels corresponding to the plurality of virtual sound sources and output the sound signals to the sound reproduction device. When the head movement detection sensor includes the azimuth angle difference detection means, if the mixing means is configured to further perform the following operation, the volume of the virtual sound source at the position where the listener faces is set to another position. The volume of a certain virtual sound source can be increased to facilitate selection of a sound source. In order to enable this, when the azimuth angle difference is 0 degree, the mixing means mixes and outputs a plurality of acoustic signals supplied from a plurality of acoustic signal channels as they are. When the azimuth angle difference is other than 0 degrees, a state is created in which the positions of a plurality of virtual sound sources are fixed with reference to the reference azimuth, and the volume of one or more virtual sound sources positioned in the indicated azimuth is zero. Volume adjustment and phase adjustment of a plurality of acoustic signals supplied from a plurality of acoustic signal channels so as to be larger than the volume of one or more virtual sound sources at the time The ratio can be output after mixing.

  Further, angle range setting means for setting a predetermined azimuth angle range around the indicated direction can be further provided. In this case, when the azimuth angle range is set, the mixing means includes a plurality of virtual sound sources within the azimuth angle range such that the volume of one or more virtual sound sources is larger than the volume of other virtual sound sources outside the azimuth angle range. The volume of a plurality of sound signals supplied from the sound signal channel can be adjusted. In this way, even if the number of virtual sound sources is large and selection is difficult, it becomes possible to select one virtual sound source after clearly listening to it.

  The angle range setting means includes a distance detection sensor that is provided in the headphones and detects the distance between the operator's hand and the headphones, and when the distance detected by the distance detection sensor decreases, the azimuth angle range is narrowed. When the distance detected by the distance detection sensor increases, the azimuth angle range can be widened. By providing such a distance detection sensor, the virtual sound source can be narrowed down by the movement of the operator's hand, so the angle range can be set independently of the movement of the head, and in the sound source selection operation The occurrence of malfunction can be effectively prevented. The distance detection sensor is preferably an infrared sensor that detects a distance by detecting a change in the angle of reflection of infrared light applied to the operator's hand. If an infrared sensor is used, the setting operation of the angle range can be detected only by the movement of the operator's hand, so there is no need to provide a switch for narrowing the angle range on the headphones, and the external shape of the headphones is compact. It becomes possible to be.

  Further, the plurality of localization sound source arrangement patterns include a first virtual sound source that is located at a first elevation angle position as viewed from the listener and is arranged in the azimuth direction at a predetermined interval within the first distance range. The virtual sound source train and the azimuth direction with a predetermined interval in a second distance range that is at a second elevation angle position different from the first elevation angle position and further away from the listener than the first distance range One or more localization sound source arrangement patterns including a plurality of virtual sound source sequences including at least a second virtual sound source sequence composed of a plurality of virtual sound sources arranged in a row can be included. And when using the localization sound source arrangement pattern provided with such a multiple virtual sound source sequence, an elevation angle difference detection means is further provided. The elevation angle difference detection means detects the difference between the reference elevation angle and the elevation angle of the headphones as an elevation angle difference when the reference azimuth is determined, and raises the headphones upward from the posture when the reference azimuth is determined. The elevation angle difference that appears when the headphone is directed is set as a positive elevation angle difference, and the elevation angle difference that appears when the headphone is turned downward is output as a negative elevation angle difference. In this case, when the elevation angle difference detection means outputs a positive elevation angle difference, the mixing means increases the volume of the plurality of virtual sound sources arranged in the indicated direction as the virtual sound source moving away from the headphones in proportion to the elevation angle difference. When the elevation angle difference detection means outputs a negative elevation difference, it is instructed to reduce the volume of the virtual sound sources arranged in the indicated direction in proportion to the elevation angle difference and to decrease the virtual sound source far from the headphones. It is preferable to adjust the volume of the plurality of acoustic signals of the plurality of acoustic signal channels corresponding to the plurality of virtual sound sources arranged in the direction. That is, the mixing means is configured such that when the elevation angle difference detection means outputs a positive elevation difference, the volume of the plurality of virtual sound sources arranged in the indicated direction increases in proportion to the elevation angle difference as the virtual sound source moves away from the headphones. To. Further, the mixing means is configured such that when the elevation angle difference detection means outputs a negative elevation angle difference, the volume of a plurality of virtual sound sources arranged in the indicated direction is reduced in proportion to the virtual sound source farther from the headphones in proportion to the elevation angle difference. To. In this way, by changing the elevation angle of the headphones, the volume of a plurality of virtual sound sources arranged in the indicated direction can be selectively increased or decreased. In this way, a plurality of virtual sound sources are divided and arranged in a plurality of virtual sound source rows, and the volume of the plurality of virtual sound sources included in one virtual sound source row is changed from the plurality of virtual sound source rows to another volume by setting the elevation angle of the headphones. The volume can be made larger than the volume of a plurality of virtual sound sources included in the virtual sound source row. In this way, when performing the sound source selection operation, candidates can be narrowed down by selecting the virtual sound source row based on the elevation angle setting of the headphones. After that, a specific sound source in one virtual sound source row can be selected by setting the azimuth angle of the headphones. Therefore, even when a large number of virtual sound sources are arranged in a narrow virtual space range, a desired sound source can be easily selected by the operation of setting the elevation angle and azimuth angle of the headphones.

  What kind of sensor is used for the head motion detection sensor is arbitrary. For example, when an electronic compass, a gyro sensor, a tilt sensor or an acceleration sensor capable of detecting a tilt in three axial directions is used, an azimuth angle detection sensor and an elevation angle detection sensor can be configured by one sensor, The score can be reduced.

  According to the present invention, since a desired pattern can be selected from a plurality of localization sound source arrangement patterns, even when the number of virtual sound sources increases or when virtual sound sources are approximated, it is difficult to identify them. By changing the localization sound source arrangement pattern, it is possible to increase the degree of freedom of the sound source selection operation and to obtain an advantage that the sound source can be easily selected. In addition, even when a predetermined selection operation causes annoyance to surrounding people, such as when selecting a sound source in a public vehicle, by changing the localization sound source arrangement pattern, By limiting the range of the selection operation, there is an advantage that it is possible to select a sound source without disturbing the surroundings.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of an example of a configuration of a sound source selection device of the present invention. FIG. 2 is a diagram showing a headphone 7 with a sensor that is actually used. The sound source selection device 1 according to the present embodiment mixes a plurality of sound signals supplied from a plurality of sound signal channels corresponding to a plurality of virtual sound sources into the sound reproduction device 3 that creates a plurality of virtual sound sources around the listener. And mixing means 5 for outputting. In addition, the mixing device 1 includes a headphone 7 with a head motion detection sensor that is worn by a listener, and an arithmetic unit 9. As shown in FIG. 2, the headphone 7 is provided with at least a reference azimuth determination switch 13, an azimuth angle detection sensor 15, an elevation angle detection sensor 17, and a narrowing infrared sensor 19. The arithmetic unit 9 is provided with an elevation angle difference calculation means 21, an azimuth angle difference calculation means 23, an angle range determination means 25, and an acoustic signal channel storage means 27 in addition to the mixing means 5 described above. Yes. The mixing unit 5 includes a channel selection unit 29 and a mixing unit 31. The arithmetic unit 9 includes a head movement determination unit 33, a sound source determination unit 35, a sound source storage unit 37, a sound source type change unit 39, a localization sound source arrangement pattern storage unit 41, and an arrangement pattern selection unit 43. I have. In the present embodiment, the head movement determination means 33 and the sound source determination means 35 constitute a virtual sound source selection means. The mixing means 5, the signal channel storage means 27, the head movement determination means 33, and the sound source storage. The means 37, the sound source type changing means 39, the localization sound source arrangement image pattern storage means 41, and the arrangement pattern selection means 43 constitute virtual sound source providing means. The main part of the arithmetic unit 9 is realized by a computer.

  The reference orientation determination switch 13 is a switch that is operated by a listener when the headphone 7 is attached to start mixing. For example, when the reference azimuth determination switch 13 is operated while a plurality of pieces of music to be selected are being reproduced by the sound reproduction device 3, the azimuth angle θ detected by the azimuth angle detection sensor 15 at that time is the reference. It is stored in the internal memory of the azimuth angle difference calculation means 23 as the azimuth reference azimuth. When the reference azimuth determination switch 13 is operated, the elevation angle φ detected by the elevation angle detection sensor 17 at that time is stored in the internal memory of the elevation angle difference calculation means 21 as the reference elevation angle in the reference azimuth.

  After the reference azimuth determination switch 13 is operated, the azimuth angle θ detected by the azimuth angle detection sensor 15 at a predetermined sampling period is input to the azimuth angle difference calculation means 23. The azimuth angle difference calculating means 23 is a difference between a reference azimuth angle of a predetermined reference azimuth and an output (detection azimuth angle) of the azimuth angle detection sensor 15 that detects the azimuth of the head of the listener wearing the headphones 7. The angle difference θd is calculated. In this embodiment, the reference azimuth determining switch 13, the azimuth angle detecting sensor 15, and the azimuth angle difference calculating means 23 constitute an azimuth angle difference detecting means 24. This azimuth angle difference detection means 24 is reproduced by the sound reproducing device 3 and indicates the direction and reference direction of the headphone 7 indicating the virtual sound source space constituted by a plurality of virtual sound sources that exist virtually in front of the listener. Azimuth angle difference between is detected.

  After the reference azimuth determination switch 13 is operated, the elevation angle φ detected by the elevation angle detection sensor 17 at a predetermined sampling period is input to the elevation angle difference calculation means 21. The elevation angle difference calculation means 21 is a difference between a reference azimuth angle of a predetermined reference azimuth and an output (detection elevation angle) of the elevation angle detection sensor 17 for detecting the head direction of the listener wearing the headphones 7, that is, an elevation angle difference. Calculate φd. In this embodiment, the reference angle determination switch 13, the elevation angle detection sensor 17, and the elevation angle difference calculation means 21 constitute an elevation angle difference detection means 22. The elevation angle difference detection means 22 detects the difference between the reference elevation angle and the elevation angle of the headphone 7 as an elevation angle difference φd, with the elevation angle of the headphone 7 when the reference azimuth is initially determined as a reference elevation angle. The elevation angle difference detection means 22 sets the elevation angle difference that appears when the headphone 7 is directed upward from the posture when the reference azimuth is determined as a positive elevation angle difference, and the elevation angle that appears when the headphone 7 is directed downward. The difference is output as a negative elevation difference.

  The output φ of the elevation angle difference calculation means 21 and the output θ of the azimuth angle difference calculation means 23 are input to the angle range determination means 25. The angle range determining means 25 sets a predetermined azimuth angle range centered on the indicated azimuth in which the operator wearing the headphones 7 is facing his face. The angle range determining means 25 sets the azimuth angle range according to the output from the infrared sensor for narrowing 19 provided in the headphones 7. The narrowing infrared sensor 19 includes an infrared light emitting unit and an infrared light receiving unit, and the infrared light received by the infrared light receiving unit reflected by the infrared light emitted from the infrared light emitting unit is received by the infrared light receiving unit, and the angle of the reflected light is changed. Accordingly, the distance between the headphone 7 and the hand is measured. In the present embodiment, the angle range setting means 26 includes the angle range determination means 25 and the infrared sensor 19. When a narrowing command is not actively input from the narrowing infrared sensor 19, the angle range setting unit 26 mixes the output φ of the elevation angle difference calculation unit 21 and the output θ of the azimuth angle difference calculation unit 23 as they are. To the channel selection means 29.

  When the output φ of the elevation angle difference calculation means 21 and the output θ of the azimuth angle difference calculation means 23 are input as they are, the mixing means 5 is configured to output a plurality of sound signal channel storage means 27 so as to realize the matters described later. Volume adjustment and phase adjustment of a plurality of acoustic signals (signals for a plurality of virtual sound sources) supplied from the acoustic signal channel are performed, and these signals are mixed and output. The plurality of sound signals are signals of a plurality of sound sources (songs) selected by the sound source type changing unit 39 from a large number of sound signals (songs) stored in the sound source storage unit 37. For example, if it is assumed that several hundreds of music signals are stored in the sound source storage unit 37, the sound source type changing unit 39 selects the sound signals for ten songs at a time and selects them in the sound signal channel storage unit 27. The acoustic signals for 10 songs are stored. The sound source type changing means 39 that can be used in the present embodiment has a voice recognition function and changes the music by inputting a change command by voice, or the head movement determining means 33 detects the movement of the head. When a predetermined sound source changing operation is detected, any of a plurality of types of virtual sound sources provided by a localized sound source arrangement pattern to be described later may be used. That is, the sound source type changing means 39 has a function of changing the sound source of the previous 10 songs to another 10 sound sources when, for example, 10 music sources (acoustic signals) are provided in a predetermined arrangement pattern. Anything can be used. Actually, the sound source type changing means 39 of the present embodiment has a voice recognition function. Therefore, when a microphone is attached to the headphone 7 and a change is instructed by voice from the microphone, the voice is recognized, and a genre song (sound source) is selected based on the recognition result and output to the acoustic signal channel storage means 27. . Therefore, in this embodiment, the type of sound source can be changed by sound.

  The virtual sound source providing means includes a localization sound source arrangement pattern storage means 41, an arrangement pattern selection means 43, a mixing means 5, an acoustic signal channel storage means 27, a sound source storage means 37, and a sound source type change means 39. . The localization sound source arrangement pattern storage means 41 is a plurality of localization sound sources employed when arranging a plurality of virtual sound sources (a plurality of songs to be selected) provided to a listener wearing the headphones 7 in a virtual space. The arrangement pattern is stored. As the plurality of localization sound source arrangement patterns, for example, localization sound source arrangement patterns as shown in FIGS. 3A to 3D are stored. 3A to 3D, a large circle arranged at the center indicates the position of the listener, and the direction in which the line indicating the radius of the circle indicating the listener extends radially outward is the face of the listener. The direction (indicated direction) in which A circle smaller than the circle indicating the listener indicates the position of the virtual sound source in the virtual space. A line connecting a plurality of small circles is an imaginary line drawn for easy understanding of the image of the arrangement pattern. In the arrangement pattern shown in FIG. 3A, ten virtual sound sources (songs) are arranged at equal intervals along a virtual circle in a virtual section around the listener with the listener as the center. In such an arrangement pattern, even if the number of virtual sound sources increases, the distance between the virtual sound sources can be ensured to some extent, so that the virtual sound sources can be easily distinguished and recognized. However, as will be described in detail later, when the sound source is selected by the movement of the head, the movement range of the head that the listener must move is widened. Also in the arrangement pattern of FIG. 3B, a plurality of virtual sound sources are arranged with the listener at the center, as in the arrangement pattern of FIG. The arrangement pattern of FIG. 3A is different from the arrangement pattern of FIG. 3A in that a plurality of virtual sound sources are distributed along a double virtual circle. In the arrangement patterns of FIGS. 3C and 3D, a plurality of virtual sound sources are distributed and arranged along two virtual lines in front of the listener. The arrangement patterns in FIGS. 3C and 3D have an advantage that the listener moves the head in a narrower range than the arrangement patterns in FIGS. 3A and 3B. . In addition, the arrangement pattern of FIG. 3D has an advantage that the distance between the listener and the virtual sound source can be shortened as compared with the arrangement pattern of FIG.

  When the arrangement patterns shown in FIGS. 3B to 3D are adopted, the virtual sound source located in the front row and the virtual sound source located in the rear row are selected and selected. Therefore, in the present embodiment, in any arrangement pattern, the first virtual sound source row in which a plurality of virtual sound sources positioned in front is arranged is at the first elevation angle position when viewed from the listener and within the first distance range. And a plurality of virtual sound sources arranged in the azimuth direction at predetermined intervals. A second virtual sound source array in which a plurality of virtual sound sources positioned rearward is arranged at a second elevation position different from the first elevation position and further away from the listener than the first distance range. Are formed from a plurality of virtual sound sources arranged in the azimuth direction with a predetermined interval within the distance range. If necessary, a third and a fourth virtual sound source sequence may be formed to form multiple virtual sound source sequences. The manner of providing a plurality of virtual sound sources in the case of forming multiple virtual sound source strings will be described in detail later.

  The arrangement pattern selection unit 43 selects a desired pattern from a plurality of localization sound source arrangement patterns according to the selection operation of the listener, and outputs the arrangement pattern to the mixing unit 31 of the mixing unit 5. The mixing unit 31 performs a mixing operation so as to arrange a plurality of virtual sound sources around the listener with the selected localization sound source arrangement pattern. In the case of the present embodiment, the selection operation of the listener includes an operation of operating the reference orientation determination switch 13 attached to the headphones 7 and also includes the movement of the head of the listener wearing the headphones 7. In the case of making a predetermined selection based on this, it includes the movement of the listener's head, and also includes a combined movement in which a plurality of types of movements are combined.

  In the present embodiment, the selection is performed mainly using the movement of the listener's head. Therefore, a head motion detection sensor (elevation angle detection sensor 17, azimuth angle detection sensor 15) and head motion determination means 33 are used. The head movement determination means 33 determines the movement of the head based on the output of the head movement detection sensor and detects that the movement of the head is one of a plurality of predetermined movements. Various commands are output based on For example, when the listener detects an action of rotating the head by 360 degrees, a sound source change command for changing the type of the virtual sound source is output, and when an action of tilting the head horizontally is detected, the arrangement pattern is changed. When a change of the arrangement pattern to be changed is output and a motion of shaking the head back and forth is detected, a determination command is output. When a motion of shaking the head left and right is detected, the current playback operation is stopped and the process returns to the start. The head movement determination means 33 can be configured to output a command.

  The arrangement pattern selection means 43 selects another localization sound source arrangement pattern from the localization sound source arrangement pattern storage means 41 when the head movement determination means 33 detects a predetermined arrangement pattern change operation from the head movement. 5 to the mixing unit 31. In this way, it is possible to change the arrangement pattern of a plurality of localized virtual sound sources provided to the listener by performing a predetermined operation with the head. Therefore, even when you are unable to operate the switch, such as when you are on a vehicle or when you are walking, you can easily change the arrangement pattern by performing a predetermined action on the head. become. In the present embodiment, at the time of starting (starting up), a plurality of virtual sound sources are provided with one predetermined sound source arrangement pattern, and then one sound source arrangement is detected when an arrangement pattern change operation is detected. Change from a pattern to another localization sound source arrangement pattern. Note that the types of the plurality of localization sound source arrangement patterns that can be selected by the arrangement pattern changing operation and the shapes of the arrangement patterns are arbitrary. In the present embodiment, the pattern is changed in a predetermined order.

  In the present embodiment, the sound source type changing means 39 is provided in consideration of the case where the number of sound sources to be selected is large. The sound source type changing means 39 provides a plurality of sound source types provided by the localization sound source arrangement pattern when the head movement determining means 33 detects a predetermined sound source changing action from the movement of the head after the arrangement pattern selecting means 43 selects the arrangement pattern. Change the type of virtual sound source. Specifically, a plurality of sound sources (acoustic signals) provided to the mixing means 5 are changed. That is, when the sound source change operation is detected when, for example, 10 sound sources (acoustic signals) are provided in a predetermined arrangement pattern, the sound source type changing unit detects the sound source changing operation, the previous 10 music sources are changed to another 10 music sources. Change to a sound source. Depending on the mode of the sound source changing operation, it is possible to return to the 10 previously provided songs.

  In the present embodiment, sound source determination means 35 is provided. The sound source determination unit 35 is a sound source determination command for determining a sound source when the head movement determination unit 33 detects a predetermined sound source determination operation from the movement of the head after the arrangement pattern selection unit 43 selects the localization sound source arrangement pattern. Is output to the mixing means 5. Specifically, a channel to be reproduced is instructed to the channel selection means 29, and the channel selection means 29 selects only a channel corresponding to the selected sound source when a sound source determination command is input. As will be described in detail later, the sound source determination operation is arbitrary. In this embodiment, since the plurality of virtual sound sources are in a localized (not moving) state, the listener searches for one favorite sound source from among the plurality of sound sources that do not move, and heads for that one sound source. Determine the sound source for the decision. The head motion determination means 33 determines the sound source by determining the motion as a sound source determination operation by shaking the head up and down and performing a nodding motion. When the sound source is determined, the mixing unit 5 provides the sound reproducing device 3 with an acoustic signal for reproducing only the determined sound source.

  Hereinafter, the specific operation | movement aspect of this Embodiment is demonstrated in detail. First, for example, assuming that the elevation angle difference φd input from the elevation angle difference calculation means 21 is 0, a case where the output θ of the azimuth angle difference calculation means 23 is input to the mixing means 5 is considered. In this case, when the azimuth angle difference is 0 degree, the channel selection means 29 supplies all of the plurality of acoustic signals supplied from the plurality of acoustic signal channels to the mixing unit 31 as they are. The mixing unit 31 mixes the supplied plurality of sound signals as they are and outputs them to the sound reproducing device 3.

  When the azimuth angle difference is other than 0 degrees, the mixing unit 5 creates a state in which the positions of the plurality of virtual sound sources are fixed with reference to the reference azimuth. That is, a listener wearing headphones 7 adjusts the balance of the left and right outputs of the headphones so that the position of the virtual sound source does not move even if the head rotates, so that a plurality of virtual sound sources are always in the virtual space. Make sure they are in the same position. Details of this fixing technique are described in a plurality of known documents such as Japanese Patent Application Laid-Open No. 2-25900, and the description thereof will be omitted. In this case, the channel selection means 29 selects one or more virtual sound sources located in the indicated direction (the direction in which the listener faces the front of the face) specified by the azimuth angle difference θd, and the mixing unit A command for designating the selected virtual sound source is output to 31. The mixing unit 31 makes the volume of one or more virtual sound sources selected by the channel selection means 29 larger than the volume of one or more virtual sound sources when the azimuth angle difference is 0 degrees, and the volume of other virtual sound sources is Keep mixing and mix. In order to increase the volume of the virtual sound source, the amplification factor of the acoustic signal of the selected channel may be increased. The degree of increase in the amplification factor may be arbitrarily determined.

  In this way, when the listener wears the headphones 7 and faces the front of the face in a virtual sound source space where a plurality of virtual sound sources are present, the azimuth angle difference detection means 24 has an azimuth angle with the indicated azimuth relative to the reference azimuth. Detect the difference. And the mixing means 5 makes the state which fixed the position of the several virtual sound source on the basis of a reference | standard azimuth | direction. Then, the mixing means 5 determines the volume of the one or more virtual sound sources located in the indicated direction directed by the listener wearing the headphones 7 from the volume of the one or more virtual sound sources when the azimuth angle difference is 0 degree. Also make it bigger. By doing so, it is possible to easily increase the volume of the virtual sound source in the direction that the listener is facing, that is, the sound source (song) that the listener wants to hear, without moving a plurality of virtual sound sources. Therefore, even a listener who does not know complicated mixing technology can increase the volume of a predetermined virtual sound source and move the face (head) and check the content of the music provided by the virtual sound source. If you want to listen to a song from another virtual sound source, you can turn your neck in the direction where the virtual sound source you want to hear exists and set the indicated direction to another direction.

  Next, it is assumed that the azimuth angle difference output from the azimuth angle difference calculation means 23 does not change, and the elevation angle difference output from the elevation angle difference calculation means 21 input to the angle range determination means 25 changes. The elevation angle difference detection means 22 sets the elevation angle difference that appears when the headphones 7 are turned upward from the posture when the reference azimuth is determined (when the listener's head is turned up) as a positive elevation angle difference + φ, and The elevation angle difference that appears when the headphones 7 are directed downward (when the listener's head is directed downward) is output as a negative elevation angle difference −φ. In this case, the channel selection means 29 selects the acoustic signal channels of a plurality of virtual sound sources arranged in the designated azimuth determined by the azimuth angle difference θd calculated by the azimuth angle calculation means 23 as described above. For example, when the elevation angle difference detection unit 22 outputs a positive elevation angle difference + φ, the mixing unit 31 separates the volumes of the plurality of virtual sound sources arranged in the indicated direction from the headphones 7 in proportion to the elevation angle difference + φ. Make it larger as the virtual sound source. In addition, when the elevation angle difference detection unit 22 outputs a negative elevation angle difference −φ, the mixing unit 31 determines the volume of the plurality of virtual sound sources arranged in the indicated direction in a virtual manner away from the headphones 7 in proportion to the elevation angle difference. Try to make the sound source smaller. In this way, by changing the elevation angle of the headphones 7, the volume of a plurality of virtual sound sources arranged in the indicated direction can be selectively increased or decreased. In this way, a plurality of virtual sound sources are adopted by adopting a localized sound source arrangement pattern so that a plurality of virtual sound sources form a multiple virtual sound source sequence as shown in FIGS. 3 (B) to 3 (D). When the headphone 7 is arranged around the sound volume, the volume of the plurality of virtual sound sources included in one virtual sound source column is changed from the plurality of virtual sound source columns by the elevation angle setting of the headphones 7. It can be larger than the volume. That is, when performing a sound source selection operation, candidates can be narrowed down by selecting a virtual sound source row based on the elevation angle setting of the headphones 7. After that, by setting the azimuth angle of the headphones 7, the pointing direction is determined as described above by directing the listener's face to a specific sound source in one virtual sound source row, and the volume of the virtual sound source in the pointing direction is determined. Can be increased. Therefore, according to the present embodiment, even when a large number of virtual sound sources are arranged in a narrow virtual space range, a desired sound source can be easily selected by the operation of setting the elevation angle and azimuth angle of the headphones 7.

  Usually, since both the output φ of the elevation angle difference calculation means 21 and the output θ of the azimuth angle difference calculation means 23 are input to the angle range determination means 25, a plurality of virtual sound sources arranged in the indicated azimuth by these two outputs are input. Selectively increase or decrease the volume.

  When a command for setting the angle range is input from the narrowing infrared sensor 19 to the angle range determination unit 25, the angle range determination unit 25 outputs the output φ of the elevation angle difference calculation unit 21 and the output θ of the azimuth angle difference calculation unit 23. The angle range is narrowed down with reference to. Then, the mixing unit 5 makes the volume of one or more virtual sound sources within the set azimuth angle range larger than the volume of one or more virtual sound sources when the azimuth angle difference is 0 degrees. At the same time, the mixing means 5 is supplied from a plurality of acoustic signal channels so that the volume of other virtual sound sources outside the azimuth angle range is smaller than the volume of one or more virtual sound sources within the azimuth angle range. Adjust the volume of multiple acoustic signals.

  The angle range determination means 25 is an operation in which the listener moves his / her hand close to the narrowing infrared sensor 19 (operates in the narrowing direction) to reduce the azimuth angle range and release his hand from the narrowing infrared sensor 19. It is configured to increase the azimuth angle range when performing the operation (operating in the direction of releasing the narrowing). For example, an α value of the azimuth difference θ ± α is set in proportion to the distance between the headphone 7 detected by the aperture infrared sensor 19 and the listener's hand, for example. When the infrared sensor 19 does not detect the presence of a hand, α is not set in particular, and the sound from all virtual sound sources can be heard around the designated direction. When the infrared sensor 19 detects the presence of a hand, the setting is changed so that the value of α changes in proportion to the distance (in an inversely proportional relationship) from a state in which sound from all virtual sound sources can be heard. As a result, only the volume of the sound signal of the virtual sound source falling within this angle range is increased, and the volume of the sound signal of the virtual sound source outside this angle range is decreased.

  As the distance detected by the infrared sensor 19 becomes shorter, the value of α becomes smaller, and only the volume of the virtual sound source at the position of one narrowed area determined by the azimuth difference θ ± α and the elevation difference φd increases. The volume of the virtual sound source becomes smaller. When such an infrared sensor 19 is provided, only the operation of bringing the hand closer to the infrared sensor 19 can narrow the angle range and easily adjust the volume of a specific virtual sound source.

  In FIG. 2, reference numerals are assigned to portions where the aperture infrared sensor 19, the azimuth angle detection sensor 15, and the elevation angle detection sensor 17 are attached. By using such a headphone 7, the virtual sound source can be selected or specified by the rotation of the listener's head and the elevation angle of the head, so just turn the face toward the virtual sound source that the listener wants to hear, The volume of the desired virtual sound source can be increased. Further, when the infrared sensor 19 for narrowing down is provided in the headphones 7, the volume can be increased by performing the same operation as the operation of holding the hand over the ear and listening to the sound well. Therefore, the volume can be adjusted with natural operation.

  In addition, what kind of sensors are used as the azimuth angle detection sensor 15 and the elevation angle detection sensor 17 is arbitrary. For example, when an electronic compass, a gyro sensor, a tilt sensor or an acceleration sensor capable of detecting a tilt in three axial directions is used, the azimuth angle detection sensor 15 and the elevation angle detection sensor 17 can be configured by one sensor.

  Next, a program used when the above embodiment is specifically realized using a personal computer will be described. In the following description, the azimuth angle detection sensor 15 and the elevation angle detection sensor 17 are constituted by an electronic compass. Outputs (analog signals) of the azimuth angle detection sensor 15 and the elevation angle detection sensor 17 constituted by an electronic compass are A / D converted by an A / D converter and input to a computer. The computer calculates the position of the virtual sound source, determines the volume and phase, and mixes and outputs them. In the specific example described below, the angle difference (azimuth difference) between the positions of a plurality of virtual sound sources and the front of the listener's head is measured with an electronic compass, and the volume and phase ( Change the ratio of the sound coming from the left and right. Further, the elevation angle of the listener's head is measured with an electronic compass, and the larger the elevation angle, the larger the mixing volume of the sound source arranged farther, and the lower the mixing volume of the sound source arranged nearby. Then, the distance between the hand and the headphone 7 is measured by the infrared sensor 19 mounted on the headphone 7, and the directivity is changed according to the measured distance.

  This embodiment is actually realized using a computer. A more specific example in the case where this embodiment is realized using a computer will be described below. Specifically, an electronic compass capable of simultaneously measuring the azimuth angle and the elevation angle is used. The values of the azimuth angle θ and the elevation angle φ measured with the electronic compass are replaced with numerical values from 0 to 127 by the A / D converter and are taken into the computer. In the following explanation, the unit of angle is radians, and explanation will be made assuming that −π ≦ θ <π and −π ≦ φ <π. However, in the following description, the elevation angle φ and the azimuth angle θ are set to 0 in the direction in which the listener is facing in the initial state. Therefore, in the following description, the elevation angle φ and the azimuth angle θ coincide with the elevation angle difference φd and the azimuth angle difference θd from the reference azimuth described above.

  Further, the output of the infrared sensor for narrowing 19 used for narrowing is also replaced with a numerical value from 0 to 127 by the A / D converter, and taken into the computer. On the computer, the distance between the headphone and the hand is normalized to a value from 0 to 1 and used.

  As the plurality of sound sources, acoustic signals of a plurality of acoustic channels obtained by recording a plurality of music pieces are used. In advance, the signal level of each sound source is adjusted to the same level.

  First, the sound source selection method and the sound source selection at that time will be described. In the following description, as shown in FIG. 4, the azimuth angle θ obtained from the electronic compass is described as −π ≦ θ <π. Further, the elevation angle φ is set to −π ≦ φ <π, and the distance δ between the narrowing infrared sensor 19 and the hand is set to 0 ≦ δ ≦ 1 (when 0: the presence of the hand is not detected, when 1): This will be described as a case where a hand is present nearby. The unit of angle is radians, and the elevation angle and azimuth angle are set to 0 when the user is facing in the initial state. The distance sensor detects a distance from 0 cm to 3 cm, but δ is normalized to a value from 0 to 1, 0 when the distance is 0 cm, and 1.0 cm when the distance is 3 cm or longer. A value between 0 and 1 is output when it is between 3 and 3 cm.

For example, virtual sound sources (music pieces) Sn for 10 songs are arranged in the virtual space in the localization sound source arrangement pattern shown in FIG. In the following description, the signal of each sound source is Sn. n indicates the number of the signal. At this time, the distance _{l n} from listener to each virtual sound source 10, an azimuth angle and theta _n. However, the unit of θ _n is radians, and l _n (0 ≦ l _n ≦ 1) is a value normalized with the distance to the most distant virtual sound source (musical piece) as 1. First, the amplification factor (attenuation factor) h _n ^φ of each virtual sound source Sn to be changed according to the elevation angle φ is calculated based on the following equation (1). Here, the following equation is used so that the amplification factor of the music arranged farther increases when facing up, and the amplification factor of the music arranged closer increases when facing down.

However,

  m is the total number of sound sources.

  If each musical piece is arranged as shown in FIG. 5 (a), when the elevation angle φ = 0, the amplification factor of each sound source is as shown in FIG. 5 (b). On the other hand, when the elevation angle φ <0, as shown in FIG. 5C, the amplification factor of the sound source arranged near (far) increases (decreases). 5 (b) and 5 (c) show the amplification factor as a music mixer for easy understanding. The vertical slide bars in FIGS. 5B and 5C correspond to sound sources 1 to 10 in order from the left, and the higher the slider, the higher the amplification factor.

Next, the amplification factor h _n ^φ of each sound source that is changed according to the distance δ is calculated by the following equation (2).

| A | is an absolute value of a, and θ _n ′ (−π ≦ θ _n ′ <π) is an angle formed by θ _n and θ, that is, an angle difference.

For example, when θ = π / 3 and distance δ = 0.5, as shown in FIG. 6, the amplification factor h _n ^φ is a virtual sound source arranged in the rear half region in the direction in which the listener is facing. = 0, and the amplification factor h _n ^φ = 1 with the virtual sound source arranged in the front half. As a result, unnecessary virtual sound sources can be excluded.
Next, the amplification factor h _n ^θ of each sound source that is changed according to the azimuth angle θ obtained from the electronic compass is calculated by the following equation (3).

However,

The amplification factor h _n ^θ is a function that indicates a large value for a sound source arranged in a direction in which the listener is facing and a small value for a sound source that is not. In this case, assuming that a plurality of virtual sound sources are arranged by selecting the arrangement pattern shown in FIG. 3A as the localization sound source arrangement pattern, the amplification factor when the listener is facing left is shown in FIG. 7 (a), the amplification factor when facing the front is as shown in FIG. 7 (b), and the amplification factor when facing the right is as shown in FIG. 7 (c). α (0 ≦ α ≦ 1) is an adjustable parameter, and sets a change in amplification factor when the distance δ <1 when a hand is put close to the ear and a hand is brought close to the ear. When α = 0, there is no change in the amplification factor of each sound source even if the ear is paused. However, when α> 0, the amplification factor decreases as the hand approaches the ear. At this time, since the decrease in the amplification factor of the sound source in the direction not facing is larger than the decrease in the amplification factor of the sound source in the direction toward the listener, the front sound can be heard with a relatively loud sound. If each sound source is arranged as shown in FIG. 3A, the amplification factor when δ = 0 is as shown in FIG. The amplification factor in the case of δ <1 when the ear is paused and the hand is brought close to the ear is as shown in FIG. 8B, so that the sound source in the front can be heard more clearly.

Next, in accordance with the azimuth angle θ obtained from the electronic compass, the localization (ratio of left and right amplification factors) p _n (0 ≦ p _n α ≦ 1) of a plurality of virtual sound sources is calculated using the following equation (4). .

When _pn is 0, the right / left amplification factor ratio of the sound source is 0: 1, and when _pn is 0.5, the amplification factor ratio is 1: 1. Β is an adjustable parameter. When β = 1, there is no change in localization even if the ear is placed in a clear pose and the hand is brought close to the ear, but when β> 0, the hand is held in the ear. As it gets closer, the localization of the sound source other than the sound source in front moves at that time. For example, a sound source that is localized to the right front moves to the right rear. This makes it possible to hear the front sound source more clearly.

The mixing means 5 adds all the virtual sound source signals and outputs them from the headphones 7. At that time, the angular amplification factor obtained above is multiplied. Equation (5) below shows the output of the right speaker of the headphones, and Equation (6) below shows the output of the left speaker of the headphones.

  10 and 11 are flowcharts showing an algorithm of a program that is installed in a computer and realizes the sound source selection device of the present invention. The arrangement of the sound source in step ST1 in the flowchart of FIG. 10 means that the sound reproduction apparatus 3 reproduces the sound signal and places the sound source in front of or around the listener. In this example, in step ST1, a plurality of virtual sound sources are provided to the listener according to a predetermined initial sound source arrangement pattern.

  In step ST2 of FIG. 10, it is determined whether or not the reference orientation determination switch 13 has been pressed. If the reference orientation determination switch 13 is pressed, in step ST3, the orientation in which the headphones 7 are facing (the orientation in which the listener wearing the headphones is facing) is set as the front (that is, the reference orientation). And a reference elevation angle). In the initial stage, step ST3 is always executed. It is also possible to change the reference orientation on the way.

Next, in step ST4, it is detected whether or not the elevation angle of the headphones 7 in the direction indicated by the headphones 7 has changed. If the elevation angle has changed, the process proceeds to step ST5. In step ST5, the elevation angle of the headphones when determining the reference azimuth is used as a reference elevation angle, and the difference between the reference elevation angle and the elevation angle of the headphones is detected as an elevation angle difference. In this case, the elevation angle difference that appears when the headphones are directed upward from the attitude when the reference azimuth is determined is defined as a positive elevation angle difference, and the elevation difference that appears when the headphones are directed downward is defined as a negative elevation angle difference. In step ST5, the amplification factor h _n ^φ of each sound source according to the elevation angle is calculated. Specifically, the amplification factor, that is, the amplification ratio (attenuation ratio) h _n ^φ (0 ≦ h _n ^φ ≦ 1) of each sound source n is calculated according to the elevation angle φ obtained from the electronic compass.

  Next, in step ST6, it is determined whether or not the direction in which the listener wearing the headphones 7 is facing has been changed. If the azimuth angle has changed, the process proceeds to step ST8. If the azimuth angle has not changed, the process proceeds to step ST7. In step ST7, the narrowing infrared sensor 19 as a distance detection sensor detects the presence of a hand and determines whether or not a narrowing operation (operation) has been performed. In step ST7, it is determined from the output whether or not the infrared sensor 19 as a distance detection sensor detects a narrowing operation (operation).

In step ST7, when the amount of adjustment, that is, the distance adjustment change (distance length change) is performed, the distance δ is measured. In step ST8, in response to this, the aforementioned amplification factor h _n ^δ of each sound source is calculated according to the distance δ obtained from the infrared sensor as the distance detection sensor.

Next, the process proceeds to step ST9. In step ST9, the amplification factor h _n ^θ of each sound source is calculated according to the designated direction θ obtained from the electronic compass. The amplification factor h _n ^θ is a function that indicates a large value for a sound source arranged in a specified direction facing the listener and a small value for a sound source arranged in a direction other than that.

Next, the process proceeds to step ST10, and the volume ratio _Pn between the left and right volumes is calculated according to the direction of each sound source. The phase is adjusted by determining the volume ratio of each virtual sound source, and even if the listener rotates his / her head, the virtual sound source will not move with the rotation.

  Next, proceeding to step ST11, the left and right volume of the headphones are calculated. That is, the signals of all virtual sound sources are added and output from the headphones. At that time, each amplification factor obtained in step ST5, step ST8 and step ST9 is multiplied. The calculation is performed by the mixing means 5. FIG. 9 shows a multiplication image of amplification factors executed by the mixing means 5. In FIG. 9, three “× h1” arranged in three stages are the amplification factors of the virtual sound source 1 obtained in the above steps ST5, ST8, and ST9. “X” and “x1−” in the last stage mean that the left and right output of the headphone is multiplied by the left and right volume ratio in step 10. The last “Σ” means that a multiplication signal obtained by multiplying the sound signals of all virtual sound sources by the amplification factor and the volume ratio is added.

  Next, the process proceeds to step ST12 shown in FIG. Steps ST12 to ST22 constitute a selection step for selecting one sound source from a plurality of virtual sound sources. In step ST12, it is determined whether or not the sound source type changing means 39 having a voice recognition function has recognized a change in the types of a plurality of sound sources arranged in the localization sound source arrangement pattern by the voice recognition function. When the genre is recognized such as “Rock” or “Jazz” by the voice recognition, the ten sound sources searched according to the recognition result in Step ST13 are provided to the listener in a predetermined arrangement pattern. The genre may be selected by the action of the listener's neck. For example, of course, the genre may be selected and changed by rotating the neck 180 degrees and returning it to the base. With the voice recognition function of the sound source type changing means 39, when there is no desired song in the current ten songs, a voice signal instructing to change the type to another ten songs may be input.

  However, in the present embodiment, without using the voice recognition function of the sound source type changing means 39, 10 songs (10 sound source types) provided by the operation of the listener's head are changed. Therefore, in the present embodiment, when providing the next 10 songs (changing the type of sound source), the listener operates “turn the neck once in 360 degrees”, and this operation is determined in step ST14. . The determination in step ST14 is executed by the head movement determination means 33. When an operation of “turning the neck once in 360 degrees” is detected in step ST14, the next ten songs of the current search are provided to the localization sound source arrangement pattern in step ST15. If the listener performs a motion of swinging his / her head left and right thereafter, this is determined in step ST16, and the previous 10 songs are returned in step ST17.

  If the currently selected localization sound source arrangement pattern is difficult to hear the performance of 10 sound sources, the localization sound source arrangement pattern can be changed. The localization sound source arrangement pattern can be changed by tilting the neck left and right. Accordingly, in step ST18, it is determined whether or not this pattern change operation has been performed. When this pattern changing operation is detected, the process proceeds to step ST19 where the localization sound source arrangement pattern is changed. In this pattern change, for example, an order is assigned to the localization sound source arrangement patterns prepared in advance, and when the pattern change operation is performed once, the localization sound source arrangement pattern is changed in order. In this example, if you do not like the changed pattern, return to step ST1 from step ST20 by not performing any operation, and change the next pattern by performing the pattern changing operation again in step ST18. be able to. In step ST20, it is determined whether or not the listener has performed a determination operation instructing determination of a pattern and determination of a sound source (song) by performing a nodding operation (an operation of shaking the head up and down). To be done. That is, when the listener performs a determination operation in step ST20, it is determined that the music (sound source) in front of the listener is selected at the same time as the selection of the localization sound source arrangement pattern is completed. For this reason, when the determination operation is detected, the process proceeds to step ST21, where only the music (sound source) in front of the listener is played. If you don't like the song being played, you can just swing your head left or right (music change operation). When this operation is determined in step ST22, the process returns to step ST1. When returning to step ST1, provision of the virtual sound source is executed by the localization sound source arrangement pattern determined in step ST19. In particular, if the operation of shaking the head left and right is not performed, the reproduction of the selected song (sound source) is continued.

  In FIG. 11, symbols (A) to (D) are attached to the determination steps for determining the movements (A) to (D) of the listener's head or neck shown in FIG.

It is a block diagram which shows schematic structure of an example of a structure of the mixing apparatus which implements the sound source selection apparatus of this invention. It is a figure which shows the headphone with a sensor actually used. (A) thru | or (D) is a figure which shows the example from which a localization sound source arrangement | positioning pattern differs. It is a figure which shows the relationship between a listener's head and each angle. (A) thru | or (C) is the figure which replaced and simulated the relationship between an example of the localization sound source arrangement pattern and the amplification factor of each sound source by the amplification factor determination lever of the mixing device. It is a figure which shows the example of a certain localization sound source arrangement pattern, and the relationship of an amplification factor. (A) thru | or (C) is the figure which replaced and simulated the relationship of the amplification factor of each sound source with the amplification factor determination lever of the mixing device. (A) And (B) is the figure which replaced and simulated the relationship of the amplification factor of each sound source with the amplification factor determination lever of the mixing device. It is a figure which shows the multiplication image of the amplification factor currently performed by the mixing means. It is a flowchart figure which shows a part of algorithm of the program used when implement | achieving the sound source selection apparatus of this Embodiment using a computer. It is a flowchart figure which shows the remainder of the algorithm of the program used when implement | achieving the sound source selection apparatus of this Embodiment using a computer. It is a figure used in order to explain the operation mode of a head.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Mixing apparatus 3 Sound reproducing apparatus 5 Mixing means 7 Headphone 9 Arithmetic unit 13 Reference | standard azimuth | direction determination switch 15 Azimuth angle detection sensor 17 Elevation angle detection sensor 19 Narrowing infrared sensor 21 Elevation angle difference calculation means 22 Elevation angle difference detection means 23 Azimuth angle Difference calculation means 24 Azimuth angle difference detection means 25 Angle range determination means 26 Angle range setting means 27 Acoustic signal channel storage means 29 Channel selection means 31 Mixing unit 33 Head movement determination means 35 Sound source determination means 37 Sound source storage means 39 Sound source type change Means 41 Localized sound source arrangement pattern storage means 43 Arrangement pattern selection means

Claims (9)

Headphones, virtual sound source providing means for providing a plurality of virtual sound sources localized via the headphones to a listener wearing the headphones, and virtual sound source selection means for selecting one virtual sound source from the plurality of virtual sound sources A sound source selection device comprising:
The virtual sound source providing means stores a localization sound source arrangement pattern storage means for storing a plurality of localization sound source arrangement patterns of the plurality of virtual sound sources provided to the listener, and the plurality of the sound sources according to a selection operation of the listener Arrangement pattern selecting means for selecting a desired pattern from the localization sound source arrangement pattern, and mixing means for providing the plurality of virtual sound sources according to the localization sound source arrangement pattern,
A head motion detection sensor mounted on the headphones for detecting the motion of the listener's head, and a head motion determination means for determining the motion of the head based on the output of the head motion detection sensor. In addition,
The arrangement pattern selection means selects another localization sound source arrangement pattern from the localization sound source arrangement pattern storage means when the head movement determination means detects a predetermined arrangement pattern change operation from the movement of the head. A sound source selection device configured to output to mixing means. The virtual sound source providing unit, the speech recognition, according to claim 1, wherein the benzalkonium further comprise a tone generator type changing means for changing the type of the plurality of virtual sound sources provided in the sound source localization arrangement pattern Sound source selection device. The virtual sound source providing means, when the head movement determining means detects a predetermined sound source changing operation from the movement of the head, a sound source type for changing the types of the plurality of virtual sound sources provided by the localization sound source arrangement pattern sound source selection device according to claim 1, wherein the benzalkonium further include changing means.   The virtual sound source selecting unit determines a sound source when the head movement determining unit detects a predetermined sound source determining operation from the movement of the head after the arrangement pattern selecting unit selects the localization sound source arrangement pattern. The sound source selection device according to claim 1, further comprising sound source determination means for outputting a command to the mixing means. The head movement detection sensor is provided in the headphone, and is between a predetermined reference direction and an instruction direction in which a front face of the listener's face faces a virtual sound source space where the plurality of virtual sound sources exist. Azimuth angle difference detection means for detecting the azimuth angle difference of
The mixing means is configured to mix a plurality of sound signals supplied from a plurality of sound signal channels corresponding to the plurality of virtual sound sources and output the sound signals to a sound reproducing device,
Further, the mixing means includes
When the azimuth angle difference is 0 degree, the plurality of acoustic signals supplied from the plurality of acoustic signal channels are mixed and output as they are,
When the azimuth angle difference is other than 0 degrees, a state is created in which the positions of the plurality of virtual sound sources are fixed with reference to the reference azimuth, and the volume of the one or more virtual sound sources located in the indicated direction is Mixing is performed by performing volume adjustment and phase adjustment of the plurality of acoustic signals supplied from the plurality of acoustic signal channels so as to be larger than the volume of the one or more virtual sound sources when the azimuth angle difference is 0 degree. The sound source selection device according to claim 1, wherein the sound source selection device is configured to output the sound after being performed. Angle range setting means for setting a predetermined azimuth angle range centered on the indicated azimuth,
When the azimuth angle range is set, the mixing means makes the volume of one or more virtual sound sources within the azimuth angle range larger than the volume of other virtual sound sources outside the azimuth angle range. The sound source selection device according to claim 5 , wherein volume adjustment of the plurality of acoustic signals supplied from the plurality of acoustic signal channels is performed. The angle range setting means includes a distance detection sensor that is provided in the headphones and detects a distance between the operator's hand and the headphones, and the azimuth angle range when the distance detected by the distance detection sensor decreases. The sound source selection device according to claim 6 , wherein the azimuth angle range is increased when the distance detected by the distance detection sensor is increased. The sound source selection device according to claim 7 , wherein the distance detection sensor includes an infrared sensor that detects reflection by detecting reflection of infrared light applied to an operator's hand. The plurality of localization sound source arrangement patterns are composed of the plurality of virtual sound sources that are in a first elevation angle position as viewed from the listener and arranged in a azimuth direction at a predetermined interval within a first distance range. The first virtual sound source row and a predetermined interval within a second distance range that is at a second elevation angle position different from the first elevation angle position and further away from the listener than the first distance range. Including one or more localization sound source arrangement patterns including multiple virtual sound source sequences, including at least a second virtual sound source sequence composed of the plurality of virtual sound sources arranged in the azimuth direction with a gap therebetween,
Using the elevation angle of the headphone when the reference azimuth is determined as a reference elevation angle, a difference between the reference elevation angle and the elevation angle of the headphone is detected as an elevation angle difference, and the headphone is directed upward from the posture when the reference azimuth is determined. An elevation angle difference detection means for outputting an elevation angle difference that appears when the headphone is directed downward and an elevation angle difference that appears when the headphone is directed downward as a negative elevation angle difference;
The mixing means separates the volume of the plurality of virtual sound sources arranged in the indicated direction from the headphones in proportion to the elevation angle difference when the elevation angle difference detection means outputs the positive elevation angle difference. When the virtual sound source is made larger and the elevation angle difference detection means outputs the negative elevation angle difference, the headphone volume of the plurality of virtual sound sources arranged in the indicated direction is proportional to the elevation angle difference. It said to smaller virtual source away from a plurality of the preceding claims is configured to perform volume adjustment of the plurality of acoustic signals of the plurality of acoustic signal channels corresponding to the virtual sound source 5 arranged in the indication orientation The sound source selection device according to 1.