JP2013207759A - Portable terminal, sound source position control method, and sound source position control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to operate a sound source position virtually determined in space.SOLUTION: A portable terminal 1 includes: a hand action measuring section 16 for determining an operation of a main body of an own terminal and an operation direction; a sound source management section 17 for controlling a sound source position virtually determined in space around the main body on the basis of the determined operation and operation direction; and a regeneration section 23 that regenerates sound of the sound source on the basis of the controlled sound source position and then outputs the regenerated sound to a headphone 2.

Description

  The present invention relates to a portable terminal and the like.

  There is a surround system as a system that reproduces sound with a sense of presence by localizing a plurality of sound sources in a three-dimensional space.

  For example, the sound image is localized based on the sound source position and the user position in the virtual sound space, the sound information is processed as if it is heard from the sound source position toward the user position, and the sound information after the sound image localization process is respectively processed. The prior art of the output surround system is disclosed.

Japanese Patent Laid-Open No. 9-90963

  However, the conventional surround system has a problem that the user cannot operate the position of the localized sound source. That is, in the conventional surround system, if the sound image is localized based on the sound source position and the user position, the user cannot operate the position of the localized sound image.

  An object of the disclosed technique is to allow a user to operate the position of a localized sound source.

  In one aspect, the mobile terminal virtually determines in the space around the subject based on the determination unit that determines the operation and the direction of the operation of the subject terminal, and the operation and the direction of the operation determined by the determination unit. A position control unit that controls the position of the sound source localized in the position, a reproduction unit that reproduces the sound of the sound source based on the position of the sound source controlled by the position control unit, and outputs the reproduced sound to the headphones; Have

  According to one aspect of the mobile terminal disclosed in the present application, the user can operate the position of the localized sound source.

FIG. 1 is a functional block diagram illustrating the configuration of the sound source position control system according to the embodiment. FIG. 2 is a diagram illustrating the concept of the sound source position control method according to the embodiment. FIG. 3 is a diagram illustrating an example of a data structure of a sound source management table according to the embodiment. FIG. 4A is a diagram (1) illustrating the transition of the sound source management table. FIG. 4B is a diagram (2) illustrating the transition of the sound source management table. FIG. 4C is a diagram (3) illustrating the transition of the sound source management table. FIG. 5 is a flowchart illustrating the procedure of the sound source position control process according to the embodiment. FIG. 6 is a diagram for explaining detection of a hand action and a head posture. FIG. 7 is a diagram for explaining a case where the sound source position control method according to the embodiment is used in an exhibition navigation system. FIG. 8 is a diagram illustrating an example of a computer that executes a sound source position control program.

  Hereinafter, embodiments of a mobile terminal, a sound source position control method, and a sound source position control program disclosed in the present application will be described in detail with reference to the drawings. In addition, although an Example demonstrates the case where it applies to the sound source position control system which has a portable terminal and headphones, this invention is not limited by this Example.

[Configuration of sound source position control system]
FIG. 1 is a functional block diagram illustrating the configuration of the sound source position control system according to the embodiment. As shown in FIG. 1, in the sound source position control system 9, the mobile terminal 1 and the headphones 2 are connected. The connection between the portable terminal 1 and the headphones 2 may be wireless or wired.

  In the sound source position control system 9, the mobile terminal 1 determines the operation of the subject of the terminal itself and the direction of the operation, and is virtually localized in the surrounding space around the subject based on the determined operation and the direction of the operation. Control the position of the generated sound source. Then, the mobile terminal 1 reproduces the sound of the sound source based on the controlled position of the sound source, and outputs the reproduced sound to the headphones 2.

The concept of the sound source position control method executed by the sound source position control system 9 will be described with reference to FIG. FIG. 2 is a diagram illustrating the concept of the sound source position control method according to the embodiment. As shown in FIG. 2, a plurality of sound sources S _{1 to} S ₈ are localized in a surrounding space around the main body P. Such a space is divided into a plurality of regions according to the length of the distance from the subject. Here, the space is divided into concentric circles with the subject P as the center, and is divided into a focus area, a showcase area, and a defocus area from a shorter distance from the subject P. “Focus area” means an area where only the sound sources in this area are played. The “showcase area” means an area where a sound source in the showcase area is reproduced at an average volume, for example, when no sound source exists in the focus area. The “defocus area” means an area where the sound source in the defocus area is reproduced at a volume lower than the average volume when no sound source exists in the focus area.

The mobile terminal 1 selects a sound source that the subject P is interested in by one action, for example, a hand action (hereinafter referred to as a hand action), or moves the selected sound source between areas. Hand actions include, for example, a grabbing action, a pushing action, a pulling action, and a pushing action. As an example, the sound source entity P is noted When a S _1, the operation of grasping the direction in which principal P is the sound can be heard. Then, the mobile terminal 1 determines the direction of operation and gripping operation grabbing the entity P, and move the sound source S ₁ of the determined direction to the focus area. Then, the portable terminal 1 reproduces only the sound of the sound source S _{1 in} the focus area, and outputs the reproduced sound to the headphones 2. As another example, the operation of mainly P presses the direction heard the sound source S _1. Then, the mobile terminal 1 determines the direction of operation and pressing operation presses the main P, and moves the determined direction of the sound source S ₁ from the current focus area on one outer side of the showcase area. And the portable terminal 1 reproduces | regenerates all the sounds of the sound source in a showcase area, when a sound source does not exist in a focus area. Further, when the main P is an operation of pressing to the direction in which sounds of a sound source S _1, the mobile terminal 1 determines the direction of operation and pressing operation presses the main P, the source S ₁ of the determined direction from the showcase area Go to one outside of the defocusing area, to reproduce the sound of the sound source S ₁ with a smaller volume than the average volume. The sound sources S _{1 to} S ₈ are virtually localized in space, and when the subject P rotates the neck, the positions of the sound sources S _{1 to} S ₈ are moved by the localization process.

[Configuration of mobile terminal]
Returning to FIG. 1, the mobile terminal 1 corresponds to, for example, a mobile phone, but is not limited thereto, and may be a PDA (Personal Digital Assistants) or a portable personal computer. The portable terminal 1 includes a storage unit 10, a gyro sensor 11, an acceleration sensor 12, a geomagnetic sensor 13, an input unit 14, and an output unit 15. Furthermore, the portable terminal 1 includes a hand action measurement unit 16, a sound source management unit 17, a localization processing unit 18, a sound source selection unit 19, an amplification circuit 20, a mixer 21, SW 22, and a reproduction unit 23.

  The storage unit 10 corresponds to a storage device such as a nonvolatile semiconductor memory element such as a flash memory (Frash Memory) or an FRAM (registered trademark) (Ferroelectric Random Access Memory). Furthermore, the storage unit 10 includes sound source data 101 and a sound source management table 102. The sound source data 101 is data of a sound source that is not localized, that is, a monaural sound source. It is possible to store data for a number of sound sources that are divided as directions localized by the localization processing unit 18 described later. The sound source management table 102 is a table for managing each sound source in association with the localization direction and region. The information of the sound source data 101 and the sound source management table 102 may be downloaded from a server that manages the information when the sound source position control process is executed, for example.

Here, the data structure of the sound source management table 102 will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a data structure of a sound source management table according to the embodiment. As shown in the left diagram of FIG. 3, the sound source management table 102 stores the sound sources S _{1 to} S ₈ in association with the direction represented by each row and the region represented by each column. As the direction, a direction divided about the subject is set. For example, with the subject as the center, the direction 45 degrees to the right in front of the subject is A, the direction 45 degrees to 90 degrees right is B, the direction 90 degrees to 135 degrees right is C, and the direction 135 degrees to 180 degrees is D Is set. Centered around the subject, the left 45 ° direction on the subject's front is set to H, the left 45 ° to 90 ° direction is set to G, the left 90 ° to 135 ° direction is set to F, and the left 135 ° to 180 ° direction is set to E. Is done. A focus area, a showcase area, a defocus area, and a delete area are set in the area. The “delete area” means an area for managing sound sources that are not reproduced.

As an example, the sound source management table 102 in the left diagram of FIG. 3 manages the sound sources shown in the right diagram of FIG. Source S ₁ is associated with the direction H and the focus area. Source S ₂ is associated with the direction A and the de-focus area. Source S ₃ is associated with the direction B and the defocus area. Tone S ₄ is associated with the direction C and the showcase area. Tone S ₅ is associated with the direction D and delete area. Sound source S ₆ is associated with the direction E and showcase area. Sound source S ₇ is associated with the direction F and showcase area. Tone S ₈ is associated with the direction G and the defocus area.

  Returning to FIG. 1, the gyro sensor 11 detects the angular velocity. The acceleration sensor 12 detects acceleration in three orthogonal directions. The geomagnetic sensor 13 detects the direction. The input unit 14 corresponds to a touch panel (or keyboard, mouse, microphone) by pressing a button output to the output unit 15 described later, for example. The output unit 15 outputs various buttons, for example, and corresponds to a display (or monitor).

  The hand action measuring unit 16 uses the gyro sensor 11, the acceleration sensor 12, the geomagnetic sensor 13, the input unit 14, and the output unit 15 to measure the main hand action and the direction of the hand action. The hand actions to be measured are, for example, a grabbing action, a pushing action, a pulling action, and a pushing action. The grasping operation is realized, for example, by pressing a “grab” button output to the output unit 15. The “grab” button can be created by an application of the mobile terminal 1, for example. The hand action measurement unit 16 is an example of a determination unit.

  The sound source management unit 17 selects a sound source virtually localized in the space based on the direction of the hand action measured by the hand action measurement unit 16, and based on the hand action measured by the hand action measurement unit 16. Move the position of the selected sound source. The sound source management unit 17 is an example of a position control unit.

  For example, the sound source management unit 17 selects a sound source corresponding to the direction of the hand action measured by the hand action measurement unit 16 from the sound sources stored in the sound source management table 102. Then, the sound source management unit 17 moves the selected sound source from the region managed in the sound source management table 102 to a different region based on the hand action measured by the hand action measurement unit 16. As an example, when the hand action is “grab”, the sound source management unit 17 moves the selected sound source from the showcase area to the focus area. Further, when the hand action is “push”, the sound source management unit 17 moves the selected sound source to an area outside by one. In addition, when the hand action is “pull”, the sound source management unit 17 moves the selected sound source to an area inside one. When the hand action is “push away”, the sound source management unit 17 moves the selected sound source to the delete area to delete the selected sound source. The sound source management unit 17 then updates the sound source management table 102 so that the selected sound source is associated with the moved region and the direction of the sound source.

  The sound source management unit 17 notifies the localization processing unit 18 described later of the direction of each sound source stored in the sound source management table 102. In addition, the sound source management unit 17 notifies the sound source selection unit 19 (to be described later) of each sound source region stored in the sound source management table 102. The sound source management unit 17 also uses the sound source management table 102 to determine whether there is any sound source in the focus area. When the sound source management unit 17 determines that there is any sound source in the focus area, the sound source management unit 17 instructs the SW 22 to be described later to switch the switch to reproduce the sound source in the focus area. On the other hand, when the sound source management unit 17 determines that there is no sound source in the focus area, the sound source management unit 17 instructs the SW 22 to be described later to switch the switch to the direction of reproducing the sound source in the showcase area and the defocus area.

  The localization processing unit 18 localizes each monaural sound source according to the direction of each sound source, and acquires a stereo output for each sound source. For example, the localization processing unit 18 receives posture data of the main head from the head posture detection device 31 described later. The posture data includes, for example, an absolute angle indicating the front direction of the head. Then, the localization processing unit 18 is based on the front direction of the head included in the received posture data and the transfer characteristics (head transfer function) for each direction of each sound source notified from the sound source management unit 17. Localize the sound source. Then, the localization processing unit 18 acquires a stereo output for each localized sound source, and outputs the acquired stereo output of each sound source to the sound source selecting unit 19. The localization processing unit 18 has been described as localizing each sound source using transfer characteristics (head-related transfer function), but is not limited to this, and any technique that can localize each sound source. May be used.

The sound source selection unit 19 mixes the stereo output of each sound source according to the region of each sound source notified from the sound source management unit 17. For example, the sound source selection unit 19 outputs the stereo output of the focus area sound source amplifier 20 ₁ to be described later. Further, the sound source selection unit 19, the stereo output of the sound source of the showcase area to the amplifier circuit 20 ₂ to output the stereo output of the de-focus area tone to the amplifier circuit 20 _3.

The amplifier circuit 20, there are an amplifier circuit 20 ₃ for amplifying the sound of the amplifier circuit 20 ₂ and the defocus area to amplify the sound of the amplifier circuit 20 ₁ and the showcase area which amplifies the sound sources of the focus area. Gain a of the amplifier circuit 20 ₁ and the amplifier circuit 20 ₂ is greater than the gain b of the amplifier circuit 20 _3. Thus, the stereo output of the amplified by the amplifier circuit 20 ₁ and the amplifier circuit 20 ₂ sound source becomes greater volume than the stereo output is amplified by the amplifier circuit 20 _{by three} sources. The amplifier circuit 20 ₁ outputs the stereo output of the amplified sound source SW22. Amplifier circuit 20 ₂ and the amplifier circuit 20 ₃ outputs the stereo output of the sound source which are amplified to the mixer 21.

Mixer 21, together stereo output of each sound source output from the amplifier circuit 20 ₂ and the amplifier circuit 20 ₃ (mixes) to the SW22. That is, the mixer 21 mixes the sound source in the showcase area and the sound source in the defocus area. As a result, the subject listens to the sound of each sound source simultaneously from the direction of each sound source in the showcase area and the defocus area via the headphones 2.

The SW 22 switches the switch based on the switching instruction from the sound source management unit 17. For example, when the sound source management unit 17 instructs the SW 22 to switch the switch to play the sound source on the focus area side, the SW 22 switches the switch to the _one connected to the amplifier circuit 201. Further, when the sound source management unit 17 instructs the SW 22 to switch the switch to the direction of reproducing the sound source on the showcase area side and the defocus area side, the SW 22 switches the switch to the direction connected to the mixer 21.

  The reproduction unit 23 reproduces each sound source to the headphone output based on the position of each sound source controlled by the sound source management unit 17, that is, the area of each sound source. For example, when the playback unit 23 outputs from the focus area side through the SW 22, the playback unit 23 plays back the stereo output of the output sound source to the headphone output. Further, when output from the showcase area side and the defocus area side, that is, the mixer 21, by the SW 22, the playback unit 23 plays back the stereo output of each output sound source to the headphone output. That is, the reproducing unit 23 reproduces an output obtained by mixing the sound sources in the showcase area and the defocus area into a headphone output.

[Headphone configuration]
The headphone 2 is a device that is worn on the ear and listens to sound. Furthermore, the headphone 2 includes a head posture detection device 31 and an output device 32. The head posture detection device 31 detects posture data of the head of the subject wearing the headphones 2 and transmits the detected posture data to the mobile terminal 1. For example, the head posture detection device 31 may detect posture data of the main head using a gyro sensor. Although the head posture detection device 31 has been described as being provided inside the headphones 2, the head posture detection device 31 is not limited thereto, and may be provided outside the headphones 2.

  The output device 32 outputs the headphone output reproduced by the reproducing unit 23 to the outside of the headphones 2.

[Transition of sound source management table]
Next, how the sound source management table 102 changes as the sound source selected by the subject by hand action moves in the area is shown. 4A to 4C are diagrams for explaining transition of the sound source management table. 4A describes the transition when the subject (here, a person) grabs and pulls the sound source S ₇ , and FIG. 4B describes the transition when the subject performs the action of pushing the sound source S ₇ , in Figure 4C, mainly from the initial state will be described transition in a case where the operation to pull the sound source S _8.

As shown in the upper diagram of FIG. 4A, the sound source management table 102, the sound source S ₁ it is managed in association with the H direction and the focus area. In such a case, the mobile terminal 1 is to play only sound source S ₁ of the focus area, subject P is heard only the sound of the sound source S _1. And, as a main component P has an operation to pull grabbed the F direction of the sound source S ₇ in the hand action. Then, as shown in the lower portion of FIG. 4A, the sound source management table 102, the sound source S ₇ that were in the showcase area at the same time moves the focus area, the sound source S ₁ that has been in the focus area is moved to the showcase area. That is, the sound source management unit 17 selects the sound source S ₇ corresponding to the direction F of the grabbing and pulling operation. Then, the sound source managing unit 17, based on the operation of pulling grab, the sound source S ₇ selected is moved to the inside of the focus area of the showcase area. At the same time, the sound source managing unit 17 moves the sound source S ₁ that was in focus area showcase area. As a result, the mobile terminal 1 is to play only sound source S ₇ of the focus area, subject P is to be heard only the sound of the sound source S _7.

Further, as shown in the upper diagram in FIG. 4B, the sound source management table 102, the sound source S ₇ is managed in association with the F direction and the focus area. In such a case, the mobile terminal 1 is to play only sound source S ₇ of the focus area, subject P is heard only the sound of the sound source S _7. Then, it is assumed that the operations subject P is skip Press the F direction of the sound source S ₇ in the hand action. Then, as shown in the lower portion of FIG. 4B, the sound source management table 102, the sound source S ₇ that were in focus area moves to delete area. That is, the sound source management unit 17 selects the sound source S ₇ corresponding to the direction F of the pushing operation. Then, the sound source managing unit 17, based on the operation skip press, the sound source S ₇ selected is moved to the delete area. Accordingly, since the sound source in the focus area does not exist, the mobile terminal 1 mixes and reproduces the sound sources S ₁ , S ₄ , and S ₆ in the showcase area, and the main P performs the sound sources S ₁ , S ₄ , It will be heard for each sound of the S _6.

4C, the sound source management table 102 manages the sound sources S _{1 to} S ₈ in association with the showcase area as an initial state. In such a case, the portable terminal 1 mixes and reproduces all the sound sources S _{1 to} S ₈ in the showcase area, and the main body P can hear each sound of the sound sources S _{1 to} S ₈ . And, as a main component P has an operation to pull the G direction of the sound source S ₈ in the hand action. Then, as shown in the lower portion of FIG. 4C, the sound source management table 102, the sound source S ₈ that was in the showcase area is moved to the focus area. That is, the sound source management unit 17 selects the sound source S ₈ corresponding to the direction G of the pulling operation. Then, the sound source managing unit 17, based on the operation of pulling, the sound source S ₈ selected is moved to the focus area. As a result, the mobile terminal 1 is to play only sound source S ₈ of the focus area, subject P is to be heard only the sound of the sound source S _8.

[Sound source position control procedure]
Next, the procedure of the sound source position control process will be described with reference to FIG. FIG. 5 is a flowchart showing the procedure of the sound source position control process. Note that localization of each sound source is performed by the localization processing unit 18.

  First, when the sound source position control process is started, the sound source management unit 17 checks the sound source management table 102 (step S11). Then, as a result of the confirmation, the sound source management unit 17 determines whether there is a sound source in the focus area (step S12). When it is determined that there is a sound source in the focus area (step S12; Yes), the sound source management unit 17 instructs the SW 22 to switch the switch to the focus area side (step S13). That is, the sound source management unit 17 instructs the SW 22 to switch the switch to the direction of reproducing the sound source in the focus area. Then, the process proceeds to step S15.

  On the other hand, when it is determined that there is no sound source in the focus area (step S12; No), the sound source management unit 17 instructs the SW 22 to switch the switch to the mixer 21 side (step S14). That is, the sound source management unit 17 instructs the SW 22 to switch the switch to the direction of reproducing the sound source in the showcase area and the defocus area. Then, the process proceeds to step S15.

  In step S15, the playback unit 23 performs playback processing (step S15). That is, when the switch is on the focus area side, the playback unit 23 plays back the stereo output of the sound source in the focus area to the headphone output. On the other hand, when the switch is on the mixer 21 side, the reproducing unit 23 reproduces an output obtained by mixing the stereo outputs of the sound sources in the showcase area and the defocus area into a headphone output. Thereafter, the reproducing unit 23 outputs the reproduced headphone output to the headphones 2.

  Subsequently, the sound source management unit 17 waits for a hand action event (step S16). The sound source management unit 17 determines whether or not there is a hand action event (step S17). When it is determined that there is no hand action event (step S17; No), the sound source management unit 17 proceeds to step S16 to wait for a hand action event.

  On the other hand, if it is determined that there is a hand action event (step S17; Yes), the sound source management unit 17 updates the sound source management table 102 based on the hand action indicated by the event (step S18). For example, the sound source management unit 17 selects a sound source corresponding to the direction in which the hand action is performed. The sound source management unit 17 moves the selected sound source from the area managed in the sound source management table 102 to the area based on the hand action. The sound source management unit 17 then updates the sound source management table 102 so that the selected sound source is associated with the moved region and the direction of the sound source.

  Then, the sound source management unit 17 proceeds to step S11 to perform sound source position control based on the sound source management table 102.

[Hand action and head posture detection]
Next, detection of a hand action and a head posture will be described with reference to FIG. FIG. 6 is a diagram for explaining detection of a hand action and a head posture. As shown in FIG. 6, a selection button b1, a grabbing button b2, and a navigation start button b3 are displayed on the screen of the portable terminal 1 held by the subject P. In addition, the subject P wears the headphone 2 including the head posture detection device 31 on the head.

  Under such circumstances, the hand action measuring unit 16 of the mobile terminal 1 measures the hand action using the screen of the mobile terminal 1 and the acceleration sensor 12 (not shown) built in the mobile terminal 1. For example, the hand action measuring unit 16 recognizes the “grab” operation by detecting that the subject P has pressed the button b2 to be grabbed on the screen of the mobile terminal 1. The hand action measuring unit 16 measures each operation of “pull”, “push”, and “push-off” from the direction of the acceleration sensor 12 and the magnitude of the acceleration. Then, the hand action measuring unit 16 recognizes each operation based on the measured result.

  The hand action measuring unit 16 measures the direction of the sound source using a geomagnetic sensor 13 and a gyro sensor 11 (not shown) of the mobile terminal 1. The head posture detection device 31 measures the posture of the head using a gyro sensor (not shown) built in the device itself, and transmits the measured head posture data to the mobile terminal 1. Then, the localization processing unit 18 of the portable terminal 1 localizes each sound source of the sound source data 101 in conjunction with the posture of the head.

[Use of sound source position control method]
Next, the case where the sound source position control method according to the embodiment is used in the exhibition navigation system will be described with reference to FIG. FIG. 7 is a diagram for explaining a case where the sound source position control method according to the embodiment is used in an exhibition navigation system. It is assumed that the sound source management table 102 and the sound source data 101 corresponding to the room serving as the exhibition hall are registered in advance in a server (not shown) of the exhibition navigation system. In the sound source management table 102, as an initial state, sound sources related to the exhibitions 1 to 8 are managed in association with the showcase areas.

First, the server detects that the portable terminal 1 owned by the person P ₀ has entered the sound source download section Q of the exhibition hall, and obtains the sound source management table 102 and the sound source data 101 corresponding to the room serving as the exhibition hall. Download to ₀ mobile terminal 1. And the portable terminal 1 starts reproduction | regeneration of the sound source in a sound source position control system. That is, the mobile terminal 1 reproduces each sound source in the showcase area based on the sound source management table 102 and the sound source data 101.

Then, the person P ₀ stands in the center of the room and selects a sound source using a hand action. For example, the person P ₀ presses the button b2 to be grasped on the screen of the portable terminal 1 in FIG. 6 and presses the selection button b1 for the sound source that is interested, thereby confirming the selection of the sound source. The selected sound source is a sound source that moves from the showcase area to the focus area. The person P ₀ repeats this operation and selects a plurality of sound sources that are interested. Then, the navigation starts when the person P ₀ presses the navigation start button b3 on the screen of the mobile terminal 1 of FIG. That is, the mobile terminal 1 sequentially moves the selected sound source from the showcase area to the focus area, and reproduces the sound source in the focus area.

Note that the mobile terminal 1 may take a predetermined guide route from the server and play the selected sound sources in order based on the taken guide route. At the start of navigation, the portable terminal 1 transfers the profile data of the person P ₀ to the exhibition instructor side, and the person P ₀ can receive an explanation customized to the individual. .

[Effect of Example]
According to the above-described embodiment, the mobile terminal 1 determines the action of the subject of the terminal itself and the direction of the action, and is virtually localized in the space around the subject based on the determined action and the direction of action. Control the position of the sound source. Then, the mobile terminal 1 reproduces the sound of the sound source based on the position of the sound source, and outputs the reproduced sound to the headphones 2. According to such a configuration, the mobile terminal 1 controls the position of the sound source virtually localized in the space by the main operation, so that the main body can operate the position of the localized sound source. As a result, the mobile terminal 1 can reproduce the sound of the sound source based on the position of the sound source after the operation.

  Further, according to the above embodiment, the mobile terminal 1 selects a sound source virtually localized in the space based on the determined direction of the operation, and the position of the selected sound source based on the determined operation. Move. According to such a configuration, the mobile terminal 1 can select or further move the sound source of interest by the intuitive operation of the subject, and can reproduce based on the position of the moved sound source It becomes.

  Further, according to the above embodiment, in the mobile terminal 1, the sound source management table 102 is localized in a plurality of directions around the subject for each of a plurality of regions into which the space is divided according to the distance from the subject. Manage the generated sound source. Then, the mobile terminal 1 selects a sound source corresponding to the determined direction of operation from the sound sources managed in the sound source management table 102, and selects the selected sound source based on the determined operation. The area managed by 102 is moved to a different area. According to such a configuration, the mobile terminal 1 can reproduce the sound source that has been moved from region to region by the subject's action based on the moved region.

[Programs]
In the embodiment, the hand action measuring unit 16 has been described as measuring a gripping action, a pushing action, a pulling action, and a pushing action as the hand action to be measured. However, the hand action measurement unit 16 is not limited to these, and any operation is possible as long as the operation can move the sound source and can be measured using the gyro sensor 11, the acceleration sensor 12, the geomagnetic sensor 13, and the like. May be. Thereby, in the portable terminal 1, the subject can finely operate the position of the localized sound source.

  In the embodiment, the hand action measuring unit 16 has been described as measuring a hand action, that is, a hand movement. However, the hand action measuring unit 16 is not limited to this, and instead of the hand, the hand action, the entire foot, the trunk, and the head may be measured. In such a case, the user may attach the portable terminal 1 having the hand action measuring unit 16 to a part where the action is to be measured. Thereby, the sound source position control method can be used for general purposes.

  In the embodiment, the sound source position control system 9 is described as including the mobile terminal 1 and the headphones 2. However, the sound source position control system 9 is not limited to this, and may include a server. For example, the server manages the sound source management table 102 for each subject (mobile terminal). In this case, the sound source management unit 17 selects a sound source virtually localized in the space based on the direction of the hand action measured by the hand action measurement unit 16. Then, the sound source management unit 17 updates the sound source management table 102 of the server so as to move the position of the selected sound source based on the hand action measured by the hand action measurement unit 16. Then, the sound source management unit 17 inquires of the server about information of the sound source management table 102 related to the own terminal, and acquires information on the sound source for each area. As a result, the sound source management unit 17 can control the SW 22 and the sound source selection unit 19 based on the acquired sound source information for each area. Further, the server may include the hand action measurement unit 16 or the sound source management unit 17 as long as the sound source position control process can be realized in cooperation with the mobile terminal 1.

  It should be noted that each component of each illustrated apparatus does not necessarily have to be physically configured as illustrated. That is, the specific mode of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the input unit 14 and the output unit 15 may be integrated as one unit. On the other hand, the sound source management unit 17 may be distributed between a sound source selection unit that selects a sound source and a sound source moving unit that moves the selected sound source. In addition, storage units such as the sound source data 101 and the sound source management table 102 may be connected as an external device of the mobile terminal 1 via a network.

  The various processes described in the above embodiments can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. Therefore, in the following, an example of a computer that executes a sound source position control program that realizes the same function as the portable terminal 1 shown in FIG. 1 will be described. FIG. 8 is a diagram illustrating an example of a computer that executes a sound source position control program.

  As shown in FIG. 8, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives input of data from a user, and a display 203. The computer 200 also includes a reading device 204 that reads programs and the like from a storage medium, and an interface device 205 that exchanges data with other computers via a network. The computer 200 also includes a RAM 206 that temporarily stores various information and a hard disk device 207. The devices 201 to 207 are connected to the bus 208.

  The hard disk device 207 stores a sound source position control program 207a and sound source position control related information 207b. The CPU 201 reads the sound source position control program 207 a and develops it in the RAM 206. The sound source position control program 207a functions as a sound source position control process 206a.

  For example, the sound source position control process 206 a corresponds to the hand action measurement unit 16, the sound source management unit 17, the localization processing unit 18, and the sound source selection unit 19.

  Note that the sound source position control program 207a is not necessarily stored in the hard disk device 207 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk (FD), a CD-ROM, a DVD disk, a magneto-optical disk, and an IC card inserted into the computer 200. Then, the computer 200 may read out and execute the sound source position control program 207a from these.

  The following supplementary notes are further disclosed with respect to the embodiments including the above examples.

(Additional remark 1) The determination part which determines the operation | movement of the main body of an own terminal, and the direction of operation,
A position control unit that controls the position of the sound source virtually localized in the space around the subject based on the motion and the direction of motion determined by the determination unit;
A portable terminal comprising: a reproduction unit that reproduces sound of a sound source based on the position of the sound source controlled by the position control unit, and outputs the reproduced sound to headphones.

(Additional remark 2) The said position control part selects the sound source virtually localized in space based on the direction of the operation | movement determined by the said determination part, and selects based on the operation | movement determined by the said determination part The mobile terminal according to appendix 1, wherein the position of the sound source is moved.

(Supplementary Note 3) The position control unit
A management table for managing sound sources localized in a plurality of directions around the subject for each of a plurality of regions divided in space according to the length of the distance from the subject;
The sound source corresponding to the direction of the operation determined by the determination unit is selected from the sound sources managed in the management table, and the selected sound source is selected by the management table based on the operation determined by the determination unit. The mobile terminal according to Appendix 2, further comprising: a moving unit that moves the managed area to a different area.

(Appendix 4) The computer
Determine the actions and direction of the subject of the terminal itself,
Control the position of the sound source virtually localized in the space around the subject based on the motion and the motion direction determined by the determination processing,
A sound source position control method, comprising: executing a process of reproducing sound of a sound source based on the position of the sound source controlled by the process of controlling the position and outputting the reproduced sound to headphones.

(Appendix 5)
Determine the actions and direction of the subject of the terminal itself,
Control the position of the sound source virtually localized in the space around the subject based on the motion and the motion direction determined by the determination processing,
A sound source position control program that executes a process of reproducing sound of a sound source based on the position of the sound source controlled by the process of controlling the position and outputting the reproduced sound to headphones.

(Additional remark 6) It has a portable terminal and the headphones connected with this portable terminal,
The portable terminal is
A determination unit that determines the operation of the subject terminal and the direction of the operation;
A position control unit that controls the position of the sound source virtually localized in the space around the subject based on the motion and the direction of motion determined by the determination unit;
Based on the position of the sound source controlled by the position control unit, and a reproduction unit that reproduces the sound of the sound source,
The headphones are
A sound source position control system comprising an output unit that outputs sound reproduced by a previous reproduction unit.

DESCRIPTION OF SYMBOLS 1 Portable terminal 2 Headphone 10 Memory | storage part 101 Sound source data 102 Sound source management table 11 Gyro sensor 12 Acceleration sensor 13 Geomagnetic sensor 14 Input part 15 Output part 16 Hand action measurement part 17 Sound source management part 18 Localization processing part 19 Sound source selection part 20 Amplification circuit 21 Mixer 22 SW
23 playback unit 31 head posture detection device 32 output device

Claims (5)

A determination unit that determines the operation of the subject terminal and the direction of the operation;
A position control unit that controls the position of the sound source virtually localized in the space around the subject based on the motion and the direction of motion determined by the determination unit;
A portable terminal comprising: a reproduction unit that reproduces sound of a sound source based on the position of the sound source controlled by the position control unit, and outputs the reproduced sound to headphones.   The position control unit selects a sound source virtually localized in space based on the direction of the operation determined by the determination unit, and the position of the selected sound source based on the operation determined by the determination unit The mobile terminal according to claim 1, wherein the mobile terminal is moved. The position controller is
A management table for managing sound sources localized in a plurality of directions around the subject for each of a plurality of regions divided in space according to the length of the distance from the subject;
The sound source corresponding to the direction of the operation determined by the determination unit is selected from the sound sources managed in the management table, and the selected sound source is selected by the management table based on the operation determined by the determination unit. The mobile terminal according to claim 2, further comprising a moving unit that moves the managed area to a different area. Computer
Determine the actions and direction of the subject of the terminal itself,
Control the position of the sound source virtually localized in the space around the subject based on the motion and the motion direction determined by the determination processing,
A sound source position control method, comprising: executing a process of reproducing sound of a sound source based on the position of the sound source controlled by the process of controlling the position and outputting the reproduced sound to headphones. On the computer,
Determine the actions and direction of the subject of the terminal itself,
Control the position of the sound source virtually localized in the space around the subject based on the motion and the motion direction determined by the determination processing,
A sound source position control program that executes a process of reproducing sound of a sound source based on the position of the sound source controlled by the process of controlling the position and outputting the reproduced sound to headphones.

Images