JP6275557B2 - Audio output device - Google Patents

Description

  The present invention relates to a technique for selecting a menu using sound.

  A technique for realizing menu selection using a virtual surround technique is known. For example, in Patent Document 1, a plurality of menu sound images corresponding to a plurality of menu items are localized in a virtual three-dimensional sound field, and an arbitrary menu sound image is selected by the wearer moving his / her head and selected. It describes that a menu corresponding to a menu sound image is executed.

JP 2000-194460 A

However, as in the technique described in Patent Document 1, if the sound indicating the menu is simply output using the virtual surround technology, the entire menu cannot be recognized efficiently, or the sound source indicating the menu is In some cases, the position of the virtual sound source cannot be accurately recognized. In this case, the user may not be able to select the menu smoothly and may feel stress.
An object of this invention is to reduce the stress of the user who concerns on the selection of the menu using a sound.

  The present invention relates to an arrangement unit that arranges a virtual sound source indicating a menu around a user, and an audio signal indicating the sound is processed so that a sound indicating the menu can be heard from the virtual sound source arranged by the arrangement unit. A sound processing unit that performs sound processing, a speaker that outputs sound according to the sound signal subjected to the sound processing by the sound processing unit, a detection unit that detects the user's action, and a body in the direction of the virtual sound source And a selection unit that selects the menu in response to detection of an action to move the sound, wherein the sound output from the speaker changes according to a predetermined rule.

  The arrangement unit arranges a plurality of virtual sound sources indicating a plurality of menus at positions different from each other in the same direction by the user, and the sound processing unit includes a plurality of audio signals indicating the plurality of menus. Voice processing may be performed according to the distance.

  The plurality of menus include a first menu and a second menu, and the selection unit has detected a first action of moving a body in a direction in which the plurality of virtual sound sources are arranged by the detection unit. In this case, the first menu is selected, and the second menu is selected when the detection unit detects a second action of moving the body in the direction in which the plurality of virtual sound sources are arranged. May be.

  When a predetermined operation is detected by the detection unit when a first sound included in a plurality of sounds indicating the plurality of menus is output from the speaker, a source of the first sound is An output for outputting from the speaker at least one sound generated from at least one virtual sound source arranged in the same direction as the first virtual sound source in an order corresponding to a distance from the user to the at least one virtual sound source A control unit may be further provided.

  After outputting the 1st sound which shows the said menu from the said speaker, you may further provide the output control part which outputs the 2nd sound which shows the said menu from the said speaker.

  The sound is a voice that reads out the name of the menu, a partial voice that reads out the first character of the name is extracted from the voice, the extracted partial voice is output from the speaker, and a predetermined operation is performed. In such a case, an output control unit that outputs the sound from the speaker may be further provided.

  The arrangement unit arranges a first virtual sound source indicating a first menu and a second virtual sound source indicating a second menu, and the first menu and the second menu are different types. And the audio processing unit is different between a first audio signal of the first sound indicating the first menu and a second audio signal of the second sound indicating the second menu. Audio processing may be performed.

  When the predetermined operation is detected by the detection unit, the arrangement unit may delete the virtual sound source and arrange a new virtual sound source indicating another menu related to the menu.

  You may further provide the notification part which notifies the number of the said menu with a sound.

  The present invention provides an arrangement step of arranging a virtual sound source indicating a menu around a user, and processing an audio signal indicating the sound so that a sound indicating the menu can be heard from the virtual sound source arranged in the arrangement step. A sound processing step for performing sound processing, an output step for outputting sound according to the sound signal subjected to the sound processing in the sound processing step, a detection step for detecting the user's operation, and the virtual sound source. A selection step for selecting the menu in response to an action of moving the body in a different direction being detected in the detection step, wherein the sound output in the output step changes in accordance with a predetermined rule. Provide a method.

  ADVANTAGE OF THE INVENTION According to this invention, the stress of the user who concerns on selection of the menu using a sound can be reduced.

The figure which shows the external appearance of a wearable terminal. The figure which shows the hardware constitutions of a wearable terminal. The figure which shows the function structure of a wearable terminal. The flowchart which shows operation | movement of a wearable terminal. The figure which shows an example of arrangement | positioning of a virtual sound source. The figure which shows the other example of arrangement | positioning of a virtual sound source. The figure which shows the other example of arrangement | positioning of a virtual sound source. The figure which shows an example of arrangement | positioning of the virtual sound source which concerns on a modification. The figure which shows an example of arrangement | positioning of the virtual sound source which concerns on a modification. The figure explaining the detection method of the operation | movement which selects the menu which concerns on a modification.

1. Configuration FIG. 1 is a diagram illustrating an appearance of a wearable terminal 10. The wearable terminal 10 is an earphone type wearable computer. The wearable terminal 10 includes a right ear casing 101, a left ear casing 102, a cable 103, and a main body 104. The housing 101 is attached to the right ear of the user. The casing 101 accommodates a speaker 16-1. The housing 102 is attached to the user's left ear. The casing 102 accommodates a speaker 16-2. The cable 103 connects the housings 101 and 102 and the main body 104. The main body 104 reproduces sound in a stereo manner by supplying 2-channel audio signals to the speakers 16-1 and 16-2.

  FIG. 2 is a diagram illustrating a hardware configuration of the wearable terminal 10. The wearable terminal 10 has a function of realizing menu selection using a virtual surround technology. The wearable terminal 10 includes a control unit 11, a storage unit 12, a communication unit 13, an operation unit 14, a microphone 15, speakers 16-1 and 16-2, a positioning unit 17, a sensor unit 18, and a power source. 19. These components are connected via a bus or cable 103. Note that components other than the speakers 16-1 and 16-2 are basically housed in the main body 104. However, the sensor unit 18 is accommodated in the housing 101 or 102.

  The control unit 11 executes a program stored in the storage unit 12 to perform calculation of data and control of other components. For example, a CPU is used as the control unit 11. The storage unit 12 stores programs executed by the control unit 11 and various data. The storage unit 12 includes a main storage device and an auxiliary storage device. For example, a RAM is used as the main storage device. For example, a flash memory is used as the auxiliary storage device.

  The communication unit 13 is a communication interface for performing data communication. The communication unit 13 performs communication according to a near field communication standard such as Bluetooth (registered trademark). The operation unit 14 inputs a signal corresponding to a user operation to the control unit 11. For example, a touch sensor is used for the operation unit 14. The microphone 15 receives sound and inputs a signal corresponding to the received sound to the control unit 11. The speakers 16-1 and 16-2 output sound according to the audio signal.

  The positioning unit 17 measures the current position of the wearable terminal 10. For the positioning unit 17, for example, a GPS (Global Positioning System) receiver is used. The power source 19 supplies power to each component of the wearable terminal 10. For example, a battery is used as the power source 19.

  The sensor unit 18 is used to detect a user operation. The sensor unit 18 includes, for example, an acceleration sensor 181, an angular velocity sensor 182, and a geomagnetic sensor 183. The acceleration sensor 181 measures axial acceleration. The angular velocity sensor 182 measures the angular velocity in the axial direction. The geomagnetic sensor 183 measures the geomagnetism in the axial direction.

  FIG. 3 is a diagram illustrating a functional configuration of the wearable terminal 10. In this embodiment, the wearable terminal 10 functions as an audio output device. The wearable terminal 10 has functions of a notification unit 111, an arrangement unit 112, an audio processing unit 113, an output control unit 114, a detection unit 115, a selection unit 116, and an execution unit 117. These functions are realized by the control unit 11 executing one or a plurality of programs. Further, these functions may be realized by cooperation between the control unit 11 and other components.

  The notification unit 111 notifies the number of menus with sound. The placement unit 112 places a virtual sound source indicating a menu around the user. The audio processing unit 113 performs audio processing on the audio signal indicating the sound so that the sound indicating the menu can be heard from the virtual sound source arranged by the arrangement unit 112. The output control unit 114 causes the speakers 16-1 and 16-2 to output sound corresponding to the audio signal subjected to the audio processing by the audio processing unit 113. The detection unit 115 detects a user's operation. The selection unit 116 selects a menu in response to the movement of moving the body in the direction of the virtual sound source detected by the detection unit 115. The execution unit 117 executes processing corresponding to the menu selected by the selection unit 116.

2. Operation FIG. 4 is a flowchart showing the operation of the wearable terminal 10. This operation is started when an operation for starting the menu is performed by the user. This operation is a voice operation using a voice recognition technology. For example, this operation is started when the word “menu” is issued by the user.

  In step S101, the notification unit 111 notifies the number of menus with a sound. Specifically, the notification unit 111 outputs sound effects indicating the number of menus from the speakers 16-1 and 16-2. This sound effect is, for example, a drop sound falling on the water surface. This sound effect changes according to the number of menus. For example, the larger the number of menus, the longer the reverberation time of the sound effect.

  In step S <b> 102, the placement unit 112 places a virtual sound source serving as a sound generation source indicating a menu around the user. FIG. 5 is a diagram illustrating an example of the arrangement of virtual sound sources. FIG. 5 is a view of the placement of the virtual sound source as seen from above. In FIG. 5, the user's front direction is indicated by the y-axis direction, the user's rear direction is indicated by the −y-axis direction, the user's right direction is indicated by the x-axis direction, and the user's left direction is indicated by the −x-axis direction. It is shown in

  In the example shown in FIG. 5, virtual sound sources V1 to V8 corresponding to the first to eighth menus are arranged on a virtual circle C1 centered on the user. Specifically, the virtual sound source V1 is disposed in front of the user. The virtual sound source V2 is disposed on the right front side of the user. The virtual sound source V3 is arranged on the right side of the user. The virtual sound source V4 is arranged on the right rear side of the user. The virtual sound source V5 is disposed behind the user. The virtual sound source V6 is disposed on the left rear side of the user. The virtual sound source V7 is arranged on the left side of the user. The virtual sound source V8 is disposed on the left front side of the user.

  Note that “arranging the virtual sound source” specifically means determining the position of the virtual sound source. Therefore, “arranging the virtual sound sources V1 to V8” specifically means determining the position coordinates of the virtual sound sources V1 to V8 on the xy plane with the user as the origin.

  In the example shown in FIG. 5, the virtual sound source corresponding to the menu frequently selected by the user among the first to eighth menus is easily selected by the user, that is, the user's left front, front, or right front. May be arranged. For example, virtual sound sources corresponding to the top three menus with the highest selection frequency may be arranged on the left front, front, and right front of the user.

  FIG. 6 is a diagram illustrating another example of the arrangement of virtual sound sources. In the example shown in FIG. 6, a virtual circle C2 having a larger radius than the virtual circle C1 is formed outside the virtual circle C1. Similar to FIG. 5, virtual sound sources V1 to V8 corresponding to the first to eighth menus (an example of the first menu) are arranged on the virtual circle C1. On the virtual circle C2, virtual sound sources V9 to V16 corresponding to the ninth to sixteenth menus (an example of the second menu) are arranged. Specifically, the virtual sound sources V1 and V9 are both arranged in front of the user. However, the virtual sound source V1 is arranged at a position away from the user by a distance L1, and the virtual sound source V9 is arranged at a position away from the user by a distance L2. Virtual sound sources V1 and V9, virtual sound sources V3 and V11, virtual sound sources V4 and V12, virtual sound sources V5 and V13, virtual sound sources V6 and V14, virtual sound sources V7 and V15, and virtual sound sources V8 and V16 are also used. Have the same relationship. In the example illustrated in FIG. 6, the virtual sound source is arranged in two layers. However, when the number of menus is large, the virtual sound source may be arranged in three or more layers.

  In the example illustrated in FIG. 6, the placement of the virtual sound source may be determined according to the contents of the menu. For example, the virtual sound source corresponding to the main menu may be arranged on the virtual circle C1, and the virtual sound source corresponding to the sub menu may be arranged on the virtual circle C2. As another example, a virtual sound source corresponding to an important menu may be arranged on the virtual circle C2. The important menu is, for example, a menu related to payment processing or a menu related to deletion of mails and applications. As another example, a virtual sound source corresponding to a menu related to a function may be arranged on the virtual circle C1, and a virtual sound source corresponding to a menu related to a command executed in the function may be arranged on the virtual circle C2.

  In the example illustrated in FIG. 6, the placement of the virtual sound source may be determined according to the date and time attached to the menu. The date / time is, for example, a creation date / time or an update date / time when the menu relates to a file or data. For example, a virtual sound source corresponding to a menu with a date within a predetermined period such as one day, one week, or one month may be arranged on the virtual circle C1. In addition, virtual sound sources corresponding to menus with other dates may be arranged on the virtual circle C2.

  In the example illustrated in FIG. 6, the placement of the virtual sound source may be determined according to the menu selection frequency. For example, virtual sound sources corresponding to the top eight menus with the highest selection frequency may be arranged on the virtual circle C1. Further, virtual sound sources corresponding to other selection frequency menus may be arranged on the virtual circle C2.

  In the example illustrated in FIG. 6, the placement of the virtual sound source may be determined according to the category to which the menu belongs. For example, a virtual sound source corresponding to a menu belonging to the category “frequently used functions” may be arranged on the virtual circle C1. A virtual sound source corresponding to a menu belonging to the category “basic function” may be arranged on the virtual circle C2. When virtual sound sources are arranged in three layers, virtual sound sources corresponding to a menu belonging to the category “communication tool” may be arranged on the triple virtual circle. When virtual sound sources are arranged in four layers, virtual sound sources corresponding to a menu belonging to the category “downloaded application” may be arranged on the fourth virtual circle.

  FIG. 7 is a diagram illustrating another example of the arrangement of virtual sound sources. In the example shown in FIG. 7, virtual sound sources V1 to V4 corresponding to the first to fourth menus are arranged on the virtual circle C1 on the front, rear, left, and right sides of the user. In addition, virtual sound sources V5 to V8 corresponding to the fifth to eighth menus are arranged on the virtual circle C2 on the right front, right rear, left front, and left rear of the user. In this way, the virtual sound source arranged on one virtual circle may be arranged at a position that is not arranged in the same direction as the virtual sound source arranged inside the virtual circle when viewed from the user.

  In step S103, the sound processing unit 113 performs sound processing on the sound signal indicating the sound so that the sound of the menu can be heard from the virtual sound source arranged in step S102. This audio signal is stored in the storage unit 12 in advance. The menu sound is, for example, a voice that reads out the name of the menu. As another example, the sound of the menu may be a sound reminiscent of the menu. For example, a clicking sound may be used as a menu sound related to the setting. For sounds of menus related to music, sounds of instruments such as a piano and a trumpet and a part of music may be used. The sound when the letter enters the post may be used as the sound of the menu related to the mail.

  Humans recognize the direction and distance of sound arrival based on the difference in the volume of sound transmitted to the left and right ears, the difference in time, and the difference in frequency characteristics. Therefore, in the audio processing, a sound pressure level difference, a time difference, and a frequency characteristic difference are added to the audio signals supplied to the left and right speakers 16-1 and 16-2 according to the direction and position of the virtual sound source.

  In the example shown in FIG. 5, the virtual sound source V1 is arranged in front of the user. Therefore, the audio signal of the first menu corresponding to the virtual sound source V1 is subjected to audio processing so that the sound of the first menu can be heard from the front of the user. Further, the virtual sound source V2 is arranged on the right front side of the user. Therefore, the audio signal of the second menu corresponding to the virtual sound source V2 is subjected to audio processing so that the sound of the second menu can be heard from the front right of the user. Audio processing is similarly performed on the audio signals of the third to eighth menus corresponding to the virtual sound sources V3 to V8.

  In the example shown in FIG. 6, the virtual sound sources V1 and V9 are both arranged in front of the user. Accordingly, the first menu sound signal and the ninth menu sound signal corresponding to the virtual sound sources V1 and V9 both allow the first menu sound and the ninth menu sound to be heard from the front of the user. Is processed. However, the virtual sound source V1 is at a position away from the user by a distance L1, and the virtual sound source V9 is at a position away from the user by a distance L2. Therefore, the audio signal of the first menu is further subjected to audio processing so that the sound of the first menu can be heard from a position separated by the distance L1. The ninth menu sound signal is further subjected to sound processing so that the sound of the ninth menu can be heard from a position separated by a distance L2. That is, the audio signal of the first menu is further subjected to the audio signal according to the distance L1, and the audio signal of the ninth menu is further subjected to the audio processing according to the distance L2. Audio processing is similarly performed on the audio signals of the second to eighth menus corresponding to the virtual sound sources V2 to V8 and the audio signals of the tenth to sixteenth menus corresponding to the virtual sound sources V10 to V16.

  Thereby, for example, the sound pressure levels of the sound signals of the ninth to sixteenth menus are smaller than the sound pressure levels of the sound signals of the first to eighth menus. An echo effect may be added to the audio signals of the ninth to sixteenth menus corresponding to the virtual sound sources V9 to V16. As another example, when the virtual sound source is arranged in three or more layers, a predetermined effect may be added to the audio signal of the menu corresponding to the virtual sound source arranged in the intermediate layer.

  In step S104, the output control unit 114 performs a menu reading process. Specifically, the output control unit 114 supplies the audio signals subjected to the audio processing in step S103 to the speakers 16-1 and 16-2. At this time, the audio signal for the right ear is supplied to the speaker 16-1, and the audio signal for the left ear is supplied to the speaker 16-2. As a result, menu sounds are output from the speakers 16-1 and 16-2. The user recognizes the position of the virtual sound source corresponding to the menu by listening to the sound of the menu. In the reading process, menu sounds are output in a predetermined order.

  In the example shown in FIG. 5, when viewed in the clockwise direction with reference to the virtual sound source V1 arranged in front of the user, the arrangement order of the virtual sound sources V1 to V8 is the virtual sound sources V1, V2, V3, V4, V5, The order is V6, V7, and V8. In this case, for example, the sound of the first menu corresponding to the virtual sound source V1 is output first, and the sound of the second menu corresponding to the virtual sound source V2 is output second, so that the virtual sound sources V1 to V8 are output. The sounds of the first to eighth menus corresponding to may be output in the order corresponding to the clockwise direction.

  In the example illustrated in FIG. 5, the output control unit 114 causes the speakers 16-1 and 16-2 to sequentially output the first type of sound (an example of the first sound) indicating the first to eighth menus. After that, the second type sound (an example of the second sound) indicating the first to eighth menus may be output from the speakers 16-1 and 16-2 in order. The first type of sound is, for example, a voice that reads a menu name. The second type of sound is, for example, a voice that reads out the first character of the menu name. For example, it is assumed that the name of the first menu is “music”. In this case, when the sound of the first menu is output for the first time, the sound “ongaku” is output, and when the sound of the first menu is output for the second time, the sound “o” is output. It may be output. That is, in this example, the menu sound changes according to a predetermined rule when it is output for the second time. As another example, the sound of the first type may be a sound that reads out the name of the menu, and the sound of the second type may be a sound effect that reminds the menu.

  The output of the second type of sound may be started immediately after all of the first type of sound is output, or may be started in accordance with the user's operation. This operation is, for example, an operation of turning the head, and is detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182. Further, the order of outputting the second type of sound may be changed by the user's operation. For example, when the user performs an operation of turning his head counterclockwise, the second type of sound indicating the first to eighth menus may be output in an order corresponding to the counterclockwise direction.

  In the example shown in FIG. 5, as described above, virtual sound sources corresponding to the top three menus with the highest selection frequency may be arranged on the left front, front, and right front of the user. In this case, the output control unit 114 may repeat the process of sequentially outputting the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 from the speakers 16-1 and 16-2 a predetermined number of times. Thereafter, the output control unit 114 sequentially outputs only the sounds of the eighth, first, and second menus corresponding to the virtual sound sources V8, V1, and V2 arranged at the left front, front, and right front of the user. You may make it output from 16-1 and 16-2.

  In the example shown in FIG. 5, as described above, the voice that reads out the name of the menu may be used as the sound of the menu. In this case, the output control unit 114 may extract the voice that reads the first character of the name from the voice that reads the name of the menu, and output the extracted voice from the speakers 16-1 and 16-2 in order. For example, when the name of the first menu is “music”, the voice “o” (an example of a partial voice) is extracted from the voice “ongaku” and the sound of the first menu is output. In addition, a voice “O” may be output.

  In this case, when a predetermined operation is performed by the user, the output control unit 114 may cause the speakers 16-1 and 16-2 to sequentially output a sound that reads out all menu names. This predetermined operation is performed by, for example, an operation of tilting the head lightly or a gesture indicating that the head is not well understood, for example, an operation of tilting the head sideways. These operations are detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182, for example. As another example, the predetermined operation may be an operation of blowing on the microphone 15. For example, when a sound of “O” is output as the sound of the first menu and the user performs an operation of tilting his / her head sideways, the sound of “Ongaku” that reads the name of the first menu is read. Is output. That is, in this example, the sound of the menu changes according to a predetermined rule according to the user's operation.

  In the example shown in FIG. 6, after the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 are output in the order according to the clockwise direction, the ninth to ninth sounds corresponding to the virtual sound sources V9 to V16 are output. The sound of the 16th menu is output in the order corresponding to the clockwise direction. As described above, the voice signals of the ninth to sixteenth menus are subjected to voice processing different from the voice signals of the first to eighth menus. Therefore, when the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 arranged in the first hierarchy are output, and the ninth corresponding to the virtual sound sources V9 to V16 arranged in the second hierarchy. When the sound of the sixteenth menu is output, the size and tone color of the menu sound output from the speakers 16-1 and 16-2 changes according to a predetermined rule.

  In the example illustrated in FIG. 6, the output control unit 114 may change the sound of the menu to be output by the user's operation. This operation is, for example, an operation of tilting the head, and is detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182. For example, when the user tilts his / her head by the first angle, the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 arranged on the virtual circle C1 may be output in order. . When the user tilts the head by a second angle larger than the first angle, the sounds of the ninth to sixteenth menus corresponding to the virtual sound sources V9 to V16 arranged on the virtual circle C2 are output in order. May be.

  As another example, when the user tilts his / her head by the first angle, the sounds of the second to fourth menus corresponding to the virtual sound sources V2 to V4 arranged on the virtual circle C1 are sequentially output. May be. In addition, when the user tilts his / her head by a second angle larger than the first angle, the sounds of the second to sixth menus corresponding to the virtual sound sources V2 to V6 arranged on the virtual circle C1 are in turn. May be output.

  In the example shown in FIG. 6, as described above, the placement of the virtual sound source may be determined according to the category of the menu. In this case, in addition to the menu sound, a voice that reads out the category name may be output. For example, when the virtual sound sources V1 to V8 arranged on the virtual circle C1 correspond to a menu belonging to the category “Frequently Used Functions”, the voice “Frequently Used Functions” which is the name of this category is generated. After the output, sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 may be output. When the virtual sound sources V9 to V16 arranged on the virtual circle C2 correspond to a menu belonging to the category “basic function”, the voice “basic function” which is the name of this category is output. After that, the sounds of the ninth to sixteenth menus corresponding to the virtual sound sources V9 to V16 may be output.

  In step S105, the selection unit 116 selects a menu according to the user's operation. In the example shown in FIG. 5, since the virtual sound source V1 is arranged in front of the user, the sound of the first menu corresponding to the virtual sound source V1 can be heard from the front of the user. For example, when selecting the first menu corresponding to the virtual sound source V1, the user performs an operation of tilting the head forward (an example of the first operation). In this case, the detection unit 115 detects this operation based on the angular velocity measured by the angular velocity sensor 182, for example. When this operation is detected by the detection unit 115, the selection unit 116 selects the first menu corresponding to the virtual sound source V1 arranged in front of the user. At this time, a sound notifying that the menu selection has been executed may be output from the speakers 16-1 and 16-2.

  In the example shown in FIG. 6, the virtual sound source V1 and the virtual sound source V9 are both arranged in front of the user, but the virtual sound source V9 is arranged farther than the virtual sound source V1. In this case, the first menu sound corresponding to the virtual sound source V1 can be heard from near in front of the user. On the other hand, the ninth menu sound corresponding to the virtual sound source V9 can be heard from a distance in front of the user. For example, when selecting the ninth menu (an example of the second menu) corresponding to the virtual sound source V9, the user first flicks the virtual sound source V1 from the bottom to the top (an example of the second operation). ) For example, after tilting the head forward, the head is swung up. In this case, the detection unit 115 detects this operation based on the angular velocity measured by the angular velocity sensor 182. When this operation is detected by the detection unit 115, the positions of the virtual sound source V1 and the virtual sound source V9 are switched. Thereafter, the user performs an operation of tilting his / her head forward. In this case, the detection unit 115 detects this operation based on the angular velocity measured by the angular velocity sensor 182. When this operation is detected by the detection unit 115, the selection unit 116 selects the ninth menu corresponding to the virtual sound source V9 arranged closest to the front of the user.

  In step S106, the execution unit 117 executes processing corresponding to the menu selected in step S105.

  According to this embodiment, since the sound indicating the menu is output in order, the user can efficiently recognize all the menus. Also, according to the present embodiment, the first type of sound indicating a menu may be output the first time, and the second type of sound indicating a menu may be output the second time. Thereby, the troublesomeness by repeatedly outputting the same sound is prevented. Further, according to the present embodiment, a sound for reading out the first character of the menu name may be output, and a sound for reading out all the names of the menu may be output when a predetermined operation is performed by the user. As a result, a user who can recognize the menu only with the first character of the menu name can efficiently recognize all the menus. Further, a user who does not recognize the name of the menu so much can easily recognize the menu by performing a predetermined operation.

  In addition, in the example shown in FIG. 6, the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 are heard from near, and the sounds of the ninth to sixteenth menus corresponding to the virtual sound sources V9 to V16 are far away. I can hear it. Therefore, even when a plurality of virtual sound sources are arranged in the same direction, the user can accurately recognize the positions of the plurality of virtual sound sources. Thereby, the user can select a desired menu reliably.

3. The present invention is not limited to the above-described embodiment. For example, the embodiment may be modified as follows. Further, the following modifications may be combined.

(1) The type of operation for selecting a menu may be different depending on the menu. For example, the first menu may be selected by a normal pressing operation, and the second menu may be selected by a long pressing operation. The normal pressing operation is, for example, an operation of tilting the head. The long pressing operation is, for example, an operation in which the head is tilted for a predetermined time or longer. In this modification, the audio processing unit 113 has an effect different from the audio signal of the first menu (an example of the first audio signal) for the audio signal of the second menu (an example of the second audio signal). Is added. Therefore, in this modification, the speaker is used when the sound of the first menu (an example of the first sound) is output and when the sound of the second menu (an example of the second sound) is output. The timbre of the menu output from 16-1 and 16-2 changes according to a predetermined rule. Accordingly, it is understood that the user needs to perform a long press operation when selecting the second menu. Therefore, for example, when selecting the second menu, the state where the head is tilted in the right front direction where the virtual sound source V2 is arranged is continued for a certain period of time. When this operation is detected by the detection unit 115, the selection unit 116 selects the second menu.

(2) A new menu may be developed by the user's operation. FIG. 8 is a diagram illustrating an example of the arrangement of virtual sound sources according to the modification. For example, when the user moves toward the virtual sound source V2 corresponding to the second menu (an example of a predetermined operation), the placement unit 112 is related to the second menu after deleting the virtual sound sources V1 to V8. Virtual sound sources V17 to V24 corresponding to the new eight menus are arranged around the user. This movement is detected by the detection unit 115 based on the acceleration measured by the acceleration sensor 181, for example. The new menu may be, for example, a submenu of the second menu. As another example, if the second menu is related to an application, the new menu may be related to other applications related to this application, for example other applications belonging to the same category. When the virtual sound sources V17 to V24 are newly arranged, the processes of steps S103 to S105 described above are performed again. In this case, in step S103, sounds in the seventh to 24th menus corresponding to the newly arranged virtual sound sources V17 to V24 are output in order. That is, in this modification, the sound of the menu output from the speakers 16-1 and 16-2 changes according to a predetermined rule before and after the new menu is developed.

  The operation of arranging the virtual sound source corresponding to the new menu is not limited to the movement of the user. For example, this operation may be an operation in which the user tilts his / her head. In this case, the operation of selecting a menu and the operation of arranging a virtual sound source corresponding to a new menu may be distinguished depending on the angle at which the head is tilted. For example, when the user tilts his / her head toward the virtual sound source V2, a new menu related to the second menu may be developed as described in the present modification. On the other hand, when the user tilts his / her head toward the virtual sound source V2, the second menu may be selected.

(3) Menu sounds corresponding to a plurality of virtual sound sources arranged in the same direction may be output in order by a user operation. This is effective for efficiently recognizing these related menus, particularly when a plurality of virtual sound sources corresponding to a plurality of menus related to each other are arranged in the same direction.

  FIG. 9 is a diagram illustrating an example of the arrangement of virtual sound sources according to the present modification. In the example shown in FIG. 9, virtual circles C1 to C4 centering on the user are formed. The virtual circle C1 has the smallest radius. The virtual circle C2 has the second smallest radius. The virtual circle C3 has the third smallest radius. The virtual circle C4 has the largest radius. Similar to the example shown in FIG. 5, virtual sound sources V1 to V8 corresponding to the first to eighth menus are arranged in the virtual circle C1. A virtual sound source V9 corresponding to the ninth menu is arranged in the virtual circle C2. A virtual sound source V10 corresponding to the tenth menu is arranged in the virtual circle C3. A virtual sound source V11 corresponding to the eleventh menu is arranged in the virtual circle C4. The virtual sound sources V2k and V9 to V11 are all in the right front of the user (an example of the first direction).

  In the example shown in FIG. 9, as described in the embodiment, the sounds of the first to eighth menus corresponding to the virtual sound sources V1 to V8 are output in the order corresponding to the clockwise direction. Here, when the sound of the second menu corresponding to the virtual sound source V2 (an example of the second sound) is output, an operation in which the user looks into the back of the virtual sound source V2 (an example of a predetermined operation) For example, when the operation of shifting the head position to the left or right with the virtual sound source V2 as the center is performed, the output control unit 114 displays the menu corresponding to the virtual sound sources V1 to V8 arranged on the virtual circle C1. Stop sound output. This operation is detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182, for example. Subsequently, the output control unit 114 outputs the sounds of the ninth to eleventh menus corresponding to the virtual sound sources V9 to V11 arranged in the same direction as the virtual sound source V2 in the order corresponding to the distance from the user.

  In the example shown in FIG. 9, the virtual sound source V9 is arranged at a position separated from the user by a distance L2. The virtual sound source V10 is arranged at a position away from the user by a distance L3. The virtual sound source V11 is disposed at a position separated from the user by a distance L4. In this case, following the sound of the second menu, the sound of the ninth menu corresponding to the virtual sound source V9 is output, followed by the sound of the tenth menu corresponding to the virtual sound source V10, and subsequently virtual. As the sound of the eleventh menu corresponding to the sound source V11 is output, the sounds of the ninth to eleventh menus corresponding to the virtual sound sources V9 to V11 are short from the user to the virtual sound sources V9 to V11. It may be output in order.

  In the example illustrated in FIG. 9, the distances L2 to L4 may be changed according to the number of virtual sound sources. In addition, when a menu is selected when the operation amount of the gesture operation exceeds the threshold value, the threshold value of the operation amount of the gesture operation for selecting the menu corresponding to the virtual sound source according to the distance to the virtual sound source May be changed.

(4) The wearable terminal 10 may be used in cooperation with other terminals. The other terminal is, for example, a wristwatch type wearable terminal. Other terminals include various sensors such as an acceleration sensor in order to detect the movement of the user's hand. In this case, the operation for selecting the menu may be a hand motion instead of the head motion. In the example shown in FIG. 5, when the user moves his / her hand forward, the first menu corresponding to the virtual sound source V1 may be selected. This operation is detected by a sensor. In the example shown in FIG. 6, the first to eighth menus corresponding to the virtual sound sources V1 to V8 arranged in the virtual circle C1 may be selected by the action of moving the head. The ninth to sixteenth menus corresponding to the virtual sound sources V9 to V16 arranged in the virtual circle C2 may be selected by moving the hand. For example, when the user tilts his head forward, the first menu corresponding to the virtual sound source V1 may be selected. On the other hand, when the user moves his / her hand forward, the ninth menu corresponding to the virtual sound source V9 may be selected.

  As another example, the other terminal may be a glove-type wearable terminal. Other terminals include various sensors such as an acceleration sensor in order to detect the movement of the user's hand. Other terminals include a vibration unit. For example, an actuator is used for the vibration unit. In this case, the operation for selecting the menu may be a hand motion instead of the head motion. Further, the user may be notified that the menu has been selected by sound and vibration. In the example shown in FIG. 5, when the first menu corresponding to the virtual sound source V1 is selected by moving the hand forward by the user, a sound indicating that the menu has been selected is heard from the speaker 16-1. And 16-2, and the vibration part of another terminal may vibrate.

(5) The virtual sound source may be moved by the user's operation. In the example illustrated in FIG. 5, when the user performs an operation of turning his / her head, the virtual sound sources V <b> 1 to V <b> 8 may be rotated along the rotation direction. This operation is detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182, for example. As a result, the user can move the virtual sound source corresponding to the desired menu to a position that is easy to select.

  As another example, the virtual sound source may be moved according to the posture of the user wearing the wearable terminal 10. The posture of the user is detected based on the angular velocity measured by the angular velocity sensor 182, for example. For example, when the user is sleeping, it is difficult to select the fourth to sixth menus corresponding to the rear virtual sound sources V4 to V6. Therefore, the virtual sound sources V4 to V6 are moved to the front position where it is easy to select. May be.

(6) The method for detecting an operation for selecting a menu is not limited to the method described in the embodiment. FIG. 10 is a diagram illustrating a method for detecting an operation of selecting a menu according to a modification. In the example shown in FIG. 10, the region in the virtual circle C1 is divided into regions R1 to R8 by a line connecting the center of the virtual circle C1 and a point on the circumference. The regions R1 to R8 include one virtual sound source V1 to V8. The central angles of the regions R1, R3, R5, and R7 including the virtual sound sources V1, V3, V5, and V7 on the front, back, left, and right of the user are all θ1. On the other hand, the central angles of the regions R2, R4, R6, and R8 including the virtual sound sources V2, V4, V5, and V6 at the right front, right rear, left rear, and left front of the user are all larger than θ1. It is. In this modification, when the user tilts his / her head to the region R1, the first menu corresponding to the virtual sound source V1 is selected. When the user tilts his head to the region R2, the second menu corresponding to the virtual sound source V2 is selected. Generally, it is difficult to move the head accurately in an oblique direction, that is, right front, right rear, left rear, and left front. For this reason, for example, it is detected that the head is tilted to the right and the head is tilted to the right, and an unintended menu may be selected. However, according to this modification, it is detected that the head is tilted in an oblique direction without accurately tilting the head in an oblique direction, and thus such erroneous menu selection can be suppressed.

(7) Menu reading processing is not limited to the example described in the embodiment. For example, when the user performs an action of turning his / her head, the sound of the menu corresponding to the virtual sound source arranged within the range of turning the head may be output. This operation is detected by the detection unit 115 based on the angular velocity measured by the angular velocity sensor 182, for example. As another example, when the user performs an action of turning his / her head, the playback speed of the menu sound may change depending on the initial speed of the head. This initial velocity is detected by the detection unit 115 based on the acceleration measured by the acceleration sensor 181, for example. For example, the higher the initial speed of the head, the higher the playback speed of the menu sound.

(8) The operation of selecting a menu is not limited to the example described in the embodiment. In the example shown in FIG. 6, when the user tilts his / her head forward by a first angle, the first menu corresponding to the virtual sound source V1 may be selected. When the user tilts the head forward by a second angle larger than the first angle, a ninth menu corresponding to the virtual sound source V9 may be selected. In the example shown in FIG. 6, when the user moves forward one step and then tilts his head forward, the ninth menu corresponding to the virtual sound source V9 may be selected.

(9) The arrangement of the virtual sound source is not limited to the example described in the embodiment. For example, when the sound of the menu is a voice that reads out the name of the menu, the virtual sound sources may be arranged in an arrangement order such that the virtual sound sources corresponding to the menu having the same initial name are not adjacent to each other.

(10) The menu is not limited to the example described in the embodiment. The menu may be related to music or images downloaded to the wearable terminal 10.

(11) The wearable terminal 10 is not limited to the example shown in FIG. For example, the wearable terminal 10 may have other shapes such as an ear hook type or an overhead type.

(12) The program executed by the control unit 11 of the wearable terminal 10 may be downloaded via a communication line such as the Internet. The program is provided in a state of being recorded on a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. May be.

(13) The distance from the user to the virtual sound source may be changed according to the situation. For example, when the menu relates to an application, the distance to the virtual sound source corresponding to the menu may be changed according to the use frequency of the application. For example, if the sixteenth, ninth, and tenth menus corresponding to the virtual sound sources V16, V9, and V10 shown in FIG. L2 may be made smaller than the initial value. However, the distance L2 is made larger than the distance L1.

  As another example, when the menu is related to a mailer or a call application, the distance to the virtual sound source corresponding to the menu may be changed according to the occurrence of an event such as reception of mail or incoming call. For example, when the first menu corresponding to the virtual sound source V1 shown in FIG. 6 relates to the mailer, the distance L1 may be made smaller than the initial value when a mail is received. At this time, the distance L2 does not change.

  As another example, the distance to the virtual sound source may be changed according to the amount of exercise of the user. For example, when the user is walking, the distance L1 shown in FIG. 6 may be larger than the initial value. This user's walking is detected based on the acceleration measured by the acceleration sensor 181, for example.

10: Wearable terminal, 16-1 and 16-2: Speaker, 111: Notification unit, 112: Arrangement unit, 113: Audio processing unit, 114: Output control unit, 115: Detection unit, 116: Selection unit, 117: Execution , 181: acceleration sensor, 182: angular velocity sensor, 183: geomagnetic sensor

Claims (10)

A placement unit for placing a virtual sound source indicating a menu around the user;
Wherein as voice to speak the name of the menu from the arranged the virtual sound source by the arrangement unit is heard, and the sound processing unit that performs sound processing on the audio signal indicating the voice,
A speaker that outputs a sound corresponding to the sound signal subjected to the sound processing by the sound processing unit;
A detection unit for detecting the user's action;
A selection unit that selects the menu in response to the action of moving the body in the direction of the virtual sound source detected by the detection unit ;
An output for extracting a partial voice that reads out the first character of the name from the voice, outputting the extracted partial voice from the speaker, and outputting the voice from the speaker when a predetermined operation is performed. With control
An audio output device comprising: An arrangement unit that arranges a plurality of virtual sound sources indicating a plurality of menus at positions different from each other by a different distance in the same direction;
Wherein such plurality of sounds indicative of the plurality of menus from arranged the plurality of virtual sound sources by the arrangement unit is heard, the sound processing unit that performs speech processing in accordance with the distance to a plurality of sound signals indicating the plurality of menus When,
A speaker for outputting a plurality of sounds corresponding to the plurality of audio signals in which the audio processing has been performed by the audio processing unit,
A detection unit for detecting the user's action;
A selection unit that selects the menu in response to the action of moving the body in the direction of the virtual sound source detected by the detection unit;
When a predetermined operation is detected by the detection unit when a first sound included in a plurality of sounds indicating the plurality of menus is output from the speaker, a source of the first sound is An output for outputting from the speaker at least one sound generated from at least one virtual sound source arranged in the same direction as the first virtual sound source in an order corresponding to a distance from the user to the at least one virtual sound source With control
An audio output device comprising: The arrangement unit arranges a plurality of virtual sound sources indicating a plurality of menus at positions different from each other by different distances in the same direction from the user,
The audio output device according to claim 1, wherein the audio processing unit performs audio processing on a plurality of audio signals indicating the plurality of menus according to the distance. The plurality of menus include a first menu and a second menu,
The selection unit selects the first menu when the first operation of moving the body in the direction in which the plurality of virtual sound sources are arranged is detected by the detection unit, and the plurality of virtual sound sources are The audio output device according to claim 3 , wherein the second menu is selected when the detection unit detects a second action of moving the body in the arranged direction. The output control unit is configured to detect the first operation when a predetermined operation is detected by the detection unit when the first sound included in the plurality of sounds indicating the plurality of menus is output from the speaker. At least one sound generated from at least one virtual sound source arranged in the same direction as the first virtual sound source that is the sound generation source in the order according to the distance from the user to the at least one virtual sound source The audio output device according to claim 3, wherein the audio output device is configured to output from the speaker. The output control section, after the first sound indicative of the menu is output from the speaker, the audio output device according to claim 1 or 2 to output the second sound indicating the menu from the speaker. The sound is a voice that reads out the name of the menu,
An output for extracting a partial voice that reads out the first character of the name from the voice, outputting the extracted partial voice from the speaker, and outputting the voice from the speaker when a predetermined operation is performed. The audio output device according to claim 2 , further comprising a control unit. The arrangement unit arranges a first virtual sound source indicating a first menu and a second virtual sound source indicating a second menu,
The first menu and the second menu are selected by different types of actions,
The audio processing unit performs different audio processing on a first audio signal of a first sound indicating the first menu and a second audio signal of a second sound indicating the second menu. The audio output device according to 1 or 2 . The arrangement unit, when said predetermined operation is detected by the detection unit, the delete the virtual sound source, to claim 1 or 2, placing the new virtual sound source of another menu related to the menu The audio output device described. The audio output device according to claim 1 or 2 further comprising a notification unit that notifies by sound the number of the menu.

Images