WO2016178328A1

WO2016178328A1 - Wearable device, information processing method and program

Info

Publication number: WO2016178328A1
Application number: PCT/JP2016/052451
Authority: WO
Inventors: 正樹秋常; 高橋　敏; 小林　信夫; 角田　直隆
Original assignee: ソニー株式会社
Priority date: 2015-05-01
Filing date: 2016-01-28
Publication date: 2016-11-10

Abstract

[Problem] To provide a wearable device, information processing method and program capable of improving operability of an operation unit of said wearable device in cases in which said unit is outside of a user's view. [Solution] A wearable device is provided with an operation unit that is located outside of a user's view when said device is worn by said user and a display control unit that causes a display unit to display information relating to the operation of said operation unit.

Description

Wearable device, information processing method, and program

The present disclosure relates to a wearable device, an information processing method, and a program.

2. Description of the Related Art Conventionally, various types of wearable devices for a user to watch images and music by wearing them on their bodies such as headphones and HMD (Head Mounted Display) have been developed.

For example, Patent Literature 1 describes a headphone in which a plurality of operation keys for a user to perform a reproduction instruction, an end instruction, and the like are installed outside the headband.

JP 2000-32582 A

However, with the technique described in Patent Document 1, the operability is low when the wearable device is worn by the user. For example, when a headphone provided with operation keys is worn on the user's head, the operation keys are located outside the user's field of view. For this reason, the user cannot visually recognize the position of the desired operation key, and it is difficult for the user to perform the desired operation or to perform an erroneous operation.

Therefore, the present disclosure proposes a new and improved wearable device, information processing method, and program capable of improving operability when the operation unit of the wearable device is located outside the user's field of view. .

According to the present disclosure, when the wearable device is worn by a user, an operation unit disposed outside the user's field of view, and a display control unit that displays information related to operations on the operation unit on the display unit, A wearable device is provided.

According to the present disclosure, there is provided an information processing method comprising: when a wearable device is worn by a user, displaying information related to an operation on an operation unit arranged outside the user's field of view on a display unit. Provided.

Further, according to the present disclosure, when the wearable device is worn by a user, the computer functions as a display control unit that causes the display unit to display information related to operations on the operation unit arranged outside the user's field of view. A program is provided to make it happen.

As described above, according to the present disclosure, it is possible to improve the operability when the operation unit of the wearable device is located outside the user's field of view. Note that the effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

It is explanatory drawing which showed a mode that the user was wearing the headphones 10 by 1st Embodiment. FIG. 3 is an explanatory diagram showing an appearance when the headphones 10 according to the embodiment are viewed from below. It is explanatory drawing which showed a mode that the user has applied the right hand to the right housing of the headphones 10 by the embodiment. FIG. 4 is an explanatory diagram showing an external appearance when the right housing of the headphone 10 according to the embodiment is viewed obliquely from below. FIG. 4 is an explanatory diagram showing a configuration example of a projection unit of the headphones 10 according to the embodiment. 2 is a functional block diagram showing an internal configuration of a headphone 10 according to the same embodiment. FIG. It is explanatory drawing which showed the example of the image projected by the projection part of the embodiment. FIG. 6 is an explanatory diagram illustrating an example of projection of an image when a user's hand approach or contact with a sensor of the headphone is detected. FIG. 6 is an explanatory diagram illustrating another example of projection of an image when the approach or contact of a user's hand to a sensor of the headphone is detected. FIG. 6 is an explanatory diagram illustrating another example of projection of an image when the approach or contact of a user's hand to a sensor of the headphone is detected. It is explanatory drawing which showed the example of a projection of the image when a user performs music feeding operation. It is the flowchart which showed the operation | movement by the embodiment. It is explanatory drawing which showed a mode that the user was mounting | wearing with HMD30 by 2nd Embodiment. It is explanatory drawing which showed the structural example of the bottom face of HMD30 by the embodiment. It is explanatory drawing which showed a mode that a user operated the operation part of HMD30 by the embodiment. It is the functional block diagram which showed the structural example of HMD30 by the embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

In the present specification and drawings, a plurality of constituent elements having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. For example, a plurality of configurations having substantially the same functional configuration are distinguished as the operation unit 122a and the operation unit 122b as necessary. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given. For example, when there is no need to distinguish between the operation unit 122a and the operation unit 122b, they are simply referred to as the operation unit 122.

Further, the “DETAILED DESCRIPTION OF THE INVENTION” will be described according to the following item order.
1. Background 2 1. First embodiment Second Embodiment 4. Modified example

<< 1. Background >>
The present disclosure can be implemented in various forms as described in detail in “2. First Embodiment” to “3. Second Embodiment” as an example. First, in order to clearly show the features of the present disclosure, the background that led to the creation of the wearable device according to the present disclosure will be described.

Conventionally, various headphones for listening to music by wearing on the head have been developed. For example, an operation unit is installed outside the headphones, and headphones that allow a user to issue a reproduction instruction, an end instruction, or the like by operating the operation unit have been developed.

However, in such headphones, since the operation unit is located outside the user's field of view during wearing, it is impossible to confirm which operation unit should be operated when the user wants to perform a desired operation. And in order for a user to perform reliable operation, the user needs to be skilled in operation, such as memorizing arrangement of an operation part.

Furthermore, if the user makes a mistake in the operation, it is inconvenient because the user cannot notice an operation error unless the operation is reflected in the headphones. For example, the user cannot recognize whether or not a song has been sent or returned without playing the song. In addition, since the music that the user listens to for the first time does not know the content of the music, the user may not know whether the music has been sent or returned in the first place.

As a method of solving the above problem, a method of generating a sound effect for reaction when operating the operation unit is conceivable. However, in this method, it is necessary to have a one-to-one correspondence between sound effects and operations. For this reason, in order for a user to operate reliably, since a user needs to memorize the sound effect for every operation, it is inconvenient.

Therefore, the wearable device according to the present disclosure has been created by focusing on the above circumstances. According to the present disclosure, it is possible to improve operability by causing the display unit to display information related to an operation on the operation unit located outside the user's field of view when the wearable device is mounted. Hereinafter, each embodiment of the present disclosure will be sequentially described in detail.

<< 2. First Embodiment >>
<2-1. External configuration>
First, the first embodiment will be described. FIG. 1 is an explanatory diagram showing a state in which the user 2 is wearing the headphones 10 according to the first embodiment. This headphone 10 is an example of a wearable device according to the present disclosure.

As shown in FIG. 1, the headphone 10 includes a right housing 12a and a left housing 12b. The right housing 12a and the left housing 12b are examples of the first unit or the second unit in the present disclosure. The right housing 12a is a portion that covers the user's right ear, and the left housing 12b is a portion that covers the user's left ear. The user can listen to the sound output from the headphones 10 by attaching the right housing 12a and the left housing 12b to the ear.

Further, as shown in FIG. 1, the headphones 10 include, for example, an operation unit 122 and a projection unit 126. Further, as illustrated in FIG. 1, the operation unit 122 is located outside the user's field of view while wearing the headphones 10. As will be described later, the operation unit 122 is a part for the user to operate the headphones 10 while the headphones 10 are being worn. The projection unit 126 is a part that projects image information by light emission. For example, as illustrated in FIG. 1, the projection unit 126 can project an image onto a projection surface such as a palm of a user by projecting light.

As shown in FIG. 1, the operation unit 122 and the projection unit 126 can be installed in different housings 12. For example, when the operation unit 122 is installed in the right housing 12a, the projection unit 126 is installed in the left housing 12b. According to such a configuration, when the palm is used as the projection plane, the user is mounted on the left side of the body center line while operating the operation unit 122 mounted on the right side of the body center line with the right hand. It is possible to project the light projected by the projection unit 126 on the left hand. Therefore, the user can easily see the projected image while performing an operation on the operation unit 122 due to the structure of the human body.

The operation unit 122 may be installed in the left housing 12b, and the projection unit 126 may be installed in the right housing 12a. Further, the operation unit 122 and the projection unit 126 can be installed in the same housing 12.

[2-1-1. Operation unit 122]
The operation unit 122 is a part for the user to operate various functions of the headphones 10. Here, the contents of the operation unit 122 will be described in detail with reference to FIG. FIG. 2 is an explanatory diagram showing an appearance when the headphones 10 are viewed from below. As shown in FIG. 2, for example, a plurality of operation units 122 (operation keys 122a, operation keys 122b, and operation keys 122c) may be installed on the bottom surface of the right housing 12a.

(2-1-1-1. Operation keys 122a)
Here, the operation keys 122a can be associated with functions such as playing a song, pausing, sending a song, returning a song, adjusting the volume, and receiving a call. Further, the operation key 122a may be configured by, for example, a cross key or a lever.

For example, as indicated by the four-directional arrows in FIG. 2, “tune feed” is performed when the operation key 122a is moved rightward, and “music return” is performed when the operation key 122a is moved leftward. When the operation key 122a is moved upward, the function of “increase volume” is executed, and when the operation key 122a is moved downward, the function of “decrease volume” is executed.

Also, when the operation key 122a is pushed by the user, the functions of “song playback” and “pause” are executed. Further, when the user presses the operation key 122a while a call is being made to a telephone (not shown) that is wirelessly connected to the headphones 10, a call to the telephone is received, and A call can be made by the headphones 10.

(2-1-1-2. Operation keys 122b)
Further, the operation key 122b can be associated with functions such as setting of a noise canceling function and establishment of wireless communication with other devices, for example. For example, when the operation key 122b is pushed by the user, switching between ON and OFF of the noise canceling function is executed. Further, when the operation key 122b is pressed for a long time, for example, establishment or cancellation of pairing with another device is executed by Bluetooth (registered trademark).

(2-1-1-3. Operation keys 122c)
The operation key 122c can be associated with, for example, a function of adjusting the focus of projection by the projection unit 126. Further, the operation key 122c may be configured as a drum type, for example. For example, when the operation key 122c is rotated by the user, the projection focus is moved.

(2-1-1-4. Power operation key 122d)
Further, as shown in FIG. 2, for example, a power operation key 122d can be installed on the bottom surface of the left housing 12b. The power operation key 122d is a key for switching the power of the headphones 10 between ON and OFF. In addition, it is not limited to said example, 122 d of power supply operation keys may be provided in the right housing 12a.

[2-1-2. Sensor 124]
The sensor 124 is, for example, a capacitive touch sensor or a proximity sensor. This sensor 124 measures the approach or contact of the user's hand. The sensor 124 is associated with each of the plurality of operation units 122 provided in the headphone 10 in advance, and can be installed in the vicinity of the installation position of the associated operation unit 122. Thereby, the sensor 124 can measure the approach or contact of the user's hand with respect to the associated operation unit 122.

FIG. 3 is an explanatory diagram showing a state in which the user places the right hand on the right housing 12a in order to perform an operation on the operation unit 122. FIG. 4 is an explanatory diagram showing a configuration when the right housing 12a is viewed from an obliquely downward direction. As shown in FIGS. 3 and 4, for example, the sensor 124a can be installed near the operation key 122a, the sensor 124b can be installed near the operation key 122b, and the sensor 124c can be installed near the operation key 122c. As described above, the sensor 124 is basically installed at a location where the user touches the associated operation key 122 when the user tries to touch it or a location where the user's hand approaches.

[2-1-3. Projection unit 126]
The projection unit 126 is an example of a display unit in the present disclosure. The projection unit 126 projects image information by light emission. The projection unit 126 can project an image on the palm of the user, for example, or can project an image on a user's wearing object, a desk, a floor, a wall, or the like. Further, the projection unit 126 may be a pico projector, for example.

Here, a configuration example of the projection unit 126 will be described in detail with reference to FIG. As shown in FIG. 5, the projection unit 126 includes, for example, an LED (Light Emitting Diode) 1260, a collimator lens 1262, an LCD (Liquid Crystal Display) 1264, and a convex meniscus lens 1266.

The collimator lens 1262 is a lens that transforms incident light into parallel rays. As shown in FIG. 5, the collimator lens 1262 transforms the light emitted by the LED 1260 into parallel light rays. The LCD 1264 is a transmissive LCD, for example. For example, the LCD 1264 transmits light only in the region of the image to be projected among the light rays that have passed through the collimator lens 1262. The convex meniscus lens 1266 is a lens that diverges incident light. For example, the convex meniscus lens 1266 diverges the light transmitted through the LCD 1264. Then, the diverged light is projected onto the projection surface.

Note that the projection method by the projection unit 126 is not limited to the above example, and for example, a method using laser light may be used.

Also, the projection direction of the projection unit 126 may be automatically adjustable based on, for example, a user operation on the operation unit 122, or may be manually adjustable by the user. Alternatively, the projection direction of the projection unit 126 may be fixed.

<2-2. Internal configuration>
The external configuration according to the first embodiment has been described above. Next, the internal configuration of the headphone 10 according to the first embodiment will be described in detail. FIG. 6 is a functional block diagram showing the internal configuration of the headphones 10 according to the first embodiment. As illustrated in FIG. 6, the headphone 10 includes a control unit 100, a communication unit 120, an operation unit 122, a sensor 124, a projection unit 126, and an audio output unit 128. In addition, below, description is abbreviate | omitted about the content which overlaps with said description.

[2-2-1. Control unit 100]
The control unit 100 generally controls the operation of the headphones 10 using hardware such as a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory) built in the headphones 10. As shown in FIG. 6, the control unit 100 includes a detection unit 102 and a display control unit 104.

[2-2-2. Detection unit 102]
The detection unit 102 detects the approach or contact of the user's hand with respect to the operation unit 122 associated with the sensor 124 based on the measurement result by the sensor 124. For example, the detection unit 102 simultaneously detects the approach or contact of the user's hand to each operation unit 122 associated with each of the plurality of sensors 124 based on the measurement results of the plurality of sensors 124.

According to such a configuration, before the user operates the operation unit 122, it is possible to detect which operation unit 122 the user is trying to operate.

[2-2-3. Display control unit 104]
(2-2-3-1. Display control example 1)
The display control unit 104 causes the projection unit 126 to project information indicating a function associated with the operation unit 122 when the detection unit 102 detects the approach or contact of the user's hand to the operation unit 122.

FIG. 7 is an explanatory diagram showing an example (image 20) of an image projected by the projection unit 126. As shown in FIG. 7, the image 20 includes a display showing the function associated with each operation key 122. For example, the image 20 is a song playback, pause, song advance, song return, volume adjustment, call button, wireless communication connection display, noise cancel function status display, focus amount display by the projection unit 126, volume control Includes display and battery level display.

As illustrated in FIG. 7, for example, a display group of a plurality of functions associated with the operation unit 122 a is above the image 20, and a plurality of functions associated with the operation unit 122 b are near the center of the image 20. The function display group and the function display group associated with the operation unit 122c may be displayed together below the image 20, respectively. Further, on the right side of the image 20, a display group indicating the state of the headphones 10 such as a set value of a volume and a remaining battery level can be displayed.

(2-2-3-2. Display control example 2)
More specifically, the display control unit 104 causes the projection unit 126 to project information indicating a function associated with the operation unit 122 in which the approach or contact of the user's hand is detected. For example, when there are a plurality of operation units 122 in which the approach or contact of the user's hand is detected, the display control unit 104 is associated with the operation unit 122 having the highest priority among the plurality of operation units 122. The information indicating the function is projected on the projection unit 126, and the information indicating the function associated with the other operation unit 122 is not projected on the projection unit 126.

Here, the above functions will be described in more detail with reference to FIGS. Here, it is assumed that the priority of each operation unit 122 is determined so that the order of priority is the operation key 122a, the operation key 122b, and the operation key 122c.

For example, when the approach or contact of the user's hand to the three operation units 122 of the operation key 122a, the operation key 122b, and the operation key 122c is detected, the display control unit 104 is as shown in FIG. In addition, the function display group 220a associated with the operation key 122a (having the highest priority) is projected onto the projection unit 126, and the function display group 220b associated with the operation key 122b is associated with the operation key 122c. The projection unit 126 is not allowed to project the display group 220c having the function thus obtained.

In this case, the headphones 10 can accept only the user's operation on the operation key 122a, and can not accept the user's operation on the operation key 122b and the operation key 122c. If it is detected that the operation key 122b or the operation key 122c is operated by the user, for example, the display control unit 104 displays a display indicating the type of the operation key operated by the user (as a reaction). 126 can be projected. According to this projection example, since the user can understand what the key operated by the user is, the user does not feel stress.

Alternatively, the headphones 10 may be able to accept a user operation on the operation key 122b or the operation key 122c.

When the approach or contact of the user's hand with respect to the two operation units 122 of the operation key 122b and the operation key 122c is detected, the display control unit 104, as shown in FIG. The display group 220b of the function associated with the operation key 122b is projected onto the projection unit 126, and the display group 220c of the function associated with the operation key 122c is not projected onto the projection unit 126.

In this case, the headphones 10 can accept only the user's operation on the operation key 122b, and can not accept the user's operation on the operation key 122c. If it is detected that the operation key 122c is operated by the user, for example, the display control unit 104 displays a display indicating the type of the operation key operated by the user (that is, the operation key 122c) (as a reaction). The projection unit 126 can project the image. Alternatively, the headphones 10 may be able to accept user operations on the operation keys 122c.

Further, when the operation unit 122 in which the approach or contact of the user's hand is detected is only the operation key 122c, the display control unit 104 has a function associated with the operation key 122c as illustrated in FIG. The display group 220c is projected on the projection unit 126.

According to the above projection example, it is possible to convey as visual information what function can be operated by the operation unit 122 that the user is currently touching (and what function cannot be operated).

As shown in FIGS. 8 to 10, when the approach or contact of the user's hand with respect to any one or more operation units 122 is detected, the display control unit 104 indicates the state of the headphones 10. The display group 222 may be fixedly projected on the projection unit 126.

Note that the priority of each of the plurality of operation units 122 may be determined such that, for example, the operation unit 122 installed at a position closer to the end in a predetermined direction has a higher priority. For example, in the example illustrated in FIG. 3, the priority may be set such that the priority is higher in the operation unit 122 located further rearward when the headphones are worn. That is, in the example illustrated in FIG. 3, the priority of each operation unit 122 may be determined so that the priority becomes higher in the order of the operation key 122c, the operation key 122b, and the operation key 122a.

(2-2-3-3. Display control example 3)
Further, the display control unit 104 causes the projection unit 126 to project information indicating a function associated with each of the plurality of operation units 122 at a display position corresponding to each installation position of the plurality of operation units 122 in the headphone 10. . More specifically, the display control unit 104 determines the order relationship between the installation positions of the plurality of operation units 122 in the headphones 10 and the display position order of information indicating the functions associated with each of the plurality of operation units 122. The projection unit 126 is caused to project information indicating the function associated with each of the plurality of operation units 122 so that the relationship matches.

For example, when a plurality of operation units 122 are installed side by side in the vertical direction, information indicating a function associated with the operation unit 122 installed at a higher position is displayed at a higher position. Information indicating a function associated with each of the operation units 122 is projected on the projection unit 126. In addition, when a plurality of operation units 122 are installed side by side in the left-right direction, the information indicating the function associated with the operation unit 122 installed on the right side is such that the display position is on the right side. In addition, information indicating the function associated with each of the operation units 122 is projected on the projection unit 126.

As shown in FIG. 3, when at least one of the plurality of operation units 122 is located on the rear side of the headphones 10, that is, on the rear side of the user's head when worn, the display control unit 104 is Of the plurality of operation units 122, the information indicating the function associated with the operation unit 122 located on the rear side of the headphones 10 is projected onto the projection unit 126 so that the display position in the display area is on the upper side.

Here, the above functions will be described in more detail. In the example illustrated in FIG. 3, each operation unit 122 is installed in the headphone 10 so that the operation key 122 c, the operation key 122 b, and the operation key 122 a are positioned behind in this order. Therefore, for example, as shown in FIGS. 8 to 10, the display control unit 104 displays the function display group 220c associated with the operation key 122c, the function display group 220b associated with the operation key 122b, and the operation key 122a. In order of the display group 220a of the associated functions, the projection unit 126 projects the display position so that the display position in the display area is higher. According to this display example, information associated with each operation unit 122 is sequentially displayed downward in accordance with the order of each operation unit 122 that is touched when the user slides his / her finger forward from behind the headphones 10. Can be made. As a result, the user can imagine the actual arrangement of each operation unit 122 by viewing the transition of the projected image, and the operation becomes easier.

(2-2-3-4. Display control example 4)
Further, when an operation is performed on the operation unit 122, the display control unit 104 can also highlight and display information indicating a function associated with the operation unit 122. For example, in the above case, the display control unit 104 causes the display indicating the function associated with the corresponding operation unit 122 to blink, temporarily change the color, or temporarily display brightly.

For example, when an operation corresponding to “music feed” is performed on the operation unit 122 by the user, the display control unit 104 of the projected image 24, as shown by hatching in FIG. 11. The display corresponding to “tune feed” is blinked and projected on the projection unit 126. According to this projection example, the user can visually confirm the contents of the operation performed by the user immediately after the operation.

[2-2-4. Communication unit 120]
The communication unit 120 transmits and receives information to and from other devices connected by wire or wireless. For example, the communication unit 120 receives sound information from another device.

[2-2-5. Audio output unit 128]
The sound output unit 128 outputs sound according to the control of the control unit 100. For example, the audio output unit 128 converts music information selected based on an operation on the operation unit 122 into a sound wave and outputs the sound wave.

The functions of other components are the same as described in section 2-1.

<2-3. Operation>
The internal configuration according to the first embodiment has been described above. Next, the operation according to the first embodiment will be described with reference to FIG. Here, the three sensors 124 of “sensor A”, “sensor B”, and “sensor C” are installed in the headphones 10, and the operation unit 122 a and sensor B associated with the sensor A are used. It is assumed that the three operation units 122, that is, the operation unit 122 b associated with, and the operation unit 122 c associated with the sensor C are installed in the headphones 10. Also, it is assumed that the priority of each operation unit 122 is determined so that the order of priority is the operation unit 122a, the operation unit 122b, and the operation unit 122c.

FIG. 12 is a flowchart showing an operation example according to the first embodiment. As shown in FIG. 12, first, the user turns on the power of the headphones 10 by pushing the power operation key 122d of the headphones 10 (S101).

Thereafter, the detection unit 102 of the headphone 10 determines whether or not there is a sensor 124 that is “ON” among the three sensors 124, that is, whether or not there is a sensor 124 that is approaching or touching the user's hand. Is confirmed (S103). When all the sensors 124 are “OFF” (S103: No), the detection unit 102 performs the operation of S103 again after a predetermined time, for example.

On the other hand, when there is a sensor 124 that is “ON” (S103: Yes), the detection unit 102 confirms whether or not the sensor A is “ON” (S105). When the sensor A is “ON” (S105: Yes), the display control unit 104 causes the projection unit 126 to project only the display group indicating the functions operable by the operation unit 122a associated with the sensor A ( S107). Thereafter, the headphones 10 perform an operation of S115 described later.

On the other hand, when the sensor A is “OFF” (S105: No), the detection unit 102 confirms whether the sensor B is “ON” (S109). When the sensor B is “ON” (S109: Yes), the display control unit 104 causes the projection unit 126 to project only a display group indicating a function operable by the operation unit 122b associated with the sensor B ( S111). Thereafter, the headphones 10 perform an operation of S115 described later.

On the other hand, when the sensor B is “OFF” (S109: No), the display control unit 104 projects only the display group indicating the functions operable by the operation unit 122c associated with the sensor C onto the projection unit 126. (S113).

Thereafter, the detection unit 102 of the headphone 10 monitors the measurement results of the three sensors 124 and determines whether at least one of the three sensors 124 is “ON” within a certain time ( S115). If at least one sensor 124 is “ON” within a certain time (S115: Yes), the headphones 10 performs the operation of S105 again.

On the other hand, when a certain time has passed with all the sensors 124 being “OFF” (S115: No), the display control unit 104 ends the projection of the image to the projection unit 126 (S117). Thereafter, the headphone 10 performs the operation of S103 again.

<2-4. Effect>
[2-4-1. Effect 1]
As described above with reference to FIGS. 1, 6, and 12, for example, the headphone 10 according to the first embodiment includes the operation unit 122 that is located outside the user's field of view when worn, and the operation Projection information is projected on the projection unit 126. For this reason, when the headphone 10 is worn, the user can visually confirm information related to the operation on the operation unit 122, so that the operability can be improved.

For example, the headphone 10 causes the projection unit 126 to project a display indicating a function associated with each of the plurality of operation units 122 on, for example, the palm of the user. For this reason, when the user wants to perform a desired operation while wearing the headphones 10, the user can visually confirm which of the plurality of operation units 122 should be operated. Therefore, even if the user is not skilled in the operation, the user can perform a reliable operation.

In addition, if the user makes a mistake in the operation, the user can be aware of an operation error before the operation content is reflected in the headphones 10. For example, the user can notice whether or not a song has been sent or returned by checking the projected image even immediately before the song is played.

[2-4-2. Effect 2]
In addition, the headphone 10 projects the menu screen on the projection unit 126, and enables various operations on the menu screen based on user operations on the operation unit 122. For example, the user can perform various and complicated operations such as selecting a function included in the menu screen and selecting a song or album to be reproduced from a plurality of songs or albums.

<< 3. Second Embodiment >>
The first embodiment has been described above. Next, a second embodiment will be described. As will be described later, according to the second embodiment, when the HMD 30 is mounted (instead of the headphones 10), it is possible to cause the HMD 30 to display information related to operations on the operation unit of the HMD 30.

<3-1. External configuration>
First, the external configuration of the HMD 30 according to the second embodiment will be described. FIG. 13 is an explanatory view showing a state in which the user wears the HMD 30. The HMD 30 is an example of a wearable device according to the present disclosure. As illustrated in FIG. 13, the user 2 can view the video displayed by the HMD 30 by wearing the HMD 30 on the head.

FIG. 14 is an explanatory view showing a configuration example of the bottom surface of the HMD 30. As shown in FIG. 14, a plurality of operation units 322 are installed on the bottom surface of the HMD 30. The operation unit 322 is a part that is located outside the user's field of view while the HMD 30 is being worn, and for the user to operate various functions of the HMD 30. For example, as shown in FIGS. 13 and 15, the user can operate the operation unit 322 by holding the HMD 30 with both hands and pushing the operation unit 322 with, for example, the thumb.

Further, as shown in FIG. 14, a sensor 324 is installed in the vicinity of each operation unit 322.

In addition, when the HMD 30 is grasped by hand, the range that the thumb can reach is only from the outer periphery of the HMD 30 toward the inside. Therefore, the priority of each of the plurality of operation units 322 can be determined such that the priority is higher in the operation unit 322 closer to the center of the HMD 30. For example, in the example illustrated in FIG. 14, the priority is determined so that the priority becomes higher in the order of the operation unit 322c, the operation unit 322b, and the operation unit 322a.

<3-2. Internal configuration>
The external configuration according to the second embodiment has been described above. Next, the internal configuration of the HMD 30 according to the second embodiment will be described in detail. FIG. 16 is a functional block diagram showing the internal configuration of the HMD 30. As illustrated in FIG. 16, the HMD 30 includes a control unit 300, a communication unit 320, an operation unit 322, a sensor 324, a display unit 326, and an audio output unit 328. The functions of the communication unit 320, the operation unit 322, the sensor 324, and the voice output unit 328 are substantially the same as those of the communication unit 120, the operation unit 122, the sensor 124, and the voice output unit 128 according to the first embodiment, respectively. is there.

[3-2-1. Control unit 300]
The control unit 300 generally controls the operation of the HMD 30 using hardware such as a CPU, RAM, and ROM built in the HMD 30. Further, as illustrated in FIG. 16, the control unit 300 includes a detection unit 302 and a display control unit 304. The function of the detection unit 302 is substantially the same as that of the detection unit 102 according to the first embodiment.

[3-2-2. Display control unit 304]
The display control unit 304 causes the display unit 326 to display information related to the operation on the operation unit 322 when the detection unit 302 detects the approach or contact of the user's hand to the operation unit 322. Note that the specific functions of the display control unit 304 are substantially the same as those of the display control unit 104 according to the first embodiment, except that the display unit 326 is controlled instead of the projection unit 126.

[3-2-3. Display unit 326]
The display unit 326 is configured by a light emitting display such as an LCD or an OLED (Organic Light Emitting Diode). The display unit 326 displays video, images, and the like under the control of the display control unit 304.

<3-3. Operation>
The internal configuration according to the second embodiment has been described above. The operation according to the second embodiment is substantially the same as the operation according to the first embodiment shown in FIG.

<3-4. Effect>
As described above with reference to FIGS. 13 and 16, for example, the HMD 30 according to the second embodiment includes the operation unit 322 located outside the user's field of view when worn, and the operation on the operation unit 322. The display unit 326 is caused to display information regarding the above. For this reason, the effect similar to 1st Embodiment is acquired.

Further, since the HMD 30 includes the display unit 326 (display) in terms of the configuration of the device, there is an advantage that it is not necessary to include the projection unit 126 as compared with the first embodiment.

<< 4. Modification >>
The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present disclosure belongs can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present disclosure.

<4-1. Modification 1>
[4-1-1. Device example 1]
In each of the embodiments described above, an example in which the wearable device according to the present disclosure is the headphone 10 or the HMD 30 has been described, but the present disclosure is not limited to such an example. For example, the wearable device may be a device that operates in cooperation with a display device such as a television receiver, such as surround headphones.

The surround headphone according to the first modification includes an operation unit located outside the user's field of view when worn, and displays information related to operations on the operation unit on the display device. For this reason, according to the modification 1, the effect similar to 1st Embodiment is acquired.

[4-1-2. Device example 2]
Alternatively, the wearable device according to the present disclosure may be a helmet equipped with an action cam, or may be a glasses-type computer.

<4-2. Modification 2>
Moreover, although each embodiment mentioned above demonstrated the application example in case a user performs operation with respect to an operation part in the state with which the wearable apparatus which has an operation part was mounted | worn, this indication is not limited to this example. For example, the present disclosure can also be applied to a scene in which the operation unit is located outside the user's field of view when the user attempts to perform an operation on an operation unit included in a device other than the wearable device.

As an example, when the user's hand approaching or touching the operation unit installed in the vehicle is detected while the user is driving the vehicle, a display indicating the function of the operation unit is displayed, for example, on the windshield. It is also possible to display them. Alternatively, if the approach or contact of the user's hand to a surgical instrument such as an endoscope is detected while the doctor is performing an operation, information on the state of the surgical instrument is projected onto the projector. May be. Alternatively, when the approach or contact of the user's hand to the work tool outside the user's field of view is detected while the worker is working in the factory, information on the work tool is projected onto the projector. You may let them.

<4-3. Modification 3>
Moreover, although each embodiment mentioned above demonstrated the application example in case a user directly operates with respect to an operation key, this indication is not limited to this example. For example, the present disclosure can be applied to a scene where a user performs a gesture operation on a gesture sensor (not shown). As an example, when the gesture sensor detects that the user has performed a predetermined gesture operation in front of the gesture sensor, a display indicating a function previously associated with the detected gesture operation may be projected on the projector. Good.

<4-4. Modification 4>
Moreover, according to each embodiment mentioned above, the computer program for making hardware, such as CPU, ROM, RAM, etc. exhibit the function equivalent to each structure of the headphones 10 or HMD30 mentioned above can also be provided. A recording medium on which the computer program is recorded is also provided.

The following configurations also belong to the technical scope of the present disclosure.
(1)
When the wearable device is worn by a user, an operation unit arranged outside the user's field of view;
A display control unit for displaying information on an operation on the operation unit on a display unit;
A wearable device comprising:
(2)
The wearable device according to (1), wherein the information related to the operation includes information indicating a function associated with the operation unit.
(3)
The wearable device further includes a detection unit that detects the approach or contact of the user's hand to the operation unit,
The said display control part is a wearable apparatus as described in said (2) which displays the information regarding the said operation on the said display part based on the detection result by the said detection part.
(4)
The wearable device has a plurality of the operation units,
The wearable device according to (3), wherein the display control unit causes the display unit to display information on the operation with respect to the operation unit in which the approach or contact of the user's hand is detected among the plurality of operation units. .
(5)
When there are a plurality of operation units in which the approach or contact of the user's hand is detected among the plurality of operation units, the display control unit is configured to perform a plurality of operations in which the approach or contact of the user's hand is detected. The mounting according to (4), wherein information regarding the operation with respect to the operation unit having the highest priority among the units is displayed on the display unit, and information regarding the operation with respect to another operation unit is not displayed on the display unit. Mold device.
(6)
The wearable device has a plurality of the operation units,
The display control unit displays information related to the operation on each of the plurality of operation units at a display position corresponding to an installation position of each of the plurality of operation units in the wearable device. The wearable device according to any one of 5).
(7)
The display control unit is configured so that an order relationship between the installation positions of the plurality of operation units in the wearable device matches an order relationship between display positions of information regarding the operation with respect to each of the plurality of operation units. The wearable device according to (6), wherein information related to the operation for each of the plurality of operation units is displayed.
(8)
The display control unit causes the operation unit located on the rear side of the wearable device among the plurality of operation units to display information regarding the operation on the upper side of the display area. apparatus.
(9)
The wearable die according to (8), wherein when the wearable device is worn on the user's head, at least one or more of the plurality of operation units is located on a rear side of the user's head. apparatus.
(10)
The wearable device has a plurality of the operation units arranged in one direction,
Each of the plurality of operation units has a display priority,
The priority of each of the plurality of operation units is set according to any one of (2) to (9), wherein the operation unit closer to an end in the one direction has a higher priority. Wearable device.
(11)
The wearable device according to any one of (1) to (10), wherein the display unit is a projection unit that projects an image.
(12)
The wearable device according to (11), wherein the wearable device further includes the projection unit.
(13)
The wearable device according to (11) or (12), wherein the wearable device is a headphone.
(14)
The said projection part is a wearable apparatus as described in said (12) or (13) which projects an image on the said user or the user's wearing thing.
(15)
The wearable device includes a first unit located on the left side when the wearable device is worn by the user, and a second unit located on the right side,
The operation unit is installed in one of the first unit or the second unit,
The wearable device according to any one of (12) to (14), wherein the projection unit is installed on the other of the first unit or the second unit.
(16)
When the wearable device is worn by the user, displaying information on an operation on the operation unit arranged outside the user's field of view on the display unit;
An information processing method comprising:
(17)
Computer
A display control unit for displaying information on an operation on an operation unit arranged outside the user's field of view on the display unit when the wearable device is mounted on the user;
Program to function as

10 Headphone 30 HMD
100, 300

Control unit

102, 302

Detection unit

104, 304

Display control unit

120, 320

Communication unit

122, 322

Operation unit

124, 324 Sensor 126

Projection unit

128, 328 Audio output unit 326 Display unit

Claims

When the wearable device is worn by a user, an operation unit arranged outside the user's field of view;
A display control unit for displaying information on an operation on the operation unit on a display unit;
A wearable device comprising:
The wearable device according to claim 1, wherein the information related to the operation includes information indicating a function associated with the operation unit.
The wearable device further includes a detection unit that detects the approach or contact of the user's hand to the operation unit,
The wearable device according to claim 2, wherein the display control unit causes the display unit to display information on the operation based on a detection result by the detection unit.
The wearable device has a plurality of the operation units,
The wearable device according to claim 3, wherein the display control unit causes the display unit to display information related to the operation with respect to the operation unit in which the approach or contact of the user's hand is detected among the plurality of operation units.
When there are a plurality of operation units in which the approach or contact of the user's hand is detected among the plurality of operation units, the display control unit is configured to perform a plurality of operations in which the approach or contact of the user's hand is detected. 5. The wearing type according to claim 4, wherein information related to the operation with respect to the operation unit having the highest priority among the units is displayed on the display unit, and information related to the operation with respect to another operation unit is not displayed on the display unit. apparatus.
The wearable device has a plurality of the operation units,
The said display control part displays the information regarding the said operation with respect to each of these operation parts in the display position according to each installation position of these operation parts in the said mounting | wearing apparatus. Wearable device.
The display control unit is configured so that an order relationship between the installation positions of the plurality of operation units in the wearable device matches an order relationship between display positions of information regarding the operation with respect to each of the plurality of operation units. The wearable device according to claim 6, wherein information related to the operation for each of the plurality of operation units is displayed.
The wearable device according to claim 7, wherein the display control unit displays information related to the operation on an upper side of a display area of an operation portion located on a rear side of the wearable device among the plurality of operation portions. .
The wearable device according to claim 8, wherein when the wearable device is worn on the user's head, at least one of the plurality of operation units is located behind the user's head. .
The wearable device has a plurality of the operation units arranged in one direction,
Each of the plurality of operation units has a display priority,
The wearable device according to claim 2, wherein the priority of each of the plurality of operation units is determined such that an operation unit closer to an end in the one direction has a higher priority.
The wearable device according to claim 1, wherein the display unit is a projection unit that projects an image.
The wearable device according to claim 11, wherein the wearable device further includes the projection unit.
The wearable device according to claim 11, wherein the wearable device is a headphone.
The wearable device according to claim 12, wherein the projection unit projects an image onto the user or an object worn by the user.
The wearable device includes a first unit located on the left side when the wearable device is worn by the user, and a second unit located on the right side,
The operation unit is installed in one of the first unit or the second unit,
The wearable device according to claim 12, wherein the projection unit is installed on the other of the first unit or the second unit.
When the wearable device is worn by the user, displaying information on an operation on the operation unit arranged outside the user's field of view on the display unit;
An information processing method comprising:
Computer
A display control unit for displaying information on an operation on an operation unit arranged outside the user's field of view on the display unit when the wearable device is mounted on the user;
Program to function as