JP6483514B2 - Wearable device, control method, and control program - Google Patents

Description

  The present invention relates to a wearable device that can be worn on a user's head, a control method, and a control program.

  In recent years, as the wearable device, a head-mounted display device that has a display arranged in front of the eyes and an infrared detection unit that can recognize the movement of a finger and is operated by a hand gesture has been disclosed (patent) Reference 1).

International Publication No. 2014/128751

  In the wearable device as described above, a device that is easier to use is desired.

  An object of the present invention is to provide a wearable device that is easier to use.

  A wearable device according to one aspect includes an imaging unit and a detection unit that detects a predetermined object in an actual space, and has a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. In the first range that overlaps with the imaging range of the imaging unit in the detection range of the detection unit when the imaging unit is imaging, the predetermined range within the first range Even if a predetermined motion of the object is detected, the predetermined function corresponding to the predetermined motion is not executed.

  A wearable device according to one aspect includes a detection unit that detects a predetermined object in an actual space, and performs a predetermined function according to a predetermined operation of the predetermined object that is detected by the detection unit. When the predetermined function is activated, the detection application range of the detection unit is changed according to the execution content of the predetermined function.

  A wearable device according to one aspect includes an imaging unit and a detection unit that detects a predetermined object in an actual space, and has a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. In accordance with a predetermined operation of the predetermined object, the wearable device receives the designation of at least one subject included in the detection range of the detection unit, and in the state where the reception is performed, the subject In response to the movement to a predetermined position in the imaging range of the imaging unit, the captured image captured by the imaging unit is stored.

  A wearable device according to one aspect includes an imaging unit and a detection unit that detects a predetermined object in a real space, and when the imaging unit is imaging, the detection range of the detection unit, Based on the detection of the predetermined operation in a range that does not overlap with the imaging range of the imaging unit, processing related to the function of the imaging unit is executed.

  A wearable device according to one aspect includes an imaging unit, a display unit, and a detection unit that detects a predetermined operation of a predetermined object in an actual space, and when the imaging unit is imaging, the display The processing related to the function of the imaging unit is executed based on the detection of the predetermined operation in a predetermined region that does not overlap with the imaging range of the imaging unit in the display area of the unit.

  A control method according to one aspect includes an imaging unit and a detection unit that detects a predetermined object in a real space, and has a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. In the first range that overlaps with the imaging range of the imaging unit in the detection range of the detection unit when the imaging unit is imaging. Even if a predetermined operation of the predetermined object is detected within one range, the predetermined function corresponding to the predetermined operation is not executed.

  A control program according to one aspect corresponds to a predetermined operation of the predetermined object detected by the detection unit in a wearable device including an imaging unit and a detection unit that detects a predetermined object in an actual space. A control program for executing a predetermined function when the imaging unit is imaging, the first range that overlaps the imaging range of the imaging unit in the detection range of the detection unit is within the first range. In this case, even if a predetermined operation of the predetermined object is detected, the wearable device does not execute the predetermined function corresponding to the predetermined operation.

  According to the present invention, it is possible to provide a wearable device that is easier to use.

FIG. 1 is a perspective view of a wearable device. FIG. 2 is a block diagram of the wearable device. FIG. 3 is a first example illustrating the relationship between the imaging range of the imaging unit, the detection range of the detection unit, and the display area of the display unit. FIG. 4 is a second example illustrating the relationship between the imaging range of the imaging unit, the detection range of the detection unit, and the display area of the display unit. FIG. 5 is a diagram showing each change pattern when the detection range is changed depending on the execution contents of the function. FIG. 6 is a diagram for explaining an execution example of the predetermined function of the wearable device 1. FIG. 7 is a diagram for explaining a modification of the present embodiment.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range.

  First, the overall configuration of the wearable device 1 will be described with reference to FIG. FIG. 1 is a perspective view of the device 1. As shown in FIG. 1, the wearable device 1 is a head mount type device that is worn on a user's head.

  The wearable device 1 includes a front surface portion 1a, a side surface portion 1b, and a side surface portion 1c. Front part 1a is arranged in front of the user so as to cover both eyes of the user when worn. The side surface portion 1b is connected to one end portion of the front surface portion 1a, and the side surface portion 1c is connected to the other end portion of the front surface portion 1a. The side surface portion 1b and the side surface portion 1c are supported by a user's ear like a vine of glasses when worn, and stabilize the wearable device 1. The side surface portion 1b and the side surface portion 1c may be configured to be connected to the back surface of the user's head when worn.

  The front surface portion 1a includes a display portion 32a and a display portion 32b on the surface facing the user's eyes when worn. The display unit 32a is disposed at a position facing the user's right eye when worn, and the display unit 32b is disposed at a position facing the user's left eye when worn. The display unit 32a displays a right-eye image, and the display unit 32b displays a left-eye image. Thus, by providing the display unit 32a and the display unit 32b that display an image corresponding to each eye of the user at the time of wearing, the wearable device 1 realizes three-dimensional display using parallax of both eyes. Can do.

  The display unit 32a and the display unit 32b are a pair of transflective displays, but are not limited thereto. For example, the display unit 32a and the display unit 32b may be provided with lenses such as an eyeglass lens, a sunglasses lens, and an ultraviolet cut lens, and the display unit 32a and the display unit 32b may be provided separately from the lens. The display unit 32a and the display unit 32b may be configured by a single display device as long as different images can be independently provided to the right eye and the left eye of the user.

  An imaging unit 40 is provided on the front surface portion 1a. The imaging unit 40 acquires an image in a range corresponding to the user's field of view. The field of view here is a field of view when the user is looking at the front, for example. The imaging unit 40 includes an imaging unit disposed in the vicinity of one end (the right eye side when mounted) of the front surface portion 1a and the other end (the left eye side when mounted) of the front surface portion 1a. It may be constituted by two with the imaging unit arranged in. In this case, an image in a range corresponding to the field of view of the user's right eye is acquired by the imaging unit disposed in the vicinity of one end portion (the right eye side when worn) of the front surface portion 1a. An image in a range corresponding to the field of view of the user's left eye is acquired by an imaging unit disposed in the vicinity of the end portion (left eye side when worn).

  The wearable device 1 has a function of visually recognizing various information on the foreground that the user is viewing. The foreground is a landscape in front of the user. When the display unit 32a and the display unit 32b are not displaying, the wearable device 1 allows the user to visually recognize the foreground through the display unit 32a and the display unit 32b. When the display unit 32a and the display unit 32b are displaying, the wearable device 1 allows the user to visually recognize the foreground through the display unit 32a and the display unit 32b and the display contents of the display unit 32a and the display unit 32b. .

  In FIG. 1, an example in which the wearable device 1 has a shape like glasses is shown, but the shape of the wearable device 1 is not limited to this. For example, the wearable device 1 may have a goggle shape. The wearable device 1 may be configured to be connected to an external device such as an information processing device or a battery device in a wired or wireless manner.

  Next, a functional configuration of the wearable device 1 will be described with reference to FIG. FIG. 2 is a block diagram of the wearable device 1. As shown in FIG. 2, the wearable device 1 includes an operation unit 13, a control unit 22, a storage unit 24, display units 32a and 32b, an imaging unit 40, a line-of-sight detection unit 42, a detection unit 44, And a distance measuring unit 46.

  The operation unit 13 is, for example, a touch sensor disposed on the side surface (1b or 1c). The touch sensor can detect a user's contact, and accepts basic operations such as starting and stopping the wearable device 1 and changing the operation mode according to the detection result.

  The display units 32 a and 32 b include a transflective display device such as a liquid crystal display (Liquid Crystal Display) and an organic EL (Organic Electro-Luminescence) panel. The display units 32 a and 32 b display various types of information as images in accordance with control signals input from the control unit 22. The display units 32a and 32b may be projection devices that project an image onto a user's retina using a light source such as a laser beam. In this case, a configuration may be adopted in which a half mirror is installed on the lens portion of wearable device 1 simulating glasses and an image irradiated from a separately provided projector is projected. Further, as described above, the display units 32a and 32b may display various information three-dimensionally. Further, various types of information may be displayed as if they exist in front of the user (a position away from the user). As a method for displaying information in this way, for example, a frame sequential method, a polarization method, a linear polarization method, a circular polarization method, a top and bottom method, a side-by-side method, an anaglyph method, a lenticular method, a parallax barrier method, a liquid crystal parallax method. Any of a multi-parallax method such as a barrier method and a two-parallax method may be employed.

  The imaging unit 40 electronically captures an image using an image sensor such as a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor). Then, the imaging unit 40 converts the captured image into a signal and outputs the signal to the control unit 22.

  The line-of-sight detection unit 42 includes, for example, an infrared irradiation unit that can irradiate infrared rays to the user's eyes and an infrared imaging unit having infrared sensitivity. The control unit 22 detects the user's line-of-sight position based on the user image acquired by the line-of-sight detection unit 42 by executing a control program 24a described later. For example, as shown in FIG. 1, the line-of-sight detection unit 42 is provided on the face side of the user in the front surface 1 a of the wearable device 1.

  Note that the line-of-sight detection unit 42 is not limited to the above, and may be an imaging unit provided separately from the imaging unit 40 described above, and may be an imaging unit capable of imaging the eyes of the user. The control unit 22 detects the line-of-sight direction based on the positional relationship between the eyes and the iris in the user image acquired by the line-of-sight detection unit 42 by executing a control program 24a described later.

  Note that the line-of-sight detection unit 42 is not limited to the above, and has electrodes provided at positions that can be contacted with the periphery of the user's eyes, and is generated when the user's eyes move (blink or move the line of sight). A myoelectric sensor for detecting myoelectric potential may be used. Here, as measurement electrodes for measuring myoelectric potential, a first electrode and a second electrode that can be in contact with the left and right sides of the user's nose are extended from, for example, a bridge of the wearable device 1. Provided on the nose pad. Moreover, the 3rd electrode which can contact the center part of a user's nose is provided in a bridge as a reference electrode. With this configuration, the myoelectric sensor detects, for example, changes in the potentials of the first electrode and the second electrode with respect to the third electrode when the user moves the line of sight in a predetermined direction. To do. Based on the detection result of the myoelectric sensor, the control unit 22 detects, for example, the presence / absence of blinking, the presence / absence of eye movement (including changes in the eye direction, the eye position), and the like.

  The third electrode as the reference electrode may be provided at a position different from the bridge. For example, the third electrode may be provided in the vicinity of the end portion of the side surface portion 1b (or 1c) opposite to the front surface portion 1a. The arrangement configuration of the electrodes is not limited to these, and various known techniques may be applied.

  The detection unit 44 detects an imaging range of the imaging unit 40 and an actual object existing around the imaging range (or the foreground). For example, the detection unit 44 detects an object (predetermined object) that matches a pre-registered shape (for example, a shape of a human hand, a finger, or the like) among real objects. The detection unit 44 also determines the range (shape and size) of an actual object in an image based on the brightness, saturation, hue edge, and the like of an object (predetermined object) whose shape is not registered in advance. It may be configured to detect.

  The detection unit 44 includes a sensor that detects an actual object (predetermined object). The sensor is, for example, a sensor that detects an actual object using at least one of visible light, infrared light, ultraviolet light, radio waves, sound waves, magnetism, and capacitance.

  In the present embodiment, the imaging unit 40 may also serve as the detection unit 44. That is, the imaging unit 40 detects an object (predetermined object) within the imaging range by analyzing the captured image.

  The control unit 22 includes a CPU (Central Processing Unit) that is a calculation unit and a memory that is a storage unit, and implements various functions by executing programs using these hardware resources. Specifically, the control unit 22 reads a program or data stored in the storage unit 24 and expands it in a memory, and causes the CPU to execute instructions included in the program expanded in the memory. The control unit 22 reads / writes data from / to the memory and the storage unit 24 and controls operations of the display units 32a, 32b and the like according to the execution result of the instruction by the CPU. When the CPU executes an instruction, data developed in the memory, an operation detected via the detection unit 44, or the like is used as a part of parameters or determination conditions.

  The storage unit 24 includes a nonvolatile storage device such as a flash memory, and stores various programs and data. The program stored in the storage unit 24 includes a control program 24a. The data stored in the storage unit 24 includes imaging data 24b. The storage unit 24 may be configured by a combination of a portable storage medium such as a memory card and a read / write device that reads from and writes to the storage medium. In this case, the control program 24a and the imaging data 24b may be stored in a storage medium. The control program 24a may be acquired from another device such as a server device by wireless communication or wired communication.

  The control program 24 a provides functions related to various controls for operating the wearable device 1. The functions provided by the control program 24a include a function for controlling the imaging of the imaging unit 40, a function for detecting the user's line of sight from the detection result of the line of sight detection unit 42, a function for controlling the display of the display units 32a and 32b, and the like. included.

  The control program 24 a includes a detection processing unit 25 and a display control unit 26. The detection processing unit 25 detects a real object (predetermined object) existing in the imaging range of the image capturing unit 40 and provides a function for detecting a predetermined operation of the real object (predetermined object). The detection processing unit 25 detects a real object (predetermined object) existing within the detection range of the detection unit 44 and provides a function for detecting a predetermined operation of the real object (predetermined object). The display control unit 26 provides a function for managing the correspondence between the display states of the display units 32a and 32b and the imaging range.

  The detection processing unit 25 provides a function of detecting the user's line of sight from the detection result of the line-of-sight detection unit 42. For example, the detection processing unit 25 detects the user's line-of-sight position by applying an algorithm based on the cornea reflection method to the user's image. Specifically, the detection processing unit 25 irradiates infrared rays from the infrared irradiation unit when acquiring a user image. The detection processing unit 25 specifies the position of the pupil and the position of infrared corneal reflection from the acquired user image. The detection processing unit 25 identifies the direction of the user's line of sight based on the positional relationship between the position of the pupil and the position of infrared corneal reflection. For example, if the position of the pupil is closer to the corner of the eye than the position of the corneal reflection, the detection processing unit 25 determines that the direction of the line of sight is toward the outer corner of the eye, and the position of the pupil is closer to the eye than the position of the corneal reflection. For example, it is determined that the direction of the line of sight is the eye side. For example, the detection processing unit 25 calculates the distance between the user's eyeball and the display based on the size of the iris. Based on the direction of the user's line of sight and the distance between the user's eyeball and the display, the detection processing unit 25 displays the line of sight starting from the pupil from the center position of the pupil in the user's eyeball. The line-of-sight position, which is the position on the display when intersecting, is detected. And the detection process part 25 detects the movement of a user's eyes | visual_axis by performing the detection of the said eyes | visual_axis position recursively.

  In addition, although said example is a case where the detection process part 25 detects a user's eyes | visual_axis position by performing the process using a cornea reflection method, it is not restricted to this example. For example, the detection processing unit 25 may detect the line-of-sight position by executing an image recognition process on the user's image. For example, the detection processing unit 25 extracts a predetermined region including the user's eyeball from the user's image, and specifies the line-of-sight direction based on the positional relationship between the eyes and the iris. And the detection process part 25 detects the said gaze position based on the specified gaze direction and the distance from a user's eyeball to a display. Or the detection process part 25 accumulate | stores the image of the some eyeball when a user is browsing each place of the display area on a display as a reference image, respectively. And the detection process part 25 detects the said gaze position by collating a reference image and the image of the user's eyeball acquired as a determination target.

  The imaging data 24b is data indicating an image obtained by imaging the imaging range by the imaging unit 40. The imaging data 24b includes two imaging units, an imaging unit in which the imaging unit 40 is disposed in the vicinity of one end of the front surface portion 1a and an imaging unit in the vicinity of the other end of the front surface portion 1a. In the case of being configured, the data may be data obtained by synthesizing images captured by the respective images, or data indicating the respective images. The imaging data 24b includes still image data and moving image data.

  Next, the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b will be described with reference to FIGS. FIG. 3 is a first example illustrating the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b.

  In the present embodiment, it is assumed that the detection unit 44 includes an infrared irradiation unit that emits infrared rays and an infrared imaging unit that can receive infrared rays reflected from an actual predetermined object (having infrared sensitivity). I will do it. That is, the control unit 22 detects an actual object (predetermined object) from the captured image of the infrared imaging unit. Further, in the present embodiment, description will be made on the assumption that the display images are displayed as if the display units 32a and 32b exist at positions away from the wearable device 1.

  FIG. 3A is a perspective view schematically showing the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b. 3 (b) is a top view of FIG. 3 (a), and FIGS. 3 (c) and 3 (d) are side views of FIG. 3 (a). In FIG. 3, a three-dimensional orthogonal coordinate system including an x-axis, a y-axis, and a z-axis is defined. The y-axis direction is a vertical direction, the z-axis direction is a front-rear direction of the user, and the x-axis direction is a direction orthogonal to both the y-axis direction and the z-axis direction. As illustrated, FIG. 3D corresponds to the field of view when the user visually recognizes the front.

  FIG. 3 shows an imaging range 401 that can be captured by the imaging unit 40, a detection range 441 that can be detected by the detection unit 44, and a display area 321 that can be displayed by the display units 32a and 32b. In the present embodiment (first example), the detectable detection range 441 includes the imaging range 401 (the imaging range 401 exists within the detection range 441). As can be seen from FIGS. 3A to 3D, the detection range 441 has a three-dimensional space. That is, a predetermined object in the detection range 441, which is a three-dimensional space, can be detected by detecting the infrared rays irradiated from the infrared irradiation unit of the detection unit 44 by the infrared imaging unit. Further, a predetermined action of a predetermined object in the detection range 441 that is a three-dimensional space may be detected, and a predetermined function corresponding to the predetermined action may be executed using this as a trigger. For example, when the predetermined object is the user's arm, hand, or finger, or a combination of these (generally referred to as the upper limb), the predetermined operation includes finger bending / extension, wrist bending, forearm Rotation (pronation, pronation), etc. (gesture). Further, a predetermined movement of the predetermined region of the upper limb within the detection range 441 may be detected as a predetermined action of the predetermined object (upper limb). Further, it may be detected as a predetermined action of the predetermined object (upper limb) that the predetermined object (upper limb) is in a predetermined form. For example, a form (good sign) in which a thumb is stretched to information and another finger is gripped.

  Further, as can be seen from FIGS. 3A to 3D, the display units 32a and 32b are not part of the actually provided wearable device 1, but in a display area 321 that is located away from the wearable device 1. Display the display image. At this time, the display units 32a and 32b may display the display image as a three-dimensional 3D object having a depth. Note that the depth corresponds to the thickness in the z-axis direction.

  Next, an example in which a predetermined function is executed based on a predetermined operation of a predetermined object will be described with reference to FIG. In the example of FIG. 3, the case where the imaging function which acquires a captured image by the imaging part 40 is performed as a predetermined function is shown. Note that “acquiring a captured image” means storing (saving) a captured image captured by the imaging unit 40 in the storage unit 24 as captured data 24b. Here, in the detection range 441 of the detection unit, a range that overlaps with the imaging range 401 of the imaging unit 40 (a space shared by the detection range 441 and the imaging range 401) is defined as a first range 441a, and in the detection range 441 of the detection unit. A range that does not overlap with the imaging range 401 of the imaging unit 40 is defined as a second range 441b. The first range 441a is a portion indicated by hatching.

  In the display area 321, display images 51 to 54 related to a predetermined function (imaging function) are displayed in an area 321 a (for example, an area surrounded by a dotted line in FIG. 3) that overlaps the second range 441 b. . The icon 51 is a display image showing a function of changing a correction value in exposure correction, which is one of imaging functions, for example. The icon 52 is a display image showing a function of changing the ISO sensitivity, which is one of imaging functions, for example. The icon 53 is a display image showing a function for acquiring a captured image, which is one of imaging functions, for example. The icon 54 is a display image showing a zoom function, which is one of imaging functions, for example.

  Here, the wearable device 1 is imaging, that is, the imaging unit 40 captures the foreground, sequentially transmits the captured image to the storage unit 24, and temporarily stores the captured image in the storage unit 21. In some cases, the wearable device 1 has a predetermined object within the first range 441a (a range indicated by hatching) in the first range 441a that overlaps the imaging range 401 of the imaging unit 40 in the detection range 441 of the detection unit 44. Even if the predetermined operation is detected, the predetermined function corresponding to the predetermined operation is not executed. Here, the predetermined function is a function of acquiring a captured image as described above, for example.

  Thereby, in a state where there is a predetermined object (upper limb) in the first range 441a, a captured image in which the upper limb is reflected in the image is not acquired by performing an operation of acquiring the captured image, Usability is improved.

  In addition, the wearable device 1 displays the display images 51 and 54 related to a predetermined function in a region 321a that does not overlap with the imaging range of the imaging unit 40 in the display regions 321 of the display units 32a and 32b. It may have a configuration for executing a predetermined function based on the superposition of the upper limbs).

  At this time, in a state where the user's finger is present in the area where the icon 53 (display image showing the function of acquiring the captured image) is displayed in the second range 441b, the finger is moved in the depth direction (z-axis direction). ) (Moving the finger), the captured image may be acquired as a function based on the display image 53. As described above, since the image can be acquired in a state where the upper limb does not enter the imaging range (first range 441a), usability is improved.

  In addition to the above configuration, from the first range 441a (or within the imaging range 401) that overlaps the imaging range 401 in the detection range 441, to the second range 441b (or imaging that does not overlap the imaging range 401 in the detection range 441). The captured image may be acquired as a function based on the display image 53 based on the movement of the upper limb to the outside of the range 401). At this time, the movement of the upper limb may be detected from the captured image of the imaging unit 40 or may be detected from the detection result of the detection unit 44. Even in such a configuration, since the image can be acquired in a state where the upper limb does not enter the imaging range (first range 441a), usability is improved.

  As described above, the wearable device 1 includes the imaging unit 40 and the detection unit 44 that detects a predetermined object in the real space. When the imaging unit 40 is imaging, the wearable device 1 In the detection range 441, in a range 441b that does not overlap with the imaging range 401 of the imaging unit 40, the processing related to the function of the imaging unit 40 may be performed based on the detection of the predetermined operation.

  Further, the wearable device 1 has detected the predetermined motion of the writing object in the predetermined area 321 a that does not overlap the imaging range 401 of the imaging unit 40 in the display area 321 of the display unit 32 when the imaging unit 40 is imaging. On the basis of the above, it is also possible to adopt a configuration for executing processing relating to the function of the imaging unit 40.

  Further, in the above embodiment, as shown in FIG. 3D, the icon 51 is displayed in the range near the right end of the imaging range 401 in the second range 441b (the range that does not overlap the imaging range 401 in the detection range 441). However, the present invention is not limited to this, and the icons 51 to 54 may be displayed in the vicinity of the left end, the upper end, or the lower end of the imaging range 401. In this case, the predetermined function may be executed based on detecting a predetermined operation of the predetermined object in a state where the predetermined object exists in the vicinity of the left end, the upper end, or the lower end of the imaging range 401.

  In addition, in the range near the upper end of the imaging range 401 (the upper range of the imaging range 401) in the second range 441b instead of such a configuration, execution of a predetermined function based on a predetermined operation of a predetermined object in the range In the second range 441b, excluding the range in the vicinity of the upper end of the imaging range 401 (the upper range of the imaging range 401), executing a predetermined function based on a predetermined operation of a predetermined object in the range. It may be allowed. For example, when a captured image is acquired in a state where a predetermined object (for example, the tip of the user's finger) is in the range near the upper end of the imaging range 401 in the second range 441b, use is performed. The captured image may be acquired in a state where a part of the person's hand or forearm is reflected in the image. On the other hand, in the above configuration, since the execution of the predetermined function is prohibited in the range near the upper end of the imaging range 401, such a problem hardly occurs.

  According to another aspect, the wearable device 1 according to the above embodiment changes the detection range 441 of the detection unit 44 from the detection range 441 to the first range 441a when the imaging function is activated and the imaging is in progress. It can be defined as having a configuration that changes to the second range 441b excluding. That is, the wearable device 1 is a wearable device that executes a predetermined function according to a predetermined operation of a predetermined object detected by the detection unit 44, and when the predetermined function is activated, according to the execution contents of the predetermined function, The detection application range of the detection unit 44 is changed.

  By having such a configuration, the wearable device 1 can set an appropriate detection range according to the content of the user's operation (the content of the function executed by the wearable device 1). Etc. can be made difficult to invite.

  For example, when the execution content of the predetermined function is the imaging function, the detection application range of the detection unit 40 may be the second range 441b as described above. On the other hand, when the execution content of the predetermined function is a function different from the imaging function, for example, a function including an operation of designating a predetermined position in the real space by a predetermined operation of the predetermined object, the detection application of the detection unit 40 The range may be a combined range of the first range 441a and the second range 441b (corresponding to the range 441). The function including an operation of designating a predetermined position in the real space is a function of displaying information on the designated building by designating the building that exists in the foreground by the user. For example, the foreground building that overlaps the user's fingertip in the front-rear direction (for example, the z-axis direction) of the user may be regarded as being selected.

  Here, for example, “the detection application range of the detection unit 40 is set to the second range 441b” is made by changing the irradiation range (or the imaging range of the infrared imaging unit) by the infrared irradiation unit in the detection unit 44. Also good. Alternatively, “setting the detection application range of the detection unit 40 to the second range 441b” does not change the irradiation range by the infrared irradiation unit (or the imaging range of the infrared imaging unit), and the predetermined range of the predetermined object in the detection range 411 The operation is detected, but may be made by changing the application range for executing the function based on the predetermined operation to the second range 441b. This change process may be performed by the control unit 22, for example.

  In addition, when the execution content of the predetermined function includes an operation of designating a predetermined position in the actual space, as another example different from the above, the first range 441a (or the detection range 441 of the detection unit 44). The imaging range 401) may be the detection application range. That is, in the second range 441b, even if a predetermined motion of the upper limb (fingertip) is detected, the predetermined function is not executed. Here, as shown in FIG. 3 (d), the first range 441a (or the imaging range 401) is surrounded by the display area 321, and hence is referred to as a display viewing range that can be viewed by the user.

  As described above, the wearable device 1 determines whether or not the execution content of the function includes an operation of specifying the position of the actual space by a predetermined operation of the predetermined object, and changes the detection application range based on the determination result. It has the composition to do. When an operation for specifying a predetermined position in the actual space is included in the execution contents of the function, the display viewing range in which the user can visually recognize the display area 321 is set as the detection application range of the detection unit 44.

  According to the above configuration, the application range of the operation for designating a predetermined position in the real space can be set to an appropriate range that can be performed while the user visually recognizes, and an unintended operation is performed. Can be reduced.

  FIG. 4 is a second example illustrating the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b.

  FIG. 4A is a perspective view schematically showing the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b. 4 (b) and 4 (c) are side views of FIG. 4 (a). In FIG. 4, a three-dimensional orthogonal coordinate system including an x-axis, a y-axis, and a z-axis is defined. The y-axis direction is a vertical direction, the z-axis direction is a front-rear direction of the user, and the x-axis direction is a direction orthogonal to both the y-axis direction and the z-axis direction. As illustrated, FIG. 4C corresponds to the field of view when the user visually recognizes the front.

  Also in the example shown in FIG. 4, as in the first example (FIG. 3), the imaging range 401 that can be imaged by the imaging unit 40, the detection range 441 that can be detected by the detection unit, and the display units 32a and 32b can be displayed. A display area 321 is shown. In the second example, the detectable detection range 441 is located below the imaging range 401.

  Also in the example shown in FIG. 4, as in the first example (FIG. 3), the wearable device 1 detects a predetermined action of a predetermined object within a detection range 441 that is a three-dimensional space, and a predetermined function corresponding to the predetermined action. Can be executed. The predetermined operation is the same as in the first example (FIG. 3).

  In the example of FIG. 4, the case where the function which acquires a captured image by the imaging part 40 is performed as a predetermined function is shown.

  Here, the wearable device 1 is imaging, that is, the imaging unit 40 captures the foreground, sequentially transmits the captured image to the storage unit 24, and temporarily stores the captured image in the storage unit 21. In some cases, the wearable device 1 can detect that a predetermined object is included in captured images that are sequentially transmitted. It is also possible to detect whether a predetermined operation of a predetermined object has been performed from captured images that are sequentially transmitted, and it is also possible to execute a predetermined function based on the detection of the predetermined operation. . Therefore, the imaging unit 40 may be handled in the same manner as the detection unit 44 that detects a predetermined object in the real space (the imaging unit 40 and the detection unit 44 may be regarded as one detection unit). That is, the wearable device 1 can detect a predetermined operation of the predetermined object in a state where the predetermined object exists in a space where the imaging range 401 of the imaging unit 40 and the detection range 441 of the detection unit 44 are combined. The imaging unit 40 functions as a second detection unit that is distinguished from the detection unit 44.

  The wearable device 1 according to the present embodiment views the imaging unit 40 (second detection unit) and the detection unit 44 as a single detection unit when the wearable device 1 starts imaging due to activation of the imaging function. In this case, the detection range of the detection unit may be changed. For example, when the wearable device 1 is not imaging, the detection range for detecting the upper limb is the combined range of the imaging range 401 and the detection range 441. On the other hand, when the imaging is being performed, the upper limb is detected. The detection range for this may be the detection range 441 only. That is, when the wearable device 1 is imaging, even if a predetermined motion of the upper limb is detected within the imaging range 401, a predetermined function corresponding to the predetermined motion is not executed.

  By having such a configuration, the wearable device 1 allows the upper limb to appear in the image by performing an operation or the like for acquiring a captured image in a state where the predetermined object (upper limb) is within the imaging range. The captured image is not acquired, and the usability is improved.

  Here, the imaging function described above defines the virtual plane 442 in the detection range 441 of the detection unit 44 and associates the coordinates of the virtual plane 442 with the coordinates of the predetermined range in the display range 321, thereby The position in the display range 321 may be specified based on the position of the upper limb H (for example, a fingertip). Specifically, the wearable device 1 detects the position of the fingertip in the detection range 441, and when the position is projected onto the virtual plane 442 from a direction perpendicular to the virtual plane 442, the virtual plane 442 The projection position projected on the screen is detected. Then, based on the projection position on the virtual plane 442, the position of the display range 321 associated with the projection position is designated. As illustrated in FIG. 4C, based on the projection position on the virtual plane 442, the position to be superimposed on the icon 53 in the display range 321 associated with the projection position is designated by the user. Then, based on the designation of the position to be superimposed on the icon 53, a function corresponding to the icon 53 (a function of acquiring a captured image) is executed.

  Here, the orientation of the virtual plane 442 may be defined by various conditions. For example, as shown in FIG. 4B, the center direction C in the detection range 441 and the virtual plane 442 are set so as to intersect at a predetermined angle A. Here, the predetermined angle A may be about 45 to 90 degrees, for example. Here, the center direction C is a line (see FIG. 4B) passing through the approximate center of the portion corresponding to the bottom surface in the detection range 411 (see FIG. 4A) having a substantially pyramid-shaped three-dimensional space. Good.

  Further, the orientation of the virtual plane 442 may be set so that it intersects with a virtual line passing through the own device (wearable device 1) and a predetermined object (predetermined portion in the upper limb such as a fingertip) at a predetermined angle A. good.

  The orientation of the virtual plane 442 is such that it intersects with a virtual line passing through a predetermined position (for example, eyes) of the user's face and a predetermined object (a predetermined location on the upper limb such as a fingertip) at a predetermined angle A. It may be set to. At this time, the wearable device 1 detects a predetermined position (for example, eyes) of the user's face by an imaging unit (or a line-of-sight detection unit 44) provided in a portion of the wearable device 1 facing the user's face. good.

  Further, in the detection range 441, when the user's fingertip is extended, the virtual plane 442 may be defined so that the extension direction and the virtual plane 442 intersect with each other at a predetermined angle A. .

  Further, the orientation of the virtual plane 442 may be defined so as to intersect the user's line-of-sight direction estimated from the detection result of the line-of-sight detection unit 42 at a predetermined angle A.

  According to the above configuration, when the user performs a character input operation, the orientation of the surface imagined by the user and the orientation of the virtual surface 442 defined by the wearable device 1 are close to each other. The operation becomes easier to execute. In particular, as the predetermined angle A approaches 90 degrees, the orientation of the surface imagined by the user and the orientation of the virtual surface 442 defined by the wearable device 1 become closer, improving usability.

  In addition, when a function is executed based on the motion of the upper limb within the detection range 441 where the user cannot visually recognize the display area 321, it is detected within the detection range 44 as shown in FIG. Based on the shape and position of the upper limb H, the virtual object H ′ having the same shape as the detected shape may be displayed at a predetermined position in the display area 321. Accordingly, even when the detection range does not overlap with the display area 321, the virtual object H ′ is displayed in the display area 321 and can be operated while visually recognizing the virtual object.

  Moreover, although the example which starts an imaging function was shown, as another example, operation (for example, the user moved the finger so that a character might draw in the air based on the locus information of the movement of the upper limb (predetermined object)) A configuration in which a function including a character input operation (character input operation for inputting a character based on the trajectory information) in the execution content may be started. In the case where the execution content of the function includes an operation based on the trajectory information of the movement of the upper limb, only the detection range 441 that is a range that does not overlap the display viewing range (imaging range 401) may be set as the detection application range. Here, the detection range 441 as the detection application range is located below the display viewing range (imaging range 401). In addition, a range in the detection range 441 that is positioned below a predetermined length from the position of the eye height of the user may be defined as the detection application range.

  As described above, the wearable device 1 has a configuration in which it is determined whether the execution content of the predetermined function includes an operation based on the trajectory information of the movement of the predetermined object, and the detection application range is changed based on the determination result. . And when the operation based on the trajectory information of the movement of the predetermined object is included, a range that does not overlap the display visual recognition range is set as the detection application range.

  With such a configuration, in an operation that does not require raising the upper limb to the face position (display viewing range) in order to designate a predetermined position in the real space, such as a character input operation, the detection range is positioned further downward. Therefore, it is not necessary to raise the upper limbs unnecessarily, and the operation can be performed easily.

  Here, the character input function defines a virtual plane for detecting a two-dimensional movement of a predetermined object (upper limb) in the detection range 441 of the detection unit 44, and a trajectory of the movement of the upper limb with respect to the virtual plane. This may be realized by detecting a character desired by the user based on the above. When the wearable device 1 defines the virtual plane, the wearable device 1 stores the coordinates of the virtual plane in the detection range, projects the position of a predetermined region (for example, a fingertip) of the upper limb in the detection range 441 from a direction perpendicular to the virtual plane, The coordinates of the projection position projected on the virtual plane are detected. Then, based on the coordinate change of the projection position with respect to the virtual plane of the fingertip, the locus of movement of the fingertip is detected. For example, if the user performs an operation of drawing a character by moving the fingertip to input a character, based on the trajectory on the virtual plane when the trajectory of the fingertip is projected on the virtual plane To detect characters.

  Moreover, although the example which starts an imaging function or a character input function was shown, as another example, you may perform the function which includes the operation which designates the predetermined position of the real space by the predetermined operation | movement of a predetermined object in execution content. . The wearable device 1 is configured such that when the function execution content is a function including an operation of designating a predetermined position in the actual space by a predetermined operation of a predetermined object, the detection application range of the detection unit 44 may be the imaging range 401 alone. Good (that is, the operation related to the execution of the function is not executed depending on the predetermined operation in the detection range 441). In the example of FIG. 4, the imaging range 401 is surrounded by the display region 321 (see FIG. 4C), and is therefore referred to as a display viewing range that can be viewed by the user. According to such a configuration, the application range of the operation for designating a predetermined position in the real space can be set to an appropriate range that can be performed while the user visually recognizes, and an unintended operation is performed. You can reduce that. Note that in the case of a function for designating a predetermined position in the actual space by a predetermined operation of a predetermined object, the virtual plane as described above may be oriented in a direction orthogonal to the depth direction (z-axis direction) in the display region 321.

  As described above, the detection unit 44 (or the imaging unit 40 (second detection unit) and the detection unit 44 are regarded as one detection unit according to the execution contents of the predetermined function when the predetermined function is activated. Various examples of changing the detection application range of the detection unit) are shown. Here, the wearable device 1 may have a configuration that activates a function corresponding to the type of the operation (gesture) when the operation of the predetermined object is detected from the detection result of the detection unit. For example, when a gesture is made that forms a square with fingers of both hands, that is, a square imitating an imaging frame, the execution content is set as an imaging function, while the index finger is extended and When a gesture for drawing the character is made, the execution content may be detected as a character input function. As a means for receiving an instruction for starting a predetermined function, for example, a display image associated with the imaging function and a display image associated with the character input function are displayed in the display area 321, and the user A function corresponding to one display image on which the upper limb is superimposed may be executed.

  Each change pattern when changing the detection range depending on the execution contents of the function is shown in FIG. Pattern 1 is the same as in the case of the first example (FIG. 3). The imaging range 401 and the detection range 441 are superimposed, and both the imaging range 401 and the detection range 441 are superimposed on the display area 321. This is an example. According to such a configuration, the user can perform an operation (gesture) while visually recognizing a predetermined object (upper limb) in both the imaging range 401 and the detection range 441.

  Pattern 2 is the same as in the case of the second example (FIG. 4), and a predetermined motion of the upper limb can be detected by the imaging range 401 that overlaps the display area 321 and the detection area 441 that does not overlap the display area 321. In this case, the predetermined function is executed by a predetermined operation of the upper limb in the imaging range 401 overlapping the display area 321. Since the imaging range 401 (the detection range of the second detection unit) has a portion that matches the height of the user's eyes in the front-rear direction of the user, the user can visually recognize a predetermined object (for example, a fingertip). However, it is easy to perform an operation (gesture). Therefore, an operation for designating a predetermined position in the actual space by a predetermined operation of a predetermined object may be applied to a function including execution contents. In such a case, the virtual object H ′ as described above may not be displayed.

  Pattern 3 is a case where a predetermined motion of the upper limb can be detected by the imaging range 401 that overlaps the display area 321 and the detection area 441 that does not overlap the display area 321, as in the second example (FIG. 4). is there. The pattern 3 has a direction in which the virtual plane serving as a reference when performing an operation based on the movement of the upper limb in the detection region 441 intersects the central direction C of the detection range 441 at a predetermined angle A (or the various types described above) This is the case where the orientation is defined by the conditions).

  Pattern 4 is a case where a predetermined motion of the upper limb can be detected by the imaging range 401 that overlaps the display area 321 and the detection area 441 that does not overlap the display area 321, as in the second example (FIG. 4). is there. Pattern 4 is a case where the direction of the virtual plane is set to be the horizontal direction in the detection area 441 that does not overlap the display area 321.

  For example, it is assumed that the user performs an operation by moving a finger while the finger is placed on a desk. In such a case, the orientation of the virtual plane may be changed so that the upper surface of the desk is parallel to the virtual plane as in pattern 4. That is, when the wearable device 1 detects a surface having a predetermined size in the real space from the detection result of the detection unit 44 (or the imaging unit 40), the direction of the virtual plane is detected by the virtual plane. The configuration may be characterized in that the orientation is changed so as to be parallel to each other.

  So far, embodiments according to the present invention have been described. Here, the wearable device 1 according to the present embodiment is the wearable device 1 that can detect the upper limb in the imaging range 401 of the imaging unit 40 (second detection unit), and also in the detection range 441 of the detection unit 44. Since the upper limb can be detected, the range in which the upper limb can be detected may be regarded as being extended. By having such a configuration, for example, the following applications are possible.

  FIG. 6 is a diagram for explaining an execution example of the predetermined function of the wearable device 1 in the present embodiment. The functions shown in FIG. 6 are executed based on the control provided by the control program 24a.

  In FIG. 6, the foreground (left column) is a front view viewed through the display units 32 a and 32 b when the user wears the wearable device 1 on the head. In FIG. 6, the right column shows the relationship between the imaging range 401 and the detection range 441 of the wearable device 1 with respect to the foreground. The positions of the imaging range 401 and the detection range 441 with respect to the foreground vary depending on the position and orientation of the user wearing the wearable device 1. In the example illustrated in FIG. 6, the wearable device 1 is imaging, that is, the imaging unit 40 captures the foreground, sequentially transmits the captured images to the storage unit 24, and temporarily stores in the storage unit 21. It is in a saved state.

  In step S10, the foreground includes a subject P1 and a subject P2 that can be imaged by the imaging unit 40. The user can visually recognize the subject P1 and the subject P2 through the display units 32a and 32b. The user designates the subject P1 as an imaging target with the right hand H (upper limb). More specifically, the user moves the right hand H so that the right hand H overlaps the subject P1 in the depth direction (the direction of the approximate center in the detection range) in the detection by the imaging unit 40 or the detection unit 44. Yes. In the example of FIG. 6, the depth direction in the detection by the imaging unit 40 or the detection unit 44 and the front-rear direction (z-axis direction) of the user substantially coincide with each other. Then, the state in which the subject P1 is designated as an imaging target can be achieved by continuing the state in which the right hand H is superimposed on the subject P1 for a predetermined time. Here, the wearable device 1 stores that the subject P1 is designated as an imaging target by the user. Thereafter, when the position or orientation of the wearable device 1 changes, if the designated subject P1 is in the imaging range 401 or the detection range 441, the subject P1 is continuously detected. Alternatively, when the position or orientation of the wearable device 1 changes, a change in the relative positional relationship between the wearable device 1 and the subject P1 is calculated based on the change. Thereby, even after the position and orientation of the wearable device 1 have changed, the wearable device 1 recognizes the position of the designated subject P1 relative to the wearable 1. The wearable device 1 has a frame or the like corresponding to the outline of the imaging range 401 or the detection range 441 in the display area (not shown in FIG. 6) so that the user can visually recognize the imaging range 401 or the detection range 441. You may display.

  In step S11, the user is moving or changing the direction of the neck. Due to the change in the position and orientation of the wearable device 1 due to the movement of the user and the change of the orientation, the positions of the imaging range 401 and the detection range 441 relative to the foreground are changed compared to the case of step S10. Yes. Here, it is assumed that the positions of the subject P1 and the subject P2 in the foreground have not changed (see the left column in S11). In step S11, the user designates the subject P2 as an imaging target by moving the right hand H so that the right hand H overlaps the subject P2 in the depth direction detected by the imaging unit 40 or the detection unit 44. ing. The wearable device 1 stores that the subject P1 is designated as an imaging target by the user. As shown in step S <b> 11, the wearable device 1 detects that the subject P <b> 2 is outside the imaging range 401. Further, in step S11, the wearable device 1 determines how far the subject P2 is from the imaging range 401 based on the position of the subject P2 in the detection range 441 or a change in the position, or whether the subject P2 is It may be estimated whether it is in a state of being away from the imaging range or whether the subject P2 is in a state of approaching the imaging range 401.

  In step S12, in the foreground (left column), the subject P2 moves in a direction approaching the subject P1 (left direction) (the subject P2 is an animal, for example). At this time, the user moves and changes the direction so as to follow the change in the position of the moved subject P2, and accordingly, the imaging range 401 and the detection range 441 move to the left (right Column). Then, based on detecting that both the subject P1 and the subject P2 are in the imaging range 401 in the imaging range 401, the wearable device 1 acquires a captured image.

  By executing such a function, when it is desired to simultaneously image a plurality of subjects and at least one subject is an animal, the positions of the plurality of subjects in the foreground are detected in advance, and at least one subject is detected. Since the wearable device 1 acquires a captured image at the timing when the (animal) moves to a desired position (a position within a predetermined distance from another subject), it is not necessary for the user to perform a timing operation. .

  In addition, when the position of the subject in the foreground is detected in advance, the detection range can be expanded not only to the imaging range 401 but also to the range including the detection range 441, so even if the subjects are separated from each other. Each subject can be specified.

  As described above, the wearable device 1 according to the present embodiment includes the imaging unit 40 and the detection unit 44 that detects a predetermined object in the real space, and is detected based on the detection result of the detection unit 44. A wearable device capable of executing a predetermined function in accordance with a predetermined operation of a predetermined object, and receiving and receiving designation of at least one subject included in a detection range of the detection unit in accordance with the predetermined operation of the predetermined object When the subject is moved, the captured image captured by the imaging unit 40 is saved (acquired) when the subject moves to a predetermined position in the imaging range of the imaging unit 40.

  Further, according to a predetermined operation of a predetermined object, designation of a plurality of subjects included in the detection range of the detection unit 44 is accepted, and in the state where the acceptance is made, a plurality of subjects are captured within the imaging range 401 of the imaging unit 40. The captured image captured by the imaging unit 40 is saved (acquired) when the predetermined positional relationship is reached.

(Modification 1)
The embodiment has been described above. Below, the modification in said embodiment is demonstrated.

  FIG. 7 is a diagram for explaining a modification of the present embodiment. In the above-described embodiment, the predetermined motion of the upper limb can be detected in the detection range obtained by combining the detection range 441 of the detection unit 44 and the imaging range 401 of the imaging unit 40 (second detection unit). However, the functional unit for detecting the upper limb is not limited to these combinations. For example, as shown in FIG. 7A, a plurality of detection units 44 having different detection ranges are provided, and a predetermined motion of the upper limb can be detected in a detection range (441 and 443) in which different detection ranges are combined. It is good as a thing. And it is good also as a structure which changes the application range in a detection range according to the execution content of a function among the detection ranges which match | combined the mutually different detection ranges of the some detection part 44. FIG.

  Further, for example, as shown in FIG. 7B, one detection unit 44 may be provided, and the detection application range in the detection range in the detection unit 44 may be changed according to the execution content of the function. FIG. 7B shows an example in which the detection application range in the detection unit 44 is defined as a range 441a (shaded portion).

  In addition, the detection application range of the predetermined object is changed by, for example, providing the infrared irradiation unit (or infrared imaging unit) so as to be mechanically supported on the wearable device 1 and rotating the wearable device 1. You may implement | achieve by changing the direction of an infrared irradiation part.

  Further, changing the detection application range of the predetermined object may be realized by changing the infrared irradiation range (or infrared imaging range). In this case, the wearable device 1 is separately provided with a scanning unit, a polarizing member, and the like that can change the infrared irradiation range. When the wearable device 1 is provided with a projector so that the user can visually recognize an image, the scanning unit that scans light emitted from the light source of the projector two-dimensionally changes the infrared irradiation range. It may also serve as a scanning unit for this purpose.

  In the configuration illustrated in FIG. 7, the execution content of the function is a function including an operation of specifying a position of an actual space by a predetermined operation of a predetermined object, a function including an operation based on the movement trajectory information of the predetermined object, or the like. Applicable in some cases.

(Modification 2)
In the above embodiment, when the detection pattern 1 shown in FIG. 5 is applied, a predetermined function (imaging function) based on a predetermined operation of a predetermined object is performed in the first range 441a that overlaps the imaging range 401 in the detection range 441. Although the structure (1st example (refer FIG. 3)) which prohibits is demonstrated, it is not limited to such a structure. For example, in the first range 441a that overlaps the imaging range 401 in the detection range 441, a predetermined object may be detected and a predetermined function based on a predetermined operation of the predetermined object may be performed.

  As an application example, for example, in a state where the mutual positional relationship between the detection range 441 and the imaging range 401 is stored in advance, the position of the upper limb in the first range 441 a is detected not by the imaging unit 40 but by the detection unit 44. And the structure which estimates the position of the upper limb in the imaging range 401 based on the position of the upper limb in the detection range 44 may be employ | adopted.

  In this case, the wearable device 1 sets the application range of the focusing process by the imaging unit 40 in advance so as to be a space ahead of the wearable device 1 by a predetermined distance or more. The wearable device 1 may focus on the subject in the vicinity of the center around the position of the upper limb in the imaging range 401 estimated based on the detection result of the detection unit 44. Here, the “predetermined distance” in the item “forward over a predetermined distance” is a distance based on a space where the user's upper limb may exist in front of the wearable device 1, for example, forward from the wearable device 1. The distance is up to 50 cm. Accordingly, the wearable device 1 is set in advance so that the user's upper limb cannot be focused when the focusing process by the imaging unit 40 is executed. Under such conditions, the wearable device 1 can perform the focusing process within a range where the upper limb cannot be focused while allowing the designation of the focus position based on the position of the upper limb. It is possible to prevent the in-focus state.

  Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various changes and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. Further, all the technical matters disclosed in this specification can be rearranged so as not to contradict each other, and a plurality of components can be combined into one or divided.

  In the above-described embodiment, the example where the wearable device 1 has the shape of glasses has been shown, but the shape of the wearable device 1 is not limited to this. For example, the wearable device 1 may have a helmet-type shape that covers substantially the upper half of the user's head. Alternatively, the wearable device 1 may have a mask type shape that covers almost the entire face of the user.

  Further, in the above embodiment, the configuration in which the display unit 32 includes the pair of display units 32a and 32b provided in front of the user's left and right eyes has been exemplified, but the present invention is not limited thereto, and the display unit 32 is not limited thereto. May have a configuration having one display unit provided in front of one of the left and right eyes of the user.

  Further, in the above-described embodiment, the configuration in which the edge of the front portion surrounds the entire circumference of the edge of the display area of the display unit 32 is not limited to this, but the display area of the display unit 32 is not limited to this. The structure which has enclosed only a part of edge may be sufficient.

  In the above embodiment, as described with reference to FIG. 4, when the function to be executed is an imaging function or a character input function (a function including an operation based on trajectory information of movement of the upper limb), the upper limb When the function to be executed is a function including an operation for designating a predetermined position in the real space, the detection application range for detecting the upper limb is set as the display visual recognition range. Although the configuration of the range excluding the display visual recognition range is shown, the combination of the function execution content and the detection application range is not limited to the above. The detection range suitable for the function is applied to any function including various other execution contents.

  Further, in the above-described embodiment, the configuration in which the upper limb is detected as the predetermined object is shown, but the present invention is not limited to this. For example, the predetermined object may be an object gripped by the user (for example, a stick-shaped object such as a pen) that is not the user's body. In addition, the object gripped by the user here may be a portable electronic device such as a mobile phone or an electronic device such as a wristwatch type terminal worn on the upper limb of the user.

  In the above-described embodiment, the configuration in which the imaging unit 40 (or the detection unit 44) detects a hand or a finger as the user's upper limb is shown. However, the hand or the finger is in a state in which a glove, a glove, or the like is worn. Even it can be detected.

  In the above embodiment, the configuration and operation of the wearable device 1 have been described. However, the present invention is not limited to this and may be configured as a method or program including each component.

DESCRIPTION OF SYMBOLS 1 Wearable apparatus 1a Front part 1b Side part 1c Side part 13 Operation part 22 Control part 24 Storage part 24a Control program 24b Imaging data 25 Detection process part 26 Display control part 32a, 32b Display part 40, 42 Image | photographing part 44 Detection part

Claims (4)

An imaging unit;
A detection unit for detecting a predetermined object in an actual space,
A wearable device that performs a predetermined function according to a predetermined operation of the predetermined object, detected by the detection unit,
When the imaging unit is imaging,
In the first range that overlaps with the imaging range of the imaging unit in the detection range of the detection unit, the predetermined function corresponding to the predetermined operation is detected even if the predetermined operation of the predetermined object is detected within the first range. Do not execute wearable devices. With a display,
Displaying a display image related to the predetermined function in a predetermined area that does not overlap with the imaging range of the imaging unit in the display area of the display unit;
The wearable device according to claim 1, wherein the predetermined function is executed based on the predetermined region and the predetermined object being overlapped. An imaging unit and a detection unit that detects a predetermined object in a real space, and is executed by a wearable device that performs a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit A control method,
When the imaging unit is imaging,
In the first range that overlaps with the imaging range of the imaging unit in the detection range of the detection unit, the predetermined function corresponding to the predetermined operation is detected even if the predetermined operation of the predetermined object is detected within the first range. A control method characterized by not executing. A control program that causes a wearable device including an imaging unit and a detection unit that detects a predetermined object in a real space to execute a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. There,
When the imaging unit is imaging,
In the first range that overlaps with the imaging range of the imaging unit in the detection range of the detection unit, the predetermined function corresponding to the predetermined operation is detected even if the predetermined operation of the predetermined object is detected within the first range. Is not executed by the wearable device.