JP2019075175A - Wearable device, control method, and control program - Google Patents

Abstract

To provide a more convenient wearable device.SOLUTION: A wearable device according to the present invention is a wearable device worn on the head, includes a detection unit that detects a predetermined object present in a real space, executes a predetermined function according to a predetermined movement of the detected predetermined object, and when starting up the predetermined function, changes a detection application range for the detection unit according to the details of execution of the predetermined function.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a wearable device wearable on the head of a user, a control method, and a control program.

  In recent years, a head-mounted display device has been disclosed as the wearable device described above that includes a display placed in front of the eye and an infrared detection unit capable of recognizing the movement of the finger, and an operation is performed by a hand gesture (Patent Reference 1).

International Publication No. 2014/128751

  Among the wearable devices as described above, those that are more convenient to use are desired.

  An object of the present invention is to provide a wearable device that is more convenient to use.

  A wearable device according to one aspect includes a detection unit configured to detect a predetermined object existing in a real space, and performs a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. When the predetermined function is activated, the detection application range of the detection unit is changed according to the content of execution of the predetermined function.

  A wearable device according to one aspect includes an imaging unit and a detection unit configured to detect a predetermined object existing in a real space, and the predetermined function according to a predetermined operation of the predetermined object detected by the detection unit. A wearable device for performing at least one subject included in the detection range of the detection unit according to a predetermined operation of the predetermined object, and the subject being in a state in which the reception is performed The captured image captured by the imaging unit is saved when the imaging unit moves to a predetermined position in the imaging range of the imaging unit.

  The wearable device according to one aspect includes an imaging unit and a detection unit that detects a predetermined object existing in the real space, and the imaging unit is in the detection range of the detection unit when the imaging unit is in imaging. The processing related to the function of the imaging unit is executed based on the detection of the predetermined operation in a range not overlapping the imaging range of the imaging unit.

  The wearable device according to one aspect includes an imaging unit, a display unit, and a detection unit that detects a predetermined movement of a predetermined object existing in the real space, and the display is performed when the imaging unit is imaging. The processing related to the function of the imaging unit is executed based on the detection of the predetermined operation in a predetermined area not overlapping the imaging range of the imaging unit in the display area of the unit.

  According to the present invention, it is possible to provide a wearable device that is easier to use.

FIG. 1 is a perspective view of a wearable device. FIG. 2 is a block diagram of the wearable device. FIG. 3 is a first example showing the relationship between the imaging range of the imaging unit, the detection range of the detection unit, and the display area of the display unit. FIG. 4 is a second example showing the relationship between the imaging range of the imaging unit, the detection range of the detection unit, and the display area of the display unit. FIG. 5 is a diagram showing each change pattern when changing the detection range according to the execution content of the function. FIG. 6 is a diagram for explaining an execution example of a predetermined function of the wearable device 1. FIG. 7 is a view for explaining a modification of the present embodiment.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited by the following description. Further, constituent elements in the following description include those which can be easily conceived by those skilled in the art, substantially the same ones, and so-called equivalent ranges.

  First, the overall configuration of the wearable device 1 will be described with reference to FIG. FIG. 1 is a perspective view of the device 1. As shown in FIG. 1, the wearable device 1 is a head mount type device worn on the head of a user.

  The wearable device 1 has a front surface portion 1a, a side surface portion 1b, and a side surface portion 1c. The front portion 1a is disposed on the front of the user so as to cover the eyes of the user at the time of wearing. The side surface portion 1b is connected to one end of the front surface portion 1a, and the side surface portion 1c is connected to the other end of the front surface portion 1a. The side portion 1 b and the side portion 1 c are supported by the user's ear like a pair of glasses when worn, and stabilize the wearable device 1. The side surface portion 1 b and the side surface portion 1 c may be configured to be connected on the back surface of the head of the user at the time of wearing.

  The front surface portion 1a includes a display portion 32a and a display portion 32b on the surface facing the eyes of the user at the time of wearing. The display unit 32a is disposed at a position facing the user's right eye at the time of wearing, and the display unit 32b is disposed at a position facing the user's left eye at the time of wearing. The display 32a displays an image for the right eye, and the display 32b displays an image for the left eye. As described above, the wearable device 1 realizes three-dimensional display using parallax of both eyes by providing the display unit 32a and the display unit 32b that display images corresponding to the respective eyes of the user at the time of wearing. Can.

  Although the display part 32a and the display part 32b are a pair of semi-transmissive display, it is not limited to this. For example, the display 32a and the display 32b may be provided with lenses such as a spectacle lens, a sunglass lens, and an ultraviolet ray cut lens, and the display 32a and the display 32b may be provided separately from the lenses. The display unit 32a and the display unit 32b may be configured by one display device as long as images different from the user's right eye and left eye can be provided independently.

  An imaging unit 40 is provided on the front surface 1 a. The imaging unit 40 acquires an image in a range corresponding to the field of view of the user. The view referred to here is, for example, a view when the user is looking at the front. The imaging unit 40 includes an imaging unit disposed in the vicinity of one end of the front surface portion 1a (right eye side at the time of wearing) and the vicinity of the other end portion of the front surface 1a (the left eye at the time of wearing It may be comprised from two with the imaging part arrange | positioned by this. In this case, an image in a range equivalent to the field of vision of the user's right eye is acquired by the imaging unit disposed in the vicinity of one end of the front surface 1a (right eye side at the time of wearing). An image in a range equivalent to the field of vision of the user's left eye is acquired by the imaging unit disposed in the vicinity of the end portion (the side of the left eye when worn).

  The wearable device 1 has a function of causing various information to be viewed in the foreground viewed by the user. The foreground is the scene ahead of the user. When the display 32a and the display 32b do not perform display, the wearable device 1 causes the user to visually recognize the foreground through the display 32a and the display 32b. When the display unit 32a and the display unit 32b perform display, the wearable device 1 causes the user to visually recognize the foreground through the display unit 32a and the display unit 32b and the display contents of the display unit 32a and the display unit 32b. .

  Although FIG. 1 shows an example in which the wearable device 1 has a shape like glasses, the shape of the wearable device 1 is not limited to this. For example, the wearable device 1 may have the shape of goggles. For example, the wearable device 1 may be connected to an external device such as an information processing device or a battery device by wire or wirelessly.

  Next, the functional configuration of the wearable device 1 will be described with reference to FIG. FIG. 2 is a block diagram of the wearable device 1. As illustrated in FIG. 2, the wearable device 1 includes an operation unit 13, a control unit 22, a storage unit 24, display units 32 a and 32 b, an imaging unit 40, a sight line detection unit 42, and a detection unit 44. And a distance measuring unit 46.

  The operation unit 13 is, for example, a touch sensor disposed on the side surface portion (1b or 1c). The touch sensor can detect the touch of the user, and receives basic operations such as activation and termination of the wearable device 1 and change of the operation mode according to the detection result.

  The display units 32 a and 32 b include semi-transmissive or transmissive display devices such as a liquid crystal display (Liquid Crystal Display), an organic electro-luminescence (EL) panel, and the like. The display units 32 a and 32 b display various information as an image in accordance with a control signal input from the control unit 22. The display units 32a and 32b may be projection devices that project an image on the user's retina using a light source such as a laser beam. In this case, a half mirror may be installed in the lens portion of the wearable device 1 that simulates glasses, and an image irradiated from a separately provided projector may be projected. Further, as described above, the display units 32a and 32b may three-dimensionally display various information. In addition, various information may be displayed as if it exists in front of the user (a position away from the user). As a system for displaying information in this manner, for example, frame sequential system, polarization system, linear polarization system, circular polarization system, top-and-bottom system, side-by-side system, anaglyph system, lenticular system, parallax barrier system, liquid crystal parallax Either a barrier system or a multi-parallax system such as a two-parallax system may be employed.

  The imaging unit 40 electronically captures an image using an image sensor such as a charge coupled device image sensor (CCD) or a complementary metal oxide semiconductor (CMOS). Then, the imaging unit 40 converts the captured image into a signal and outputs the signal to the control unit 22.

  The line-of-sight detection unit 42 includes, for example, an infrared irradiation unit capable of irradiating infrared light to the eyes of the user, and an infrared imaging unit having infrared sensitivity. The control unit 22 executes a control program 24a described later to detect the gaze position of the user based on the image of the user acquired by the gaze detection unit 42. For example, as shown in FIG. 1, the line-of-sight detection unit 42 is provided on the face of the front side portion 1 a of the wearable device 1 on the face side of the user.

  The line-of-sight detection unit 42 is not limited to the above-described one, and may be an imaging unit provided separately from the above-described imaging unit 40 and may be an imaging unit capable of imaging the eyes of the user. The control unit 22 executes a control program 24a described later to detect the direction of the line of sight based on the positional relationship between the eye inside and the iris in the image of the user acquired by the line-of-sight detection unit 42.

  The line-of-sight detection unit 42 is not limited to the above-described one, and has an electrode provided at a position where it can contact the periphery of the user's eyes, and occurs with the user's eye movement (blinking or eye movement). It may be an myoelectric sensor that detects myoelectric potential. Here, as measurement electrodes for measuring the myoelectric potential, a first electrode and a second electrode capable of contacting each of the left and right sides of the user's nose are extended, for example, from the bridge of the wearable device 1 Provided on the nose pad. In addition, as a reference electrode, a bridge is provided with a third electrode that can contact the central portion of the user's nose. With such a configuration, the myoelectric sensor detects, for example, changes in the potential of the first electrode and the second electrode based on the third electrode when the user moves the sight line in a predetermined direction. Do. Based on the detection result of the myoelectric sensor, the control unit 22 detects, for example, the presence or absence of blinking, the presence or absence of eye movement (including a change in eye direction, eye position, etc.) as the eye movement of the user.

  Note that the third electrode as a reference electrode may be provided at a position different from the bridge. For example, the third electrode may be provided in the vicinity of the end of the side surface portion 1b (or 1c) opposite to the front surface portion 1a. The arrangement configuration of the electrodes is not limited to these, and various known techniques may be applied.

  The detection unit 44 detects an imaging range of the imaging unit 40 and a real object present around (or in the foreground of) the imaging range. The detection unit 44 detects, for example, an object (predetermined object) matching a shape (for example, a shape of a human hand, a finger or the like) registered in advance among real objects. The detection unit 44 detects the range (shape and size) of the real object in the image even for an object (predetermined object) whose shape is not registered in advance, based on the lightness, saturation, edge of hue, etc. of the pixel. It may be configured to detect.

  The detection unit 44 has a sensor that detects a real object (predetermined object). The sensor is, for example, a sensor that detects a real object using at least one of visible light, infrared light, ultraviolet light, radio waves, sound waves, magnetism, and capacitance.

  In the present embodiment, the imaging unit 40 may double as the detection unit 44. That is, the imaging unit 40 detects an object (predetermined object) within the imaging range by analyzing the imaged image.

  The control unit 22 includes a central processing unit (CPU) as an arithmetic unit and a memory as a storage unit, and implements various functions by executing a program using these hardware resources. Specifically, the control unit 22 reads a program or data stored in the storage unit 24 and expands it in a memory, and causes the CPU to execute an instruction included in the program expanded in the memory. Then, the control unit 22 reads and writes data to the memory and the storage unit 24 and controls the operation of the display units 32a and 32b according to the execution result of the instruction by the CPU. When the CPU executes an instruction, data developed in the memory or an operation detected through the detection unit 44 or the like is used as part of the parameter or the determination condition.

  The storage unit 24 is a non-volatile storage device such as a flash memory and stores various programs and data. The programs stored in the storage unit 24 include a control program 24 a. The data stored in the storage unit 24 includes imaging data 24 b. The storage unit 24 may be configured by a combination of a portable storage medium such as a memory card and a read / write device that reads from and writes to the storage medium. In this case, the control program 24a and the imaging data 24b may be stored in a storage medium. The control program 24a may also be acquired from another device such as a server device by wireless communication or wired communication.

  The control program 24 a provides functions related to various controls for operating the wearable device 1. The functions provided by the control program 24a include a function to control the imaging of the imaging unit 40, a function to detect the line of sight of the user from the detection result of the line of sight detection unit 42, and a function to control the display of the display units 32a and 32b. included.

  The control program 24 a includes a detection processing unit 25 and a display control unit 26. The detection processing unit 25 detects an actual object (predetermined object) present in the imaging range of the imaging unit 40 and provides a function for detecting a predetermined movement of the actual object (predetermined object). Further, the detection processing unit 25 detects an actual object (predetermined object) present in the detection range of the detection unit 44, and provides a function for detecting a predetermined operation of the actual object (predetermined object). The display control unit 26 provides a function for managing the correspondence between the display states of the display units 32 a and 32 b and the imaging range.

  The detection processing unit 25 also provides a function of detecting the line of sight of the user from the detection result of the line of sight detection unit 42. For example, the detection processing unit 25 detects the gaze position of the user by applying an algorithm based on the corneal reflection method to the image of the user. Specifically, when acquiring a user's image, the detection processing unit 25 causes the infrared irradiation unit to emit infrared light. The detection processing unit 25 specifies the position of the pupil and the position of corneal reflection of infrared light from the acquired image of the user. The detection processing unit 25 specifies the direction of the line of sight of the user based on the positional relationship between the position of the pupil and the position of corneal reflection of infrared light. For example, if the position of the pupil is on the corner of the eye than the position of the corneal reflection, the detection processing unit 25 determines that the direction of the line of sight is on the side of the corner of the eye, and the position of the pupil is on the corner of the eye than the position of the corneal reflection. For example, it is determined that the direction of the line of sight is on the eye inside side. The detection processing unit 25 calculates the distance between the eye of the user and the display based on, for example, the size of the iris. The detection processing unit 25 displays the line of sight starting at the pupil from the central position of the pupil in the eye of the user based on the direction of the line of sight of the user and the distance between the eye of the user and the display. A gaze position which is a position on the display when crossing is detected. Then, the detection processing unit 25 detects the movement of the line of sight of the user by recursively executing the detection of the line of sight position.

  Although the above-mentioned example is a case where detection processing part 25 detects a user's look position by performing processing using a corneal reflex method, it is not restricted to this example. For example, the detection processing unit 25 may detect the gaze position by performing an image recognition process on the image of the user. For example, the detection processing unit 25 extracts a predetermined area including the eyeball of the user from the image of the user, and specifies the gaze direction based on the positional relationship between the inner corner of the eye and the iris. Then, the detection processing unit 25 detects the gaze position based on the identified gaze direction and the distance from the user's eye to the display. Alternatively, the detection processing unit 25 accumulates, as reference images, images of a plurality of eyeballs when the user browses the display areas on the display. Then, the detection processing unit 25 detects the sight line position by collating the reference image with the image of the eye of the user acquired as the determination target.

  The imaging data 24 b is data indicating an image obtained by imaging the imaging range by the imaging unit 40. The imaging data 24b includes two imaging units, the imaging unit 40 being disposed in the vicinity of one end of the front surface 1a, and the imaging unit disposed in the vicinity of the other end of the front surface 1a. When it consists of these, the data which synthesize | combined the image imaged by each may be sufficient, and the data which show each image may be sufficient. The imaging data 24 b includes still image data and moving image data.

  Next, the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b will be described with reference to FIG. 3 and FIG. FIG. 3 is a first example showing the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b.

  In the present embodiment, the detection unit 44 is described as being composed of an infrared irradiation unit that emits infrared light, and an infrared imaging unit that can receive infrared light reflected from an actual predetermined object (having infrared sensitivity). I will. That is, the control unit 22 detects a real object (predetermined object) from the image captured by the infrared imaging unit. Further, in the present embodiment, it is assumed that the display image is displayed as if the display units 32 a and 32 b are present at positions away from the wearable device 1.

  FIG. 3A is a perspective view schematically showing an imaging range of the imaging unit 40, a detection range of the detection unit 44, and display areas of the display units 32a and 32b. 3 (b) is a top view of FIG. 3 (a), and FIGS. 3 (c) and 3 (d) are side views of FIG. 3 (a). In FIG. 3, a three-dimensional orthogonal coordinate system including x-axis, y-axis and z-axis is defined. The y-axis direction is the vertical direction, the z-axis direction is the longitudinal direction of the user, and the x-axis direction is the direction orthogonal to both the y-axis direction and the z-axis direction. As illustrated, FIG. 3 (d) corresponds to the field of view when the user views the front.

  FIG. 3 shows an imaging range 401 that can be imaged by the imaging unit 40, a detection range 441 that can be detected by the detection unit 44, and a display area 321 that can be displayed by the display units 32a and 32b. In the present embodiment (first example), the detectable detection range 441 includes the imaging range 401 (the imaging range 401 exists in the detection range 441). As understood from FIGS. 3A to 3D, the detection range 441 has a three-dimensional space. That is, by detecting the infrared light emitted from the infrared irradiation unit of the detection unit 44 by the infrared imaging unit, it is possible to detect a predetermined object in the detection range 441 which is a three-dimensional space. In addition, a predetermined operation of a predetermined object in the detection range 441 which is a three-dimensional space may be detected, and a predetermined function according to the predetermined operation may be made executable upon detection of the predetermined operation. For example, if the predetermined object is the user's arm, hand, or finger, or a combination thereof (collectively referred to as the upper limbs), the predetermined action includes bending action / extension action of the finger, bending of the wrist, and forearm There are rotations (in and out) and the like (gesture). In addition, the movement of the predetermined region of the upper limb in the detection range 441 may be detected as the predetermined movement of the predetermined object (upper limb). In addition, it may be detected that the predetermined object (upper limb) is in the predetermined form as the predetermined motion of the predetermined object (upper limb). For example, there is a form (Good Sign) in which the other finger is held while extending the thumb to information.

  Further, as can be understood from FIGS. 3A to 3D, the display portions 32a and 32b are not in the part of the wearable device 1 actually provided, but in the display area 321 at a position away from the wearable device 1. Display the displayed image. At this time, the display units 32a and 32b may display the display image as a three-dimensional 3D object having a depth. The depth corresponds to the thickness in the z-axis direction.

  Then, with reference to FIG. 3, the example which performs a predetermined function based on the predetermined operation | movement of a predetermined thing is demonstrated. In the example of FIG. 3, the case where the imaging function which acquires a captured image by the imaging part 40 is shown as a predetermined function is shown. Note that “to obtain a captured image” means to store (save) the captured image captured by the imaging unit 40 as the captured data 24 b in the storage unit 24. Here, a range (a space shared by the detection range 441 and the imaging range 401) overlapping with the imaging range 401 of the imaging unit 40 in the detection range 441 of the detection unit is a first range 441a. A range not overlapping with the imaging range 401 of the imaging unit 40 is referred to as a second range 441 b. The first range 441a is a portion indicated by oblique lines.

  In the display area 321, in the area 321a overlapping with the second range 441b (for example, the area surrounded by the dotted line in FIG. 3), display images 51 to 54 related to the predetermined function (imaging function) are displayed. . The icon 51 is, for example, a display image showing a function of changing a correction value in exposure correction, which is one of imaging functions. The icon 52 is, for example, a display image showing one of the imaging functions, a function of changing the ISO sensitivity. The icon 53 is, for example, a display image showing a function of acquiring a captured image, which is one of imaging functions. The icon 54 is, for example, a display image showing a zoom function, which is one of the imaging functions.

  Here, in a state in which the wearable device 1 is imaging, that is, the imaging unit 40 images the foreground and sequentially transmits the captured image to the storage unit 24 and temporarily stores the image in the storage unit 21. When there is a first range 441a of the detection range 441 of the detection unit 44 that overlaps with the imaging range 401 of the imaging unit 40, the wearable device 1 detects a predetermined object within the first range 441a (the range indicated by hatching). Even if the predetermined operation of the above is detected, the predetermined function corresponding to the predetermined operation is not executed. Here, the predetermined function is, for example, the function of acquiring a captured image as described above.

  As a result, when a predetermined object (upper limb) is present in the first range 441a, the captured image in which the upper limb appears in the image is not acquired by performing the capture operation of the captured image. Usability is improved.

  Further, the wearable device 1 displays the display images 51 to 54 related to the predetermined function in the area 321a not overlapping with the imaging range of the imaging unit 40 in the display area 321 of the display units 32a and 32b. It may have a configuration that performs a predetermined function based on the overlapping of the upper limbs).

  At this time, with the finger of the user in the area where the icon 53 (display image showing the function of acquiring a captured image) is displayed in the second range 441b, the finger is moved in the depth direction (z-axis direction) When an operation of moving to a position (an operation of pushing out a finger) is performed, a captured image may be acquired as a function based on the display image 53 in response to this. As described above, since the image acquisition can be performed in a state where the upper limbs do not enter the imaging range (first range 441a), usability is improved.

  In addition to the above configuration, a second range 441b (or imaging) which does not overlap with the imaging range 401 in the detection range 441 from the first range 441a (or in the imaging range 401) overlapping with the imaging range 401 in the detection range 441 As a function based on the display image 53, acquisition of a captured image may be performed based on movement of the upper limb to the outside of the range 401). At this time, the movement of the upper limb may be detected from the captured image of the imaging unit 40 or may be detected from the detection result of the detection unit 44. Also in such a configuration, since the image can be acquired without the upper limbs entering the imaging range (first range 441a), usability is improved.

  As described above, the wearable device 1 includes the imaging unit 40 and the detection unit 44 that detects a predetermined object existing in the real space, and when the imaging unit 40 is in the process of imaging, the wearable device 1 In the detection range 441, in a range 441 b not overlapping with the imaging range 401 of the imaging unit 40, processing relating to the function of the imaging unit 40 may be performed based on the detection of the predetermined operation.

  In addition, the wearable device 1 detects the predetermined movement of the shadow object in the predetermined area 321 a that does not overlap with the imaging range 401 of the imaging unit 40 in the display area 321 of the display unit 32 when the imaging unit 40 is imaging. It is good also as composition which performs processing concerning a function of imaging part 40 based on these.

  Further, in the above embodiment, as shown in FIG. 3D, the icon 51 is displayed in the second range 441b (a range not overlapping with the imaging range 401 in the detection range 441) in the range near the right end of the imaging range 401. Although the configuration for displaying ~ 54 is shown, the present invention is not limited to this, and the icons 51 to 54 may be displayed in the range near the left end or the upper end or the lower end of the imaging range 401. In this case, in a state where the predetermined object is in the range near the left end or the upper end or the lower end of the imaging range 401, the predetermined function may be performed based on detection of the predetermined operation of the predetermined object.

  Note that instead of such a configuration, in a range near the upper end of the imaging range 401 (a range above the imaging range 401) in the second range 441b, execution of a predetermined function based on a predetermined operation of a predetermined object in the range In the second range 441b except for the range near the upper end of the imaging range 401 (the upper range of the imaging range 401), the execution of the predetermined function based on the predetermined operation of the predetermined object in the range is prohibited. You may allow it. For example, in the case where acquisition of a captured image is performed in a state where a predetermined object (for example, the tip of the user's finger) is in a range near the upper end of the imaging range 401 in the second range 441b In some cases, a captured image may be acquired with a part of the person's hand or forearm appearing in the image. On the other hand, in the above configuration, since the execution of the predetermined function is prohibited in the range near the upper end of the imaging range 401, such a problem hardly occurs.

  According to another viewpoint, the wearable device 1 according to the above-described embodiment detects the detection range 441 of the detection unit 44 from the detection range 441 to the first range 441a when imaging is underway by activating the imaging function. Can be defined as having a configuration to be changed to the second range 441b excluding. That is, the wearable device 1 is a wearable device that executes a predetermined function according to a predetermined operation of a predetermined object detected by the detection unit 44. When the predetermined function is activated, the wearable device 1 is activated according to the execution content of the predetermined function. The detection application range of the detection unit 44 is changed.

  By having such a configuration, the wearable device 1 can have an appropriate detection range according to the content of the user's operation (content of the function to be executed by the wearable device 1). Etc. can be made hard to invite.

  For example, when the content of execution of the predetermined function is the imaging function, as described above, the detection application range of the detection unit 40 may be set as the second range 441 b. On the other hand, when the execution content of the predetermined function is a function different from the imaging function, for example, the function including an operation of specifying a predetermined position in the real space by a predetermined operation of a predetermined object, The range may be a range (corresponding to the range 441) in which the first range 441a and the second range 441b are combined. The function including an operation of designating a predetermined position in the real space is, for example, a function of displaying information and the like relating to the designated building by designating a building existing in the foreground by the user. For example, a building in the foreground that overlaps the user's fingertip in the front-rear direction (for example, the z-axis direction) of the user may be considered as selected.

  Here, for example, “making the detection application range of the detection unit 40 the second range 441 b” is performed by changing the irradiation range of the infrared irradiation unit in the detection unit 44 (or the imaging range of the infrared imaging unit) Also good. Alternatively, “the detection range of the detection unit 40 is set as the second range 441 b” does not change the radiation range of the infrared radiation unit (or the imaging range of the infrared imaging unit), and the predetermined range in the detection range 411 The operation may be detected by changing the application range for performing the function based on the predetermined operation to the second range 441b. The process of this change may be performed by the control unit 22, for example.

  In addition, when the execution content of the predetermined function includes an operation of specifying a predetermined position in the real space, as another example different from the above, the first range 441a (or the detection range 441 of the detection unit 44) The imaging range 401) may be set as the detection application range. That is, in the second range 441b, the predetermined function is not performed even if the predetermined movement of the upper limb (fingertip) is detected. Here, as shown in FIG. 3D, since the first range 441a (or the imaging range 401) is surrounded by the display area 321, the first range 441a (or the imaging range 401) is referred to as a display visual range that can be visually recognized by the user.

  As described above, the wearable device 1 determines whether or not the execution content of the function includes the operation of specifying the position of the real space by the predetermined operation of the predetermined object, and changes the detection application range according to the determination result. Configuration. Then, when the execution content of the function includes an operation of specifying a predetermined position in the real space, a display visual recognition range in which the user can visually recognize the display area 321 is set as a detection application range of the detection unit 44.

  According to the above configuration, the applicable range of the operation for designating the predetermined position in the real space can be an appropriate range that can be performed while the user visually recognizes, and an unintended operation is performed. It can be reduced.

  FIG. 4 is a second example showing the relationship between the imaging range of the imaging unit 40, the detection range of the detection unit 44, and the display areas of the display units 32a and 32b.

  FIG. 4A is a perspective view schematically showing an imaging range of the imaging unit 40, a detection range of the detection unit 44, and display areas of the display units 32a and 32b. FIG.4 (b), (c) is a side view of Fig.4 (a). In FIG. 4, a three-dimensional orthogonal coordinate system including x-axis, y-axis and z-axis is defined. The y-axis direction is the vertical direction, the z-axis direction is the longitudinal direction of the user, and the x-axis direction is the direction orthogonal to both the y-axis direction and the z-axis direction. As illustrated, FIG. 4 (c) corresponds to the field of view when the user views the front.

  Also in the example shown in FIG. 4, as in the first example (FIG. 3), an imaging range 401 that can be imaged by the imaging unit 40, a detection range 441 that can be detected by the detection unit, and display by the display units 32a and 32b A display area 321 is shown. In the second example, the detectable detection range 441 is located below the imaging range 401.

  Also in the example shown in FIG. 4, the wearable device 1 detects a predetermined motion of a predetermined object in a detection range 441 which is a three-dimensional space, as in the first example (FIG. 3), and a predetermined function corresponding to the predetermined motion Is feasible. The predetermined operation is similar to that of the first example (FIG. 3).

  In the example of FIG. 4, a case where the imaging unit 40 executes a function of acquiring a captured image is shown as the predetermined function.

  Here, in a state in which the wearable device 1 is imaging, that is, the imaging unit 40 images the foreground and sequentially transmits the captured image to the storage unit 24 and temporarily stores the image in the storage unit 21. In some cases, the wearable device 1 can detect that a predetermined object is included in the sequentially transmitted captured image. Moreover, it is also possible to detect whether or not a predetermined operation of a predetermined object has been performed from captured images sequentially transmitted, and it is also possible to execute a predetermined function based on the detection of the predetermined operation. . Therefore, the imaging unit 40 may be treated in the same manner as the detection unit 44 that detects a predetermined object in the real space (the imaging unit 40 and the detection unit 44 may be regarded as one detection unit). That is, the wearable device 1 can detect the predetermined operation of the predetermined object in a state where the predetermined object exists in a space obtained by combining the imaging range 401 of the imaging unit 40 and the detection range 441 of the detection unit 44. The imaging unit 40 functions as a second detection unit distinguished from the detection unit 44.

  The wearable device 1 according to the present embodiment sees the imaging unit 40 (second detection unit) and the detection unit 44 as one detection unit when the wearable device 1 starts imaging by activating the imaging function. In this case, the detection range of the detection unit may be changed. For example, in the case where the wearable device 1 is not in imaging, the detection range for detecting the upper limb is a combination of the imaging range 401 and the detection range 441. On the other hand, in the case of imaging, the upper limb is detected. The detection range to be set may be only the detection range 441. That is, when the wearable device 1 is imaging, even if a predetermined motion of the upper limb is detected in the imaging range 401, the predetermined function according to the predetermined motion is not performed.

  By having such a configuration, the wearable device 1 displays the upper limb in the image by performing an operation or the like for acquiring a captured image in a state where the predetermined object (upper limb) is in the imaging range. There is no possibility that the captured image is acquired, and the usability is improved.

  Here, the imaging function described above defines the virtual plane 442 in the detection range 441 of the detection unit 44, and associates the coordinates of the virtual plane 442 with the coordinates of the predetermined range in the display range 321, thereby obtaining the virtual plane 442 The position in the display range 321 may be specified based on the position of the upper limb H (for example, a fingertip). Specifically, when the wearable device 1 detects the position of the fingertip in the detection range 441 and projects the position on the virtual plane 442 from the direction perpendicular to the virtual plane 442, the virtual plane 442 Detect the projection position projected on the Then, based on the projection position on the virtual plane 442, the position of the display range 321 associated with the projection position is designated. As shown in FIG. 4C, based on the projection position on the virtual plane 442, the user designates a position to be superimposed on the icon 53 in the display range 321 associated with the projection position. Then, based on the designation of the position to be superimposed on the icon 53, the function (the function of acquiring a captured image) corresponding to the icon 53 is executed.

  Here, the orientation of the virtual plane 442 may be defined by various conditions. For example, as shown in FIG. 4B, it is set so that the central direction C in the detection range 441 and the virtual plane 442 intersect at a predetermined angle A. Here, the predetermined angle A may be, for example, about 45 to 90 degrees. Here, the central direction C is a line (see FIG. 4B) passing substantially through the center of a portion corresponding to the bottom surface in the detection range 411 (see FIG. 4A) having a substantially pyramidal three-dimensional space. It is good.

  Also, the direction of the virtual plane 442 is set to be such that it intersects at a predetermined angle A with a virtual line passing through the own device (the wearable device 1) and a predetermined object (a predetermined location on the upper limb of a finger tip or the like). good.

  Also, the direction of the virtual plane 442 is such that it intersects at a predetermined angle A with a virtual line passing through a predetermined position (for example, an eye) of the user's face and a predetermined object (a predetermined location on the upper limb of a finger tip or the like) It may be set to At this time, the wearable device 1 detects a predetermined position (for example, an eye) of the user's face by the imaging unit (or the line-of-sight detection unit 44) provided in the part of the wearable device 1 facing the user's face. good.

  Further, in the detection range 441, when the user's fingertip is extended, the virtual plane 442 may be defined such that the extension direction and the virtual plane 442 intersect at a predetermined angle A. .

  Further, the direction of the virtual plane 442 may be defined so as to intersect the user's sight line direction estimated by the detection result of the sight line detection unit 42 at a predetermined angle A.

  According to the above configuration, when the user performs the character input operation, the direction of the surface imagined by the user and the direction of the virtual surface 442 defined by the wearable device 1 become close to each other. The operation is easier to perform. In particular, as the predetermined angle A approaches 90 degrees, the orientation of the surface imagined by the user and the orientation of the virtual surface 442 defined by the wearable device 1 become closer, and usability improves.

  In the case where the function is executed based on the motion of the upper limb in the detection range 441 in which the user can not visually recognize the display area 321, as shown in FIG. 4C, it is detected in the detection range 44. Based on the shape and position of the upper limb H, a virtual object H ′ having a shape similar to the detected shape may be displayed at a predetermined position in the display area 321. As a result, even when the detection range does not overlap with the display area 321, the virtual object H 'is displayed in the display area 321, and the virtual object can be manipulated while being viewed, which is convenient.

  Moreover, although the example which starts an imaging function was shown, operation (For example, the user moved the finger so that the character was drawn in the air as another example) based on the locus | trajectory information of movement of an upper limb (predetermined thing) It may be configured to activate a function including, in the execution content, a character input operation of inputting characters based on locus information. When the content of execution of the function includes an operation based on the trajectory information of the movement of the upper limb, only the detection range 441 which does not overlap with the display visual range (the imaging range 401) may be set as the detection application range. Here, the detection range 441 as the detection application range is located below the display visual range (the imaging range 401). In addition, a range located below the position of the height of the user's eyes in the detection range 441 by a predetermined length or more may be defined as the detection application range.

  As described above, the wearable device 1 has a configuration that determines whether the execution content of the predetermined function includes an operation based on the movement trajectory information of the predetermined object, and changes the detection application range according to the determination result. . Then, when the operation based on the trajectory information of the movement of the predetermined object is included, a range not overlapping with the display visual recognition range is set as a detection application range.

  With such a configuration, in an operation such as a character input operation where it is not necessary to raise the upper limbs to the position of the face (display visual recognition range) in order to specify a predetermined position in the real space, the detection range is positioned further downward Since the upper limbs need not be raised unnecessarily, the operation can be performed easily.

  Here, the character input function described above defines a virtual plane for detecting two-dimensional movement of a predetermined object (upper limb) in the detection range 441 of the detection unit 44, and a locus of movement of the upper limb with respect to the virtual plane. It may be realized by detecting characters desired by the user on the basis of. Having defined the virtual plane, the wearable device 1 stores the coordinates of the virtual plane in the detection range, and projects the position of a predetermined region (for example, a fingertip) of the upper limb in the detection range 441 from the direction perpendicular to the virtual plane. The coordinates of the projection position projected onto the virtual plane are detected. Then, based on the change in coordinates of the projection position with respect to the virtual plane of the fingertip, a trajectory of movement of the fingertip is detected. For example, if the user performs an operation of drawing a character by moving a fingertip in order to perform character input, a locus of movement of the fingertip is projected on a virtual plane, based on a locus on the virtual plane. Character detection.

  In addition, although the example of activating the imaging function and the character input function has been shown, as another example, the function may be executed including an operation of specifying a predetermined position in the real space by a predetermined operation of a predetermined object. . The wearable device 1 sets the detection application range of the detection unit 44 as only the imaging range 401 when the execution content of the function is a function including an operation of specifying a predetermined position in the real space by a predetermined operation of a predetermined object. It is good (that is, depending on the predetermined operation in the detection range 441, the operation relating to the execution of the function is not performed). In the example of FIG. 4, since the imaging range 401 is enclosed by the display area 321 (see FIG. 4C), it is referred to as a display visual range which can be visually recognized by the user. According to such a configuration, the application range of the operation for designating the predetermined position in the real space can be made an appropriate range that can be performed while the user visually recognizes, and an unintended operation is performed. You can reduce things. In the case where the predetermined position of the real space is designated by the predetermined operation of the predetermined object, the virtual plane as described above may be oriented orthogonal to the depth direction (z-axis direction) in the display area 321.

  As described above, in the case where the detection unit 44 (or the imaging unit 40 (second detection unit) and the detection unit 44 are regarded as one detection unit according to the content of execution of the predetermined function when the predetermined function is activated. The various examples which change the detection range of the said detection part were shown. Here, the wearable device 1 may have a configuration for activating a function according to the type of the operation (gesture) when the operation of the predetermined object is detected from the detection result of the detection unit. For example, when a gesture is performed in which a square is formed by fingers of both hands, that is, a square that imitates a frame for imaging is made, the execution content is set to the imaging function, while the index finger is in a stretched state. If a gesture is made to draw a character, the execution content may be detected as a character input function. In addition, as means for receiving an instruction to activate a predetermined function, for example, a display image associated with the imaging function and a display image associated with the character input function are displayed in the display area 321, and the user A function corresponding to one display image on which the upper limbs are superimposed may be executed.

  Each change pattern at the time of changing a detection range by the content of execution of a function is shown in FIG. The pattern 1 is the same as in the first example (FIG. 3), and the imaging range 401 and the detection range 441 overlap, and both the imaging range 401 and the detection range 441 overlap the display area 321. Example. According to such a configuration, the user can perform an operation (gesture) while visually recognizing the predetermined object (upper limb) in any of the imaging range 401 and the detection range 441.

  Pattern 2 is the same as in the second example (FIG. 4), and the predetermined motion of the upper limb can be detected by the imaging range 401 overlapping the display area 321 and the detection area 441 not overlapping the display area 321. In this case, the predetermined function is performed by the predetermined movement of the upper limb in the imaging range 401 to be superimposed on the display area 321. Since the imaging range 401 (the detection range of the second detection unit) has a portion that matches the height of the user's eyes in the front-rear direction of the user, the user can visually recognize a predetermined object (for example, a fingertip) While doing, it is easy to make an action (gesture). Therefore, an operation of specifying a predetermined position in the real space by a predetermined operation of a predetermined object may be applied to the function including in the execution content. In such a case, the virtual object H 'as described above may not be displayed.

  As in the case of the second example (FIG. 4), pattern 3 is a case where the predetermined movement of the upper limb can be detected by the imaging range 401 overlapping with the display area 321 and the detection area 441 not overlapping with the display area 321. is there. In pattern 3, in the detection area 441, a direction in which a virtual plane serving as a reference when performing an operation by the operation of the upper limb intersects the central direction C of the detection range 441 at a predetermined angle A (or various types shown above) It is the case where it is set to the direction specified by the conditions.

  As in the case of the second example (FIG. 4), pattern 4 is a case where the predetermined movement of the upper limb can be detected by the imaging range 401 overlapping with the display area 321 and the detection area 441 not overlapping with the display area 321. is there. Pattern 4 is a case where the direction of the virtual plane is set to be the horizontal direction in the detection area 441 which does not overlap with the display area 321.

  For example, it is also assumed that the user performs an operation by moving a finger while placing the finger on the desk. In such a case, as in the pattern 4, the direction of the virtual plane may be changed such that the upper surface of the desk and the virtual plane are parallel. That is, when the wearable device 1 detects a surface of a predetermined size in the real space from the detection result of the detection unit 44 (or the imaging unit 40), the virtual plane detects the direction of the virtual plane. It may be characterized in that it is configured to change in a direction parallel to the direction.

  The embodiments according to the present invention have been described above. Here, the wearable device 1 according to the present embodiment is the wearable device 1 capable of detecting the upper limb in the imaging range 401 of the imaging unit 40 (second detection unit), and also in the detection range 441 of the detection unit 44. Since the upper limbs can be detected, the range in which the upper limbs can be detected may be considered to be expanded. By having such a configuration, for example, the following applications become possible.

  FIG. 6 is a diagram for explaining an execution example of a predetermined function of the wearable device 1 according to the present embodiment. The functions shown in FIG. 6 are executed based on the control provided by the control program 24a.

  In FIG. 6, the foreground (left row) is a front view viewed through the display portions 32a and 32b in a state where the user wears the wearable device 1 on the head. In FIG. 6, the right column shows the relationship between the position of the imaging range 401 and the detection range 441 of the wearable device 1 with respect to the foreground. The positions of the imaging range 401 and the detection range 441 with respect to the foreground change depending on the position and orientation of the user wearing the wearable device 1. In the example illustrated in FIG. 6, the wearable device 1 is capturing an image, that is, the imaging unit 40 captures an image of the foreground, sequentially transmits the captured image to the storage unit 24 and temporarily It is in the state of saving.

  In step S10, a subject P1 and a subject P2 that can be imaged by the imaging unit 40 exist in the foreground. The user can visually recognize the subject P1 and the subject P2 through the display portions 32a and 32b. The user designates the subject P1 as an imaging target by the right hand H (upper limb). More specifically, the user moves the right hand H so that the right hand H overlaps the subject P1 in the depth direction (the direction of the approximate center of the detection range) in detection by the imaging unit 40 or the detection unit 44. There is. In the example of FIG. 6, the case where the depth direction in detection of the imaging unit 40 or the detection unit 44 substantially matches the front-rear direction (z-axis direction) of the user is shown. Then, by causing the right hand H to overlap the subject P1 for a predetermined time or the like, the subject P1 can be designated as an imaging target. Here, the wearable device 1 stores that the subject P1 has been designated as a target for imaging by the user. Thereafter, when the position or the orientation of the wearable device 1 changes, when the designated subject P1 is in the imaging range 401 or in the detection range 441, the subject P1 is continuously detected. Alternatively, when the position or orientation of the wearable device 1 changes, a change in the relative positional relationship between the wearable device 1 and the subject P1 is calculated based on the change. Thereby, even after the position or orientation of the wearable device 1 changes, the wearable device 1 recognizes the position of the specified subject P1 with respect to the wearable 1. In the display area (not shown in FIG. 6), the wearable device 1 has a frame or the like corresponding to the outer periphery of the imaging range 401 or the detection range 441 so that the user can visually recognize the imaging range 401 or the detection range 441. You may display it.

  In step S11, the user moves or turns his / her neck. The positions of the imaging range 401 and the detection range 441 with respect to the foreground are changed as compared with the case of step S10 due to the change of the position and the orientation of the wearable device 1 caused by the movement of the user and the change of the direction. There is. Here, it is assumed that the positions of the subject P1 and the subject P2 in the foreground have not changed (see the left column in S11). In step S11, the user designates the subject P2 as an imaging target by moving the right hand H so that the right hand H overlaps the subject P2 in the depth direction detected by the imaging unit 40 or the detection unit 44. ing. Then, the wearable device 1 stores that the user has designated the subject P1 as an imaging target. As shown in step S11, the wearable device 1 detects that the subject P2 is out of the imaging range 401. In step S11, the wearable device 1 determines how far away the subject P2 is from the imaging range 401 based on the position of the subject P2 in the detection range 441 or a change in the position, or the subject P2 is It may be estimated whether it is in a state of being separated from the imaging range, or in a state of being close to the imaging range 401 or the like.

  In step S12, in the foreground (left row), the subject P2 is moving in a direction (left direction) approaching the subject P1 (the subject P2 is, for example, an animal). At this time, the user moves and changes the direction so as to follow the change in the position of the moved subject P2, and accordingly, the imaging range 401 and the detection range 441 move in the left direction (right See column). The wearable device 1 acquires a captured image based on the detection that both the subject P1 and the subject P2 are in the imaging range 401 in the imaging range 401.

  By performing such a function, when it is desired to simultaneously capture a plurality of subjects, and at least one subject is an animal, the positions of the plurality of subjects in the foreground are detected in advance, and the at least one subject is detected. Since the wearable device 1 acquires a captured image at the timing when the (animal) moves to a desired position (position within a predetermined distance from another subject), the user does not have to measure the timing and perform an operation. .

  In addition, when detecting the position of the subject in the foreground in advance, the detection range can be expanded not only to the imaging range 401 but also to the range including the detection range 441. , Each subject can be specified.

  As described above, the wearable device 1 according to the present embodiment includes the imaging unit 40 and the detection unit 44 that detects a predetermined object existing in the real space, and is detected based on the detection result of the detection unit 44. The wearable device is capable of executing a predetermined function according to a predetermined operation of a predetermined object, and receives specification of at least one subject included in the detection range of the detection unit according to the predetermined operation of the predetermined object, and receives the designation When the subject is moved to a predetermined position in the imaging range of the imaging unit 40 in a state where it is being performed, the captured image captured by the imaging unit 40 is stored (acquired).

  Further, in accordance with the predetermined operation of the predetermined object, the specification of the plurality of subjects included in the detection range of the detection unit 44 is received, and in the state where the reception is performed, the plurality of subjects are the imaging range 401 of the imaging unit 40 The captured image to be captured by the imaging unit 40 is stored (acquired) when the predetermined positional relationship is reached.

(Modification 1)
The embodiments have been described above. Below, the modification in said embodiment is demonstrated.

  FIG. 7 is a view for explaining a modification of the present embodiment. In the above embodiment, the predetermined action of the upper limb can be detected in the detection range in which the detection range 441 of the detection unit 44 and the imaging range 401 of the imaging unit 40 (second detection unit) are combined. Accordingly, the configuration for changing the detection range is illustrated, but the functional unit for detecting the upper limb is not limited to these combinations. For example, as shown in FIG. 7A, a plurality of detection units 44 having different detection ranges are provided, and predetermined movements of the upper limb can be detected in detection ranges (441 and 443) in which different detection ranges are combined. It is good also as a thing. Then, among the detection ranges in which different detection ranges of the plurality of detection units 44 are combined, the application range in the detection range may be changed according to the content of execution of the function.

  Further, for example, as shown in FIG. 7B, one detection unit 44 may be provided, and the detection application range in the detection range of the detection unit 44 may be changed according to the content of the function execution. FIG. 7B shows an example in which the detection application range in the detection unit 44 is defined in a range 441a (hatched portion).

  The detection application range of the predetermined object can be changed, for example, by mechanically supporting the infrared irradiation unit (or infrared imaging unit) on the wearable device 1 and rotating the wearable device 1 by rotating the wearable device 1. It may be realized by changing the direction of the infrared radiation unit.

  Also, changing the detection application range of the predetermined object may be realized by changing the infrared radiation range (or infrared imaging range). In this case, the wearable device 1 is separately provided with a scanning unit, a polarization member, and the like capable of changing the irradiation range of infrared light. By providing the projector in the wearable device 1 and changing the irradiation range of the infrared light to the scanning unit that two-dimensionally scans the light emitted from the light source of the projector when the image is made to be viewed by the user You may double as a scanning part for.

  The configuration illustrated in FIG. 7 is a function in which the execution content of the function includes a function including an operation for specifying the position of the real space by a predetermined operation of a predetermined object, and a function including an operation based on trajectory information of movement of the predetermined object. In some cases, it is applicable.

(Modification 2)
In the above embodiment, when the detection pattern 1 shown in FIG. 5 is applied, the execution of the predetermined function (imaging function) based on the predetermined operation of the predetermined object in the first range 441a overlapping the imaging range 401 in the detection range 441 Although the configuration (the first example (see FIG. 3)) for prohibiting the above has been described, the present invention is not limited to such a configuration. For example, a predetermined object may be detected in the first range 441a overlapping the imaging range 401 in the detection range 441, and a predetermined function may be executed based on a predetermined operation of the predetermined object.

  As an application example, for example, in a state where the relative positional relationship between the detection range 441 and the imaging range 401 is stored in advance, the position of the upper limb in the first range 441a is detected by the detection unit 44 instead of the imaging unit 40 Then, based on the position of the upper limb in the detection range 44, a configuration may be adopted in which the position of the upper limb in the imaging range 401 is estimated.

  In this case, the wearable device 1 sets in advance the application range of the focusing process by the imaging unit 40 to be a space ahead of the wearable device 1 by a predetermined distance or more. Then, the wearable device 1 may focus on a subject in the vicinity of the center with the position of the upper limb in the imaging range 401 estimated on the basis of the detection result of the detection unit 44. Here, the “predetermined distance” in the term “predetermined distance or more forward” is a distance based on a space where the user's upper limb may exist in front of the wearable device 1, for example, from the wearable device 1 forward The distance is up to 50 cm. Therefore, in the wearable device 1, when performing the focusing process by the imaging unit 40, the setting in which the upper limb of the user can not be set as the focusing target is set in advance. Under such conditions, the wearable device 1 can execute the focusing process in a range where the upper limb can not be focused while being able to specify the in-focus position based on the position of the upper limb. It is possible to prevent being in focus.

  Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various changes and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. Furthermore, all the technical matters disclosed in the present specification can be rearranged without contradiction, and a plurality of components can be combined or divided into one.

  In the above embodiment, although the example in which the wearable device 1 has an eyeglass shape has been shown, the shape of the wearable device 1 is not limited to this. For example, the wearable device 1 may have a helmet type shape that covers approximately the upper half of the user's head. Alternatively, the wearable device 1 may have a mask type shape that covers substantially the entire face of the user.

  Moreover, although said embodiment illustrated the structure which has a pair of display part 32a, 32b in which the display part 32 is provided in front of a user's left and right eyes, it is not limited to this, The display part 32 May be configured to have one display unit provided in front of one of the left and right eyes of the user.

  Moreover, in the above embodiment, the edge of the front part exemplifies a configuration in which the entire circumference of the edge of the display area of the display unit 32 is surrounded, but the present invention is not limited thereto. It may be configured to surround only part of the edge.

  In the above embodiment, as described with reference to FIG. 4, if the function to be performed is an imaging function or a character input function (a function including an operation based on trajectory information of movement of the upper limb), the upper limb In the case where the detection application range for detecting an object is a display visual range, while the function to be performed is a function including an operation of designating a predetermined position in a real space, the detection application range for detecting an upper limb is Although the configuration in which the display visual recognition range is excluded is shown, the combination of the function execution content and the detection application range is not limited to the above. For any function including various other execution contents, a detection range suitable for the function is applied.

  Moreover, in said embodiment, although the structure which detects an upper limb as a predetermined thing was shown, it is not limited to this. For example, the predetermined object may be an object (eg, a rod-like object such as a pen) grasped by the user that is not the user's body. The object held by the user here may be a portable electronic device such as a mobile phone or an electronic device such as a watch-type terminal worn on the upper limb of the user.

  Further, in the above embodiment, the configuration in which the hand or finger is detected by the imaging unit 40 (or the detection unit 44) as the upper limb of the user is shown, but the hand or finger is wearing a glove or glove Even if it is detectable.

  Although the above-mentioned embodiment explained composition and operation of wearable device 1, it is not limited to this, but may be constituted as a method and program provided with each component.

DESCRIPTION OF SYMBOLS 1 wearable device 1a front face part 1b side face part 1c side face part 13 operation part 22 control part 24 control part 24 storage part 24a control program 24b imaging data 25 detection processing part 26 display control part 32a, 32b display part 40, 42 photographing part 44 detection part

Claims (12)

A detection unit for detecting a predetermined object existing in the real space;
A wearable device worn on a head that performs a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit,
A wearable device, which, upon activating the predetermined function, changes a detection application range of the detection unit according to the content of execution of the predetermined function. It is determined whether or not the content of execution of the predetermined function includes an operation for specifying the position of the actual space by the predetermined operation of the predetermined object, and the detection application range is changed according to the determination result. Wearable devices. A display unit having a predetermined display area;
In the case where the content of execution of the predetermined function includes an operation of specifying the position of the actual space by the predetermined operation of the predetermined object,
The wearable device according to claim 2, wherein a display visual recognition range in which the user can visually recognize the display area is set as the detection application range. The wearable device according to claim 1, wherein it is determined whether the content of execution of the predetermined function includes an operation based on movement trajectory information of the predetermined object, and the detection application range is changed according to the determination result. A display unit having a predetermined display area;
A control unit that defines a display visual recognition range in which the user can visually recognize the display area;
When the content of execution of the predetermined function includes an operation based on trajectory information of movement of the predetermined object,
The wearable device according to claim 4, wherein a range not overlapping with the display visual range within the detectable range of the detection unit is set as the detection application range. The wearable device according to claim 5, wherein the detection application range is located below the display visual range. Equipped with a control unit,
The detection unit can three-dimensionally detect a real space,
The control unit defines a virtual plane within a three-dimensional detection range of the detection unit,
While detecting the position of the predetermined object in the real space, when the position is projected from the direction perpendicular to the virtual plane with respect to the virtual plane, a projection position projected onto the virtual plane is detected. ,
The wearable device according to claim 1, wherein the predetermined function is performed based on the projection position on the virtual plane. And a display unit having a predetermined display range,
The control unit associates the coordinates of the virtual plane with the coordinates of a predetermined range in the display range,
The wearable device according to claim 7, wherein a virtual object based on the shape of the predetermined object is displayed at a position corresponding to the projection position in the display range. An imaging unit,
A detection unit for detecting a predetermined object existing in the real space;
A wearable device that executes a predetermined function according to a predetermined operation of the predetermined object detected by the detection unit,
In accordance with the predetermined operation of the predetermined object, the designation of at least one subject included in the detection range of the detection unit is received, and in the state where the reception is performed, the subject is a predetermined one in the imaging range of the imaging unit The wearable device stores a captured image captured by the imaging unit in response to movement to a position. In accordance with a predetermined operation of the predetermined object, specification of a plurality of subjects included in the detection range of the detection unit is received, and in a state where the reception is performed, the plurality of subjects are in the imaging range of the imaging unit The wearable device according to claim 9, wherein the captured image captured by the imaging unit is stored when the predetermined positional relationship is reached. An imaging unit,
A detection unit for detecting a predetermined object existing in the real space;
When the imaging unit is in imaging,
A wearable device that executes processing related to a function of the imaging unit based on detection of the predetermined operation in a range not overlapping with an imaging range of the imaging unit in a detection range of the detection unit. An imaging unit,
A display unit,
A detection unit for detecting a predetermined movement of a predetermined object existing in the real space;
When the imaging unit is in imaging,
A wearable device, which executes processing related to a function of the imaging unit based on detection of the predetermined operation in a predetermined area not overlapping the imaging range of the imaging unit in a display area of the display unit.