JP5365684B2 - Control device and head mounted display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide technique capable of identifying and executing operation of an image switching process and operation of a screen scrolling process according to a head movement of a user, and executing operation by the head movement with more accuracy. <P>SOLUTION: A head mounted display device comprises a control unit 310 which can execute operation by a head movement of a user with more accuracy, by specifying the head movement of the user according to information detected by a head movement detection unit 200, then executing a process desired by the user corresponding to angular velocity of the head movement of the user, and preventing a returning movement of the head movement of the user from being reflected on the process. The control unit 310 performs processes to execute a start and an end of each process corresponding to magnitude of the angular velocity detected, based on predetermined thresholds. <P>COPYRIGHT: (C)2012,JPO&amp;INPIT

Description

  The present invention relates to a technique for detecting a motion of a human body and performing specific control.

  In a head mounted display device that displays an image in front of the user's eyes, it detects the movement of the user's head and performs control (reproduction start, pause, etc.) on the image and video according to the specific movement, There are known technologies for scrolling the displayed video in accordance with the user's head movement and moving the sound field of the headphones to improve the sense of reality. Detection of the user's head movement in the head-mounted display device is known. For this, a sensor such as a gyro sensor (angular velocity sensor) or an acceleration sensor is used.

  A head-mounted display device is known that uses these sensors to reflect a user's head movement in information display (see, for example, Patent Document 1).

JP-A-11-161190

  However, in the technique described in Patent Document 1, it is impossible to distinguish between screen scrolling and screen switching by the head movement, and the user has to perform a manual operation. In addition, there is a problem that processing unintended by the user is executed by the return operation of the user's head.

  Therefore, in the present invention, the screen switching process and the screen scrolling process are executed from the angular velocity of the user's head movement, and the process desired by the user is executed, and the return movement of the user's head is not reflected in the process. Thus, an object of the present invention is to provide a technique that can more accurately execute an operation based on a user's head movement.

A head-mounted display device according to an aspect of the present invention includes a motion detection unit that detects the motion of the head of a user wearing the device, and the motion detection unit has a predetermined threshold speed or angular velocity. determined first operation of Jo Tokoro when detecting processing faster than the speed or angular velocity by the start, and a control unit to terminate the process after a predetermined time has elapsed, the control unit is within the predetermined time period by the motion detection unit second operation, characterized in that to terminate the pre-Symbol processing when it is detected.
The control device according to one aspect of the present invention includes a motion detection unit that detects a motion of a head of a user wearing the device, and the motion detection unit has a predetermined threshold speed or angular velocity. A control unit that starts a predetermined process when a first motion faster than a fixed speed or angular velocity is detected, and terminates the process after a predetermined time has elapsed, the control unit within the predetermined time The processing may be terminated when a second motion is detected by the motion detection unit.
The control device according to one aspect of the present invention includes a motion detection unit that detects a motion of a user wearing the device, and the motion detection unit that has a speed or angular velocity determined by a predetermined threshold in a specific direction. A control unit that starts a predetermined process when a first motion faster than the angular velocity is detected and ends the process after a predetermined time has elapsed, and the control unit is a user detected by the motion detection unit. The motion direction is specified, and the processing is terminated when the motion detection unit detects a second motion including at least a velocity or angular velocity in a direction opposite to the specific direction within the predetermined time. It is good.
A program according to one aspect of the present invention is a program that causes a computer to function as a detection unit and a control unit that detect movement of a head of a user wearing a device. When the detection means detects a first motion in a specific direction having a speed or angular velocity faster than a speed or angular velocity determined by a predetermined threshold, the predetermined processing is started, and the predetermined processing is ended after a predetermined time has elapsed. And a process of ending the predetermined process when a second operation is detected by the detection means within the predetermined time.
A program according to one aspect of the present invention is a program that causes a computer to function as a detection unit and a control unit that detect a movement of a user wearing the apparatus, and the detection unit includes the detection unit. A process for starting a predetermined process when detecting a first movement in a specific direction having a speed or angular speed faster than a speed or angular speed determined by a predetermined threshold, and ending the predetermined process after elapse of a predetermined time; , A process for further specifying the direction of movement of the user detected by the detection means, and a second action including at least a speed or angular velocity in a direction opposite to the specific direction within the predetermined time. It is good also as performing the process which complete | finishes a process.
Also, the control method according to one aspect of the present invention is a control method for performing processing corresponding to the detected motion speed or angular velocity of the user's head, which is faster than a speed or angular velocity determined by a predetermined threshold. Alternatively, a step of detecting a first movement in a specific direction having an angular velocity, a step of starting a predetermined process when the first movement is detected, and ending the predetermined process after a predetermined time has elapsed. And a step of ending the process when a second action is detected within the predetermined time.
The control method according to one aspect of the present invention is a control method for performing processing corresponding to the detected motion speed or angular velocity, and is a specific direction having a speed or angular velocity faster than a speed or angular velocity determined by a predetermined threshold. A step of detecting a first action to the user, a step of starting a predetermined process when the first action is detected, a step of ending the predetermined process after a predetermined time has elapsed, and a user And a step of ending the processing when a second motion including at least a speed or an angular velocity opposite to the specific direction is detected within the predetermined time. May be a feature.

  As described above, according to the present invention, the head-mounted display device can execute the control by more accurately recognizing the operation intended by the user from the angular velocity of the user's head movement. Can be provided.

It is a perspective view of HMD100 concerning a first embodiment of the present invention. It is a side view of HMD100 concerning a first embodiment of the present invention. It is a block diagram which shows the functional structure of HMD100 which concerns on 1st embodiment of this invention. (A) It is the schematic of the flag information 700 stored in the memory | storage part 320 of HMD100 which concerns on 1st embodiment of this invention. (B) It is the schematic of the direction information 701 stored in the memory | storage part 320 of HMD100 which concerns on 1st embodiment of this invention. It is a chart which shows a time-dependent change of the angular velocity of head movement at the time of scroll processing being performed by control part 310 concerning a first embodiment of the present invention. It is a chart which shows a time-dependent change of angular velocity of head operation at the time of a screen change process being performed by control part 310 concerning a first embodiment of the present invention. 5 is a flowchart illustrating processing when the control unit 310 according to the first embodiment of the present invention receives a voltage value transmitted from the head movement detection unit 200. 5 is a flowchart illustrating a scroll process when the control unit 310 according to the first embodiment of the present invention receives a voltage value sent from the head movement detection unit 200. 5 is a flowchart showing insensitive operation processing when the control unit 310 according to the first embodiment of the present invention receives a voltage value sent from the head movement detection unit 200. 5 is a flowchart illustrating an image switching process when the control unit 310 according to the first embodiment of the present invention receives a voltage value sent from the head movement detection unit 200. It is a block diagram which shows the functional structure of HMD500 which concerns on 2nd embodiment of this invention. It is a flowchart which shows the process at the time of the control part 610 which concerns on 2nd embodiment of this invention receiving the voltage value transmitted from the head movement detection part 200. FIG. 6 is a schematic diagram showing a display example of an indicator 800. It is a block diagram which shows the electric constitution of HMD100 which concerns on 1st embodiment of this invention. 5 is a flowchart illustrating processing when the control unit 310 according to the first embodiment of the present invention receives a voltage value transmitted from the head movement detection unit 200.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  1 and 2 show a head mounted display device (hereinafter abbreviated as HMD) 100 according to a first embodiment of the present invention. FIG. 1 is a perspective view of the HMD 100 according to the first embodiment of the present invention, and FIG. 2 is a side view of the HMD 100 according to the first embodiment of the present invention.

  As shown in the figure, the HMD 100 according to the present embodiment includes a head wearing band 110, an audio output unit 120, housings 130A and 130B, a support unit 140, an arm unit 150, a display unit 160, and an operation unit. 170.

  The head mounting band 110 is formed in a curved shape so that both ends thereof face each other. Further, the head wearing band 110 is formed of an elastic material. When the head wearing band 110 is worn on the user's head, the speakers 121A and 121B formed at both ends thereof (if these are not distinguished, The HMD 100 can be detachably mounted on the user's head by simply pressing 121) toward the inside of the user's head.

  Enclosures 130A and 130B are connected to both ends of the head wearing band 110. The enclosure 130A is provided with a speaker 121A, and the enclosure 130B is provided with a speaker 121B. In addition, in the head wearing band 110, signal lines for electrically connecting the speakers 121A and 121B, the operation unit 170, the display unit 160, and the power supply unit 180 (see FIG. 3), A power line or the like for supplying power is wired from a power supply unit 180 built in a housing 130B described later.

  The audio output unit 120 converts the audio signal into audio. In this embodiment, there are speakers 121A and 121B, which are so-called headphones speakers used by being applied to both ears of the user. In FIG. 1, the right speaker 121A is the left ear speaker, and the left speaker 121B is the right ear speaker. These left and right distinctions may be arbitrarily determined by user operation. In addition, a power line for supplying power from the power supply unit 180 and an audio signal line for supplying an audio signal are wired.

  The casings 130A and 130B are provided at both ends in the longitudinal direction of the head mounting band 110, and speakers 121A and 130B are provided on the outer wall surfaces of the casings 130A and 130B on the user's head side (opposite sides). 121B are connected to each other. In the present embodiment, the control unit 300 and the power supply unit 180 are built in the housing 130B, and the operation unit 170 is provided on the outer wall surface opposite to the speaker 121B.

  The power supply unit 180 is connected to the audio output unit 120, the display unit 160, the operation unit 170, and the control device 300 through a power line. A power switch (not shown) for switching the power of the HMD 100 on and off is provided on the outer wall surface of the housing 130A opposite to the speaker 121A.

  The power supply unit 180, the control device 300, the operation unit 170, and the power switch may be arranged in any of the housings 130A and 130B, and the housings 130A and 130B are integrated with the speakers 121A and 121B. It is good also as such a structure.

  The support unit 140 rotatably connects one end side of the arm unit 150 to the housing 130B. Any connection method may be used.

  When the arm 150 is attached to the head of the user, the display unit 160 attached to the other end of the arm 150 other than the casing 130A is in front of the user's eyes. It is curved in its longitudinal direction so as to be located. In addition, a power line for supplying power to the display unit 160 and an image signal line for supplying an image signal are wired from the power supply unit 180 inside.

  The display unit 160 is connected to the tip of the arm unit 150 so as to be rotatable in accordance with the line of sight of the user. The display unit 160 includes an LCD (Liquid Crystal Display) as a display device for displaying an image and an optical system for enlarging the displayed image. Based on the image signal supplied from the control device 300, the display unit 160 displays an image. Is displayed.

  The operation unit 170 includes operation switches 171A, 171B, 171C, 171D, and 171E, and a power switch (not shown). Through the operation switches 171A, 171B, 171C, 171D, and 171E, it is possible to input instructions related to the HMD 100 such as play, stop, fast forward, rewind, cancel control processing, and change the volume. ing. When an operation instruction is input via these switches, it is transmitted to the control unit 310 via the I / F unit 330.

  Further, a remote controller (not shown) capable of performing operations related to the HMD 100 may be provided separately. The remote controller can be operated wirelessly or by wire while the user looks at the operation switch. Further, the control device 300 and the power supply unit 180 may be built in the remote control. Further, when the operation is performed wirelessly, the operation unit 170 may be provided with a remote control reception unit 172.

  Next, the HMD 100 according to the first embodiment of the present invention will be described with reference to FIG. FIG. 3 is a block diagram showing a functional configuration of the HMD 100.

  First, the control device 300 will be described. As illustrated in FIG. 3, the control device 300 includes a head movement detection unit 200, a control unit 310, a storage unit 320, and an I / F unit 330.

  Next, the head movement detection unit 200 will be described. The head motion detection unit 200 is a device for detecting head motion, and is expressed as an angular velocity sensor (Z) 201A and an angular velocity sensor (X) 201B (in the case where these are not distinguished, simply 201). ). The head movement detection unit 200 detects, as an angular velocity, direction information related to a detection target, that is, a user's head movement, from a specific reference axis. In the head movement detection unit 200 according to the first embodiment of the present invention, as shown in FIG. 1, the vertical direction (direction in which the user stands upright) is the Z axis, and is orthogonal to the Z axis. The axis in the direction from the side surface to the other side surface (direction passing through the speakers 121A and 121B) is taken as the X axis, and angular velocity detection is executed using these two axes as reference axes.

  As the angular velocity sensor 201, an optical gyro utilizing the fact that when the laser beam is circulated by a mirror or fiber in the housing and the direction of the housing changes, the timing of light reception from the light emission of the laser that circulates inside changes, Applying precession, a mechanical gyro that detects angular velocity variation, using the fact that when angular velocity is applied to the mass that vibrates (primary vibration), vibration (secondary vibration) is also generated in the direction perpendicular to it by Coriolis force. A vibrating gyroscope or the like can be used. Here, a piezoelectric vibration gyro using piezoelectric ceramics is used as the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B.

  As shown in FIG. 1, the angular velocity sensor (Z) 201A detects the angular velocity in the yaw direction, that is, the yaw angle that is the inclination of the rotation angle around the Z axis, and the angular velocity sensor (X) 201B The angular velocity in the (Pitch) direction, that is, the pitch angle that is the inclination of the rotation angle around the X axis is detected. With such a sensor, the HMD 100 can detect a horizontal swing motion and a vertical swing motion of the user's head. In the present embodiment, the angular velocity sensor 201 performs sampling every predetermined cycle (for example, 50 msec), and the detection result is output as an analog voltage value proportional to the angular velocity. The output voltage value is converted into a digital signal by an A / D converter (not shown) and transmitted to the control unit 310 of the control device 300.

  Further, the number of angular velocity sensors 201 is not limited to that described above. An angular velocity sensor using the Y axis as a reference axis for detecting a movement of the user's head can be further provided so that the roll angle can be detected. An angular velocity may be detected.

  An acceleration sensor may be further provided in addition to the angular velocity sensor 201, and a configuration having only an acceleration sensor instead of the angular velocity sensor may be employed.

  The I / F unit 330 connects the audio output unit 120, the display unit 160, the operation unit 170, and the power supply unit 180 to the control device 300. In addition, as a general-purpose bus for connecting the HMD 100 and an external device so as to be able to transfer data, a terminal conforming to a standard such as USB (Universal Serial Bus) or IEEE1394 is provided. Further, a network such as Ethernet (trademark), a short-range wireless communication between devices such as Bluetooth (trademark), and the like may be provided.

  The storage unit 320 includes a flag information storage area 321 and a direction information storage area 322.

Flag information 700 is stored in the flag information storage area 321 (see FIG. 4A). The flag information 700 has an AV (Z) flag storage area 700a and an AV (X) flag storage area 700b. For these, in the scroll processing described later, the motion analysis unit 311 detects a value equal to or less than the threshold Th ₃ for the angular velocity of the rotation angle (yaw angle) around the Z axis or the rotation angle (pitch angle) around the X axis. A flag indicating that this has been done is registered.

  The direction information storage area 322 stores direction information 701 (see FIG. 4B). The direction information 701 includes a set direction information storage area 701a and a reverse direction detection flag storage area 701b. In the setting direction information storage area 701a, information indicating the direction of angular velocity used by the motion analysis unit 311 in the screen switching process described later, for example, Z + (right direction), Z- (left direction), X- (upward direction). ), X + (downward), etc. are stored as setting direction information. In the reverse direction detection flag storage area 701b, a flag indicating that an angular velocity in the direction opposite to the set direction has been detected is registered.

  Hereinafter, the angular velocity obtained from the voltage value of the angular velocity sensor (Z) 201A indicating the left-right direction is AV (Z), and the angular velocity obtained from the voltage value of the angular velocity sensor (X) 201B indicating the vertical direction is AV (X). Of the directions of the angular velocity AV (Z), the right direction is Z +, the left direction is Z−, and among the directions of the angular velocity AV (X), the upward direction is X−, and the downward direction is X +.

  The control unit 310 includes an operation analysis unit 311, a time measurement unit 312, and a signal control unit 313.

  When the motion analysis unit 311 receives the voltage values sent from the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B, the motion analysis unit 311 calculates the angular velocity of the head movement from each voltage value and a reference value generated in advance. AV (Z) and AV (X) are calculated, and each process is executed according to the angular velocity.

  The time measuring unit 312 includes three timers (not shown) that measure the processing time of each process, which are a setting timer, a dead operation timer, and a screen switching timer. When the time measurement unit 312 receives each timer start request from the operation analysis unit 311, the time measurement unit 312 starts the operation of the requested timer. Then, when a predetermined time determined for each of these timers has elapsed, the time measuring unit 312 stops each timer and outputs a timer end response to the operation analysis unit 311. Each timer may be configured to count down a predetermined time from the start.

  The signal control unit 313 generates and outputs a control signal corresponding to the head movement, for example, an image signal to be output to the display unit 160, an audio signal to be output to the audio output unit 120, and the like. Similarly, a generation and output process is executed for a signal corresponding to a user instruction received via the operation unit 170.

  Next, processing executed by the control unit 310 will be described in detail with reference to FIGS. FIG. 5 is a chart showing the temporal change of the angular velocity of the head movement when the scroll process is executed by the control unit 310, and FIG. 6 is the head movement when the screen switching process is executed by the control unit 310. It is a chart which shows the time-dependent change of angular velocity of.

  In the charts shown in FIGS. 5 and 6, the horizontal axis represents time, and the vertical axis represents angular velocity. Furthermore, coordinates above the horizontal axis indicate an angular velocity in the downward direction or the right direction when the head movement is performed, and coordinates below the horizontal axis indicate an angular velocity in the upward direction or the left direction when the head movement is performed.

  In FIG. 5, a broken line 811 represents a change with time in angular velocity of AV (Z) (horizontal direction), and a solid line 812 represents a change in angular velocity of AV (X) (vertical direction).

The threshold Th ₁ is an angular velocity required when the user instructs a screen switching operation, and the threshold Th ₂ is an angular velocity necessary when the user instructs a screen scrolling operation. It is provided to define the speed. Th ₁ and Th ₂ have predetermined values in the respective directions, up, down, left, and right (for example, Th ₁ = 70 to 80 ° / s, Th ₂ = 25 to 35 ° / s).

Th ₁ and Th ₂ are set to values larger than the opposite directions in the direction in which head movement is easy (downward and rightward here) among up, down, left and right. With such a configuration, it is possible to perform operations in all directions without a sense of incongruity. Of course, this value can be appropriately changed depending on the use conditions and the like. In FIG. 5, Th ₁ and Th ₂ are shown as single values for convenience.

Further, in the HMD 100 according to the first embodiment, Th ₁ is a larger value than Th ₂ , and the operation of shifting to the screen switching process is more angular in the head movement than the operation of shifting to the scroll process. Is required. Each threshold value may be set in advance, or may be configured to be appropriately changed depending on usage conditions and the like.

The threshold value Th ₃ is a predetermined value provided to end the screen scrolling process, and the threshold value Th ₄ is a predetermined value provided to end the screen switching process. In order to prevent frequent screen switching, Th ₃ and Th ₄ are preferably smaller than Th ₁ and Th ₂ , and the values of Th ₃ and Th ₄ are in the vicinity of 0 ° / s. Or 0 ° / s. In FIG. 5, Th ₃ is a value in the vicinity of 0 ° / s, and in FIG. 6, Th ₄ is shown as 0 ° / s.

T ₁ is a time when the absolute value of AV (Z) or AV (X) becomes equal to or greater than the threshold Th ₂ and the setting timer is started by the time measuring unit 312. 5 and 6 has a AV (X +) the absolute value of (downward operation) the threshold Th ₂ or more.

T ₂ is a time point when the operation time of a predetermined setting timer elapses and the setting timer is stopped by the time measuring unit 312. In FIG. 5, after the elapse of T ₂ also, since the absolute value of AV (X) is from the threshold value Th ₁ in the range of Th _2, thereafter, to perform screen scrolling, the scroll process is started. In FIG. 6, by the time of T _2, the absolute value of AV (X) at time T ₅ has reached the threshold value Th _1, at time T _5, the screen switching processing for switching the screen Is started. Thus, in the time of subsequent T _2, screen switching process is already running.

T ₃ is a time when the absolute values of both AV (Z) and AV (X) become equal to or less than the threshold Th ₃ after T ₂ , and the insensitive operation timer is started by the time measuring unit 312, and scroll processing is performed. Ends. In FIG. 5, since the absolute value of AV (Z +) (rightward movement) is equal to or lower than the threshold Th ₃ first, the time when the absolute value of AV (X) is equal to or lower than the threshold Th ₃ is T _3. It becomes. Thereafter, the scroll process is terminated, and an insensitive operation process that does not reflect the angular velocity in the control is started.

T ₄ is a time when the elapsed operation time of apathetic operation timer determined in advance, the time measuring unit 312, apathy operation timer is stopped, apathy operation process ends. Therefore, AV (X) in the period from T _{3 to} T ₄ in FIG. 5 is not reflected in the actual control.

T ₆ in FIG. 6, the threshold value Th ₂ or more and is the angular velocity of the angular direction (setting direction) at T ₅ on the screen switching process of T ₅ after the angular direction opposite the direction of the angular velocity reaches the threshold Th ₄ This is the point in time when the screen switching process is completed again in the direction that matches the set direction. In FIG. 6, AV (X−) (upward operation) opposite to AV (X +) (downward operation) reaches the threshold Th ₄ and AV (X +) (downward operation) again. It is time to become. At the time of T _7, the operation time of the screen switching timer be predetermined has elapsed, the screen switching timer is finished. Therefore, if the absolute value of the reverse angular velocity and set direction T ₅ or later, if not reach the threshold Th _4, the screen switching process at time T ₇ becomes to be terminated.

  FIG. 7 is a flowchart showing processing when the control unit 310 of the HMD 100 according to the first embodiment receives a voltage value sent from the head movement detection unit 200.

  The motion analysis unit 311 receives voltage values detected and output at predetermined intervals (here, 50 msec) from the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B (S101). The motion analysis unit 311 then subtracts a predetermined reference value from the received voltage value to calculate the true change amount of the head motion, and obtains the angular velocities AV (Z) and AV (X).

  Next, the motion analysis unit 311 detects whether the setting timer included in the time measurement unit 312 is operating (S102). When the setting timer is operating (YES), the process proceeds to step 108, and when the setting timer is not operating (NO), the process proceeds to step 103.

  The determination as to whether or not the timer is in operation may be performed by detecting whether or not a timer end response has been received from the time measuring unit 312 described later, or by appropriately requesting timer information from the time measuring unit 312. Is also good (the same applies below).

  In step 103, the operation analysis unit 311 determines whether or not the voltage value received in step 101 is the first after receiving the setting timer end response. If the received voltage value is the first after receiving the set timer end response (YES), the process proceeds to step 106, and if not (NO), the process proceeds to step 104. .

In step 104, the motion analysis unit 311, and the angular velocity AV (Z), the absolute value of the AV (X) it is determined whether the threshold value Th ₂ or more. When both or one of the absolute values of the angular velocities AV (Z) and AV (X) is greater than or equal to Th ₂ (YES), the motion analysis unit 311 causes the time measurement unit 312 to set the set timer. The process proceeds to step 105, and if the absolute values of both angular velocities are less than Th ₂ (NO), the process returns to step 101 and the process is repeated.

  In step 105, the time measuring unit 312 starts the operation of the setting timer. Further, the time measuring unit 312 ends the operation of the setting timer after a predetermined time has elapsed, and outputs a setting timer end response to the operation analysis unit 311.

Returning to Step 103, if the received voltage value is the first after receiving the setting timer end response (YES), the motion analysis unit 311 determines that the angular velocities AV (Z), AV (X), Is detected to be within the range from the threshold Th ₂ to the threshold Th ₁ (Th ₂ ≦ AV (Z or X) <Th ₁ ) (S106). When both or one of the absolute values of the two angular velocities are within the range from the threshold Th ₂ to the threshold Th ₁ (YES), the scroll process is started (S107) and the process is terminated. If the absolute values of both angular velocities are not in the range from the threshold Th ₂ to the threshold Th ₁ (NO), the process returns to Step 101 and is repeated.

Returning to step 102, whether when setting the timer was operating (YES), the motion analysis unit 311, and the angular velocity AV (Z), the absolute value of the AV (X), the threshold value Th ₁ or more Is determined (S108). If both or one of the absolute values of the angular velocities AV (Z) and AV (X) is equal to or greater than the threshold Th ₁ (YES), the process proceeds to step 109, where the absolute values of both angular velocities are If the threshold Th is not equal to or greater than ₁ (NO), the process returns to step 101 and the process is repeated.

In step 109, the motion analysis unit 311 detects the angular velocity that is equal to or greater than the threshold Th ₁ in step 108 (for example, right direction if Z +, left direction if Z-, and upward direction if X-. , If X +, any one of the downward directions) is generated and stored in the setting direction information storage area of the direction information storage area 322.

  Next, the motion analysis unit 311 requests the time measurement unit 312 to stop the setting timer and start the screen switching timer (S110), and the signal control unit 313 to the angular velocities AV (Z) and AV (X). Is output to start the screen switching process (S111), and the process ends. Upon receiving the setting timer stop request and the screen switching timer start request, the time measuring unit 312 stops the setting timer that is operating and starts the screen switching timer. When the screen switching timer ends the operation after a predetermined time has elapsed, the time measuring unit 312 outputs a screen switching timer end response to the operation analyzing unit 311.

  Next, the scroll process will be described. FIG. 8 is a flowchart showing a scroll process executed by the control unit 310.

  The motion analysis unit 311 receives voltage values detected and output at predetermined intervals from the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B (S201). The motion analysis unit 311 then subtracts a predetermined reference value from the received voltage value to calculate the true change amount of the head motion, and obtains the angular velocities AV (Z) and AV (X).

Next, the motion analysis unit 311 determines whether or not the absolute value of the angular velocity AV (Z) or the angular velocity AV (X) is equal to or less than a threshold Th ₃ (S202). If the absolute values of both angular velocities are not less than or equal to the threshold Th ₃ (NO), the angular velocities AV (Z) and AV (X) are output to the signal control unit 313, and the process proceeds to step 207. Alternatively, if the absolute value of one of the angular velocities is equal to or less than the threshold Th ₃ (YES), the process proceeds to step 203.

In step 203, the motion analysis unit 311 generates flag information 700 and stores it in the flag information storage area 321. Further, a flag indicating that a value equal to or less than the threshold Th ₃ has been detected for the angular velocity at which a value equal to or less than the threshold Th ₃ is detected in Step 202 is indicated by an AV (Z) flag storage area 700 a of the flag information 700 X) Register in the flag storage area 700b.

In step 204, the operation analysis unit 311 reads flag information from the flag information storage area 321 of the storage unit 320, and registers the flags in the AV (Z) flag storage area 700a and the AV (X) flag storage area 700b. Is detected, that is, whether or not there is a threshold value Th ₃ or less at both rotation angles. If information indicating both rotation angles is stored (YES), the process proceeds to step 205. If only information indicating one rotation angle is stored (NO), only the unstored angular velocity is signaled. The data is output to the control unit 313 and the process proceeds to step 207.

  In step 205, the motion analysis unit 311 requests the time measurement unit 312 to start the insensitive operation timer, starts the insensitive operation processing (S206), and ends the processing. When the time measuring unit 312 receives the insensitive operation timer start request, the time measuring unit 312 starts the insensitive operation timer. When the insensitive operation timer ends the operation after a lapse of a predetermined time, the time measuring unit 312 outputs an insensitive operation timer end response to the operation analyzing unit 311.

  In step 207, when the signal control unit 313 receives the angular velocity output in step 202 or 204, the signal control unit 313 generates a scroll control signal instructing a scroll direction, a distance, and the like based on the angular velocity. Then, the signal control unit 313 outputs the generated scroll control signal to the display unit 160 (S208), and returns to Step 201.

  Next, the insensitive operation process will be described. FIG. 9 is a flowchart showing insensitive operation processing executed by the control unit 310.

  The motion analysis unit 311 receives voltage values detected and output at predetermined intervals from the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B (S301).

  Next, the motion analysis unit 311 detects whether or not the insensitive operation timer of the time measurement unit 312 is operating (S302). If the insensitive operation timer is in operation (YES), the process returns to step 301 to repeat the processing. If the insensitive operation timer is not in operation (NO), the insensitive operation processing is terminated, and the step of FIG. Returning to 101, the process is repeated.

  Next, the screen switching process will be described. FIG. 10 is a flowchart showing the screen switching process executed by the control unit 310.

  In step 401, when the signal control unit 313 receives the angular velocity output from the motion analysis unit 311 in step 111, the signal control unit 313 generates a screen switching control signal instructing a screen switching direction or the like based on the angular velocity. Then, the signal control unit 313 outputs the generated screen switching control signal to the display unit 160 (S402).

  Next, the motion analysis unit 311 receives voltage values detected and output at predetermined intervals from the angular velocity sensor (Z) 201A and the angular velocity sensor (X) 201B (S403). The motion analysis unit 311 then subtracts a predetermined reference value from the received voltage value to calculate the true change amount of the head motion, and obtains the angular velocities AV (Z) and AV (X).

  Next, the operation analysis unit 311 detects whether the screen switching timer of the time measurement unit 312 is operating (S404). If the screen switching timer is operating (YES), the process proceeds to step 405. If the screen switching timer is not operating (NO), the screen switching process is terminated (S408), and the process returns to step 101 in FIG. Repeat the process.

  In step 405, the motion analysis unit 311 reads the setting direction information from the setting direction information storage area 701a of the direction information storage area 322, and the direction of the angular velocity AV (Z) or AV (X) matches the setting direction. Judge whether to do. If the directions of the angular velocities match, the process proceeds to step 406, and if not, the process proceeds to step 409.

  In step 406, the motion analysis unit 311 reads the direction information 701 from the direction information storage area 322, and detects whether the reverse direction detection flag is registered in the reverse direction detection flag storage area 701b. If the reverse direction detection flag is registered (YES), the process proceeds to step 407, and if not registered (NO), the process returns to step 403 and the process is repeated.

  In step 407, the motion analysis unit 311 requests the time measurement unit 312 to stop the screen switching timer. Upon receiving the screen switching timer stop request from the motion analysis unit 311, the time measurement unit 312 stops the screen switching timer and outputs a screen switching timer end response to the motion analysis unit 311. When receiving the screen switching timer end response, the operation analysis unit 311 ends the screen switching process (S408).

  In step 409, the motion analysis unit 311 registers the reverse direction detection flag in the reverse direction detection flag storage area 701b of the direction information 701, returns to step 403, and repeats the processing.

  With the configuration as described above, the HMD 100 according to the present embodiment can appropriately switch processing depending on the magnitude of the angular velocity for detecting the user's head movement in one direction. Depending on the operation (speed), scroll processing and screen switching processing can be used properly. In addition, by providing an insensitive operation period after the scroll process, and by not reflecting the angular velocity other than the set direction in the control during the screen switching process, the user can return the head (the face is turned forward). It is possible to avoid unintended processing.

In the process of step 106, the motion analysis unit 311 determines that the absolute values of the angular velocities AV (Z) and AV (X) are lower than the threshold Th ₁ (AV (Z or X) <Th ₁ ). It is good also as a structure which progresses to step 107 and performs a scroll process.

Further, when the absolute values of the angular velocities AV (Z) and AV (X) fall below the threshold Th ₂ during the operation of the setting timer, the motion analysis unit 311 ends the currently operating setting timer. The timer end response transmitted from the time measuring unit 312 sometimes may be ignored. With such a configuration, when the user's head movement becomes small during the period from T ₁ to T ₂ , the scroll process is not executed, and malfunction can be prevented.

Further, as shown in FIG. 15, when the first voltage is received after the end response of the setting timer, the start of the scroll process and the screen switching process may be determined based on the voltage value. Further, when the absolute values of the angular velocities AV (Z) and AV (X) fall below the threshold Th ₂ during the operation of the setting timer, the angular velocities AV (Z) and AV (X) are determined in step 108. If the absolute value is less than the threshold Th ₁ (NO), the process may return to step 101 and repeat the process without proceeding to step 106.

Further, by setting the threshold values Th ₃ and Th ₄ for the scroll process and the screen switching process in the vicinity of 0 ° / s, the minute angular velocity of the head movement is detected during each process, and the process is performed. It is possible to reflect.

In step 106 in FIG. 7, it is further determined whether AV (X) or AV (Z) is an angular velocity in the opposite direction to the direction of angular velocity that was equal to or greater than Th ₂ in step 104. If there is, it may be configured not to use it. In this case, in step 104, the direction of angular velocity that is equal to or greater than Th ₂ may be stored in the storage unit. With such a configuration, it is possible to prevent malfunction due to a rapid change in head movement.

Further, Th ₃ may be set to 0 ° / s, and the insensitive operation process may be started when the angular velocity in the direction opposite to the set direction is detected, similarly to step 405 in FIG. Also, Th ₄ may be configured to compare the absolute value of the angular velocity with Th ₄ as a value in the vicinity of 0 ° / s as in Step 202 of FIG.

  Note that the processing started in steps 107 and 111 in FIG. 7 is not limited to the above. A configuration may be adopted in which other processing executed by a menu screen, a game operation, or the like is started.

  Here, the hardware configuration of the HMD 100 will be described. FIG. 14 is a block diagram showing an electrical configuration of the HMD 100.

  As shown in FIG. 14, the HMD 100 includes a CPU (Central Processing Unit) 11 that centrally controls each device, a memory 12 that stores various data in a rewritable manner, various programs, data generated by the programs, and the like. A nonvolatile auxiliary memory 13 to be stored, an LCD 15, devices such as a speaker 121, and an I / F unit 14 that connects the CPU 11 are provided. The control unit 310 can be realized, for example, by reading a predetermined program stored in the auxiliary memory 13 into the memory 12 and executing it by the CPU 11.

  Next, a second embodiment of the present invention will be described. HMD500 which is 2nd embodiment demonstrates the matter relevant to a different point hereafter compared with 1st embodiment.

  HMD500 which concerns on 2nd embodiment of this invention is demonstrated using FIG. FIG. 11 is a block diagram showing a functional configuration of the HMD 500.

  The control unit 610 will be described. The control unit 610 includes an operation analysis unit 611, a time measurement unit 612, a signal control unit 613, and a display bar generation unit 614.

  The control unit 610 displays a cross-shaped indicator 800 as shown in FIG. 13 on the screen of the display device included in the display unit 160.

The indicator 800 has a cross shape having angular velocity display areas 810A, 810B, 810C, and 810D extending in four directions (in the case where they are not distinguished from each other, they are simply expressed as angular velocity display areas 810), each having a Th ₁ scale 801A. And Th ₂ scale 802B. Furthermore, it has an angular velocity display area 810 and a process start notification area 820 that is an intersection of the angular velocity display area 810. An angular velocity display bar 815 is superimposed on the angular velocity display area 810. The symbol image related to the indicator 800 is stored in advance in the image storage area 623 of the storage unit 620.

  The angular velocity display bar 815 is generated by the display bar generator 614 based on the values of the angular velocities AV (Z) and AV (X) detected by the motion analyzer 611. In the present invention, the angular velocity is calculated as a display value, and the value is displayed on the screen by the expansion and contraction of the angular velocity display bar 815. The longer the angular velocity display bar 815, the faster the angular velocity (larger operation), and the shorter the angular velocity display bar 815, the slower the angular velocity.

  The angular velocity display area 810A has an angular velocity AV (Z +) (rightward movement), the angular velocity display area 810B has an angular velocity AV (Z-) (rightward movement), and the angular velocity display area 810C has an angular velocity AV (X -) (Upward motion), angular velocity display bar 815 of angular velocity AV (X +) (downward motion) is displayed in angular velocity display area 810D.

  The motion analysis unit 611 requests the time measurement unit 612 to start the operation of the setting timer, and requests the display bar generation unit 614 to generate the indicator 800. Then, the values of the angular velocities AV (Z) and AV (X) obtained from the first received voltage after the setting timer is finished are output to the display bar generation unit 614.

  Since the time measurement unit 612 performs the same processing as the time measurement unit 312 in the first embodiment, detailed description thereof is omitted.

  The signal control unit 613 generates an image signal to be displayed by superimposing the image of the indicator 800 output from the display bar generation unit 614 on the currently output image, and outputs the image signal to the display unit 160.

  When the display bar generation unit 614 receives a generation request for the indicator 800 from the motion analysis unit 611, the display bar generation unit 614 reads a symbol image related to the indicator 800 from the image storage area 623 of the storage unit 620. Further, based on the angular velocity output from the motion analysis unit 611, a display value is calculated, converted into an angular velocity display bar 815 having a corresponding length, and output to the signal control unit 613.

  The storage unit 620 includes a flag information storage area 621, a direction information storage area 622, and an image storage area 623.

  The flag information storage area 621 and the direction information storage area 622 store the same information as the flag information storage area 321 and the direction information storage area 322 in the first embodiment. Omitted.

  The image storage area 623 stores symbol image information related to the indicator 800 in advance.

  Next, processing executed by the control unit 610 of the HMD 500 according to the second embodiment will be described in detail with reference to FIG. FIG. 12 is a flowchart illustrating processing when the control unit 610 receives a voltage value sent from the head movement detection unit 200.

  Since the processing from step 501 to step 511 is the same as the processing from step 101 to step 111 executed by the control unit 310 of the HMD 100 according to the first embodiment described above, description thereof will be omitted.

  In step 521, the motion analysis unit 611 requests the display bar generation unit 614 to generate the indicator 800, and outputs the current angular velocity AV (Z) and AV (X). When the display bar generation unit 614 receives the generation request for the indicator 800 from the motion analysis unit 611, first, the display bar generation unit 614 reads image information related to the indicator 800 from the image storage area 623 of the storage unit 620. Further, the display bar generation unit 614 calculates display values from the angular velocities AV (Z) and AV (X) output from the motion analysis unit 611, and has a length corresponding to each angular velocity. An angular velocity display bar 815 is generated. Then, the motion analysis unit 611 outputs the indicator 800 generated in this way to the signal control unit 613.

  When the signal control unit 613 receives the image of the indicator 800 from the display bar generation unit 614, the signal control unit 613 generates an image signal to be displayed on the indicator 800 so as to be superimposed on the currently output image, and outputs the image signal to the display unit 160.

  In step 522, the motion analysis unit 611 requests the display bar generation unit 614 to generate the angular velocity display bar 815 and outputs the current angular velocity AV (Z) and AV (X). When the display bar generation unit 614 receives the generation request for the angular velocity display bar 815 from the motion analysis unit 611, the display bar generation unit 614 generates a display value from the angular velocity AV (Z) and AV (X) output from the motion analysis unit 611. The angular velocity display bar 815 having a length corresponding to each angular velocity is generated and output to the signal control unit 613.

  When the signal control unit 613 receives the image of the angular velocity display bar 815 from the display bar generation unit 614, the signal control unit 613 generates an image signal that reflects the angular velocity display bar 815 on the indicator 800 image that is currently being output, and outputs the image signal to the display unit 160. Output.

In step 506, the motion analysis unit 611, and the angular velocity AV (Z), the absolute value of the AV (X) detects whether a threshold value Th ₂ in the range of the threshold Th _1. If both or one of the absolute values of the two angular velocities are within the range of the threshold Th ₂ to the threshold Th ₁ (YES), the process proceeds to Step 523, where the absolute values of both angular velocities are changed from the threshold Th _2. If not within the range of the threshold Th ₁ (NO), the signal control unit 613 is requested to hide the image of the indicator 800, and the process proceeds to step 524.

  In step 523, the motion analysis unit 611 requests the signal control unit 613 to notify the user that the scroll process is started. When receiving the scroll process start notification request, the signal control unit 613 first increases the brightness of the process start notification area 820 to notify the user of the start of the scroll process. Next, the image signal of the indicator 800 to the display unit 160 is stopped, the process proceeds to step 507, and the scrolling process is started by the motion analysis unit 611.

  In step 524, when the signal control unit 613 accepts a non-display request for the indicator 800, the signal control unit 613 stops the image signal of the indicator 800 to the display unit 160, returns to step 501, and repeats the processing.

  In step 525, the motion analysis unit 611 requests the display bar generation unit 614 to generate the angular velocity display bar 815 and outputs the current angular velocity AV (Z) and AV (X) as in step 522. . When the display bar generation unit 614 receives the generation request for the angular velocity display bar 815 from the motion analysis unit 611, the display bar generation unit 614 generates a display value from the angular velocity AV (Z) and AV (X) output from the motion analysis unit 611. The angular velocity display bar 815 having a length corresponding to each angular velocity is generated and output to the signal control unit 613.

  When the signal control unit 613 receives the image of the angular velocity display bar 815 from the display bar generation unit 614, the signal control unit 613 generates an image signal that reflects the angular velocity display bar 815 on the indicator 800 image that is currently being output, and outputs the image signal to the display unit 160. Output.

  In step 526, the motion analysis unit 611 requests the signal control unit 613 to notify the user that the screen switching process is started. When the signal control unit 613 accepts the notification request for starting the screen switching process, first, the signal control unit 613 outputs a video signal for increasing the luminance of the processing start notification area 820 to the display unit 160 to start the screen switching process for the user. To be notified. Next, the image signal of the indicator 800 to the display unit 160 is stopped, the process proceeds to step 511, and the screen switching process is started by the operation analysis unit 611.

  With the configuration as described above, the HMD 500 of the present embodiment displays the indicator 800 at the same time as the operation of the setting timer, so that the user can determine the angular velocity of the head motion and the threshold value determined for executing each process. It is possible to more accurately perform the head movement for performing the intended process that is captured visually. In addition, the user can perform a more intuitive operation by notifying the start of each process by the light emission in the process start notification area 820.

  A setting may be made such that a sound signal for sounding the notification sound is output to the sound output unit 120 together with the light emission of the process start notification area 820, or the start of the process may be notified only by the notification sound. .

  In addition, the indicator 800 may be a transparent image so that the background image is not obstructed, and the user can set the display / non-display of the indicator 800 by the user.

  Furthermore, in step 521, step 522, and step 525, the signal control unit 613 may be configured to be able to change the display position of the indicator 800 as appropriate. For example, it is determined whether the display unit 160 is positioned in front of the user's left or right eye according to the direction in which the arm unit 150 is tilted, the setting, or the like. The indicator 800 is displayed in the lower corner, or the upper left corner or the lower left corner for the left eye.

  Moreover, application of the control apparatus 300 in embodiment described above is not restricted to HMD. The present invention can also be applied to other devices including a head detection unit.

  100, 500: HMD, 110: head wearing band, 120: audio output unit, 130A, 130B: housing, 140: support unit, 150: arm unit, 160: display unit, 170: operation unit, 171A, 171B, 171C, 171D, 171E: operation switch, 172: remote control receiving unit, 180: power supply unit, 200: head movement detection unit, 300: control device, 310, 610: control unit, 311 and 611: motion analysis unit, 312 612: Time measurement unit, 313/613: Signal control unit, 614: Display bar generation unit, 320/620: Storage unit, 321/621: Flag information storage area, 322/622: Direction information storage area, 620: Image storage Area, 330: input / output interface unit, 800: indicator.

Claims (13)

A motion detector that detects the motion of the head of the user wearing the device;
The movement detection unit initiates a Jo Tokoro processing when the velocity or the angular velocity in a particular direction is detected a first operating faster than the speed or angular velocity determined by a predetermined threshold, terminate the process after a predetermined time and a control unit for,
Wherein the control unit, head-mounted display device comprising said that second motion by the motion detection unit to terminate the pre-SL process when it is detected within the predetermined time. A motion detector that detects the motion of the head of the user wearing the device;
The movement detection unit initiates a Jo Tokoro processing when the velocity or the angular velocity in a particular direction is detected a first operating faster than the speed or angular velocity determined by a predetermined threshold, terminate the process after a predetermined time and a control unit for,
Wherein the control unit, the control device, characterized in that to terminate the pre-Symbol processing the second operation is detected by the motion detecting unit within the predetermined time. A motion detector that detects the motion of the user wearing the device;
The movement detection unit initiates a Jo Tokoro processing when the velocity or the angular velocity in a particular direction is detected a first operating faster than the speed or angular velocity determined by a predetermined threshold, terminate the process after a predetermined time and a control unit for,
The control unit specifies a user's movement direction detected by the movement detection unit , and includes at least a velocity or an angular velocity in a direction opposite to the specific direction by the movement detection unit within the predetermined time. control apparatus characterized by operation to terminate the pre-Symbol processing when it is detected. The control device according to claim 3 ,
Before Stories second operation from at least the to the specific direction or angular velocity in the reverse direction, the control device characterized by comprising the operation of the detected speed or angular velocity of a specific direction again. The control device according to any one of claims 2 to 4 ,
Further comprising a display unit,
Wherein the control unit, the control device, characterized in that to display an indicator for notifying the start of the process of speed or angular velocity and the correspondence between the operation of the prior SL user to the user on the display unit.   The control device according to any one of claims 2 to 5,
  The predetermined threshold is a first threshold,
  When the motion detection unit detects the first motion in which the speed or angular velocity of the user's motion in a specific direction is faster than the speed or angular velocity determined by the first threshold, the first process is performed. And a third motion in which the speed or angular velocity of the user's motion in the specific direction is faster than the speed or angular velocity defined by the second threshold set slower than the velocity or angular velocity defined by the first threshold Is detected, a control unit that performs the second process;
  A control device comprising: A head mounted display device comprising the control device according to any one of claims 3 to 6 ,
The head mounted display device, wherein the movement of the user is a movement of the head of the user. Computer
Detecting means for detecting the movement of the head of the user wearing the device;
A program that functions as a control means,
To the control means, said detecting means so that starting the first operation of Jo Tokoro when detecting processing in a specific direction with a faster rate or angular than or angular velocity determined by a predetermined threshold value, a predetermined time has elapsed A process of ending the predetermined process later,
A program characterized by executing the a processing to terminate the previous SL predetermined processing when the second operation is detected by the detecting unit within the predetermined time.   Computer
  Detection means for detecting the movement of the user wearing the device,
  A program that functions as a control means,
  The control means starts a predetermined process when the detection means detects a first motion in a specific direction having a speed or angular velocity faster than a speed or angular speed determined by a predetermined threshold, and after a predetermined time has elapsed. A process for terminating the predetermined process;
  Processing for further specifying the direction of movement of the user detected by the detection means;
  A process for ending the process when a second motion including at least a speed or an angular speed in a direction opposite to the specific direction is detected within the predetermined time.
  A program characterized by that.   The program according to claim 9, wherein
  The second movement is at least from the speed or angular velocity in the direction opposite to the specific direction.
Includes motions that detect velocity or angular velocity in a specific direction
  A program characterized by that.   A control method for performing processing corresponding to the detected speed or angular velocity of the user's head,
  Detecting a first movement in a specific direction having a speed or angular velocity faster than a speed or angular velocity determined by a predetermined threshold;
  A step of starting a predetermined process when the first operation is detected;
  Ending the predetermined process after a predetermined time has elapsed;
  And a step of ending the process when a second operation is detected within the predetermined time.
  A control method characterized by that.   A control method for performing processing corresponding to a detected motion speed or angular velocity,
  Detecting a first movement in a specific direction having a speed or angular velocity faster than a speed or angular velocity determined by a predetermined threshold;
  A step of starting a predetermined process when the first operation is detected;
  Ending the predetermined process after a predetermined time has elapsed;
  Identifying the direction of user movement;
  And a step of ending the process when a second motion including at least a velocity or angular velocity in a direction opposite to the specific direction is detected within the predetermined time.
  A control method characterized by that.   A control method according to claim 12, comprising:
  The second movement is at least from the speed or angular velocity in the direction opposite to the specific direction.
Includes motions that detect velocity or angular velocity in a specific direction
  A control device characterized by that.

Images