JP2016195310A - Wearable terminal, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a wearable terminal capable of reducing the burden on a user, while preventing incorrect operation, and to provide a control method and program.SOLUTION: A wearable terminal 10 includes a first detector 11, a second detector 12, a recording section 15 and a control section 16. The wearable terminal 10 is attached directly or indirectly to the head of a user. The first detector 11 and second detector 12 detect the information about the movement of the head of a user. The recording section 15 records the data (e.g., the data indicating the information about the work of the user). The recording section 15 has a recording mode for recording the data, and a stop mode not recording the data. The control section 16 switches the recording mode and stop mode of the recording section 15, based on the information about the movement of the head of a user detected by the first detector 11 and second detector 12.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a wearable terminal that a user wears on his / her head, a control method thereof, and a program for realizing them.

  In recent years, wearable terminals have attracted attention. Various types of wearable terminals such as a glasses type and a wristwatch type have been proposed. Among these, in the glasses-type wearable terminal, the user can check the information presented on the screen of the display device while visually checking in the real world, and thus the demand for business use is increasing. .

  In a glasses-type wearable terminal, a GUI such as an icon may be displayed on the screen of the display device. In such a terminal, a pointing system is conventionally used as an input interface.

  For example, Patent Document 1 discloses a pointing system used in a head mounted display. The system of Patent Literature 1 includes a display, a line-of-sight detection unit, and an acceleration sensor.

  In the system of Patent Document 1, when the operator's line of sight detected by the line-of-sight detection unit is facing the display, the pointer displayed on the display can be moved and the operation by the pointer can be performed. When the operator moves the head in this state, the pointer is moved or an operation using the pointer is performed according to the acceleration of the head detected by the acceleration sensor. On the other hand, when the operator's line of sight detected by the line-of-sight detection unit is not facing the display, even if the operator moves his head, the pointer displayed on the display is moved and the operation using the pointer is performed. Absent. For this reason, in the system of Patent Document 1, when the operator does not want to move the pointer, the line of sight may be removed from the display. Thereby, an erroneous operation contrary to the operator's intention can be prevented.

JP 2006-243784 A

  By the way, the present inventors are considering using a wearable terminal equipped with a camera or the like for recording work such as farm work. For example, since the worker often uses both hands during farm work, it is necessary to operate the wearable terminal without using both hands. For this reason, it is conceivable to adopt the system of Patent Document 1 also in such a wearable terminal. When the system of the above-mentioned patent document 1 is adopted, the wearable terminal can be operated without using both hands by the movement of the head even during farm work. In addition, by adopting the system of Patent Document 1, it is considered that erroneous operation of the wearable terminal against the operator's (user's) intention can be prevented.

  However, since the operation of the worker is greatly limited during the farm work, using the pointing system as described above places a heavy burden on the worker. For example, since the operator has to move the pointer while working with both hands in order to turn on the function of the camera, there is a possibility that the attention is distracted. In this case, there is a risk of not only erroneous operation of the wearable terminal but also agricultural work, and work efficiency is deteriorated.

  An object of the present invention is to provide a wearable terminal, a control method, and a program that can solve the above problems, reduce the burden on the user, and prevent erroneous operations.

In order to achieve the above object, a wearable terminal according to an aspect of the present invention is a wearable terminal attached directly or indirectly to a user's head,
A first detector for detecting first information relating to the movement of the head;
A second detector for detecting second information relating to the movement of the head;
A recording unit having a recording mode for recording data and a stop mode for not recording the data;
A control unit that switches the recording mode and the stop mode of the recording unit based on the first information detected by the first detection unit and the second information detected by the second detection unit. And

In order to achieve the above object, a control method according to one aspect of the present invention is a control method for a wearable terminal that includes a recording unit that records data and is directly or indirectly attached to a user's head,
(A) detecting first information related to the movement of the head;
(B) detecting second information relating to the movement of the head;
(C) switching the mode of the recording unit based on the first information and the second information,
In the step (c), the recording mode for recording the data and the stop mode for not recording the data are switched.

In order to achieve the above object, a program according to one aspect of the present invention includes a recording unit for recording data, and controls a wearable terminal directly or indirectly attached to a user's head by a computer. A program for
In the computer,
(A) obtaining first information relating to the movement of the head;
(B) obtaining second information relating to the movement of the head;
(C) executing a step of switching a mode of the recording unit based on the first information and the second information;
In the step (c), the recording mode for recording the data and the stop mode for not recording the data are switched.

  As described above, according to the present invention, it is possible to reduce the burden on the user and prevent erroneous operation of the wearable terminal.

FIG. 1 is a block diagram showing a schematic configuration of a wearable terminal according to an embodiment of the present invention. FIG. 2 is a perspective view showing the appearance of the wearable terminal according to the present embodiment. FIG. 3 is a front view showing the wearable terminal mounted on the user's head. FIG. 4 is a block diagram specifically showing the configuration of the wearable terminal in the present embodiment. FIG. 5 is a flowchart showing the operation of the wearable terminal in the embodiment of the present invention. FIG. 6 is a block diagram illustrating an example of a computer that implements the wearable terminal according to the embodiment of the present invention.

(Embodiment)
Hereinafter, a wearable terminal, a control method, and a program according to an embodiment of the present invention will be described with reference to FIGS.

[Device configuration]
Initially, the structure of a wearable terminal is demonstrated using FIG. FIG. 1 is a block diagram showing a schematic configuration of a wearable terminal according to an embodiment of the present invention. The wearable terminal in the present embodiment is attached directly or indirectly to the user's head.

  Referring to FIG. 1, wearable terminal 10 in the present embodiment includes a first detection unit 11, a second detection unit 12, a recording unit 15, and a control unit 16.

  The 1st detection part 11 and the 2nd detection part 12 each detect the information regarding a motion of a user's head. Examples of the user's head movement include various movements such as eye movement, eyelid movement, head movement itself, mouth movement, cheek movement, or tongue movement. In addition, the 1st detection part 11 and the 2nd detection part 12 detect the information regarding a mutually different motion.

  For example, the recording unit 15 records data indicating information related to the user's work. Examples of the information related to the user's work include a video (moving image and photograph) of the user's work, a work time, and the like. In the present embodiment, the recording unit 15 has a recording mode for recording data and a stop mode for not recording data. The control unit 16 switches the recording mode and the stop mode of the recording unit 15 based on information on the movement of the user's head detected by the first detection unit 11 and the second detection unit 12.

  As described above, in the present embodiment, the user can start recording data by the recording unit 15 by two movements related to the head. In this case, unlike a wearable terminal using a pointing system, the user does not need to move the pointer in order to set the recording unit 15 to the recording mode. Thereby, the user can start recording by the recording unit 15 easily. Therefore, it is possible to prevent the user's attention from being distracted when recording by the recording unit 15 is started. As a result, it is possible to prevent erroneous operation of the wearable terminal 10 and to prevent a reduction in work efficiency.

  Next, the configuration of the wearable terminal in the present embodiment will be specifically described. FIG. 2 is a perspective view showing the appearance of the wearable terminal according to the present embodiment. FIG. 3 is a front view showing the wearable terminal mounted on the user's head.

  As shown in FIGS. 2 and 3, in the present embodiment, wearable terminal 10 is attached to eyewear 100 worn by the user, and is indirectly attached to user's head 200 via eyewear 100. The In the present specification, the “head” includes a face.

  FIG. 4 is a block diagram specifically showing the configuration of the wearable terminal in the present embodiment. As shown in FIG. 4, the wearable terminal 10 further includes a display unit 17, an imaging unit 18, a timer 19, a first unit, in addition to the first detection unit 11, the second detection unit 12, the recording unit 15, and the control unit 16 described above. The 1 determination part 13 and the 2nd determination part 14 are provided.

  2 to 4, display unit 17 is a transmissive display panel in the present embodiment. The display part 17 is arrange | positioned ahead of a user's eyes so that a user can visually recognize. For this reason, the user can visually recognize the situation in the real world and the information displayed on the screen of the display unit 17 at the same time. For example, information for informing the user that the recording unit 15 is in the recording mode or the stop mode is displayed on the screen of the display unit 17.

  The imaging unit 18 is a camera, and includes an optical system such as a lens and a solid-state imaging element (not shown) in the present embodiment. For this reason, the imaging unit 18 can output image data that identifies the captured image. Referring to FIG. 4, timer 19 generates time information.

  With reference to FIGS. 2-4, the 1st detection part 11 is arrange | positioned in front of a user's eyes in this Embodiment, and detects a user's eyes | visual_axis. Although a detailed description is omitted, the first detection unit 11 is configured using, for example, a known gaze detection technique. Referring to FIG. 4, second detection unit 12 includes a known acceleration sensor, for example, and detects the acceleration of wearable terminal 10 based on the operation of head 200.

  The first determination unit 13 determines whether or not the user's line of sight detected by the first detection unit 11 is located within a predetermined range. In the present embodiment, when the display unit 17 is positioned on the user's line of sight detected by the first detection unit 11, the first determination unit 13 is positioned within a predetermined range. Is determined. Note that the information for determining the predetermined range is stored in advance in a storage unit (not shown), for example. The second determination unit 14 determines whether or not the acceleration detected by the second detection unit 12 is larger than a preset first threshold value or second threshold value. The first threshold value and the second threshold value are stored in advance in a storage unit (not shown), for example.

  The recording unit 15 has a recording mode and a stop mode, and records video captured by the imaging unit 18 and time information generated by the timer 19 in the recording mode. The control unit 16 controls the recording unit 15 based on the determination results of the first determination unit 13 and the second determination unit 14 to switch the mode of the recording unit 15. Details will be described later.

[Terminal operation]
Next, the operation of the wearable terminal in the embodiment of the present invention will be described with reference to FIG. In the following description, FIG. 4 will be referred to as appropriate.

  In the present embodiment, the wearable terminal control method is implemented by operating the wearable terminal. Therefore, the description of the control method in the present embodiment is replaced with the following description of the operation of the wearable terminal.

  FIG. 5 is a flowchart showing the operation of wearable terminal 10 in the embodiment of the present invention.

  Referring to FIG. 5, first, in wearable terminal 10, first determination unit 13 acquires information related to the user's line of sight detected by first detection unit 11 (step S <b> 1). Next, the 1st determination part 13 determines whether the eyes | visual_axis detected in step S1 is located in the predetermined range (step S2). When the line of sight is located within a predetermined range, that is, when the user is looking at the display unit 17, the second determination unit 14 acquires the acceleration detected by the second detection unit 12 (step S3). .

  Next, the control part 16 determines whether the mode of the recording part 15 is a stop mode (step S4). In the stop mode, the second determination unit 14 determines whether or not the acceleration acquired in step S3 is larger than a first threshold value set in advance (step S5). When the acceleration is larger than the first threshold, that is, when the user quickly moves the head 200 while looking at the display unit 17, the control unit 16 switches the mode of the recording unit 15 to the recording mode. Thereby, the video imaged by the imaging unit 18 and the time information generated by the timer 19 are recorded in the recording unit 15. That is, information related to the user's work is recorded in the recording unit 15.

  If the line of sight is not located within the predetermined range in step S2, that is, if the user is not looking at the display unit 17, the process returns to step S1.

  If the stop mode is not set in step S4, the second determination unit 14 determines whether or not the acceleration acquired in step S3 is larger than a second threshold set in advance (step S7). When the acceleration is larger than the second threshold, that is, when the user quickly moves the head 200 while looking at the display unit 17, the control unit 16 switches the mode of the recording unit 15 to the stop mode. As a result, recording of the video imaged by the imaging unit 18 and the time information generated by the timer 19 to the recording unit 15 is stopped. Note that the second threshold value and the first threshold value may be the same value or different values.

  If the acceleration is not more than the first threshold value in step S5, the process returns to step S1. Moreover, also when acceleration is below a 2nd threshold value in step S7, it returns to step S1.

  As described above, in the present embodiment, the mode of the recording unit 15 is not switched when the user does not look at the display unit 17. In addition, by appropriately setting the first threshold value and the second threshold value, the mode of the recording unit 15 can be prevented from being switched by a slight movement of the head 200 even when the user is looking at the display unit 17. can do. As a result, for example, even when the user is doing farm work or the like, erroneous operation of the wearable terminal 10 can be sufficiently prevented. Further, the user can start and stop data recording by the recording unit 15 by simple movements of the eyes and head. Thereby, the fall of work efficiency can also be prevented.

[Modification]
In the above-described embodiment, the second detection unit 12 may detect vertical acceleration and horizontal acceleration. Then, the acceleration in the vertical direction or the acceleration in the horizontal direction may be used as the acceleration in step S5 shown in FIG. 5, and the acceleration in the vertical direction or the acceleration in the horizontal direction may be used as the acceleration in step S7.

  In the above-described embodiment, when it is determined in step S2 shown in FIG. 5 that the line of sight is located within a predetermined range, information indicating that may be displayed on the display unit 17. In this case, the user can recognize that the mode switching operation of the recording unit 15 is possible by viewing the display on the display unit 17.

[program]
The program in the embodiment of the present invention may be a program that causes a computer to execute steps S1 to S8 shown in FIG. By installing and executing this program on a computer, the wearable terminal and the control method according to the present embodiment can be realized. In this case, a CPU (Central Processing Unit) of a computer serving as the wearable terminal 10 functions as the first determination unit 13, the second determination unit 14, and the control unit 16 to perform processing.

  Further, in the present embodiment, the recording unit 15 stores the data files constituting these in a storage device such as a hard disk provided in the computer, or the recording medium storing the data file as a computer. This is realized by mounting on a connected reader.

[Physical configuration]
Here, a computer that realizes a wearable terminal by executing the program according to the present embodiment will be described with reference to the drawings. FIG. 6 is a block diagram illustrating an example of a computer that implements the wearable terminal according to the embodiment of the present invention.

  As shown in FIG. 6, the computer 110 includes a CPU 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These units are connected to each other via a bus 121 so that data communication is possible.

  The CPU 111 performs various calculations by developing the program (code) in the present embodiment stored in the storage device 113 in the main memory 112 and executing them in a predetermined order. The main memory 112 is typically a volatile storage device such as a DRAM (Dynamic Random Access Memory). Further, the program in the present embodiment is provided in a state of being stored in a computer-readable recording medium 120. Note that the program in the present embodiment may be distributed on the Internet connected via the communication interface 117.

  Specific examples of the storage device 113 include a hard disk drive and a semiconductor storage device such as a flash memory. The input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard and a mouse. The display controller 115 is connected to the display device 119 and controls display on the display device 119.

  The data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, and reads a program from the recording medium 120 and writes a processing result in the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.

  Specific examples of the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash (registered trademark)) and SD (Secure Digital), magnetic storage media such as a flexible disk, or CD- An optical storage medium such as ROM (Compact Disk Read Only Memory) can be used.

  As described above, according to the present invention, it is possible to reduce the burden on the user and to prevent erroneous operation of the wearable terminal. The present invention is useful not only for agricultural work recording but also for work recording in factories or the like as long as data recording during work is necessary.

DESCRIPTION OF SYMBOLS 10 Wearable terminal 11 1st detection part 12 2nd detection part 13 1st determination part 14 2nd determination part 15 Recording part 16 Control part 17 Display part 18 Imaging part 19 Timer 100 Eyewear 110 Computer 111 CPU
112 Main memory 113 Storage device 114 Input interface 115 Display controller 116 Data reader / writer 117 Communication interface 118 Input device 119 Display device 120 Recording medium 121 Bus 200 Head

Claims (21)

A wearable device that is worn directly or indirectly on the user's head,
A first detector for detecting first information relating to the movement of the head;
A second detector for detecting second information relating to the movement of the head;
A recording unit having a recording mode for recording data and a stop mode for not recording the data;
A wearable terminal comprising: a control unit that switches the recording mode and the stop mode of the recording unit based on the first information detected by the first detection unit and the second information detected by the second detection unit. The first detection unit detects the line of sight of the user as the first information,
The wearable terminal according to claim 1, wherein the second detection unit detects an acceleration as the second information. A first determination unit that determines whether or not the line of sight of the user detected by the first detection unit is located within a predetermined range;
A second determination unit that determines whether the acceleration detected by the second detection unit is greater than a first threshold;
The controller is
In a state where the first determination unit determines that the mode of the recording unit is the stop mode and the line of sight is within the range, the second value is determined when the acceleration is greater than the first threshold. The wearable terminal according to claim 2, wherein when the determination unit determines, the mode of the recording unit is switched to the recording mode. The second determination unit further determines whether the acceleration detected by the second detection unit is greater than a second threshold;
In the state where the first determination unit determines that the mode of the recording unit is the recording mode and the line of sight is within the range, the control unit has the acceleration greater than a second threshold value. The wearable terminal according to claim 3, wherein the mode of the recording unit is switched to the stop mode when the second determination unit determines. A display unit that is arranged at a position where the user can visually recognize and displays information;
The first determination unit determines that the line of sight is positioned within the range when the display unit is positioned on the line of sight of the user detected by the first detection unit. Or the wearable terminal of 4. The camera further includes an imaging unit that captures images.
The wearable terminal according to any one of claims 1 to 5, wherein the recording unit records video captured by the imaging unit in the recording mode.   The wearable terminal according to claim 1, wherein the data is data indicating information related to the user's work. A control method for a wearable terminal that has a recording unit for recording data and is directly or indirectly mounted on a user's head,
(A) detecting first information related to the movement of the head;
(B) detecting second information relating to the movement of the head;
(C) switching the mode of the recording unit based on the first information and the second information,
In the step (c), a control method of switching between a recording mode for recording the data and a stop mode for not recording the data. In the step (a), the user's line of sight is detected as the first information,
The control method according to claim 8, wherein in the step (b), acceleration is detected as the second information. (D) determining whether or not the user's line of sight detected in the step (a) is within a predetermined range;
(E) further comprising a step of determining whether or not the acceleration detected in the step (b) is greater than a first threshold;
In the step (c),
In a state where the mode of the recording unit is the stop mode and it is determined in the step (d) that the line of sight is located within the range, the acceleration is greater than the first threshold value. The control method according to claim 9, wherein the mode of the recording unit is switched to the recording mode when it is determined in step (e). (F) further comprising a step of determining whether or not the acceleration detected in the step (b) is greater than a second threshold;
In the step (c),
In a state where the mode of the recording unit is the recording mode and it is determined in the step (d) that the line of sight is located within the range, the acceleration is greater than the second threshold value. The control method according to claim 10, wherein the mode of the recording unit is switched to the stop mode when it is determined in step (f). The wearable terminal further includes a display unit that is arranged at a position where the user can visually recognize and displays information;
The control method according to claim 10 or 11, wherein, in the step (d), when the display unit is located on the line of sight of the user, it is determined that the line of sight is located within the range. . The wearable terminal further includes an imaging unit that captures an image,
The control method according to claim 8, wherein the recording unit records an image captured by the imaging unit in the recording mode.   The control method according to claim 8, wherein the data is data indicating information related to the user's work. A program for executing, by a computer, control of a wearable terminal that has a recording unit for recording data and is directly or indirectly worn on the user's head,
In the computer,
(A) obtaining first information relating to the movement of the head;
(B) obtaining second information relating to the movement of the head;
(C) executing a step of switching a mode of the recording unit based on the first information and the second information;
In the step (c), a program for switching between a recording mode for recording the data and a stop mode for not recording the data. In the step (a), the line of sight of the user is acquired as the first information,
The program according to claim 15, wherein in the step (b), an acceleration is acquired as the second information. (D) determining whether or not the user's line of sight acquired in step (a) is located within a predetermined range;
(E) causing the computer to further execute a step of determining whether or not the acceleration acquired in the step (b) is greater than a first threshold value,
In the step (c),
In a state where the mode of the recording unit is the stop mode and it is determined in the step (d) that the line of sight is located within the range, the acceleration is greater than the first threshold value. The program according to claim 16, wherein the mode of the recording unit is switched to the recording mode when determined in step (e). (F) causing the computer to further execute a step of determining whether or not the acceleration acquired in the step (b) is greater than a second threshold;
In the step (c),
In a state where the mode of the recording unit is the recording mode and it is determined in the step (d) that the line of sight is located within the range, the acceleration is greater than the second threshold value. The program according to claim 17, wherein the mode of the recording unit is switched to the stop mode when it is determined in step (f). The wearable terminal further includes a display unit that is arranged at a position where the user can visually recognize and displays information;
The program according to claim 17 or 18, wherein, in the step (d), when the display unit is positioned on the line of sight of the user, it is determined that the line of sight is positioned within the range. The wearable terminal further includes an imaging unit that captures an image,
The program according to any one of claims 15 to 19, wherein the recording unit records an image captured by the imaging unit in the recording mode.   The program according to any one of claims 15 to 20, wherein the data is data indicating information related to the work of the user.

Images