JP2015049695A - Glasses type display device, display control device, display system and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve user-friendliness of a glass display 10 and prevent improper operation.SOLUTION: A glass-type display device includes: a glass display 10 that includes a masseter potential sensor 12 detecting masseter potential in the head of a user, and a communication unit 15 transmitting the detection result of the masseter potential to a display data generation device 30; and the display data generation device 30 that includes a communication unit 31 receiving the detection result of the masseter potential from the glass display 10, and a display control unit 33 controlling display of the glass display 10 on the basis of the received detection result of the masseter potential.

Description

  The present invention relates to a glasses-type display device, a display control device, a display system, and a computer program.

  In recent years, eyeglass-type display devices called glass displays have attracted attention. The glass display can display information images such as various characters and figures in the visual space of the user wearing the glass display like glasses. As a display control technique for controlling the display of the glass display, for example, Non-Patent Document 1 uses a voice recognition technique to realize a hands-free operation that does not require the user to perform a display operation by hand. In Patent Document 1, the movement of the user's head itself (vertical movement or horizontal movement of the head) is detected, and display control is performed based on the detection result.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for performing an operation of an external information processing apparatus in a hands-free manner. In the hands-free operation technique of Patent Document 2, an acceleration sensor and a pressure sensor that comes into contact with the user's head are provided in an operation device that is mounted on the user's head with a headband. Then, an operation signal is output to the information processing apparatus according to the tilt of the head detected by the acceleration sensor and the change in the movement of the head muscle detected by the pressure sensor.

Japanese Patent Laid-Open No. 2004-233909 JP 2009-116609 A Japanese Patent No. 4730621

“Head-mounted display-type hands-free picking”, Internet <URL: http://www.murata-system.co.jp/products/yubi_kitasu/index.html>

  However, in the display control technique of Non-Patent Document 1 described above, the user needs to emit a voice, so that it is difficult to use in an environment where calmness is required (for example, in a library, classroom, train, bus, etc.).

  In the display control technology of Patent Document 1, the user performs an operation by moving the head. However, if the user moves the head to visually recognize the surroundings or moves the head unconsciously, an erroneous operation is performed. It becomes. For this reason, it is a problem to accurately determine the timing of using the detection result of the user's head movement for display control.

  In the hands-free operation technique of Patent Document 2, the detection result of the user's head tilt and the detection result of the head muscle movement are used as independent control signals, and therefore the detection result of the head tilt is provided. Is always used for control regardless of the user's intention of operation. This causes an erroneous operation. Therefore, it is a problem to accurately determine the user's intention to operate and to use the detection result of the head tilt for control based on the user's intention to operate.

  The present invention has been made in consideration of such circumstances, and includes a glasses-type display device, a display control device, and a user-friendly glass display (glasses-type display device) that can improve usability and prevent erroneous operations. It is an object to provide a display system and a computer program.

(1) A glasses-type display device according to the present invention includes a motion detection unit that detects a motion of a muscle of a user's head, and the display is controlled based on a detection result of the motion detection unit. To do.

(2) In the glasses-type display device according to the present invention, in the glasses-type display device according to (1), the motion detection unit detects the movement of the masseter muscle.

(3) The glasses-type display device according to the present invention is characterized in that, in the glasses-type display device according to (2), a masseter potential sensor is provided on the temple of the glasses-type display device.

(4) In the glasses-type display device according to the present invention, the glasses-type display device according to any one of (1) to (3) further includes a tilt detection unit that detects the tilt of the head. The display is controlled based on the detection result of the part and the detection result of the motion detection part.

(5) In the glasses-type display device according to the present invention, in the glasses-type display device according to (4), the detection result of the tilt detector is determined based on the detection result of the motion detector. It is characterized by that.

(6) In the display control device according to the present invention, the detection result of the movement of the user's head muscle detected by the glasses-type display device including the motion detection unit that detects the movement of the muscle of the user's head. The display of the glasses-type display device is controlled based on the above.

(7) In the display control device according to the present invention, in the display control device according to (6), the glasses-type display device further includes a tilt detection unit that detects the tilt of the head, and the detection of the tilt detection unit. The display of the glasses-type display device is controlled based on the result and the detection result of the motion detection unit.

(8) In the display control device according to the present invention, in the display control device according to (7), it is determined whether or not the detection result of the tilt detection unit can be used based on the detection result of the motion detection unit. And

(9) In the display control device according to the present invention, in the display control device according to (8), it is determined that the detection result of the tilt detection unit is used in a period in which the detection value of the motion detection unit is equal to or greater than a predetermined threshold. It is characterized by doing.

(10) In the display control device according to the present invention, in the display control device according to any one of (7) to (9), when the detection value of the motion detection unit is equal to or greater than a threshold value within a predetermined time width. It is determined that a specific operation is designated.

(11) A display system according to the present invention includes the glasses-type display device according to (1) and the display control device according to (6).

(12) A computer program according to the present invention is a computer program for detecting the movement of a user's head muscle detected by a glasses-type display device provided with a motion detection unit that detects the movement of the user's head muscle. It is a computer program for executing a step of controlling display of the glasses-type display device based on a detection result.

  According to the present invention, it is possible to improve the usability of a user of a glass display (glasses-type display device) and to prevent erroneous operation.

It is a block diagram which shows the structure of the display system 1 which concerns on one Embodiment of this invention. It is an external view of the glass display 10 shown in FIG. It is explanatory drawing which shows the example of the information image space of the glass display. It is a flowchart of the display control process which concerns on one Embodiment of this invention. It is a graph which shows the example of the masseter potential detection signal A (instantaneous value) and masseter potential detection rectification signal B (rectification value) concerning one embodiment of the present invention. It is explanatory drawing of the example of the hands-free operation which concerns on Example 1 of this invention. It is a table figure which shows the example of the operation content table 40 which concerns on Example 1 of this invention. It is a graph which shows the example of the masseter potential detection signal A (instantaneous value) and the masseter potential detection rectification signal B (rectification value) concerning Example 1 of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a display system 1 according to an embodiment of the present invention. In FIG. 1, a glass display (glasses-type display device) 10 includes a display unit 11, a masseter potential sensor 12, an acceleration sensor 13, a gyro sensor 14, and a communication unit 15. The display data generation device 30 includes a communication unit 31, a rectification unit 32, a display control unit 33, an operation content table storage unit 34, and a display data generation unit 35.

  The communication unit 15 of the glass display 10 and the communication unit 31 of the display data generation device 30 mutually transmit and receive data by wireless communication or wired communication.

  FIG. 2 is an external view of the glass display 10 shown in FIG. In FIG. 2, the glass display 10 is mounted on the user's head 100 like glasses. In the glass display 10, a display unit 11 is provided in the lens portion of the glasses. The display unit 11 displays information images such as various characters and graphics in the visual space of the user.

  The temple 16 is provided with a masseter potential sensor 12, an acceleration sensor 13, and a gyro sensor 14. The communication unit 15 is provided in the other temple 16 (not shown in FIG. 2). The masseter potential sensor 12, the acceleration sensor 13, and the gyro sensor 14 are respectively connected to the communication unit 15 by signal lines (not shown).

  The masseter muscle potential sensor 12 detects an electric potential according to the movement of the user's masseter muscle. By providing the masseter potential sensor 12 on the temple 16 so as to come into contact with the skin of the head 100, a potential corresponding to the movement of the masseter muscle can be detected. The acceleration sensor 13 and the gyro sensor 14 function as a tilt detection unit that detects the tilt of the head 100. The provision of the masseter potential sensor 12, the acceleration sensor 13, the gyro sensor 14, and the communication unit 15 in the temple 16 provides an effect that the user feels good and is not bad in appearance.

Returning to FIG.
The masseter potential sensor 12 outputs the detected masseter potential detection signal to the communication unit 15. The acceleration sensor 13 outputs the detected acceleration detection signal to the communication unit 15. The gyro sensor 14 outputs the detected angular velocity detection signal to the communication unit 15. The communication unit 15 transmits the input masseter potential detection signal, acceleration detection signal, and angular velocity detection signal to the display data generation device 30.

  The communication unit 15 receives display data from the display data generation device 30. The communication unit 15 outputs the received display data to the display unit 11. The display unit 11 displays the input display data.

  In the display data generation device 30, the communication unit 31 receives a masseter muscle potential detection signal, an acceleration detection signal, and an angular velocity detection signal from the glass display 10. The communication unit 31 outputs the received masseter potential detection signal to the rectification unit 32. The communication unit 31 outputs the received acceleration detection signal and angular velocity detection signal to the display control unit 33. The rectification unit 32 rectifies the input masseter potential detection signal and outputs the rectified signal (massage potential detection rectification signal) to the display control unit 33.

  The display control unit 33 outputs a display control signal to the display data generation unit 35 based on the input acceleration detection signal, angular velocity detection signal, and masseter muscle potential detection rectification signal. When the display control unit 33 outputs the display control signal, the display control unit 33 refers to the information stored in the operation content table storage unit 34 based on the acceleration detection signal, the angular velocity detection signal, and the masseter muscle potential detection rectification signal. The operation content table storage unit 34 stores information that associates the acceleration detection signal, the angular velocity detection signal, the masseter muscle potential detection rectification signal, and the display operation content. The display control unit 33 outputs a display control signal to the display data generation unit 35 according to the display operation content associated with the acceleration detection signal, the angular velocity detection signal, and the masseter potential detection rectification signal.

  The display data generation unit 35 generates display data based on the input display control signal. The display data generation unit 35 outputs the generated display data to the communication unit 31. The communication unit 31 transmits the input display data to the glass display 10.

  As the display data generation device 30, for example, a notebook personal computer (PC), a tablet PC, a mobile terminal such as a smartphone, or the like can be used.

  FIG. 3 is an explanatory diagram showing an example of the information image space of the glass display 10. In FIG. 3, an information image (“textbook unit B” in the example of FIG. 3) visible to the user is displayed in the display area 18 surrounded by the rim 17 of the glasses. The information image space is invisible to the user, but there are information images in the left, right, up, down, and diagonal directions outside the display area 18. Further, the information image may continuously spread as a space on the outer side. Furthermore, when 3D display is possible on the glass display 10, the information image space is three-dimensionally expanded in the depth direction. In the present embodiment, the user performs an operation for using the information image existing in the information image space of the glass display 10 in combination with the movement of the head 100 and the biting operation.

  Next, the operation of the display system 1 shown in FIG. 1 will be described with reference to FIG. FIG. 4 is a flowchart of the display control process according to the present embodiment.

(Step S1) The user turns on the power of the glass display 10 and the display data generation device 30. After this, a hands-free operation is possible.

(Step S <b> 2) The glass display 10 transmits a masseter potential detection signal of the masseter potential sensor 12 to the display data generation device 30. In the display data generation device 30, the received masseter potential detection signal is input to the rectification unit 32.

(Step S3) The rectification unit 32 rectifies the input masseter potential detection signal and outputs the masseter potential detection rectification signal to the display control unit 33.

  FIG. 5 is a graph showing examples of masseter potential detection signal A (instantaneous value) and masseter potential detection rectification signal B (rectification value) according to the present embodiment. As shown in the example of masseter potential detection signal A, the masseter muscle potential represents the result of adding action potentials (composite action potentials) when individual action potentials generated from muscle fibers reach the electrodes. The instantaneous voltage of the masseter muscle potential is a value that goes up and down 0 V (reference potential) like the masseter potential detection signal A. By rectifying this masseter potential (instantaneous value) by signal processing, the user bites it. During the period, the smoothed masseter potential (rectified value) is obtained like the masseter potential detection rectification signal B.

  Since the masseter potential generated by the user biting lightly is due to voluntary muscles, the user's intention to operate can be reliably expressed. Thereby, whether the user operates or not can be clearly distinguished by the masseter potential. Therefore, in the present embodiment, by determining the masseter potential (rectified value) using the threshold value, it is determined whether the user operates or does not operate.

  Specifically, the detection and rectification of the masseter potential sensor 12 are repeated at a cycle of about 100 milliseconds (msec). It is determined that the period in which the value of the masseter potential detection rectification signal B obtained in this way is equal to or greater than a predetermined threshold is a period during which the user performs a hands-free operation (operable period). And only in the operable period, each detection signal of the acceleration sensor 13 and the gyro sensor 14 is used for display control of the glass display 10. Thereby, since the detection result of the movement of the user's head 100 is used for display control in accordance with the user's intention to chew, the display of the glass display 10 based on the user's intention of operation is displayed. Control becomes possible, and the effect of preventing erroneous operation is obtained.

(Step S4) The display control unit 33 compares the value of the input masseter potential detection rectification signal with a threshold value. As a result, if the value of the masseter potential detection rectification signal is greater than or equal to the threshold value, the process proceeds to step S5. If the value of the masseter potential detection rectification signal is less than the threshold value, the process proceeds to step S8.

(Step S <b> 5) Detection signals of the acceleration sensor 13 and the gyro sensor 14 are input from the glass display 10 to the display data generation device 30. Each detection signal is input to the display control unit 33.

(Step S <b> 6) The display control unit 33 reads from the operation content table storage unit 34 the display operation content associated with the input detection signal values of the acceleration sensor 13 and the gyro sensor 14.

(Step S <b> 7) The display control unit 33 outputs a display control signal to the display data generation unit 35 in accordance with the display operation content read from the operation content table storage unit 34. Thereafter, the process returns to step S4. When the value of the masseter potential detection rectification signal is equal to or greater than the threshold value, the display control unit 33 outputs a display control signal based on the detection signal values of the acceleration sensor 13 and the gyro sensor 14. On the other hand, when the value of the masseter potential detection rectification signal is less than the threshold value, the display control signal output is stopped, thereby terminating the display control of the glass display 10.

(Step S <b> 8) When the user turns off the power of the glass display 10 or the display data generation device 30, the process of FIG. 4 ends. If the power of the glass display 10 and the display data generating device 30 is kept on, the process returns to step S2.

  Note that the threshold value for determining the masseter potential may vary depending on the person or the environment. For this reason, it is preferable that the threshold value can be arbitrarily set.

  Example 1 is an example of a hands-free operation according to the present embodiment. By using the acceleration sensor 13 and the gyro sensor 14 of the glass display 10, the movement of the user's head 100 in the three-dimensional space is detected. Specifically, by using the acceleration sensor 13 of the glass display 10, the acceleration / movement amount in three directions (left and right, up and down, front and back) of the user's head 100 is detected. By using the gyro sensor 14 of the glass display 10, the angular velocity / angle of the three axis directions (yawing, pitching, rolling) of the user's head 100 is detected. These detection results enable a variety of hands-free operations.

  FIG. 6 is an explanatory diagram of an example of the hands-free operation according to the first embodiment of the present invention. By using the acceleration sensor 13 of the glass display 10 attached to the user, as shown in FIG. 6, it is possible to detect the movement (left and right, up and down, front and rear) of the user's head 100 in three directions. Further, by using the gyro sensor 14 of the glass display 10, as shown in FIG. 6, the rotation angles (yawing, pitching, rolling) of the three axes of the user's head 100 can be detected. The detected movement of the head 100 and the operation content on the glass display 10 are made to correspond to each other so as to form a natural human interface.

  FIG. 7 is a table diagram illustrating an example of the operation content table 40 stored in the operation content table storage unit 34 according to the first embodiment of the present invention. Hereinafter, the hands-free operation according to the first embodiment will be described with reference to the operation content table 40 of FIG.

(1) Image Display Outside the Display Area In the two-dimensional information image space of the glass display 10, when the image is in the left, right, up, down, or diagonal direction outside the display area 18, the user moves the head 100 left and right in the direction desired to be viewed. It is natural to rotate it vertically or diagonally. Therefore, yawing, pitching, which is the rotation angle of the Y axis which is the vertical direction of the gyro sensor 14, and the rotation angle of the X axis which is the left and right direction, or the rotation angle obtained by combining the two axes is made to correspond to the direction the user wants to see. Thus, the user can quickly display and view images in the left, right, up, down, and diagonal directions.

  Furthermore, when the image is inclined obliquely, the rolling which is the rotation angle of the Z axis in the front-rear direction of the gyro sensor 14 can be detected and used. However, it is not usually necessary to look obliquely, and if the image rolls in response to the detection value of the gyro sensor 14 in a sensitive manner, it may cause video sickness, so that it can be set not to use the detection value of rolling. It is preferable to make it.

  Note that the user does not need to keep the head 100 rotated in the corresponding direction when viewing an image that is left, right, up, down, or diagonally for a long time. That is, if the user stops biting when the image in the desired direction is displayed in the display area 18, the detection value of the gyro sensor 14 is not used, so the head 100 is not rotated and the head 100 is not rotated. It is possible to return to the front and continue to view the desired image in a natural posture.

(2) Scroll (Continuous movement of images)
In the two-dimensional information image space of the glass display 10, when an image is continuously long or spread in the vertical, horizontal, or diagonal directions outside the display area 18, the user has a head in that direction. It is difficult to continue increasing the rotation angle of 100. Therefore, scrolling such as the mouse wheel and the up / down / left / right keys of the keyboard can be performed in any direction. Therefore, in the first embodiment, the user turns the biting operation once (within a predetermined time width) once, and then continues the second biting operation, while rotating the head 100 in the up / down / left / right and diagonal directions. By keeping this, continuous scrolling is possible.

  FIG. 8 is a graph showing examples of masseter potential detection signal A (instantaneous value) and masseter potential detection rectification signal B (rectification value) according to Example 1 of the present invention. In FIG. 8, the masseter potential detection signal A and the masseter potential detection rectification signal B indicate the masseter potential when the user continues to bite after chewing once in a short time. The section B_1 is a waveform when the user bites once for a short time, and is detected when the user exceeds the threshold value within a predetermined time width. The detection time of the interval between the second biting operation can be arbitrarily set in advance, similarly to the setting of the so-called double click speed.

  The speed of scrolling is linked to the magnitude of the rotation angle of the head 100. Scroll faster as the rotation angle increases. The scroll speed may be linearly proportional to the rotation angle, or may be non-linear with the rotation angle.

(3) Page turning Rather than causing the display area 18 to display different images on the left, right, top, and bottom as in the case of image display outside the display area or scrolling, it is possible to turn pages related to the image displayed in the display area 18. For example, when a plurality of pages are continuously overlapped as in a document, the result of left / right / up / down position detection by the acceleration sensor 13 is used. For example, when turning the right page, the user moves the head 100 in parallel to the right. Further, when turning the lower page, the user moves the head 100 upward in parallel.

  Further, when page turning is performed continuously, the user can turn pages one after another in a certain time if the user moves the head 100 left and right and up and down. The page turning speed in this case is linked to the value of the movement amount (movement value) of the user's head 100, and the larger the movement value, the faster the page turning.

(4) Zoom in / zoom out When a person looks closely at an object such as a newspaper, it is natural to move the face closer to the object, and when viewing the entire object, it is natural to move the face away from the object. . Therefore, in order to zoom in / out the image displayed on the glass display 10, the acceleration sensor 13 corresponds to the detection result of the forward / backward movement of the head 100.

(5) Drag Dragging of a window image, an icon or the like performed by a PC operation is enabled on the display area 18 of the glass display 10 by a hands-free operation. In the two-dimensional information image space of the glass display 10, when a window image in the left, right, up, down, or diagonal direction of the display area 18 is moved to an arbitrary position or displayed in an overlapping manner, an operation of pulling the window image is performed. Is natural. Therefore, the user first displays the window image to be dragged in the center of the display area 18 by image display outside the display area, scrolling, or the like. Next, in the state where the user's biting operation is continued, the acceleration sensor 13 displays the image in the center of the display area 18 by corresponding to the detection result of the direction and distance of the head 100 moving in parallel to the left, right, up, down or diagonally. Drag the moved window image.

  In the case of the glass display 10 that can be viewed stereoscopically, in order to enable dragging in the depth direction, it is made to correspond to the detection result of the distance that the acceleration sensor 13 moves in the front-rear direction of the head 100.

(6) Select, execute (click)
It is possible to select (click) a window or a button on the display area 18 of the glass display 10. For example, when there are a plurality of buttons A, B, C,..., When selecting the A button, the user moves the A button in the display area 18 by displaying an image outside the display area, scrolling, or the like. Display in the center. Next, the user's one biting operation corresponds to one click, and the two consecutive biting operations correspond to double clicks. Thereby, one-click and double-click can be realized.

(7) Left and right buttons of a mouse Although a mouse may have left and right buttons, the right and left buttons can be operated. For this purpose, a masseter potential sensor 12 is provided on each of the left and right temples 16 of the glass display 10. Thus, the left biting operation and the right biting operation by the user are distinguished and detected, the difference in the magnitude of the left and right masseter potentials is discriminated, and the left or right button is operated.

(8) Expression of Yes (positive) / No (negative) / unknown It is possible to answer Yes / No / unknown in a questionnaire or the like. “Yes” corresponds to the detection result of the short time vertical pitching by the gyro sensor 14 as the user's nodding operation. “No” corresponds to the detection result of short-time left and right yawing by the gyro sensor 14 as an operation of shaking the user's head sideways. “Unknown” corresponds to a detection result of a short-time tilting / returning rolling by the gyro sensor 14 as an operation of tilting the user's neck diagonally.

  Example 2 is an application example according to the present embodiment. When the glass display 10 is used as a terminal of an information device, the security lock can be released by a hands-free operation.

  Conventionally, in a smartphone or the like, as a method of releasing a security lock, for example, a user can trace a 3 × 3 9-point connection order on a two-dimensional plane on a touch panel. Therefore, in the second embodiment, as a method of releasing the security lock, the user clicks the above-described first embodiment on the display area 18 of the glass display 10 to obtain 3 × 3 nine points on the two-dimensional plane. Correspond to tracing the order of connection. In this case, the detection result of either the acceleration sensor 13 or the gyro sensor 14 may be used.

  In addition, a cube shape may be newly used as a security lock releasing method. For example, it corresponds to tracing the connection order of 8 points of 2 × 2 × 2 based on the detection result of the moving direction of the head 100 by the acceleration sensor 13. Furthermore, various security locks can be set, for example, by using a detection result of a combination of six rotation directions of three axes by the gyro sensor 14.

  As described above, according to the present embodiment, the detected value of the masseter muscle potential is used to determine that the movement of the head 100 is being performed while the user is biting, as the operating state. Thus, the user's intention to operate can be clearly grasped. Thereby, the effect that prevention of an erroneous operation can be aimed at is acquired.

  Particularly, the act of biting by a person is more dependent on the person's intention than the movement of the line of sight, for example, and is suitable for grasping the intention of the user. In addition, the act of chewing is less burdensome for humans than fixing the line of sight. For this reason, according to the present embodiment, it is possible to realize a hands-free operation with higher accuracy than in the case where a hands-free operation is performed based on the detection result of the line of sight.

  Further, by using the detection results obtained by the acceleration sensor 13 and the gyro sensor 14, the natural movement of the human head 100 can be made compatible with various hands-free operations.

  Further, according to the present embodiment, it is not necessary to make a sound for a hands-free operation, and even if the glass display 10 is attached, it does not look bad and is difficult to use. As a result, the glass display 10 can be used even in environments where there is a need for quietness, such as in libraries, classrooms, trains, buses, etc., and it is easy to use. can get.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.

  For example, as a method of detecting the masseter muscle movement, in addition to the method using the masseter potential sensor 12, a method of optically detecting changes in the epidermis of the face (see Patent Document 3), a change in muscle expansion and contraction is determined by pressure. Examples include a method of detecting with a sensor (see Patent Document 2). However, optical detection methods may cause optical malfunctions due to changes in ambient light, and pressure sensor detection methods must capture the masseter displacement to the extent that pressure is generated. High accuracy such as masseter potential cannot be obtained. For example, masseter potentials also occur when speaking or eating, but they are detected with different intensities and distinctive patterns, so it is possible to use them by using the masseter potential detection values as in the embodiment described above. It is possible to clearly distinguish the display of the intention of operation by the person from the other cases by the characteristics of the masseter muscle potential.

  Further, a computer program for realizing the display system 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed. Here, the “computer system” may include an OS and hardware such as peripheral devices.

  “Computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a DVD (Digital Versatile Disk), and a built-in computer system. A storage device such as a hard disk.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Display system, 10 ... Glass display (glasses type display apparatus), 11 ... Display part, 12 ... Masseter muscle potential sensor, 13 ... Accelerometer, 14 ... Gyro sensor, 15, 31 ... Communication part, 16 ... Temple (vine) , 17 ... rim, 18 ... display area, 32 ... rectification unit, 33 ... display control unit, 34 ... operation content table storage unit, 35 ... display data generation device, 40 ... operation content table, 100 ... head

Claims (12)

It has a motion detector that detects the movement of the muscles of the user's head,
The display is controlled based on the detection result of the motion detection unit.   The glasses-type display device according to claim 1, wherein the movement detection unit detects movement of the masseter muscle.   The glasses-type display device according to claim 2, wherein a masseter potential sensor is provided on the temple of the glasses-type display device. A tilt detector for detecting tilt of the head;
Display is controlled based on the detection result of the tilt detection unit and the detection result of the motion detection unit,
The glasses-type display device according to any one of claims 1 to 3, wherein the glasses-type display device is provided.   5. The glasses-type display device according to claim 4, wherein whether or not the detection result of the tilt detection unit is usable is determined based on the detection result of the motion detection unit. Based on the detection result of the movement of the muscles of the user's head detected by the glasses-type display device provided with a movement detection unit that detects the movement of the muscles of the user's head, the display of the glasses-type display device Do control,
A display control device characterized by that. The glasses-type display device further includes a tilt detection unit that detects the tilt of the head,
Control display of the glasses-type display device based on the detection result of the tilt detection unit and the detection result of the motion detection unit,
The display control apparatus according to claim 6.   The display control apparatus according to claim 7, wherein whether to use the detection result of the tilt detection unit is determined based on the detection result of the motion detection unit.   The display control apparatus according to claim 8, wherein it is determined that the detection result of the tilt detection unit is used in a period in which the detection value of the motion detection unit is equal to or greater than a predetermined threshold.   The display according to any one of claims 7 to 9, wherein when the detection value of the motion detection unit is equal to or greater than a threshold value within a predetermined time width, it is determined that a specific operation is designated. Control device.   A display system comprising the glasses-type display device according to claim 1 and the display control device according to claim 6. On the computer,
Based on the detection result of the movement of the muscles of the user's head detected by the glasses-type display device provided with a movement detection unit that detects the movement of the muscles of the user's head, the display of the glasses-type display device The step of controlling,
A computer program for running.

Images